Disrupting Deepfakes Adversarial Attacks Against Conditional Image Translation Networks and Facial Manipulation Systems. Face modification systems using deep learning have become increasingly powerful and accessible. Given images of a person's face, such systems can generate new images of that same person under different expressions and poses. Some systems can also modify targeted attributes such as hair color or age. This type of manipulated images and video have been coined Deepfakes. In order to prevent a malicious user from generating modified images of a person without their consent we tackle the new problem of generating adversarial attacks against such image translation systems, which disrupt the resulting output image. We call this problem disrupting deepfakes. Most image translation architectures are generative models conditioned on an attribute (e.g. put a smile on this person's face). We are first to propose and successfully apply (1) class transferable adversarial attacks that generalize to different classes, which means that the attacker does not need to have knowledge about the conditioning class, and (2) adversarial training for generative adversarial networks (GANs) as a first step towards robust image translation networks. Finally, in gray box scenarios, blurring can mount a successful defense against disruption. We present a spread spectrum adversarial attack, which evades blur defenses. Our open source code can be found at https github.com natanielruiz disrupting deepfakes.


Linear programming bounds for spherical (k,k) designs. We derive general linear programming bounds for spherical (k,k) designs. This includes lower bounds for the minimum cardinality and lower and upper bounds for minimum and maximum energy, respectively. As applications we obtain a universal bound in sense of Levenshtein for the minimum possible cardinality of a (k,k) design for fixed dimension and k and corresponding optimality result. We also discuss examples and possibilities for attaining the universal bound.


Modeling and simulating the spatial spread of an epidemic through multiscale kinetic transport equations. In this work we propose a novel space dependent multiscale model for the spread of infectious diseases in a two dimensional spatial context on realistic geographical scenarios. The model couples a system of kinetic transport equations describing a population of commuters moving on a large scale (extra urban) with a system of diffusion equations characterizing the non commuting population acting over a small scale (urban). The modeling approach permits to avoid unrealistic effects of traditional diffusion models in epidemiology, like infinite propagation speed on large scales and mass migration dynamics. A construction based on the transport formalism of kinetic theory allows to give a clear model interpretation to the interactions between infected and susceptible in compartmental space dependent models. In addition, in a suitable scaling limit, our approach permits to couple the two populations through a consistent diffusion model acting at the urban scale. A discretization of the system based on finite volumes on unstructured grids, combined with an asymptotic preserving method in time, shows that the model is able to describe correctly the main features of the spatial expansion of an epidemic. An application to the initial spread of COVID 19 is finally presented.


Enhancing the Three Photon Luminesce via the Resonance in Lead Halide Perovskite Metasurfaces. Lead halide perovskites (MAPbX3) have emerged as promising materials for photovoltaic and optoelectronic devices. However, their exceptional nonlinear properties have not been fully exploited in nanophotonics yet. Herein we fabricate MAPbX3 perovskite metasurfaces and explore their internal nonlinear processes. While both of third order harmonic generation (THG) and three photon luminescence are generated, the latter one is less affected by the material loss and has been significantly enhanced by a factor of 60. The corresponding simulation reveals that the improvement is caused by the resonant enhancement of incident laser in perovskite metasurface. Interestingly, such kind of resonance enhanced three photon luminescence holds true for metasurfaces with a small period number of 4, enabling new applications of perovskite metasurface in high resolution nonlinear color nanoprinting and optical encoding. The encoded information "NANO" is visible only when the incident laser is on resonance. The off resonance pumping and the single photon excitation just produce a uniform dark or photoluminescence background.


Laboratory tests for MIR light detection and transport with specialty optical fibres. The FAMU (Fisica degli Atomi Muonici) experiment at the RIKEN RAL pulsed muon facility will measure the proton Zemach radius with high precision, thus contributing to the solution of the so called proton radius puzzle. The situation is now confused and new measurements will help reduce the discrepancy as measured with electrons or muons. To this aim, FAMU will make use of a high intensity pulsed muon beam at RIKEN RAL impinging on a cryogenic hydrogen target and a tunable Mid infrared (MIR) laser emitting at around 6.78 um, to measure the hyperfine (HFS) splitting of the 1S state of muonic hydrogen. The injection of light into the cryogenic target and its monitoring via dedicated MIR sensors is an asset for the experiment. A possible solution is via specialty MIR fibres based on hollow core waveguides or polycrystalline fibres. Two dedicated setups based on pulsed QCL lasers, from Alpes Laser, emitting around 6.78 um have been used to study the fibre attenuation while the high energy laser developed at Elettra Sincrotrone in Trieste has been used to study the damage threshold at high energies. The alignment of MIR laser radiation into an optical cavity presents criticalities due to geometrical constraints. Its control requires the use of small and sensitive detectors. The results obtained with a quantum IR sensor with an integrated circuit for signal processing are reported.


Controllability of periodic bilinear quantum systems on infinite graphs. In this work, we study the controllability of the bilinear Schr "odinger equation on infinite graphs for periodic quantum states. We consider the bilinear Schr "odinger equation i partial t psi Delta psi u(t)B psi in the Hilbert space L 2 p composed by functions defined on an infinite graph mathscr G verifying periodic boundary conditions on the infinite edges. The Laplacian Delta is equipped with specific boundary conditions, B is a bounded symmetric operator and u in L 2((0,T), mathbb R ) with T 0 . We present the well posedness of the system in suitable subspaces of D( Delta 3 2 ) . In such spaces, we study the global exact controllability and we provide examples involving for instance tadpole graphs and star graphs with infinite spokes.


A Fully Integrated Sensing and Control System for High Accuracy Mobile Robotic Building Construction. We present a fully integrated sensing and control system which enables mobile manipulator robots to execute building tasks with millimeter scale accuracy on building construction sites. The approach leverages multi modal sensing capabilities for state estimation, tight integration with digital building models, and integrated trajectory planning and whole body motion control. A novel method for high accuracy localization updates relative to the known building structure is proposed. The approach is implemented on a real platform and tested under realistic construction conditions. We show that the system can achieve sub cm end effector positioning accuracy during fully autonomous operation using solely on board sensing.


Some Remarks on Systems of Equiangular Lines. In this note, we study the maximum number N alpha(d) of a system of equiangular lines in mathbb R d with cosine alpha , where frac 1 alpha is not an odd positive integer. This note is motivated by a remark in a 2018 paper by Balla, Dr " a xler, Keevash and Sudakov.


On block Gaussian sketching for the Kaczmarz method. The Kaczmarz algorithm is one of the most popular methods for solving large scale over determined linear systems due to its simplicity and computational efficiency. This method can be viewed as a special instance of a more general class of sketch and project methods. Recently, a block Gaussian version was proposed that uses a block Gaussian sketch, enjoying the regularization properties of Gaussian sketching, combined with the acceleration of the block variants. Theoretical analysis was only provided for the non block version of the Gaussian sketch method. Here, we provide theoretical guarantees for the block Gaussian Kaczmarz method, proving a number of convergence results showing convergence to the solution exponentially fast in expectation. On the flip side, with this theory and extensive experimental support, we observe that the numerical complexity of each iteration typically makes this method inferior to other iterative projection methods. We highlight only one setting in which it may be advantageous, namely when the regularizing effect is used to reduce variance in the iterates under certain noise models and convergence for some particular matrix constructions.


Asymptotic Enumeration and Distributional Properties of Galled Networks. We show a first order asymptotics result for the number of galled networks with n leaves. This is the first class of phylogenetic networks of it large size for which an asymptotic counting result of such strength can be obtained. In addition, we also find the limiting distribution of the number of reticulation nodes of a galled networks with n leaves chosen uniformly at random. These results are obtained by performing an asymptotic analysis of a recent approach of Gunawan, Rathin, and Zhang (2020) which was devised for the purpose of (exactly) counting galled networks. Moreover, an old result of Bender and Richmond (1984) plays a crucial role in our proofs, too.


Explainability in Graph Neural Networks A Taxonomic Survey. Deep learning methods are achieving ever increasing performance on many artificial intelligence tasks. A major limitation of deep models is that they are not amenable to interpretability. This limitation can be circumvented by developing post hoc techniques to explain the predictions, giving rise to the area of explainability. Recently, explainability of deep models on images and texts has achieved significant progress. In the area of graph data, graph neural networks (GNNs) and their explainability are experiencing rapid developments. However, there is neither a unified treatment of GNN explainability methods, nor a standard benchmark and testbed for evaluations. In this survey, we provide a unified and taxonomic view of current GNN explainability methods. Our unified and taxonomic treatments of this subject shed lights on the commonalities and differences of existing methods and set the stage for further methodological developments. To facilitate evaluations, we generate a set of benchmark graph datasets specifically for GNN explainability. We summarize current datasets and metrics for evaluating GNN explainability. Altogether, this work provides a unified methodological treatment of GNN explainability and a standardized testbed for evaluations.


Verified Self Explaining Computation. Common programming tools, like compilers, debuggers, and IDEs, crucially rely on the ability to analyse program code to reason about its behaviour and properties. There has been a great deal of work on verifying compilers and static analyses, but far less on verifying dynamic analyses such as program slicing. Recently, a new mathematical framework for slicing was introduced in which forward and backward slicing are dual in the sense that they constitute a Galois connection. This paper formalises forward and backward dynamic slicing algorithms for a simple imperative programming language, and formally verifies their duality using the Coq proof assistant.


A Study on Multimodal and Interactive Explanations for Visual Question Answering. Explainability and interpretability of AI models is an essential factor affecting the safety of AI. While various explainable AI (XAI) approaches aim at mitigating the lack of transparency in deep networks, the evidence of the effectiveness of these approaches in improving usability, trust, and understanding of AI systems are still missing. We evaluate multimodal explanations in the setting of a Visual Question Answering (VQA) task, by asking users to predict the response accuracy of a VQA agent with and without explanations. We use between subjects and within subjects experiments to probe explanation effectiveness in terms of improving user prediction accuracy, confidence, and reliance, among other factors. The results indicate that the explanations help improve human prediction accuracy, especially in trials when the VQA system's answer is inaccurate. Furthermore, we introduce active attention, a novel method for evaluating causal attentional effects through intervention by editing attention maps. User explanation ratings are strongly correlated with human prediction accuracy and suggest the efficacy of these explanations in human machine AI collaboration tasks.


A hidden anti jamming method based on deep reinforcement learning. Most of the current anti jamming algorithms for wireless communications only consider how to avoid jamming attacks, but ignore that the communication waveform or frequency action may be obtained by the jammers. Although existing anti jamming methods can guarantee temporary communication effects, the long term performance of these anti jamming methods may be depressed when intelligent jammers are capable of learning from historical communication activities. Aiming at this issue, a hidden anti jamming method based on the idea of reducing the jammer's sense probability is proposed. Firstly, the sensing probability of the jammer is obtained by calculating the correlation between the actions of the jammer and the user. Later, a deep reinforcement learning framework is designed, which aims at not only maximizing the communication throughput but also minimizing the action's correlation between the jammer and the user. Finally, a hidden anti jamming algorithm is proposed, which links the instantaneous return with the communication quality of users and the correlation between users and jammer. The simulation result shows that the proposed algorithm not only avoids being sensed by the jammer but also improves its anti jamming performance compared to the current algorithm that only considers jamming avoidance.


Large Scale Discrete Fourier Transform on TPUs. In this work, we present two parallel algorithms for the large scale discrete Fourier transform (DFT) on Tensor Processing Unit (TPU) clusters. The two parallel algorithms are associated with two formulations of DFT one is based on the Kronecker product, to be specific, dense matrix multiplications between the input data and the Vandermonde matrix, denoted as KDFT in this work the other is based on the famous Cooley Tukey algorithm and phase adjustment, denoted as FFT in this work. Both KDFT and FFT formulations take full advantage of TPU's strength in matrix multiplications. The KDFT formulation allows direct use of nonuniform inputs without additional step. In the two parallel algorithms, the same strategy of data decomposition is applied to the input data. Through the data decomposition, the dense matrix multiplications in KDFT and FFT are kept local within TPU cores, which can be performed completely in parallel. The communication among TPU cores is achieved through the one shuffle scheme in both parallel algorithms, with which sending and receiving data takes place simultaneously between two neighboring cores and along the same direction on the interconnect network. The one shuffle scheme is designed for the interconnect topology of TPU clusters, minimizing the time required by the communication among TPU cores. Both KDFT and FFT are implemented in TensorFlow. The three dimensional complex DFT is performed on an example of dimension 8192 times 8192 times 8192 with a full TPU Pod the run time of KDFT is 12.66 seconds and that of FFT is 8.3 seconds. Scaling analysis is provided to demonstrate the high parallel efficiency of the two DFT implementations on TPUs.


Functional inequalities for marked point processes. In recent years, a number of functional inequalities have been derived for Poisson random measures, with a wide range of applications. In this paper, we prove that such inequalities can be extended to the setting of marked temporal point processes, under mild assumptions on their Papangelou conditional intensity. First, we derive a Poincar 'e inequality. Second, we prove two transportation cost inequalities. The first one refers to functionals of marked point processes with a Papangelou conditional intensity and is new even in the setting of Poisson random measures. The second one refers to the law of marked temporal point processes with a Papangelou conditional intensity, and extends a related inequality which is known to hold on a general Poisson space. Finally, we provide a variational representation of the Laplace transform of functionals of marked point processes with a Papangelou conditional intensity. The proofs make use of an extension of the Clark Ocone formula to marked temporal point processes. Our results are shown to apply to classes of renewal, nonlinear Hawkes and Cox point processes.


A Data Driven Study of Commonsense Knowledge using the ConceptNet Knowledge Base. Acquiring commonsense knowledge and reasoning is recognized as an important frontier in achieving general Artificial Intelligence (AI). Recent research in the Natural Language Processing (NLP) community has demonstrated significant progress in this problem setting. Despite this progress, which is mainly on multiple choice question answering tasks in limited settings, there is still a lack of understanding (especially at scale) of the nature of commonsense knowledge itself. In this paper, we propose and conduct a systematic study to enable a deeper understanding of commonsense knowledge by doing an empirical and structural analysis of the ConceptNet knowledge base. ConceptNet is a freely available knowledge base containing millions of commonsense assertions presented in natural language. Detailed experimental results on three carefully designed research questions, using state of the art unsupervised graph representation learning ('embedding') and clustering techniques, reveal deep substructures in ConceptNet relations, allowing us to make data driven and computational claims about the meaning of phenomena such as 'context' that are traditionally discussed only in qualitative terms. Furthermore, our methodology provides a case study in how to use data science and computational methodologies for understanding the nature of an everyday (yet complex) psychological phenomenon that is an essential feature of human intelligence.


Am I Building a White Box Agent or Interpreting a Black Box Agent?. The rule extraction literature contains the notion of a fidelity accuracy dilemma when building an interpretable model of a black box function, optimising for fidelity is likely to reduce performance on the underlying task, and vice versa. I reassert the relevance of this dilemma for the modern field of explainable artificial intelligence, and highlight how it is compounded when the black box is an agent interacting with a dynamic environment. I then discuss two independent research directions building white box agents and interpreting black box agents which are both coherent and worthy of attention, but must not be conflated by researchers embarking on projects in the domain of agent interpretability.


Optimization with Equality and Inequality Constraints Using Parameter Continuation. We generalize the successive continuation paradigm introduced by Kern 'evez and Doedel 16 for locating locally optimal solutions of constrained optimization problems to the case of simultaneous equality and inequality constraints. The analysis shows that potential optima may be found at the end of a sequence of easily initialized separate stages of continuation, without the need to seed the first stage of continuation with nonzero values for the corresponding Lagrange multipliers. A key enabler of the proposed generalization is the use of complementarity functions to define relaxed complementary conditions, followed by the use of continuation to arrive at the limit required by the Karush Kuhn Tucker theory. As a result, a successful search for optima is found to be possible also from an infeasible initial solution guess. The discussion shows that the proposed paradigm is compatible with the staged construction approach of the COCO software package. This is evidenced by a modified form of the COCO core used to produce the numerical results reported here. These illustrate the efficacy of the continuation approach in locating stationary solutions of an objective function along families of two point boundary value problems and in optimal control problems.


The impact of Use Cases in real world software development projects A systematic mapping study. Objective To identify and classify the positive and negative impacts of using Use Cases in real world settings. Method We conducted a systematic mapping study. The search strategies retrieved a set of 4,431 papers out of which 47 were selected as primary studies. We defined four facets to classify these studies 1) the positive impact (advantages), 2) the negative impact (disadvantages), 3) the industry's domain and 4) the type of research reported. Results Our study identified eight categories of advantages related to the application of Use Cases. The most mentioned were estimation, analysis and automation. These advantages had a heterogeneous distribution along the years. On the other hand, the granularity of the scenarios described in the Use Cases, the lack of a standardized format for specifying requirements, and the lack of appropriate guidelines for analysing them were the most mentioned disadvantages. We identified a variety of industry domains, grouped into seven categories. As we can expect most of the papers report experiences in the Information Technology domain, followed by financials applications. Almost half the papers applied evaluation research, including an empirical validation. Only one third of the analysed papers reported threats to validity, the most mentioned being generalizability (38 ). Conclusions Use Cases have proven to be a useful tool in software development, particularly during the early stages. The positive effects far outweigh the few negative effects reported, although this may be due to the researchers' tendency of not reporting negative results.


CS563 QA A Collection for Evaluating Question Answering Systems. Question Answering (QA) is a challenging topic since it requires tackling the various difficulties of natural language understanding. Since evaluation is important not only for identifying the strong and weak points of the various techniques for QA, but also for facilitating the inception of new methods and techniques, in this paper we present a collection for evaluating QA methods over free text that we have created. Although it is a small collection, it contains cases of increasing difficulty, therefore it has an educational value and it can be used for rapid evaluation of QA systems.


Determinantal Facet Ideals for Smaller Minors. A determinantal facet ideal (DFI) is generated by a subset of the maximal minors of a generic n times m matrix where n leq m indexed by the facets of a simplicial complex Delta . We consider the more general notion of an r DFI, which is generated by a subset of r minors of a generic matrix indexed by the facets of Delta for some 1 leq r leq n . We define and study so called lcm closed and unit interval r DFIs, and show that the minors parametrized by the facets of Delta form a reduced Gr "obner basis with respect to emph any term order for an lcm closed r DFI. We also see that being lcm closed generalizes conditions previously introduced in the literature, and conjecture that in the case r n , lcm closedness is necessary for being a Gr "obner basis. We also give conditions on the maximal cliques of Delta ensuring that lcm closed and unit interval r DFIs are Cohen Macaulay. Finally, we conclude with a variant of a conjecture of Ene, Herzog, and Hibi on the Betti numbers of certain types of r DFIs, and provide a proof of this conjecture for Cohen Macaulay unit interval DFIs.


On the existence of four or more curved foldings with common creases and crease patterns. Consider an oriented curve Gamma in a domain D in the plane boldsymbol R 2 . Thinking of D as a piece of paper, one can make a curved folding in the Euclidean space boldsymbol R 3 . This can be expressed as the image of an "origami map" Phi D to boldsymbol R 3 such that Gamma is the singular set of Phi , the word "origami" coming from the Japanese term for paper folding. We call the singular set image C Phi( Gamma) the crease of Phi and the singular set Gamma the crease pattern of Phi . We are interested in the number of origami maps whose creases and crease patterns are C and Gamma , respectively. Two such possibilities have been known. In the authors' previous work, two other new possibilities and an explicit example with four such non congruent distinct curved foldings were established. In this paper, we determine the possibility of the number N of congruence classes of curved foldings with the same crease and crease pattern. As a consequence, if C is a non closed simple arc, then N 4 if and only if both Gamma and C do not admit any symmetries. On the other hand, when C is a closed curve, there are infinitely many distinct possibilities for curved foldings with the same crease and crease pattern, in general.


A short note on the decision tree based neural turing machine. Turing machine and decision tree have developed independently for a long time. With the recent development of differentiable models, there is an intersection between them. Neural turing machine(NTM) opens door for the memory network. It use differentiable attention mechanism to read write external memory bank. Differentiable forest brings differentiable properties to classical decision tree. In this short note, we show the deep connection between these two models. That is differentiable forest is a special case of NTM. Differentiable forest is actually decision tree based neural turing machine. Based on this deep connection, we propose a response augmented differential forest (RaDF). The controller of RaDF is differentiable forest, the external memory of RaDF are response vectors which would be read write by leaf nodes.


A Multilingual View of Unsupervised Machine Translation. We present a probabilistic framework for multilingual neural machine translation that encompasses supervised and unsupervised setups, focusing on unsupervised translation. In addition to studying the vanilla case where there is only monolingual data available, we propose a novel setup where one language in the (source, target) pair is not associated with any parallel data, but there may exist auxiliary parallel data that contains the other. This auxiliary data can naturally be utilized in our probabilistic framework via a novel cross translation loss term. Empirically, we show that our approach results in higher BLEU scores over state of the art unsupervised models on the WMT'14 English French, WMT'16 English German, and WMT'16 English Romanian datasets in most directions. In particular, we obtain a 1.65 BLEU advantage over the best performing unsupervised model in the Romanian English direction.


Improved Dynamic Algorithms for Longest Increasing Subsequence. We study dynamic algorithms for the longest increasing subsequence ( textsf LIS ) problem. A dynamic textsf LIS algorithm maintains a sequence subject to operations of the following form arriving one by one (i) insert an element, (ii) delete an element, or (iii) substitute an element for another. After performing each operation, the algorithm must report the length of the longest increasing subsequence of the current sequence. Our main contribution is the first exact dynamic textsf LIS algorithm with sublinear update time. More precisely, we present a randomized algorithm that performs each operation in time tilde O(n 2 3 ) and after each update, reports the answer to the textsf LIS problem correctly with high probability. We use several novel techniques and observations for this algorithm that may find their applications in future work. In the second part of the paper, we study approximate dynamic textsf LIS algorithms, which are allowed to underestimate the solution size within a bounded multiplicative factor. In this setting, we give a deterministic algorithm with update time O(n o(1) ) and approximation factor 1 o(1) . This result substantially improves upon the previous work of Mitzenmacher and Seddighin (STOC'20) that presents an Omega( epsilon O(1 epsilon) ) approximation algorithm with update time tilde O(n epsilon) for any constant epsilon 0 .


A Primal Dual Smoothing Framework for Max Structured Nonconvex Optimization. We propose a primal dual first order smoothing framework for solving a class of nonsmooth nonconvex optimization problems with max structure. We analyze the primal and dual oracle complexities of the framework via two approaches, i.e., the dual then primal and primal the dual smoothing approaches. Our framework improves the best known oracle complexities of the existing methods, even in the restricted problem setting. As the cornerstone of our framework, we propose a conceptually simple primal dual method for solving a class of convex concave saddle point problems with primal strong convexity, which is based on a newly developed non Hilbertian inexact accelerated proximal gradient algorithm. This primal dual method has a dual oracle complexity that is significantly better than the previous ones, and a primal oracle complexity that matches the best known, up to logarithmic factor. Finally, we extend our framework to the stochastic case, and demonstrate that the oracle complexities of this extension indeed match the state of the art.


Asymptotic expansion of Mathieu power series and trigonometric Mathieu series. We consider a generalized Mathieu series where the summands of the classical Mathieu series are multiplied by powers of a complex number. The Mellin transform of this series can be expressed by the polylogarithm or the Hurwitz zeta function. From this we derive a full asymptotic expansion, generalizing known expansions for alternating Mathieu series. Another asymptotic regime for trigonometric Mathieu series is also considered, to first order, by applying known results on the asymptotic behavior of trigonometric series.


Nonzero positive solutions of fractional Laplacian systems with functional terms. We study the existence of non zero positive solutions of a class of systems of differential equations driven by fractional powers of the Laplacian. Our approach is based on the notion of fixed point index, and allows us to deal with non local functional weights and functional boundary conditions. We present two examples to shed light on the type of functionals and growth conditions that can be considered with our approach.


Learning Machines from Simulation to Real World. Learning Machines is developing a flexible, cross industry, advanced analytics platform, targeted during stealth stage at a limited number of specific vertical applications. In this paper, we aim to integrate a general machine system to learn a variant of tasks from simulation to real world. In such a machine system, it involves real time robot vision, sensor fusion, and learning algorithms (reinforcement learning). To this end, we demonstrate the general machine system on three fundamental tasks including obstacle avoidance, foraging, and predator prey robot. The proposed solutions are implemented on Robobo robots with mobile device (smartphone with camera) as interface and built in infrared (IR) sensors. The agent is trained in a virtual environment. In order to assess its performance, the learned agent is tested in the virtual environment and reproduce the same results in a real environment. The results show that the reinforcement learning algorithm can be reliably used for a variety of tasks in unknown environments.


Writing Polishment with Simile Task, Dataset and A Neural Approach. A simile is a figure of speech that directly makes a comparison, showing similarities between two different things, e.g. "Reading papers can be dull sometimes,like watching grass grow". Human writers often interpolate appropriate similes into proper locations of the plain text to vivify their writings. However, none of existing work has explored neural simile interpolation, including both locating and generation. In this paper, we propose a new task of Writing Polishment with Simile (WPS) to investigate whether machines are able to polish texts with similes as we human do. Accordingly, we design a two staged Locate Gen model based on transformer architecture. Our model firstly locates where the simile interpolation should happen, and then generates a location specific simile. We also release a large scale Chinese Simile (CS) dataset containing 5 million similes with context. The experimental results demonstrate the feasibility of WPS task and shed light on the future research directions towards better automatic text polishment.


The Nusselt numbers of horizontal convection. We consider the problem of horizontal convection in which non uniform buoyancy, b rm s (x,y) , is imposed on the top surface of a container and all other surfaces are insulating. Horizontal convection produces a net horizontal flux of buoyancy, mathbf J , defined by vertically and temporally averaging the interior horizontal flux of buoyancy. We show that overline mathbf J cdot mathbf nabla b rm s kappa langle boldsymbol nabla b 2 rangle overbar denotes a space time average over the top surface, angle brackets denote a volume time average and kappa is the molecular diffusivity of buoyancy b . This connection between mathbf J and kappa langle boldsymbol nabla b 2 rangle justifies the definition of the horizontal convective Nusselt number, Nu , as the ratio of kappa langle boldsymbol nabla b 2 rangle to the corresponding quantity produced by molecular diffusion alone. We discuss the advantages of this definition of Nu over other definitions of horizontal convective Nusselt number currently in use. We investigate transient effects and show that kappa langle boldsymbol nabla b 2 rangle equilibrates more rapidly than other global averages, such as the domain averaged kinetic energy and bottom buoyancy. We show that kappa langle boldsymbol nabla b 2 rangle is essentially the volume averaged rate of Boussinesq entropy production within the enclosure. In statistical steady state, the interior entropy production is balanced by a flux of entropy through the top surface. This leads to an equivalent "surface Nusselt number", defined as the surface average of vertical buoyancy flux through the top surface times the imposed surface buoyancy b rm s (x,y) . In experiments it is likely easier to evaluate the surface entropy flux, rather than the volume integral of mathbf nabla b 2 demanded by kappa langle mathbf nabla b 2 rangle .


Learning to combine Grammatical Error Corrections. The field of Grammatical Error Correction (GEC) has produced various systems to deal with focused phenomena or general text editing. We propose an automatic way to combine black box systems. Our method automatically detects the strength of a system or the combination of several systems per error type, improving precision and recall while optimizing F score directly. We show consistent improvement over the best standalone system in all the configurations tested. This approach also outperforms average ensembling of different RNN models with random initializations. In addition, we analyze the use of BERT for GEC reporting promising results on this end. We also present a spellchecker created for this task which outperforms standard spellcheckers tested on the task of spellchecking. This paper describes a system submission to Building Educational Applications 2019 Shared Task Grammatical Error Correction. Combining the output of top BEA 2019 shared task systems using our approach, currently holds the highest reported score in the open phase of the BEA 2019 shared task, improving F0.5 by 3.7 points over the best result reported.


Varieties of Bounded K lattices. In this paper we continue to study varieties of K lattices, focusing on their bounded versions. These (bounded) commutative residuated lattices arise from a specific kind of construction the em twist product of a lattice. Twist products were first considered by Kalman in 1958 to deal with order involutions on plain lattices, but the extension of this concept to residuated lattices has attracted some attention lately.


Planar lattice subsets with minimal vertex boundary. A subset of vertices of a graph is minimal if, within all subsets of the same size, its vertex boundary is minimal. We give a complete, geometric characterization of minimal sets for the planar integer lattice X. Our characterization elucidates the structure of all minimal sets, and we are able to use it to obtain several applications. We characterize uniquely minimal sets of X those which are congruent to any other minimal set of the same size. We also classify all efficient sets of X those that have maximal size amongst all such sets with a fixed vertex boundary. We define and investigate the graph G of minimal sets whose vertices are congruence classes of minimal sets of X and whose edges connect vertices which can be represented by minimal sets that differ by exactly one vertex. We prove that G has exactly one infinite component, has infinitely many isolated vertices and has bounded components of arbitrarily large size. Finally, we show that all minimal sets, except one, are connected.


physics.comp-ph cs.CL cs.PF physics.ao-ph

Scaling through abstractions high performance vectorial wave simulations for seismic inversion with Devito. Devito is an open source Python project based on domain specific language and compiler technology. Driven by the requirements of rapid HPC applications development in exploration seismology, the language and compiler have evolved significantly since inception. Sophisticated boundary conditions, tensor contractions, sparse operations and features such as staggered grids and sub domains are all supported operators of essentially arbitrary complexity can be generated. To accommodate this flexibility whilst ensuring performance, data dependency analysis is utilized to schedule loops and detect computational properties such as parallelism. In this article, the generation and simulation of MPI parallel propagators (along with their adjoints) for the pseudo acoustic wave equation in tilted transverse isotropic media and the elastic wave equation are presented. Simulations are carried out on industry scale synthetic models in a HPC Cloud system and reach a performance of 28TFLOP s, hence demonstrating Devito's suitability for production grade seismic inversion problems.


Neutral surface topology. Neutral surfaces, along which most of the mixing in the ocean occurs, are notoriously difficult objects they do not exist as well defined surfaces, and as such can only be approximated. In a hypothetical ocean where neutral surfaces are well defined, the in situ density on the surface is a multivalued function of the pressure on the surface, underset sim p . The surface is decomposed into geographic regions where there is one connected pressure contour per pressure value, making this function single valued in each region. The regions are represented by arcs of the Reeb graph of underset sim p . The regions meet at saddles of underset sim p which are represented by internal nodes of the Reeb graph. Leaf nodes represent extrema of underset sim p . Cycles in the Reeb graph are created by islands and other holes in the neutral surface. This topological theory of neutral surfaces is used to create a new class of approximately neutral surfaces in the real ocean, called topobaric surfaces, which are very close to neutral and fast to compute. Topobaric surfaces are the topologically correct extension of orthobaric density surfaces to be geographically dependent, which is fundamental to neutral surfaces. Also considered is the possibility that helical neutral trajectories might have a larger pitch around islands than in the open ocean.


Asymptotic stability of homogeneous solutions of incompressible stationary Navier Stokes equations. It was proved by Karch and Pilarzyc that Landau solutions are asymptotically stable under any L 2 perturbation. In our earlier work with L. Li, we have classified all ( 1) homogeneous axisymmetric no swirl solutions of incompressible stationary Navier Stokes equations in three dimension which are smooth on the unit sphere minus the south and north poles. In this paper, we study the asymptotic stability of the least singular solutions among these solutions other than Landau solutions, and prove that such solutions are asymptotically stable under any L 2 perturbation.


Shape turnpike for linear parabolic PDE models. We introduce and study the turnpike property for time varying shapes, within the viewpoint of optimal control. We focus here on second order linear parabolic equations where the shape acts as a source term and we seek the optimal time varying shape that minimizes a quadratic criterion. We first establish existence of optimal solutions under some appropriate sufficient conditions. We then provide necessary conditions for optimality in terms of adjoint equations and, using the concept of strict dissipativity, we prove that state and adjoint satisfy the measure turnpike property, meaning that the extremal time varying solution remains essentially close to the optimal solution of an associated static problem. We show that the optimal shape enjoys the exponential turnpike property in term of Hausdorff distance for a Mayer quadratic cost. We illustrate the turnpike phenomenon in optimal shape design with several numerical simulations.


Characterizing Jacobians via the KP equation and via flexes and degenerate trisecants to the Kummer variety an algebro geometric approach. We give completely algebro geometric proofs of a theorem by T. Shiota, and of a theorem by I. Krichever, characterizing Jacobians of algebraic curves among all irreducible principally polarized abelian varieties. Shiota's characterization is given in terms of the KP equation. Krichever's characterization is given in terms of trisecant lines to the Kummer variety. Here we treat the case of flexes and degenerate trisecants. The basic tool we use is a theorem we prove asserting that the base locus of the linear system associated to an effective line bundle on an abelian variety is reduced. This result allows us to remove all the extra assumptions that were introduced in the theorems by the first author, C. De Concini, G.Marini, and O. Debarre, in order to achieve algebro geometric proofs of the results above.


Ontology alignment A Content Based Bayesian Approach. There are many legacy databases, and related stores of information that are maintained by distinct organizations, and there are other organizations that would like to be able to access and use those disparate sources. Among the examples of current interest are such things as emergency room records, of interest in tracking and interdicting illicit drugs, or social media public posts that indicate preparation and intention for a mass shooting incident. In most cases, this information is discovered too late to be useful. While agencies responsible for coordination are aware of the potential value of contemporaneous access to new data, the costs of establishing a connection are prohibitive. The problem grown even worse with the proliferation of hash tagging,'' which permits new labels and ontological relations to spring up overnight. While research interest has waned, the need for powerful and inexpensive tools enabling prompt access to multiple sources has grown ever more pressing. This paper describes techniques for computing alignment matrix coefficients, which relate the fields or content of one database to those of another, using the Bayesian Ontology Alignment tool (BOA). Particular attention is given to formulas that have an easy to understand meaning when all cells of the data sources containing values from some small set. These formulas can be expressed in terms of probability estimates. The estimates themselves are given by a black box'' polytomous logistic regression model (PLRM), and thus can be easily generalized to the case of any arbitrary probability generating model. The specific PLRM model used in this example is the BOXER Bayesian Extensible Online Regression model.


Impact of micro scale stochastic Zonal Flows on the macro scale V RMHD modes. A model is developed to simulate micro scale turbulence driven ZFs, and their impact on the MHD tearing and kink modes is examined. The model is based on a stochastic representation of the micro scale ZFs with a given Alfv ' e n Mach number, M S. Two approaches were explored i) passive stochastic model where the ZFs amplitudes are independent of the MHD mode amplitude, and ii) the semi stochastic model where the amplitudes of the ZFs have a dependence on the amplitude of the MHD mode itself. The results show that the stochastic ZFs can significantly stabilise the (2,1) and (1,1) MHD modes even at very low kinematic viscosity, Pr, where the mode is linearly unstable. Our results, therefore indicate a possible mechanism for stabilisation of the MHD modes via small scale perturbations in poloidal flow, simulating the turbulence driven ZFs.


Contractible, hyperbolic but non CAT(0) complexes. We prove that almost all arc complexes do not admit a CAT(0) metric with finitely many shapes, in particular any finite index subgroup of the mapping class group does not preserve such a metric on the arc complex. We also show the analogous statement for all but finitely many disc complexes of handlebodies and free splitting complexes of free groups. The obstruction is combinatorial. These complexes are all hyperbolic and contractible but despite this we show that they satisfy no combinatorial isoperimetric inequality for any n there is a loop of length 4 that only bounds discs consisting of at least n triangles. On the other hand we show that the curve complexes satisfy a linear combinatorial isoperimetric inequality, which answers a question of Andrew Putman.


A Riemanian Approach to Blob Detection in Manifold Valued Images. This paper is devoted to the problem of blob detection in manifold valued images. Our solution is based on new definitions of blob response functions. We define the blob response functions by means of curvatures of an image graph, considered as a submanifold. We call the proposed framework Riemannian blob detection. We prove that our approach can be viewed as a generalization of the grayscale blob detection technique. An expression of the Riemannian blob response functions through the image Hessian is derived. We provide experiments for the case of vector valued images on 2D surfaces the proposed framework is tested on the task of chemical compounds classification.


On the Order Type of Scattered Context Free Orderings. We show that if a context free grammar generates a language whose lexicographic ordering is well ordered of type less than omega 2 , then its order type is effectively computable.


Particle capture by drops in turbulent flow. We examine the process of particle capture by large deformable drops in turbulent channel flow. We simulate the solid liquid liquid three phase flow with an Eulerian Lagrangian method based on Direct Numerical Simulation of turbulence coupled with a Phase Field Model, to capture the interface dynamics, and Lagrangian tracking of small (sub Kolmogorov) particles. Drops have same density and viscosity of the carrier liquid, and neutrally buoyant solid particles are one way coupled with the other phases. Our results show that particles are transported towards the interface by jet like turbulent motions and, once close enough, are captured by interfacial forces in regions of positive surface velocity divergence. These regions appear to be well correlated with high enstrophy flow topologies that contribute to enstrophy production via vortex compression or stretching. Examining the turbulent mechanisms that bring particles to the interface, we have been able to derive a simple mechanistic model for particle capture. The model can predict the overall capture efficiency and is based on a single turbulent transport equation in which the only parameter scales with the turbulent kinetic energy of the fluid measured in the vicinity of the drop interface. The model is valid in the limit of non interacting particles and its predictions agree remarkably well with numerical results.


Characterization of Sobolev spaces on the sphere. We prove a characterization of the Sobolev spaces H alpha on the unit sphere mathbb S d 1 , where the smoothness index alpha is any positive real number and d geq 2 . This characterization does not use differentiation and it is given in terms of ( alpha 2 1) multidimensional square functions S alpha . For alpha 2 0, a function f in L 2( mathbb S d 1 ) belongs to H alpha( mathbb S d 1 ) if and only if S alpha (f) in L 2( mathbb S d 1 ) . If n alpha 2 0 , the membership of f is equivalent to the existence of g 1, cdots,g n in L 2( mathbb S d 1 ) such that S alpha(f,g 1, ldots,g n) in L 2( mathbb S d 1 ) and in this case, g j T j(( Delta S) j f) , where T j is a zonal Fourier multiplier in the sphere and Delta S is the Laplace Beltrami operator. The square functions S alpha are based on averaging operators over euclidean balls (caps) in the sphere that may be viewed as zonal multipliers. The results in the paper are in the spirit of the characterization of fractional Sobolev spaces given in mathbb R d proved in cite AMV . The development of the theory is fully based on zonal Fourier multipliers and special functions.


A Generalized Probabilistic Learning Approach for Multi Fidelity Uncertainty Propagation in Complex Physical Simulations. Two of the most significant challenges in uncertainty propagation pertain to the high computational cost for the simulation of complex physical models and the high dimension of the random inputs. In applications of practical interest both of these problems are encountered and standard methods for uncertainty quantification either fail or are not feasible. To overcome the current limitations, we propose a probabilistic multi fidelity framework that can exploit lower fidelity model versions of the original problem in a small data regime. The approach circumvents the curse of dimensionality by learning dependencies between the outputs of high fidelity models and lower fidelity models instead of explicitly accounting for the high dimensional inputs. We complement the information provided by a low fidelity model with a low dimensional set of informative features of the stochastic input, which are discovered by employing a combination of supervised and unsupervised dimensionality reduction techniques. The goal of our analysis is an efficient and accurate estimation of the full probabilistic response for a high fidelity model. Despite the incomplete and noisy information that low fidelity predictors provide, we demonstrate that accurate and certifiable estimates for the quantities of interest can be obtained in the small data regime, i.e., with significantly fewer high fidelity model runs than state of the art methods for uncertainty propagation. We illustrate our approach by applying it to challenging numerical examples such as Navier Stokes flow simulations and monolithic fluid structure interaction problems.


Convergence Analysis of Extended LOBPCG for Computing Extreme Eigenvalues. This paper is concerned with the convergence analysis of an extended variation of the locally optimal preconditioned conjugate gradient method (LOBPCG) for the extreme eigenvalue of a Hermitian matrix polynomial which admits some extended form of Rayleigh quotient. This work is a generalization of the analysis by Ovtchinnikov (SIAM J. Numer. Anal., 46(5) 2567 2592, 2008). As instances, the algorithms for definite matrix pairs and hyperbolic quadratic matrix polynomials are shown to be globally convergent and to have an asymptotically local convergence rate. Also, numerical examples are given to illustrate the convergence.


DeepVar An End to End Deep Learning Approach for Genomic Variant Recognition in Biomedical Literature. We consider the problem of Named Entity Recognition (NER) on biomedical scientific literature, and more specifically the genomic variants recognition in this work. Significant success has been achieved for NER on canonical tasks in recent years where large data sets are generally available. However, it remains a challenging problem on many domain specific areas, especially the domains where only small gold annotations can be obtained. In addition, genomic variant entities exhibit diverse linguistic heterogeneity, differing much from those that have been characterized in existing canonical NER tasks. The state of the art machine learning approaches in such tasks heavily rely on arduous feature engineering to characterize those unique patterns. In this work, we present the first successful end to end deep learning approach to bridge the gap between generic NER algorithms and low resource applications through genomic variants recognition. Our proposed model can result in promising performance without any hand crafted features or post processing rules. Our extensive experiments and results may shed light on other similar low resource NER applications.


StereoDRNet Dilated Residual Stereo Net. We propose a system that uses a convolution neural network (CNN) to estimate depth from a stereo pair followed by volumetric fusion of the predicted depth maps to produce a 3D reconstruction of a scene. Our proposed depth refinement architecture, predicts view consistent disparity and occlusion maps that helps the fusion system to produce geometrically consistent reconstructions. We utilize 3D dilated convolutions in our proposed cost filtering network that yields better filtering while almost halving the computational cost in comparison to state of the art cost filtering architectures.For feature extraction we use the Vortex Pooling architecture. The proposed method achieves state of the art results in KITTI 2012, KITTI 2015 and ETH 3D stereo benchmarks. Finally, we demonstrate that our system is able to produce high fidelity 3D scene reconstructions that outperforms the state of the art stereo system.


Computing isolated coefficients of the j function. We consider the problem of efficiently computing isolated coefficients c n in the Fourier series of the elliptic modular function j( tau) . We show that a hybrid numerical modular method with complexity n 1 o(1) is efficient in practice. As an application, we locate the first few values of c n that are prime, the first occurring at n 457871 .


How many can you infect? Simple (and naive) methods of estimating the reproduction number. This is a pedagogical paper on estimating the number of people that can be infected by one infectious person during an epidemic outbreak, known as the reproduction number. Knowing the number is crucial for developing policy responses. There are generally two types of such a number, i.e., basic and effective (or instantaneous). While basic reproduction number is the average expected number of cases directly generated by one case in a population where all individuals are susceptible, effective reproduction number is the number of cases generated in the current state of a population. In this paper, we exploit the deterministic susceptible infected removed (SIR) model to estimate them through three different numerical approximations. We apply the methods to the pandemic COVID 19 in Italy to provide insights into the spread of the disease in the country. We see that the effect of the national lockdown in slowing down the disease exponential growth appeared about two weeks after the implementation date. We also discuss available improvements to the simple (and naive) methods that have been made by researchers in the field. Authors of this paper are members of the SimcovID (Simulasi dan Pemodelan COVID 19 Indonesia) collaboration.


A Matching Mechanism with Anticipatory Tolls for Congestion Pricing. This paper presents a matching mechanism for assigning drivers to routes where the drivers pay a toll for the marginal delay they impose on other drivers. The simple matching mechanism is derived from the RANKING algorithm for online bipartite matching proposed by Karp et al. 8 . The toll, which is anticipatory in design, is an adaption of one proposed by Dong et al. 5 . Our research proves that the matching mechanism proposed here is pareto user optimal and can be adapted to give network optimal results for the minimizing total social cost of travel.


Analytic stability boundaries for compressional and global Alfv 'en eigenmodes driven by fast ions. I. Interaction via ordinary and anomalous cyclotron resonances. Conditions for net fast ion drive are derived for beam driven, sub cyclotron compressional (CAE) and global (GAE) Alfv 'en eigenmodes, such as those routinely observed in spherical tokamaks such as NSTX( U) and MAST. Both co and counter propagating CAEs and GAEs are investigated, driven by the ordinary and anomalous Doppler shifted cyclotron resonance with fast ions. Whereas prior results were restricted to vanishingly narrow distributions in velocity space, broad parameter regimes are identified in this work which enable an analytic treatment for realistic fast ion distributions generated by neutral beam injection. The simple, approximate conditions derived in these regimes for beam distributions of realistic width compare well to the numerical evaluation of the full analytic expressions for fast ion drive. Moreover, previous results in the very narrow beam case are corrected and generalized to retain all terms in omega omega ci and k parallel k perp , which are often assumed to be small parameters but can significantly modify the conditions of drive and damping when they are non negligible. Favorable agreement is demonstrated between the approximate stability criterion, simulation results, and a large database of NSTX observations of cntr GAEs.


Home, SafeHome Smart Home Reliability with Visibility and Atomicity. Smart environments (homes, factories, hospitals, buildings) contain an increasing number of IoT devices, making them complex to manage. Today, in smart homes where users or triggers initiate routines (i.e., a sequence of commands), concurrent routines and device failures can cause incongruent outcomes. We describe SafeHome, a system that provides notions of atomicity and serial equivalence for smart homes. Due to the human facing nature of smart homes, SafeHome offers a spectrum of it visibility models which trade off between responsiveness vs. incongruence of the smart home state. We implemented SafeHome and performed workload driven experiments. We find that a weak visibility model, called it eventual visibility , is almost as fast as today's status quo (up to 23 slower) and yet guarantees serially equivalent end states.


Using math in physics 5. Functional dependence. When students are learning to use math in physics, one of the most important ideas they need to learn is that equations are not just calculational tools they represent relationships between physical variables that change together (covary). How much a change in one variable or parameter is associated with a change in another depends on how they appear in the equation their functional dependence. Understanding this sort of relationship is rarely taught in introductory mathematics classes, and students who have not yet learned to blend conceptual ideas with mathematical symbols may not see the relevance and power of this idea. We need to explicitly teach functional dependence as part of our effort to help students to learn to use math productively in science.


On Existence and Regularity for a Cahn Hilliard Variational Model for Lithium Ion Batteries. The Cahn Hilliard reaction model, a nonlinear, evolutionary system of PDEs, was introduced to model phase separation in lithium ion batteries. Using Butler Volmer kinetics for electrochemical consistency, this model incorporates a nonlinear Neumann boundary condition partial nu mu R(c, mu) for the chemical potential mu , with c , the lithium ion density. Importantly, R depends exponentially on mu . In arbitrary dimension, existence of a weak solution for the Cahn Hilliard reaction model with elasticity is proven using a generalized gradient structure. This approach is, at present, restricted to polynomial growth in R . Working to remove this limitation, fixed point methods are applied to obtain existence of strong solutions of the Cahn Hilliard reaction model without elasticity in dimensions 2 and 3. This method is then extended to prove existence of higher regularity solutions in dimension 2 , allowing for recovery of exponential boundary conditions as in the physical application to lithium ion batteries.


The quantum disk is not a quantum group. We show that the quantum disk, i.e. the quantum space corresponding to the Toeplitz C algebra does not admit any compact quantum group structure. We prove that if such a structure existed the resulting compact quantum group would simultaneously be of Kac type and not of Kac type. The main tools used in the solution come from the theory of type I locally compact quantum groups, but also from the theory of operators on Hilbert spaces.


The NVIDIA PilotNet Experiments. Four years ago, an experimental system known as PilotNet became the first NVIDIA system to steer an autonomous car along a roadway. This system represents a departure from the classical approach for self driving in which the process is manually decomposed into a series of modules, each performing a different task. In PilotNet, on the other hand, a single deep neural network (DNN) takes pixels as input and produces a desired vehicle trajectory as output there are no distinct internal modules connected by human designed interfaces. We believe that handcrafted interfaces ultimately limit performance by restricting information flow through the system and that a learned approach, in combination with other artificial intelligence systems that add redundancy, will lead to better overall performing systems. We continue to conduct research toward that goal. This document describes the PilotNet lane keeping effort, carried out over the past five years by our NVIDIA PilotNet group in Holmdel, New Jersey. Here we present a snapshot of system status in mid 2020 and highlight some of the work done by the PilotNet group.


Open Multiparty Sessions. Multiparty sessions are systems of concurrent processes, which allow several participants to communicate by sending and receiving messages. Their overall behaviour can be described by means of global types. Typable multiparty session enjoy lock freedom. We look at multiparty sessions as open systems by a suitable definition of connection transforming compatible processes into gateways (forwarders). A relation resembling the standard subtyping relation for session types is used to formalise compatibility. We show that the session obtained by connection can be typed by manipulating the global types of the starting sessions. This allows us to prove that lock freedom is preserved by connection.


Adaptive Convolution Kernel for Artificial Neural Networks. Many deep neural networks are built by using stacked convolutional layers of fixed and single size (often 3 times 3) kernels. This paper describes a method for training the size of convolutional kernels to provide varying size kernels in a single layer. The method utilizes a differentiable, and therefore backpropagation trainable Gaussian envelope which can grow or shrink in a base grid. Our experiments compared the proposed adaptive layers to ordinary convolution layers in a simple two layer network, a deeper residual network, and a U Net architecture. The results in the popular image classification datasets such as MNIST, MNIST CLUTTERED, CIFAR 10, Fashion, and Faces in the Wild'' showed that the adaptive kernels can provide statistically significant improvements on ordinary convolution kernels. A segmentation experiment in the Oxford Pets dataset demonstrated that replacing a single ordinary convolution layer in a U shaped network with a single 7 times 7 adaptive layer can improve its learning performance and ability to generalize.


On Relative Ranks of the Semigroup of Orientation preserving Transformations on Infinite Chains. In this paper, we determine the relative rank of the semigroup OP(X) of all orientation preserving transformations on infinite chains modulo the semigroup O(X) of all order preserving transformations.


Strong approximation of time changed stochastic differential equations involving drifts with random and non random integrators. The rates of strong convergence for various approximation schemes are investigated for a class of stochastic differential equations (SDEs) which involve a random time change given by an inverse subordinator. SDEs to be considered are unique in two different aspects i) they contain two drift terms, one driven by the random time change and the other driven by a regular, non random time variable ii) the standard Lipschitz assumption is replaced by that with a time varying Lipschitz bound. The difficulty imposed by the first aspect is overcome via an approach that is significantly different from a well known method based on the so called duality principle. On the other hand, the second aspect requires the establishment of a criterion for the existence of exponential moments of functions of the random time change.


A Survey on Text Simplification. Text Simplification (TS) aims to reduce the linguistic complexity of content to make it easier to understand. Research in TS has been of keen interest, especially as approaches to TS have shifted from manual, hand crafted rules to automated simplification. This survey seeks to provide a comprehensive overview of TS, including a brief description of earlier approaches used, discussion of various aspects of simplification (lexical, semantic and syntactic), and latest techniques being utilized in the field. We note that the research in the field has clearly shifted towards utilizing deep learning techniques to perform TS, with a specific focus on developing solutions to combat the lack of data available for simplification. We also include a discussion of datasets and evaluations metrics commonly used, along with discussion of related fields within Natural Language Processing (NLP), like semantic similarity.


Spectral convergence in geometric quantization on K3 surfaces. We study the geometric quantization on K3 surfaces from the viewpoint of the spectral convergence. We take a special Lagrangian fibrations on the K3 surfaces and a family of hyper K "ahler structures tending to large complex structure limit, and show a spectral convergence of the bar partial Laplacians on the prequantum line bundle to the spectral structure related to the set of Bohr Sommerfeld fibers.


On bodies floating in equilibrium in every orientation. Ulam's problem 19 from the Scottish Book asks it is a solid of uniform density which floats in water in every position necessarily a sphere? We obtain several results related to this problem.


Noise induced unanimity and disorder in opinion formation. We propose an opinion dynamics model based on Latan 'e's social impact theory. Actors in this model are heterogeneous and, in addition to opinions, are characterised by their varying levels of persuasion and support. The model is tested for two and three initial opinions randomly distributed among actors. We examine how the noise (randomness of behaviour) and the flow of information among actors affect the formation and spread of opinions. Our main research involves the process of opinion formation and finding phases of the system in terms of parameters describing noise and flow of the information for two and three opinions available in the system. The results show that opinion formation and spread are influenced by both (i) flow of information among actors (effective range of interactions among actors) and (ii) noise (randomness in adopting opinions). The noise not only leads to opinions disorder but also it promotes consensus under certain conditions.


Local Model Poisoning Attacks to Byzantine Robust Federated Learning. In federated learning, multiple client devices jointly learn a machine learning model each client device maintains a local model for its local training dataset, while a master device maintains a global model via aggregating the local models from the client devices. The machine learning community recently proposed several federated learning methods that were claimed to be robust against Byzantine failures (e.g., system failures, adversarial manipulations) of certain client devices. In this work, we perform the first systematic study on local model poisoning attacks to federated learning. We assume an attacker has compromised some client devices, and the attacker manipulates the local model parameters on the compromised client devices during the learning process such that the global model has a large testing error rate. We formulate our attacks as optimization problems and apply our attacks to four recent Byzantine robust federated learning methods. Our empirical results on four real world datasets show that our attacks can substantially increase the error rates of the models learnt by the federated learning methods that were claimed to be robust against Byzantine failures of some client devices. We generalize two defenses for data poisoning attacks to defend against our local model poisoning attacks. Our evaluation results show that one defense can effectively defend against our attacks in some cases, but the defenses are not effective enough in other cases, highlighting the need for new defenses against our local model poisoning attacks to federated learning.


A 100 ps TOF Detection System for On Line Range Monitoring in Hadrontherapy. The accuracy of hadrontherapy treatment is currently limited by ion range uncertainties. In order to fully exploit the potential of this technique, we propose the development of a novel system for online control of particle therapy, based on TOF resolved (time of flight) Prompt Gamma (PG) imaging with 100 ps time resolution. Our aim is to detect a possible deviation of the proton range with respect to treatment planning within the first few irradiation spots at the beginning of the session. The system consists of a diamond based beam hodoscope for single proton tagging, operated in time coincidence with one or more gamma detectors placed downstream of the patient. The TOF between the proton time of arrival in the hodoscope and the PG detection time provides an indirect measurement of the proton range in the patient with a precision strictly related to the system time resolution. With a single 38 cm 3 BaF2 detector placed at 15 cm from a heterogeneous PMMA target, we obtained a coincidence time resolution of 101 ps (rms). This system allowed us to measure the thickness and position of an air cavity within a PMMA target, and the associated proton range shift a 3 mm shift can be detected at 2 sigma confidence level within a single large irradiation spot ( 10 8 protons). We are currently conceiving a multi channel PG timing detector with 3D target coverage. Each pixel will provide the PG detection time and its hit position, that can be used to reconstruct the 3D distribution of PG vertices in the patient. Our approach does not require collimation and allows to dramatically increase the detection efficiency. Since both signal detection and background rejection are based on TOF, the constraints on energy resolution can be relaxed to further improve time resolution.


Picture to Amount (PITA) Predicting Relative Ingredient Amounts from Food Images. Increased awareness of the impact of food consumption on health and lifestyle today has given rise to novel data driven food analysis systems. Although these systems may recognize the ingredients, a detailed analysis of their amounts in the meal, which is paramount for estimating the correct nutrition, is usually ignored. In this paper, we study the novel and challenging problem of predicting the relative amount of each ingredient from a food image. We propose PITA, the Picture to Amount deep learning architecture to solve the problem. More specifically, we predict the ingredient amounts using a domain driven Wasserstein loss from image to recipe cross modal embeddings learned to align the two views of food data. Experiments on a dataset of recipes collected from the Internet show the model generates promising results and improves the baselines on this challenging task. A demo of our system and our data is availableat foodai.cs.rutgers.edu.


Identification of primary and collateral tracks in stuttered speech. Disfluent speech has been previously addressed from two main perspectives the clinical perspective focusing on diagnostic, and the Natural Language Processing (NLP) perspective aiming at modeling these events and detect them for downstream tasks. In addition, previous works often used different metrics depending on whether the input features are text or speech, making it difficult to compare the different contributions. Here, we introduce a new evaluation framework for disfluency detection inspired by the clinical and NLP perspective together with the theory of performance from cite clark1996using which distinguishes between primary and collateral tracks. We introduce a novel forced aligned disfluency dataset from a corpus of semi directed interviews, and present baseline results directly comparing the performance of text based features (word and span information) and speech based (acoustic prosodic information). Finally, we introduce new audio features inspired by the word based span features. We show experimentally that using these features outperformed the baselines for speech based predictions on the present dataset.


Analysing the impact of global demographic characteristics over the COVID 19 spread using class rule mining and pattern matching. Since the coronavirus disease (COVID 19) outbreak in December 2019, studies have been addressing diverse aspects in relation to COVID 19 and Variant of Concern 202012 01 (VOC 202012 01) such as potential symptoms and predictive tools. However, limited work has been performed towards the modelling of complex associations between the combined demographic attributes and varying nature of the COVID 19 infections across the globe. This study presents an intelligent approach to investigate the multi dimensional associations between demographic attributes and COVID 19 global variations. We gather multiple demographic attributes and COVID 19 infection data (by 8 January 2021) from reliable sources, which are then processed by intelligent algorithms to identify the significant associations and patterns within the data. Statistical results and experts' reports indicate strong associations between COVID 19 severity levels across the globe and certain demographic attributes, e.g. female smokers, when combined together with other attributes. The outcomes will aid the understanding of the dynamics of disease spread and its progression, which in turn may support policy makers, medical specialists and society, in better understanding and effective management of the disease.


On the threshold condition for D "orfler marking. It is an open question if the threshold condition theta theta star for the D "orfler marking parameter is necessary to obtain optimal algebraic rates of adaptive finite element methods. We present a (non PDE) example fitting into the common abstract convergence framework (axioms of adaptivity) and which is potentially converging with exponential rates. However, for D "orfler marking theta theta star the algebraic converges rate can be made arbitrarily small.


Superregular matrices over small finite fields. A trivially zero minor of a matrix is a minor having all its terms in the Leibniz formula equal to zero. A matrix is superregular if all of its minors that are not trivially zero are nonzero. In the area of Coding Theory, superregular matrices over finite fields are connected with codes with optimum distance proprieties. When a superregular matrix has all its entries nonzero, it is called full superregular and these matrices are used to construct Maximum Distance Separable block codes. In the context of convolutional codes, lower triangular Toeplitz superregular matrices are employed to build convolutional codes with optimal column distance. Although full superregular matrices over small fields are known (e.g. Cauchy matrices), the few known general constructions of these matrices having a lower triangular Toeplitz structure require very large field sizes. In this work we investigate lower triangular Toeplitz superregular matrices over small finite prime fields. Following the work of Hutchinson, Smarandache and Trumpf, we study the minimum number of different nontrivial minors that such a matrix have, and exhibit concrete constructions of superregular matrices of this kind.


Convergence of the summation integral type operators via statistically. Our main aim is to investigate the approximation properties for the summation integral type operators in a statistical sense. In this regard, we prove the statistical convergence theorem using well known Korovkin theorem and the degree of approximation is determined. Also using weight function, the weighted statistical convergence theorem with the help of Korovkin theorem is obtained. The statistical rate of convergence in the terms of modulus of continuity and function belonging to the Lipschitz class is obtained. To support the convergence results of the proposed operators to the function, graphical representations take place and a comparison is shown with Sz 'asz Mirakjan Kantorovich operators through examples. The last section deals with, a bivariate extension of the proposed operators to study the rate of convergence for the function of two variables, additionally, the convergence of the bivariate operators is shown graphically.


Finite Singular Orbit Modules for Algebraic Groups. Building on the classification of modules for algebraic groups with finitely many orbits on subspaces, we determine all faithful irreducible modules for simple and maximal semisimple connected algebraic groups that are orthogonal and have finitely many orbits on singular 1 spaces. This question is naturally connected with the problem of finding for which pairs of subgroups H,K of an algebraic group G there are finitely many (H,K) double cosets. This paper provides a solution to the question when K is a maximal parabolic subgroup P 1 of a classical group SO n . We find an interesting range of new examples ranging from a 5 dimensional module for SL 2 to the spin module for B 6 in characteristic 2 .


Design, Control, and Applications of a Soft Robotic Arm. This paper presents the design, control, and applications of a multi segment soft robotic arm. In order to design a soft arm with large load capacity, several design principles are proposed by analyzing two kinds of buckling issues, under which we present a novel structure named Honeycomb Pneumatic Networks (HPN). Parameter optimization method, based on finite element method (FEM), is proposed to optimize HPN Arm design parameters. Through a quick fabrication process, several prototypes with different performance are made, one of which can achieve the transverse load capacity of 3 kg under 3 bar pressure. Next, considering different internal and external conditions, we develop three controllers according to different model precision. Specifically, based on accurate model, an open loop controller is realized by combining piece wise constant curvature (PCC) modeling method and machine learning method. Based on inaccurate model, a feedback controller, using estimated Jacobian, is realized in 3D space. A model free controller, using reinforcement learning to learn a control policy rather than a model, is realized in 2D plane, with minimal training data. Then, these three control methods are compared on a same experiment platform to explore the applicability of different methods under different conditions. Lastly, we figure out that soft arm can greatly simplify the perception, planning, and control of interaction tasks through its compliance, which is its main advantage over the rigid arm. Through plentiful experiments in three interaction application scenarios, human robot interaction, free space interaction task, and confined space interaction task, we demonstrate the potential application prospect of the soft arm.


Model free Visual Control for Continuum Robot Manipulators via Orientation Adaptation. We present an orientation adaptive controller to compensate for the effects of highly constrained environments on continuum manipulator actuation. A transformation matrix updated using optimal estimation techniques from optical flow measurements captured by the distal camera is composed with any Jacobian estimation or kinematic model to compensate for these effects. By utilizing domain knowledge to define the structure of this matrix, fewer parameters need to be estimated and a stable controller can be guaranteed. The algorithm is tested on a custom robotic catheter and convergence is shown both empirically and theoretically.


Bootstrapping Conditional GANs for Video Game Level Generation. Generative Adversarial Networks (GANs) have shown im pressive results for image generation. However, GANs facechallenges in generating contents with certain types of con straints, such as game levels. Specifically, it is difficult togenerate levels that have aesthetic appeal and are playable atthe same time. Additionally, because training data usually islimited, it is challenging to generate unique levels with cur rent GANs. In this paper, we propose a new GAN architec ture namedConditional Embedding Self Attention Genera tive Adversarial Network(CESAGAN) and a new bootstrap ping training procedure. The CESAGAN is a modification ofthe self attention GAN that incorporates an embedding fea ture vector input to condition the training of the discriminatorand generator. This allows the network to model non localdependency between game objects, and to count objects. Ad ditionally, to reduce the number of levels necessary to trainthe GAN, we propose a bootstrapping mechanism in whichplayable generated levels are added to the training set. Theresults demonstrate that the new approach does not only gen erate a larger number of levels that are playable but also gen erates fewer duplicate levels compared to a standard GAN.


ActiveMoCap Optimized Viewpoint Selection for Active Human Motion Capture. The accuracy of monocular 3D human pose estimation depends on the viewpoint from which the image is captured. While freely moving cameras, such as on drones, provide control over this viewpoint, automatically positioning them at the location which will yield the highest accuracy remains an open problem. This is the problem that we address in this paper. Specifically, given a short video sequence, we introduce an algorithm that predicts which viewpoints should be chosen to capture future frames so as to maximize 3D human pose estimation accuracy. The key idea underlying our approach is a method to estimate the uncertainty of the 3D body pose estimates. We integrate several sources of uncertainty, originating from deep learning based regressors and temporal smoothness. Our motion planner yields improved 3D body pose estimates and outperforms or matches existing ones that are based on person following and orbiting.


2 local derivations on Witt algebras. In this paper, we prove that every 2 local derivation on Witt algebras W n, W n or W n is a derivation for all n 1,2, cdots, infty . As a consequence we obtain that every 2 local derivation on any centerless generalized Virasoro algebra of higher rank is a derivation.


On Cohen Macaulay Hopf monoids in species. We study Cohen Macaulay Hopf monoids in the category of species. The goal is to apply techniques from topological combinatorics to the study of polynomial invariants arising from combinatorial Hopf algebras. Given a polynomial invariant arising from a linearized Hopf monoid, we show that under certain conditions it is the Hilbert polynomial of a relative simplicial complex. If the Hopf monoid is Cohen Macaulay, we give necessary and sufficient conditions for the corresponding relative simplicial complex to be relatively Cohen Macaulay, which implies that the polynomial has a nonnegative h vector. We apply our results to the weak and strong chromatic polynomials of acyclic mixed graphs, and the order polynomial of a double poset.


Uniqueness and energy balance for isentropic Euler equation with stochastic forcing. In this article, we prove uniqueness and energy balance for isentropic Euler system driven by a cylindrical Wiener process. Pathwise uniqueness result is obtained for weak solutions having H "older regularity C alpha , alpha 1 2 in space and satisfying one sided Lipschitz bound on velocity. We prove Onsager's conjecture for isentropic Euler system with stochastic forcing, that is, energy balance equation for solutions enjoying H "older regularity C alpha , alpha 1 3 . Both the results have been obtained in a more general setting by considering regularity in Besov space.


Data Management for Causal Algorithmic Fairness. Fairness is increasingly recognized as a critical component of machine learning systems. However, it is the underlying data on which these systems are trained that often reflects discrimination, suggesting a data management problem. In this paper, we first make a distinction between associational and causal definitions of fairness in the literature and argue that the concept of fairness requires causal reasoning. We then review existing works and identify future opportunities for applying data management techniques to causal algorithmic fairness.


Software Engineering For Automated Game Design. As we develop more assistive and automated game design systems, the question of how these systems should be integrated into game development workflows, and how much adaptation may be required, becomes increasingly important. In this paper we explore the impact of software engineering decisions on the ability of an automated game design system to understand a game's codebase, generate new game code, and evaluate its work. We argue that a new approach to software engineering may be required in order for game developers to fully benefit from automated game designers.


Connecting Robust Shuffle Privacy and Pan Privacy. In the emph shuffle model of differential privacy, data holding users send randomized messages to a secure shuffler, the shuffler permutes the messages, and the resulting collection of messages must be differentially private with regard to user data. In the emph pan private model, an algorithm processes a stream of data while maintaining an internal state that is differentially private with regard to the stream data. We give evidence connecting these two apparently different models. Our results focus on emph robustly shuffle private protocols, whose privacy guarantees are not greatly affected by malicious users. First, we give robustly shuffle private protocols and upper bounds for counting distinct elements and uniformity testing. Second, we use pan private lower bounds to prove robustly shuffle private lower bounds for both problems. Focusing on the dependence on the domain size k , we find that robust approximate shuffle privacy and approximate pan privacy have additive error Theta( sqrt k ) for counting distinct elements. For uniformity testing, we give a robust approximate shuffle private protocol with sample complexity tilde O(k 2 3 ) and show that an Omega(k 2 3 ) dependence is necessary for any robust pure shuffle private tester. Finally, we show that this connection is useful in both directions we give a pan private adaptation of recent work on shuffle private histograms and use it to recover further separations between pan privacy and interactive local privacy.


Notes on Communication and Computation in Secure Distributed Matrix Multiplication. We consider the problem of secure distributed matrix multiplication in which a user wishes to compute the product of two matrices with the assistance of honest but curious servers. In this paper, we answer the following question Is it beneficial to offload the computations if security is a concern? We answer this question in the affirmative by showing that by adjusting the parameters in a polynomial code we can obtain a trade off between the user's and the servers' computational time. Indeed, we show that if the computational time complexity of an operation in mathbb F q is at most mathcal Z q and the computational time complexity of multiplying two n times n matrices is mathcal O (n omega mathcal Z q) then, by optimizing the trade off, the user together with the servers can compute the multiplication in mathcal O (n 4 frac 6 omega 1 mathcal Z q) time. We also show that if the user is only concerned in optimizing the download rate, a common assumption in the literature, then the problem can be converted into a simple private information retrieval problem by means of a scheme we call Private Oracle Querying. However, this comes at large upload and computational costs for both the user and the servers.


Space time finite element discretization of parabolic optimal control problems with energy regularization. We analyze space time finite element methods for the numerical solution of distributed parabolic optimal control problems with energy regularization in the Bochner space L 2(0,T H 1 ( Omega)) . By duality, the related norm can be evaluated by means of the solution of an elliptic quasi stationary boundary value problem. When eliminating the control, we end up with the reduced optimality system that is nothing but the variational formulation of the coupled forward backward primal and adjoint equations. Using Babu v s ka's theorem, we prove unique solvability in the continuous case. Furthermore, we establish the discrete inf sup condition for any conforming space time finite element discretization yielding quasi optimal discretization error estimates. Various numerical examples confirm the theoretical findings. We emphasize that the energy regularization results in a more localized control with sharper contours for discontinuous target functions, which is demonstrated by a comparison with an L 2 regularization and with a sparse optimal control approach.


Searching for Stage wise Neural Graphs In the Limit. Search space is a key consideration for neural architecture search. Recently, Xie et al. (2019) found that randomly generated networks from the same distribution perform similarly, which suggests we should search for random graph distributions instead of graphs. We propose graphon as a new search space. A graphon is the limit of Cauchy sequence of graphs and a scale free probabilistic distribution, from which graphs of different number of nodes can be drawn. By utilizing properties of the graphon space and the associated cut distance metric, we develop theoretically motivated techniques that search for and scale up small capacity stage wise graphs found on small datasets to large capacity graphs that can handle ImageNet. The scaled stage wise graphs outperform DenseNet and randomly wired Watts Strogatz networks, indicating the benefits of graphon theory in NAS applications.


Extending Quasi Alternating Links. Champanerkar and Kofman introduced an interesting way to construct new examples of quasi alternating links from existing ones. Actually, they proved that replacing a quasi alternating crossing c in a quasi alternating link by a rational tangle of same type yields a new quasi alternating link. This construction has been extended to alternating algebraic tangles and applied to characterize all quasi alternating Montesinos links. In this paper, we extend this technique to any alternating tangle of same type as c. As an application, we give new examples of quasi alternating knots of 13 and 14 crossings. Moreover, we prove that the Jones polynomial of a quasi alternating link that is obtained in this way has no gap if the original link has no gap in its Jones polynomial. This supports a conjecture introduced in arXiv 1810.11773 math.GT , which states that Jones polynomial of any prime quasi alternating link except (2 n) torus link has no gap.


Crosscap number and epimorphisms of two bridge knot groups. We consider the relationship between the crosscap number gamma of knots and a partial order on the set of all prime knots, which is defined as follows. For two knots K and J , we say K geq J if there exists an epimorphism f pi 1(S 3 K) longrightarrow pi 1(S 3 J) . We prove that if K and J are 2 bridge knots and K J , then gamma(K) geq 3 gamma(J) 4 . We also classify all pairs (K,J) for which the inequality is sharp. A similar result relating the genera of two knots has been proven by Suzuki and Tran. Namely, if K and J are 2 bridge knots and K J , then g(K) geq 3 g(J) 1 , where g(K) denotes the genus of the knot K .


On the Role of Vesicle Transport in Neurite Growth Modelling and Experiments. The processes that determine the establishment of the complex morphology of neurons during development are still poorly understood. We present experiments that use live imaging to examine the role of vesicle transport and propose a lattice based model that shows symmetry breaking features similar to a neuron during its polarization. In a otherwise symmetric situation our model predicts that a difference in neurite length increases the growth potential of the longer neurite indicating that vesicle transport can be regarded as a major factor in neurite growth.


Testing Scenario Library Generation for Connected and Automated Vehicles, Part II Case Studies. Testing scenario library generation (TSLG) is a critical step for the development and deployment of connected and automated vehicles (CAVs). In Part I of this study, a general methodology for TSLG is proposed, and theoretical properties are investigated regarding the accuracy and efficiency of CAV evaluation. This paper aims to provide implementation examples and guidelines, and to enhance the proposed methodology under high dimensional scenarios. Three typical cases, including cut in, highway exit, and car following, are designed and studied in this paper. For each case, the process of library generation and CAV evaluation is elaborated. To address the challenges brought by high dimensions, the proposed methodology is further enhanced by reinforcement learning technique. For all three cases, results show that the proposed methods can accelerate the CAV evaluation process by multiple magnitudes with same evaluation accuracy, if compared with the on road test method.


Hierarchical reinforcement learning for efficient exploration and transfer. Sparse reward domains are challenging for reinforcement learning algorithms since significant exploration is needed before encountering reward for the first time. Hierarchical reinforcement learning can facilitate exploration by reducing the number of decisions necessary before obtaining a reward. In this paper, we present a novel hierarchical reinforcement learning framework based on the compression of an invariant state space that is common to a range of tasks. The algorithm introduces subtasks which consist of moving between the state partitions induced by the compression. Results indicate that the algorithm can successfully solve complex sparse reward domains, and transfer knowledge to solve new, previously unseen tasks more quickly.


Medical Entity Linking using Triplet Network. Entity linking (or Normalization) is an essential task in text mining that maps the entity mentions in the medical text to standard entities in a given Knowledge Base (KB). This task is of great importance in the medical domain. It can also be used for merging different medical and clinical ontologies. In this paper, we center around the problem of disease linking or normalization. This task is executed in two phases candidate generation and candidate scoring. In this paper, we present an approach to rank the candidate Knowledge Base entries based on their similarity with disease mention. We make use of the Triplet Network for candidate ranking. While the existing methods have used carefully generated sieves and external resources for candidate generation, we introduce a robust and portable candidate generation scheme that does not make use of the hand crafted rules. Experimental results on the standard benchmark NCBI disease dataset demonstrate that our system outperforms the prior methods by a significant margin.


"Good Robot!" Efficient Reinforcement Learning for Multi Step Visual Tasks with Sim to Real Transfer. Current Reinforcement Learning (RL) algorithms struggle with long horizon tasks where time can be wasted exploring dead ends and task progress may be easily reversed. We develop the SPOT framework, which explores within action safety zones, learns about unsafe regions without exploring them, and prioritizes experiences that reverse earlier progress to learn with remarkable efficiency. The SPOT framework successfully completes simulated trials of a variety of tasks, improving a baseline trial success rate from 13 to 100 when stacking 4 cubes, from 13 to 99 when creating rows of 4 cubes, and from 84 to 95 when clearing toys arranged in adversarial patterns. Efficiency with respect to actions per trial typically improves by 30 or more, while training takes just 1 20k actions, depending on the task. Furthermore, we demonstrate direct sim to real transfer. We are able to create real stacks in 100 of trials with 61 efficiency and real rows in 100 of trials with 59 efficiency by directly loading the simulation trained model on the real robot with no additional real world fine tuning. To our knowledge, this is the first instance of reinforcement learning with successful sim to real transfer applied to long term multi step tasks such as block stacking and row making with consideration of progress reversal. Code is available at https github.com jhu lcsr good robot .