Learning for Microrobot Exploration Model based Locomotion, Sparse robust Navigation, and Low power Deep Classification. Building intelligent autonomous systems at any scale is challenging. The sensing and computation constraints of a microrobot platform make the problems harder. We present improvements to learning based methods for on board learning of locomotion, classification, and navigation of microrobots. We show how simulated locomotion can be achieved with model based reinforcement learning via on board sensor data distilled into control. Next, we introduce a sparse, linear detector and a Dynamic Thresholding method to FAST Visual Odometry for improved navigation in the noisy regime of mm scale imagery. We end with a new image classifier capable of classification with fewer than one million multiply and accumulate (MAC) operations by combining fast downsampling, efficient layer structures and hard activation functions. These are promising steps toward using state of the art algorithms in the power limited world of edge intelligence and microrobots.


Visual Semantic SLAM with Landmarks for Large Scale Outdoor Environment. Semantic SLAM is an important field in autonomous driving and intelligent agents, which can enable robots to achieve high level navigation tasks, obtain simple cognition or reasoning ability and achieve language based human robot interaction. In this paper, we built a system to creat a semantic 3D map by combining 3D point cloud from ORB SLAM with semantic segmentation information from Convolutional Neural Network model PSPNet 101 for large scale environments. Besides, a new dataset for KITTI sequences has been built, which contains the GPS information and labels of landmarks from Google Map in related streets of the sequences. Moreover, we find a way to associate the real world landmark with point cloud map and built a topological map based on semantic map.


Homogeneous and Heterogeneous Response of Quorum Sensing Bacteria in an Evolutionary Context. To explain the stability of cooperation is a central task of evolutionary theory. We investigate this question in the case of quorum sensing (QS) bacteria, which regulate cooperative traits in response to population density. Cooperation is modeled by the prisoner's dilemma, where individuals produce a costly public good (PG) that equally benefits all members of a community divided into multiple, distinct patches (multilevel selection). Cost and benefit are non linear functions of the PG production. The analysis of evolutionary stability yields an optimization problem for the expression of PG in dependency on the number of QS individuals within a colony. We find that the optimal total PG production of the QS population mainly depends on the shape of the benefit. A graded and a switch like response is possible, in accordance with earlier results. Interestingly, at the level of the individual cell, the QS response is determined by the shape of the costs. All QS individuals respond either homogeneously if cost are a convex function of the PG production rate, or they respond heterogeneously with distinct ON OFF responses if the costs are concave. The latter finding is consistent with recent experimental findings, and contradicts the usual interpretation of QS as a mechanism to establish a uniform, synchronized response of a bacterial population.


Classification of conformal minimal immersions from S 2 to G(2,N mathbb C ) with parallel second fundamental form. In this paper, we determine all conformal minimal immersions of 2 spheres in complex Grassmann manifold G(2,N mathbb C ) with parallel second fundamental form.


A Complete List of All Convex Polyhedra Made by Gluing Regular Pentagons. We give a complete description of all convex polyhedra whose surface can be constructed from several congruent regular pentagons by folding and gluing them edge to edge. Our method of determining the graph structure of the polyhedra from a gluing is of independent interest and can be used in other similar settings.


AI Stories An Interactive Narrative System for Children. AI Stories is a proposed interactive dialogue system, that lets children co create narrative worlds through conversation. Over the next three years this system will be developed and tested within pediatric wards, where it offers a useful resource between the gap of education and play. Telling and making stories is a fundamental part of language play, and its chatty and nonsensical qualities are important therefore, the prologued usage an automated system offers is a benefit to children. In this paper I will present the current state of this project, in its more experimental and general guise. Conceptually story telling through dialogue relates to the preprint interpretation of story, beyond the static and linear medium, where stories were performative, temporal, and social.


Weak approximation and the Hilbert property for Campana points. We study weak approximation and the Hilbert property for Campana points, both of importance in recent work on a Manin type conjecture by Pieropan, Smeets, Tanimoto and Varilly Alvarado. We show that weak weak approximation implies the Hilbert property for Campana points, and we exploit this to exhibit Campana orbifolds whose sets of Campana points are not thin.


Haptic Teleoperation of UAVs through Control Barrier Functions. This paper presents a novel approach to haptic teleoperation. Specifically, we use control barrier functions (CBFs) to generate force feedback to help human operators safely fly quadrotor UAVs. CBFs take a control signal as input and output a control signal that is as close as possible to the initial control signal, while also meeting specified safety constraints. In the proposed method, we generate haptic force feedback based on the difference between a command issued by the human operator and the safe command returned by a CBF. In this way, if the user issues an unsafe control command, the haptic feedback will help guide the user towards the safe input command that is closest to their current command. We conducted a within subject user study, in which 12 participants flew a simulated UAV in a virtual hallway environment. Participants completed the task with our proposed CBF based haptic feedback, no haptic feedback, and haptic feedback generated via parametric risk fields, which is a state of the art method described in the literature. The results of this study show that CBF based haptic feedback can improve a human operator's ability to safely fly a UAV and reduce the operator's perceived workload, without sacrificing task efficiency.


Effective Kan fibrations in simplicial sets. We introduce the notion of an effective Kan fibration, a new mathematical structure that can be used to study simplicial homotopy theory. Our main motivation is to make simplicial homotopy theory suitable for homotopy type theory. Effective Kan fibrations are maps of simplicial sets equipped with a structured collection of chosen lifts that satisfy certain non trivial properties. This contrasts with the ordinary, unstructured notion of a Kan fibration. We show that fundamental properties of Kan fibrations can be extended to explicit constructions on effective Kan fibrations. In particular, we give a constructive (explicit) proof showing that effective Kan fibrations are stable under push forward, or fibred exponentials. This is known to be impossible for ordinary Kan fibrations. We further show that effective Kan fibrations are local, or completely determined by their fibres above representables. We also give an (ineffective) proof saying that the maps which can be equipped with the structure of an effective Kan fibration are precisely the ordinary Kan fibrations. Hence implicitly, both notions still describe the same homotopy theory. By showing that the effective Kan fibrations combine all these properties, we solve an open problem in homotopy type theory. In this way our work provides a first step in giving a constructive account of Voevodsky's model of univalent type theory in simplicial sets.


Tactile Perception of Objects by the User's Palm for the Development of Multi contact Wearable Tactile Displays. The user's palm plays an important role in object detection and manipulation. The design of a robust multi contact tactile display must consider the sensation and perception of of the stimulated area aiming to deliver the right stimuli at the correct location. To the best of our knowledge, there is no study to obtain the human palm data for this purpose. The objective of this work is to introduce the method to investigate the user's palm sensations during the interaction with objects. An array of fifteen Force Sensitive Resistors (FSRs) was located at the user's palm to get the area of interaction, and the normal force delivered to four different convex surfaces. Experimental results showed the active areas at the palm during the interaction with each of the surfaces at different forces. The obtained results can be applied in the development of multi contact wearable tactile and haptic displays for the palm, and in training a machine learning algorithm to predict stimuli aiming to achieve a highly immersive experience in Virtual Reality.


Real Symmetric Matrices with Partitioned Eigenvalues. We study the real algebraic variety of real symmetric matrices with eigenvalue multiplicities determined by a partition. We present formulas for the dimension and Euclidean distance degree. We give a parametrization by rational functions. For small matrices, we provide equations for larger matrices, we explain how to use representation theory to find equations. We describe the ring of invariants under the action of the orthogonal group. For the subvariety of diagonal matrices, we give the degree.


Channel Correlation Diversity in MU MIMO Systems Analysis and Measurements. In multiuser multiple input multiple output (MU MIMO) systems, channel correlation is detrimental to system performance. We demonstrate that widely used, yet overly simplified, correlation models that generate identical correlation profiles for each terminal tend to severely underestimate the system performance. In sharp contrast, more physically motivated models that capture variations in the power angular spectra across multiple terminals, generate diverse correlation patterns. This has a significant impact on the system performance. Assuming correlated Rayleigh fading and downlink zero forcing precoding, tight closed form approximations for the average signal to noise ratio, and ergodic sum spectral efficiency are derived. Our expressions provide clear insights into the impact of diverse correlation patterns on the above performance metrics. Unlike previous works, the correlation models are parameterized with measured data from a recent 2.53 GHz urban macrocellular campaign in Cologne, Germany. Overall, results from this paper can be treated as a timely re calibration of performance expectations from practical MU MIMO systems.


Gaussian processes for data fulfilling linear differential equations. A method to reconstruct fields, source strengths and physical parameters based on Gaussian process regression is presented for the case where data are known to fulfill a given linear differential equation with localized sources. The approach is applicable to a wide range of data from physical measurements and numerical simulations. It is based on the well known invariance of the Gaussian under linear operators, in particular differentiation. Instead of using a generic covariance function to represent data from an unknown field, the space of possible covariance functions is restricted to allow only Gaussian random fields that fulfil the homogeneous differential equation. The resulting tailored kernel functions lead to more reliable regression compared to using a generic kernel and makes some hyperparameters directly interpretable. For differential equations representing laws of physics such a choice limits realizations of random fields to physically possible solutions. Source terms are added by superposition and their strength estimated in a probabilistic fashion, together with possibly unknown hyperparameters with physical meaning in the differential operator.


Canonical connections and algebraic Ricci solitons of three dimensional Lorentzian Lie groups. In this paper, we compute canonical connections and Kobayashi Nomizu connections and their curvature on three dimensional Lorentzian Lie groups with some product structure. We define algebraic Ricci solitons associated to canonical connections and Kobayashi Nomizu connections. We classify algebraic Ricci solitons associated to canonical connections and Kobayashi Nomizu connections on three dimensional Lorentzian Lie groups with some product structure.


SubwayPS Towards Enabling Smartphone Positioning in Underground Public Transportation Systems. Thanks to rapid advances in technologies like GPS and Wi Fi positioning, smartphone users are able to determine their location almost everywhere they go. This is not true, however, of people who are traveling in underground public transportation networks, one of the few types of high traffic areas where smartphones do not have access to accurate position information. In this paper, we introduce the problem of underground transport positioning on smartphones and present SubwayPS, an accelerometer based positioning technique that allows smartphones to determine their location substantially better than baseline approaches, even deep beneath city streets. We highlight several immediate applications of positioning in subway networks in domains ranging from mobile advertising to mobile maps and present MetroNavigator, a proof of concept smartphone and smartwatch app that notifies users of upcoming points of interest and alerts them when it is time to get ready to exit the train.


When and Why Metaheuristics Researchers Can Ignore "No Free Lunch" Theorems. The No Free Lunch (NFL) theorem for search and optimisation states that averaged across all possible objective functions on a fixed search space, all search algorithms perform equally well. Several refined versions of the theorem find a similar outcome when averaging across smaller sets of functions. This paper argues that NFL results continue to be misunderstood by many researchers, and addresses this issue in several ways. Existing arguments against real world implications of NFL results are collected and re stated for accessibility, and new ones are added. Specific misunderstandings extant in the literature are identified, with speculation as to how they may have arisen. This paper presents an argument against a common paraphrase of NFL findings that algorithms must be specialised to problem domains in order to do well after problematising the usually undefined term "domain". It provides novel concrete counter examples illustrating cases where NFL theorems do not apply. In conclusion it offers a novel view of the real meaning of NFL, incorporating the anthropic principle and justifying the position that in many common situations researchers can ignore NFL.


Hybrid topological guiding mechanisms for photonic crystal fibers. We create hybrid topological photonic localisation of light by introducing concepts from the field of topological matter to that of photonic crystal fiber arrays. S polarized obliquely propagating electromagnetic waves are guided by hexagonal, and square, lattice topological systems along an array of infinitely conducting fibers. The theory utilises perfectly periodic arrays that, in frequency space, have gapped Dirac cones producing band gaps demarcated by pronounced valleys locally imbued with a nonzero local topological quantity. These broken symmetry induced stop bands allow for localised guidance of electromagnetic edge waves along the crystal fiber axis. Finite element simulations, complemented by asymptotic techniques, demonstrate the effectiveness of the proposed designs for localising energy in finite arrays in a robust manner.


The closures of test configurations and algebraic singularity types. Given a K "ahler manifold X with an ample line bundle L , we consider the metric space of L 1 geodesic rays associated to the first Chern class c 1(L) . We characterize rays that can be approximated by ample test configurations. At the same time, we also characterize the closure of algebraic singularity types among all singularity types of quasi plurisubharmonic functions, pointing out the very close relationship between these two seemingly unrelated problems. By Bonavero's holomorphic Morse inequalities, the arithmetic and non pluripolar volumes of algebraic singularity types coincide. We show that in general the arithmetic volume dominates the non pluripolar one, and equality holds exactly on the closure of algebraic singularity types. Analogously, we give an estimate for the Monge Amp ere energy of a general L 1 ray in terms of the arithmetic volumes along its Legendre transform. Equality holds exactly for rays approximable by test configurations. Various other cohomological and potential theoretic characterizations are given in both settings. As applications, we give a concrete formula for the non Archimedean Monge Amp ere energy in terms of asymptotic expansion, and show the continuity of the projection map from L 1 rays to non Archimedean rays. We also show that the closure of ample test configurations and filtrations gives the same set of rays.


Planning Optical Networks for Unexpected Traffic Growth. A lightpath configuration algorithm considering a multi period traffic model is presented and evaluated to a realistic German core network study. Strategically exploiting BVT excess capacity, we show that offered traffic can be carried up to an additional five years in all traffic growth scenarios.


Bounds on Kolmogorov widths and sampling recovery for classes with small mixed smoothness. Results on asymptotic characteristics of classes of functions with mixed smoothness are obtained in the paper. Our main interest is in estimating the Kolmogorov widths of classes with small mixed smoothness. We prove the corresponding bounds for the unit balls of the trigonometric polynomials with frequencies from a hyperbolic cross. We demonstrate how our results on the Kolmogorov widths imply new upper bounds for the optimal sampling recovery in the L 2 norm of functions with small mixed smoothness.


On the distribution of the Rudin Shapiro function for finite fields. Let q p r be the power of a prime p and ( beta 1, ldots , beta r) be an ordered basis of mathbb F q over mathbb F p . For xi sum limits j 1 r x j beta j in mathbb F q quad mbox with digits x j in mathbb F p, we define the Rudin Shapiro function R on mathbb F q by R( xi) sum limits i 1 r 1 x ix i 1 , quad xi in mathbb F q. For a non constant polynomial f(X) in mathbb F q X and c in mathbb F p we study the number of solutions xi in mathbb F q of R(f( xi)) c . If the degree d of f(X) is fixed, r ge 6 and p rightarrow infty , the number of solutions is asymptotically p r 1 for any c . The proof is based on the Hooley Katz Theorem.


On recovering the Sturm Liouville differential operators on time scales. We study Sturm Liouville differential operators on the time scales consisting of a finite number of isolated points and segments. In a previous paper it was established that such operators are uniquely determined by their spectral characteristics. In the present paper, an algorithm for their recovery based on the method of spectral mappings is obtained. We also prove that the eigenvalues of two Sturm Liouville boundary value problems with one common boundary condition alternate.


Hierarchical Predictive Coding Models in a Deep Learning Framework. Bayesian predictive coding is a putative neuromorphic method for acquiring higher level neural representations to account for sensory input. Although originating in the neuroscience community, there are also efforts in the machine learning community to study these models. This paper reviews some of the more well known models. Our review analyzes module connectivity and patterns of information transfer, seeking to find general principles used across the models. We also survey some recent attempts to cast these models within a deep learning framework. A defining feature of Bayesian predictive coding is that it uses top down, reconstructive mechanisms to predict incoming sensory inputs or their lower level representations. Discrepancies between the predicted and the actual inputs, known as prediction errors, then give rise to future learning that refines and improves the predictive accuracy of learned higher level representations. Predictive coding models intended to describe computations in the neocortex emerged prior to the development of deep learning and used a communication structure between modules that we name the Rao Ballard protocol. This protocol was derived from a Bayesian generative model with some rather strong statistical assumptions. The RB protocol provides a rubric to assess the fidelity of deep learning models that claim to implement predictive coding.


Algebraic and analytic properties of semigroups related to fixed point properties of non expansive mappings. The purpose of this paper is to give an updated survey on various algebraic and analytic properties of semigroups related to fixed point properties of semigroup actions on a non empty closed convex subset of a Banach space or, more generally, a locally convex topological vector space.


Challenges in Collaborative HRI for Remote Robot Teams. Collaboration between human supervisors and remote teams of robots is highly challenging, particularly in high stakes, distant, hazardous locations, such as off shore energy platforms. In order for these teams of robots to truly be beneficial, they need to be trusted to operate autonomously, performing tasks such as inspection and emergency response, thus reducing the number of personnel placed in harm's way. As remote robots are generally trusted less than robots in close proximity, we present a solution to instil trust in the operator through a mediator robot' that can exhibit social skills, alongside sophisticated visualisation techniques. In this position paper, we present general challenges and then take a closer look at one challenge in particular, discussing an initial study, which investigates the relationship between the level of control the supervisor hands over to the mediator robot and how this affects their trust. We show that the supervisor is more likely to have higher trust overall if their initial experience involves handing over control of the emergency situation to the robotic assistant. We discuss this result, here, as well as other challenges and interaction techniques for human robot collaboration.


Learning Generative Models of Tissue Organization with Supervised GANs. A key step in understanding the spatial organization of cells and tissues is the ability to construct generative models that accurately reflect that organization. In this paper, we focus on building generative models of electron microscope (EM) images in which the positions of cell membranes and mitochondria have been densely annotated, and propose a two stage procedure that produces realistic images using Generative Adversarial Networks (or GANs) in a supervised way. In the first stage, we synthesize a label "image" given a noise "image" as input, which then provides supervision for EM image synthesis in the second stage. The full model naturally generates label image pairs. We show that accurate synthetic EM images are produced using assessment via (1) shape features and global statistics, (2) segmentation accuracies, and (3) user studies. We also demonstrate further improvements by enforcing a reconstruction loss on intermediate synthetic labels and thus unifying the two stages into one single end to end framework.


Persistent Homology and Applied Homotopy Theory. This paper is a survey of persistent homology, primarily as it is used in topological data analysis. It includes the theory of persistence modules, as well as stability theorems for persistence barcodes, generalized persistence, vectorization of persistence barcodes, as well as some applications.


Network connectivity optimization An evaluation of heuristics applied to complex networks and a transportation case study. Network optimization has generally been focused on solving network flow problems, but recently there have been investigations into optimizing network characteristics. Optimizing network connectivity to maximize the number of nodes within a given distance to a focal node and then minimizing the number and length of additional connections has not been as thoroughly explored, yet is important in several domains including transportation planning, telecommunications networks, and geospatial analysis. We compare several heuristics to explore this network connectivity optimization problem with the use of random networks, including the introduction of two planar random networks that are useful for spatial network simulation research, and a real world case study from urban planning and public health. We observe significant variation between nodal characteristics and optimal connections across network types. This result along with the computational costs of the search for optimal solutions highlights the difficulty of finding effective heuristics. A novel genetic algorithm is proposed and we find this optimization heuristic outperforms existing techniques and describe how it can be applied to other combinatorial and dynamic problems.


Higher Deformations of Lie Algebra Representations II. Steinberg's tensor product theorem shows that for semisimple algebraic groups the study of irreducible representations of higher Frobenius kernels reduces to the study of irreducible representations of the first Frobenius kernel. In the preceding paper in this series, deforming the distribution algebra of a higher Frobenius kernel yielded a family of deformations called higher reduced enveloping algebras. In this paper we prove that Steinberg decomposition can be similarly deformed, allowing us to reduce representation theoretic questions about these algebras to questions about reduced enveloping algebras. We use this to derive structural results about modules over these algebras. Separately, we also show that many of the results in the preceding paper hold without an assumption of reductivity.


Congruences Related to Dual Sequences and Catalan Numbers. During the study of dual sequences, Sun introduced the polynomials D n(x,y) sum k 0 n n choose k x choose k y k text and S n(x,y) sum k 0 n binom n k binom x k binom 1 x k y k. Many related congruences have been established and conjectured by Sun. Here we generalize some of them by determining sum k 0 p 1 D k(x 1,y 1)D k(x 2,y 2) pmod p text and sum k 0 p 1 S k(x 1,y 1)S k(x 2,y 2) pmod p for any odd prime p and p adic integers x i, y i with i in 1,2 . Considering the immediate connection between binomial coefficients and Catalan numbers, we also characterize sum n 0 p 1 left( sum k 0 n n choose k frac C k a k right) 2 pmod p , where C k denotes the k th Catalan number, a in mathbb Z setminus 0 with gcd(a,p) 1 . These confirm and generalise some of Sun's conjectures.


The Curse of Shared Knowledge Recursive Belief Reasoning in a Coordination Game with Imperfect Information. Common knowledge is a necessary condition for safe group coordination. When common knowledge can not be obtained, humans routinely use their ability to attribute beliefs and intentions in order to infer what is known. But such shared knowledge attributions are limited in depth and therefore prone to coordination failures, because any finite order knowledge attribution allows for an even higher order attribution that may change what is known by whom. In three separate experiments we investigate to which degree human participants (N 802) are able to recognize the difference between common knowledge and nth order shared knowledge. We use a new two person coordination game with imperfect information that is able to cast the recursive game structure and higher order uncertainties into a simple, everyday like setting. Our results show that participants have a very hard time accepting the fact that common knowledge is not reducible to shared knowledge. Instead, participants try to coordinate even at the shallowest depths of shared knowledge and in spite of huge payoff penalties.


Wireless sensor networks simulators and testbeds. Wireless sensor networks (WSNs) have emerged as one of the most promising technologies for the current era. Researchers have studied them for several years ago, but more work still needed to be made since open opportunities to integrate new technologies are added to this field. One challenging task is WSN deployment. Yet, this is done by real deployment with testbeds platforms or by simulation tools when real deployment could be costly and time consuming. In this paper, we review the implementation and evaluation process in WSNs. We then describe relevant testbeds and simulation tools, and their features. Lastly, we conduct an experimentation study using these testbeds and simulations to highlight their pro and cons. As a use case, we implement a localization protocol. This work gives clarity to future work for better implementation in order to improve reliability, accuracy and time consumed.


Alternative Metrics. The main scope of this chapter is metrics defined for coding and decoding purposes, mainly for block codes.


Multiscale dimension reduction for flow and transport problems in thin domain with reactive boundaries. In this paper, we consider flow and transport problems in thin domains. The mathematical model considered in the paper is described by a system of equations for velocity, pressure, and concentration, where the flow is described by the Stokes equations and the transport is described by an unsteady convection diffusion equation with non homogeneous boundary conditions on walls (reactive boundaries). We start with the finite element approximation of the problem on unstructured grids and use it as a reference solution for two and three dimensional model problems. Fine grid approximation resolves complex geometries on the grid level and leads to a large discrete system of equations that is computationally expensive to solve. To reduce the size of the discrete systems, we develop a multiscale model reduction technique, where we construct local multiscale basis functions to generate a lower dimensional model on a coarse grid. The proposed multiscale model reduction is based on the Discontinuous Galerkin Generalized Multiscale Finite Element Method (DG GMsGEM). In DG GMsFEM for flow problems, we start with constructing the snapshot space for each interface between coarse grid cells to capture possible flows. For the reduction of the snapshot space size, we perform a dimension reduction via a solution of the local spectral problem and use eigenvectors corresponding to the smallest eigenvalues as multiscale basis functions for the approximation on the coarse grid. For the transport problem, we construct multiscale basis functions for each interface between coarse grid cells and present additional basis functions to capture non homogeneous boundary conditions on walls. Finally, we will present some numerical simulations for three test geometries for two and three dimensional problems to demonstrate the method's performance.


Regularity and stability of feedback relaxed controls. This paper proposes a relaxed control regularization with general exploration rewards to design robust feedback controls for multi dimensional continuous time stochastic exit time problems. We establish that the regularized control problem admits a H " o lder continuous feedback control, and demonstrate that both the value function and the feedback control of the regularized control problem are Lipschitz stable with respect to parameter perturbations. Moreover, we show that a pre computed feedback relaxed control has a robust performance in a perturbed system, and derive a first order sensitivity equation for both the value function and optimal feedback relaxed control. These stability results provide a theoretical justification for recent reinforcement learning heuristics that including an exploration reward in the optimization objective leads to more robust decision making. We finally prove first order monotone convergence of the value functions for relaxed control problems with vanishing exploration parameters, which subsequently enables us to construct the pure exploitation strategy of the original control problem based on the feedback relaxed controls.


Highly edge connected regular graphs without large factorizable subgraphs. We construct highly edge connected r regular graph which do not contain r 2 pairwise disjoint perfect matchings. The results partially answer a question stated by Thomassen Factorizing regular graphs, J. Comb. Theory Ser. B (2019), https doi.org 10.1016 j.jctb.2019.05.002 (article in press) .


Robot Calligraphy using Pseudospectral Optimal Control in Conjunction with a Novel Dynamic Brush Model. Chinese calligraphy is a unique art form with great artistic value but difficult to master. In this paper, we formulate the calligraphy writing problem as a trajectory optimization problem, and propose an improved virtual brush model for simulating the real writing process. Our approach is inspired by pseudospectral optimal control in that we parameterize the actuator trajectory for each stroke as a Chebyshev polynomial. The proposed dynamic virtual brush model plays a key role in formulating the objective function to be optimized. Our approach shows excellent performance in drawing aesthetically pleasing characters, and does so much more efficiently than previous work, opening up the possibility to achieve real time closed loop control.


Maximizing robustness of point set registration by leveraging non convexity. Point set registration is a classical image processing problem that looks for the optimal transformation between two sets of points. In this work, we analyze the impact of outliers when finding the optimal rotation between two point clouds. The presence of outliers motivates the use of least unsquared deviation, which is a non smooth minimization problem over non convex domain. We compare approaches based on non convex optimization over special orthogonal group and convex relaxations. We show that if the fraction of outliers is larger than a certain threshold, any naive convex relaxation fails to recover the ground truth rotation regardless of the sample size and dimension. In contrast, minimizing the least unsquared deviation directly over the special orthogonal group exactly recovers the ground truth rotation for any level of corruption as long as the sample size is large enough. These theoretical findings are supported by numerical simulations.


Multi View Stereo by Temporal Nonparametric Fusion. We propose a novel idea for depth estimation from multi view image pose pairs, where the model has capability to leverage information from previous latent space encodings of the scene. This model uses pairs of images and poses, which are passed through an encoder decoder model for disparity estimation. The novelty lies in soft constraining the bottleneck layer by a nonparametric Gaussian process prior. We propose a pose kernel structure that encourages similar poses to have resembling latent spaces. The flexibility of the Gaussian process (GP) prior provides adapting memory for fusing information from previous views. We train the encoder decoder and the GP hyperparameters jointly end to end. In addition to a batch method, we derive a lightweight estimation scheme that circumvents standard pitfalls in scaling Gaussian process inference, and demonstrate how our scheme can run in real time on smart devices.


Virtual Complete Intersections in mathbb P 1 times mathbb P 1 . The minimal free resolution of the coordinate ring of a complete intersection in projective space is a Koszul complex on a regular sequence. In the product of projective spaces mathbb P 1 times mathbb P 1 , we investigate which sets of points have a virtual resolution that is a Koszul complex on a regular sequence. This paper provides conditions on sets of points some of which guarantee the points have this property, and some of which guarantee the points do not have this property.


Stochasticity and heterogeneity in the transmission dynamics of SARS CoV 2. SARS CoV 2 causing COVID 19 disease has moved rapidly around the globe, infecting millions and killing hundreds of thousands. The basic reproduction number, which has been widely used and misused to characterize the transmissibility of the virus, hides the fact that transmission is stochastic, is dominated by a small number of individuals, and is driven by super spreading events (SSEs). The distinct transmission features, such as high stochasticity under low prevalence, and the central role played by SSEs on transmission dynamics, should not be overlooked. Many explosive SSEs have occurred in indoor settings stoking the pandemic and shaping its spread, such as long term care facilities, prisons, meat packing plants, fish factories, cruise ships, family gatherings, parties and night clubs. These SSEs demonstrate the urgent need to understand routes of transmission, while posing an opportunity that outbreak can be effectively contained with targeted interventions to eliminate SSEs. Here, we describe the potential types of SSEs, how they influence transmission, and give recommendations for control of SARS CoV 2.


TreeCaps Tree Based Capsule Networks for Source Code Processing. Recently program learning techniques have been proposed to process source code based on syntactical structures (e.g., Abstract Syntax Trees) and or semantic information (e.g., Dependency Graphs). Although graphs may be better at capturing various viewpoints of code semantics than trees, constructing graph inputs from code needs static code semantic analysis that may not be accurate and introduces noise during learning. Although syntax trees are precisely defined according to the language grammar and easier to construct and process than graphs, previous tree based learning techniques have not been able to learn semantic information from trees to achieve better accuracy than graph based techniques. We propose a new learning technique, named TreeCaps, by fusing together capsule networks with tree based convolutional neural networks, to achieve learning accuracy higher than existing graph based techniques while it is based only on trees. TreeCaps introduces novel variable to static routing algorithms into the capsule networks to compensate for the loss of previous routing algorithms. Aside from accuracy, we also find that TreeCaps is the most robust to withstand those semantic preserving program transformations that change code syntax without modifying the semantics. Evaluated on a large number of Java and C C programs, TreeCaps models outperform prior deep learning models of program source code, in terms of both accuracy and robustness for program comprehension tasks such as code functionality classification and function name prediction


Amharic Abstractive Text Summarization. Text Summarization is the task of condensing long text into just a handful of sentences. Many approaches have been proposed for this task, some of the very first were building statistical models (Extractive Methods) capable of selecting important words and copying them to the output, however these models lacked the ability to paraphrase sentences, as they simply select important words without actually understanding their contexts nor understanding their meaning, here comes the use of Deep Learning based architectures (Abstractive Methods), which effectively tries to understand the meaning of sentences to build meaningful summaries. In this work we discuss one of these new novel approaches which combines curriculum learning with Deep Learning, this model is called Scheduled Sampling. We apply this work to one of the most widely spoken African languages which is the Amharic Language, as we try to enrich the African NLP community with top notch Deep Learning architectures.


Deep Drone Acrobatics. Performing acrobatic maneuvers with quadrotors is extremely challenging. Acrobatic flight requires high thrust and extreme angular accelerations that push the platform to its physical limits. Professional drone pilots often measure their level of mastery by flying such maneuvers in competitions. In this paper, we propose to learn a sensorimotor policy that enables an autonomous quadrotor to fly extreme acrobatic maneuvers with only onboard sensing and computation. We train the policy entirely in simulation by leveraging demonstrations from an optimal controller that has access to privileged information. We use appropriate abstractions of the visual input to enable transfer to a real quadrotor. We show that the resulting policy can be directly deployed in the physical world without any fine tuning on real data. Our methodology has several favorable properties it does not require a human expert to provide demonstrations, it cannot harm the physical system during training, and it can be used to learn maneuvers that are challenging even for the best human pilots. Our approach enables a physical quadrotor to fly maneuvers such as the Power Loop, the Barrel Roll, and the Matty Flip, during which it incurs accelerations of up to 3g.


Modelling of flow through spatially varying porous media with application to topology optimization. The objective of this study is to highlight the effect of porosity variation in a topology optimization process in the field of fluid dynamics. Usually a penalization term added to momentum equation provides to get material distribution. Every time material is added inside the computational domain, there is creation of new fluid solid interfaces and apparition of gradient of porosity. However, at present, porosity variation is not taken account in topology optimization and the penalization term used to locate the solid is analogous to a Darcy term used for flows in porous media. With that in mind, in this paper, we first develop an original one domain macroscopic model for the modelling of flow through spatially varying porous media that goes beyond the scope of Darcy regime. Next, we numerically solve a topology optimization problem and compare the results obtained with the standard model that does not include effect of porosity variation with those obtained with our model. Among our results, we show for instance that the designs obtained are different but percentages of reduction of objective functional remain quite close (below 4 of difference). In addition, we illustrate effects of porosity and particle diameter values on final optimized designs.


Mixed projection and density based topology optimization with applications to structural assemblies. In this paper we present a mixed projection and density based topology optimization approach. The aim is to combine the benefits of both parametrizations the explicit geometric representation provides specific controls on certain design regions while the implicit density representation provides the ultimate design freedom elsewhere. This approach is particularly suited for structural assemblies, where the optimization of the structural topology is coupled with the optimization of the shape of the interface between the sub components in a unified formulation. The interface between the assemblies is defined by a segmented profile made of linear geometric entities. The geometric coordinates of the nodes connecting the profile segments are used as shape variables in the problem, together with density variables as in conventional topology optimization. The variable profile is used to locally impose specific geometric constraints or to project particular material properties. Examples of the properties considered herein are a local volume constraint, a local maximum length scale control, a variable Young's modulus for the distributed solid material, and spatially variable minimum and maximum length scale. The resulting optimization approach is general and various geometric entities can be used. The potential for complex design manipulations is demonstrated through several numerical examples.


Sequential vs. Integrated Algorithm Selection and Configuration A Case Study for the Modular CMA ES. When faced with a specific optimization problem, choosing which algorithm to use is always a tough task. Not only is there a vast variety of algorithms to select from, but these algorithms often are controlled by many hyperparameters, which need to be tuned in order to achieve the best performance possible. Usually, this problem is separated into two parts algorithm selection and algorithm configuration. With the significant advances made in Machine Learning, however, these problems can be integrated into a combined algorithm selection and hyperparameter optimization task, commonly known as the CASH problem. In this work we compare sequential and integrated algorithm selection and configuration approaches for the case of selecting and tuning the best out of 4608 variants of the Covariance Matrix Adaptation Evolution Strategy (CMA ES) tested on the Black Box Optimization Benchmark (BBOB) suite. We first show that the ranking of the modular CMA ES variants depends to a large extent on the quality of the hyperparameters. This implies that even a sequential approach based on complete enumeration of the algorithm space will likely result in sub optimal solutions. In fact, we show that the integrated approach manages to provide competitive results at a much smaller computational cost. We also compare two different mixed integer algorithm configuration techniques, called irace and Mixed Integer Parallel Efficient Global Optimization (MIP EGO). While we show that the two methods differ significantly in their treatment of the exploration exploitation balance, their overall performances are very similar.


Domain specific BERT representation for Named Entity Recognition of lab protocol. Supervised models trained to predict properties from representations have been achieving high accuracy on a variety of tasks. For instance, the BERT family seems to work exceptionally well on the downstream task from NER tagging to the range of other linguistic tasks. But the vocabulary used in the medical field contains a lot of different tokens used only in the medical industry such as the name of different diseases, devices, organisms, medicines, etc. that makes it difficult for traditional BERT model to create contextualized embedding. In this paper, we are going to illustrate the System for Named Entity Tagging based on Bio Bert. Experimental results show that our model gives substantial improvements over the baseline and stood the fourth runner up in terms of F1 score, and first runner up in terms of Recall with just 2.21 F1 score behind the best one.


ECH capacities and the Ruelle invariant. The ECH capacities are a sequence of real numbers associated to any symplectic four manifold, which are monotone with respect to symplectic embeddings. It is known that for a compact star shaped domain in R 4, the ECH capacities asymptotically recover the volume of the domain. We conjecture, with a heuristic argument, that generically the error term in this asymptotic formula converges to a constant determined by a "Ruelle invariant" which measures the average rotation of the Reeb flow on the boundary. Our main result is a proof of this conjecture for a large class of toric domains. As a corollary, we obtain a general obstruction to symplectic embeddings of open toric domains with the same volume. For more general domains in R 4, we bound the error term with an improvement on the previously known exponent from 2 5 to 1 4.


Evaluating the Effect of Crutch using on Trunk Muscle Loads. As a traditional tool of external assistance, crutches play an important role in society. They have a wide range of applications to help either the elderly and disabled to walk or to treat certain illnesses or for post operative rehabilitation. But there are many different types of crutches, including shoulder crutches and elbow crutches. How to choose has become an issue that deserves to be debated. Because while crutches help people walk, they also have an impact on the body. Inappropriate choice of crutches or long term misuse can lead to problems such as scoliosis. Previous studies were mainly experimental measurements or the construction of dynamic models to calculate the load on joints with crutches. These studies focus only on the level of the joints, ignoring the role that muscles play in this process. Although some also take into account the degree of muscle activation, there is still a lack of quantitative analysis. The traditional dynamic model can be used to calculate the load on each joint. However, due to the activation of the muscle, this situation only causes part of the load transmitted to the joint, and the work of the chair will compensate the other part of the load. Analysis at the muscle level allows a better understanding of the impact of crutches on the body. By comparing the levels of activation of the trunk muscles, it was found that the use of crutches for walking, especially a single crutch, can cause a large difference in the activation of the back muscles on the left and right sides, and this difference will cause muscle degeneration for a long time, leading to scoliosis. In this article taking scoliosis as an example, by analyzing the muscles around the spine, we can better understand the pathology and can better prevent diseases. The objective of this article is to analyze normal walking compared to walking with one or two crutches using OpenSim software to obtain the degree of activation of different muscles in order to analyze the impact of crutches on the body.


Functional inequalities for a class of nonlocal hypoelliptic equations of H "ormander type. We consider a class of second order partial differential operators mathscr A of H "ormander type, which contain as a prototypical example a well studied operator introduced by Kolmogorov in the '30s. We analyze some properties of the nonlocal operators driven by the fractional powers of mathscr A , and we introduce some interpolation spaces related to them. We also establish sharp pointwise estimates of Harnack type for the semigroup associated with the extension operator. Moreover, we prove both global and localised versions of Poincar 'e inequalities adapted to the underlying geometry.


Iris Verification with Convolutional Neural Network and Unit Circle Layer. We propose a novel convolutional neural network to verify a match between two normalized images of the human iris. The network is trained end to end and validated on three publicly available datasets yielding state of the art results against four baseline methods. The network performs better by a 10 margin to the state of the art method on the CASIA.v4 dataset. In the network, we use a novel Unit Circle Layer layer which replaces the Gabor filtering step in a common iris verification pipeline. We show that the layer improves the performance of the model up to 15 on previously unseen data.


Efficient video annotation with visual interpolation and frame selection guidance. We introduce a unified framework for generic video annotation with bounding boxes. Video annotation is a longstanding problem, as it is a tedious and time consuming process. We tackle two important challenges of video annotation (1) automatic temporal interpolation and extrapolation of bounding boxes provided by a human annotator on a subset of all frames, and (2) automatic selection of frames to annotate manually. Our contribution is two fold first, we propose a model that has both interpolating and extrapolating capabilities second, we propose a guiding mechanism that sequentially generates suggestions for what frame to annotate next, based on the annotations made previously. We extensively evaluate our approach on several challenging datasets in simulation and demonstrate a reduction in terms of the number of manual bounding boxes drawn by 60 over linear interpolation and by 35 over an off the shelf tracker. Moreover, we also show 10 annotation time improvement over a state of the art method for video annotation with bounding boxes 25 . Finally, we run human annotation experiments and provide extensive analysis of the results, showing that our approach reduces actual measured annotation time by 50 compared to commonly used linear interpolation.


The operatorname Ext algebra of standard modules over dual extension algebras. We exhibit an isomorphism of associative algebras between the operatorname Ext algebra operatorname Ext Lambda ast( Delta, Delta) of standard modules over the dual extension algebra Lambda of two directed algebras B and A and the dual extension algebra of the operatorname Ext algebra operatorname Ext B ast( mathbb L , mathbb L ) with A . There are natural A infty structures on these operatorname Ext algebras, and, under certain technical assumptions on B , we describe that on operatorname Ext Lambda ast( Delta, Delta) completely in terms of that on operatorname Ext B ast( mathbb L , mathbb L ) . As an example, we compute these A infty structures explicitly in the case where B A K mathbb A n ( operatorname rad K mathbb A n) ell .


A Tunable Robust Pruning Framework Through Dynamic Network Rewiring of DNNs. This paper presents a dynamic network rewiring (DNR) method to generate pruned deep neural network (DNN) models that are robust against adversarial attacks yet maintain high accuracy on clean images. In particular, the disclosed DNR method is based on a unified constrained optimization formulation using a hybrid loss function that merges ultra high model compression with robust adversarial training. This training strategy dynamically adjusts inter layer connectivity based on per layer normalized momentum computed from the hybrid loss function. In contrast to existing robust pruning frameworks that require multiple training iterations, the proposed learning strategy achieves an overall target pruning ratio with only a single training iteration and can be tuned to support both irregular and structured channel pruning. To evaluate the merits of DNR, experiments were performed with two widely accepted models, namely VGG16 and ResNet 18, on CIFAR 10, CIFAR 100 as well as with VGG16 on Tiny ImageNet. Compared to the baseline uncompressed models, DNR provides over20x compression on all the datasets with no significant drop in either clean or adversarial classification accuracy. Moreover, our experiments show that DNR consistently finds compressed models with better clean and adversarial image classification performance than what is achievable through state of the art alternatives.


Optimum design of tracking bifacial solar farms A comprehensive global analysis of next generation PV. The bifacial gain of East West vertical and South facing optimally tilted bifacial farms are well established. One wonders if bifacial gain (and the associated LCOE) may be further improved by tracking the sun. Tracking bifacial PV has advantages of improved temperature sensitivity, enhanced diffuse and albedo light collection, flattened energy output, reduced soiling, etc. Monofacial tracking already provides many of these advantages, therefore the relative merits of bifacial tracking are not obvious. In this paper, we use a detailed illumination and temperature dependent bifacial solar farm model to show that bifacial tracking PV delivers up to 45 energy gain when compared to fixed tilt bifacial PV near the equator, and 10 bifacial energy gain over tracking monofacial farm with an albedo of 0.5. An optimum pitch further improves the gain of a tracking bifacial farm. Our results will broaden the scope and understanding of bifacial technology by demonstrating global trends in energy gain for worldwide deployment.


Small Survey Event Detection. A small survey on event detection using Twitter. This work first defines the problem statement, and then summarizes and collates the different research works towards solving the problem.


NP Reasoning in the Monotone mu Calculus. Satisfiability checking for monotone modal logic is known to be (only) NP complete. We show that this remains true when the logic is extended with aconjunctive and alternation free fixpoint operators as well as the universal modality the resulting logic the aconjunctive alternation free monotone mu calculus with the universal modality contains both concurrent propositional dynamic logic (CPDL) and the alternation free fragment of game logic as fragments. We obtain our result from a characterization of satisfiability by means of B "uchi games with polynomially many Eloise nodes.


Singularities in Fluid Mechanics. Singularities of the Navier Stokes equations occur when some derivative of the velocity field is infinite at any point of a field of flow (or, in an evolving flow, becomes infinite at any point within a finite time). Such singularities can be mathematical (as e.g. in two dimensional flow near a sharp corner, or the collapse of a Mobius strip soap film onto a wire boundary) in which case they can be resolved by refining the geometrical description or they can be physical (as e.g. in the case of cusp singularities at a fluid fluid interface) in which case resolution of the singularity involves incorporation of additional physical effects these examples will be briefly reviewed. The finite time singularity problem for the Navier Stokes equations will then be discussed and a recently developed analytical approach will be presented here it will be shown that, even when viscous vortex reconnection is taken into account, there is indeed a physical singularity, in that, at sufficiently high Reynolds number, vorticity can be amplified by an arbitrarily large factor in an extremely small point neighbourhood within a finite time, and this behaviour is not resolved by viscosity. Similarities with the soap film collapse and free surface cusping problems are noted in the concluding section, and the implications for turbulence are considered.


A method for simulating interfacial mass transfer on arbitrary meshes. This paper presents a method for modelling interfacial mass transfer in Interface Capturing simulations of two phase flow with phase change. The model enables mechanistic prediction of the local rate of phase change at the vapour liquid interface on arbitrary computational meshes and is applicable to realistic cases involving two phase mixtures with large density ratios. The simulation methodology is based on the Volume Of Fluid (VOF) representation of the flow, whereby an interfacial region in which mass transfer occurs is implicitly identified by a phase indicator, in this case the volume fraction of liquid, which varies from the value pertaining to the "bulk" liquid to the value of the bulk vapour. The novel methodology proposed here has been implemented using the Finite Volume framework and solution methods typical of "industrial" CFD practice. The proposed methodology for capturing mass transfer is applicable to arbitrary meshes without the need to introduce elaborate but artificial smearing of the mass transfer term as is often done in other techniques. The method has been validated via comparison with analytical solutions for planar interface evaporation and bubble growth test cases, and against experimental observations of steam bubble growth.


CityLearn Standardizing Research in Multi Agent Reinforcement Learning for Demand Response and Urban Energy Management. Rapid urbanization, increasing integration of distributed renewable energy resources, energy storage, and electric vehicles introduce new challenges for the power grid. In the US, buildings represent about 70 of the total electricity demand and demand response has the potential for reducing peaks of electricity by about 20 . Unlocking this potential requires control systems that operate on distributed systems, ideally data driven and model free. For this, reinforcement learning (RL) algorithms have gained increased interest in the past years. However, research in RL for demand response has been lacking the level of standardization that propelled the enormous progress in RL research in the computer science community. To remedy this, we created CityLearn, an OpenAI Gym Environment which allows researchers to implement, share, replicate, and compare their implementations of RL for demand response. Here, we discuss this environment and The CityLearn Challenge, a RL competition we organized to propel further progress in this field.


Growing a Brain Fine Tuning by Increasing Model Capacity. CNNs have made an undeniable impact on computer vision through the ability to learn high capacity models with large annotated training sets. One of their remarkable properties is the ability to transfer knowledge from a large source dataset to a (typically smaller) target dataset. This is usually accomplished through fine tuning a fixed size network on new target data. Indeed, virtually every contemporary visual recognition system makes use of fine tuning to transfer knowledge from ImageNet. In this work, we analyze what components and parameters change during fine tuning, and discover that increasing model capacity allows for more natural model adaptation through fine tuning. By making an analogy to developmental learning, we demonstrate that "growing" a CNN with additional units, either by widening existing layers or deepening the overall network, significantly outperforms classic fine tuning approaches. But in order to properly grow a network, we show that newly added units must be appropriately normalized to allow for a pace of learning that is consistent with existing units. We empirically validate our approach on several benchmark datasets, producing state of the art results.


Quantification of the Leakage in Federated Learning. With the growing emphasis on users' privacy, federated learning has become more and more popular. Many architectures have been raised for a better security. Most architecture work on the assumption that data's gradient could not leak information. However, some work, recently, has shown such gradients may lead to leakage of the training data. In this paper, we discuss the leakage based on a federated approximated logistic regression model and show that such gradient's leakage could leak the complete training data if all elements of the inputs are either 0 or 1.


Nonlinear problem involving the fractional p(x) Laplacian operator by Topological degree. This paper is concerned with the study of a nonlinear problems involving the fractional p(x) Laplacian operator. By means of the Berkovits degree theory, we prove the existence of nontrivial weak solutions for this problem. The appropriate functional framework for this problems is the fractional Sobolev spaces with variable exponent.


Scene Graph to Image Generation with Contextualized Object Layout Refinement. Generating images from scene graphs is a challenging task that attracted substantial interest recently. Prior works have approached this task by generating an intermediate layout description of the target image. However, the representation of each object in the layout was generated independently, which resulted in high overlap, low coverage, and an overall blurry layout. We propose a novel method that alleviates these issues by generating the entire layout description gradually to improve inter object dependency. We empirically show on the COCO STUFF dataset that our approach improves the quality of both the intermediate layout and the final image. Our approach improves the layout coverage by almost 20 points and drops object overlap to negligible amounts.


The Selberg Trace Formula IX Contribution from the Conjugacy Classes (The Regular Case). This paper initiates a study into the contribution to the trace provided by the conjugacy classes.


EvilCoder Automated Bug Insertion. The art of finding software vulnerabilities has been covered extensively in the literature and there is a huge body of work on this topic. In contrast, the intentional insertion of exploitable, security critical bugs has received little (public) attention yet. Wanting more bugs seems to be counterproductive at first sight, but the comprehensive evaluation of bug finding techniques suffers from a lack of ground truth and the scarcity of bugs. In this paper, we propose EvilCoder, a system to automatically find potentially vulnerable source code locations and modify the source code to be actually vulnerable. More specifically, we leverage automated program analysis techniques to find sensitive sinks which match typical bug patterns (e.g., a sensitive API function with a preceding sanity check), and try to find data flow connections to user controlled sources. We then transform the source code such that exploitation becomes possible, for example by removing or modifying input sanitization or other types of security checks. Our tool is designed to randomly pick vulnerable locations and possible modifications, such that it can generate numerous different vulnerabilities on the same software corpus. We evaluated our tool on several open source projects such as for example libpng and vsftpd, where we found between 22 and 158 unique connected source sink pairs per project. This translates to hundreds of potentially vulnerable data flow paths and hundreds of bugs we can insert. We hope to support future bug finding techniques by supplying freshly generated, bug ridden test corpora so that such techniques can (finally) be evaluated and compared in a comprehensive and statistically meaningful way.


Balancing Cost and Benefit with Tied Multi Transformers. We propose and evaluate a novel procedure for training multiple Transformers with tied parameters which compresses multiple models into one enabling the dynamic choice of the number of encoder and decoder layers during decoding. In sequence to sequence modeling, typically, the output of the last layer of the N layer encoder is fed to the M layer decoder, and the output of the last decoder layer is used to compute loss. Instead, our method computes a single loss consisting of NxM losses, where each loss is computed from the output of one of the M decoder layers connected to one of the N encoder layers. Such a model subsumes NxM models with different number of encoder and decoder layers, and can be used for decoding with fewer than the maximum number of encoder and decoder layers. We then propose a mechanism to choose a priori the number of encoder and decoder layers for faster decoding, and also explore recurrent stacking of layers and knowledge distillation for model compression. We present a cost benefit analysis of applying the proposed approaches for neural machine translation and show that they reduce decoding costs while preserving translation quality.


Early decarbonisation of the European energy system pays off. For a given carbon budget over several decades, different transformation rates for the energy system yield starkly different results. Here we consider a budget of 33 GtCO2 for the cumulative carbon dioxide emissions from the European electricity, heating, and transport sectors between 2020 and 2050, which represents Europe's contribution to the Paris Agreement. We have found that following an early and steady path in which emissions are strongly reduced in the first decade is more cost effective than following a late and rapid path in which low initial reduction targets quickly deplete the carbon budget and require a sharp reduction later. We show that solar photovoltaic, onshore and offshore wind can become the cornerstone of a fully decarbonised energy system and that installation rates similar to historical maxima are required to achieve timely decarbonisation. Key to those results is a proper representation of existing balancing strategies through an open, hourly resolved, networked model of the sector coupled European energy system.


Synthesizing Safe Policies under Probabilistic Constraints with Reinforcement Learning and Bayesian Model Checking. We propose to leverage epistemic uncertainty about constraint satisfaction of a reinforcement learner in safety critical domains. We introduce a framework for specification of requirements for reinforcement learners in constrained settings, including confidence about results. We show that an agent's confidence in constraint satisfaction provides a useful signal for balancing optimization and safety in the learning process.


Coarse graining of non reversible stochastic differential equations quantitative results and connections to averaging. This work is concerned with model reduction of stochastic differential equations and builds on the idea of replacing drift and noise coefficients of preselected relevant, e.g. slow variables by their conditional expectations. We extend recent results by Legoll Leli evre Nonlinearity 23, 2131, 2010 and Duong et al. Nonlinearity 31, 4517, 2018 on effective reversible dynamics by conditional expectations to the setting of general non reversible processes with non constant diffusion coefficient. We prove relative entropy and Wasserstein error estimates for the difference between the time marginals of the effective and original dynamics as well as an entropy error bound for the corresponding path space measures. A comparison with the averaging principle for systems with time scale separation reveals that, unlike in the reversible setting, the effective dynamics for a non reversible system need not agree with the averaged equations. We present a thorough comparison for the Ornstein Uhlenbeck process and make a conjecture about necessary and sufficient conditions for when averaged and effective dynamics agree for nonlinear non reversible processes. The theoretical results are illustrated with suitable numerical examples.


An upper bound on the topological complexity of discriminantal varieties. We give an upper bound on the topological complexity of varieties mathcal V obtained as complements in mathbb C m of the zero locus of a polynomial. As an application, we determine the topological complexity of unordered configuration spaces of the plane.


Tweaking Ramanujan's Approximation of n!. In 1730 James Stirling, building on the work of Abraham de Moivre, published what is known as Stirling's approximation of n! . He gave a good formula which is asymptotic to n! . Since then hundreds of papers have given alternative proofs of his result and improved upon it, including notably by Burside, Gosper, and Mortici. However Srinivasa Ramanujan gave a remarkably better asymptotic formula. Hirschhorn and Villarino gave a nice proof of Ramanujan's result and an error estimate for the approximation. In recent years there have been several improvements of Stirling's formula including by Nemes, Windschitl, and Chen. Here it is shown (i) how all these asymptotic results can be easily verified (ii) how Hirschhorn and Villarino's argument allows a tweaking of Ramanujan's result to give a better approximation (iii) that a new asymptotic formula can be obtained by further tweaking of Ramanujan's result (iv) that Chen's asymptotic formula is better than the others mentioned here, and the new asymptotic formula is comparable with Chen's.


A general approach to nonautonomous shadowing for nonlinear dynamics. Given a nonautonomous and nonlinear differential equation begin equation label DE x' A(t)x f(t,x) quad t geq 0, end equation on an arbitrary Banach space X , we formulate very general conditions for the associated linear equation x' A(t)x and for the nonlinear term f 0, infty) times X to X under which the above system satisfies an appropriate version of the shadowing property. More precisely, we require that x' A(t)x admits a very general type of dichotomy, which includes the classical hyperbolic behaviour as a very particular case. In addition, we require that f is Lipschitz in the second variable with a sufficiently small Lipschitz constant. Our general framework enables us to treat various settings in which no shadowing result has been previously obtained. Moreover, we are able to recover and refine several known results. We also show how our main results can be applied to the study of the shadowing property for higher order differential equations. Finally, we conclude the paper by presenting a discrete time versions of our results.


Analytical Approximate Solution of a Coupled Two Frequency Hill's Equation. A coupled two frequency Hill's equation is solved. Analytically approximate solution correct up to first order is derived using modified Lindstedt Poincare perturbation method. For a wide range of controlling parameters we compare the numerical and analytical solutions. The solution is the first step towards developing a comprehensive understanding of the electrodynamics of charged particles in a combinational ion trap utilizing both electrostatic DC and RF fields along with a constant static magnetic field with prospects of confining antimatter such as anti hydrogen for a reasonably long durations of time.


Online Multi Object Tracking and Segmentation with GMPHD Filter and Mask based Affinity Fusion. In this paper, we propose a highly practical fully online multi object tracking and segmentation (MOTS) method that uses instance segmentation results as an input. The proposed method is based on the Gaussian mixture probability hypothesis density (GMPHD) filter, a hierarchical data association (HDA), and a mask based affinity fusion (MAF) model to achieve high performance online tracking. The HDA consists of two associations segment to track and track to track associations. One affinity, for position and motion, is computed by using the GMPHD filter, and the other affinity, for appearance is computed by using the responses from a single object tracker such as a kernalized correlation filter. These two affinities are simply fused by using a score level fusion method such as min max normalization referred to as MAF. In addition, to reduce the number of false positive segments, we adopt mask IoU based merging (mask merging). The proposed MOTS framework with the key modules HDA, MAF, and mask merging, is easily extensible to simultaneously track multiple types of objects with CPU only execution in parallel processing. In addition, the developed framework only requires simple parameter tuning unlike many existing MOTS methods that need intensive hyperparameter optimization. In the experiments on the two popular MOTS datasets, the key modules show some improvements. For instance, ID switch decreases by more than half compared to a baseline method in the training sets. In conclusion, our tracker achieves state of the art MOTS performance in the test sets.


PathGAN Local Path Planning with Attentive Generative Adversarial Networks. To achieve autonomous driving without high definition maps, we present a model capable of generating multiple plausible paths from egocentric images for autonomous vehicles. Our generative model comprises two neural networks the feature extraction network (FEN) and path generation network (PGN). The FEN extracts meaningful features from an egocentric image, whereas the PGN generates multiple paths from the features, given a driving intention and speed. To ensure that the paths generated are plausible and consistent with the intention, we introduce an attentive discriminator and train it with the PGN under generative adversarial networks framework. We also devise an interaction model between the positions in the paths and the intentions hidden in the positions and design a novel PGN architecture that reflects the interaction model, resulting in the improvement of the accuracy and diversity of the generated paths. Finally, we introduce ETRIDriving, a dataset for autonomous driving in which the recorded sensor data are labeled with discrete high level driving actions, and demonstrate the state of the art performance of the proposed model on ETRIDriving in terms of accuracy and diversity.


Simplified Action Decoder for Deep Multi Agent Reinforcement Learning. In recent years we have seen fast progress on a number of benchmark problems in AI, with modern methods achieving near or super human performance in Go, Poker and Dota. One common aspect of all of these challenges is that they are by design adversarial or, technically speaking, zero sum. In contrast to these settings, success in the real world commonly requires humans to collaborate and communicate with others, in settings that are, at least partially, cooperative. In the last year, the card game Hanabi has been established as a new benchmark environment for AI to fill this gap. In particular, Hanabi is interesting to humans since it is entirely focused on theory of mind, i.e., the ability to effectively reason over the intentions, beliefs and point of view of other agents when observing their actions. Learning to be informative when observed by others is an interesting challenge for Reinforcement Learning (RL) Fundamentally, RL requires agents to explore in order to discover good policies. However, when done naively, this randomness will inherently make their actions less informative to others during training. We present a new deep multi agent RL method, the Simplified Action Decoder (SAD), which resolves this contradiction exploiting the centralized training phase. During training SAD allows other agents to not only observe the (exploratory) action chosen, but agents instead also observe the greedy action of their team mates. By combining this simple intuition with best practices for multi agent learning, SAD establishes a new SOTA for learning methods for 2 5 players on the self play part of the Hanabi challenge. Our ablations show the contributions of SAD compared with the best practice components. All of our code and trained agents are available at https github.com facebookresearch Hanabi SAD.


Nonabelian Hodge theory for Fujiki class mathcal C manifolds. The nonabelian Hodge correspondence (Corlette Simpson correspondence), between the polystable Higgs bundles with vanishing Chern classes on a compact K "ahler manifold X and the completely reducible flat connections on X , is extended to the Fujiki class mathcal C manifolds.


Replication Markets Results, Lessons, Challenges and Opportunities in AI Replication. The last decade saw the emergence of systematic large scale replication projects in the social and behavioral sciences, (Camerer et al., 2016, 2018 Ebersole et al., 2016 Klein et al., 2014, 2018 Collaboration, 2015). These projects were driven by theoretical and conceptual concerns about a high fraction of "false positives" in the scientific publications (Ioannidis, 2005) (and a high prevalence of "questionable research practices" (Simmons, Nelson, and Simonsohn, 2011). Concerns about the credibility of research findings are not unique to the behavioral and social sciences within Computer Science, Artificial Intelligence (AI) and Machine Learning (ML) are areas of particular concern (Lucic et al., 2018 Freire, Bonnet, and Shasha, 2012 Gundersen and Kjensmo, 2018 Henderson et al., 2018). Given the pioneering role of the behavioral and social sciences in the promotion of novel methodologies to improve the credibility of research, it is a promising approach to analyze the lessons learned from this field and adjust strategies for Computer Science, AI and ML In this paper, we review approaches used in the behavioral and social sciences and in the DARPA SCORE project. We particularly focus on the role of human forecasting of replication outcomes, and how forecasting can leverage the information gained from relatively labor and resource intensive replications. We will discuss opportunities and challenges of using these approaches to monitor and improve the credibility of research areas in Computer Science, AI, and ML.


Constructive Hybrid Games. Hybrid games are models which combine discrete, continuous, and adversarial dynamics. Game logic enables proving (classical) existence of winning strategies. We introduce constructive differential game logic (CdGL) for hybrid games, where proofs that a player can win the game correspond to computable winning strategies. This is the logical foundation for synthesis of correct control and monitoring code for safety critical cyber physical systems. Our contributions include novel static and dynamic semantics as well as soundness and consistency.


Optimal Patrol of a Perimeter. A defender dispatches patrollers to circumambulate a perimeter to guard against potential attacks. The defender decides on the time points to dispatch patrollers and each patroller's direction and speed, as long as the long run rate patrollers are dispatched is capped at some constant. An attack at any point on the perimeter requires the same amount of time, during which it will be detected by each passing patroller independently with the same probability. The defender wants to maximize the probability of detecting an attack before it completes, while the attacker wants to minimize it. We study two scenarios, depending on whether the patrollers are undercover or wear a uniform. Conventional wisdom would suggest that the attacker gains advantage if he can see the patrollers going by so as to time his attack, but we show that the defender can achieve the same optimal detection probability by carefully spreading out the patrollers probabilistically against a learning attacker.


The homotopy classification of four dimensional toric orbifolds. Let X be a 4 dimensional toric orbifold. If H 3(X) has a non trivial odd primary torsion, then we show that X is homotopy equivalent to the wedge of a Moore space and a CW complex. As a corollary, given two 4 dimensional toric orbifolds having no 2 torsion in the cohomology, we prove that they have the same homotopy type if and only their integral cohomology rings are isomorphic.


Cutting the Unnecessary Long Tail Cost Effective Big Data Clustering in the Cloud. Clustering big data often requires tremendous computational resources where cloud computing is undoubtedly one of the promising solutions. However, the computation cost in the cloud can be unexpectedly high if it cannot be managed properly. The long tail phenomenon has been observed widely in the big data clustering area, which indicates that the majority of time is often consumed in the middle to late stages in the clustering process. In this research, we try to cut the unnecessary long tail in the clustering process to achieve a sufficiently satisfactory accuracy at the lowest possible computation cost. A novel approach is proposed to achieve cost effective big data clustering in the cloud. By training the regression model with the sampling data, we can make widely used k means and EM (Expectation Maximization) algorithms stop automatically at an early point when the desired accuracy is obtained. Experiments are conducted on four popular data sets and the results demonstrate that both k means and EM algorithms can achieve high cost effectiveness in the cloud with our proposed approach. For example, in the case studies with the much more efficient k means algorithm, we find that achieving a 99 accuracy needs only 47.71 71.14 of the computation cost required for achieving a 100 accuracy while the less efficient EM algorithm needs 16.69 32.04 of the computation cost. To put that into perspective, in the United States land use classification example, our approach can save up to 94,687.49 for the government in each use.


Deep Learning for Stable Monotone Dynamical Systems. Monotone systems, originating from real world (e.g., biological or chemical) applications, are a class of dynamical systems that preserves a partial order of system states over time. In this work, we introduce a feedforward neural networks (FNNs) based method to learn the dynamics of unknown stable nonlinear monotone systems. We propose the use of nonnegative neural networks and batch normalization, which in general enables the FNNs to capture the monotonicity conditions without reducing the expressiveness. To concurrently ensure stability during training, we adopt an alternating learning method to simultaneously learn the system dynamics and corresponding Lyapunov function, while exploiting monotonicity of the system. The combination of the monotonicity and stability constraints ensures that the learned dynamics preserves both properties, while significantly reducing learning errors. Finally, our techniques are evaluated on two complex biological and chemical systems.


New Fusion Algorithm provides an alternative approach to Robotic Path planning. For rapid growth in technology and automation, human tasks are being taken over by robots as robots have proven to be better with both speed and precision. One of the major and widespread usages of these robots is in the industrial businesses, where they are employed to carry massive loads in and around work areas. As these working environments might not be completely localized and could be dynamically changing, new approaches must be evaluated to guarantee a crash free way of performing duties. This paper presents a new and efficient fusion algorithm for solving the path planning problem in a custom 2D environment. This fusion algorithm integrates an improved and optimized version of both, A algorithm and the Artificial potential field method. Firstly, an initial or preliminary path is planned in the environmental model by adopting the A algorithm. The heuristic function of this A algorithm is optimized and improved according to the environmental model. This is followed by selecting and saving the key nodes in the initial path. Lastly, on the basis of these saved key nodes, path smoothing is done by artificial potential field method. Our simulation results carried out using Python viz. libraries indicate that the new fusion algorithm is feasible and superior in smoothness performance and can satisfy as a time efficient and cheaper alternative to conventional A strategies of path planning.


Extreme first passage times for random walks on networks. Many biological, social, and communication systems can be modeled by searchers'' moving through a complex network. For example, intracellular cargo is transported on tubular networks, news and rumors spread through online social networks, and the rapid global spread of infectious diseases occurs through passengers traveling on the airport network. To understand the timescale of search transport spread, one commonly studies the first passage time (FPT) of a single searcher (or spreader'') to a target. However, in many scenarios the relevant timescale is not the FPT of a single searcher to a target, but rather the FPT of the fastest searcher to a target out of many searchers. For example, many processes in cell biology are triggered by the first molecule to find a target out of many, and the time it takes an infectious disease to reach a particular city depends on the first infected traveler to arrive out of potentially many infected travelers. Such fastest FPTs are called extreme FPTs. In this paper, we study extreme FPTs for a general class of continuous time random walks on networks (which includes continuous time Markov chains). In the limit of many searchers, we find explicit formulas for the probability distribution and all the moments of the k th fastest FPT. These rigorous formulas depend only on network parameters along a certain geodesic path(s) from the starting location to the target since the fastest searchers take a direct route to the target. Furthermore, our results allow one to estimate if a particular system is in a regime characterized by fast extreme FPTs. We also prove similar results for mortal searchers on a network that are conditioned to find the target before a fast inactivation time. We illustrate our results with numerical simulations and uncover potential pitfalls of modeling diffusive or subdiffusive processes involving extreme statistics.


Dolbeault and J invariant cohomologies on almost complex manifolds. In this paper we relate the cohomology of J invariant forms to the Dolbeault cohomology of an almost complex manifold. We find necessary and sufficient condition for the inclusion of the former into the latter to be true up to isomorphism. We also extend some results obtained by J. Cirici and S.O. Wilson about the computation of the left invariant cohomology of nilmanifolds to the setting of solvmanifolds. Several examples are given.


(In)Existence of Equilibria for 2 Players, 2 Values Games with Concave Valuations. We consider 2 players, 2 values minimization games where the players' costs take on two values, a,b , a b . The players play mixed strategies and their costs are evaluated by unimodal valuations. This broad class of valuations includes all concave, one parameter functions mathsf F 0,1 rightarrow mathbb R with a unique maximum point. Our main result is an impossibility result stating that If the maximum is obtained in (0,1) and mathsf F left( frac 1 2 right) ne b , then there exists a 2 players, 2 values game without mathsf F equilibrium. The counterexample game used for the impossibility result belongs to a new class of very sparse 2 players, 2 values bimatrix games which we call normal games. In an attempt to investigate the remaining case mathsf F left( frac 1 2 right) b , we show that Every normal, n strategies game has an mathsf F equilibrium when mathsf F left( frac 1 2 right) b . We present a linear time algorithm for computing such an equilibrium. For 2 players, 2 values games with 3 strategies we have that if mathsf F left( frac 1 2 right) le b , then every 2 players, 2 values, 3 strategies game has an mathsf F equilibrium if mathsf F left( frac 1 2 right) b , then there exists a normal 2 players, 2 values, 3 strategies game without mathsf F equilibrium. To the best of our knowledge, this work is the first to provide an (almost complete) answer on whether there is, for a given concave function mathsf F , a counterexample game without mathsf F equilibrium.


Dynamic Binary Countdown for Massive IoT Random Access in Dense 5G Networks. Massive connectivity for Internet of Things applications is expected to challenge the way access reservation protocols are designed in 5G networks. Since the number of devices and their density are envisioned to be orders of magnitude larger, state of the art access reservation, Random Access (RA) procedure, might be a bottleneck for end to end delay. This would be especially challenging for burst arrival scenarios Semi synchronous triggering of a large number of devices due to a common event (blackout, emergency alarm, etc.). In this article, to improve RA procedure scalability, we propose to combine Binary Countdown Contention Resolution (BCCR) with the state of the art Access Class Barring (ACB). We present a joint analysis of ACB and BCCR and apply a framework for treating RA as a bi objective optimization, minimizing the resource consumption and maximizing the throughput of the procedure in every contention round. We use this framework to devise dynamic load adaptive algorithm and simulatively illustrate that the proposed algorithm reduces the burst resolution delay while consuming less resources compared to the state of the art techniques.


The log symplectic geometry of Poisson slices. Our paper develops a theory of Poisson slices and a uniform approach to their partial compactifications. The theory in question is loosely comparable to that of symplectic cross sections in real symplectic geometry.


Global logarithmic stability results on the Cauchy problem for anisotropic wave equations. We discuss the Cauchy problem for anisotropic wave equations. Precisely, we address the question to know which kind of Cauchy data on the lateral boundary are necessary to guarantee the uniqueness of continuation of solutions of an anisotropic wave equation. In the case where the uniqueness holds, the natural problem that arise naturally in this context is to estimate the solutions, in some appropriate space, in terms of norms of the Cauchy data. We aim in this paper to convert, via a reduced Fourrier Bros Iagolnitzer transform, the known stability results on the Cauchy problem for elliptic equations to stability results on the Cauchy problem for waves equations. By proceeding in that way the main difficulty is to control the residual terms, induced by the reduced Fourrier Bros Iagolnitzer transform, by the Cauchy data. Also, the uniqueness of continuation from Cauchy data is obtained as byproduct of stability results.


Deep Learning based HEp 2 Image Classification A Comprehensive Review. Classification of HEp 2 cell patterns plays a significant role in the indirect immunofluorescence test for identifying autoimmune diseases in the human body. Many automatic HEp 2 cell classification methods have been proposed in recent years, amongst which deep learning based methods have shown impressive performance. This paper provides a comprehensive review of the existing deep learning based HEp 2 cell image classification methods. These methods perform HEp 2 image classification at two levels, namely, cell level and specimen level. Both levels are covered in this review. At each level, the methods are organized with a deep network usage based taxonomy. The core idea, notable achievements, and key strengths and weaknesses of each method are critically analyzed. Furthermore, a concise review of the existing HEp 2 datasets that are commonly used in the literature is given. The paper ends with a discussion on novel opportunities and future research directions in this field. It is hoped that this paper would provide readers with a thorough reference of this novel, challenging, and thriving field.


Net2 A Graph Attention Network Method Customized for Pre Placement Net Length Estimation. Net length is a key proxy metric for optimizing timing and power across various stages of a standard digital design flow. However, the bulk of net length information is not available until cell placement, and hence it is a significant challenge to explicitly consider net length optimization in design stages prior to placement, such as logic synthesis. This work addresses this challenge by proposing a graph attention network method with customization, called Net2, to estimate individual net length before cell placement. Its accuracy oriented version Net2a achieves about 15 better accuracy than several previous works in identifying both long nets and long critical paths. Its fast version Net2f is more than 1000 times faster than placement while still outperforms previous works and other neural network techniques in terms of various accuracy metrics.


Efficient Hardware Implementation of Incremental Learning and Inference on Chip. In this paper, we tackle the problem of incrementally learning a classifier, one example at a time, directly on chip. To this end, we propose an efficient hardware implementation of a recently introduced incremental learning procedure that achieves state of the art performance by combining transfer learning with majority votes and quantization techniques. The proposed design is able to accommodate for both new examples and new classes directly on the chip. We detail the hardware implementation of the method (implemented on FPGA target) and show it requires limited resources while providing a significant acceleration compared to using a CPU.


Analysis of Multilevel Replicator Dynamics for General Two Strategy Social Dilemmas. Here we consider a game theoretic model of multilevel selection in which individuals compete based on their payoff and groups also compete based on the average payoff of group members. Our focus is on multilevel social dilemmas games in which individuals are best off cheating, while groups of individuals do best when composed of many cooperators. We analyze the dynamics of the two level replicator dynamics, a nonlocal hyperbolic PDE describing deterministic birth death dynamics for both individuals and groups. While past work on such multilevel dynamics has restricted attention to scenarios with exactly solvable within group dynamics, we use comparison principles and an invariant property of the tail of the population distribution to extend our analysis to all possible two player, two strategy social dilemmas. We characterize the threshold level of between group selection dividing a regime in which the population converges to a delta function at the equilibrium of the within group dynamics from a regime in which between group competition facilitates the existence of steady state densities supporting greater levels of cooperation. In particular, we see that the threshold selection strength and average payoff at steady state depend on a tug of war between the individual level incentive to be a defector in a many cooperator group and the group level incentive to have many cooperators over many defectors. We also find that lower level selection casts a long shadow if groups are best off with a mix of cooperators and defectors, then there will always be fewer cooperators than optimal at steady state, even in the limit of infinitely strong competition between groups.


Not so Particular about Calibration Smile Problem Resolved. We present a novel Monte Carlo based LSV calibration algorithm that applies to all stochastic volatility models, including the non Markovian rough volatility family. Our framework overcomes the limitations of the particle method proposed by Guyon and Henry Labord ere (2012) and theoretically guarantees a variance reduction without additional computational complexity. Specifically, we obtain a closed form and exact calibration method that allows us to remove the dependency on both the kernel function and bandwidth parameter. This makes the algorithm more robust and less prone to errors or instabilities in a production environment. We test the efficiency of our algorithm on various hybrid (rough) local stochastic volatility models.