Long exit times near a repelling equilibrium. For a smooth vector field in a neighborhood of a critical point with all positive eigenvalues of the linearization, we consider the associated dynamics perturbed by white noise. Using Malliavin calculus tools, we obtain polynomial asymptotics for probabilities of atypically long exit times in the vanishing noise limit.


Robust Robot assisted Tele grasping Through Intent Uncertainty Aware Planning. In teleoperation, research has mainly focused on target approaching, where we deal with the more challenging object manipulation task by advancing the shared control technique. Appropriately manipulating an object is challenging due to the fine motion constraint requirements for a specific manipulation task. Although these motion constraints are critical for task success, they often are subtle when observing ambiguous human motion. The disembodiment problem and physical discrepancy between the human and robot hands bring additional uncertainty, further exaggerating the complications of the object manipulation task. Moreover, there is a lack of planning and modeling techniques that can effectively combine the human and robot agents' motion input while considering the ambiguity of the human intent. To overcome this challenge, we built a multi task robot grasping model and developed an intent uncertainty aware grasp planner to generate robust grasp poses given the ambiguous human intent inference inputs. With these validated modeling and planning techniques, it is expected to extend teleoperated robots' functionality and adoption in practical telemanipulation scenarios.


Recovery of coefficients for a weighted p Laplacian perturbed by a linear second order term. This paper considers the inverse boundary value problem for the equation nabla cdot( sigma nabla u a nabla u p 2 nabla u) 0 . We give a procedure for the recovery of the coefficients sigma and a from the corresponding Dirichlet to Neumann map, under suitable regularity and ellipticity assumptions.


Is POS Tagging Necessary or Even Helpful for Neural Dependency Parsing?. In the pre deep learning era, part of speech tags have been considered as indispensable ingredients for feature engineering in dependency parsing. But quite a few works focus on joint tagging and parsing models to avoid error propagation. In contrast, recent studies suggest that POS tagging becomes much less important or even useless for neural parsing, especially when using character based word representations. Yet there are not enough investigations focusing on this issue, both empirically and linguistically. To answer this, we design and compare three typical multi task learning framework, i.e., Share Loose, Share Tight, and Stack, for joint tagging and parsing based on the state of the art biaffine parser. Considering that it is much cheaper to annotate POS tags than parse trees, we also investigate the utilization of large scale heterogeneous POS tag data. We conduct experiments on both English and Chinese datasets, and the results clearly show that POS tagging (both homogeneous and heterogeneous) can still significantly improve parsing performance when using the Stack joint framework. We conduct detailed analysis and gain more insights from the linguistic aspect.


Split extensions and semidirect products of unitary magmas. We develop a theory of split extensions of unitary magmas, which includes defining such extensions and describing them via suitably defined semidirect product, yielding an equivalence between the categories of split extensions and of (suitably defined) actions of unitary magmas on unitary magmas. The class of split extensions is pullback stable but not closed under composition. We introduce two subclasses of it that have both of these properties.


Tame torsion, the tame inverse Galois problem, and endomorphisms. Fix a positive integer g and rational prime p . We prove the existence of a genus g curve C mathbb Q such that the mod p representation of its Jacobian is tame by imposing conditions on the endomorphism ring. As an application, we consider the tame inverse Galois problem and are able to realise general symplectic groups as Galois groups of tame extensions of mathbb Q .


Recovering Variable Names for Minified Code with Usage Contexts. In modern Web technology, JavaScript (JS) code plays an important role. To avoid the exposure of original source code, the variable names in JS code deployed in the wild are often replaced by short, meaningless names, thus making the code extremely difficult to manually understand and analysis. This paper presents JSNeat, an information retrieval (IR) based approach to recover the variable names in minified JS code. JSNeat follows a data driven approach to recover names by searching for them in a large corpus of open source JS code. We use three types of contexts to match a variable in given minified code against the corpus including the context of properties and roles of the variable, the context of that variable and relations with other variables under recovery, and the context of the task of the function to which the variable contributes. We performed several empirical experiments to evaluate JSNeat on the dataset of more than 322K JS files with 1M functions, and 3.5M variables with 176K unique variable names. We found that JSNeat achieves a high accuracy of 69.1 , which is the relative improvements of 66.1 and 43 over two state of the art approaches JSNice and JSNaughty, respectively. The time to recover for a file or for a variable with JSNeat is twice as fast as with JSNice and 4x as fast as with JNaughty, respectively.


Observation of stimulated Brillouin scattering in silicon nitride integrated waveguides. Silicon nitride (Si3N4) has emerged as a promising material for integrated nonlinear photonics and has been used for broadband soliton microcombs and low pulse energy supercontinuum generation. Therefore understanding all nonlinear optical properties of Si3N4 is important. So far, only stimulated Brillouin scattering (SBS) has not been reported. Here we observe, for the first time, backward SBS in fully cladded Si3N4 waveguides. The Brillouin gain spectrum exhibits an unusual multi peak structure resulting from hybridization with with high overtone bulk acoustic resonances (HBARs) of the silica cladding. The reported intrinsic Si3N4 Brillouin gain at 25 GHz is estimated as 7x10 13 m W. Moreover, the magnitude of the Si3N4 photoelastic constant is estimated as p12 0.047 0.004. Since SBS imposes an optical power limitation for waveguides, our results explain the capability of Si3N4 to handle high optical power, central for integrated nonlinear photonics.


Filling Conversation Ellipsis for Better Social Dialog Understanding. The phenomenon of ellipsis is prevalent in social conversations. Ellipsis increases the difficulty of a series of downstream language understanding tasks, such as dialog act prediction and semantic role labeling. We propose to resolve ellipsis through automatic sentence completion to improve language understanding. However, automatic ellipsis completion can result in output which does not accurately reflect user intent. To address this issue, we propose a method which considers both the original utterance that has ellipsis and the automatically completed utterance in dialog act and semantic role labeling tasks. Specifically, we first complete user utterances to resolve ellipsis using an end to end pointer network model. We then train a prediction model using both utterances containing ellipsis and our automatically completed utterances. Finally, we combine the prediction results from these two utterances using a selection model that is guided by expert knowledge. Our approach improves dialog act prediction and semantic role labeling by 1.3 and 2.5 in F1 score respectively in social conversations. We also present an open domain human machine conversation dataset with manually completed user utterances and annotated semantic role labeling after manual completion.


Boiling transitions during droplet contact on superheated nano micro structured surfaces. Manipulating surface topography is one of the most promising strategies for increasing the efficiency of numerous industrial processes involving droplet contact with superheated surfaces. In such scenarios, the droplets may immediately boil upon contact, splash and boil, or could levitate on their own vapor in the Leidenfrost state. In this work, we report the outcomes of water droplets coming in gentle contact with designed nano micro textured surfaces at a wide range of temperatures as observed using high speed optical and X ray imaging. We report a paradoxical increase in the Leidenfrost temperature (TLFP) as the texture spacing is reduced below a critical value ( 10 um). Although droplets on such textured solids appear to boil upon contact, our studies suggest that their behavior is dominated by hydrodynamic instabilities implying that the increase in TLFP may not necessarily lead to enhanced heat transfer. On such surfaces, the droplets display a new regime characterized by splashing accompanied by a vapor jet penetrating through the droplets before they transition to the Leidenfrost state. We provide a comprehensive map of boiling behavior of droplets over a wide range of texture spacings that may have significant implications towards applications such as electronics cooling, spray cooling, nuclear reactor safety and containment of fire calamities.


2nd Place Scheme on Action Recognition Track of ECCV 2020 VIPriors Challenges An Efficient Optical Flow Stream Guided Framework. To address the problem of training on small datasets for action recognition tasks, most prior works are either based on a large number of training samples or require pre trained models transferred from other large datasets to tackle overfitting problems. However, it limits the research within organizations that have strong computational abilities. In this work, we try to propose a data efficient framework that can train the model from scratch on small datasets while achieving promising results. Specifically, by introducing a 3D central difference convolution operation, we proposed a novel C3D neural network based two stream (Rank Pooling RGB and Optical Flow) framework for the task. The method is validated on the action recognition track of the ECCV 2020 VIPriors challenges and got the 2nd place (88.31 ). It is proved that our method can achieve a promising result even without a pre trained model on large scale datasets. The code will be released soon.


Energy scaling laws for geometrically linear elasticity models for microstructures in shape memory alloys. We consider a singularly perturbed two well problem in the context of planar geometrically linear elasticity to model a rectangular martensitic nucleus in an austenitic matrix. We derive the scaling regimes for the minimal energy in terms of the problem parameters, which represent the shape of the nucleus, the quotient of the elastic moduli of the two phases, the surface energy constant, and the volume fraction of the two martensitic variants. We identify several different scaling regimes, which are distinguished either by the exponents in the parameters, or by logarithmic corrections, for which we have matching upper and lower bounds.


ViBE Dressing for Diverse Body Shapes. Body shape plays an important role in determining what garments will best suit a given person, yet today's clothing recommendation methods take a "one shape fits all" approach. These body agnostic vision methods and datasets are a barrier to inclusion, ill equipped to provide good suggestions for diverse body shapes. We introduce ViBE, a VIsual Body aware Embedding that captures clothing's affinity with different body shapes. Given an image of a person, the proposed embedding identifies garments that will flatter her specific body shape. We show how to learn the embedding from an online catalog displaying fashion models of various shapes and sizes wearing the products, and we devise a method to explain the algorithm's suggestions for well fitting garments. We apply our approach to a dataset of diverse subjects, and demonstrate its strong advantages over the status quo body agnostic recommendation, both according to automated metrics and human opinion.


Transparency and granularity in the SP Theory of Intelligence and its realisation in the SP Computer Model. This chapter describes how the SP System, meaning the SP Theory of Intelligence, and its realisation as the SP Computer Model, may promote transparency and granularity in AI, and some other areas of application. The chapter describes how transparency in the workings and output of the SP Computer Model may be achieved via three routes 1) the program provides a very full audit trail for such processes as recognition, reasoning, analysis of language, and so on. There is also an explicit audit trail for the unsupervised learning of new knowledge 2) knowledge from the system is likely to be granular and easy for people to understand and 3) there are seven principles for the organisation of knowledge which are central in the workings of the SP System and also very familiar to people (eg chunking with codes, part whole hierarchies, and class inclusion hierarchies), and that kind of familiarity in the way knowledge is structured by the system, is likely to be important in the interpretability, explainability, and transparency of that knowledge. Examples from the SP Computer Model are shown throughout the chapter.


An Alternative C based HPC system for Hadoop MapReduce. MapReduce is a technique used to vastly improve distributed processing of data and can massively speed up computation. Hadoop and its MapReduce relies on JVM and Java which is expensive on memory. High Performance Computing based MapReduce framework could be used that can perform more memory efficiently and faster than the standard MapReduce. This paper explores an entirely C based approach to the MapReduce and its feasibility on multiple factors like developer friendliness, deployment interface, efficiency and scalability. This paper also introduces Delayed Reduction and deployment techniques that can speed up MapReduce in a compiled environment.


Nilpotence in normed MGL modules. We establish a motivic version of the May Nilpotence Conjecture if E is a normed motivic spectrum that satisfies E wedge HZ simeq 0 , then also E wedge MGL simeq 0 . In words, motivic homology detects vanishing of normed modules over the algebraic cobordism spectrum.


Targeted Pandemic Containment Through Identifying Local Contact Network Bottlenecks. Decision making about pandemic mitigation often relies upon simulation modelling. Models of disease transmission through networks of contacts between individuals or between population centres are increasingly used for these purposes. Real world contact networks are rich in structural features that influence infection transmission, such as tightly knit local communities that are weakly connected to one another. In this paper, we propose a new flow based edge betweenness centrality method for detecting bottleneck edges that connect nodes in contact networks. In particular, we utilize convex optimization formulations based on the idea of diffusion with p norm network flow. Using simulation models of COVID 19 transmission through real network data at both individual and county levels, we demonstrate that targeting bottleneck edges identified by the proposed method reduces the number of infected cases by up to 10 more than state of the art edge betweenness methods. Furthermore, the proposed method is orders of magnitude faster than existing methods.


A Dynamical Systems Perspective Reveals Coordination in Russian Twitter Operations. We study Twitter data from a dynamical systems perspective. In particular, we focus on the large set of data released by Twitter Inc. and asserted to represent a Russian influence operation. We propose a mathematical model to describe the per day tweet production that can be extracted using spectral analysis. We show that this mathematical model allows us to construct families (clusters) of users with common harmonics. We define a labeling scheme describing user strategy in an information operation and show that the resulting strategies correspond to the behavioral clusters identified from their harmonics. We then compare these user clusters to the ones derived from text data using a graph based topic analysis method. We show that spectral properties of the user clusters are related to the number of user topic groups represented in a spectral cluster. Bulk data analysis also provides new insights into the data set in the context of prior work.


Model Free Mean Field Reinforcement Learning Mean Field MDP and Mean Field Q Learning. We study infinite horizon discounted Mean Field Control (MFC) problems with common noise through the lens of Mean Field Markov Decision Processes (MFMDP). We allow the agents to use actions that are randomized not only at the individual level but also at the level of the population. This common randomization allows us to establish connections between both closed loop and open loop policies for MFC and Markov policies for the MFMDP. In particular, we show that there exists an optimal closed loop policy for the original MFC. Building on this framework and the notion of state action value function, we then propose reinforcement learning (RL) methods for such problems, by adapting existing tabular and deep RL methods to the mean field setting. The main difficulty is the treatment of the population state, which is an input of the policy and the value function. We provide convergence guarantees for tabular algorithms based on discretizations of the simplex. Neural network based algorithms are more suitable for continuous spaces and allow us to avoid discretizing the mean field state space. Numerical examples are provided.


MUSE Textual Attributes Guided Portrait Painting Generation. We propose a novel approach, MUSE, to illustrate textual attributes visually via portrait generation. MUSE takes a set of attributes written in text, in addition to facial features extracted from a photo of the subject as input. We propose 11 attribute types to represent inspirations from a subject's profile, emotion, story, and environment. We propose a novel stacked neural network architecture by extending an image to image generative model to accept textual attributes. Experiments show that our approach significantly outperforms several state of the art methods without using textual attributes, with Inception Score score increased by 6 and Fr 'echet Inception Distance (FID) score decreased by 11 , respectively. We also propose a new attribute reconstruction metric to evaluate whether the generated portraits preserve the subject's attributes. Experiments show that our approach can accurately illustrate 78 textual attributes, which also help MUSE capture the subject in a more creative and expressive way.


Wearable Sensors for Individual Grip Force Profiling. Biosensors and wearable sensor systems with transmitting capabilities are currently developed and used for the monitoring of health data, exercise activities, and other performance data. Unlike conventional approaches, these devices enable convenient, continuous, and or unobtrusive monitoring of user behavioral signals in real time. Examples include signals relative to body motion, body temperature, blood flow parameters and a variety of biological or biochemical markers and, as will be shown in this chapter here, individual grip force data that directly translate into spatiotemporal grip force profiles for different locations on the fingers and palm of the hand. Wearable sensor systems combine innovation in sensor design, electronics, data transmission, power management, and signal processing for statistical analysis, as will be further shown herein. The first section of this chapter will provide an overview of the current state of the art in grip force profiling to highlight important functional aspects to be considered. In the next section, the contribution of wearable sensor technology in the form of sensor glove systems for the real time monitoring of surgical task skill evolution in novices training in a simulator task will be described on the basis of recent examples. In the discussion, advantages and limitations will be weighed against each other.


The images of non commutative polynomials evaluated on the Quaternion algebra. Let p be a multilinear polynomial in several non commuting variables with coefficients in an arbitrary field K . Kaplansky conjectured that for any n , the image of p evaluated on the set M n(K) of n by n matrices is a vector space. In this paper we settle the analogous conjecture for a quaternion algebra.


Generating Major Types of Chinese Classical Poetry in a Uniformed Framework. Poetry generation is an interesting research topic in the field of text generation. As one of the most valuable literary and cultural heritages of China, Chinese classical poetry is very familiar and loved by Chinese people from generation to generation. It has many particular characteristics in its language structure, ranging from form, sound to meaning, thus is regarded as an ideal testing task for text generation. In this paper, we propose a GPT 2 based uniformed framework for generating major types of Chinese classical poems. We define a unified format for formulating all types of training samples by integrating detailed form information, then present a simple form stressed weighting method in GPT 2 to strengthen the control to the form of the generated poems, with special emphasis on those forms with longer body length. Preliminary experimental results show this enhanced model can generate Chinese classical poems of major types with high quality in both form and content, validating the effectiveness of the proposed strategy. The model has been incorporated into Jiuge, the most influential Chinese classical poetry generation system developed by Tsinghua University (Guo et al., 2019).


A new Fragile Points Method (FPM) in computational mechanics, based on the concepts of Point Stiffnesses and Numerical Flux Corrections. In this paper, a new method, named the Fragile Points Method (FPM), is developed for computer modeling in engineering and sciences. In the FPM, simple, local, polynomial, discontinuous and Point based trial and test functions are proposed based on randomly scattered points in the problem domain. The local discontinuous polynomial trial and test functions are postulated by using the Generalized Finite Difference method. These functions are only piece wise continuous over the global domain. By implementing the Point based trial and test functions into the Galerkin weak form, we define the concept of Point Stiffnesses as the contribution of each Point in the problem domain to the global stiffness matrix. However, due to the discontinuity of trial and test functions in the domain, directly using the Galerkin weak form leads to inconsistency. To resolve this, Numerical Flux Corrections, which are frequently used in Discontinuous Galerkin methods are further employed in the FPM. The resulting global stiffness matrix is symmetric and sparse, which is advantageous for large scale engineering computations. Several numerical examples of 1D and 2D Poisson equations are given in this paper to demonstrate the high accuracy, robustness and convergence of the FPM. Because of the locality and discontinuity of the Point based trial and test functions, this method can be easily extended to model extreme problems in mechanics, such as fragility, rupture, fracture, damage, and fragmentation. These extreme problems will be discussed in our future studies.


Adaptive Susceptibility and Heterogeneity in Contagion Models on Networks. Contagious processes, such as spread of infectious diseases, social behaviors, or computer viruses, affect biological, social, and technological systems. Epidemic models for large populations and finite populations on networks have been used to understand and control both transient and steady state behaviors. Typically it is assumed that after recovery from an infection, every agent will either return to its original susceptible state or acquire full immunity to reinfection. We study the network SIRI (Susceptible Infected Recovered Infected) model, an epidemic model for the spread of contagious processes on a network of heterogeneous agents that can adapt their susceptibility to reinfection. The model generalizes existing models to accommodate realistic conditions in which agents acquire partial or compromised immunity after first exposure to an infection. We prove necessary and sufficient conditions on model parameters and network structure that distinguish four dynamic regimes infection free, epidemic, endemic, and bistable. For the bistable regime, which is not accounted for in traditional models, we show how there can be a rapid resurgent epidemic after what looks like convergence to an infection free population. We use the model and its predictive capability to show how control strategies can be designed to mitigate problematic contagious behaviors.


Heterogeneity in evolutionary games an analysis of the risk perception. In this work, we analyse the relationship between heterogeneity and cooperation. Previous investigations suggest that this relation is nontrivial, as some authors found that heterogeneity sustains cooperation, while others obtained different results. Among the possible forms of heterogeneity, we focus on the individual perception of risks and rewards related to a generic event, that can show up in a number of social and biological systems. The modelling approach is based on the framework of Evolutionary Game Theory. To represent this kind of heterogeneity, we implement small and local perturbations on the payoff matrix of simple 2 strategy games, as the Prisoner's Dilemma. So, while usually the payoff is considered as a global and time invariant structure, i.e. it is the same for all individuals of a population at any time, in our model its value is continuously affected by small variations, both in time and space (i.e. position on a lattice). We found that such perturbations can be beneficial or detrimental to cooperation, depending on their setting. Notably, cooperation is strongly supported when perturbations act on the main diagonal of the payoff matrix, whereas when they act on the off diagonal the resulting effect is more difficult to quantify. To conclude, the proposed model shows a rich spectrum of possible equilibria, whose interpretation might offer insights and enrich the description of several systems.


Multi Objective Neural Architecture Search Based on Diverse Structures and Adaptive Recommendation. The search space of neural architecture search (NAS) for convolutional neural network (CNN) is huge. To reduce searching cost, most NAS algorithms use fixed outer network level structure, and search the repeatable cell structure only. Such kind of fixed architecture performs well when enough cells and channels are used. However, when the architecture becomes more lightweight, the performance decreases significantly. To obtain better lightweight architectures, more flexible and diversified neural architectures are in demand, and more efficient methods should be designed for larger search space. Motivated by this, we propose MoARR algorithm, which utilizes the existing research results and historical information to quickly find architectures that are both lightweight and accurate. We use the discovered high performance cells to construct network architectures. This method increases the network architecture diversity while also reduces the search space of cell structure design. In addition, we designs a novel multi objective method to effectively analyze the historical evaluation information, so as to efficiently search for the Pareto optimal architectures with high accuracy and small parameter number. Experimental results show that our MoARR can achieve a powerful and lightweight model (with 1.9 error rate and 2.3M parameters) on CIFAR 10 in 6 GPU hours, which is better than the state of the arts. The explored architecture is transferable to ImageNet and achieves 76.0 top 1 accuracy with 4.9M parameters.


Tearing Down the Memory Wall. We present a vision for the Erudite architecture that redefines the compute and memory abstractions such that memory bandwidth and capacity become first class citizens along with compute throughput. In this architecture, we envision coupling a high density, massively parallel memory technology like Flash with programmable near data accelerators, like the streaming multiprocessors in modern GPUs. Each accelerator has a local pool of storage class memory that it can access at high throughput by initiating very large numbers of overlapping requests that help to tolerate long access latency. The accelerators can also communicate with each other and remote memory through a high throughput low latency interconnect. As a result, systems based on the Erudite architecture scale compute and memory bandwidth at the same rate, tearing down the notorious memory wall that has plagued computer architecture for generations. In this paper, we present the motivation, rationale, design, benefit, and research challenges for Erudite.


Decomposing Textual Information For Style Transfer. This paper focuses on latent representations that could effectively decompose different aspects of textual information. Using a framework of style transfer for texts, we propose several empirical methods to assess information decomposition quality. We validate these methods with several state of the art textual style transfer methods. Higher quality of information decomposition corresponds to higher performance in terms of bilingual evaluation understudy (BLEU) between output and human written reformulations.


Inertial manifolds for the incompressible Navier Stokes equations. In this article, we devote to the existence of an N dimensional inertial manifold for the incompressible Navier Stokes equations in mathbb T d ( d 2,3 ). Our results can be summarized as two aspects Firstly, we construct an N dimensional inertial manifold for the Navier Stokes equations in mathbb T 2 Secondly, we extend slightly the spatial averaging method to the abstract case partial t u A 1 alpha u A alpha F(u) f (here 0 alpha 1 , A 0 is a self adjoint operator with compact inverse and F is Lipschitz from a Hilbert space mathbb H to mathbb H ), and then verify the existence of an N dimensional inertial manifold for the hyperviscous Navier Stokes equation with the hyperviscous index 5 4 in mathbb T 3 .


Semi equivelar maps on the surface of Euler genus 3. If the cyclic sequence of faces for all the vertices in a map are of same type, then the map is said to be a semi equivelar map. In this article, we classify all the types of semi equivelar maps on the surface of Euler genus 3, i.e. , on the surface of Euler characteristic 1 . That is, we present a complete map types of semi equivelar maps (if exist) on the surface of Euler char. 1 . We know the complete list of semi equivelar maps (upto isomorphism) for some types. Here, we also present a complete list of semi equivelar maps for one type and for other types, similar steps can be followed.


L ojasiewicz inequalities, uniqueness and rigidity for cylindrical self shrinkers. We establish L ojasiewicz inequalities for a class of cylindrical self shrinkers for the mean curvature flow, which includes round cylinders and cylinders over Abresch Langer curves, in any codimension. We deduce the uniqueness of blowups at singularities modelled on this class of cylinders, and that any such cylinder is isolated in the space of self shrinkers. The Abresch Langer case answers a conjecture of Colding Minicozzi. Our proof uses direct perturbative analysis of the shrinker mean curvature, so it is new even for round cylinders.


DeCoRIC Decentralized Connected Resilient IoT Clustering. Maintaining peer to peer connectivity with low energy overhead is a key requirement for several emerging Internet of Things (IoT) applications. It is also desirable to develop such connectivity solutions for non static network topologies, so that resilience to device failures can be fully realized. Decentralized clustering has emerged as a promising technique to address this critical challenge. Clustering of nodes around cluster heads (CHs) provides an energy efficient two tier framework for peer to peer communication. At the same time, decentralization ensures that the framework can quickly adapt to a dynamically changing network topology. Although some decentralized clustering solutions have been proposed in the literature, they either lack guarantees on connectivity or incur significant energy overhead to maintain the clusters. In this paper, we present Decentralized Connected Resilient IoT Clustering (DeCoRIC), an energy efficient clustering scheme that is self organizing and resilient to network changes while guaranteeing connectivity. Using experiments implemented on the Contiki simulator, we show that our clustering scheme adapts itself to node faults in a time bound manner. Our experiments show that DeCoRIC achieves 100 connectivity among all nodes while improving the power efficiency of nodes in the system compared to the state of the art techniques BEEM and LEACH by up to 110 and 70 , respectively. The improved power efficiency also translates to longer lifetime before first node death with a best case of 109 longer than BEEM and 42 longer than LEACH.


Automatic Differentiation of Some First Order Methods in Parametric Optimization. We aim at computing the derivative of the solution to a parametric optimization problem with respect to the involved parameters. For a class broader than that of strongly convex functions, this can be achieved by automatic differentiation of iterative minimization algorithms. If the iterative algorithm converges pointwise, then we prove that the derivative sequence also converges pointwise to the derivative of the minimizer with respect to the parameters. Moreover, we provide convergence rates for both sequences. In particular, we prove that the accelerated convergence rate of the Heavy ball method compared to Gradient Descent also accelerates the derivative computation. An experiment with L2 Regularized Logistic Regression validates the theoretical results.


Enzyme kinetics at the molecular level. The celebrated Michaelis Menten (MM) expression provides a fundamental relation between the rate of enzyme catalysis and substrate concentration. The validity of this classical expression is, however, restricted to macroscopic amounts of enzymes and substrates and, thus, to processes with negligible fluctuations. Recent experiments have measured fluctuations in the catalytic rate to reveal that the MM equation, though valid for bulk amounts, is not obeyed at the molecular level. In this mini review, we show how new statistical measures of fluctuations in the catalytic rate identify a regime in which the MM equation is always violated. This regime, characterized by temporal correlations between enzymatic turnovers, is absent for a single enzyme and unobservably short in the classical limit.


Deep Multimodal Neural Architecture Search. Designing effective neural networks is fundamentally important in deep multimodal learning. Most existing works focus on a single task and design neural architectures manually, which are highly task specific and hard to generalize to different tasks. In this paper, we devise a generalized deep multimodal neural architecture search (MMnas) framework for various multimodal learning tasks. Given multimodal input, we first define a set of primitive operations, and then construct a deep encoder decoder based unified backbone, where each encoder or decoder block corresponds to an operation searched from a predefined operation pool. On top of the unified backbone, we attach task specific heads to tackle different multimodal learning tasks. By using a gradient based NAS algorithm, the optimal architectures for different tasks are learned efficiently. Extensive ablation studies, comprehensive analysis, and comparative experimental results show that the obtained MMnasNet significantly outperforms existing state of the art approaches across three multimodal learning tasks (over five datasets), including visual question answering, image text matching, and visual grounding.


Minimal graphs for hamiltonian extension. For every n ge 3 we determine the minimum number of edges of graph with n vertices such that for any non edge xy there exits a hamiltonian cycle containing xy .


On traceable iterated line graph and hamiltonian path index. Xiong and Liu L. Xiong and Z. Liu, Hamiltonian iterated line graphs, Discrete Math. 256 (2002) 407 422 gave a characterization of the graphs G for which the n th iterated line graph L n(G) is hamiltonian, for n ge2 . In this paper, we study the existence of a hamiltonian path in L n(G) , and give a characterization of G for which L n(G) has a hamiltonian path. As applications, we use this characterization to give several upper bounds on the hamiltonian path index of a graph.


Normal Forms for Manifolds of Normally Hyperbolic Singularities and Asymptotic Properties of Nearby Transitions. This paper contains theory on two related topics relevant to manifolds of normally hyperbolic singularities. First, theorems on the formal and C k normal forms for these objects are proved. Then, the theorems are applied to give asymptotic properties of the transition map between sections transverse to the centre stable and centre unstable manifolds of some normally hyperbolic manifolds. A method is given for explicitly computing these so called Dulac maps. The Dulac map is revealed to have similar asymptotic structures as in the case of a saddle singularity in the plane.


Riemannian Anosov extension and applications. Let Sigma be a Riemannian manifold with strictly convex spherical boundary. Assuming absence of conjugate points and that the trapped set is hyperbolic, we show that Sigma can be isometrically embedded into a closed Riemannian manifold with Anosov geodesic flow. We use this embedding to provide a direct link between the classical Livshits theorem for Anosov flows and the Livshits theorem for the X ray transform which appears in the boundary rigidity program. Also, we give an application for lens rigidity in a conformal class.


FRaZ A Generic High Fidelity Fixed Ratio Lossy Compression Framework for Scientific Floating point Data. With ever increasing volumes of scientific floating point data being produced by high performance computing applications, significantly reducing scientific floating point data size is critical, and error controlled lossy compressors have been developed for years. None of the existing scientific floating point lossy data compressors, however, support effective fixed ratio lossy compression. Yet fixed ratio lossy compression for scientific floating point data not only compresses to the requested ratio but also respects a user specified error bound with higher fidelity. In this paper, we present FRaZ a generic fixed ratio lossy compression framework respecting user specified error constraints. The contribution is twofold. (1) We develop an efficient iterative approach to accurately determine the appropriate error settings for different lossy compressors based on target compression ratios. (2) We perform a thorough performance and accuracy evaluation for our proposed fixed ratio compression framework with multiple state of the art error controlled lossy compressors, using several real world scientific floating point datasets from different domains. Experiments show that FRaZ effectively identifies the optimum error setting in the entire error setting space of any given lossy compressor. While fixed ratio lossy compression is slower than fixed error compression, it provides an important new lossy compression technique for users of very large scientific floating point datasets.


On the I O complexity of hybrid algorithms for Integer Multiplication. Almost asymptotically tight lower bounds are derived for the Input Output (I O) complexity IO mathcal A left(n,M right) of a general class of hybrid algorithms computing the product of two integers, each represented with n digits in a given base s , in a two level storage hierarchy with M words of fast memory, with different digits stored in different memory words. The considered hybrid algorithms combine the Toom Cook k (or Toom k ) fast integer multiplication approach with computational complexity Theta left(c kn log k left(2k 1 right) right) , and "standard" integer multiplication algorithms which compute Omega left(n 2 right) digit multiplications. We present an Omega left( left(n max M,n 0 right) log k left(2k 1 right) left( max 1,n 0 M right) 2M right) lower bound for the I O complexity of a class of "uniform, non stationary" hybrid algorithms, where n 0 denotes the threshold size of sub problems which are computed using standard algorithms with algebraic complexity Omega left(n 2 right) . As a special case, our result yields an asymptotically tight Theta left(n 2 M right) lower bound for the I O complexity of any standard integer multiplication algorithm. As some sequential hybrid algorithms from this class exhibit I O cost within a mathcal O left(k 2 right) multiplicative term of the corresponding lower bounds, the proposed lower bounds are almost asymptotically tight and indeed tight for constant values of k . By extending these results to a distributed memory model with n 0 processors, we obtain both memory dependent and memory independent I O lower bounds for parallel versions of hybrid integer multiplication algorithms. All the lower bounds are derived for the more general class of "non uniform, non stationary" hybrid algorithms that allow recursive calls to have a different structure.


On the formulations of interfacial force in the phase field based lattice Boltzmann method. Different formulations of interfacial force have been adopted in phase field based lattice Boltzmann method for two phase flows. Although they are identical mathematically, their numerical performances may be different due to truncation errors in the discretization. In this paper, four type formulations of interfacial force available in the literature, namely stress tensor form (STF), chemical potential form (CPF), pressure form (PF) and continuum surface force (CSF) form, are compared and discussed. A series of benchmark problems, including stationary droplet, two merging droplets, Capillary wave, rising bubble and drop deformation in shear flow, are simulated. Numerical results show that CPF is a good choice for small surface deformation problems while STF is preferred for dynamical problems, both STF and CSF demonstrate good numerical stability.


Incremental Fairness in Two Sided Market Platforms On Smoothly Updating Recommendations. Major online platforms today can be thought of as two sided markets with producers and customers of goods and services. There have been concerns that over emphasis on customer satisfaction by the platforms may affect the well being of the producers. To counter such issues, few recent works have attempted to incorporate fairness for the producers. However, these studies have overlooked an important issue in such platforms to supposedly improve customer utility, the underlying algorithms are frequently updated, causing abrupt changes in the exposure of producers. In this work, we focus on the fairness issues arising out of such frequent updates, and argue for incremental updates of the platform algorithms so that the producers have enough time to adjust (both logistically and mentally) to the change. However, naive incremental updates may become unfair to the customers. Thus focusing on recommendations deployed on two sided platforms, we formulate an ILP based online optimization to deploy changes incrementally in n steps, where we can ensure smooth transition of the exposure of items while guaranteeing a minimum utility for every customer. Evaluations over multiple real world datasets show that our proposed mechanism for platform updates can be efficient and fair to both the producers and the customers in two sided platforms.


Contravariant Pseudo Hessian manifolds and their associated Poisson structures. A contravariant pseudo Hessian manifold is a manifold M endowed with a pair ( nabla,h) where nabla is a flat connection and h is a symmetric bivector field satisfying a contravariant Codazzi equation. When h is invertible we recover the known notion of pseudo Hessian manifold. Contravariant pseudo Hessian manifolds have properties similar to Poisson manifolds and, in fact, to any contravariant pseudo Hessian manifold (M, nabla,h) we associate naturally a Poisson tensor on TM . We investigate these properties and we study in details many classes of such structures in order to highlight the richness of the geometry of these manifolds.


Toward Simulating Environments in Reinforcement Learning Based Recommendations. With the recent advances in Reinforcement Learning (RL), there have been tremendous interests in employing RL for recommender systems. However, directly training and evaluating a new RL based recommendation algorithm needs to collect users' real time feedback in the real system, which is time and efforts consuming and could negatively impact on users' experiences. Thus, it calls for a user simulator that can mimic real users' behaviors where we can pre train and evaluate new recommendation algorithms. Simulating users' behaviors in a dynamic system faces immense challenges (i) the underlining item distribution is complex, and (ii) historical logs for each user are limited. In this paper, we develop a user simulator base on Generative Adversarial Network (GAN). To be specific, the generator captures the underlining distribution of users' historical logs and generates realistic logs that can be considered as augmentations of real logs while the discriminator not only distinguishes real and fake logs but also predicts users' behaviors. The experimental results based on real world e commerce data demonstrate the effectiveness of the proposed simulator.


On the homogeneous ergodic bilinear averages with 1 bounded multiplicative weights. We establish a generalization of Bourgain double recurrence theorem and ergodic Bourgain Sarnak's theorem by proving that for any aperiodic 1 bounded multiplicative function boldsymbol nu , for any map T acting on a probability space (X, mathcal A , mu) , for any integers a,b , for any f,g in L 2(X) , and for almost all x in X , we have frac 1 N sum n 1 N boldsymbol nu (n) f(T a n x)g(T bn x) xrightarrow N rightarrow infty 0. We further present with proof the key ingredients of Bourgain's proof of his double recurrence theorem.


A Survey of Evaluation Metrics Used for NLG Systems. The success of Deep Learning has created a surge in interest in a wide a range of Natural Language Generation (NLG) tasks. Deep Learning has not only pushed the state of the art in several existing NLG tasks but has also facilitated researchers to explore various newer NLG tasks such as image captioning. Such rapid progress in NLG has necessitated the development of accurate automatic evaluation metrics that would allow us to track the progress in the field of NLG. However, unlike classification tasks, automatically evaluating NLG systems in itself is a huge challenge. Several works have shown that early heuristic based metrics such as BLEU, ROUGE are inadequate for capturing the nuances in the different NLG tasks. The expanding number of NLG models and the shortcomings of the current metrics has led to a rapid surge in the number of evaluation metrics proposed since 2014. Moreover, various evaluation metrics have shifted from using pre determined heuristic based formulae to trained transformer models. This rapid change in a relatively short time has led to the need for a survey of the existing NLG metrics to help existing and new researchers to quickly come up to speed with the developments that have happened in NLG evaluation in the last few years. Through this survey, we first wish to highlight the challenges and difficulties in automatically evaluating NLG systems. Then, we provide a coherent taxonomy of the evaluation metrics to organize the existing metrics and to better understand the developments in the field. We also describe the different metrics in detail and highlight their key contributions. Later, we discuss the main shortcomings identified in the existing metrics and describe the methodology used to evaluate evaluation metrics. Finally, we discuss our suggestions and recommendations on the next steps forward to improve the automatic evaluation metrics.


Biomedical Named Entity Recognition at Scale. Named entity recognition (NER) is a widely applicable natural language processing task and building block of question answering, topic modeling, information retrieval, etc. In the medical domain, NER plays a crucial role by extracting meaningful chunks from clinical notes and reports, which are then fed to downstream tasks like assertion status detection, entity resolution, relation extraction, and de identification. Reimplementing a Bi LSTM CNN Char deep learning architecture on top of Apache Spark, we present a single trainable NER model that obtains new state of the art results on seven public biomedical benchmarks without using heavy contextual embeddings like BERT. This includes improving BC4CHEMD to 93.72 (4.1 gain), Species800 to 80.91 (4.6 gain), and JNLPBA to 81.29 (5.2 gain). In addition, this model is freely available within a production grade code base as part of the open source Spark NLP library can scale up for training and inference in any Spark cluster has GPU support and libraries for popular programming languages such as Python, R, Scala and Java and can be extended to support other human languages with no code changes.


Registration of multi view point sets under the perspective of expectation maximization. Registration of multi view point sets is a prerequisite for 3D model reconstruction. To solve this problem, most of previous approaches either partially explore available information or blindly utilize unnecessary information to align each point set, which may lead to the undesired results or introduce extra computation complexity. To this end, this paper consider the multi view registration problem as a maximum likelihood estimation problem and proposes a novel multi view registration approach under the perspective of Expectation Maximization (EM). The basic idea of our approach is that different data points are generated by the same number of Gaussian mixture models (GMMs). For each data point in one point set, its nearest neighbors can be searched from other well aligned point sets. Then, we can suppose this data point is generated by the special GMM, which is composed of each nearest neighbor adhered with one Gaussian distribution. Based on this assumption, it is reasonable to define the likelihood function including all rigid transformations, which requires to be estimated for multi view registration. Subsequently, the EM algorithm is utilized to maximize the likelihood function so as to estimate all rigid transformations. Finally, the proposed approach is tested on several bench mark data sets and compared with some state of the art algorithms. Experimental results illustrate its super performance on accuracy, robustness and efficiency for the registration of multi view point sets.


Reconstructing Sinus Anatomy from Endoscopic Video Towards a Radiation free Approach for Quantitative Longitudinal Assessment. Reconstructing accurate 3D surface models of sinus anatomy directly from an endoscopic video is a promising avenue for cross sectional and longitudinal analysis to better understand the relationship between sinus anatomy and surgical outcomes. We present a patient specific, learning based method for 3D reconstruction of sinus surface anatomy directly and only from endoscopic videos. We demonstrate the effectiveness and accuracy of our method on in and ex vivo data where we compare to sparse reconstructions from Structure from Motion, dense reconstruction from COLMAP, and ground truth anatomy from CT. Our textured reconstructions are watertight and enable measurement of clinically relevant parameters in good agreement with CT. The source code is available at https github.com lppllppl920 DenseReconstruction Pytorch.


The Hitchin cscK system. We present an infinite dimensional hyperk "ahler reduction that extends the classical moment map picture of Fujiki and Donaldson for the scalar curvature of K "ahler metrics. We base our approach on an explicit construction of hyperk "ahler metrics due to Biquard and Gauduchon. The construction is motivated by how one can derive Hitchin's equations for harmonic bundles from the Hermitian Yang Mills equation, and yields a system of moment map equations which modifies the constant scalar curvature K "ahler (cscK) condition by adding a "Higgs field" to the cscK equation. In the special case of complex curves, we recover previous results of Donaldson, while for higher dimensional manifolds the system of equations has not yet been studied. We study the existence of solutions to the system in some special cases. On a Riemann surface, we extend an existence result for Donaldson's equation to our system. We then study the existence of solutions to the moment map equations on a class of ruled surfaces which do not admit cscK metrics, showing that adding a suitable Higgs term to the cscK equation can stabilize the manifold. Lastly, we study the system of equations on abelian and toric surfaces, taking advantage of a description of the system in symplectic coordinates analogous to Abreu's formula for the scalar curvature.


Efficient Second Order TreeCRF for Neural Dependency Parsing. In the deep learning (DL) era, parsing models are extremely simplified with little hurt on performance, thanks to the remarkable capability of multi layer BiLSTMs in context representation. As the most popular graph based dependency parser due to its high efficiency and performance, the biaffine parser directly scores single dependencies under the arc factorization assumption, and adopts a very simple local token wise cross entropy training loss. This paper for the first time presents a second order TreeCRF extension to the biaffine parser. For a long time, the complexity and inefficiency of the inside outside algorithm hinder the popularity of TreeCRF. To address this issue, we propose an effective way to batchify the inside and Viterbi algorithms for direct large matrix operation on GPUs, and to avoid the complex outside algorithm via efficient back propagation. Experiments and analysis on 27 datasets from 13 languages clearly show that techniques developed before the DL era, such as structural learning (global TreeCRF loss) and high order modeling are still useful, and can further boost parsing performance over the state of the art biaffine parser, especially for partially annotated training data. We release our code at https github.com yzhangcs crfpar.


Simple QE Better Automatic Quality Estimation for Text Simplification. Text simplification systems generate versions of texts that are easier to understand for a broader audience. The quality of simplified texts is generally estimated using metrics that compare to human references, which can be difficult to obtain. We propose Simple QE, a BERT based quality estimation (QE) model adapted from prior summarization QE work, and show that it correlates well with human quality judgments. Simple QE does not require human references, which makes the model useful in a practical setting where users would need to be informed about the quality of generated simplifications. We also show that we can adapt this approach to accurately predict the complexity of human written texts.


Spectral Extension and Synchronisation of Microcombs in a Single Microresonator. We demonstrate that the optical spectrum of a soliton microcomb generated in a microresonator can be coherently extended by using bichromatic pumping one pump with a frequency in the anomalous dispersion regime of the microresonator is used to generate a bright soliton microcomb while a second pump in the normal dispersion regime both compensates the thermal effect of the microresonator and generates a second frequency comb via cross phase modulation with the bright soliton, thus extending the spectrum of the microcomb. Experimental results for different microresonators show that the mode spacings of the two combs are synchronised, even when the combs are generated in different mode families. Numerical simulations agree well with experimental results and reveal that a bright optical pulse from the second pump is passively formed in the normal dispersion regime and trapped by the bright soliton. We believe the demonstrated technique provides an alternative way to generate broadband microcombs and multi coloured frequency combs that can be useful for frequency metrology and spectroscopy. In addition, this method enables the selective enhancement of available optical power in specific parts of the comb spectrum.


A Scheme for Dynamic Risk Sensitive Sequential Decision Making. We present a scheme for sequential decision making with a risk sensitive objective and constraints in a dynamic environment. A neural network is trained as an approximator of the mapping from parameter space to space of risk and policy with risk sensitive constraints. For a given risk sensitive problem, in which the objective and constraints are, or can be estimated by, functions of the mean and variance of return, we generate a synthetic dataset as training data. Parameters defining a targeted process might be dynamic, i.e., they might vary over time, so we sample them within specified intervals to deal with these dynamics. We show that i). Most risk measures can be estimated using return variance ii). By virtue of the state augmentation transformation, practical problems modeled by Markov decision processes with stochastic rewards can be solved in a risk sensitive scenario and iii). The proposed scheme is validated by a numerical experiment.


Irrationality and Transcendence of Alternating Series Via Continued Fractions. Euler gave recipes for converting alternating series of two types, I and II, into equivalent continued fractions, i.e., ones whose convergents equal the partial sums. A condition we prove for irrationality of a continued fraction then allows easy proofs that e, sin1 , and the primorial constant are irrational. Our main result is that, if a series of type II is equivalent to a simple continued fraction, then the sum is transcendental and its irrationality measure exceeds 2 . We construct all aleph 0 aleph 0 mathfrak c such series and recover the transcendence of the Davison Shallit and Cahen constants. Along the way, we mention pi , the golden ratio, Fermat, Fibonacci, and Liouville numbers, Sylvester's sequence, Pierce expansions, Mahler's method, Engel series, and theorems of Lambert, Sierpi ' n ski, and Thue Siegel Roth. We also make three conjectures. (This manuscript was submitted posthumously. The author passed away on January 16, 2020.)


Dual canonical bases for unipotent groups and base affine spaces. Denote by N subset SL k the subgroup of unipotent upper triangular matrices. In this paper, we show that the dual canonical basis of mathbb C N can be parameterized by semi standard Young tableaux. Moreover, we give an explicit formula for every element in the the dual canonical basis using the data of the corresponding semistandard Young tableau.


An outranking Choquet integral formulation for multi criteria sorting problems with heterogeneous scales an extension of FlowSort for interacting criteria. In multi criteria decision aiding, the Choquet integral has been used as an aggregation operator to deal with interacting criteria, having as a requirement a prior assumption of common scale for all the criteria. This restriction on the adopted scale may be considered as a limitation in some practical problems. In order to overcome this limitation, we propose a new Choquet integral formulation, specific for sorting problems, that constructs a common scale from heterogenous scales using the framework of the FlowSort method. We also introduce a new outranking degree based on the Choquet integral preference model, which allows the modeling of interacting criteria in FlowSort. Therefore, the proposed approach can be seen either as an extension of FlowSort for problems with interacting criteria or as a new Choquet integral formulation for multi criteria sorting problems with heterogeneous scales. Numerical examples attest that the proposed approach is conceptually simple to be implemented and acknowledge the importance of considering interaction between criteria when it exists.


Learning Fast and Robust Target Models for Video Object Segmentation. Video object segmentation (VOS) is a highly challenging problem since the initial mask, defining the target object, is only given at test time. The main difficulty is to effectively handle appearance changes and similar background objects, while maintaining accurate segmentation. Most previous approaches fine tune segmentation networks on the first frame, resulting in impractical frame rates and risk of overfitting. More recent methods integrate generative target appearance models, but either achieve limited robustness or require large amounts of training data. We propose a novel VOS architecture consisting of two network components. The target appearance model consists of a light weight module, which is learned during the inference stage using fast optimization techniques to predict a coarse but robust target segmentation. The segmentation model is exclusively trained offline, designed to process the coarse scores into high quality segmentation masks. Our method is fast, easily trainable and remains highly effective in cases of limited training data. We perform extensive experiments on the challenging YouTube VOS and DAVIS datasets. Our network achieves favorable performance, while operating at higher frame rates compared to state of the art. Code and trained models are available at https github.com andr345 frtm vos.


Data Driven Conditional Optimal Transport. A data driven procedure is developed to compute the optimal map between two conditional probabilities rho(x z 1 ,...,z L ) and mu(y z 1 ,...,z L ) depending on a set of covariates z i . The procedure is tested on synthetic data from the ACIC Data Analysis Challenge 2017 and it is applied to non uniform lightness transfer between images. Exactly solvable examples and simulations are performed to highlight the differences with ordinary optimal transport.


Pseudospectra and Simultaneous Power Control. We prove that, for M 0 and n,m ge2 , we can find two 10 times10 matrices A and B with identical pseudospectra such that we have simultaneously A n B n M and A m B m M . We also prove that, under certain conditions, this result holds for two more general functions of A and B .


Numerical Analysis of History dependent Variational hemivariational Inequalities. In this paper, numerical analysis is carried out for a class of history dependent variational hemivariational inequalities arising in contact problems. Three different numerical treatments for temporal discretization are proposed to approximate the continuous model. Fixed point iteration algorithms are employed to implement the implicit scheme and the convergence is proved with a convergence rate independent of the time step size and mesh grid size. A special temporal discretization is introduced for the history dependent operator, leading to numerical schemes for which the unique solvability and error bounds for the temporally discrete systems can be proved without any restriction on the time step size. As for spatial approximation, the finite element method is applied and an optimal order error estimate for the linear element solutions is provided under appropriate regularity assumptions. Numerical examples are presented to illustrate the theoretical results.


Propagation and mitigation of epidemics in a scale free network. The epidemic curve and the final extent of the COVID 19 pandemic are usually predicted from the rate of early exponential raising using the SIR model. These predictions implicitly assume a full social mixing, which is not plausible generally. Here I am showing a counterexample to the these predictions, based on random propagation of an epidemic in Barab 'asi Albert scale free network models. The start of the epidemic suggests R 0 2.6 , but unlike Omega approx 70 predicted by the SIR model, they reach a final extent of only Omega approx 4 without external mitigation and Omega approx 0.5 1.5 with mitigation. Daily infection rate at the top is also 1 1.5 orders of magnitude less than in SIR models. Quarantining only the 1.5 most active superspreaders has similar effect on extent and top infection rate as blind quarantining a random 50 of the full community.


Noncommutative Geometry of Quantized Coverings. This research is devoted to the noncommutative generalization of topological coverings. Otherwise since topological coverings are related to the set of geometric constructions one can obtain noncommutative generalizations of these constructions. Here the generalizations of the universal covering space, fundamental group, homotopy theory, Hurewicz homomorphism, covering of the Riemannian manifold, flat connection are explained. The theory gives pure algebraic proof well known results of the topology and the differential geometry. Besides there are applications of the theory to (unbounded) operator spaces and this theme is also discussed here.


A refined Brill Noether theory over Hurwitz spaces. Let f colon C rightarrow mathbb P 1 be a degree k genus g cover. The stratification of line bundles L in mathrm Pic d(C) by the splitting type of f L is a refinement of the stratification by Brill Noether loci W r d(C) . We prove that for general degree k covers, these strata are smooth of the expected dimension. In particular, this determines the dimensions of all irreducible components of W r d(C) for a general k gonal curve (there are often components of different dimensions), extending results of Pflueger and Jensen Ranganathan. The results here apply over any algebraically closed field.


Elliptic solutions of dynamical Lucas sequences. We study two types of dynamical extensions of Lucas sequences and give elliptic solutions for them. The first type concerns a level dependent (or discrete time dependent) version involving commuting variables. We show that a nice solution for this system is given by elliptic numbers. The second type involves a non commutative version of Lucas sequences which defines the non commutative (or abstract) Fibonacci polynomials introduced by Johann Cigler. If the non commuting variables are specialized to be elliptic commuting variables the abstract Fibonacci polynomials become non commutative elliptic Fibonacci polynomials. Some properties we derive for these include their explicit expansion in terms of normalized monomials and a non commutative elliptic Euler Cassini identity.


An improvement of Zalcman's lemma in C n . The aim of this paper is to give a proof of improving of Zalcman's lemma.


Deep Recurrent Quantization for Generating Sequential Binary Codes. Quantization has been an effective technology in ANN (approximate nearest neighbour) search due to its high accuracy and fast search speed. To meet the requirement of different applications, there is always a trade off between retrieval accuracy and speed, reflected by variable code lengths. However, to encode the dataset into different code lengths, existing methods need to train several models, where each model can only produce a specific code length. This incurs a considerable training time cost, and largely reduces the flexibility of quantization methods to be deployed in real applications. To address this issue, we propose a Deep Recurrent Quantization (DRQ) architecture which can generate sequential binary codes. To the end, when the model is trained, a sequence of binary codes can be generated and the code length can be easily controlled by adjusting the number of recurrent iterations. A shared codebook and a scalar factor is designed to be the learnable weights in the deep recurrent quantization block, and the whole framework can be trained in an end to end manner. As far as we know, this is the first quantization method that can be trained once and generate sequential binary codes. Experimental results on the benchmark datasets show that our model achieves comparable or even better performance compared with the state of the art for image retrieval. But it requires significantly less number of parameters and training times. Our code is published online https github.com cfm uestc DRQ.


On ell adic Galois polylogarithms and triple ell th power residue symbols. The ell adic Galois polylogarithm is an arithmetic function on an absolute Galois group with values in ell adic numbers, which arises from Galois actions on ell adic 'etale paths on mathbb P 1 backslash 0,1, infty . In the present paper, we discuss a relationship between ell adic Galois polylogarithms and triple ell th power residue symbols in some special cases studied by a work of Hirano Morishita. We show that a functional equation of ell adic Galois polylogarithms by Nakamura Wojtkowiak implies a reciprocity law of triple ell th power residue symbols.


Stochastic heat equations with logarithmic nonlinearity. In this paper, we establish the existence and uniqueness of solutions to stochastic heat equations with logarithmic nonlinearity driven by Brownian motion on a bounded domain D in the setting of L 2(D) space. The result is valid for all initial values in L 2(D) . The logarithmic Sobolev inequality plays an important role.


TAEN Temporal Aware Embedding Network for Few Shot Action Recognition. Classification of new class entities requires collecting and annotating hundreds or thousands of samples that is often prohibitively costly. Few shot learning suggests learning to classify new classes using just a few examples. Only a small number of studies address the challenge of few shot learning on spatio temporal patterns such as videos. In this paper, we present the Temporal Aware Embedding Network (TAEN) for few shot action recognition, that learns to represent actions, in a metric space as a trajectory, conveying both short term semantics and longer term connectivity between action parts. We demonstrate the effectiveness of TAEN on two few shot tasks, video classification and temporal action detection and evaluate our method on the Kinetics 400 and on ActivityNet 1.2 few shot benchmarks. With training of just a few fully connected layers we reach comparable results to prior art on both few shot video classification and temporal detection tasks, while reaching state of the art in certain scenarios.


Forcing axioms and the complexity of non stationary ideals. We study the influence of strong forcing axioms on the complexity of the non stationary ideal on omega 2 and its restrictions to certain cofinalities. Our main result shows that the strengthening MM of Martin's Maximum does not decide whether the restriction of the non stationary ideal on omega 2 to sets of ordinals of countable cofinality is Delta 1 definable by formulas with parameters in H( omega 3) . The techniques developed in the proof of this result also allow us to prove analogous results for the full non stationary ideal on omega 2 and strong forcing axioms that are compatible with CH. Finally, we answer a question of S. Friedman, Wu and Zdomskyyshow by showing that the Delta 1 definability of the non stationary ideal on omega 2 is compatible with arbitrary large values of the continuum function at omega 2 .


Analysis of Fully Discrete Mixed Finite Element Methods for Time dependent Stochastic Stokes Equations with Multiplicative Noise. This paper is concerned with fully discrete mixed finite element approximations of the time dependent stochastic Stokes equations with multiplicative noise. A prototypical method, which comprises of the Euler Maruyama scheme for time discretization and the Taylor Hood mixed element for spatial discretization is studied in detail. Strong convergence with rates is established not only for the velocity approximation but also for the pressure approximation (in a time averaged fashion). A stochastic inf sup condition is established and used in a nonstandard way to obtain the error estimate for the pressure approximation in the time averaged fashion. Numerical results are also provided to validate the theoretical results and to gauge the performance of the proposed fully discrete mixed finite methods.


Prime Clocks. Physical implementations of digital computers began in the latter half of the 1930's and were first constructed from various forms of logic gates. Based on the prime numbers, we introduce prime clocks and prime clock sums, where the clocks utilize time and act as computational primitives instead of gates. The prime clocks generate an infinite abelian group, where for each n, there is a finite subgroup S such that for each Boolean function f 0, 1 n 0, 1 , there exists a finite prime clock sum in S that can represent and compute f. A parallelizable algorithm, implemented with a finite prime clock sum, is provided that computes f. In contrast, the negation, conjunction, and disjunction operations generate a Boolean algebra. In terms of computation, Boolean circuits computed with logic gates NOT, AND, OR have a depth. This means that a completely parallel computation of Boolean functions is not possible with these gates. Overall, some new connections between number theory, Boolean functions and computation are established.


From the Lagrange polygon to the figure eight I Numerical evidence extending a conjecture of Marchal. The present work studies the continuation class of the regular n gon solution of the n body problem. For odd numbers of bodies between n 3 and n 15 we apply one parameter numerical continuation algorithms to the energy frequency variable, and find that the figure eight choreography can be reached starting from the regular n gon. The continuation leaves the plane of the n gon, and passes through families of spatial choreographies with the topology of torus knots. Numerical continuation out of the n gon solution is complicated by the fact that the kernel of the linearization there is high dimensional. Our work exploits a symmetrized version of the problem which admits dense sets of choreography solutions, and which can be written as a delay differential equation in terms of one of the bodies. This symmetrized setup simplifies the problem in several ways. On one hand, the direction of the kernel is determined automatically by the symmetry. On the other hand, the set of possible bifurcations is reduced and the n gon continues to the eight after a single symmetry breaking bifurcation. Based on the calculations presented here we conjecture that the n gon and the eight are in the same continuation class for all odd numbers of bodies.


Quantitative stability and numerical analysis of Markovian quadratic BSDEs with reflection. We study the quantitative stability of the solutions to Markovian quadratic reflected BSDEs with bounded terminal data. By virtue of BMO martingale and change of measure techniques, we obtain stability estimates for the variation of the solutions with different underlying forward processes. In addition, we propose a truncated discrete time numerical scheme for quadratic reflected BSDEs, and obtain the explicit rate of convergence by applying the quantitative stability result.


Foundations of brick diagrams. We discuss the foundations of 2 dimensional graphical languages, with a view towards their computer implementation in a 'compiler' for monoidal categories. In particular, we discuss the close relationship between string diagrams, pasting diagrams, linear logic proof trees and k d trees, the last being a data structure from computational geometry and computer graphics that recursively partitions a space. We introduce a minor variant of cubical pasting diagrams, which we call 'brick diagrams', which are used in the Statebox visual programming language. This paper is intended as a discussion and literature review, and contains little mathematics.


Formal Modeling and SMT Based Parameterized Verification of Multi Case Data Aware BPMN. We propose DAB a data aware extension of the BPMN de facto standard with the ability of operating over case and persistent data (partitioned into a read only catalog and a read write repository), and that balances between expressiveness and the possibility of supporting parameterized verification of safety properties on top of it. In particular, we take inspiration from the literature on verification of artifact systems, and consider verification problems where safety properties are checked irrespectively of the content of the read only catalog, possibly considering an unbounded number of active cases and tuples in the catalog and repository. Such problems are tackled using fully implemented array based backward reachability techniques belonging to the well established tradition of SMT model checking. We also identify relevant classes of DABs for which the backward reachability procedure implemented in the MCMT array based model checker is sound and complete, and then further strengthen such classes to ensure termination.


An Efficient Approach for Reviewing Security Related Aspects in Agile Requirements Specifications of Web Applications. Defects in requirements specifications can have severe consequences during the software development lifecycle. Some of them may result in poor product quality and or time and budget overruns due to incorrect or missing quality characteristics, such as security. This characteristic requires special attention in web applications because they have become a target for manipulating sensible data. Several concerns make security difficult to deal with. For instance, security requirements are often misunderstood and improperly specified due to lack of security expertise and emphasis on security during early stages of software development. This often leads to unspecified or ill defined security related aspects. These concerns become even more challenging in agile contexts, where lightweight documentation is typically produced. To tackle this problem, we designed an approach for reviewing security related aspects in agile requirements specifications of web applications. Our proposal considers user stories and security specifications as inputs and relates those user stories to security properties via Natural Language Processing. Based on the related security properties, our approach identifies high level security requirements from the Open Web Application Security Project (OWASP) to be verified, and generates a reading technique to support reviewers in detecting defects. We evaluate our approach via three experiment trials conducted with 56 novice software engineers, measuring effectiveness, efficiency, usefulness, and ease of use. We compare our approach against using (1) the OWASP high level security requirements, and (2) a perspective based approach as proposed in contemporary state of the art. The results strengthen our confidence that using our approach has a positive impact (with large effect size) on the performance of inspectors in terms of effectiveness and efficiency.


A pressure robust embedded discontinuous Galerkin method for the Stokes problem by reconstruction operators. The embedded discontinuous Galerkin (EDG) finite element method for the Stokes problem results in a point wise divergence free approximate velocity on cells. However, the approximate velocity is not H(div) conforming and it can be shown that this is the reason that the EDG method is not pressure robust, i.e., the error in the velocity depends on the continuous pressure. In this paper we present a local reconstruction operator that maps discretely divergence free test functions to exactly divergence free test functions. This local reconstruction operator restores pressure robustness by only changing the right hand side of the discretization, similar to the reconstruction operator recently introduced for the Taylor Hood and mini elements by Lederer et al. (SIAM J. Numer. Anal., 55 (2017), pp. 1291 1314). We present an a priori error analysis of the discretization showing optimal convergence rates and pressure robustness of the velocity error. These results are verified by numerical examples. The motivation for this research is that the resulting EDG method combines the versatility of discontinuous Galerkin methods with the computational efficiency of continuous Galerkin methods and accuracy of pressure robust finite element methods.


Data driven simulation of pedestrian collision avoidance with a nonparametric neural network. Data driven simulation of pedestrian dynamics is an incipient and promising approach for building reliable microscopic pedestrian models. We propose a methodology based on generalized regression neural networks, which does not have to deal with a huge number of free parameters as in the case of multilayer neural networks. Although the method is general, we focus on the one pedestrian one obstacle problem. Experimental data were collected in a motion capture laboratory providing high precision trajectories. The proposed model allows us to simulate the trajectory of a pedestrian avoiding an obstacle from any direction.


Generalizing a theorem of B e s and Choffrut. B e s and Choffrut recently showed that there are no intermediate structures between ( mathbb R , , ) and ( mathbb R , , , mathbb Z ) . We prove a generalization if mathcal R is an o minimal expansion of ( mathbb R , , ) by bounded subsets of Euclidean space then there are no intermediate structures between mathcal R and ( mathcal R , mathbb Z ) . It follows there are no intermediate structures between ( mathbb R , , , sin 0,2 pi ) and ( mathbb R , , , sin) .


Nonequilibrium Physics in Biology. Life is characterized by a myriad of complex dynamic processes allowing organisms to grow, reproduce, and evolve. Physical approaches for describing systems out of thermodynamic equilibrium have been increasingly applied to living systems, which often exhibit phenomena unknown from those traditionally studied in physics. Spectacular advances in experimentation during the last decade or two, for example, in microscopy, single cell dynamics, in the reconstruction of sub and multicellular systems outside of living organisms, or in high throughput data acquisition have yielded an unprecedented wealth of data about cell dynamics, genetic regulation, and organismal development. These data have motivated the development and refinement of concepts and tools to dissect the physical mechanisms underlying biological processes. Notably, the landscape and flux theory as well as active hydrodynamic gel theory have proven very useful in this endeavour. Together with concepts and tools developed in other areas of nonequilibrium physics, significant progresses have been made in unraveling the principles underlying efficient energy transport in photosynthesis, cellular regulatory networks, cellular movements and organization, embryonic development and cancer, neural network dynamics, population dynamics and ecology, as well as ageing, immune responses and evolution. Here, we review recent advances in nonequilibrium physics and survey their application to biological systems. We expect many of these results to be important cornerstones as the field continues to build our understanding of life.


NeuralScale Efficient Scaling of Neurons for Resource Constrained Deep Neural Networks. Deciding the amount of neurons during the design of a deep neural network to maximize performance is not intuitive. In this work, we attempt to search for the neuron (filter) configuration of a fixed network architecture that maximizes accuracy. Using iterative pruning methods as a proxy, we parameterize the change of the neuron (filter) number of each layer with respect to the change in parameters, allowing us to efficiently scale an architecture across arbitrary sizes. We also introduce architecture descent which iteratively refines the parameterized function used for model scaling. The combination of both proposed methods is coined as NeuralScale. To prove the efficiency of NeuralScale in terms of parameters, we show empirical simulations on VGG11, MobileNetV2 and ResNet18 using CIFAR10, CIFAR100 and TinyImageNet as benchmark datasets. Our results show an increase in accuracy of 3.04 , 8.56 and 3.41 for VGG11, MobileNetV2 and ResNet18 on CIFAR10, CIFAR100 and TinyImageNet respectively under a parameter constrained setting (output neurons (filters) of default configuration with scaling factor of 0.25).


Simple is Better! Lightweight Data Augmentation for Low Resource Slot Filling and Intent Classification. Neural based models have achieved outstanding performance on slot filling and intent classification, when fairly large in domain training data are available. However, as new domains are frequently added, creating sizeable data is expensive. We show that lightweight augmentation, a set of augmentation methods involving word span and sentence level operations, alleviates data scarcity problems. Our experiments on limited data settings show that lightweight augmentation yields significant performance improvement on slot filling on the ATIS and SNIPS datasets, and achieves competitive performance with respect to more complex, state of the art, augmentation approaches. Furthermore, lightweight augmentation is also beneficial when combined with pre trained LM based models, as it improves BERT based joint intent and slot filling models.


The regular free boundary in the thin obstacle problem for degenerate parabolic equations. In this paper we study the existence, the optimal regularity of solutions, and the regularity of the free boundary near the so called emph regular points in a thin obstacle problem that arises as the local extension of the obstacle problem for the fractional heat operator ( partial t Delta x) s for s in (0,1) . Our regularity estimates are completely local in nature. This aspect is of crucial importance in our forthcoming work on the blowup analysis of the free boundary, including the study of the singular set. Our approach is based on first establishing the boundedness of the time derivative of the solution. This allows reduction to an elliptic problem at every fixed time level. Using several results from the elliptic theory, including the epiperimetric inequality, we establish the optimal regularity of solutions as well as H 1 gamma, frac 1 gamma 2 regularity of the free boundary near such regular points.


Semantic Segmentation With Multi Scale Spatial Attention For Self Driving Cars. In this paper, we present a novel neural network using multi scale feature fusion at various scales for accurate and efficient semantic image segmentation. We used ResNet based feature extractor, dilated convolutional layers in downsampling part, atrous convolutional layers in the upsampling part and used concat operation to merge them. A new attention module is proposed to encode more contextual information and enhance the receptive field of the network. We present an in depth theoretical analysis of our network with training and optimization details. Our network was trained and tested on the Camvid dataset and Cityscapes dataset using mean accuracy per class and Intersection Over Union (IOU) as the evaluation metrics. Our model outperforms previous state of the art methods on semantic segmentation achieving mean IOU value of 74.12 while running at 100 FPS.


fairseq A Fast, Extensible Toolkit for Sequence Modeling. fairseq is an open source sequence modeling toolkit that allows researchers and developers to train custom models for translation, summarization, language modeling, and other text generation tasks. The toolkit is based on PyTorch and supports distributed training across multiple GPUs and machines. We also support fast mixed precision training and inference on modern GPUs. A demo video can be found at https www.youtube.com watch?v OtgDdWtHvto


Weakly Supervised Multi Person Action Recognition in 360 circ Videos. The recent development of commodity 360 circ cameras have enabled a single video to capture an entire scene, which endows promising potentials in surveillance scenarios. However, research in omnidirectional video analysis has lagged behind the hardware advances. In this work, we address the important problem of action recognition in top view 360 circ videos. Due to the wide filed of view, 360 circ videos usually capture multiple people performing actions at the same time. Furthermore, the appearance of people are deformed. The proposed framework first transforms omnidirectional videos into panoramic videos, then it extracts spatial temporal features using region based 3D CNNs for action recognition. We propose a weakly supervised method based on multi instance multi label learning, which trains the model to recognize and localize multiple actions in a video using only video level action labels as supervision. We perform experiments to quantitatively validate the efficacy of the proposed method and qualitatively demonstrate action localization results. To enable research in this direction, we introduce 360Action, the first omnidirectional video dataset for multi person action recognition.


Sufficient Conditions and Radius Problems for a starlike Class Involving a Differential Inequality. Let mathcal A n be the class of analytic functions f(z) of the form f(z) z sum k n 1 infty a kz k,n in mathbb N and let begin align Omega n left f in mathcal A n left zf'(z) f(z) right frac 1 2 , z in mathbb D right . end align We make use of differential subordination technique to obtain sufficient conditions for the class Omega n , and then employ these conditions to construct functions which involve double integrals and members of Omega n . We also consider a subclass widehat Omega n subset Omega n and obtain subordination results for members of widehat Omega n besides a necessary and sufficient condition. Writing Omega 1 Omega , we obtain inclusion properties of Omega with respect to functions defined on certain parabolic regions and as a consequence, establish a relation connecting the parabolic starlike class mathcal S p and the uniformly starlike UST . Various radius problems for the class Omega are considered and the sharpness of the radii estimates is obtained analytically besides graphical illustrations.


Large deviations for random walks on free products of finitely generated groups. We prove existence of the large deviation principle, with a proper convex rate function, for the distribution of the renormalized distance from the origin of a random walk on a free product of finitely generated groups. As a consequence, we derive the same principle for nearest neighbour random walks on regular trees.


A formalization of forcing and the unprovability of the continuum hypothesis. We describe a formalization of forcing using Boolean valued models in the Lean 3 theorem prover, including the fundamental theorem of forcing and a deep embedding of first order logic with a Boolean valued soundness theorem. As an application of our framework, we specialize our construction to the Boolean algebra of regular opens of the Cantor space 2 omega 2 times omega and formally verify the failure of the continuum hypothesis in the resulting model.


A Game Theoretic Model of Human Driving and Application to Discretionary Lane Changes. In this paper we consider the application of Stackelberg game theory to model discretionary lane changing in lightly congested highway setting. The fundamental intent of this model, which is parameterized to capture driver disposition (aggressiveness or inattentiveness), is to help with the development of decision making strategies for autonomous vehicles in ways that are mindful of how human drivers perform the same function on the road (on which have reported elsewhere.) This paper, however, focuses only on the model development and the respective qualitative assessment. This is accomplished in unit test simulations as well as in bulk mode (i.e. using the Monte Carlo methodology), via a limited traffic micro simulation compared against the NHTSA 100 Car Naturalistic Driving Safety data. In particular, a qualitative comparison shows the relative consistency of the proposed model with human decision making in terms of producing qualitatively similar proportions of crashes and near crashes as a function of driver inattentiveness (or aggressiveness). While this result by itself does not offer a true quantitative validation of the proposed model, it does demonstrate the utility of the proposed approach in modeling discretionary lane changing and may therefore be of use in autonomous driving in a manner that is consistent with human decision making on the road.


Absolutely continuous copulas with prescribed support constructed by differential equations, with an application in toxicology. A new method for constructing absolutely continuous two dimensional copulas by differential equations is presented. The copulas are symmetric with respect to reflection in the opposite diagonal. The support of the copula density may be prescribed to arbitrary opposite symmetric hypographs of invertible functions, containing the diagonal. The method is applied to toxicological probit modeling, where new compatibility conditions for the probit parameters are derived.


Primes in short intervals Heuristics and calculations. We formulate, using heuristic reasoning, precise conjectures for the range of the number of primes in intervals of length y around x , where y ll ( log x) 2 . In particular we conjecture that the maximum grows surprisingly slowly as y ranges from log x to ( log x) 2 . We will show that our conjectures are somewhat supported by available data, though not so well that there may not be room for some modification.


On the Locality of Nash Williams Forest Decomposition and Star Forest Decomposition. Given a graph G (V,E) with arboricity alpha , we study the problem of decomposing the edges of G into (1 epsilon) alpha disjoint forests in the distributed LOCAL model. Barenboim and Elkin PODC 08 gave a LOCAL algorithm that computes a (2 epsilon) alpha forest decomposition using O( frac log n epsilon ) rounds. Ghaffari and Su SODA 17 made further progress by computing a (1 epsilon) alpha forest decomposition in O( frac log 3 n epsilon 4 ) rounds when epsilon alpha Omega( sqrt alpha log n ) , i.e. the limit of their algorithm is an ( alpha Omega( sqrt alpha log n )) forest decomposition. This algorithm, based on a combinatorial construction of Alon, McDiarmid Reed Combinatorica 92 , in fact provides a decomposition of the graph into emph star forests , i.e. each forest is a collection of stars. Our main result in this paper is to reduce the threshold of epsilon alpha in (1 epsilon) alpha forest decomposition and star forest decomposition. This further answers the 10 text th open question from Barenboim and Elkin's "Distributed Graph Algorithms" book. Moreover, it gives the first (1 epsilon) alpha orientation algorithms with it linear dependencies on epsilon 1 . At a high level, our results for forest decomposition are based on a combination of network decomposition, load balancing, and a new structural result on local augmenting sequences. Our result for star forest decomposition uses a more careful probabilistic analysis for the construction of Alon, McDiarmid, Reed the bounds on star arboricity here were not previously known, even non constructively.


Efficient Sentence Embedding via Semantic Subspace Analysis. A novel sentence embedding method built upon semantic subspace analysis, called semantic subspace sentence embedding (S3E), is proposed in this work. Given the fact that word embeddings can capture semantic relationship while semantically similar words tend to form semantic groups in a high dimensional embedding space, we develop a sentence representation scheme by analyzing semantic subspaces of its constituent words. Specifically, we construct a sentence model from two aspects. First, we represent words that lie in the same semantic group using the intra group descriptor. Second, we characterize the interaction between multiple semantic groups with the inter group descriptor. The proposed S3E method is evaluated on both textual similarity tasks and supervised tasks. Experimental results show that it offers comparable or better performance than the state of the art. The complexity of our S3E method is also much lower than other parameterized models.


Generation mechanism of cell assembly to store information about hand recognition. A specific memory is stored in a cell assembly that is activated during fear learning in mice however, research regarding cell assemblies associated with procedural and habit learning processes is lacking. In modeling studies, simulations of the learning process for hand regard, which is a type of procedural learning, resulted in the formation of cell assemblies. However, the mechanisms through which the cell assemblies form and the information stored in these cell assemblies remain unknown. In this paper, the relationship between hand movements and weight changes during the simulated learning process for hand regard was used to elucidate the mechanism through which inhibitory weights are generated, which plays an important role in the formation of cell assemblies. During the early training phase, trial and error attempts to bring the hand into the field of view caused the generation of inhibitory weights, and the cell assemblies self organized from these inhibitory weights. The information stored in the cell assemblies was estimated by examining the contributions of the cell assemblies outputs to hand movements. During sustained hand regard, the outputs from these cell assemblies moved the hand into the field of view, using hand related inputs almost exclusively. Therefore, infants are likely able to select the inputs associated with their hand (that is, distinguish between their hand and others), based on the information stored in the cell assembly, and move their hands into the field of view during sustained hand regard.