Structure exploiting methods for fast uncertainty quantification in multiphase flow through heterogeneous media. We present a computational framework for dimension reduction and surrogate modeling to accelerate uncertainty quantification in computationally intensive models with high dimensional inputs and function valued outputs. Our driving application is multiphase flow in saturated unsaturated porous media in the context of radioactive waste storage. For fast input dimension reduction, we utilize an approximate global sensitivity measure, for function value outputs, motivated by ideas from the active subspace methods. The proposed approach does not require expensive gradient computations. We generate an efficient surrogate model by combining a truncated Karhunen Lo ' e ve (KL) expansion of the output with polynomial chaos expansions, for the output KL modes, constructed in the reduced parameter space. We demonstrate the effectiveness of the proposed surrogate modeling approach with a comprehensive set of numerical experiments, where we consider a number of function valued (temporally or spatially distributed) QoIs.


Ising Based Louvain Method Clustering Large Graphs with Specialized Hardware. Recent advances in specialized hardware for solving optimization problems such quantum computers, quantum annealers, and CMOS annealers give rise to new ways for solving real word complex problems. However, given current and near term hardware limitations, the number of variables required to express a large real world problem easily exceeds the hardware capabilities, thus hybrid methods are usually developed in order to utilize the hardware. In this work, we advocate for the development of hybrid methods that are built on top of the frameworks of existing state of art heuristics, thereby improving these methods. We demonstrate this by building on the so called Louvain method, which is one of the most popular algorithms for the Community detection problem and develop and Ising based Louvain method. The proposed method outperforms two state of the art community detection algorithms in clustering several small to large scale graphs. The results show promise in adapting the same optimization approach to other unsupervised learning heuristics to improve their performance.


On the determinant of multiplication map of a monomial complete intersection ring. In this article, we consider the monomial complete intersection algebra mathbb K x,y langle x d,y q rangle in two variables. For elements l 1, ldots,l d q 2k of degree 1 , we give a formula of the deteminant of linear map from the homogeneous component of degree k to the homogenous component of degree d q k defined by the multiplication of l 1 cdots l d q 2k .


Natural Strategic Abilities in Voting Protocols. Security properties are often focused on the technological side of the system. One implicitly assumes that the users will behave in the right way to preserve the property at hand. In real life, this cannot be taken for granted. In particular, security mechanisms that are difficult and costly to use are often ignored by the users, and do not really defend the system against possible attacks. Here, we propose a graded notion of security based on the complexity of the user's strategic behavior. More precisely, we suggest that the level to which a security property varphi is satisfied can be defined in terms of (a) the complexity of the strategy that the voter needs to execute to make varphi true, and (b) the resources that the user must employ on the way. The simpler and cheaper to obtain varphi , the higher the degree of security. We demonstrate how the idea works in a case study based on an electronic voting scenario. To this end, we model the vVote implementation of the Pret voting protocol for coercion resistant and voter verifiable elections. Then, we identify "natural" strategies for the voter to obtain receipt freeness, and measure the voter's effort that they require. We also look at how hard it is for the coercer to compromise the election through a randomization attack.


Time regularity for local weak solutions of the heat equation on local Dirichlet spaces. We study the time regularity of local weak solutions of the heat equation in the context of local regular symmetric Dirichlet spaces. Under two basic and rather minimal assumptions, namely, the existence of certain cut off functions and a very weak L 2 Gaussian type upper bound for the heat semigroup, we prove that the time derivatives of a local weak solution of the heat equation are themselves local weak solutions. This applies, for instance, to local weak solutions of parabolic equations with uniformly elliptic symmetric divergence form second order operators with measurable coefficients. We describe some applications to the structure of ancient local weak solutions of such equations which generalize recent results of 8 and 33 .


Distributed representation of patients and its use for medical cost prediction. Efficient representation of patients is very important in the healthcare domain and can help with many tasks such as medical risk prediction. Many existing methods, such as diagnostic Cost Groups (DCG), rely on expert knowledge to build patient representation from medical data, which is resource consuming and non scalable. Unsupervised machine learning algorithms are a good choice for automating the representation learning process. However, there is very little research focusing on onpatient level representation learning directly from medical claims. In this paper, weproposed a novel patient vector learning architecture that learns high quality,fixed length patient representation from claims data. We conducted several experiments to test the quality of our learned representation, and the empirical results show that our learned patient vectors are superior to vectors learned through other methods including a popular commercial model. Lastly, we provide potential clinical interpretation for using our representation on predictive tasks, as interpretability is vital in the healthcare domain


The inviscid limit for the Navier Stokes equations with data analytic only near the boundary. We address the inviscid limit for the Navier Stokes equations in a half space, with initial datum that is analytic only close to the boundary of the domain, and has finite Sobolev regularity in the complement. We prove that for such data the solution of the Navier Stokes equations converges in the vanishing viscosity limit to the solution of the Euler equation, on a constant time interval.


Convergence of proximal solutions for evolution inclusions with time dependent maximal monotone operators. This article studies the solutions of time dependent differential inclusions which is motivated by their utility in the modeling of certain physical systems. The differential inclusion is described by a time dependent set valued mapping having the property that, for a given time instant, the set valued mapping describes a maximal monotone operator. Under certain mild assumptions on the regularity with respect to the time argument, we construct a sequence of functions parameterized by the sampling time that corresponds to the discretization of the continuous time system. Using appropriate tools from functional and variational analysis, this sequence is then shown to converge to the unique solution of the original differential inclusion. The result is applied to develop conditions for well posedness of differential equations interconnected with nonsmooth time dependent complementarity relations, using passivity of underlying dynamics (equivalently expressed in terms of linear matrix inequalities).


Sharp subcritical and critical L p Hardy inequalities on the sphere. We prove sharp inequalities of Hardy type for functions in the Sobolev space W 1,p on the unit sphere mathbb S n 1 in mathbb R n . We achieve this in both the subcritical and critical cases. The method we use to show optimality takes into account all the constants involved in our inequalities.


Towards More Realistic Human Robot Conversation A Seq2Seq based Body Gesture Interaction System. This paper presents a novel system that enables intelligent robots to exhibit realistic body gestures while communicating with humans. The proposed system consists of a listening model and a speaking model used in corresponding conversational phases. Both models are adapted from the sequence to sequence (seq2seq) architecture to synthesize body gestures represented by the movements of twelve upper body keypoints. All the extracted 2D keypoints are firstly 3D transformed, then rotated and normalized to discard irrelevant information. Substantial videos of human conversations from Youtube are collected and preprocessed to train the listening and speaking models separately, after which the two models are evaluated using metrics of mean squared error (MSE) and cosine similarity on the test dataset. The tuned system is implemented to drive a virtual avatar as well as Pepper, a physical humanoid robot, to demonstrate the improvement on conversational interaction abilities of our method in practice.


Elastic Weyl points and surface arc states in 3D structures. The study of Weyl points in electronic systems has inspired many recent researches in classical systems such as photonic and acoustic lattices. Here we show how the Weyl physics can also inspire the design of novel elastic structures. We construct a single phase 3D structure, an analogue of the AA stacked honeycomb lattice, and predict the existence of Weyl points with opposite topological charges ( pm 1 ), elastic Fermi arcs, and the associated gapless topologically protected surface states. We employ full scale numerical simulations on the elastic 3D structure, and present a clear visualization of topological surface states that are directional and robust. Such designed lattices can pave the way for novel vibration control and energy harvesting on structures that are ubiquitous in many engineering applications.


When Distributed Ledger Technology meets Internet of Things Benefits and Challenges. There is a growing interest from both the academia and industry to employ distributed ledger technology in the Internet of Things domain for addressing security related and performance challenges. Distributed ledger technology enables non trusted entities to communicate and reach consensus in a fully distributed manner through a cryptographically secure and immutable ledger. However, significant challenges arise mainly related to transaction processing speed and user privacy. This work explores the interplay between Internet of Things and distributed ledger technology, analysing the fundamental characteristics of this technology and discussing the related benefits and challenges.


Tur 'an and Ramsey problems for alternating multilinear maps. Guided by the connections between hypergraphs and exterior algebras, we study Tur 'an and Ramsey type problems for alternating multilinear maps. This study lies at the intersection of combinatorics, group theory, and algebraic geometry, and has origins in the works of Lov 'asz (Proc. Sixth British Combinatorial Conf., 1977), Buhler, Gupta, and Harris (J. Algebra, 1987), and Feldman and Propp (Adv. Math., 1992). Our main result is a Ramsey theorem for alternating bilinear maps. Given s, t in mathbb N , s, t geq 2 , and an alternating bilinear map f V times V to U with dim(V) s cdot t 4 , we show that there exists either a dimension s subspace W leq V such that dim(f(W, W)) 0 , or a dimension t subspace W leq V such that dim(f(W, W)) binom t 2 . This result has natural group theoretic (for finite p groups) and geometric (for Grassmannians) implications, and leads to new Ramsey type questions for varieties of groups and Grassmannians.


Big Transfer (BiT) General Visual Representation Learning. Transfer of pre trained representations improves sample efficiency and simplifies hyperparameter tuning when training deep neural networks for vision. We revisit the paradigm of pre training on large supervised datasets and fine tuning the model on a target task. We scale up pre training, and propose a simple recipe that we call Big Transfer (BiT). By combining a few carefully selected components, and transferring using a simple heuristic, we achieve strong performance on over 20 datasets. BiT performs well across a surprisingly wide range of data regimes from 1 example per class to 1M total examples. BiT achieves 87.5 top 1 accuracy on ILSVRC 2012, 99.4 on CIFAR 10, and 76.3 on the 19 task Visual Task Adaptation Benchmark (VTAB). On small datasets, BiT attains 76.8 on ILSVRC 2012 with 10 examples per class, and 97.0 on CIFAR 10 with 10 examples per class. We conduct detailed analysis of the main components that lead to high transfer performance.


A Generalized Framework for Agglomerative Clustering of Signed Graphs applied to Instance Segmentation. We propose a novel theoretical framework that generalizes algorithms for hierarchical agglomerative clustering to weighted graphs with both attractive and repulsive interactions between the nodes. This framework defines GASP, a Generalized Algorithm for Signed graph Partitioning, and allows us to explore many combinations of different linkage criteria and cannot link constraints. We prove the equivalence of existing clustering methods to some of those combinations, and introduce new algorithms for combinations which have not been studied. An extensive comparison is performed to evaluate properties of the clustering algorithms in the context of instance segmentation in images, including robustness to noise and efficiency. We show how one of the new algorithms proposed in our framework outperforms all previously known agglomerative methods for signed graphs, both on the competitive CREMI 2016 EM segmentation benchmark and on the CityScapes dataset.


Instance Weighted Incremental Evolution Strategies for Reinforcement Learning in Dynamic Environments. Evolution strategies (ES), as a family of black box optimization algorithms, recently emerge as a scalable alternative to reinforcement learning (RL) approaches such as Q learning or policy gradient, and are much faster when many central processing units (CPUs) are available due to better parallelization. In this paper, we propose a systematic incremental learning method for ES in dynamic environments. The goal is to adjust previously learned policy to a new one incrementally whenever the environment changes. We incorporate an instance weighting mechanism with ES to facilitate its learning adaptation, while retaining scalability of ES. During parameter updating, higher weights are assigned to instances that contain more new knowledge, thus encouraging the search distribution to move towards new promising areas of parameter space. We propose two easy to implement metrics to calculate the weights instance novelty and instance quality. Instance novelty measures an instance's difference from the previous optimum in the original environment, while instance quality corresponds to how well an instance performs in the new environment. The resulting algorithm, Instance Weighted Incremental Evolution Strategies (IW IES), is verified to achieve significantly improved performance on challenging RL tasks ranging from robot navigation to locomotion. This paper thus introduces a family of scalable ES algorithms for RL domains that enables rapid learning adaptation to dynamic environments.


Robust Cellular Communications for Unmanned Aerial Vehicles in Maritime Search and Rescue. Unmanned aerial vehicles (UAV) are a promising technology for fast, large scale survey operations such as maritime search and rescue (SAR). However, providing reliable communications over long distances remains a challenge. Cellular technology such as Long Term Evolution (LTE) is designed to perform well in the presence of fast moving clients and highly dynamic channel conditions. Yet, its generic medium access mechanisms make it hard to support low latency uplink traffic, which is needed for real time command and control and similar applications. In this paper, we introduce an unmanned aerial system for maritime SAR, supported via an LTE data link. To mitigate drawbacks in uplink channel access, we develop a resource guaranteed scheme based on persistent scheduling, using an open source LTE stack. The approach is evaluated with a laboratory setup using software defined radio modules. Measurements are taken on the application layer, using real world telemetry data generated by an autopilot system in the presence of high bandwidth background traffic. Evaluations demonstrate that our system fulfills UAV requirements in terms of latency and reliability. Latency is further reduced to 6 ms on average and a 99.9th percentile of 10 ms by application aware overprovisioning for mission critical traffic and users.


Portability of Scientific Workflows in NGS Data Analysis A Case Study. The analysis of next generation sequencing (NGS) data requires complex computational workflows consisting of dozens of autonomously developed yet interdependent processing steps. Whenever large amounts of data need to be processed, these workflows must be executed on a parallel and or distributed systems to ensure reasonable runtime. Porting a workflow developed for a particular system on a particular hardware infrastructure to another system or to another infrastructure is non trivial, which poses a major impediment to the scientific necessities of workflow reproducibility and workflow reusability. In this work, we describe our efforts to port a state of the art workflow for the detection of specific variants in whole exome sequencing of mice. The workflow originally was developed in the scientific workflow system snakemake for execution on a high performance cluster controlled by Sun Grid Engine. In the project, we ported it to the scientific workflow system SaasFee that can execute workflows on (multi core) stand alone servers or on clusters of arbitrary sizes using the Hadoop. The purpose of this port was that also owners of low cost hardware infrastructures, for which Hadoop was made for, become able to use the workflow. Although both the source and the target system are called scientific workflow systems, they differ in numerous aspects, ranging from the workflow languages to the scheduling mechanisms and the file access interfaces. These differences resulted in various problems, some expected and more unexpected, that had to be resolved before the workflow could be run with equal semantics. As a side effect, we also report cost runtime ratios for a state of the art NGS workflow on very different hardware platforms A comparably cheap stand alone server (80 threads), a mid cost, mid sized cluster (552 threads), and a high end HPC system (3784 threads).


Generalized k contact structures. With the goal to study and better understand algebraic Anosov actions of mathbb R k , we develop a higher codimensional analogue of the contact distribution on odd dimensional manifolds, call such structure a generalized k contact structure. We show that there exist an mathbb R k action associated with this structure, afterwards, we relate this structure with the Weyl chamber actions and a few more general algebraic Anosov actions, proving that such actions admits a compatible generalized k contact structure.


RobustScanner Dynamically Enhancing Positional Clues for Robust Text Recognition. The attention based encoder decoder framework has recently achieved impressive results for scene text recognition, and many variants have emerged with improvements in recognition quality. However, it performs poorly on contextless texts (e.g., random character sequences) which is unacceptable in most of real application scenarios. In this paper, we first deeply investigate the decoding process of the decoder. We empirically find that a representative character level sequence decoder utilizes not only context information but also positional information. Contextual information, which the existing approaches heavily rely on, causes the problem of attention drift. To suppress such side effect, we propose a novel position enhancement branch, and dynamically fuse its outputs with those of the decoder attention module for scene text recognition. Specifically, it contains a position aware module to enable the encoder to output feature vectors encoding their own spatial positions, and an attention module to estimate glimpses using the positional clue (i.e., the current decoding time step) only. The dynamic fusion is conducted for more robust feature via an element wise gate mechanism. Theoretically, our proposed method, dubbed emph RobustScanner , decodes individual characters with dynamic ratio between context and positional clues, and utilizes more positional ones when the decoding sequences with scarce context, and thus is robust and practical. Empirically, it has achieved new state of the art results on popular regular and irregular text recognition benchmarks while without much performance drop on contextless benchmarks, validating its robustness in both contextual and contextless application scenarios.


On the strong regularity of degenerate additive noise driven stochastic differential equations with respect to their initial values. Recently in M. Hairer, M. Hutzenthaler, and A. Jentzen, Ann. Probab. 43, 2 (2015), 468 527 and A. Jentzen, T. M "uller Gronbach, and L. Yaroslavtseva, Commun. Math. Sci. 14, 6 (2016), 1477 1500 stochastic differential equations (SDEs) with smooth coefficient functions have been constructed which have an arbitrarily slowly converging modulus of continuity in the initial value. In these SDEs it is crucial that some of the first order partial derivatives of the drift coefficient functions grow at least exponentially and, in particular, quicker than any polynomial. However, in applications SDEs do typically have coefficient functions whose first order partial derivatives are polynomially bounded. In this article we study whether arbitrarily bad regularity phenomena in the initial value may also arise in the latter case and we partially answer this question in the negative. More precisely, we show that every additive noise driven SDE which admits a Lyapunov type condition (which ensures the existence of a unique solution of the SDE) and which has a drift coefficient function whose first order partial derivatives grow at most polynomially is at least logarithmically H "older continuous in the initial value.


Stability of the non abelian X ray transform in dimension ge 3 . Non abelian X ray tomography seeks to recover a matrix potential Phi M rightarrow mathbb C m times m in a domain M from measurements of its so called scattering data C Phi at partial M . For dim M ge 3 (and under appropriate convexity and regularity conditions), injectivity of the forward map Phi mapsto C Phi was established in arXiv 1605.07894 . In this article we extend arXiv 1605.07894 by proving a H "older type stability estimate. As an application we generalise a statistical consistency result for dim M 2 arXiv 1905.00860 to higher dimensions. The injectivity proof in arXiv 1605.07894 relies on a novel method by Uhlmann Vasy arXiv 1210.2084 , which first establishes injectivity in a shallow layer below partial M and then globalises this by a layer stripping argument. The main technical contribution of this paper is a more quantitative version of these arguments, in particular proving uniform bounds on layer depth and stability constants.


Real Time Quality Assessment of Pediatric MRI via Semi Supervised Deep Nonlocal Residual Neural Networks. In this paper, we introduce an image quality assessment (IQA) method for pediatric T1 and T2 weighted MR images. IQA is first performed slice wise using a nonlocal residual neural network (NR Net) and then volume wise by agglomerating the slice QA results using random forest. Our method requires only a small amount of quality annotated images for training and is designed to be robust to annotation noise that might occur due to rater errors and the inevitable mix of good and bad slices in an image volume. Using a small set of quality assessed images, we pre train NR Net to annotate each image slice with an initial quality rating (i.e., pass, questionable, fail), which we then refine by semi supervised learning and iterative self training. Experimental results demonstrate that our method, trained using only samples of modest size, exhibit great generalizability, capable of real time (milliseconds per volume) large scale IQA with near perfect accuracy.


Energy Minimization for Mobile Edge Computing Networks with Time Sensitive Constraints. Mobile edge computing (MEC) provides users with a high quality experience (QoE) by placing servers with rich services close to the end users. Compared with local computing, MEC can contribute to energy saving, but results in increased communication latency. In this paper, we jointly optimize task offloading and resource allocation to minimize the energy consumption in an orthogonal frequency division multiple access (OFDMA) based MEC networks, where the time sensitive tasks can be processed at both local users and MEC server via partial offloading. Since the optimization variables of the problem are strongly coupled, we first decompose the original problem into two subproblems named as offloading selection (PO), and subcarriers and computing resource allocation (PS), and then propose an iterative algorithm to deal with them in a sequence. To be specific, we derive the closed form solution for PO, and deal with PS by an alternating way in the dual domain due to its NP hardness. Simulation results demonstrate


Dynamic real time risk analytics of uncontrollable states in complex internet of things systems, cyber risk at the edge. The Internet of Things (IoT) triggers new types of cyber risks. Therefore, the integration of new IoT devices and services requires a self assessment of IoT cyber security posture. By security posture this article refers to the cybersecurity strength of an organisation to predict, prevent and respond to cyberthreats. At present, there is a gap in the state of the art, because there are no self assessment methods for quantifying IoT cyber risk posture. To address this gap, an empirical analysis is performed of 12 cyber risk assessment approaches. The results and the main findings from the analysis is presented as the current and a target risk state for IoT systems, followed by conclusions and recommendations on a transformation roadmap, describing how IoT systems can achieve the target state with a new goal oriented dependency model. By target state, we refer to the cyber security target that matches the generic security requirements of an organisation. The research paper studies and adapts four alternatives for IoT risk assessment and identifies the goal oriented dependency modelling as a dominant approach among the risk assessment models studied. The new goal oriented dependency model in this article enables the assessment of uncontrollable risk states in complex IoT systems and can be used for a quantitative self assessment of IoT cyber risk posture.


Asymptotically best possible Lebesque type inequalities for the Fourier sums on sets of generalized Poisson integrals. In this paper we establish Lebesgue type inequalities for 2 pi periodic functions f , which are defined by generalized Poisson integrals of the functions varphi from L p , 1 leq p infty . In these inequalities uniform norms of deviations of Fourier sums f S n 1 C are expressed via best approximations E n ( varphi) L p of functions varphi by trigonometric polynomials in the metric of space L p . We show that obtained estimates are asymptotically best possible.


SMAP Single Shot Multi Person Absolute 3D Pose Estimation. Recovering multi person 3D poses with absolute scales from a single RGB image is a challenging problem due to the inherent depth and scale ambiguity from a single view. Addressing this ambiguity requires to aggregate various cues over the entire image, such as body sizes, scene layouts, and inter person relationships. However, most previous methods adopt a top down scheme that first performs 2D pose detection and then regresses the 3D pose and scale for each detected person individually, ignoring global contextual cues. In this paper, we propose a novel system that first regresses a set of 2.5D representations of body parts and then reconstructs the 3D absolute poses based on these 2.5D representations with a depth aware part association algorithm. Such a single shot bottom up scheme allows the system to better learn and reason about the inter person depth relationship, improving both 3D and 2D pose estimation. The experiments demonstrate that the proposed approach achieves the state of the art performance on the CMU Panoptic and MuPoTS 3D datasets and is applicable to in the wild videos.


Lithic techno complexes in Italy from 50 to 39 thousand years BP an overview of lithic technological changes across the Middle Upper Palaeolithic boundary. Defining the processes involved in the technical cultural shifts from the Late Middle to the Early Upper Palaeolithic in Europe ( 50 39 thousand years BP) is one of the most important tasks facing prehistoric studies. In this debate Italy plays a pivotal role, due to its geographical position between eastern and western Mediterranean Europe as well as to it being the location of several sites showing Late Mousterian, Uluzzian and Protoaurignacian evidence distributed across the Peninsula. Our study aims to provide a synthesis of the available lithic evidence from this key area through a review of the evidence collected from a number of reference sites. The main technical features of the Late Mousterian, the Uluzzian and the Protoaurignacian traditions are examined from a diachronic and spatial perspective. Our overview allows the identification of major differences in the technological behaviour of these populations, making it possible to propose a number of specific working hypotheses on the basis of which further studies can be carried out. This study presents a detailed comparative study of the whole corpus of the lithic production strategies documented during this interval, and crucial element thus emerge.These data are of primary importance in order to assess the nature of the "transition" phenomenon in Italy, thus contributing to the larger debate about the disappearance of Neandertals and the arrival of early Modern Humans in Europe.


Controlling spatiotemporal nonlinearities in multimode fibers with deep neural networks. Spatiotemporal nonlinear interactions in multimode fibers are of interest for beam shaping and frequency conversion by exploiting the nonlinear propagation of different pump regimes from quasi continuous wave to ultrashort pulses centered around visible to infrared pump wavelengths. The nonlinear effects in multi mode fibers depend strongly on the excitation condition, however relatively little work has been reported on this subject. Here, we present the first machine learning approach to learn and control the nonlinear frequency conversion inside multimode fibers by tailoring the excitation condition via deep neural networks. Trained with experimental data, deep neural networks are adapted to learn the relation between the spatial beam profile of the pump pulse and the spectrum generation. For different user defined target spectra, network suggested beam shapes are applied and control over the cascaded Raman scattering and supercontinuum generation processes are achieved. Our results present a novel method to tune the spectra of a broadband source.


Asymptotic behaviour of singular solution of the fast diffusion equation in the punctured Euclidean space. For n ge 3 , 0 m frac n 2 n , beta 0 and alpha frac 2 beta 1 m , we prove the existence, uniqueness and asymptotics near the origin of the singular eternal self similar solutions of the fast diffusion equation in ( mathbb R n setminus 0 ) times mathbb R of the form U lambda (x,t) e alpha t f lambda (e beta t x), x in mathbb R n setminus 0 , t in mathbb R , where f lambda is a radially symmetric function satisfying frac n 1 m Delta f m alpha f beta x cdot nabla f 0 text in mathbb R n setminus 0 , with underset substack r to 0 lim frac r 2f(r) 1 m log r 1 frac 2(n 1)(n 2 nm) beta (1 m) and underset substack r to infty lim r frac n 2 m f(r) lambda frac 2 1 m frac n 2 m , for some constant lambda 0 . As a consequence we prove the existence and uniqueness of solutions of Cauchy problem for the fast diffusion equation u t frac n 1 m Delta u m in ( mathbb R n setminus 0 ) times (0, infty) with initial value u 0 satisfying f lambda 1 (x) le u 0(x) le f lambda 2 (x) , forall x in mathbb R n setminus 0 , which satisfies U lambda 1 (x,t) le u(x,t) le U lambda 2 (x,t) , forall x in mathbb R n setminus 0 , t ge 0 , for some constants lambda 1 lambda 2 0 . We also prove the asymptotic behaviour of such singular solution u of the fast diffusion equation as t to infty when n 3,4 and frac n 2 n 2 le m frac n 2 n holds. Asymptotic behaviour of such singular solution u of the fast diffusion equation as t to infty is also obtained when 3 le n 8 , 1 sqrt 2 n le m min left( frac 2(n 2) 3n , frac n 2 n 2 right) , and u(x,t) is radially symmetric in x in mathbb R n setminus 0 for any t 0 under appropriate conditions on the initial value u 0 .


Finite and symmetric Mordell Tornheim multiple zeta values. We introduce finite and symmetric Mordell Tornheim type of multiple zeta values and give a new approach to the Kaneko Zagier conjecture stating that the finite and symmetric multiple zeta values satisfy the same relations.


A Distributed Algorithm for High Dimension Convex Quadratically Constrained Quadratic Programs. We propose a Jacobi style distributed algorithm to solve convex, quadratically constrained quadratic programs (QCQPs), which arise from a broad range of applications. While small to medium sized convex QCQPs can be solved efficiently by interior point algorithms, large scale problems pose significant challenges to traditional algorithms that are mainly designed to be implemented on a single computing unit. The exploding volume of data (and hence, the problem size), however, may overwhelm any such units. In this paper, we propose a distributed algorithm for general, non separable, large scale convex QCQPs, using a novel idea of predictor corrector primal dual update with an adaptive step size. The algorithm enables distributed storage of data as well as parallel distributed computing. We establish the conditions for the proposed algorithm to converge to a global optimum, and implement our algorithm on a computer cluster with multiple nodes using Message Passing Interface (MPI). The numerical experiments are conducted on data sets of various scales from different applications, and the results show that our algorithm exhibits favorable scalability for solving large scale problems.


Global Attractors for Hindmarsh Rose Equations in Neurodynamics. Global dynamics of the diffusive and partly diffusive Hindmarsh Rose equations on a three dimensional bounded domain originated in neurodynamics are investigated in this paper. The existence of global attractors as well as the regularity are proved through various uniform estimates showing the dissipative properties and the asymptotically compact characteristics, especially for the partly diffusive Hindmarsh Rose equations by means of the Kolmogorov Riesz theorem.


Exploring the Limitations of Behavior Cloning for Autonomous Driving. Driving requires reacting to a wide variety of complex environment conditions and agent behaviors. Explicitly modeling each possible scenario is unrealistic. In contrast, imitation learning can, in theory, leverage data from large fleets of human driven cars. Behavior cloning in particular has been successfully used to learn simple visuomotor policies end to end, but scaling to the full spectrum of driving behaviors remains an unsolved problem. In this paper, we propose a new benchmark to experimentally investigate the scalability and limitations of behavior cloning. We show that behavior cloning leads to state of the art results, including in unseen environments, executing complex lateral and longitudinal maneuvers without these reactions being explicitly programmed. However, we confirm well known limitations (due to dataset bias and overfitting), new generalization issues (due to dynamic objects and the lack of a causal model), and training instability requiring further research before behavior cloning can graduate to real world driving. The code of the studied behavior cloning approaches can be found at https github.com felipecode coiltraine .


Certified Grasping. This paper studies robustness in planar grasping from a geometric perspective. By treating grasping as a process that shapes the free space of an object over time, we can define three types of certificates to guarantee success of a grasp (a) invariance under an initial set, (b) convergence towards a goal grasp, and (c) observability over the final object pose. We develop convex combinatorial models for each of these certificates, which can be expressed as simple semi algebraic relations under mild modeling assumptions. By leveraging these models to synthesize certificates, we optimize certifiable grasps of arbitrary planar objects composed as a union of convex polygons, using manipulators described as point fingers. We validate this approach with simulations and real robot experiments, by grasping random polygons, comparing against other standard grasp planning algorithms, and performing sensorless grasps over different objects.


Masksembles for Uncertainty Estimation. Deep neural networks have amply demonstrated their prowess but estimating the reliability of their predictions remains challenging. Deep Ensembles are widely considered as being one of the best methods for generating uncertainty estimates but are very expensive to train and evaluate. MC Dropout is another popular alternative, which is less expensive, but also less reliable. Our central intuition is that there is a continuous spectrum of ensemble like models of which MC Dropout and Deep Ensembles are extreme examples. The first uses an effectively infinite number of highly correlated models while the second relies on a finite number of independent models. To combine the benefits of both, we introduce Masksembles. Instead of randomly dropping parts of the network as in MC dropout, Masksemble relies on a fixed number of binary masks, which are parameterized in a way that allows to change correlations between individual models. Namely, by controlling the overlap between the masks and their density one can choose the optimal configuration for the task at hand. This leads to a simple and easy to implement method with performance on par with Ensembles at a fraction of the cost. We experimentally validate Masksembles on two widely used datasets, CIFAR10 and ImageNet.


Point Line Geometry in the Tropical Plane. We study the classical result by Bruijn and Erd H os regarding the bound on the number of lines determined by a n point configuration in the plane, and in the light of the recently proven Tropical Sylvester Gallai theorem, come up with a tropical version of the above mentioned result. In this work, we introduce stable tropical lines, which help in answering questions pertaining to incidence geometry in the tropical plane. Projective duality in the tropical plane helps in translating the question for stable lines to stable intersections that have been previously studied in depth. Invoking duality between Newton subdivisions and line arrangements, we are able to classify stable intersections with shapes of cells in subdivisions, and this ultimately helps us in coming up with a bound. In this process, we also encounter various unique properties of linear Newton subdivisions which are dual to tropical line arrangements.


Knowledge is Never Enough Towards Web Aided Deep Open World Recognition. While today's robots are able to perform sophisticated tasks, they can only act on objects they have been trained to recognize. This is a severe limitation any robot will inevitably see new objects in unconstrained settings, and thus will always have visual knowledge gaps. However, standard visual modules are usually built on a limited set of classes and are based on the strong prior that an object must belong to one of those classes. Identifying whether an instance does not belong to the set of known categories (i.e. open set recognition), only partially tackles this problem, as a truly autonomous agent should be able not only to detect what it does not know, but also to extend dynamically its knowledge about the world. We contribute to this challenge with a deep learning architecture that can dynamically update its known classes in an end to end fashion. The proposed deep network, based on a deep extension of a non parametric model, detects whether a perceived object belongs to the set of categories known by the system and learns it without the need to retrain the whole system from scratch. Annotated images about the new category can be provided by an 'oracle' (i.e. human supervision), or by autonomous mining of the Web. Experiments on two different databases and on a robot platform demonstrate the promise of our approach.


Group velocity distribution and short pulse dispersion in a disordered transverse Anderson localization optical waveguide. We investigate the group velocity distribution of waveguide modes in the presence of disorder. The results are based on extensive numerical simulations of disordered optical waveguides using statistical methods. We observe that the narrowest distribution of group velocities is obtained in the presence of a small amount of disorder therefore, the modal dispersion of an optical pulse is minimized when there is only a slight disorder in the waveguide. The absence of disorder or the presence of a large amount of disorder can result in a large modal dispersion due to the broadening of the distribution of the group velocities. We devise a metric that can be applied to the mode group index probability density function and predict the optimal level of disorder that results in the lowest amount of modal dispersion for short pulse propagation. Our results are important for studying the propagation of optical pulses in the linear regime, e.g., for optical communications and the nonlinear regime for high power short pulse propagation.


Gorenstein stable surfaces with K X 2 2 and chi( mathcal O X) 4 . We define and study a concrete stratification of the moduli space of Gorenstein stable surfaces X satisfying K X 2 2 and chi( mathcal O X ) 4 , by first establishing an isomorphism with the moduli space of plane octics with certain singularities, which is then easier to handle concretely. In total, there are 47 inhabited strata with altogether 78 components.


From the signature theorem to anomaly cancellation. We survey the Hirzebruch signature theorem as a special case of the Atiyah Singer index theorem. The family version of the Atiyah Singer index theorem in the form of the Riemann Roch Grothendieck Quillen (RRGQ) formula is then applied to the complexified signature operators varying along the universal family of elliptic curves. The RRGQ formula allows us to determine a generalized cohomology class on the base of the elliptic fibration that is known in physics as (a measure of) the local and global anomaly. Combining several anomalous operators allows us to cancel the local anomaly on a Jacobian elliptic surface, a construction that is based on the construction of the Poincar 'e line bundle over an elliptic surface.


Large Deviations and Exit times for reflected McKean Vlasov equations with self stabilizing terms and superlinear drifts. We study a class of reflected McKean Vlasov diffusions over a convex domain with self stabilizing coefficients. This includes coefficients that do not satisfy the classical Wasserstein Lipschitz condition. Further, the process is constrained to a (not necessarily bounded) convex domain by a local time on the boundary. These equations include the subclass of reflected self stabilizing diffusions that drift towards their mean via a convolution of the solution law with a stabilizing potential. Firstly, we establish existence and uniqueness results for this class and address the propagation of chaos. We work with a broad class of coefficients, including drift terms that are locally Lipschitz in spatial and measure variables. However, we do not rely on the boundedness of the domain or the coefficients to account for these non linearities and instead use the self stabilizing properties. We prove a Freidlin Wentzell type Large Deviations Principle and an Eyring Kramer's law for the exit time from subdomains contained in the interior of the reflecting domain.


Improving Panoptic Segmentation at All Scales. Crop based training strategies decouple training resolution from GPU memory consumption, allowing the use of large capacity panoptic segmentation networks on multi megapixel images. Using crops, however, can introduce a bias towards truncating or missing large objects. To address this, we propose a novel crop aware bounding box regression loss (CABB loss), which promotes predictions to be consistent with the visible parts of the cropped objects, while not over penalizing them for extending outside of the crop. We further introduce a novel data sampling and augmentation strategy which improves generalization across scales by counteracting the imbalanced distribution of object sizes. Combining these two contributions with a carefully designed, top down panoptic segmentation architecture, we obtain new state of the art results on the challenging Mapillary Vistas (MVD), Indian Driving and Cityscapes datasets, surpassing the previously best approach on MVD by 4.5 PQ and 5.2 mAP.


A New Stock Market Valuation Measure with Applications to Equity Linked Annuities. We propose a new stock market valuation measure. We use the USA stock market data from 1871. We split total returns into three components earnings growth, dividend yield, and valuation change. The first two components are fundamental, the third is speculative. We treat earnings growth as exogenous. Combining the other two components gives us a new valuation measure, which fits autoregression of order 1 with Gaussian innovations, centered at 4.6 . Therefore, long term total returns equal long term earnings growth plus 4.6 . We confirm the classic 4 withdrawal rule for investing in stocks A retiree should invest in stocks and withdraw 4 of initial wealth after adjusting for inflation. This is useful for equity linked annuities, which invest retiree's savings used for annuity purchase into the stock market.


Hard Aware Fashion Attribute Classification. Fashion attribute classification is of great importance to many high level tasks such as fashion item search, fashion trend analysis, fashion recommendation, etc. The task is challenging due to the extremely imbalanced data distribution, particularly the attributes with only a few positive samples. In this paper, we introduce a hard aware pipeline to make full use of "hard" samples attributes. We first propose Hard Aware BackPropagation (HABP) to efficiently and adaptively focus on training "hard" data. Then for the identified hard labels, we propose to synthesize more complementary samples for training. To stabilize training, we extend semi supervised GAN by directly deactivating outputs for synthetic complementary samples (Deact). In general, our method is more effective in addressing "hard" cases. HABP weights more on "hard" samples. For "hard" attributes with insufficient training data, Deact brings more stable synthetic samples for training and further improve the performance. Our method is verified on large scale fashion dataset, outperforming other state of the art without any additional supervisions.


ATTACK2VEC Leveraging Temporal Word Embeddings to Understand the Evolution of Cyberattacks. Despite the fact that cyberattacks are constantly growing in complexity, the research community still lacks effective tools to easily monitor and understand them. In particular, there is a need for techniques that are able to not only track how prominently certain malicious actions, such as the exploitation of specific vulnerabilities, are exploited in the wild, but also (and more importantly) how these malicious actions factor in as attack steps in more complex cyberattacks. In this paper we present ATTACK2VEC, a system that uses temporal word embeddings to model how attack steps are exploited in the wild, and track how they evolve. We test ATTACK2VEC on a dataset of billions of security events collected from the customers of a commercial Intrusion Prevention System over a period of two years, and show that our approach is effective in monitoring the emergence of new attack strategies in the wild and in flagging which attack steps are often used together by attackers (e.g., vulnerabilities that are frequently exploited together). ATTACK2VEC provides a useful tool for researchers and practitioners to better understand cyberattacks and their evolution, and use this knowledge to improve situational awareness and develop proactive defenses.


A new interface capturing method for Allen Cahn type equations based on a flow dynamic approach in Lagrangian coordinates, I. One dimensional case. We develop a new Lagrangian approach flow dynamic approach to effectively capture the interface in the Allen Cahn type equations. The underlying principle of this approach is the Energetic Variational Approach (EnVarA), motivated by Rayleigh and Onsager cite onsager1931reciprocal,onsager1931reciprocal2 . Its main advantage, comparing with numerical methods in Eulerian coordinates, is that thin interfaces can be effectively captured with few points in the Lagrangian coordinate. We concentrate in the one dimensional case and construct numerical schemes for the trajectory equation in Lagrangian coordinate that obey the variational structures, and as a consequence, are energy dissipative. Ample numerical results are provided to show that only a fewer points are enough to resolve very thin interfaces by using our Lagrangian approach.


Linear transient growth of particulate pipe flows. We tackle the question of whether the presence of particles in a pipe flow can influence the linear transient growth of infinitesimal perturbations, in view of better understanding the behaviour of particulate pipe flows in regimes of transition to turbulence. The problem is tackled numerically by means of a simple model where particles are modelled as a second fluid, that interacts with the fluid phase through a two way Stokes drag only. The transient growth is found to be enhanced by the presence of particles, especially so if the particles are localised at a specific radial location of the pipe. At the same time, the mechanisms of transient growth themselves remain those of non particulate flows. The effect is maximised for particles of intermediate size (somewhere between the ballistic limit of very light particles and the point where they are too heavy to be influenced by the flow). Most remarkably, the Segre Silberberg radius (around 2 3 of the pipe radius), where particles naturally cluster in laminar flows, turns out to be close to the optimal location to enhance the transient growth.


Nonnegative Whitney Extension Problem for C 1( mathbb R n) . Let f be a real valued function on a compact subset in mathbb R n . We show how to decide if f extends to a nonnegative and C 1 function on mathbb R n . There has been no known result for nonnegative C m extension from a general compact set E when m 0 . The nonnegative extension problem for m geq 2 remains open.


Steady information transfer through free space employing orthogonal aberration mode division multiplexing. In this paper we propose and experimentally demonstrate information transfer through free space using a laser beam encoded with multiple orthogonal aberration modes in its phase profile. We use Zernike polynomials which forms a complete set of basis functions to represent the aberration modes. The user information is encoded as amplitudes of multiple Zernike modes whose linear combination is used to define the wavefront of the laser beam in the transmission station. It therefore requires a single phase modulating device since the multiplexing is done digitally providing flexibility over the number and type of modes used. The receiving station uses a wavefront sensor that gives a direct measure of all the aberration modes from a single measurement which is decoded to retrieve the user information. The transmission mechanism enables the use of multiple modes and multiple strengths of each mode to encode the user information and external perturbation compensation, utilizing the completeness of the orthogonal modes.


Computing Lyapunov functions using deep neural networks. We propose a deep neural network architecture and a training algorithm for computing approximate Lyapunov functions of systems of nonlinear ordinary differential equations. Under the assumption that the system admits a compositional Lyapunov function, we prove that the number of neurons needed for an approximation of a Lyapunov function with fixed accuracy grows only polynomially in the state dimension, i.e., the proposed approach is able to overcome the curse of dimensionality. We show that nonlinear systems satisfying a small gain condition admit compositional Lyapunov functions. Numerical examples in up to ten space dimensions illustrate the performance of the training scheme.


Linear Mode Connectivity in Multitask and Continual Learning. Continual (sequential) training and multitask (simultaneous) training are often attempting to solve the same overall objective to find a solution that performs well on all considered tasks. The main difference is in the training regimes, where continual learning can only have access to one task at a time, which for neural networks typically leads to catastrophic forgetting. That is, the solution found for a subsequent task does not perform well on the previous ones anymore. However, the relationship between the different minima that the two training regimes arrive at is not well understood. What sets them apart? Is there a local structure that could explain the difference in performance achieved by the two different schemes? Motivated by recent work showing that different minima of the same task are typically connected by very simple curves of low error, we investigate whether multitask and continual solutions are similarly connected. We empirically find that indeed such connectivity can be reliably achieved and, more interestingly, it can be done by a linear path, conditioned on having the same initialization for both. We thoroughly analyze this observation and discuss its significance for the continual learning process. Furthermore, we exploit this finding to propose an effective algorithm that constrains the sequentially learned minima to behave as the multitask solution. We show that our method outperforms several state of the art continual learning algorithms on various vision benchmarks.


Learning to Ask Unanswerable Questions for Machine Reading Comprehension. Machine reading comprehension with unanswerable questions is a challenging task. In this work, we propose a data augmentation technique by automatically generating relevant unanswerable questions according to an answerable question paired with its corresponding paragraph that contains the answer. We introduce a pair to sequence model for unanswerable question generation, which effectively captures the interactions between the question and the paragraph. We also present a way to construct training data for our question generation models by leveraging the existing reading comprehension dataset. Experimental results show that the pair to sequence model performs consistently better compared with the sequence to sequence baseline. We further use the automatically generated unanswerable questions as a means of data augmentation on the SQuAD 2.0 dataset, yielding 1.9 absolute F1 improvement with BERT base model and 1.7 absolute F1 improvement with BERT large model.


A theory of inner Riesz balayage and its applications. We establish the theory of balayage for the Riesz kernel x y alpha n , alpha in(0,2 , on mathbb R n , n geqslant3 , alternative to that suggested in the book by Landkof. A need for that is caused by the fact that the balayage in that book is defined by means of the integral representation, which, however, so far is not completely justified. Our alternative approach is mainly based on Cartan's ideas concerning inner balayage, formulated by him for the Newtonian kernel. Applying the theory of inner Riesz balayage thereby developed, we obtain a number of criteria for the existence of an inner equilibrium measure gamma A for A subset mathbb R n arbitrary, in particular given in terms of the total mass of the inner swept measure mu A with mu suitably chosen. For example, gamma A exists if and only if varepsilon A ne varepsilon , where varepsilon is a Dirac measure at x 0 and A the inverse of A relative to the sphere x 1 , which leads to a Wiener type criterion of inner alpha irregularity. The results obtained are illustrated by examples.


Cold start Active Learning through Self supervised Language Modeling. Active learning strives to reduce annotation costs by choosing the most critical examples to label. Typically, the active learning strategy is contingent on the classification model. For instance, uncertainty sampling depends on poorly calibrated model confidence scores. In the cold start setting, active learning is impractical because of model instability and data scarcity. Fortunately, modern NLP provides an additional source of information pre trained language models. The pre training loss can find examples that surprise the model and should be labeled for efficient fine tuning. Therefore, we treat the language modeling loss as a proxy for classification uncertainty. With BERT, we develop a simple strategy based on the masked language modeling loss that minimizes labeling costs for text classification. Compared to other baselines, our approach reaches higher accuracy within less sampling iterations and computation time.


Optimizing vaccine distribution networks in low and middle income countries. Vaccination has been proven to be the most effective method to prevent infectious diseases. However, there are still millions of children in low and middle income countries who are not covered by routine vaccines and remain at risk. The World Health Organization Expanded Programme on Immunization (WHO EPI) was designed to provide universal childhood vaccine access for children across the world and in this work, we address the design of the distribution network for WHO EPI vaccines. In particular, we formulate the network design problem as a mixed integer program (MIP) and present a new algorithm for typical problems that are too large to be solved using commercial MIP software. We test the algorithm using data derived from four different countries in sub Saharan Africa and show that the algorithm is able to obtain high quality solutions for even the largest problems within a few minutes.


Volterra Choquet nonlinear operators. In this paper we study to what extend some properties of the classical linear Volterra operators could be transferred to the nonlinear Volterra Choquet operators, obtained by replacing the classical linear integral with respect to the Lebesgue measure, by the nonlinear Choquet integral with respect to a nonadditive set function. Compactness, Lipschitz and cyclicity properties are studied.


On Line Sum Optimization. We show that the em column sum optimization problem , of finding a (0,1) matrix with prescribed row sums which minimizes the sum of evaluations of given functions at its column sums, can be solved in polynomial time, either when all functions are the same or when all row sums are bounded by any constant. We conjecture that the more general em line sum optimization problem , of finding a matrix minimizing the sum of given functions evaluated at its row sums and column sums, can also be solved in polynomial time.


Prenex normal form theorems in semi classical arithmetic. Akama et al. systematically studied an arithmetical hierarchy of the law of excluded middle and related principles in the context of first order arithmetic. In that paper, they first provide a prenex normal form theorem as a justification of their semi classical principles restricted to prenex formulas. However, there are some errors in their proof. In this paper, we provide a simple counterexample of their prenex normal form theorem, then modify it in an appropriate way. In addition, we characterize several prenex normal form theorems with respect to semi classical arithmetic.


Optimal Linear Coding Schemes for the Secure Decentralized Pliable Index Coding Problem. We study the secure decentralized Pliable Index CODing (PICOD) problem with circular side information sets at the users. The security constraint forbids every user to decode more than one message while a decentralized setting means there is no central transmitter in the system. Compared to the secure but centralized version of the problem, a converse bound from one of our previous works showed a factor of three difference in optimal code length under the constraint of linear encoding. In this paper, we first list the linearly infeasible cases, that is, problems where no linear code can simultaneously achieve both correctness decodability and security. Then, we propose linear coding schemes for all remaining cases and show that their attained code length is to within an additive constant gap from our converse bound.


Mitigating Gender Bias for Neural Dialogue Generation with Adversarial Learning. Dialogue systems play an increasingly important role in various aspects of our daily life. It is evident from recent research that dialogue systems trained on human conversation data are biased. In particular, they can produce responses that reflect people's gender prejudice. Many debiasing methods have been developed for various NLP tasks, such as word embedding. However, they are not directly applicable to dialogue systems because they are likely to force dialogue models to generate similar responses for different genders. This greatly degrades the diversity of the generated responses and immensely hurts the performance of the dialogue models. In this paper, we propose a novel adversarial learning framework Debiased Chat to train dialogue models free from gender bias while keeping their performance. Extensive experiments on two real world conversation datasets show that our framework significantly reduces gender bias in dialogue models while maintaining the response quality. The implementation of the proposed framework is released.


Deep Learning Convective Flow Using Conditional Generative Adversarial Networks. We developed a general deep learning framework, FluidGAN, that is capable of learning and predicting time dependent convective flow coupled with energy transport. FluidGAN is thoroughly data driven with high speed and accuracy and satisfies the physics of fluid without any prior knowledge of underlying fluid and energy transport physics. FluidGAN also learns the coupling between velocity, pressure and temperature fields. Our framework could be used to learn deterministic multiphysics phenomena where the underlying physical model is complex or unknown.


An electrostatic interpretation of the zeros of sieved ultraspherical polynomials. In a companion paper On semiclassical orthogonal polynomials via polynomial mappings, J. Math. Anal. Appl. (2017) we proved that the semiclassical class of orthogonal polynomials is stable under polynomial transformations. In this work we use this fact to derive in an unified way old and new properties concerning the sieved ultraspherical polynomials of the first and second kind. In particular we derive ordinary differential equations for these polynomials. As an application, we use the differential equation for sieved ultraspherical polynomials of the first kind to deduce that the zeros of these polynomials mark the locations of a set of particles that are in electrostatic equilibrium with respect to a particular external field.


Anomaly Detection in Video Sequence with Appearance Motion Correspondence. Anomaly detection in surveillance videos is currently a challenge because of the diversity of possible events. We propose a deep convolutional neural network (CNN) that addresses this problem by learning a correspondence between common object appearances (e.g. pedestrian, background, tree, etc.) and their associated motions. Our model is designed as a combination of a reconstruction network and an image translation model that share the same encoder. The former sub network determines the most significant structures that appear in video frames and the latter one attempts to associate motion templates to such structures. The training stage is performed using only videos of normal events and the model is then capable to estimate frame level scores for an unknown input. The experiments on 6 benchmark datasets demonstrate the competitive performance of the proposed approach with respect to state of the art methods.


Buerling Ahlfors Commutators on Weighted Morrey Spaces and Applications to Beltrami Equations. Let p in(1, infty) , kappa in(0, 1) and w in A p( mathbb C). In this article, the authors obtain a boundedness (resp., compactness) characterization of the Buerling Ahlfors commutator mathcal B, b on the weighted Morrey space L w p, , kappa ( mathbb C) via mathrm BMO ( mathbb C) resp., mathrm CMO ( mathbb C) , where mathcal B denotes the Buerling Ahlfors transform and b in mathrm BMO ( mathbb C) resp., mathrm CMO ( mathbb C) . Moreover, an application to the Beltrami equation is also given.


KRW Composition Theorems via Lifting. One of the major open problems in complexity theory is proving super logarithmic lower bounds on the depth of circuits (i.e., mathbf P not subseteq mathbf NC 1 ). Karchmer, Raz, and Wigderson (Computational Complexity 5(3 4), 1995) suggested to approach this problem by proving that depth complexity behaves "as expected" with respect to the composition of functions f diamond g . They showed that the validity of this conjecture would imply that mathbf P not subseteq mathbf NC 1 . Several works have made progress toward resolving this conjecture by proving special cases. In particular, these works proved the KRW conjecture for every outer function f , but only for few inner functions g . Thus, it is an important challenge to prove the KRW conjecture for a wider range of inner functions. In this work, we extend significantly the range of inner functions that can be handled. First, we consider the textit monotone version of the KRW conjecture. We prove it for every monotone inner function g whose depth complexity can be lower bounded via a query to communication lifting theorem. This allows us to handle several new and well studied functions such as the s textbf t connectivity, clique, and generation functions. In order to carry this progress back to the textit non monotone setting, we introduce a new notion of textit semi monotone composition, which combines the non monotone complexity of the outer function f with the monotone complexity of the inner function g . In this setting, we prove the KRW conjecture for a similar selection of inner functions g , but only for a specific choice of the outer function f .


Hyperharmonic analysis for the study of high order information theoretic signals. Network representations often cannot fully account for the structural richness of complex systems spanning multiple levels of organisation. Recently proposed high order information theoretic signals are well suited to capture synergistic phenomena that transcend pairwise interactions however, the exponential growth of their cardinality severely hinders their applicability. In this work, we combine methods from harmonic analysis and combinatorial topology to construct efficient representations of high order information theoretic signals. The core of our method is the diagonalisation of a discrete version of the Laplace de Rham operator, that geometrically encodes structural properties of the system. We capitalise on these ideas by developing a complete workflow for the construction of hyperharmonic representations of high order signals, which is applicable to a wide range of scenarios.


Towards Co execution on Commodity Heterogeneous Systems Optimizations for Time Constrained Scenarios. Heterogeneous systems are present from powerful supercomputers, to mobile devices, including desktop computers, thanks to their excellent performance and energy consumption. The ubiquity of these architectures in both desktop systems and medium sized service servers allow enough variability to exploit a wide range of problems, such as multimedia workloads, video encoding, image filtering and inference in machine learning. Due to the heterogeneity, some efforts have been done to reduce the programming effort and preserve performance portability, but these systems include a set of challenges. The context in which applications offload the workload along with the management overheads introduced when doing co execution, penalize the performance gains under time constrained scenarios. Therefore, this paper proposes optimizations for the EngineCL runtime to reduce the penalization when co executing in commodity systems, as well as algorithmic improvements when load balancing. An exhaustive experimental evaluation is performed, showing optimization improvements of 7.5 and 17.4 for binary and ROI based offloading modes, respectively. Thanks to all the optimizations, the new load balancing algorithm is always the most efficient scheduling configuration, achieving an average efficiency of 0.84 under a pessimistic scenario.


It's All Around You Range Guided Cylindrical Network for 3D Object Detection. Modern perception systems in the field of autonomous driving rely on 3D data analysis. LiDAR sensors are frequently used to acquire such data due to their increased resilience to different lighting conditions. Although rotating LiDAR scanners produce ring shaped patterns in space, most networks analyze their data using an orthogonal voxel sampling strategy. This work presents a novel approach for analyzing 3D data produced by 360 degree depth scanners, utilizing a more suitable coordinate system, which is aligned with the scanning pattern. Furthermore, we introduce a novel notion of range guided convolutions, adapting the receptive field by distance from the ego vehicle and the object's scale. Our network demonstrates powerful results on the nuScenes challenge, comparable to current state of the art architectures. The backbone architecture introduced in this work can be easily integrated onto other pipelines as well.


SHE A Fast and Accurate Deep Neural Network for Encrypted Data. Homomorphic Encryption (HE) is one of the most promising security solutions to emerging Machine Learning as a Service (MLaaS). Leveled HE (LHE) enabled Convolutional Neural Networks (LHECNNs) are proposed to implement MLaaS to avoid large bootstrapping overhead. However, prior LHECNNs have to pay significant computing overhead but achieve only low inference accuracy, due to their polynomial approximation activations and poolings. Stacking many polynomial approximation activation layers in a network greatly reduces inference accuracy, since the polynomial approximation activation errors lead to a low distortion of the output distribution of the next batch normalization layer. So the polynomial approximation activations and poolings have become the obstacle to a fast and accurate LHECNN model. In this paper, we propose a Shift accumulation based LHE enabled deep neural network (SHE) for fast and accurate inferences on encrypted data. We use the binary operation friendly Leveled Fast Homomorphic Encryption over Torus (LTFHE) encryption scheme to implement ReLU activations and max poolings. We also adopt the logarithmic quantization to accelerate inferences by replacing expensive LTFHE multiplications with cheap LTFHE shifts. We propose a mixed bitwidth accumulator to accelerate accumulations. Since the LTFHE ReLU activations, max poolings, shifts and accumulations have small multiplicative depth overhead, SHE can implement much deeper network architectures with more convolutional and activation layers. Our experimental results show SHE achieves the state of the art inference accuracy and reduces the inference latency by 76.21 94.23 over prior LHECNNs on MNIST and CIFAR 10. The source code of SHE is available at https github.com qianlou SHE.


Category Level Articulated Object Pose Estimation. This project addresses the task of category level pose estimation for articulated objects from a single depth image. We present a novel category level approach that correctly accommodates object instances previously unseen during training. We introduce Articulation aware Normalized Coordinate Space Hierarchy (ANCSH) a canonical representation for different articulated objects in a given category. As the key to achieve intra category generalization, the representation constructs a canonical object space as well as a set of canonical part spaces. The canonical object space normalizes the object orientation,scales and articulations (e.g. joint parameters and states) while each canonical part space further normalizes its part pose and scale. We develop a deep network based on PointNet that predicts ANCSH from a single depth point cloud, including part segmentation, normalized coordinates, and joint parameters in the canonical object space. By leveraging the canonicalized joints, we demonstrate 1) improved performance in part pose and scale estimations using the induced kinematic constraints from joints 2) high accuracy for joint parameter estimation in camera space.


Generalised Voltage Graphs. A graph with a semiregular group of automorphisms can be thought of as the derived cover arising from a voltage graph. Since its inception, the theory of voltage graphs and their derived covers has been a powerful tool used in the study of graphs with a significant degree of symmetry. We generalise this theory to graphs with a group of automorphisms that is not necessarily semiregular, and we generalise several well known results of the classical theory of voltage graphs to this broader setting.


Operator splitting for abstract Cauchy problems with dynamical boundary condition. In this work we study operator splitting methods for a certain class of coupled abstract Cauchy problems, where the coupling is such that one of the problems prescribes a "boundary type" extra condition for the other one. The theory of one sided coupled operator matrices provides an excellent framework to study the well posedness of such problems. We show that with this machinery even operator splitting methods can be treated conveniently and rather efficiently. We consider three specific examples the Lie (sequential), the Strang and the weighted splitting, and prove the convergence of these methods along with error bounds under fairly general assumptions.


Learning Transferrable Parameters for Long tailed Sequential User Behavior Modeling. Sequential user behavior modeling plays a crucial role in online user oriented services, such as product purchasing, news feed consumption, and online advertising. The performance of sequential modeling heavily depends on the scale and quality of historical behaviors. However, the number of user behaviors inherently follows a long tailed distribution, which has been seldom explored. In this work, we argue that focusing on tail users could bring more benefits and address the long tails issue by learning transferrable parameters from both optimization and feature perspectives. Specifically, we propose a gradient alignment optimizer and adopt an adversarial training scheme to facilitate knowledge transfer from the head to the tail. Such methods can also deal with the cold start problem of new users. Moreover, it could be directly adaptive to various well established sequential models. Extensive experiments on four real world datasets verify the superiority of our framework compared with the state of the art baselines.


Move Fast and Meet Deadlines Fine grained Real time Stream Processing with Cameo. Resource provisioning in multi tenant stream processing systems faces the dual challenges of keeping resource utilization high (without over provisioning), and ensuring performance isolation. In our common production use cases, where streaming workloads have to meet latency targets and avoid breaching service level agreements, existing solutions are incapable of handling the wide variability of user needs. Our framework called Cameo uses fine grained stream processing (inspired by actor computation models), and is able to provide high resource utilization while meeting latency targets. Cameo dynamically calculates and propagates priorities of events based on user latency targets and query semantics. Experiments on Microsoft Azure show that compared to state of the art, the Cameo framework i) reduces query latency by 2.7X in single tenant settings, ii) reduces query latency by 4.6X in multi tenant scenarios, and iii) weathers transient spikes of workload.


Cross modal Center Loss. Cross modal retrieval aims to learn discriminative and modal invariant features for data from different modalities. Unlike the existing methods which usually learn from the features extracted by offline networks, in this paper, we propose an approach to jointly train the components of cross modal retrieval framework with metadata, and enable the network to find optimal features. The proposed end to end framework is updated with three loss functions 1) a novel cross modal center loss to eliminate cross modal discrepancy, 2) cross entropy loss to maximize inter class variations, and 3) mean square error loss to reduce modality variations. In particular, our proposed cross modal center loss minimizes the distances of features from objects belonging to the same class across all modalities. Extensive experiments have been conducted on the retrieval tasks across multi modalities, including 2D image, 3D point cloud, and mesh data. The proposed framework significantly outperforms the state of the art methods on the ModelNet40 dataset.


Embeddings Based Clustering for Target Specific Stances The Case of a Polarized Turkey. On June 24, 2018, Turkey conducted a highly consequential election in which the Turkish people elected their president and parliament in the first election under a new presidential system. During the election period, the Turkish people extensively shared their political opinions on Twitter. One aspect of polarization among the electorate was support for or opposition to the reelection of Recep Tayyip Erdo u g an. In this paper, we present an unsupervised method for target specific stance detection in a polarized setting, specifically Turkish politics, achieving 90 precision in identifying user stances, while maintaining more than 80 recall. The method involves representing users in an embedding space using Google's Convolutional Neural Network (CNN) based multilingual universal sentence encoder. The representations are then projected onto a lower dimensional space in a manner that reflects similarities and are consequently clustered. We show the effectiveness of our method in properly clustering users of divergent groups across multiple targets that include political figures, different groups, and parties. We perform our analysis on a large dataset of 108M Turkish election related tweets along with the timeline tweets of 168k Turkish users, who authored 213M tweets. Given the resultant user stances, we are able to observe correlations between topics and compute topic polarization.


Heterogeneous Parallelization and Acceleration of Molecular Dynamics Simulations in GROMACS. The introduction of accelerator devices such as graphics processing units (GPUs) has had profound impact on molecular dynamics simulations and has enabled order of magnitude performance advances using commodity hardware. To fully reap these benefits, it has been necessary to reformulate some of the most fundamental algorithms, including the Verlet list, pair searching and cut offs. Here, we present the heterogeneous parallelization and acceleration design of molecular dynamics implemented in the GROMACS codebase over the last decade. The setup involves a general cluster based approach to pair lists and non bonded pair interactions that utilizes both GPUs and CPU SIMD acceleration efficiently, including the ability to load balance tasks between CPUs and GPUs. The algorithm work efficiency is tuned for each type of hardware, and to use accelerators more efficiently we introduce dual pair lists with rolling pruning updates. Combined with new direct GPU GPU communication as well as GPU integration, this enables excellent performance from single GPU simulations through strong scaling across multiple GPUs and efficient multi node parallelization.


Effect of the Thickness on the Fracturing Behavior of Discontinuous Fiber Composite Structures. In this study, we investigate experimentally and numerically the mode I intra laminar fracture and size effect of Discontinuous Fiber Composites (DFCs) as a function of the structure thicknesses. By testing geometrically scaled Single Edge Notch Tension (SENT) specimens a notable structure size effect on the nominal strength of DFCs is identified. As the specimen size increases, the nominal strength decreases. For small specimens, we find a limited size effect with enhanced pseudo ductility and a strong divergence from Linear Elastic Fracture Mechanics (LEFM). For sufficiently large specimen sizes, the scaling of the nominal strength follows closely LEFM with a strong brittle failure. As the thickness increases, the size effect decreases. We identify the fracture energy and the effective size of the fracture process zone as a function of the thickness of the structure. To do so, we integrate equivalent fracture mechanics and stochastic finite element modeling. Experimentally, we collect the nominal strength of geometrically scaled Single Edge Notch Tension (SENT) specimens. The numerical stochastic model captures the complex, inhomogeneous mesostructure of DFCs by explicitly generating the platelets. From the integrated analysis, it is found that the fracture energy depends significantly on the structure thickness. It is shown to increase gradually up to 2 mm and saturates after 3 mm to a value of 57.77 N mm, which is 4.81 times larger than a typical aluminum alloy.


Unsupervised Domain Attention Adaptation Network for Caricature Attribute Recognition. Caricature attributes provide distinctive facial features to help research in Psychology and Neuroscience. However, unlike the facial photo attribute datasets that have a quantity of annotated images, the annotations of caricature attributes are rare. To facility the research in attribute learning of caricatures, we propose a caricature attribute dataset, namely WebCariA. Moreover, to utilize models that trained by face attributes, we propose a novel unsupervised domain adaptation framework for cross modality (i.e., photos to caricatures) attribute recognition, with an integrated inter and intra domain consistency learning scheme. Specifically, the inter domain consistency learning scheme consisting an image to image translator to first fill the domain gap between photos and caricatures by generating intermediate image samples, and a label consistency learning module to align their semantic information. The intra domain consistency learning scheme integrates the common feature consistency learning module with a novel attribute aware attention consistency learning module for a more efficient alignment. We did an extensive ablation study to show the effectiveness of the proposed method. And the proposed method also outperforms the state of the art methods by a margin. The implementation of the proposed method is available at https github.com KeleiHe DAAN.


Complexity yardsticks for f vectors of polytopes and spheres. We consider geometric and computational measures of complexity for sets of integer vectors, asking for a qualitative difference between f vectors of simplicial and general d polytopes, as well as flag f vectors of d polytopes and regular CW (d 1) spheres, for d ge 4 .


Analysis of Indexing Structures for Immutable Data. In emerging applications such as blockchains and collaborative data analytics, there are strong demands for data immutability, multi version accesses, and tamper evident controls. This leads to three new index structures for immutable data, namely Merkle Patricia Trie (MPT), Merkle Bucket Tree (MBT), and Pattern Oriented Split Tree (POS Tree). Although these structures have been adopted in real applications, there is no systematic evaluation of their pros and cons in the literature. This makes it difficult for practitioners to choose the right index structure for their applications, as there is only a limited understanding of the characteristics of each index. To alleviate the above deficiency, we present a comprehensive analysis of the existing index structures for immutable data, evaluating both their asymptotic and empirical performance. Specifically, we show that MPT, MBT, and POS Tree are all instances of a recently proposed framework, dubbed my Structurally Invariant and Reusable Indexes (SIRI) . We propose to evaluate the SIRI instances based on five essential metrics their efficiency for four index operations (i.e., lookup, update, comparison, and merge), as well as their my deduplication ratios (i.e., the size of the index with deduplication over the size without deduplication). We establish the worst case guarantees of each index in terms of these five metrics, and we experimentally evaluate all indexes in a large variety of settings. Based on our theoretical and empirical analysis, we conclude that POS Tree is a favorable choice for indexing immutable data.


The Modular Temperley Lieb Algebra. We investigate the representation theory of the Temperley Lieb algebra, TL n( delta) , defined over a field of positive characteristic. The principle question we seek to answer is the multiplicity of simple modules in cell modules for TL n over arbitrary rings. This provides us with the decomposition numbers for this algebra, as well as the dimensions of all simple modules. We obtain these results from diagrammatic principles, without appealing to realisations of TL n as endomorphism algebras of U q( mathfrak sl 2) modules. Our results strictly generalise the known characteristic zero theory of the Temperley Lieb algebras.


LSTM Easy first Dependency Parsing with Pre trained Word Embeddings and Character level Word Embeddings in Vietnamese. In Vietnamese dependency parsing, several methods have been proposed. Dependency parser which uses deep neural network model has been reported that achieved state of the art results. In this paper, we proposed a new method which applies LSTM easy first dependency parsing with pre trained word embeddings and character level word embeddings. Our method achieves an accuracy of 80.91 of unlabeled attachment score and 72.98 of labeled attachment score on the Vietnamese Dependency Treebank (VnDT).


Revising FUNSD dataset for key value detection in document images. FUNSD is one of the limited publicly available datasets for information extraction from document im ages. The information in the FUNSD dataset is defined by text areas of four categories ("key", "value", "header", "other", and "background") and connectivity between areas as key value relations. In specting FUNSD, we found several inconsistency in labeling, which impeded its applicability to thekey value extraction problem. In this report, we described some labeling issues in FUNSD and therevision we made to the dataset. We also reported our implementation of for key value detection onFUNSD using a UNet model as baseline results and an improved UNet model with Channel InvariantDeformable Convolution.


Incident rational curves. We study families of rational curves on an algebraic variety satisfying incidence conditions. We prove an analogue of bend and break that is, we show that under suitable conditions, such a family must contain reducibles. In the case of curves in P n incident to certain complete intersections, we prove the family is irreducible.


The logic induced by effect algebras. Effect algebras form an algebraic formalization of the logic of quantum mechanics. For lattice effect algebras E we investigate a natural implication and prove that the implication reduct of E is term equivalent to E. Then we present a simple axiom system in Gentzen style in order to axiomatize the logic induced by lattice effect algebras. For effect algebras which need not be lattice ordered we introduce a certain kind of implication which is everywhere defined but whose result need not be a single element. Then we study effect implication algebras and prove the correspondence between these algebras and effect algebras satisfying the Ascending Chain Condition. We present an axiom system in Gentzen style also for not necessarily lattice ordered effect algebras and prove that it is an algebraic semantics for the logic induced by finite effect algebras.


HeAT a Distributed and GPU accelerated Tensor Framework for Data Analytics. To cope with the rapid growth in available data, the efficiency of data analysis and machine learning libraries has recently received increased attention. Although great advancements have been made in traditional array based computations, most are limited by the resources available on a single computation node. Consequently, novel approaches must be made to exploit distributed resources, e.g. distributed memory architectures. To this end, we introduce HeAT, an array based numerical programming framework for large scale parallel processing with an easy to use NumPy like API. HeAT utilizes PyTorch as a node local eager execution engine and distributes the workload on arbitrarily large high performance computing systems via MPI. It provides both low level array computations, as well as assorted higher level algorithms. With HeAT, it is possible for a NumPy user to take full advantage of their available resources, significantly lowering the barrier to distributed data analysis. When compared to similar frameworks, HeAT achieves speedups of up to two orders of magnitude.


ACUTE EVAL Improved Dialogue Evaluation with Optimized Questions and Multi turn Comparisons. While dialogue remains an important end goal of natural language research, the difficulty of evaluation is an oft quoted reason why it remains troublesome to make real progress towards its solution. Evaluation difficulties are actually two fold not only do automatic metrics not correlate well with human judgments, but also human judgments themselves are in fact difficult to measure. The two most used human judgment tests, single turn pairwise evaluation and multi turn Likert scores, both have serious flaws as we discuss in this work. We instead provide a novel procedure involving comparing two full dialogues, where a human judge is asked to pay attention to only one speaker within each, and make a pairwise judgment. The questions themselves are optimized to maximize the robustness of judgments across different annotators, resulting in better tests. We also show how these tests work in self play model chat setups, resulting in faster, cheaper tests. We hope these tests become the de facto standard, and will release open source code to that end.


A Universality Theorem for Nested Polytopes. In a nutshell, we show that polynomials and nested polytopes are topological, algebraic and algorithmically equivalent. Given two polytops A subseteq B and a number k , the Nested Polytope Problem (NPP) asks, if there exists a polytope X on k vertices such that A subseteq X subseteq B . The polytope A is given by a set of vertices and the polytope B is given by the defining hyperplanes. We show a universality theorem for NPP. Given an instance I of the NPP, we define the solutions set of I as V'(I) (x 1, ldots,x k) in mathbb R k cdot n A subseteq text conv (x 1, ldots,x k) subseteq B . As there are many symmetries, induced by permutations of the vertices, we will consider the emph normalized solution space V(I) . Let F be a finite set of polynomials, with bounded solution space. Then there is an instance I of the NPP, which has a rationally equivalent normalized solution space V(I) . Two sets V and W are rationally equivalent if there exists a homeomorphism f V rightarrow W such that both f and f 1 are given by rational functions. A function f V rightarrow W is a homeomorphism, if it is continuous, invertible and its inverse is continuous as well. As a corollary, we show that NPP is exists mathbb R complete. This implies that unless exists mathbb R NP, the NPP is not contained in the complexity class NP. Note that those results already follow from a recent paper by Shitov. Our proof is geometric and arguably easier.


Convergence to equilibrium for hypoelliptic non symmetric Ornstein Uhlenbeck type operators. We study a generalized curvature dimension inequality which is suitable for subelliptic Ornstein Uhlenbeck type operators and deduce convergence to equilibrium in the L 2 and entropic sense. The main difficulty is that the operators we consider may not be symmetric. Our results apply in particular to Ornstein Uhlenbeck operators on two step Carnot groups.


Counterexamples to conjectures by Gross, Mansour and Tucker on partial dual genus polynomials of ribbon graphs. Gross, Mansour and Tucker introduced the partial dual orientable genus polynomial and the partial dual Euler genus polynomial. They computed these two partial dual genus polynomials of four families of ribbon graphs, posed some research problems and made some conjectures. In this paper, we introduce the notion of signed sequences of bouquets and obtain the partial dual Euler genus polynomials for all ribbon graphs with the number of edges less than 4 and the partial dual orientable genus polynomials for all orientable ribbon graphs with the number of edges less than 5 in terms of signed sequences. We check all the conjectures and find a counterexample to the Conjecture 3.1 in their paper There is no orientable ribbon graph having a non constant partial dual genus polynomial with only one non zero coefficient. Motivated by this counterexample, we further find an infinite family of counterexamples to the conjecture. Moreover, we find a counterexample to the Conjecture 5.3 in their paper The partial dual Euler genus polynomial for any non orientable ribbon graph is interpolating.


On the fixed volume discrepancy of the Fibonacci sets in the integral norms. This paper is devoted to the study of a discrepancy type characteristic the fixed volume discrepancy of the Fibonacci point set in the unit square. It was observed recently that this new characteristic allows us to obtain optimal rate of dispersion from numerical integration results. This observation motivates us to thoroughly study this new version of discrepancy, which seems to be interesting by itself. The new ingredient of this paper is the use of the average over the shifts of hat functions instead of taking the supremum over the shifts. We show that this change in the setting results in an improvement of the upper bound for the smooth fixed volume discrepancy, similarly to the well known results for the usual L p discrepancy. Interestingly, this shows that bad boxes'' for the usual discrepancy cannot be too small''. The known results on smooth discrepancy show that the obtained bounds cannot be improved in a certain sense.


Proper 3 orientations of bipartite planar graphs with minimum degree at least 3. We show that every bipartite planar graph with minimum degree at least 3 has proper orientation number at most 3.


Datalog Reasoning over Compressed RDF Knowledge Bases. Materialisation is often used in RDF systems as a preprocessing step to derive all facts implied by given RDF triples and rules. Although widely used, materialisation considers all possible rule applications and can use a lot of memory for storing the derived facts, which can hinder performance. We present a novel materialisation technique that compresses the RDF triples so that the rules can sometimes be applied to multiple facts at once, and the derived facts can be represented using structure sharing. Our technique can thus require less space, as well as skip certain rule applications. Our experiments show that our technique can be very effective when the rules are relatively simple, our system is both faster and requires less memory than prominent state of the art RDF systems.


Emotion in Future Intelligent Machines. Over the past decades, research in cognitive and affective neuroscience has emphasized that emotion is crucial for human intelligence and in fact inseparable from cognition. Concurrently, there has been a significantly growing interest in simulating and modeling emotion in robots and artificial agents. Yet, existing models of emotion and their integration in cognitive architectures remain quite limited and frequently disconnected from neuroscientific evidence. We argue that a stronger integration of emotion in robot models is critical for the design of intelligent machines capable of tackling real world problems. Drawing from current neuroscientific knowledge, we provide a set of guidelines for future research in artificial emotion and intelligent machines more generally.