Parsl Pervasive Parallel Programming in Python. High level programming languages such as Python are increasingly used to provide intuitive interfaces to libraries written in lower level languages and for assembling applications from various components. This migration towards orchestration rather than implementation, coupled with the growing need for parallel computing (e.g., due to big data and the end of Moore's law), necessitates rethinking how parallelism is expressed in programs. Here, we present Parsl, a parallel scripting library that augments Python with simple, scalable, and flexible constructs for encoding parallelism. These constructs allow Parsl to construct a dynamic dependency graph of components that it can then execute efficiently on one or many processors. Parsl is designed for scalability, with an extensible set of executors tailored to different use cases, such as low latency, high throughput, or extreme scale execution. We show, via experiments on the Blue Waters supercomputer, that Parsl executors can allow Python scripts to execute components with as little as 5 ms of overhead, scale to more than 250 000 workers across more than 8000 nodes, and process upward of 1200 tasks per second. Other Parsl features simplify the construction and execution of composite programs by supporting elastic provisioning and scaling of infrastructure, fault tolerant execution, and integrated wide area data management. We show that these capabilities satisfy the needs of many task, interactive, online, and machine learning applications in fields such as biology, cosmology, and materials science.


Uniform spanning forest on the integer lattice with drift in one coordinate. In this article we investigate the Uniform Spanning Forest ( mathsf USF ) in the nearest neighbour integer lattice mathbf Z d 1 mathbf Z times mathbf Z d with an assignment of conductances that makes the underlying (Network) Random Walk ( mathsf NRW ) drifted towards the right of the first coordinate. This assignment of conductances has exponential growth and decay in particular, the measure of balls can be made arbitrarily close to zero or arbitrarily large. We establish upper and lower bounds for its Green's function. We show that in dimension d 1, 2 the mathsf USF consists of a single tree while in d geq 3, there are infinitely many trees. We then show, by an intricate study of multiple mathsf NRW s, that in every dimension the trees are one ended the technique for d 2 is completely new, while the technique for d geq 3 is a major makeover of the technique for the proof of the same result for the graph mathbf Z d. We finally establish the probability that two or more vertices are mathsf USF connected and study the distance between different trees.


Accurate transferable polarization model derived from the monomer electron density. Force field have for decades proven to be an indispensable tool for molecular simulations which are out of reach for ab initio methods. Recent efforts to improve the accuracy of these simulations have focused on the inclusion of many body interactions in force fields. In this regard, we propose a transferable inducible dipole model which requires only the monomer electron density as input, without the need for atom type specific parameters. Slater dipoles are introduced, the widths of which are derived from the ab initio monomer density. An additional exchange repulsion interaction is introduced in our model, originating from the overlap of the delocalized dipoles with other dipoles and the ground state electron density. This interaction has previously been neglected in point dipole models, as the lack of spatial extent of the dipoles prevents the inclusion of an overlap term. The inclusion of this interaction is shown to significantly improve the prediction of three body energies. Our model is incorporated in a previously proposed non covalent force field and is benchmarked on interaction energies of dimers contained in the hsg and hbc6 datasets. Furthermore, we demonstrate the transferability of our model to the condensed phase of water, and to the interaction of CO 2 and H 2 O molecules with the ZIF 8 metal organic framework. The inherent transferability of our model makes it widely applicable to systems like the aforementioned metal organic frameworks, where no specifically fitted parameters for polarization models are available in the literature.


Measurement in AI Policy Opportunities and Challenges. As artificial intelligence increasingly influences our world, it becomes crucial to assess its technical progress and societal impact. This paper surveys problems and opportunities in the measurement of AI systems and their impact, based on a workshop held at Stanford University in the fall of 2019. We identify six summary challenges inherent to measuring the progress and impact of AI, and summarize over 40 presentations and associated discussions from the workshop. We hope this can inspire research agendas in this crucial area.


Warped Language Models for Noise Robust Language Understanding. Masked Language Models (MLM) are self supervised neural networks trained to fill in the blanks in a given sentence with masked tokens. Despite the tremendous success of MLMs for various text based tasks, they are not robust for spoken language understanding, especially for spontaneous conversational speech recognition noise. In this work we introduce Warped Language Models (WLM) in which input sentences at training time go through the same modifications as in MLM, plus two additional modifications, namely inserting and dropping random tokens. These two modifications extend and contract the sentence in addition to the modifications in MLMs, hence the word "warped" in the name. The insertion and drop modification of the input text during training of WLM resemble the types of noise due to Automatic Speech Recognition (ASR) errors, and as a result WLMs are likely to be more robust to ASR noise. Through computational results we show that natural language understanding systems built on top of WLMs perform better compared to those built based on MLMs, especially in the presence of ASR errors.


Comparing manual contact tracing and digital contact advice. Manual contact tracing is a top down solution that starts with contact tracers at the public health level, who identify the contacts of infected individuals, interview them to get additional context about the exposure, and also monitor their symptoms and support them until the incubation period is passed. On the other hand, digital contact tracing is a bottom up solution that starts with citizens who on obtaining a notification about possible exposure to an infected individual may choose to ignore the notification, get tested to determine if they were actually exposed or self isolate and monitor their symptoms over the next two weeks. Most experts recommend a combination of manual contact tracing and digital contact advice but they are not based on a scientific basis. For example, a possible hybrid solution could involve a smartphone based alert that requests the possible contact of an infected individual to call the Public Health (PH) number for next steps, or in some cases, suggest ways to self assess in order to reduce the burden on PH so only most critical cases require a phone conversation. In this paper, we aim to compare the manual and digital approaches to contact tracing and provide suggestions for potential hybrid solutions.


A Mean Field Games approach to Cluster Analysis. In this paper, we develop a Mean Field Games approach to Cluster Analysis. We consider a finite mixture model, given by a convex combination of probability density functions, to describe the given data set. We interpret a data point as an agent of one of the populations represented by the components of the mixture model, and we introduce a corresponding optimal control problem. In this way, we obtain a multi population Mean Field Games system which characterizes the parameters of the finite mixture model. Our method can be interpreted as a continuous version of the classical Expectation Maximization algorithm.


Vision based Target Interception using Aerial Manipulation. Selective interception of objects in unknown environment autonomously by UAVs is an interesting problem. In this work, vision based interception is carried out. This problem is a part of challenge 1 of Mohammed Bin Zayed International Robotic Challenge, 2020, where, balloons are kept at five random locations for the UAVs to autonomously explore, detect, approach and intercept. The problem requires a different formulation to execute compared to the normal interception problems in literature. This work details the different aspect of this problem from vision to manipulator design. The frame work is implemented on hardware using Robot Operating System (ROS) communication architecture.


Seven derivations of the Lambert Beer law. Seven derivations of the Lambert Beer law are proposed in this paper. They were designed to be simple and intuitive. Most of them are suitable for the classroom. Readers can also benefit from them by looking at the phenomenon from different perspectives, which gives valuable resources when explaining it in class.


Reflection groups and quiver mutation Diagrammatics. We extend Carter's notion of admissible diagrams and attach a "Dynkin like" diagram to each reduced reflection factorization of an element in a finite Weyl group. We give a complete classification for the diagrams attached to reduced reflection factorizations. Remarkably, such a diagram turns out to be cyclically orientable if and only if it is isomorphic to the underlying graph of a quiver which is mutation equivalent to a Dynkin quiver. Furthermore we show that each diagram encodes a natural presentation of the Weyl group as reflection group. The latter one extends work of Cameron, Seidel and Tsaranov as well as Barot and Marsh.


On the descriptive complexity of Salem sets. In this paper we study the notion of Salem set from the point of view of descriptive set theory. We first work in the hyperspace mathbf K ( 0,1 ) of compact subsets of 0,1 and show that the closed Salem sets form a boldsymbol Pi 0 3 complete family. This is done by characterizing the complexity of the family of sets having sufficiently large Hausdorff or Fourier dimension. We also show that the complexity does not change if we increase the dimension of the ambient space and work in mathbf K ( 0,1 d) . We then generalize the results by relaxing the compactness of the ambient space, and show that the closed Salem sets are still boldsymbol Pi 0 3 complete when we endow the hyperspace of all closed subsets of mathbb R d with the Fell topology. A similar result holds also for the Vietoris topology.


Shifted Euler constants and a generalization of Euler Stieltjes constants. The purpose of this article is twofold. First, we introduce the constants zeta k( alpha,r,q) where alpha in (0,1) and study them along the lines of work done on Euler constant in arithmetic progression gamma(r,q) by Briggs, Dilcher, Knopfmacher, Lehmer and some other authors. These constants are used for evaluation of certain integrals involving error term for Dirichlet divisor problem with congruence conditions and also to provide a closed form expression for the value of a class of Dirichlet L series at any real critical point. In the second half of this paper, we consider the behaviour of the Laurent Stieltjes constants gamma k( chi) for a principal character chi. In particular, we study a generalization of the "Generalized Euler constants" introduced by Diamond and Ford in 2008. We conclude with a short proof for a closed form expression for the first generalized Stieltjes constant gamma 1(r q) which was given by Blagouchine in 2015.


On the Spectrality and Spectral Expansion of the Non self adjoint Mathieu Hill Operator in All Real Line. In this paper we investigate the non self adjoint operator H generated in all real line by the Mathieu Hill equation with a complex valued potential. We find a necessary and sufficient conditions on the potential for which H has no spectral singularity at infinity and it is an asymptotically spectral operator. Moreover, we give a detailed classification, stated in term of the potential, for the form of the spectral decomposition of the operator H by investigating the essential spectral singularities.


Using Electronegativity and Hardness to Test Density Functional Universality. Density functional theory (DFT) is used in thousands of papers each year, yet lack of universality reduces DFT's predictive capacity, and functionals may produce energy density imbalances. The absolute electronegativity ( chi) and hardness ( eta) directly reflect the energy density relationship via the chemical potential dE dN and we thus hypothesized that they probe universality. We studied chi and eta for atoms Z 1 36 using 50 diverse functionals covering all major classes. Very few functionals describe both chi and eta well. eta benefits from error cancelation whereas chi is marred by error propagation from IP and EA thus almost all standard GGA and hybrid functionals display a plateau in the MAE at 0.2 0.3 eV for eta. In contrast, variable performance for chi indicates problems in describing the chemical potential by DFT. The accuracy and precision of a functional is far from linearly related, yet for a universal functional we expect linearity. Popular functionals such as B3LYP, PBE, and revPBE, perform poorly for both properties. Density sensitivity calculations indicate large density derived errors as occupation of degenerate p and d orbitals causes "non universality" and large dependency on exact exchange. Thus, we argue that performance for chi for the same systems is a hallmark of universality by probing dE dN. With this metric, B98, B97 1, PW6B95D3, APFD are the most "universal" tested functionals. B98 and B97 1 are accurate for very diverse metal ligand bonds, supporting that a balanced description of dE dN and dE2 dN2, via chi and eta, is probably a first simple probe of universality.


A Stackelberg Game of Backward Stochastic Differential Equations with Partial Information. This paper is concerned with a Stackelberg game of backward stochastic differential equations (BSDEs) with partial information, where the information of the follower is a sub sigma algebra of that of the leader. Necessary and sufficient conditions of the optimality for the follower and the leader are first given for the general problem, by the partial information stochastic maximum principles of BSDEs and forward backward stochastic differential equations (FBSDEs), respectively. Then a linear quadratic (LQ) Stackelberg game of BSDEs with partial information is investigated. The state estimate feedback representation for the optimal control of the follower is first given via two Riccati equations. Then the leader's problem is formulated as an optimal control problem of FBSDE. Four high dimensional Riccati equations are introduced to represent the state estimate feedback for the optimal control of the leader. Theoretic results are applied to a pension fund management problem of two players in the financial market.


Resilient Self Debugging Software Protection. Debuggers are a popular reverse engineering and tampering tool. Self debugging is an effective technique for applications to defend themselves against hostile debuggers. In penetration tests on state of the art self debugging, we observed several opportunities through which it could be attacked, however. We therefore improved upon the existing technique, making it more resilient by introducing reciprocal debugging and making the transfers of control between protected application and self debugger more stealthy. This paper presents the improved self debugging design, and details our research efforts into realizing reciprocal debugging. In our evaluation we show that the improved design is significantly harder for attackers to defeat.


Just Ask An Interactive Learning Framework for Vision and Language Navigation. In the vision and language navigation task, the agent may encounter ambiguous situations that are hard to interpret by just relying on visual information and natural language instructions. We propose an interactive learning framework to endow the agent with the ability to ask for users' help in such situations. As part of this framework, we investigate multiple learning approaches for the agent with different levels of complexity. The simplest model confusion based method lets the agent ask questions based on its confusion, relying on the predefined confidence threshold of a next action prediction model. To build on this confusion based method, the agent is expected to demonstrate more sophisticated reasoning such that it discovers the timing and locations to interact with a human. We achieve this goal using reinforcement learning (RL) with a proposed reward shaping term, which enables the agent to ask questions only when necessary. The success rate can be boosted by at least 15 with only one question asked on average during the navigation. Furthermore, we show that the RL agent is capable of adjusting dynamically to noisy human responses. Finally, we design a continual learning strategy, which can be viewed as a data augmentation method, for the agent to improve further utilizing its interaction history with a human. We demonstrate the proposed strategy is substantially more realistic and data efficient compared to previously proposed pre exploration techniques.


VisImages A Fine Grained Expert Annotated Visualization Dataset. Images in visualization publications contain rich information, e.g., novel visualization designs and implicit design patterns of visualizations. A systematic collection of these images can contribute to the community in many aspects, such as literature analysis and automated tasks for visualization. In this paper, we build and make public a dataset, VisImages, which collects 12,267 images with captions from 1,397 papers in IEEE InfoVis and VAST. Built upon a comprehensive visualization taxonomy, the dataset includes 35,096 visualizations and their bounding boxes in the images.We demonstrate the usefulness of VisImages through three use cases 1) investigating the use of visualizations in the publications with VisImages Explorer, 2) training and benchmarking models for visualization classification, and 3) localizing visualizations in the visual analytics systems automatically.


Empirical investigation of state of the art mean reversion strategies for equity markets. Recent studies have shown that online portfolio selection strategies that exploit the mean reversion property can achieve excess return from equity markets. This paper empirically investigates the performance of state of the art mean reversion strategies on real market data. The aims of the study are twofold. The first is to find out why the mean reversion strategies perform extremely well on well known benchmark datasets, and the second is to test whether or not the mean reversion strategies work well on recent market data. The mean reversion strategies used in this study are the passive aggressive mean reversion (PAMR) strategy, the on line moving average reversion (OLMAR) strategy, and the transaction cost optimization (TCO) strategies. To test the strategies, we use the historical prices of the stocks that constitute S P 500 index over the period from 2000 to 2017 as well as well known benchmark datasets. Our findings are that the well known benchmark datasets favor mean reversion strategies, and mean reversion strategies may fail even in favorable market conditions, especially when there exist explicit or implicit transaction costs.


Stochastic YOLO Efficient Probabilistic Object Detection under Dataset Shifts. In image classification tasks, the evaluation of models' robustness to increased dataset shifts with a probabilistic framework is very well studied. However, object detection (OD) tasks pose other challenges for uncertainty estimation and evaluation. For example, one needs to evaluate both the quality of the label uncertainty (i.e., what?) and spatial uncertainty (i.e., where?) for a given bounding box, but that evaluation cannot be performed with more traditional average precision metrics (e.g., mAP). In this paper, we adapt the well established YOLOv3 architecture to generate uncertainty estimations by introducing stochasticity in the form of Monte Carlo Dropout (MC Drop), and evaluate it across different levels of dataset shift. We call this novel architecture Stochastic YOLO, and provide an efficient implementation to effectively reduce the burden of the MC Drop sampling mechanism at inference time. Finally, we provide some sensitivity analyses, while arguing that Stochastic YOLO is a sound approach that improves different components of uncertainty estimations, in particular spatial uncertainties.


ThreatZoom CVE2CWE using Hierarchical Neural Network. The Common Vulnerabilities and Exposures (CVE) represent standard means for sharing publicly known information security vulnerabilities. One or more CVEs are grouped into the Common Weakness Enumeration (CWE) classes for the purpose of understanding the software or configuration flaws and potential impacts enabled by these vulnerabilities and identifying means to detect or prevent exploitation. As the CVE to CWE classification is mostly performed manually by domain experts, thousands of critical and new CVEs remain unclassified, yet they are unpatchable. This significantly limits the utility of CVEs and slows down proactive threat mitigation. This paper presents the first automatic tool to classify CVEs to CWEs. ThreatZoom uses a novel learning algorithm that employs an adaptive hierarchical neural network which adjusts its weights based on text analytic scores and classification errors. It automatically estimates the CWE classes corresponding to a CVE instance using both statistical and semantic features extracted from the description of a CVE. This tool is rigorously tested by various datasets provided by MITRE and the National Vulnerability Database (NVD). The accuracy of classifying CVE instances to their correct CWE classes are 92 (fine grain) and 94 (coarse grain) for NVD dataset, and 75 (fine grain) and 90 (coarse grain) for MITRE dataset, despite the small corpus.


Symboles modulaires et produit de Petersson. We revisit some papers by Eichler and Shimura in order to give an algebraic formulation (based on Farey symbols) for the intersection product on the space of modular symbols, as described by Pollack and Stevens. We define the period homomorphism of an Eisenstein series (Eisenstein Dedekind Stevens symbol) and extend the definition of the intersection product to these objects. We construct a computationally convenient basis for the space of Eisenstein series for Gamma 0 (N) with rational periods. Given a Farey symbol for a subgroup Gamma of the modular group and a subgroup Gamma ' of finite index of Gamma , we give an algorithmic construction for a Farey symbol for Gamma '.


Inspecting state of the art performance and NLP metrics in image based medical report generation. Several deep learning architectures have been proposed over the last years to deal with the problem of generating a written report given an imaging exam as input. Most works evaluate the generated reports using standard Natural Language Processing (NLP) metrics (e.g. BLEU, ROUGE), reporting significant progress. In this article, we contrast this progress by comparing state of the art (SOTA) models against weak baselines. We show that simple and even naive approaches yield near SOTA performance on most traditional NLP metrics. We conclude that evaluation methods in this task should be further studied towards correctly measuring clinical accuracy, ideally involving physicians to contribute to this end.


The Higman operations and embeddings of recursive groups. In the context of Higman embeddings of recursive groups into finitely presented groups we suggest an algorithm which uses Higman operations to explicitly constructs the specific recursively enumerable sets of integer sequences arising during the embeddings. This makes the constructive Higman embedding a doable task for certain wide classes of groups. Specific auxiliary operations are introduced to make the work with Higman operations a simpler and more intuitive procedure. Also, an automated mechanism of constructive embeddings of countable groups into 2 generator groups is mentioned.


High Dimensional Similarity Search with Satellite System Graph Efficiency, Scalability, and Unindexed Query Compatibility. Approximate Nearest Neighbor Search (ANNS) in high dimensional space is essential in database and information retrieval. Recently, there has been a surge of interest in exploring efficient graph based indices for the ANNS problem. Among them, Navigating Spreading out Graph (NSG) provides fine theoretical analysis and achieves state of the art performance. However, we find there are several limitations with NSG 1) NSG has no theoretical guarantee on nearest neighbor search when the query is not indexed in the database 2) NSG is too sparse which harms the search performance. In addition, NSG suffers from high indexing complexity. To address the above problems, we propose the Satellite System Graphs (SSG) and a practical variant NSSG. Specifically, we propose a novel pruning strategy to produce SSGs from the complete graph. SSGs define a new family of MSNETs in which the out edges of each node are distributed evenly in all directions. Each node in the graph builds effective connections to its neighborhood omnidirectionally, whereupon we derive SSG's excellent theoretical properties for both indexed and unindexed queries. We can adaptively adjust the sparsity of an SSG with a hyper parameter to optimize the search performance. Further, NSSG is proposed to reduce the indexing complexity of the SSG for large scale applications. Both theoretical and extensive experimental analyses are provided to demonstrate the strengths of the proposed approach over the existing representative algorithms. Our code has been released at https github.com ZJULearning SSG.


High Performance Industrial Wireless Achieving Reliable and Deterministic Connectivity over IEEE 802.11 WLANs. Communication for control centric industrial applications is characterized by the requirements of very high reliability, very low and deterministic latency and high scalability. Typically, IEEE 802.11 based wireless local area networks (WLANs), also known as Wi Fi networks, are deemed ineligible for industrial control applications owing to insufficient reliability and non deterministic latency. This paper proposes a novel solution for providing reliable and deterministic communication, through Wi Fi, in industrial environments. The proposed solution, termed as textsf HAR ( text 2 )D Fi ( underline H ybrid channel underline A ccess with underline R edundancy for underline R eliable and underline D eterministic Wi underline Fi ), adopts hybrid channel access mechanisms for achieving deterministic communication. It also provides temporal redundancy for enhanced reliability. textsf HAR ( text 2 )D Fi implements different medium access control (MAC) designs that build on the standard physical (PHY) layer. Such designs can be classified into two categories (a) MAC designs with pre defined (physical) time slotted schedule, and (b) MAC designs with virtual time slotted schedule. Performance evaluation, based on analysis and system level simulations, demonstrates the viability of textsf HAR ( text 2 )D Fi for control centric industrial applications.


Plasmon induced transparency in an air dielectric grooved parallel plate terahertz waveguide. In this article, we examine plasmon induced transparency (PIT) effect in a parallel plate waveguide (PPWG) comprising of two similar pyramidal shaped grooves. One of the grooves is filled with air, while the other is filled with a dielectric material whose refractive index can be varied. The resonant frequencies corresponding to the air and dielectric grooves in the proposed configuration results in the transparency window which can be modulated with the refractive index of the dielectric material. The approach provides flexibility to actively control transparency effect in a waveguide configuration without changing physical dimensions. We examined field profiles in the transparency region to clearly depict the PIT effect. We have employed an analytical model based upon the three level plasmonic model to validate our numerical findings. Further, we examined the switching and tunability of transparency effect by including silicon layers between the grooves whose conductivity can be varied. Actively tunable response in plasmon induced transparency effect in terahertz waveguides can be significant in the construction of terahertz active components.


Recent progress on graphs with fixed smallest eigenvalue. We give a survey on graphs with fixed smallest eigenvalue, especially on graphs with large minimal valency and also on graphs with good structures. Our survey mainly consists of the following two parts (i) Hoffman graphs, the basic theory related to Hoffman graphs and the applications of Hoffman graphs to graphs with fixed smallest eigenvalue and large minimal valency (ii) recent results on distance regular graphs and co edge regular graphs with fixed smallest eigenvalue and the characterizations of certain families of distance regular graphs. At the end of the survey, we also discuss signed graphs with fixed smallest eigenvalue and present some new findings.


The Farrell Jones Conjecture for normally poly free groups. We prove the K and L theoretic Farrell Jones Conjecture with coefficients in an additive category for every normally poly free group, in particular for even Artin groups of FC type, and for all groups of the form A rtimes mathbb Z where A is a right angled Artin group. Our proof relies on the work of Bestvina Fujiwara Wigglesworth on the Farrell Jones Conjecture for free by cyclic groups.


Managed Blockchain Based Cryptocurrencies with Consensus Enforced Rules and Transparency. Blockchain based cryptocurrencies are usually unmanaged, distributed, consensus based systems in which no single entity has control. Managed cryptocurrencies can be implemented using private blockchains but are fundamentally different as the owners have complete control to do arbitrary activity without transparency (since they control the mining). In this work we explore a hybrid approach where a managed cryptocurrency is maintained through distributed consensus based methods. The currency administrator can perform ongoing management functions while the consensus methods enforce the rules of the cryptocurrency and provide transparency for all management actions. This enables the introduction of money management features common in fiat currencies but where the managing entity cannot perform arbitrary actions and transparency is enforced. We thus eliminate the need for users to trust the currency administrator but also to enable the administrator to manage the cryptocurrency. We demonstrate how to implement our approach through modest modifications to the implicit Bitcoin specification, however, our approach can be applied to most any blockchain based cryptocurrency using a variety of consensus methods.


Mitigation of Coincident Peak Charges via Approximate Dynamic Programming. A significant portion of a consumer's annual electrical costs can be made up of coincident peak charges a transmission surcharge for power consumed when the entire system is at peak demand. This charge occurs only a few times annually, but with per MW prices orders of magnitudes higher than non peak times. While predicting the moment of peak demand charges over the course of the entire billing period is possible, optimal cost mitigation strategies based on these predictions have not been explored. In this paper we cast coincident peak cost mitigation as an optimization problem and analyze conditions for optimal and near optimal policies for mitigation. For small consumers we use approximate dynamic programming to first show the existence of a near optimal policy and second train a neural policy for curtailing coincident peak charges when subject to ramping constraints.


How does the Mind store Information?. How we store information in our mind has been a major intriguing open question. We approach this question not from a physiological standpoint as to how information is physically stored in the brain, but from a conceptual and algorithm standpoint as to the right data structures to be used to organize and index information. Here we propose a memory architecture directly based on the recursive sketching ideas from the paper "Recursive Sketches for Modular Deep Networks", ICML 2019 (arXiv 1905.12730), to store information in memory as concise sketches. We also give a high level, informal exposition of the recursive sketching idea from the paper that makes use of subspace embeddings to capture deep network computations into a concise sketch. These sketches form an implicit knowledge graph that can be used to find related information via sketches from the past while processing an event.


Minimal linear codes arising from blocking sets. Minimal linear codes are algebraic objects which gained interest in the last twenty years, due to their link with Massey's secret sharing schemes. In this context, Ashikhmin and Barg provided a useful and a quite easy to handle sufficient condition for a linear code to be minimal, which has been applied in the construction of many minimal linear codes. In this paper, we generalize some recent constructions of minimal linear codes which are not based on Ashikhmin Barg's condition. More combinatorial and geometric methods are involved in our proofs. In particular, we present a family of codes arising from particular blocking sets, which are well studied combinatorial objects. In this context, we will need to define cutting blocking sets and to prove some of their relations with other notions in blocking sets' theory. At the end of the paper, we provide one explicit family of cutting blocking sets and related minimal linear codes, showing that infinitely many of its members do not satisfy the Ashikhmin Barg's condition.


Analytic Continued Fractions for Regression A Memetic Algorithm Approach. We present an approach for regression problems that employs analytic continued fractions as a novel representation. Comparative computational results using a memetic algorithm are reported in this work. Our experiments included fifteen other different machine learning approaches including five genetic programming methods for symbolic regression and ten machine learning methods. The comparison on training and test generalization was performed using 94 datasets of the Penn State Machine Learning Benchmark. The statistical tests showed that the generalization results using analytic continued fractions provides a powerful and interesting new alternative in the quest for compact and interpretable mathematical models for artificial intelligence.


Advanced Intelligent Systems for Surgical Robotics. Surgical robots have had clinical use since the mid 1990s. Robot assisted surgeries offer many benefits over the conventional approach including lower risk of infection and blood loss, shorter recovery, and an overall safer procedure for patients. The past few decades have shown many emerging surgical robotic platforms that can work in complex and confined channels of the internal human organs and improve the cognitive and physical skills of the surgeons during the operation. Advanced technologies for sensing, actuation, and intelligent control have enabled multiple surgical devices to simultaneously operate within the human body at low cost and with more efficiency. Despite advances, current surgical intervention systems are not able to execute autonomous tasks and make cognitive decisions that are analogous to that of humans. This paper will overview a historical development of surgery from conventional open to robotic assisted approaches with discussion on the capabilities of advanced intelligent systems and devices that are currently implemented in existing surgical robotic systems. It will also revisit available autonomous surgical platforms with comments on the essential technologies, existing challenges, and suggestions for the future development of intelligent robotic assisted surgical systems towards the achievement of fully autonomous operation.


iConViz Interactive Visual Exploration of the Default Contagion Risk of Networked Guarantee Loans. Groups of enterprises can serve as guarantees for one another and form complex networks when obtaining loans from commercial banks. During economic slowdowns, corporate default may spread like a virus and lead to large scale defaults or even systemic financial crises. To help financial regulatory authorities and banks manage the risk associated with networked loans, we identified the default contagion risk, a pivotal issue in developing preventive measures, and established iConVis, an interactive visual analysis tool that facilitates the closed loop analysis process. A novel financial metric, the contagion effect, was formulated to quantify the infectious consequences of guarantee chains in this type of network. Based on this metric, we designed and implement a series of novel and coordinated views that address the analysis of financial problems. Experts evaluated the system using real world financial data. The proposed approach grants practitioners the ability to avoid previous ad hoc analysis methodologies and extend coverage of the conventional Capital Accord to the banking industry.


Gelfand Tsetlin modules for gl(n,m). We address the problem of classifying of irreducible Gelfand Tsetlin modules for gl(m n) and show that it reduces to the classification of Gelfand Tsetlin modules for the even part. We also give an explicit tableaux construction and the irreducibility criterion for the class of quasi typical and quasi covariant Gelfand Tsetlin modules which includes all essentially typical and covariant tensor finite dimensional modules. In the quasi typical case new irreducible representations are infinite dimensional gl(m n) modules which are isomorphic to the parabolically induced (Kac) modules.


Hydrodynamic limit for a 2D interlaced particle process. The Markov dynamics of interlaced particle arrays, introduced by A. Borodin and P. Ferrari in arXiv 0811.0682, is a classical example of (2 1) dimensional random growth model belonging to the so called Anisotropic KPZ universality class. In Legras Toninelli (2017) arXiv 1704.06581, a hydrodynamic limit the convergence of the height profile, after space time rescaling, to the solution of a deterministic Hamilton Jacobi PDE with non convex Hamiltonian was proven when either the initial profile is convex, or for small times, before the solution develops shocks. In the present work, we give a simpler proof, that works for all times and for all initial profiles for which the limit equation makes sense. In particular, the convexity assumption is dropped. The main new idea is a new viewpoint about "finite speed of propagation" that allows to bypass the need of a priori control of the interface gradients, or equivalently of inter particle distances.


Arboretum for a generalization of Ramanujan polynomials. In this paper, we expand on the work of Guo and Zeng from 2007 on a generalization of the Ramanujan polynomials and planar trees. We manage to find combinatorial interpretations of this family of polynomials in terms of Greg trees, Cayley trees, and planar trees by constructing bijections that preserve relevant tree statistics.


Interactive Learning for Semantic Segmentation in Earth Observation. Dense pixel wise classification maps output by deep neural networks are of extreme importance for scene understanding. However, these maps are often partially inaccurate due to a variety of possible factors. Therefore, we propose to interactively refine them within a framework named DISCA (Deep Image Segmentation with Continual Adaptation). It consists of continually adapting a neural network to a target image using an interactive learning process with sparse user annotations as ground truth. We show through experiments on three datasets using synthesized annotations the benefits of the approach, reaching an IoU improvement up to 4.7 for ten sampled clicks. Finally, we exhibit that our approach can be particularly rewarding when it is faced to additional issues such as domain adaptation.


Graph structure via local occupancy. The first author together with Jenssen, Perkins and Roberts (2017) recently showed how local properties of the hard core model on triangle free graphs guarantee the existence of large independent sets, of size matching the best known asymptotics due to Shearer (1983). The present work strengthens this in two ways first, by guaranteeing stronger graph structure in terms of colourings through applications of the Lov 'asz local lemma and second, by extending beyond triangle free graphs in terms of local sparsity, treating for example graphs of bounded local edge density, of bounded local Hall ratio, and of bounded clique number. This generalises and improves upon much other earlier work, including that of Shearer (1995), Alon (1996) and Alon, Krivelevich and Sudakov (1999), and more recent results of Molloy (2019), Bernshteyn (2019) and Achlioptas, Iliopoulos and Sinclair (2019). Our results derive from a common framework built around the hard core model. It pivots on a property we call local occupancy, giving a clean separation between the methods for deriving graph structure with probabilistic information and verifying the requisite probabilistic information itself.


A Novel Approach for Generating SPARQL Queries from RDF Graphs. This work is done as part of a research master's thesis project. The goal is to generate SPARQL queries based on user supplied keywords to query RDF graphs. To do this, we first transformed the input ontology into an RDF graph that reflects the semantics represented in the ontology. Subsequently, we stored this RDF graph in the Neo4j graphical database to ensure efficient and persistent management of RDF data. At the time of the interrogation, we studied the different possible and desired interpretations of the request originally made by the user. We have also proposed to carry out a sort of transformation between the two query languages SPARQL and Cypher, which is specific to Neo4j. This allows us to implement the architecture of our system over a wide variety of BD RDFs providing their query languages, without changing any of the other components of the system. Finally, we tested and evaluated our tool using different test bases, and it turned out that our tool is comprehensive, effective, and powerful enough.


Iterated sumsets and Hilbert functions. Let A be a finite subset of an abelian group (G, ). Let h ge 2 be an integer. If A ge 2 and the cardinality hA of the h fold iterated sumset hA A times times times A is known, what can one say about (h 1)A and (h 1)A ? It is known that (h 1)A ge hA (h 1) h , a consequence of Pl "u nnecke's inequality. Here we improve this bound with a new approach. Namely, we model the sequence hA h ge 0 with the Hilbert function of a standard graded algebra. We then apply Macaulay's 1927 theorem on the growth of Hilbert functions, and more specifically a recent condensed version of it. Our bound implies (h 1)A ge theta (x, h) hA (h 1) h for some factor theta (x, h) 1, where x is a real number closely linked to hA . Moreover, we show that theta (x, h) asymptotically tends to e approx 2.718 as A grows and h lies in a suitable range varying with A .


Primary decomposition over partially ordered groups. Over any partially ordered abelian group whose positive cone is closed in an appropriate sense and has finitely many faces, modules that satisfy a weak finiteness condition admit finite primary decompositions. This conclusion rests on the introduction of basic notions in the relevant generality, such as closedness of partially ordered abelian groups, faces and their coprimary modules, and finiteness conditions as well local and global support functors for modules over partially ordered groups.


Random section and random simplex inequality. Consider some convex body K subset mathbb R d . Let X 1, dots, X k , where k leq d , be random points independently and uniformly chosen in K , and let xi k be a uniformly distributed random linear k plane. We show that for p geq d k 1 , mathbb E , K cap xi k d p leq c d,k,p cdot K k , , mathbb E , mathrm conv (0,X 1, dots,X k) p, where cdot and mathrm conv denote the volume of correspondent dimension and the convex hull. The constant c d,k,p is such that for k 1 the equality holds if and only if K is an ellipsoid centered at the origin, and for k 1 the inequality turns to equality. If p 0 , then the inequality reduces to the Busemann intersection inequality, and if k d to the Busemann random simplex inequality. We also present an affine version of this inequality which similarly generalizes the Schneider inequality and the Blaschke Gr "omer inequality.


The interpretability logic of all reasonable arithmetical theories. This paper from 2000 is a presentation of a status qu ae stionis at that tiime, to wit of the problem of the interpretability logic of em all reasonable arithmetical theories. We present both the arithmetical side and the modal side of the question.


Approximation Guarantees of Local Search Algorithms via Localizability of Set Functions. This paper proposes a new framework for providing approximation guarantees of local search algorithms. Local search is a basic algorithm design technique and is widely used for various combinatorial optimization problems. To analyze local search algorithms for set function maximization, we propose a new notion called localizability of set functions, which measures how effective local improvement is. Moreover, we provide approximation guarantees of standard local search algorithms under various combinatorial constraints in terms of localizability. The main application of our framework is sparse optimization, for which we show that restricted strong concavity and restricted smoothness of the objective function imply localizability, and further develop accelerated versions of local search algorithms. We conduct experiments in sparse regression and structure learning of graphical models to confirm the practical efficiency of the proposed local search algorithms.


A distributed control problem for a fractional tumor growth model. In this paper, the authors study the distributed optimal control of a system of three evolutionary equations involving fractional powers of three selfadjoint, monotone, unbounded linear operators having compact resolvents. The system is a generalization of a Cahn Hilliard type phase field system modeling tumor growth that goes back to Hawkins Daarud et al. (Int. J. Numer. Math. Biomed. Eng. 28 (2012), 3 24). The aim of the control process, which could be realized by either administering a drug or monitoring the nutrition, is to keep the tumor cell fraction under control while avoiding possible harm for the patient. In contrast to previous studies, in which the occurring unbounded operators governing the diffusional regimes were all given by the Laplacian with zero Neumann boundary conditions, the operators may in our case be different more generally, we consider systems with fractional powers of the type that were studied in the recent work Adv. Math. Sci. Appl. 28 (2019), 343 375 (see arXiv 1906.10874), by the present authors. In the analysis, the Fr 'echet differentiability of the associated control to state operator is shown, by also establishing the existence of solutions to the associated adjoint system, and deriving the first order necessary conditions of optimality for a cost functional of tracking type.


Quantifying and Learning Linear Symmetry Based Disentanglement. The definition of Linear Symmetry Based Disentanglement (LSBD) formalizes the notion of linearly disentangled representations, but there is currently no metric to quantify LSBD. Such a metric is crucial to evaluate LSBD methods and to compare to previous understandings of disentanglement. We propose mathcal D mathrm LSBD , a mathematically sound metric to quantify LSBD, and provide a practical implementation for mathrm SO (2) groups. Furthermore, from this metric we derive LSBD VAE, a semi supervised method to learn LSBD representations. We demonstrate the utility of our metric by showing that (1) common VAE based disentanglement methods don't learn LSBD representations, (2) LSBD VAE as well as other recent methods can learn LSBD representations, needing only limited supervision on transformations, and (3) various desirable properties expressed by existing disentanglement metrics are also achieved by LSBD representations.


Perfect sampling from spatial mixing. We introduce a new perfect sampling technique that can be applied to general Gibbs distributions and runs in linear time if the correlation decays faster than the neighborhood growth. In particular, in graphs with sub exponential neighborhood growth like mathbb Z d , our algorithm achieves linear running time as long as Gibbs sampling is rapidly mixing. As concrete applications, we obtain the currently best perfect samplers for colorings and for monomer dimer models in such graphs.


Bistability in Rayleigh B 'enard convection with a melting boundary. A pure and incompressible material is confined between two plates such that it is heated from below and cooled from above. When its melting temperature is comprised between these two imposed temperatures, an interface separating liquid and solid phases appears. Depending on the initial conditions, freezing or melting occurs until the interface eventually converges towards a stationary state. This evolution is studied numerically in a two dimensional configuration using a phase field method coupled with the Navier Stokes equations. Varying the control parameters of the model, we exhibit two types of equilibria diffusive and convective. In the latter case, Rayleigh B 'enard convection in the liquid phase shapes the solid liquid front, and a macroscopic topography is observed. A simple way of predicting these equilibrium positions is discussed and then compared with the numerical simulations. In some parameter regimes, we show that multiple equilibria can coexist depending on the initial conditions. We also demonstrate that, in this bi stable regime, transitioning from the diffusive to the convective equilibrium is inherently a nonlinear mechanism involving finite amplitude perturbations.


Learning to Update Natural Language Comments Based on Code Changes. We formulate the novel task of automatically updating an existing natural language comment based on changes in the body of code it accompanies. We propose an approach that learns to correlate changes across two distinct language representations, to generate a sequence of edits that are applied to the existing comment to reflect the source code modifications. We train and evaluate our model using a dataset that we collected from commit histories of open source software projects, with each example consisting of a concurrent update to a method and its corresponding comment. We compare our approach against multiple baselines using both automatic metrics and human evaluation. Results reflect the challenge of this task and that our model outperforms baselines with respect to making edits.


Extension of positive definite functions and Connes' embedding conjecture. In this paper we formulate a conjecture which is a strengthening of an extension theorem of Bakonyi and Timotin for positive definite functions on the free group on two generators. We prove that this conjecture implies Connes' embedding conjecture.


Hybrid Beamforming and Adaptive RF Chain Activation for Uplink Cell Free Millimeter Wave Massive MIMO Systems. In this work, we investigate hybrid analog digital beamforming (HBF) architectures for uplink cell free (CF) millimeter wave (mmWave) massive multiple input multiple output (MIMO) systems. We first propose two HBF schemes, namely, decentralized HBF (D HBF) and semi centralized HBF (SC HBF). In the former, both the digital and analog beamformers are generated independently at each AP based on the local channel state information (CSI). In contrast, in the latter, only the digital beamformer is obtained locally at the AP, whereas the analog beamforming matrix is generated at the central processing unit (CPU) based on the global CSI received from all APs. We show that the analog beamformers generated in these two HBF schemes provide approximately the same achievable rates despite the lower complexity of D HBF and its lack of CSI requirement. Furthermore, to reduce the power consumption, we propose a novel adaptive radio frequency (RF) chain activation (ARFA) scheme, which dynamically activates deactivates RF chains and their connected analog to digital converters (ADCs) and phase shifters (PSs) at the APs based on the CSI. For the activation of RF chains, low complexity algorithms are proposed, which can achieve significant improvement in energy efficiency (EE) with only a marginal loss in the total achievable rate.


Note on time regularity for weak solutions to parabolic systems of p Laplace type. We show that local weak solutions to parabolic systems of p Laplace type are H "o lder continuous in time with values in a spatial Lebesgue space and H "o lder continuous on almost every time line. We provide an elementary and self contained proof building on the local higher integrability result of Kinnunen and Lewis.


From quadratic Hawkes processes to super Heston rough volatility models with Zumbach effect. Using microscopic price models based on Hawkes processes, it has been shown that under some no arbitrage condition, the high degree of endogeneity of markets together with the phenomenon of metaorders splitting generate rough Heston type volatility at the macroscopic scale. One additional important feature of financial dynamics, at the heart of several influential works in econophysics, is the so called feedback or Zumbach effect. This essentially means that past trends in returns convey significant information on future volatility. A natural way to reproduce this property in microstructure modeling is to use quadratic versions of Hawkes processes. We show that after suitable rescaling, the long term limits of these processes are refined versions of rough Heston models where the volatility coefficient is enhanced compared to the square root characterizing Heston type dynamics. Furthermore the Zumbach effect remains explicit in these limiting rough volatility models.


A Distributed Predictive Control Approach for Cooperative Manipulation of Multiple Underwater Vehicle Manipulator Systems. This paper addresses the problem of cooperative object transportation for multiple Underwater Vehicle Manipulator Systems (UVMSs) in a constrained workspace involving static obstacles. We propose a Nonlinear Model Predictive Control (NMPC) approach for a team of UVMSs in order to transport an object while avoiding significant constraints and limitations such as kinematic and representation singularities, obstacles within the workspace, joint limits and control input saturations. More precisely, by exploiting the coupled dynamics between the robots and the object, and using certain load sharing coefficients, we design a distributed NMPC for each UVMS in order to cooperatively transport the object within the workspace's feasible region. Moreover, the control scheme adopts load sharing among the UVMSs according to their specific payload capabilities. Additionally, the feedback relies on each UVMS's locally measurements and no explicit data is exchanged online among the robots, thus reducing the required communication bandwidth. Finally, real time simulation results conducted in UwSim dynamic simulator running in ROS environment verify the efficiency of the theoretical finding.


Blockchain Powered Collaboration in Heterogeneous Swarms of Robots. One of the key challenges in the collaboration within heterogeneous multi robot systems is the optimization of the amount and type of data to be shared between robots with different sensing capabilities and computational resources. In this paper, we present a novel approach to managing collaboration terms in heterogeneous multi robot systems with blockchain technology. Leveraging the extensive research of consensus algorithms in the blockchain domain, we exploit key technologies in this field to be integrated for consensus in robotic systems. We propose the utilization of proof of work systems to have an online estimation of the available computational resources at different robots. Furthermore, we define smart contracts that integrate information about the environment from different robots in order to evaluate and rank the quality and accuracy of each of the robots' sensor data. This means that the key parameters involved in heterogeneous robotic collaboration are integrated within the Blockchain and estimated at all robots equally without explicitly sharing information about the robots' hardware or sensors. Trustability is based on the verification of data samples that are submitted to the blockchain within each data exchange transaction and validated by other robots operating in the same environment. Initial results are reported which show the viability of the concepts presented in this paper.


Construction and Elicitation of a Black Box Model in the Game of Bridge. We address the problem of building a decision model for a specific bidding situation in the game of Bridge. We propose the following multi step methodology i) Build a set of examples for the decision problem and use simulations to associate a decision to each example ii) Use supervised relational learning to build an accurate and readable model iii) Perform a joint analysis between domain experts and data scientists to improve the learning language, including the production by experts of a handmade model iv) Build a better, more readable and accurate model.


Structural Properties of the Stability of Jamitons. It is known that inhomogeneous second order macroscopic traffic models can reproduce the phantom traffic jam phenomenon whenever the sub characteristic condition is violated, uniform traffic flow is unstable, and small perturbations grow into nonlinear traveling waves, called jamitons. In contrast, what is essentially unstudied is the question which jamiton solutions are dynamically stable? To understand which stop and go traffic waves can arise through the dynamics of the model, this question is critical. This paper first presents a computational study demonstrating which types of jamitons do arise dynamically, and which do not. Then, a procedure is presented that characterizes the stability of jamitons. The study reveals that a critical component of this analysis is the proper treatment of the perturbations to the shocks, and of the neighborhood of the sonic points.


H infty calculus for submarkovian semigroups on weighted L 2 spaces. Let (T t) t geq 0 be a markovian (resp. submarkovian) semigroup on some sigma finite measure space ( Omega, mu) . We prove that its negative generator A has a bounded H infty( Sigma theta) calculus on the weighted space L 2( Omega,wd mu) as long as the weight w Omega to (0, infty) has finite characteristic defined by Q A 2(w) sup t 0 left T t(w) T t left(w 1 right) right L infty( Omega) (resp. by a variant for submarkovian semigroups). Some additional technical conditions on the semigroup have to be imposed and their validity in examples is discussed. Any angle theta frac pi 2 is admissible in the above H infty calculus, and for some semigroups also certain theta theta w frac pi 2 depending on the size of Q A 2(w) . The norm of the H infty( Sigma theta) calculus is linear in the Q A 2 characteristic for theta frac pi 2 . We also discuss negative results on angles theta frac pi 2 . Namely we show that there is a markovian semigroup on a probability space and a Q A 2 weight w without H "ormander functional calculus on L 2( Omega,w d mu) .


The Role of Modularity and Neuro Regulation for the Production of Multiple Behaviors. This project investigates whether functional specialization or modularity can support the development of multiple behaviors. In principle, modular solutions of this type can facilitate the development of multiple behaviors since each module is responsible for the production of different behavior. Consequently, the interfaces that arise neural mechanisms supporting the production of different behaviors can be reduced. The project involves the implementation of regulatory networks of this type and the realization of experiments involving the production of different behaviors.


A high order well balanced positivity preserving moving mesh DG method for the shallow water equations with non flat bottom topography. A rezoning type adaptive moving mesh discontinuous Galerkin method is proposed for the numerical solution of the shallow water equations with non flat bottom topography. The well balance property is crucial to the simulation of perturbation waves over the lake at rest steady state such as waves on a lake or tsunami waves in the deep ocean. To ensure the well balance and positivity preserving properties, strategies are discussed in the use of slope limiting, positivity preservation limiting, and data transferring between meshes. Particularly, it is suggested that a DG interpolation scheme be used for the interpolation of both the flow variables and bottom topography from the old mesh to the new one and after each application of the positivity preservation limiting on the water depth, a high order correction be made to the approximation of the bottom topography according to the modifications in the water depth. Moreover, mesh adaptation based on the equilibrium variable and water depth is shown to give more desirable results than that based on the commonly used entropy function. Numerical examples in one and two spatial dimensions are presented to demonstrate the well balance and positivity preserving properties of the method and its ability to capture small perturbations of the lake at rest steady state.


What do Entity Centric Models Learn? Insights from Entity Linking in Multi Party Dialogue. Humans use language to refer to entities in the external world. Motivated by this, in recent years several models that incorporate a bias towards learning entity representations have been proposed. Such entity centric models have shown empirical success, but we still know little about why. In this paper we analyze the behavior of two recently proposed entity centric models in a referential task, Entity Linking in Multi party Dialogue (SemEval 2018 Task 4). We show that these models outperform the state of the art on this task, and that they do better on lower frequency entities than a counterpart model that is not entity centric, with the same model size. We argue that making models entity centric naturally fosters good architectural decisions. However, we also show that these models do not really build entity representations and that they make poor use of linguistic context. These negative results underscore the need for model analysis, to test whether the motivations for particular architectures are borne out in how models behave when deployed.


Lee Yang zeros and the complexity of the ferromagnetic Ising model on bounded degree graphs. We study the computational complexity of approximating the partition function of the ferromagnetic Ising model with the external field parameter lambda on the unit circle in the complex plane. Complex valued parameters for the Ising model are relevant for quantum circuit computations and phase transitions in statistical physics, but have also been key in the recent deterministic approximation scheme for all lambda neq 1 by Liu, Sinclair, and Srivastava. Here, we focus on the unresolved complexity picture on the unit circle, and on the tantalising question of what happens around lambda 1 , where on one hand the classical algorithm of Jerrum and Sinclair gives a randomised approximation scheme on the real axis suggesting tractability, and on the other hand the presence of Lee Yang zeros alludes to computational hardness. Our main result establishes a sharp computational transition at the point lambda 1 , and more generally on the entire unit circle. For an integer Delta geq 3 and edge interaction parameter b in (0,1) we show P hardness for approximating the partition function on graphs of maximum degree Delta on the arc of the unit circle where the Lee Yang zeros are dense. This result contrasts with known approximation algorithms when lambda neq 1 or when lambda is in the complementary arc around 1 of the unit circle. Our work thus gives a direct connection between the presence absence of Lee Yang zeros and the tractability of efficiently approximating the partition function on bounded degree graphs.


Ab initio calculations of laser atom interactions reveal harmonics feedback during macroscopic propagation. We couple the full 3D ab initio quantum evolution of the light pulse polarization in interaction with an atom with a propagation model to simulate the propagation of ultrashort laser pulses over macroscopic dimensions, in the presence of self generated harmonics up to order 11. We evidence a clear feedback of the generated harmonics on propagation, with an influence on the ionization probability as well as the yield of the harmonic generation itself.


MnasFPN Learning Latency aware Pyramid Architecture for Object Detection on Mobile Devices. Despite the blooming success of architecture search for vision tasks in resource constrained environments, the design of on device object detection architectures have mostly been manual. The few automated search efforts are either centered around non mobile friendly search spaces or not guided by on device latency. We propose MnasFPN, a mobile friendly search space for the detection head, and combine it with latency aware architecture search to produce efficient object detection models. The learned MnasFPN head, when paired with MobileNetV2 body, outperforms MobileNetV3 SSDLite by 1.8 mAP at similar latency on Pixel. It is also both 1.0 mAP more accurate and 10 faster than NAS FPNLite. Ablation studies show that the majority of the performance gain comes from innovations in the search space. Further explorations reveal an interesting coupling between the search space design and the search algorithm, and that the complexity of MnasFPN search space may be at a local optimum.


An Efficient Approach for Super and Nested Term Indexing and Retrieval. This paper describes a new approach, called Terminological Bucket Indexing (TBI), for efficient indexing and retrieval of both nested and super terms using a single method. We propose a hybrid data structure for facilitating faster indexing building. An evaluation of our approach with respect to widely used existing approaches on several publicly available dataset is provided. Compared to Trie based approaches, TBI provides comparable performance on nested term retrieval and far superior performance on super term retrieval. Compared to traditional hash table, TBI needs 80 less time for indexing.


Centralizers and normalizers of local analytic and formal vector fields. We investigate the structure of the centralizer and the normalizer of a local analytic or formal differential system at a nondegenerate stationary point, using the theory of Poincar 'e Dulac normal forms. Our main results are concerned with the formal case. We obtain a description of the relation between centralizer and normalizer, sharp dimension estimates when the centralizer of the linearization has finite dimension, and lower estimates for the dimension of the centralizer in general. For a distinguished class of linear vector fields (which is sufficiently large to be of interest) we obtain a precise characterization of the centralizer for corresponding normal forms in the generic case. Moreover, in view of their relation to normalizers, we discuss inverse Jacobi multipliers and obtain existence criteria and nonexistence results for several classes of vector fields.


Spartan Sparse Robust Addressable Networks. A Peer to Peer (P2P) network is a dynamic collection of nodes that connect with each other via virtual overlay links built upon an underlying network (usually, the Internet). P2P networks are highly dynamic and can experience very heavy churn, i.e., a large number of nodes join leave the network continuously. Thus, building and maintaining a stable overlay network is an important problem that has been studied extensively for two decades. In this paper, we present our Pe overlay network called Sparse Robust Addressable Network (Spartan). Spartan can be quickly and efficiently built in a fully distributed fashion within O( log n) rounds. Furthermore, the Spartan overlay structure can be maintained, again, in a fully distributed manner despite adversarially controlled churn (i.e., nodes joining and leaving) and significant variation in the number of nodes. Moreover, new nodes can join a committee within O(1) rounds and leaving nodes can leave without any notice. The number of nodes in the network lies in n, fn for any fixed f ge 1 . Up to epsilon n nodes (for some small but fixed epsilon 0 ) can be adversarially added deleted within em any period of P rounds for some P in O( log log n) . Despite such uncertainty in the network, Spartan maintains Theta(n log n) committees that are stable and addressable collections of Theta( log n) nodes each for O(polylog(n)) rounds with high probability. Spartan's committees are also capable of performing sustained computation and passing messages between each other. Thus, any protocol designed for static networks can be simulated on Spartan with minimal overhead. This makes Spartan an ideal platform for developing applications. We experimentally show that Spartan will remain robust as long as each committee, on average, contains 24 nodes for networks of size up to 10240 .


On Occupation Time for On Off Processes with Multiple Off States. The need to model a Markov renewal on off process with multiple off states arise in many applications such as economics, physics, and engineering. Characterization of the occupation time of one specific off state marginally or two off states jointly is crucial to understanding such processes. We derive the exact marginal and joint distributions of the off state occupation times. The theoretical results are confirmed numerically in a simulation study. A special case when all holding times have Levy distribution is considered for the possibility of simplification of the formulas.


Achievable Rates of Concatenated Codes in DNA Storage under Substitution Errors. In this paper, we study achievable rates of concatenated coding schemes over a deoxyribonucleic acid (DNA) storage channel. Our channel model incorporates the main features of DNA based data storage. First, information is stored on many, short DNA strands. Second, the strands are stored in an unordered fashion inside the storage medium and each strand is replicated many times. Third, the data is accessed in an uncontrollable manner, i.e., random strands are drawn from the medium and received, possibly with errors. As one of our results, we show that there is a significant gap between the channel capacity and the achievable rate of a standard concatenated code in which one strand corresponds to an inner block. This is in fact surprising as for other channels, such as q ary symmetric channels, concatenated codes are known to achieve the capacity. We further propose a modified concatenated coding scheme by combining several strands into one inner block, which allows to narrow the gap and achieve rates that are close to the capacity.


Fractional Paley Wiener and Bernstein spaces. We introduce and study a family of spaces of entire functions in one variable that generalise the classical Paley Wiener and Bernstein spaces. Namely, we consider entire functions of exponential type a whose restriction to the real line belongs to the homogeneous Sobolev space dot W s,p and we call these spaces fractional Paley Wiener if p 2 and fractional Bernstein spaces if p in(1, infty) , that we denote by PW s a and mathcal B s,p a , respectively. For these spaces we provide a Paley Wiener type characterization, we remark some facts about the sampling problem in the Hilbert setting and prove generalizations of the classical Bernstein and Plancherel P 'olya inequalities. We conclude by discussing a number of open questions.


Log abundance of the moduli b divisors of lc trivial fibrations. We prove that the moduli b divisor of an lc trivial fibration from a log canonical pair is log abundant. The result follows from a theorem on the restriction of the moduli b divisor, based on a theory of lc trivial morphisms, which allows us to treat mathbb R divisors and proper morphisms possibly with disconnected fibres. We also prove a theorem on extending a finite cover over a closed subvariety to that over a variety in arbitrary characteristic.


A review on deep learning techniques for 3D sensed data classification. Over the past decade deep learning has driven progress in 2D image understanding. Despite these advancements, techniques for automatic 3D sensed data understanding, such as point clouds, is comparatively immature. However, with a range of important applications from indoor robotics navigation to national scale remote sensing there is a high demand for algorithms that can learn to automatically understand and classify 3D sensed data. In this paper we review the current state of the art deep learning architectures for processing unstructured Euclidean data. We begin by addressing the background concepts and traditional methodologies. We review the current main approaches including RGB D, multi view, volumetric and fully end to end architecture designs. Datasets for each category are documented and explained. Finally, we give a detailed discussion about the future of deep learning for 3D sensed data, using literature to justify the areas where future research would be most valuable.


Attention Guided Semantic Relationship Parsing for Visual Question Answering. Humans explain inter object relationships with semantic labels that demonstrate a high level understanding required to perform complex Vision Language tasks such as Visual Question Answering (VQA). However, existing VQA models represent relationships as a combination of object level visual features which constrain a model to express interactions between objects in a single domain, while the model is trying to solve a multi modal task. In this paper, we propose a general purpose semantic relationship parser which generates a semantic feature vector for each subject predicate object triplet in an image, and a Mutual and Self Attention (MSA) mechanism that learns to identify relationship triplets that are important to answer the given question. To motivate the significance of semantic relationships, we show an oracle setting with ground truth relationship triplets, where our model achieves a 25 accuracy gain over the closest state of the art model on the challenging GQA dataset. Further, with our semantic parser, we show that our model outperforms other comparable approaches on VQA and GQA datasets.


Simple Bilevel Programming and Extensions Part II Algorithms. This article continues our study on simple bilevel and simple MPEC problems. In this article we focus on developing algorithms. We show how using the idea of a gap function one can represent a simple MPEC as a simple bilevel problem with non smooth data. This motivates us first to develop an algorithm for a simple bilevel problem with non smooth data and modify the scheme for the same to develop an algorithm for the simple MPEC problem. We also discuss how the simple bilevel formulation of a simple MPEC can help us in formulating a stopping criteria for the simple MPEC problem


Dissecting Android Cryptocurrency Miners. Cryptojacking applications pose a serious threat to mobile devices. Due to the extensive computations, they deplete the battery fast and can even damage the device. In this work we make a step towards combating this threat. We collected and manually verified a large dataset of Android mining apps. In this paper, we analyze the gathered miners and identify how they work, what are the most popular libraries and APIs used to facilitate their development, and what static features are typical for this class of applications. Further, we analyzed our dataset using VirusTotal. The majority of our samples is considered malicious by at least one VirusTotal scanner, but 16 apps are not detected by any engine and at least 5 apks were not seen previously by the service. Mining code could be obfuscated or fetched at runtime, and there are many confusing miner related apps that actually do not mine. Thus, static features alone are not sufficient for miner detection. We have collected a feature set of dynamic metrics both for miners and unrelated benign apps, and built a machine learning based tool for dynamic detection. Our BrenntDroid tool is able to detect miners with 95 of accuracy on our dataset. This preprint is a technical report accompanying the paper "Dissecting Android Cryptocurrency Miners" published in ACM CODASPY 2020.


Are Emojis Emotional? A Study to Understand the Association between Emojis and Emotions. Given the growing ubiquity of emojis in language, there is a need for methods and resources that shed light on their meaning and communicative role. One conspicuous aspect of emojis is their use to convey affect in ways that may otherwise be non trivial to achieve. In this paper, we seek to explore the connection between emojis and emotions by means of a new dataset consisting of human solicited association ratings. We additionally conduct experiments to assess to what extent such associations can be inferred from existing data, such that similar associations can be predicted for a larger set of emojis. Our experiments show that this succeeds when high quality word level information is available.


Meta Context Transformers for Domain Specific Response Generation. Despite the tremendous success of neural dialogue models in recent years, it suffers a lack of relevance, diversity, and some times coherence in generated responses. Lately, transformer based models, such as GPT 2, have revolutionized the landscape of dialogue generation by capturing the long range structures through language modeling. Though these models have exhibited excellent language coherence, they often lack relevance and terms when used for domain specific response generation. In this paper, we present DSRNet (Domain Specific Response Network), a transformer based model for dialogue response generation by reinforcing domain specific attributes. In particular, we extract meta attributes from context and infuse them with the context utterances for better attention over domain specific key terms and relevance. We study the use of DSRNet in a multi turn multi interlocutor environment for domain specific response generation. In our experiments, we evaluate DSRNet on Ubuntu dialogue datasets, which are mainly composed of various technical domain related dialogues for IT domain issue resolutions and also on CamRest676 dataset, which contains restaurant domain conversations. Trained with maximum likelihood objective, our model shows significant improvement over the state of the art for multi turn dialogue systems supported by better BLEU and semantic similarity (BertScore) scores. Besides, we also observe that the responses produced by our model carry higher relevance due to the presence of domain specific key attributes that exhibit better overlap with the attributes of the context. Our analysis shows that the performance improvement is mostly due to the infusion of key terms along with dialogues which result in better attention over domain relevant terms. Other contributing factors include joint modeling of dialogue context with the domain specific meta attributes and topics.


Parametrization of Kloosterman sets and mathrm SL 3 Kloosterman sums. We stratify the mathrm SL 3 big cell Kloosterman sets using the reduced word decomposition of the Weyl group element, inspired by the Bott Samelson factorization. Thus the mathrm SL 3 long word Kloosterman sum is decomposed into finer parts, and we write it as a finite sum of a product of two classical Kloosterman sums. The fine Kloosterman sums end up being the correct pieces to consider in the Bruggeman Kuznetsov trace formula on the congruence subgroup Gamma 0(N) subseteq mathrm SL 3( mathbb Z ) . Another application is a new explicit formula, expressing the triple divisor sum function in terms of a double Dirichlet series of exponential sums, generalizing Ramanujan's formula.


An ergodic theorem for asymptotically periodic time inhomogeneous Markov processes, with application to quasi stationarity with moving boundaries. This paper deals with ergodic theorems for particular time inhomogeneous Markov processes, whose the time inhomogeneity is asymptotically periodic. Under a Lyapunov minorization condition, it is shown that, for any measurable bounded function f , the time average frac 1 t int 0 t f(X s)ds converges in mathbb L 2 towards a limiting distribution, starting from any initial distribution for the process (X t) t geq 0 . This convergence can be improved to an almost sure convergence under an additional assumption on the initial measure. This result will be then applied to show the existence of a quasi ergodic distribution for processes absorbed by an asymptotically periodic moving boundary, satisfying a conditional Doeblin's condition.


Organizing Family Support Services at ACM Conferences. This article reflects on our experiences providing family support services to a large, interdisciplinary ACM conference (CHI2018) including, the policy decisions, the challenges, and the successes. The article incorporates empirical data collected from pre and post conference surveys, observed use of the services, and aspirational aims for future conferences. We are discussing best practices and recommendations to facilitate the implementation of child support services at other conferences. We believe our article will be of great interest to both practitioners and academics in expanding the inclusivity and family support provided by ACM conferences and beyond.


Deep Learning vs. Traditional Computer Vision. Deep Learning has pushed the limits of what was possible in the domain of Digital Image Processing. However, that is not to say that the traditional computer vision techniques which had been undergoing progressive development in years prior to the rise of DL have become obsolete. This paper will analyse the benefits and drawbacks of each approach. The aim of this paper is to promote a discussion on whether knowledge of classical computer vision techniques should be maintained. The paper will also explore how the two sides of computer vision can be combined. Several recent hybrid methodologies are reviewed which have demonstrated the ability to improve computer vision performance and to tackle problems not suited to Deep Learning. For example, combining traditional computer vision techniques with Deep Learning has been popular in emerging domains such as Panoramic Vision and 3D vision for which Deep Learning models have not yet been fully optimised


Crowd simulation for crisis management the outcomes of the last decade. The last few decades, crowd simulation for crisis management is highlighted as an important topic of interest for many scientific fields. As the continues evolution of computational resources increases, along with the capabilities of Artificial Intelligence, the demand for better and more realistic simulation has become more attractive and popular to scientists. Along those years, there have been published hundreds of research articles and have been created numerous different systems that aim to simulate crowd behaviors, crisis cases and emergency evacuation scenarios. For better outcomes, recent research has focused on the separation of the problem of crisis management, to multiple research sub fields (categories), such as the navigation of the simulated pedestrians, their psychology, the group dynamics etc. There have been extended research works suggesting new methods and techniques for those categories of problems. In this paper, we propose three main research categories, each one consist of several sub categories, relying on crowd simulation for crisis management aspects and we present the outcomes of the last decade, focusing mostly on works exploiting multi agent technologies. We analyze a number of technologies, methodologies, techniques, tools and systems introduced throughout the last years. A comparative review and discussion of the proposed categories is presented towards the identification of the most efficient aspects of the proposed categories. A general framework, towards the future crowd simulation for crisis management is presented based on the most efficient to yield the most realistic outcomes of the last decades. The paper is concluded with some highlights and open questions for future directions.


On the use of spectral discretizations with time strong stability preserving properties to Dirichlet pseudo parabolic problems. This paper is concerned with the approximation of linear and nonlinearinitial boundary value problems of pseudo parabolic equations with Dirichlet boundary conditions. They are discretized in space by spectral Galerkin and collocation methods based on Legendre and Chebyshev polynomials. The time integration is carried out suitably with robust schemes attending to qualitative features such as stiffness and preservation of strong stability to simulate nonregular problems more correctly. The corresponding semidiscrete and fully discrete schemes are described and the performance of the methods is analyzed computationally.


Gathering with a strong team in weakly Byzantine environments. We study the gathering problem requiring a team of mobile agents to gather at a single node in arbitrary networks. The team consists of k agents with unique identifiers (IDs), and f of them are weakly Byzantine agents, which behave arbitrarily except falsifying their identifiers. The agents move in synchronous rounds and cannot leave any information on nodes. If the number of nodes n is given to agents, the existing fastest algorithm tolerates any number of weakly Byzantine agents and achieves gathering with simultaneous termination in O(n 4 cdot Lambda good cdot X(n)) rounds, where Lambda good is the length of the maximum ID of non Byzantine agents and X(n) is the number of rounds required to explore any network composed of n nodes. In this paper, we ask the question of whether we can reduce the time complexity if we have a strong team, i.e., a team with a few Byzantine agents, because not so many agents are subject to faults in practice. We give a positive answer to this question by proposing two algorithms in the case where at least 4f 2 9f 4 agents exist. Both the algorithms take the upper bound N of n as input. The first algorithm achieves gathering with non simultaneous termination in O((f Lambda good ) cdot X(N)) rounds. The second algorithm achieves gathering with simultaneous termination in O((f Lambda all ) cdot X(N)) rounds, where Lambda all is the length of the maximum ID of all agents. The second algorithm significantly reduces the time complexity compared to the existing one if n is given to agents and Lambda all O( Lambda good ) holds.


A splitting theorem for capillary graphs under Ricci lower bounds. In this paper, we study capillary graphs defined on a domain Omega of a complete Riemannian manifold M , where a graph is said to be capillary if it has constant mean curvature and locally constant Dirichlet and Neumann conditions on partial Omega . Our main result is a splitting theorem both for Omega and for the graph function on a class of manifolds with nonnegative Ricci curvature. As a corollary, we classify capillary graphs over domains that are globally Lipschitz epigraphs or slabs in a product space M N times mathbb R , where N has slow volume growth and non negative Ricci curvature, including the case M mathbb R 2, mathbb R 3 . A technical core of the paper is a new gradient estimate for positive CMC graphs on manifolds with Ricci lower bounds.


An Imitation Learning Approach to Unsupervised Parsing. Recently, there has been an increasing interest in unsupervised parsers that optimize semantically oriented objectives, typically using reinforcement learning. Unfortunately, the learned trees often do not match actual syntax trees well. Shen et al. (2018) propose a structured attention mechanism for language modeling (PRPN), which induces better syntactic structures but relies on ad hoc heuristics. Also, their model lacks interpretability as it is not grounded in parsing actions. In our work, we propose an imitation learning approach to unsupervised parsing, where we transfer the syntactic knowledge induced by the PRPN to a Tree LSTM model with discrete parsing actions. Its policy is then refined by Gumbel Softmax training towards a semantically oriented objective. We evaluate our approach on the All Natural Language Inference dataset and show that it achieves a new state of the art in terms of parsing F score, outperforming our base models, including the PRPN.


Reaction diffusion equations in the half space. We study reaction diffusion equations of various types in the half space. For bistable reactions with Dirichlet boundary conditions, we prove conditional uniqueness there is a unique nonzero bounded steady state which exceeds the bistable threshold on large balls. Moreover, solutions starting from sufficiently large initial data converge to this steady state as t to infty . For compactly supported initial data, the asymptotic speed of this propagation agrees with the unique speed c of the one dimensional traveling wave. We furthermore construct a traveling wave in the half plane of speed c . In parallel, we show analogous results for ignition reactions under both Dirichlet and Robin boundary conditions. Using our ignition construction, we obtain stronger results for monostable reactions with the same boundary conditions. For such reactions, we show in general that there is a unique nonzero bounded steady state. Furthermore, monostable reactions exhibit the hair trigger effect every solution with nontrivial initial data converges to this steady state as t to infty . Given compactly supported initial data, this disturbance propagates at a speed c equal to the minimal speed of one dimensional traveling waves. We also construct monostable traveling waves in the Dirichlet or Robin half plane with any speed c geq c .


On anisotropic diffusion equations for label propagation. In many problems in data classification one wishes to assign labels to points in a point cloud with a certain number of them being already correctly labeled. In this paper, we propose a microscopic ODE approach, in which information about correct labels is propagated to neighboring points. Its dynamics are based on alignment mechanisms, which are commonly used in large interacting agent systems in consensus formation. We derive the respective continuum description, which corresponds to an anisotropic diffusion equation with reaction term. Solutions of the continuum model on the bounded domain inherit certain properties of the underlying point cloud. We discuss these analytic properties and exemplify the results with micro and macroscopic simulations.


Parametrix problem for the Korteweg de Vries equation with steplike initial data. In this paper we study the asymptotics of the Korteweg de Vries (KdV) equation with steplike initial data, which leads to shock waves, in the middle region between the dispersive tail and the soliton region, as t rightarrow infty . In our previous work we have dealt with this question, but failed to obtain uniform estimates in x and t because of the previously unknown singular behaviour of the matrix model solution. The main goal of this paper is to close this gap. We present an alternative approach to the usual argument involving a small norm Riemann Hilbert (R H) problem, which is based instead on Fredholm index theory for singular integral operators. In particular, we avoid the construction of a global model matrix solution, which would be singular for arbitrary large x and t , and utilize only the symmetric model vector solution, which always exists and is unique.


Berry Esseen bounds and moderate deviations for the norm, entries and spectral radius of products of positive random matrices. Let (g n ) n geq 1 be a sequence of independent and identically distributed positive random d times d matrices and consider the matrix product G n g n ldots g 1 . Under suitable conditions, we establish the Berry Esseen bounds on the rate of convergence in the central limit theorem and moderate deviation expansions of Cram 'er type, for the matrix norm G n of G n , for its (i,j) th entry G n i,j , and the and for its spectral radius rho(G n) .


On the rate of convergence of iterated Bregman projections and of the alternating algorithm. We study the alternating algorithm for the computation of the metric projection onto the closed sum of two closed subspaces in uniformly convex and uniformly smooth Banach spaces. For Banach spaces which are convex and smooth of power type, we exhibit a condition which implies linear convergence of this method. We show these convergence results for iterates of Bregman projections onto closed linear subspaces. Using an intimate connection between the metric projection onto a closed linear subspace and the Bregman projection onto its annihilator, we deduce the convergence rate results for the alternating algorithm from the corresponding results for the iterated Bregman projection method.


On a theorem about Mosco convergence in Hadamard spaces. Let (f n),f be a sequence of proper closed convex functions defined on a Hadamard space. We show that the convergence of proximal mappings J n lambda x to J lambda x , under certain additional conditions, imply Mosco convergence of f n to f . This result is a converse to a theorem of Bacak about Mosco convergence in Hadamard spaces.


Global strong solutions to the inhomogeneous incompressible Navier Stokes system in the exterior of a cylinder. In this paper, the global strong axisymmetric solutions for the inhomogeneous incompressible Navier Stokes system are established in the exterior of a cylinder subject to the Dirichlet boundary conditions. Moreover, the vacuum is allowed in these solutions. One of the key ingredients of the analysis is to obtain the L 2 (s,T L infty ( Omega)) bound for the velocity field, where the axisymmetry of the solutions plays an important role.


On product one sequences over dihedral groups. Let G be a finite group. A sequence over G means a finite sequence of terms from G , where repetition is allowed and the order is disregarded. A product one sequence is a sequence whose elements can be ordered such that their product equals the identity element of the group. The set of all product one sequences over G (with concatenation of sequences as the operation) is a finitely generated C monoid. Product one sequences over dihedral groups have a variety of extremal properties. This article provides a detailed investigation, with methods from arithmetic combinatorics, of the arithmetic of the monoid of product one sequences over dihedral groups.


Leveraging User Access Patterns and Advanced Cyberinfrastructure to Accelerate Data Delivery from Shared use Scientific Observatories. With the growing number and increasing availability of shared use instruments and observatories, observational data is becoming an essential part of application workflows and contributor to scientific discoveries in a range of disciplines. However, the corresponding growth in the number of users accessing these facilities coupled with the expansion in the scale and variety of the data, is making it challenging for these facilities to ensure their data can be accessed, integrated, and analyzed in a timely manner, and is resulting significant demands on their cyberinfrastructure (CI). In this paper, we present the design of a push based data delivery framework that leverages emerging in network capabilities, along with data pre fetching techniques based on a hybrid data management model. Specifically, we analyze data access traces for two large scale observatories, Ocean Observatories Initiative (OOI) and Geodetic Facility for the Advancement of Geoscience (GAGE), to identify typical user access patterns and to develop a model that can be used for data pre fetching. Furthermore, we evaluate our data pre fetching model and the proposed framework using a simulation of the Virtual Data Collaboratory (VDC) platform that provides in network data staging and processing capabilities. The results demonstrate that the ability of the framework to significantly improve data delivery performance and reduce network traffic at the observatories' facilities.