Attention SLAM A Visual Monocular SLAM Learning from Human Gaze. This paper proposes a novel simultaneous localization and mapping (SLAM) approach, namely Attention SLAM, which simulates human navigation mode by combining a visual saliency model (SalNavNet) with traditional monocular visual SLAM. Most SLAM methods treat all the features extracted from the images as equal importance during the optimization process. However, the salient feature points in scenes have more significant influence during the human navigation process. Therefore, we first propose a visual saliency model called SalVavNet in which we introduce a correlation module and propose an adaptive Exponential Moving Average (EMA) module. These modules mitigate the center bias to enable the saliency maps generated by SalNavNet to pay more attention to the same salient object. Moreover, the saliency maps simulate the human behavior for the refinement of SLAM results. The feature points extracted from the salient regions have greater importance in optimization process. We add semantic saliency information to the Euroc dataset to generate an open source saliency SLAM dataset. Comprehensive test results prove that Attention SLAM outperforms benchmarks such as Direct Sparse Odometry (DSO), ORB SLAM, and Salient DSO in terms of efficiency, accuracy, and robustness in most test cases.


DyHGCN A Dynamic Heterogeneous Graph Convolutional Network to Learn Users' Dynamic Preferences for Information Diffusion Prediction. Information diffusion prediction is a fundamental task for understanding the information propagation process. It has wide applications in such as misinformation spreading prediction and malicious account detection. Previous works either concentrate on utilizing the context of a single diffusion sequence or using the social network among users for information diffusion prediction. However, the diffusion paths of different messages naturally constitute a dynamic diffusion graph. For one thing, previous works cannot jointly utilize both the social network and diffusion graph for prediction, which is insufficient to model the complexity of the diffusion process and results in unsatisfactory prediction performance. For another, they cannot learn users' dynamic preferences. Intuitively, users' preferences are changing as time goes on and users' personal preference determines whether the user will repost the information. Thus, it is beneficial to consider users' dynamic preferences in information diffusion prediction. In this paper, we propose a novel dynamic heterogeneous graph convolutional network (DyHGCN) to jointly learn the structural characteristics of the social graph and dynamic diffusion graph. Then, we encode the temporal information into the heterogeneous graph to learn the users' dynamic preferences. Finally, we apply multi head attention to capture the context dependency of the current diffusion path to facilitate the information diffusion prediction task. Experimental results show that DyHGCN significantly outperforms the state of the art models on three public datasets, which shows the effectiveness of the proposed model.


Classification of Polarimetric SAR Images Using Compact Convolutional Neural Networks. Classification of polarimetric synthetic aperture radar (PolSAR) images is an active research area with a major role in environmental applications. The traditional Machine Learning (ML) methods proposed in this domain generally focus on utilizing highly discriminative features to improve the classification performance, but this task is complicated by the well known "curse of dimensionality" phenomena. Other approaches based on deep Convolutional Neural Networks (CNNs) have certain limitations and drawbacks, such as high computational complexity, an unfeasibly large training set with ground truth labels, and special hardware requirements. In this work, to address the limitations of traditional ML and deep CNN based methods, a novel and systematic classification framework is proposed for the classification of PolSAR images, based on a compact and adaptive implementation of CNNs using a sliding window classification approach. The proposed approach has three advantages. First, there is no requirement for an extensive feature extraction process. Second, it is computationally efficient due to utilized compact configurations. In particular, the proposed compact and adaptive CNN model is designed to achieve the maximum classification accuracy with minimum training and computational complexity. This is of considerable importance considering the high costs involved in labelling in PolSAR classification. Finally, the proposed approach can perform classification using smaller window sizes than deep CNNs. Experimental evaluations have been performed over the most commonly used four benchmark PolSAR images AIRSAR L Band and RADARSAT 2 C Band data of San Francisco Bay and Flevoland areas. Accordingly, the best obtained overall accuracies range between 92.33 99.39 for these benchmark study sites.


A Closer Look at Linguistic Knowledge in Masked Language Models The Case of Relative Clauses in American English. Transformer based language models achieve high performance on various tasks, but we still lack understanding of the kind of linguistic knowledge they learn and rely on. We evaluate three models (BERT, RoBERTa, and ALBERT), testing their grammatical and semantic knowledge by sentence level probing, diagnostic cases, and masked prediction tasks. We focus on relative clauses (in American English) as a complex phenomenon needing contextual information and antecedent identification to be resolved. Based on a naturalistic dataset, probing shows that all three models indeed capture linguistic knowledge about grammaticality, achieving high performance. Evaluation on diagnostic cases and masked prediction tasks considering fine grained linguistic knowledge, however, shows pronounced model specific weaknesses especially on semantic knowledge, strongly impacting models' performance. Our results highlight the importance of (a)model comparison in evaluation task and (b) building up claims of model performance and the linguistic knowledge they capture beyond purely probing based evaluations.


Explicit Regularization of Stochastic Gradient Methods through Duality. We consider stochastic gradient methods under the interpolation regime where a perfect fit can be obtained (minimum loss at each observation). While previous work highlighted the implicit regularization of such algorithms, we consider an explicit regularization framework as a minimum Bregman divergence convex feasibility problem. Using convex duality, we propose randomized Dykstra style algorithms based on randomized dual coordinate ascent. For non accelerated coordinate descent, we obtain an algorithm which bears strong similarities with (non averaged) stochastic mirror descent on specific functions, as it is is equivalent for quadratic objectives, and equivalent in the early iterations for more general objectives. It comes with the benefit of an explicit convergence theorem to a minimum norm solution. For accelerated coordinate descent, we obtain a new algorithm that has better convergence properties than existing stochastic gradient methods in the interpolating regime. This leads to accelerated versions of the perceptron for generic ell p norm regularizers, which we illustrate in experiments.


The Model Counting Competition 2020. Many computational problems in modern society account to probabilistic reasoning, statistics, and combinatorics. A variety of these real world questions can be solved by representing the question in (Boolean) formulas and associating the number of models of the formula directly with the answer to the question. Since there has been an increasing interest in practical problem solving for model counting over the last years, the Model Counting (MC) Competition was conceived in fall 2019. The competition aims to foster applications, identify new challenging benchmarks, and to promote new solvers and improve established solvers for the model counting problem and versions thereof. We hope that the results can be a good indicator of the current feasibility of model counting and spark many new applications. In this paper, we report on details of the Model Counting Competition 2020, about carrying out the competition, and the results. The competition encompassed three versions of the model counting problem, which we evaluated in separate tracks. The first track featured the model counting problem (MC), which asks for the number of models of a given Boolean formula. On the second track, we challenged developers to submit programs that solve the weighted model counting problem (WMC). The last track was dedicated to projected model counting (PMC). In total, we received a surprising number of 9 solvers in 34 versions from 8 groups.


Electron extraction efficiency study for dual phase xenon dark matter experiments. Dual phase xenon detectors are widely used in dark matter direct detection experiments, and have demonstrated the highest sensitivities to a variety of dark matter interactions. However, a key component of the dual phase detector technology the efficiency of charge extraction from liquid xenon into gas has not been well characterized. In this paper, we report a new measurement of the electron extraction efficiency (EEE) in a small xenon detector using two mono energetic decay features of 37 Ar. By achieving stable operation at very high voltages, we measured the EEE values at the highest extraction electric field strength reported to date. For the first time, an apparent saturation of the EEE is observed over a large range of electric field between 7.5 kV cm and 10.4 kV cm extraction field in the liquid xenon the EEE stays stable at the level of 1 (kV cm) 1 . In the context of electron transport models developed for xenon, we discuss how the observed saturation may help calibrate this relative EEE measurement to the absolute EEE values. In addition, we present the implications of this result not only to current and future xenon based dark matter searches, but also to xenon based searches for coherent elastic neutrino nucleus scatters.


Experimental Clock Calibration on a Crystal Free Mote on a Chip. The elimination of the off chip frequency reference, typically a crystal oscillator, would bring important benefits in terms of size, price and energy efficiency to IEEE802.15.4 compliant radios and systems on chip. The stability of on chip oscillators is orders of magnitude worse than that of a crystal. It is known that as the temperature changes, they can drift more than 50 ppm deg C. This paper presents the result of an extensive experimental study. First, we propose mechanisms for crystal free radios to be able to track an IEEE802.15.4 join proxy, calibrate the on chip oscillators and maintain calibration against temperature changes. Then, we implement the resulting algorithms on a crystal free platform and present the results of an experimental validation. We show that our approach is able to track a crystal based IEEE802.15.4 compliant join proxy and maintain the requested radio frequency stability of 40 ppm, even when subject to temperature variation of 2 deg C min.


Efficient computation of mean reverting portfolios using cyclical coordinate descent. The econometric challenge of finding sparse mean reverting portfolios based on a subset of a large number of assets is well known. Many current state of the art approaches fall into the field of co integration theory, where the problem is phrased in terms of an eigenvector problem with sparsity constraint. Although a number of approximate solutions have been proposed to solve this NP hard problem, all are based on relatively simple models and are limited in their scalability. In this paper we leverage information obtained from a heterogeneous simultaneous graphical dynamic linear model (H SGDLM) and propose a novel formulation of the mean reversion problem, which is phrased in terms of a quasi convex minimisation with a normalisation constraint. This new formulation allows us to employ a cyclical coordinate descent algorithm for efficiently computing an exact sparse solution, even in a large universe of assets, while the use of H SGDLM data allows us to easily control the required level of sparsity. We demonstrate the flexibility, speed and scalability of the proposed approach on S P 500 , FX and ETF futures data.


Vertex operator superalgebras and 16 fold way. Let V be a vertex operator superalgebra with the natural order 2 automorphism sigma . Under suitable conditions on V , the sigma fixed subspace V bar 0 is a vertex operator algebra and the category C V bar 0 of V bar 0 modules is modular tensor category. In this paper, we prove that C V bar 0 is a fermionic modular tensor category and the M "uger centralizer C V bar 0 0 of the fermion in C V bar 0 is generated by the irreducible V bar 0 submodules of the V modules. In particular, C V bar 0 0 is a super modular tensor category and C V bar 0 is a minimal modular extension of C V bar 0 0 . We provide a construction of a vertex operator V l for each positive integer l such that C V l bar 0 is minimal modular extension of C V bar 0 0 . We prove that these modular tensor categories C V l bar 0 are uniquely determined, up to equivalence, by the congruence class of l modulo 16.


Multimode interference induced optical nonreciprocity and routing in an optical microcavity. Optical nonreciprocity and routing using optocal microcavities draw much atttention in recent years. Here, we report the results of the study on the nonreciprocity and routing using optomechanical multimode interference in an optical microcavity. The optomechanical system used here possesses multi optical modes and a mechanical mode. Optomechanical induced transparency and absorption, appear in the system due to the interference between different paths. The system can present significant nonreciprocity and routing properties when appropriate parameters of the system are set. We design quantum devices, such as diode, circulator and router, which are important applications. Our work shows that optomechanical multimode system can be used as a promising platform for buliding photonic and quantum network.


Identifying Usability Issues of Software Analytics Applications in Immersive Augmented Reality. Software analytics in augmented reality (AR) is said to have great potential. One reason why this potential is not yet fully exploited may be usability problems of the AR user interfaces. We present an iterative and qualitative usability evaluation with 15 subjects of a state of the art application for software analytics in AR. We could identify and resolve numerous usability issues. Most of them were caused by applying conventional user interface elements, such as dialog windows, buttons, and scrollbars. The used city visualization, however, did not cause any usability issues. Therefore, we argue that future work should focus on making conventional user interface elements in AR obsolete by integrating their functionality into the immersive visualization.


A Dynamic Holding Approach to Stabilizing a Bus Line Based on the Q learning Algorithm with Multistage Look ahead. The unreliable service and the unstable operation of a high frequency bus line are shown as bus bunching and the uneven distribution of headways along the bus line. Although many control strategies, such as the static and dynamic holding strategies, have been proposed to solve the above problems, many of them take on some oversimplified assumptions about the real bus line operation. So it is hard for them to continuously adapt to the evolving complex system. In view of this dynamic setting, we present an adaptive holding method which combines the classic approximate dynamic programming (ADP) with the multi stage look ahead mechanism. The holding time, that is the only control means used in this study, will be determined by estimating its impact on the operation stability of the bus line system in the remained observation period. The multi stage look ahead mechanism introduced into the classic Q learning algorithm of the ADP model makes the algorithm get through its earlier unstable phase more quickly and easily. During the implementation of the new holding approach, the past experiences of holding operations can be cumulated effectively into an artificial neural network used to approximate the unavailable Q factor. The use of a detailed simulation system in the new approach makes it possible to take into accounts most of the possible causes of instability. The numerical experiments show that the new holding approach can stabilize the system by producing evenly distributed headway and removing bus bunching thoroughly. Comparing with the terminal station holding strategies, the new method brings a more reliable bus line with shorter waiting times for passengers.


The group C 4 p times C q is a DCI group. We prove that the group C p 4 times C q is a DCI group for distinct primes p and q , that is, two Cayley digraphs over C p 4 times C q are isomorphic if and only if their connection sets are conjugate by a group automorphism.


Modelling Semantic Categories using Conceptual Neighborhood. While many methods for learning vector space embeddings have been proposed in the field of Natural Language Processing, these methods typically do not distinguish between categories and individuals. Intuitively, if individuals are represented as vectors, we can think of categories as (soft) regions in the embedding space. Unfortunately, meaningful regions can be difficult to estimate, especially since we often have few examples of individuals that belong to a given category. To address this issue, we rely on the fact that different categories are often highly interdependent. In particular, categories often have conceptual neighbors, which are disjoint from but closely related to the given category (e.g. fruit and vegetable). Our hypothesis is that more accurate category representations can be learned by relying on the assumption that the regions representing such conceptual neighbors should be adjacent in the embedding space. We propose a simple method for identifying conceptual neighbors and then show that incorporating these conceptual neighbors indeed leads to more accurate region based representations.


Query Rewriting On Path Views Without Integrity Constraints. A view with a binding pattern is a parameterised query on a database. Such views are used, e.g., to model Web services. To answer a query on such views, one has to orchestrate the views together in execution plans. The goal is usually to find equivalent rewritings, which deliver precisely the same results as the query on all databases. However, such rewritings are usually possible only in the presence of integrity constraints and not all databases have such constraints. In this paper, we describe a class of plans that give practical guarantees about their result even if there are no integrity constraints. We provide a characterisation of such plans and a complete and correct algorithm to enumerate them. Finally, we show that our method can find plans on real world Web Services.


Fine Resolution of k transversal Cones. Tougeron's implicit function theorem and Hensel's lemma are well known representatives concerning 2k approximation k nondegeneracy implying existence of solutions with identity of order k. This note aims to extend this principle to equations G z 0 in Banach spaces, using k transversality concepts, which may geometrically be interpreted as generalized cones spanned by submanifolds, each characterized by a certain expansion rate. The number of manifolds in the cone, as well as their expansion rates, are recursively increased until an appropriate desingularization of the cone is build up with linearization expressed by first k 1 derivatives of the singular operator at the base point. Along these lines, a well defined submersion is constructed in the cone with uniformly bounded inverse when approaching the singularity. The techniques are restricted to curves, possibly touching by high order the singular locus of G, but ultimately traversing it, in this way defining an isolated singularity of the operator family given by the linearization along the curve. The fine resolution of the cone by the manifolds represents an improvement compared to measuring the variation of the nonlinear operator exclusively by the overall behaviour of the determinant. In case of finite dimensions, each half cone is characterized by a constant topological degree that can be used to investigate a solution curve in general position with respect to secondary bifurcation. The core of all considerations is given by some characteristic patterns, valid in the system of undetermined coefficients that allow for detailed analysis of the power series resulting from plugging the power series of the ansatz into the power series of the nonlinear operator.


Ultra fast quantum well infared photodetectors operating at 10 mu m with flat response up to 70GHz at room temperature. III V semiconductor mid infrared photodetectors based on intersubband transitions hold a great potential for ultra high speed operation up to several hundreds of GHz. In this work we exploit a 350nm thick GaAs Al0.2Ga0.8As multi quantum well heterostructure to demonstrate heterodyne detection at 10um wavelength with a nearly flat frequency response up to 70GHz at room temperature, solely limited by the measurement system bandwidth. This is the broadest RF bandwidth reported to date for a quantum well mid infrared photodetector. Responsivities of 0.15A W and 1.5A W are obtained at 300K and 77K respectively. To allow ultrafast operation and illumination at normal incidence, the detector consists of a 50Ohm coplanar waveguide, monolithically integrated with a 2D array of sub wavelength antennas, electrically interconnected by suspended wires. With this device architecture we obtain a parasitic capacitance of 30fF, corresponding to the static capacitance of the antennas, yielding a RC limited 3dB cutoff frequency 150GHz at 300K, extracted with a small signal equivalent circuit model. Using this model, we quantitively reproduce the detector frequency response and find intrinsic roll off time constants as low as 1ps at room temperature.


An Ensemble Method for Producing Word Representations focusing on the Greek Language. In this paper we present a new ensemble method, Continuous Bag of Skip grams (CBOS), that produces high quality word representations putting emphasis on the modern Greek language. The CBOS method combines the pioneering approaches for learning word representations Continuous Bag of Words (CBOW) and Continuous Skip gram. These methods are compared through intrinsic and extrinsic evaluation tasks on three different sources of data the English Wikipedia corpus, the modern Greek Wikipedia corpus, and the modern Greek Web Content corpus. By comparing these methods across different tasks and datasets, it is evident that the CBOS method achieves state of the art performance.


Modality Transferable Emotion Embeddings for Low Resource Multimodal Emotion Recognition. Despite the recent achievements made in the multi modal emotion recognition task, two problems still exist and have not been well investigated 1) the relationship between different emotion categories are not utilized, which leads to sub optimal performance and 2) current models fail to cope well with low resource emotions, especially for unseen emotions. In this paper, we propose a modality transferable model with emotion embeddings to tackle the aforementioned issues. We use pre trained word embeddings to represent emotion categories for textual data. Then, two mapping functions are learned to transfer these embeddings into visual and acoustic spaces. For each modality, the model calculates the representation distance between the input sequence and target emotions and makes predictions based on the distances. By doing so, our model can directly adapt to the unseen emotions in any modality since we have their pre trained embeddings and modality mapping functions. Experiments show that our model achieves state of the art performance on most of the emotion categories. In addition, our model also outperforms existing baselines in the zero shot and few shot scenarios for unseen emotions.


Viscosity of the magnetized strongly coupled one component plasma. The viscosity tensor of the magnetized one component plasma, consisting of five independent shear viscosity coefficients, a bulk viscosity coefficient, and a cross coefficient, is computed using equilibrium molecular dynamics simulations and the Green Kubo relations. A broad range of Coulomb coupling and magnetization strength conditions are studied. Magnetization is found to strongly influence the shear viscosity coefficients when the gyrofrequency exceeds the Coulomb collision frequency. Three regimes are identified as the Coulomb coupling strength and magnetization strength are varied. The Green Kubo relations are used to separate kinetic and potential energy contributions to each viscosity coefficient, showing how each contribution depends upon the magnetization strength. The shear viscosity coefficient associated with the component of the stress tensor parallel to the magnetic field, and the two coefficients associated with the component perpendicular to the magnetic field, are all found to merge to a common value at strong Coulomb coupling.


Cell damage and mitigation in Swiss albino mice experiment and modelling. Chronic exposure to inorganic arsenic is a potential cause of carcinogenesis. It elicits its potential by generation of ROS, leading to DNA, protein and lipid damage. Therefore, the deleterious effect of arsenic can be mitigated by quenching ROS using antioxidants. There is a homology between the protein coding regions of mice and human. Effect of these alterations in human can be mimicked in mice. Therefore to understand the underlying mechanism of arsenic toxicity and its amelioration by black tea, studies have been conducted in mice model. Long term exposure to iAs leads to tumour growth, which has been found to be alleviated by black tea. Observations reveal that black tea has two salutary effects on the growth of tumour the rate of growth of damaged cells was appreciably reduced and an early saturation of the level of damage is achieved. To take the experimental findings further, the experimental data have been modelled with simple dynamical equations. The curves obtained from textit in vivo studies have been fitted with the data obtained from the model. The corresponding steady states and their stabilities are analyzed.


A gaze driven fast forward method for first person videos. The growing data sharing and life logging cultures are driving an unprecedented increase in the amount of unedited First Person Videos. In this paper, we address the problem of accessing relevant information in First Person Videos by creating an accelerated version of the input video and emphasizing the important moments to the recorder. Our method is based on an attention model driven by gaze and visual scene analysis that provides a semantic score of each frame of the input video. We performed several experimental evaluations on publicly available First Person Videos datasets. The results show that our methodology can fast forward videos emphasizing moments when the recorder visually interact with scene components while not including monotonous clips.


Rational Approximations via Hankel Determinants. Define the monomials e n(x) x n and let L be a linear functional. In this paper we describe a method which, under specified conditions, produces approximations for the value L(e 0 ) in terms of Hankel determinants constructed from the values L(e 1 ) , L(e 2 ) , . . . . Many constants of mathematical interest can be expressed as the values of integrals. Examples include the Euler Mascheroni constant gamma , the Euler Gompertz constant delta , and the Riemann zeta constants zeta(k) for k ge 2 . In many cases we can use the integral representation for the constant to construct a linear functional for which L(e 0) equals the given constant and L(e 1) , L(e 2) , . . . are rational numbers. In this case, under the specified conditions, we obtain rational approximations for our constant. In particular, we execute this procedure for the previously mentioned constants gamma , delta , and zeta(k) . We note that our approximations are not strong enough to study the arithmetic properties of these constants.


Fusion vectors Embedding Graph Fusions for Efficient Unsupervised Rank Aggregation. The vast increase in amount and complexity of digital content led to a wide interest in ad hoc retrieval systems in recent years. Complementary, the existence of heterogeneous data sources and retrieval models stimulated the proliferation of increasingly ingenious and effective rank aggregation functions. Although recently proposed rank aggregation functions are promising with respect to effectiveness, existing proposals in the area usually overlook efficiency aspects. We propose an innovative rank aggregation function that is unsupervised, intrinsically multimodal, and targeted for fast retrieval and top effectiveness performance. We introduce the concepts of embedding and indexing of graph based rank aggregation representation models, and their application for search tasks. Embedding formulations are also proposed for graph based rank representations. We introduce the concept of fusion vectors, a late fusion representation of objects based on ranks, from which an intrinsically rank aggregation retrieval model is defined. Next, we present an approach for fast retrieval based on fusion vectors, thus promoting an efficient rank aggregation system. Our method presents top effectiveness performance among state of the art related work, while bringing novel aspects of multimodality and effectiveness. Consistent speedups are achieved against the recent baselines in all datasets considered.


Ramsey upper density of infinite graph factors. The study of upper density problems on Ramsey theory was initiated by Erd H o s and Galvin in 1993. In this paper we are concerned with the following problem given a fixed finite graph F , what is the largest value of lambda such that every 2 edge coloring of the complete graph on mathbb N contains a monochromatic infinite F factor whose vertex set has upper density at least lambda ? Here we prove a new lower bound for this problem. For some choices of F , including cliques and odd cycles, this new bound is sharp, as it matches an older upper bound. For the particular case where F is a triangle, we also give an explicit lower bound of 1 frac 1 sqrt 7 0.62203 dots , improving the previous best bound of 3 5.


Reinforced Multi Teacher Selection for Knowledge Distillation. In natural language processing (NLP) tasks, slow inference speed and huge footprints in GPU usage remain the bottleneck of applying pre trained deep models in production. As a popular method for model compression, knowledge distillation transfers knowledge from one or multiple large (teacher) models to a small (student) model. When multiple teacher models are available in distillation, the state of the art methods assign a fixed weight to a teacher model in the whole distillation. Furthermore, most of the existing methods allocate an equal weight to every teacher model. In this paper, we observe that, due to the complexity of training examples and the differences in student model capability, learning differentially from teacher models can lead to better performance of student models distilled. We systematically develop a reinforced method to dynamically assign weights to teacher models for different training instances and optimize the performance of student model. Our extensive experimental results on several NLP tasks clearly verify the feasibility and effectiveness of our approach.


Sphere tangencies, line incidences, and Lie's line sphere correspondence. Two spheres with centers p and q and signed radii r and s are said to be in contact if p q 2 (r s) 2 . Using Lie's line sphere correspondence, we show that if F is a field in which 1 is not a square, then there is an isomorphism between the set of spheres in F 3 and the set of lines in a suitably constructed Heisenberg group that is embedded in (F i ) 3 under this isomorphism, contact between spheres translates to incidences between lines. In the past decade there has been significant progress in understanding the incidence geometry of lines in three space. The contact incidence isomorphism allows us to translate statements about the incidence geometry of lines into statements about the contact geometry of spheres. This leads to new bounds for Erd H o s' repeated distances problem in F 3 , and improved bounds for the number of point sphere incidences in three dimensions. These new bounds are sharp for certain ranges of parameters.


Spike Timing Dependent Plasticity Effect on the Temporal Patterning of Neural Synchronization. Neural synchrony in the brain at rest is usually variable and intermittent, thus intervals of predominantly synchronized activity are interrupted by intervals of desynchronized activity. Prior studies suggested that this temporal structure of the weakly synchronous activity might be functionally significant many short desynchronizations may be functionally different from few long desynchronizations even if the average synchrony level is the same. In this study, we used computational neuroscience methods to investigate the effects of spike timing dependent plasticity (STDP) on the temporal patterns of synchronization in a simple model. We employed a small network of conductance based model neurons that were connected via excitatory plastic synapses. The dynamics of this network was subjected to the time series analysis methods used in prior experimental studies. We found that STDP could alter the synchronized dynamics in the network in several ways, depending on the time scale that plasticity acts on. However, in general, the action of STDP in the simple network considered here is to promote dynamics with short desynchronizations (i.e. dynamics reminiscent of that observed in experimental studies). Complex interplay of the cellular and synaptic dynamics may lead to the activity dependent adjustment of synaptic strength in such a way as to facilitate experimentally observed short desynchronizations in the intermittently synchronized neural activity.


Introducing Network Coding to RPL The Chained Secure Mode (CSM). The current standard of Routing Protocol for Low Power and Lossy Networks (RPL) incorporates three modes of security the Unsecured Mode (UM), Preinstalled Secure Mode (PSM), and the Authenticated Secure Mode (ASM). While the PSM and ASM are intended to protect against external routing attacks and some replay attacks (through an optional replay protection mechanism), recent research showed that RPL in PSM is still vulnerable to many routing attacks, both internal and external. In this paper, we propose a novel secure mode for RPL, the Chained Secure Mode (CSM), based on the concept of intraflow Network Coding. The main goal of CSM is to enhance RPL resilience against replay attacks, with the ability to mitigate some of them. The security and performance of a proof of concept prototype of CSM were evaluated and compared against RPL in UM and PSM (with and without the optional replay protection) in the presence of Neighbor attack as an example. It showed that CSM has better performance and more enhanced security compared to both the UM and PSM with the replay protection. On the other hand, it showed a need for a proper recovery mechanism for the case of losing a control message.


How Do You Act? An Empirical Study to Understand Behavior of Deep Reinforcement Learning Agents. The demand for more transparency of decision making processes of deep reinforcement learning agents is greater than ever, due to their increased use in safety critical and ethically challenging domains such as autonomous driving. In this empirical study, we address this lack of transparency following an idea that is inspired by research in the field of neuroscience. We characterize the learned representations of an agent's policy network through its activation space and perform partial network ablations to compare the representations of the healthy and the intentionally damaged networks. We show that the healthy agent's behavior is characterized by a distinct correlation pattern between the network's layer activation and the performed actions during an episode and that network ablations, which cause a strong change of this pattern, lead to the agent failing its trained control task. Furthermore, the learned representation of the healthy agent is characterized by a distinct pattern in its activation space reflecting its different behavioral stages during an episode, which again, when distorted by network ablations, leads to the agent failing its trained control task. Concludingly, we argue in favor of a new perspective on artificial neural networks as objects of empirical investigations, just as biological neural systems in neuroscientific studies, paving the way towards a new standard of scientific falsifiability with respect to research on transparency and interpretability of artificial neural networks.


Neural trust region algorithm for unconstrained optimization (Part 1). In this paper (part 1), we describe a derivative free trust region method for solving unconstrained optimization problems. We will discuss a method when we relax the model order assumption and use artificial neural network techniques to build a computationally relatively inexpensive model. We directly find an estimate of the objective function minimizer without explicitly constructing a model function. Therefore, we need to have the neural network model derivatives, which can be obtained simply through a back propagation process.


A finite element model updating method based on global optimization. Finite element model updating of a structure made of linear elastic materials is based on the solution of a minimization problem. The goal is to find some unknown parameters of the finite element model (elastic moduli, mass densities, constraints and boundary conditions) that minimize an objective function which evaluates the discrepancy between experimental and numerical dynamic properties. The objective function depends nonlinearly on the parameters and may have multiple local minimum points. This paper presents a numerical method able to find a global minimum point and assess its reliability. The numerical method has been tested on two simulated examples a masonry tower and a domed temple and validated via a generic genetic algorithm and a global sensitivity analysis tool. A real case study monitored under operational conditions has also been addressed, and the structure's experimental modal properties have been used in the model updating procedure to estimate the mechanical properties of its constituent materials.


Simulation of scour around arbitrary offshore foundations based on the Volume of Fluid method combined with a Bingham model. This paper presents a method for the simulation of scour around arbitrary offshore structures. It is based on the solution of the Reynolds Averaged Navier Stokes equations implemented in the OpenFOAM framework. The sediment is simulated with the help of a Bingham model, which basically models a solid sediment behavior by introducing a very high viscosity. The relative pressure used by the Bingham model is estimated with a new approach based on the solution of a Poisson equation. The position of the sediment surface is calculated with the Volume of Fluid approach using a high resolution scheme. To keep the typical wall characteristics without demanding a fine grid, the common wall functions are transferred to the domain internal sediment walls. Furthermore, additional modifications are applied to model a solid sediment wall inside the solution domain. The new internal wall function implementation is validated with a 2D test case. The results show a very good agreement to common wall functions and a significant improvement compared to its negligence. Furthermore the solver is used to simulate the scour downstream of an apron and the scour around a vertical cylinder in current. The results are compared to experiments presented in the literature and show good agreement. The applicability onto arbitrary structures is demonstrated by applying the solver onto a vertical cylinder with a mudplate. The current development state is able to resolve all important physical flow and scour phenomena. The results also unveil that modeling of the suspension and the treatment of the internal wall need additional attention.


Revisiting the role of intermittent heat transport towards Reynolds stress anisotropy in convective turbulence. Thermal plumes are the energy containing eddy motions that carry heat and momentum in a convective boundary layer. The detailed understanding of their structure is of fundamental interest for a range of applications, from wall bounded engineering flows to quantifying surface atmosphere flux exchanges. We address the aspect of Reynolds stress anisotropy associated with the intermittent nature of heat transport in thermal plumes by performing an invariant analysis of the Reynolds stress tensor in an unstable atmospheric surface layer flow, using a field experimental dataset. Given the intermittent and asymmetric nature of the turbulent heat flux, we formulate this problem in an event based framework. In this approach, we provide structural descriptions of warm updraft and cold downdraft events and investigate the degree of isotropy of the Reynolds stress tensor within these events of different sizes. We discover that only a subset of these events are associated with the least anisotropic turbulence in highly convective conditions. Additionally, intermittent large heat flux events are found to contribute substantially to turbulence anisotropy under unstable stratification. Moreover, we find that the sizes related to the maximum value of the degree of isotropy do not correspond to the peak positions of the heat flux distributions. This is because, the vertical velocity fluctuations pertaining to the sizes associated with the maximum heat flux, transport significant amount of streamwise momentum. A preliminary investigation shows that the sizes of the least anisotropic events probably scale with a mixed length scale ( z 0.5 lambda 0.5 , where z is the measurement height and lambda is the large eddy length scale).


Spanning Triangle trees and Flows of Graphs. In this paper we study the flow property of graphs containing a spanning triangle tree. Our main results provide a structure characterization of graphs with a spanning triangle tree admitting a nowhere zero 3 flow. All these graphs without nowhere zero 3 flows are constructed from K 4 by a so called bull growing operation. This generalizes a result of Fan et al. in 2008 on triangularly connected graphs and particularly shows that every 4 edge connected graph with a spanning triangle tree has a nowhere zero 3 flow. A well known classical theorem of Jaeger in 1979 shows that every graph with two edge disjoint spanning trees admits a nowhere zero 4 flow. We prove that every graph with two edge disjoint spanning triangle trees has a flow strictly less than 3 .


Scalar curvature and harmonic one forms on three manifolds with boundary. For a homotopically energy minimizing map u N 3 to S 1 on a compact, oriented 3 manifold N with boundary, we establish an identity relating the average Euler characteristic of the level sets u 1 theta to the scalar curvature of N and the mean curvature of the boundary partial N . As an application, we obtain some natural geometric estimates for the Thurston norm on 3 manifolds with boundary, generalizing results of Kronheimer Mrowka and the second named author from the closed setting. By combining these techniques with results from minimal surface theory, we obtain moreover a characterization of the Thurston norm via scalar curvature and the harmonic norm for general closed, oriented three manifolds, extending Kronheimer and Mrowka's characterization for irreducible manifolds to arbitrary topologies.


Fourier Mukai Transforms, Euler Green Currents, and K Stability. We provide an analog of the Hilbert Chow morphism for generalized discriminants.


AdaLead A simple and robust adaptive greedy search algorithm for sequence design. Efficient design of biological sequences will have a great impact across many industrial and healthcare domains. However, discovering improved sequences requires solving a difficult optimization problem. Traditionally, this challenge was approached by biologists through a model free method known as "directed evolution", the iterative process of random mutation and selection. As the ability to build models that capture the sequence to function map improves, such models can be used as oracles to screen sequences before running experiments. In recent years, interest in better algorithms that effectively use such oracles to outperform model free approaches has intensified. These span from approaches based on Bayesian Optimization, to regularized generative models and adaptations of reinforcement learning. In this work, we implement an open source Fitness Landscape EXploration Sandbox (FLEXS github.com samsinai FLEXS) environment to test and evaluate these algorithms based on their optimality, consistency, and robustness. Using FLEXS, we develop an easy to implement, scalable, and robust evolutionary greedy algorithm (AdaLead). Despite its simplicity, we show that AdaLead is a remarkably strong benchmark that out competes more complex state of the art approaches in a variety of biologically motivated sequence design challenges.


PLOP Learning without Forgetting for Continual Semantic Segmentation. Deep learning approaches are nowadays ubiquitously used to tackle computer vision tasks such as semantic segmentation, requiring large datasets and substantial computational power. Continual learning for semantic segmentation (CSS) is an emerging trend that consists in updating an old model by sequentially adding new classes. However, continual learning methods are usually prone to catastrophic forgetting. This issue is further aggravated in CSS where, at each step, old classes from previous iterations are collapsed into the background. In this paper, we propose Local POD, a multi scale pooling distillation scheme that preserves long and short range spatial relationships at feature level. Furthermore, we design an entropy based pseudo labelling of the background w.r.t. classes predicted by the old model to deal with background shift and avoid catastrophic forgetting of the old classes. Our approach, called PLOP, significantly outperforms state of the art methods in existing CSS scenarios, as well as in newly proposed challenging benchmarks.


The branching ratio of intercombination A 1 Sigma sim b 3 Pi to a 3 Sigma X 1 Sigma transitions in the RbCs molecule measurements and calculations. We observed the A 1 Sigma sim b 3 Pi to a 3 Sigma X 1 Sigma laser induced fluorescence (LIF) spectra of the RbCs molecule excited from the ground X 1 Sigma state by the Ti Sapphire laser. The LIF radiation from the common perturbed levels of the singlet triplet A sim b complex was recorded by the Fourier transform (FT) spectrometer with the instrumental resolution of 0.03 cm 1 . The relative intensity distribution in the rotationally resolved A sim b to a 3 Sigma (v a) X 1 Sigma (v X) progressions was measured, and their branching ratio was found to be about of 1 div 5 times 10 4 in the bound region of the a 3 Sigma and X 1 Sigma states. The experiment was complemented with the scalar and full relativistic calculations of the A b X a transition dipole moments (TDMs) as functions of internuclear distance. The relative systematic error in the resulting emph ab initio TDM functions evaluated for the strong A X transition was estimated as few percent in the energy region, where the experimental LIF intensities are relevant. The relative spectral sensitivity of the FT registration system, operated with the InGaAs diode detector and CaF beam splitter, was calibrated in the range 6 500,12 000 cm 1 by a comparison of experimental intensities in the long A sim b to X(v X) LIF progressions of the K 2 and KCs molecules with their theoretical counterparts evaluated using the emph ab initio A X TDMs. Both experimental and theoretical transition probabilities can be employed to improve the stimulated Raman adiabatic passage process, a to A sim b to X , which is exploited for a laser assembling of ultracold RbCs molecules.


Method of fundamental solutions for the problem of doubly periodic potential flow. In this paper, we propose a method of fundamental solutions for the problem of two dimensional potential flow in a doubly periodic domain. The solution involves a doubly periodic function, to which it is difficult to give an approximation by the conventional method of fundamental solutions. We propose to approximate it by a linear combination of the periodic fundamental solutions, that is, complex logarithmic potential with sources in a doubly periodic array constructed using the theta functions. Numerical examples show the effectiveness of our method.


Spatial Temporal Fusion Graph Neural Networks for Traffic Flow Forecasting. Spatial temporal data forecasting of traffic flow is a challenging task because of complicated spatial dependencies and dynamical trends of temporal pattern between different roads. Existing frameworks typically utilize given spatial adjacency graph and sophisticated mechanisms for modeling spatial and temporal correlations. However, limited representations of given spatial graph structure with incomplete adjacent connections may restrict effective spatial temporal dependencies learning of those models. To overcome those limitations, our paper proposes Spatial Temporal Fusion Graph Neural Networks (STFGNN) for traffic flow forecasting. SFTGNN could effectively learn hidden spatial temporal dependencies by a novel fusion operation of various spatial and temporal graphs, which is generated by a data driven method. Meanwhile, by integrating this fusion graph module and a novel gated convolution module into a unified layer, SFTGNN could handle long sequences. Experimental results on several public traffic datasets demonstrate that our method achieves state of the art performance consistently than other baselines.


Effects of perturbation order and basis set on alchemical predictions. Alchemical perturbation density functional theory has been shown to be an efficient and computationally inexpensive way to explore chemical compound space. We investigate approximations made, in terms of atomic basis sets and perturbation order,introduce an electron density based estimate of errors of the alchemical prediction, and propose a correction for effects due to basis set incompleteness. Our numerical analysis of potential energy estimates, and resulting binding curves, is based on CCSD reference results, and is limited to all neutral diatomics with 14 electrons (AlH ... N 2 ). The method predicts binding energy, equilibrium distance, and vibrational frequencies of neighbouring out of sample diatomics with near CCSD quality using perturbations up to 5 th order. We also discuss simultaneous alchemical mutations at multiple sites in benzene.


New Invariants for Permutations, Orders and Graphs. We study the symmetric function and polynomial combinatorial invariants of Hopf algebras of permutations, posets and graphs. We investigate their properties and the relations among them. In particular, we show that the chromatic symmetric function and many other invariants have a property we call positively h alternating. This property of positively h alternating leads to Schur positivity and e positivity when applying the operator nabla at q 1 . We conclude by showing that the invariants we consider can be expressed as scheduling problems.


Inexact Methods for Sequential Fully Implicit (SFI) Reservoir Simulation. The sequential fully implicit (SFI) scheme was introduced (Jenny et al. 2006) for solving coupled flow and transport problems. Each time step for SFI consists of an outer loop, in which there are inner Newton loops to implicitly and sequentially solve the pressure and transport sub problems. In standard SFI, the sub problems are usually solved with tight tolerances at every outer iteration. This can result in wasted computations that contribute little progress towards the coupled solution. The issue is known as over solving'. Our objective is to minimize the cost of inner solvers while maintaining the convergence rate of SFI. We first extended a nonlinear acceleration (NA) framework (Jiang and Tchelepi 2019) to multi component compositional models, for ensuring robust outer loop convergence. We then developed inexact type methods that alleviate over solving'. It is found that there is no need for one sub problem to strive for perfection, while the coupled (outer) residual remains high due to the other sub problem. The new SFI solver was tested using several complex cases. The problems involve multi phase and EoS based compositional fluid systems. We compared different strategies such as fixed relaxations on absolute and relative tolerances for the inner solvers, as well as an adaptive approach. The results show that the basic SFI method is quite inefficient. Away from a coupled solution, additional accuracy achieved in inner solvers is wasted, contributing to little or no reduction of the overall outer residual. By comparison, the adaptive inexact method provides relative tolerances adequate for the current convergence state of the sub problems. We show across a wide range of flow conditions that the new solver can effectively resolve the over solving issue, and thus greatly improve the overall efficiency.


AutoDispNet Improving Disparity Estimation With AutoML. Much research work in computer vision is being spent on optimizing existing network architectures to obtain a few more percentage points on benchmarks. Recent AutoML approaches promise to relieve us from this effort. However, they are mainly designed for comparatively small scale classification tasks. In this work, we show how to use and extend existing AutoML techniques to efficiently optimize large scale U Net like encoder decoder architectures. In particular, we leverage gradient based neural architecture search and Bayesian optimization for hyperparameter search. The resulting optimization does not require a large scale compute cluster. We show results on disparity estimation that clearly outperform the manually optimized baseline and reach state of the art performance.


Sub method, partial behavioral reflection with Reflectivity Looking back on 10 years of use. Context. Refining or altering existing behavior is the daily work of every developer, but that cannot be always anticipated, and software sometimes cannot be stopped. In such cases, unanticipated adaptation of running systems is of interest for many scenarios, ranging from functional upgrades to on the fly debugging or monitoring of critical applications. Inquiry. A way of altering software at run time is using behavioral reflection, which is particularly well suited for unanticipated adaptation of real world systems. Partial behavioral reflection is not a new idea, and for years many efforts have been made to propose a practical way of expressing it. All these efforts resulted in practical solutions, but which introduced a semantic gap between the code that requires adaptation and the expression of the partial behavior. For example, in Aspect Oriented Programming, a pointcut description is expressed in another language, which introduces a new distance between the behavior expression (the Advice) and the source code in itself. Approach. Ten years ago, the idea of closing the gap between the code and the expression of the partial behavior led to the implementation of the Reflectivity framework. Using Reflectivity, developers annotate Abstract Syntax Tree (AST) nodes with meta behavior which is taken into account by the compiler to produce behavioral variations. In this paper, we present Reflectivity, its API, its implementation and its usage in Pharo. We reflect on ten years of use of Reflectivity, and show how it has been used as a basic building block of many innovative ideas. Knowledge. Reflectivity brings a practical way of working at the AST level, which is a high level representation of the source code manipulated by software developers. It enables a powerful way of dynamically add and modify behavior. Reflectivity is also a flexible mean to bridge the gap between the expression of the meta behavior and the source code. This ability to apply unanticipated adaptation and to provide behavioral reflection led to many experiments and projects during this last decade by external users. Existing work use Reflectivity to implement reflective libraries or languages extensions, featherweight code instrumentation, dynamic software update, debugging tools and visualization and software analysis tools. Grounding. Reflectivity is actively used in research projects. During the past ten years, it served as a support, either for implementation or as a fundamental base, for many research work including PhD theses, conference, journal and workshop papers. Reflectivity is now an important library of the Pharo language, and is integrated at the heart of the platform. Importance. Reflectivity exposes powerful abstractions to deal with partial behavioral adaptation, while providing a mature framework for unanticipated, non intrusive and partial behavioral reflection based on AST annotation. Furthermore, even if Reflectivity found its home inside Pharo, it is not a pure Smalltalk oriented solution. As validation over the practical use of Reflectivity in dynamic object oriented languages, the API has been ported to Python. Finally, the AST annotation feature of Reflectivity opens new experimentation opportunities about the control that developers could gain on the behavior of their own software.


Competition in Fund Management and Forward Relative Performance Criteria. In an Ito diffusion market, two fund managers trade under relative performance concerns. For both the asset specialization and diversification settings, we analyze the passive and competitive cases. We measure the performance of the managers' strategies via forward relative performance criteria, leading to the respective notions of forward best response criterion and forward Nash equilibrium. The motivation to develop such criteria comes from the need to relax various crucial, but quite stringent, existing assumptions such as, the a priori choices of both the market model and the investment horizon, the commonality of the latter for both managers as well as the full a priori knowledge of the competitor's policies for the best response case. We focus on locally riskless criteria and deduce the random forward equations. We solve the CRRA cases, thus also extending the related results in the classical setting. An important by product of the work herein is the development of forward performance criteria for investment problems in Ito diffusion markets under the presence of correlated random endowment process for both the perfectly and the incomplete market cases.


RIN Textured Human Model Recovery and Imitation with a Single Image. Human imitation has become topical recently, driven by GAN's ability to disentangle human pose and body content. However, the latest methods hardly focus on 3D information, and to avoid self occlusion, a massive amount of input images are needed. In this paper, we propose RIN, a novel volume based framework for reconstructing a textured 3D model from a single picture and imitating a subject with the generated model. Specifically, to estimate most of the human texture, we propose a U Net like front to back translation network. With both front and back images input, the textured volume recovery module allows us to color a volumetric human. A sequence of 3D poses then guides the colored volume via Flowable Disentangle Networks as a volume to volume translation task. To project volumes to a 2D plane during training, we design a differentiable depth aware renderer. Our experiments demonstrate that our volume based model is adequate for human imitation, and the back view can be estimated reliably using our network. While prior works based on either 2D pose or semantic map often fail for the unstable appearance of a human, our framework can still produce concrete results, which are competitive to those imagined from multi view input.


Exploring Hilbert space on a budget Novel benchmark set and performance metric for testing electronic structure methods in the regime of strong correlation. This work explores the ability of classical electronic structure methods to efficiently represent (compress) the information content of full configuration interaction (FCI) wave functions. We introduce a benchmark set of four hydrogen model systems of different dimensionality and distinctive electronic structures a 1D chain, a 1D ring, a 2D triangular lattice, and a 3D close packed pyramid. To assess the ability of a computational method to produce accurate and compact wave functions, we introduce the accuracy volume, a metric that measures the number of variational parameters necessary to achieve a target energy error. Using this metric and the hydrogen models, we examine the performance of three classical deterministic methods i) selected configuration interaction (sCI) realized both via an a posteriori and variational selection of the most important determinants, ii) rank reduced FCI, obtained by an a posteriori singular value decomposition of the FCI tensor (SVD FCI), and iii) the matrix product state representation obtained via the density matrix renormalization group (DMRG). We find that DMRG generally gives the most efficient wave function representation for all systems, particularly in the 1D chain with a localized basis. For the 2D and 3D systems, all methods perform best with a delocalized basis, and the efficiency of sCI is closer to that of DMRG, with the former having and accuracy volume approximately twice as large in the strong correlation regime. Compared to sCI, the SVD FCI scheme is generally found to require a slightly larger number of parameters to achieve the same energy accuracy.


Distant Supervision for E commerce Query Segmentation via Attention Network. The booming online e commerce platforms demand highly accurate approaches to segment queries that carry the product requirements of consumers. Recent works have shown that the supervised methods, especially those based on deep learning, are attractive for achieving better performance on the problem of query segmentation. However, the lack of labeled data is still a big challenge for training a deep segmentation network, and the problem of Out of Vocabulary (OOV) also adversely impacts the performance of query segmentation. Different from query segmentation task in an open domain, e commerce scenario can provide external documents that are closely related to these queries. Thus, to deal with the two challenges, we employ the idea of distant supervision and design a novel method to find contexts in external documents and extract features from these contexts. In this work, we propose a BiLSTM CRF based model with an attention module to encode external features, such that external contexts information, which can be utilized naturally and effectively to help query segmentation. Experiments on two datasets show the effectiveness of our approach compared with several kinds of baselines.


Gromov Hausdorff stability of inertial manifolds under perturbations of the domain and equation. In this paper, we study the Gromov Hausdorff stability and continuous dependence of the inertial manifolds under perturbations of the domain and equation. More precisely, we use the Gromov Hausdorff distances between two inertial manifolds and two dynamical systems to consider the continuous dependence of the inertial manifolds and the stability of the dynamical systems on inertial manifolds induced by the reaction diffusion equations under perturbations of the domain and equation.


Sample efficient Deep Reinforcement Learning with Imaginary Rollouts for Human Robot Interaction. Deep reinforcement learning has proven to be a great success in allowing agents to learn complex tasks. However, its application to actual robots can be prohibitively expensive. Furthermore, the unpredictability of human behavior in human robot interaction tasks can hinder convergence to a good policy. In this paper, we present an architecture that allows agents to learn models of stochastic environments and use them to accelerate learning. We descirbe how an environment model can be learned online and used to generate synthetic transitions, as well as how an agent can leverage these synthetic data to accelerate learning. We validate our approach using an experiment in which a robotic arm has to complete a task composed of a series of actions based on human gestures. Results show that our approach leads to significantly faster learning, requiring much less interaction with the environment. Furthermore, we demonstrate how learned models can be used by a robot to produce optimal plans in real world applications.


Intermediate Value Linearizability A Quantitative Correctness Criterion. Big data processing systems often employ batched updates and data sketches to estimate certain properties of large data. For example, a CountMin sketch approximates the frequencies at which elements occur in a data stream, and a batched counter counts events in batches. This paper focuses on the correctness of concurrent implementations of such objects. Specifically, we consider quantitative objects, whose return values are from a totally ordered domain, with an emphasis on (e,d) bounded objects that estimate a quantity with an error of at most e with probability at least 1 d . The de facto correctness criterion for concurrent objects is linearizability. Under linearizability, when a read overlaps an update, it must return the object's value either before the update or after it. Consider, for example, a single batched increment operation that counts three new events, bumping a batched counter's value from 7 to 10 . In a linearizable implementation of the counter, an overlapping read must return one of these. We observe, however, that in typical use cases, any intermediate value would also be acceptable. To capture this degree of freedom, we propose Intermediate Value Linearizability (IVL), a new correctness criterion that relaxes linearizability to allow returning intermediate values, for instance 8 in the example above. Roughly speaking, IVL allows reads to return any value that is bounded between two return values that are legal under linearizability. A key feature of IVL is that concurrent IVL implementations of (e,d) bounded objects remain (e,d) bounded. To illustrate the power of this result, we give a straightforward and efficient concurrent implementation of an (e, d) bounded CountMin sketch, which is IVL (albeit not linearizable). Finally, we show that IVL allows for inherently cheaper implementations than linearizable ones.


Algorithmic problems in Engel groups and cryptographic applications. The theory of Engel groups plays an important role in group theory since these groups are closely related to the Burnside problems. In this survey we consider several classical and novel algorithmic problems for Engel groups and propose several open problems. We study these problems with a view towards applications to cryptography.


Fractional order susceptible infected model definition and applications to the study of COVID 19 main protease. We propose a model for the transmission of perturbations across the amino acids of a protein represented as an interaction network. The dynamics consists of a Susceptible Infected (SI) model based on the Caputo fractional order derivative. We find an upper bound to the analytical solution of this model which represents the worse case scenario on the propagation of perturbations across a protein residue network. This upper bound is expressed in terms of Mittag Leffler functions of the adjacency matrix of the network of inter amino acids interactions. We then apply this model to the analysis of the propagation of perturbations produced by inhibitors of the main protease of SARS CoV 2. We find that the perturbations produced by strong inhibitors of the protease are propagated far away from the binding site, confirming the long range nature of intra protein communication. On the contrary, the weakest inhibitors only transmit their perturbations across a close environment around the binding site. These findings may help to the design of drug candidates against this new coronavirus.


Augmenting Transformers with KNN Based Composite Memory for Dialogue. Various machine learning tasks can benefit from access to external information of different modalities, such as text and images. Recent work has focused on learning architectures with large memories capable of storing this knowledge. We propose augmenting generative Transformer neural networks with KNN based Information Fetching (KIF) modules. Each KIF module learns a read operation to access fixed external knowledge. We apply these modules to generative dialog modeling, a challenging task where information must be flexibly retrieved and incorporated to maintain the topic and flow of conversation. We demonstrate the effectiveness of our approach by identifying relevant knowledge required for knowledgeable but engaging dialog from Wikipedia, images, and human written dialog utterances, and show that leveraging this retrieved information improves model performance, measured by automatic and human evaluation.


Boltzmann Physical Kinetic for Deep Bed Filtration Homogenization by solving operator equation in Hilbert space. This paper develops a modified version of the Boltzmann equation for micro scale particulate flow with capture and diffusion that describes the colloidal suspension nano transport in porous media. An equivalent sink term is introduced into the kinetic equation instead of non zero initial data, resulting in the solution of an operator equation in the Fourier space and an exact homogenization. The upper scale equation is obtained in closed form together with explicit formulae for the large scale model coefficients in terms of the micro scale parameters. The upscaling reveals the delay in particle transport if compared with the carrier water velocity, which is a collective effect of the particle capture and diffusion. The derived governing equation generalizes the current models for suspension colloidal nano transport in porous media.


Coherent systems on the projective line. It is well known that there are no stable bundles of rank greater than 1 on the projective line. In this paper, our main purpose is to study the existence problem for stable coherent systems on the projective line when the number of sections is larger than the rank. We include a review of known results, mostly for a small number of sections.


Learning in teams peer evaluation for fair assessment of individual contributions. The "free rider" problem has long plagued pedagogies based on collaborative learning. The most common solution to the free rider problem is peer evaluation. As well other existing methods of peer evaluation include self evaluation and hence are prone to grade inflation or, as we show here, are inaccurate in that they do not fairly reward the most hard working student. Another common concern with existing methods of peer evaluation is that students often do not have the necessary skills to evaluate the work of their peers objectively. In this paper, we introduce a new mechanism for peer evaluation that does not rely on self evaluation, and yet remains accurate, i.e., if all students are completely truthful in their evaluations, then the output of our mechanism becomes an objective truth. At the same time, our mechanism integrates the instructor's judgment with respect to the credibility of students' evaluations. For example, the instructor gives scores to students for writing credible reviews and, in turn, subsequent students' evaluations are weighted according to these instructor scores.


Steering a thermally activated micromotor with a nearby isothermal wall. Selective heating of a microparticle surface had been observed to cause its autonomous movement in a fluid medium due to self generated temperature gradients. In this work, we theoretically investigate the response of such an auto thermophoretic particle near a planar wall which is held isothermal. We derive an exact solution of the energy equation and employ the Reynolds reciprocal theorem to obtain the translational and rotational swimming velocities in the creeping flow limit. Subsequently, we analyse the trajectories of the micromotor for different thermo physical and configurational parameters. Results show that the micromotor trajectories can be switched either from wall bound sliding or stationary state to escape from the near wall zone by suitably choosing the particle and the surrounding fluid pair having selective thermal conductivity contrasts. Further, we discuss the dependency of this swimming state transition on the launching orientation and the coverage of the metallic cap. Our results reveal that the scenario addressed here holds several exclusive distinguishing features from the otherwise extensively studied self diffusiophoresis phenomenon near an inert wall, despite obvious analogies in the respective constitutive laws relating the fluxes with the gradients of the concerned forcing parameters. The most contrasting locomotion behaviour here turns out to be the ability of a self thermophoretic micromotor to migrate towards the wall with large heated cap even if it is initially directed away from the wall. Besides, during the stationary state of swimming, the cold portion on the micromotor surface faces away from the wall, under all conditions. Such unique aspects of locomotion hold the potential of being harnessed in practice towards achieving intricate control over autonomous motion of microparticles in thermally regulated fluidic environments.


FUSE Multi Faceted Set Expansion by Coherent Clustering of Skip grams. Set expansion aims to expand a small set of seed entities into a complete set of relevant entities. Most existing approaches assume the input seed set is unambiguous and completely ignore the multi faceted semantics of seed entities. As a result, given the seed set "Canon", "Sony", "Nikon" , previous models return one mixed set of entities that are either Camera Brands or Japanese Companies. In this paper, we study the task of multi faceted set expansion, which aims to capture all semantic facets in the seed set and return multiple sets of entities, one for each semantic facet. We propose an unsupervised framework, FUSE, which consists of three major components (1) facet discovery module identifies all semantic facets of each seed entity by extracting and clustering its skip grams, and (2) facet fusion module discovers shared semantic facets of the entire seed set by an optimization formulation, and (3) entity expansion module expands each semantic facet by utilizing a masked language model with pre trained BERT models. Extensive experiments demonstrate that FUSE can accurately identify multiple semantic facets of the seed set and generate quality entities for each facet.


Joint Viewpoint and Keypoint Estimation with Real and Synthetic Data. The estimation of viewpoints and keypoints effectively enhance object detection methods by extracting valuable traits of the object instances. While the output of both processes differ, i.e., angles vs. list of characteristic points, they indeed share the same focus on how the object is placed in the scene, inducing that there is a certain level of correlation between them. Therefore, we propose a convolutional neural network that jointly computes the viewpoint and keypoints for different object categories. By training both tasks together, each task improves the accuracy of the other. Since the labelling of object keypoints is very time consuming for human annotators, we also introduce a new synthetic dataset with automatically generated viewpoint and keypoints annotations. Our proposed network can also be trained on datasets that contain viewpoint and keypoints annotations or only one of them. The experiments show that the proposed approach successfully exploits this implicit correlation between the tasks and outperforms previous techniques that are trained independently.


Learning to Execute Programs with Instruction Pointer Attention Graph Neural Networks. Graph neural networks (GNNs) have emerged as a powerful tool for learning software engineering tasks including code completion, bug finding, and program repair. They benefit from leveraging program structure like control flow graphs, but they are not well suited to tasks like program execution that require far more sequential reasoning steps than number of GNN propagation steps. Recurrent neural networks (RNNs), on the other hand, are well suited to long sequential chains of reasoning, but they do not naturally incorporate program structure and generally perform worse on the above tasks. Our aim is to achieve the best of both worlds, and we do so by introducing a novel GNN architecture, the Instruction Pointer Attention Graph Neural Networks (IPA GNN), which achieves improved systematic generalization on the task of learning to execute programs using control flow graphs. The model arises by considering RNNs operating on program traces with branch decisions as latent variables. The IPA GNN can be seen either as a continuous relaxation of the RNN model or as a GNN variant more tailored to execution. To test the models, we propose evaluating systematic generalization on learning to execute using control flow graphs, which tests sequential reasoning and use of program structure. More practically, we evaluate these models on the task of learning to execute partial programs, as might arise if using the model as a heuristic function in program synthesis. Results show that the IPA GNN outperforms a variety of RNN and GNN baselines on both tasks.


Classifying toric surface codes of dimension 7 . Toric surface codes are a class of error correcting codes coming from a lattice polytope defining a two dimensional toric variety. Previous authors have mostly completed classifications of these toric surface codes with dimension up to k 7. In this note, we correct an error in the classification of the k 7 case started in cite HLYZZ , and disprove one of their conjectures.


Drawing Prolog Search Trees A Manual for Teachers and Students of Logic Programming. Programming in Prolog is hard for programmers that are used to procedural coding. In this manual the method of drawing search trees is introduced with the aim to get a better understanding of how Prolog works. After giving a first example of a Prolog database, query and search tree, the art of drawing search trees is systematically introduced giving guidelines for queries with variables, conjunction, disjunction, and negation. Further examples are provided by giving the complete search trees that are shown in Learn Prolog Now!


Whole Body Walking Generation using Contact Parametrization A Non Linear Trajectory Optimization Approach. In this paper, we describe a planner capable of generating walking trajectories by using the centroidal dynamics and the full kinematics of a humanoid robot model. The interaction between the robot and the walking surface is modeled explicitly through a novel contact parametrization. The approach is complementarity free and does not need a predefined contact sequence. By solving an optimal control problem we obtain walking trajectories. In particular, through a set of constraints and dynamic equations, we model the robot in contact with the ground. We describe the objective the robot needs to achieve with a set of tasks. The whole optimal control problem is transcribed into an optimization problem via a Direct Multiple Shooting approach and solved with an off the shelf solver. We show that it is possible to achieve walking motions automatically by specifying a minimal set of references, such as a constant desired Center of Mass velocity and a reference point on the ground.


The Bouncing Penny and Nonholonomic Impacts. The evolution of a Lagrangian mechanical system is variational. Likewise, when dealing with a hybrid Lagrangian system (a system with discontinuous impacts), the impacts can also be described by variations. These variational impacts are given by the so called Weierstrass Erdmann corner conditions. Therefore, hybrid Lagrangian systems can be completely understood by variational principles. Unlike typical (unconstrained holonomic) Lagrangian systems, nonholonomically constrained Lagrangian systems are not variational. However, by using the Lagrange d'Alembert principle, nonholonomic systems can be described as projections of variational systems. This paper works out the analogous version of the Weierstrass Erdmann corner conditions for nonholonomic systems and examines the billiard problem with a rolling disk.


Reachability in arborescence packings. Fortier et al. proposed several research problems on packing arborescences. Some of them were settled in that article and others were solved later by Matsuoka and Tanigawa and by Gao and Yang. The last open problem is settled in this article. We show how to turn an inductive idea used in the latter two articles into a simple proof technique that allows to relate previous results on arborescence packings. We show how a strong version of Edmonds' theorem on packing spanning arborescences implies Kamiyama, Katoh and Takizawa's result on packing reachability arborescences and how Durand de Gevigney, Nguyen and Szigeti's theorem on matroid based packing of arborescences implies Kir 'aly's result on matroid reachability based packing of arborescences. Finally, we deduce a new result on matroid reachability based packing of mixed hyperarborescences from a theorem on matroid based packing of mixed hyperarborescences due to Fortier et al.. In the last part of the article, we deal with the algorithmic aspects of the problems considered. We first obtain algorithms to find the desired packings of arborescences in all settings and then apply Edmonds' weighted matroid intersection algorithm to also find solutions minimizing a given weight function.


On a Competitive Secretary Problem with Deferred Selections. We study secretary problems in settings with multiple agents. In the standard secretary problem, a sequence of arbitrary awards arrive online, in a random order, and a single decision maker makes an immediate and irrevocable decision whether to accept each award upon its arrival. The requirement to make immediate decisions arises in many cases due to an implicit assumption regarding competition. Namely, if the decision maker does not take the offered award immediately, it will be taken by someone else. The novelty in this paper is in introducing a multi agent model in which the competition is endogenous. In our model, multiple agents compete over the arriving awards, but the decisions need not be immediate instead, agents may select previous awards as long as they are available (i.e., not taken by another agent). If an award is selected by multiple agents, ties are broken either randomly or according to a global ranking. This induces a multi agent game in which the time of selection is not enforced by the rules of the games, rather it is an important component of the agent's strategy. We study the structure and performance of equilibria in this game. For random tie breaking, we characterize the equilibria of the game, and show that the expected social welfare in equilibrium is nearly optimal, despite competition among the agents. For ranked tie breaking, we give a full characterization of equilibria in the 3 agent game, and show that as the number of agents grows, the winning probability of every agent under non immediate selections approaches her winning probability under immediate selections.


Testing and reconstruction via decision trees. We study sublinear and local computation algorithms for decision trees, focusing on testing and reconstruction. Our first result is a tester that runs in mathrm poly ( log s, 1 varepsilon) cdot n log n time, makes mathrm poly ( log s,1 varepsilon) cdot log n queries to an unknown function f , and circ Accepts if f is varepsilon close to a size s decision tree circ Rejects if f is Omega( varepsilon) far from decision trees of size s tilde O (( log s) 2 varepsilon 2) . Existing testers distinguish size s decision trees from those that are varepsilon far from from size s decision trees in mathrm poly (s s,1 varepsilon) cdot n time with tilde O (s varepsilon) queries. We therefore solve an incomparable problem, but achieve doubly exponential in s and exponential in s improvements in time and query complexities respectively. We obtain our tester by designing a reconstruction algorithm for decision trees given query access to a function f that is close to a small decision tree, this algorithm provides fast query access to a small decision tree that is close to f . By known relationships, our results yield reconstruction algorithms for numerous other boolean function properties Fourier degree, randomized and quantum query complexities, certificate complexity, sensitivity, etc. which in turn yield new testers for these properties. Finally, we give a hardness result for testing whether an unknown function is varepsilon close to or Omega( varepsilon) far from size s decision trees. We show that an efficient algorithm for this task would yield an efficient algorithm for properly learning decision trees, a central open problem of learning theory. It has long been known that proper learning algorithms for any class mathcal H yield property testers for mathcal H this provides an example of a converse.


Invariant quantum measure on q deformed twisted adjoint orbits. Let U be a compact semisimple Lie group with complexification G and associated Cartan involution Theta . Let nu be an involutive complex Lie group automorphism of G commuting with Theta , and consider the associated semisimple real Lie group G nu g in G mid nu(g) Theta(g) . We consider q deformed analogues of the U orbits of the quotient space G nu backslash G , and determine for these the associated von Neumann algebra and invariant state.


Pricing Path Dependent Derivatives under Multiscale Stochastic Volatility Models a Malliavin Representation. In this paper we derive a efficient Monte Carlo approximation for the price of path dependent derivatives under the multiscale stochastic volatility models of Fouque textit et al . Using the formulation of this pricing problem under the functional It o calculus framework and making use of Greek formulas from Malliavin calculus, we derive a representation for the first order approximation of the price of path dependent derivatives in the form mathbb E mbox payoff times mbox weight . The weight is known in closed form and depends only on the group market parameters arising from the calibration of the multiscale stochastic volatility to the market's implied volatility. Moreover, only simulations of the Black Scholes model is required. We exemplify the method for a couple path dependent derivatives.


On a Berry Esseen type limit theorem for Boolean convolution. We obtain a sharp estimate of the speed of convergence in the Boolean central limit theorem for measures of finite sixth moment. The main tool is a quantitative version of the Stieltjes Perron inversion formula.


physics.comp-ph cs.DC cs.LG physics.flu-dyn

Deep learning at scale for subgrid modeling in turbulent flows. Modeling of turbulent flows is still challenging. One way to deal with the large scale separation due to turbulence is to simulate only the large scales and model the unresolved contributions as done in large eddy simulation (LES). This paper focuses on two deep learning (DL) strategies, regression and reconstruction, which are data driven and promising alternatives to classical modeling concepts. Using three dimensional (3 D) forced turbulence direct numerical simulation (DNS) data, subgrid models are evaluated, which predict the unresolved part of quantities based on the resolved solution. For regression, it is shown that feedforward artificial neural networks (ANNs) are able to predict the fully resolved scalar dissipation rate using filtered input data. It was found that a combination of a large scale quantity, such as the filtered passive scalar itself, and a small scale quantity, such as the filtered energy dissipation rate, gives the best agreement with the actual DNS data. Furthermore, a DL network motivated by enhanced super resolution generative adversarial networks (ESRGANs) was used to reconstruct fully resolved 3 D velocity fields from filtered velocity fields. The energy spectrum shows very good agreement. As size of scientific data is often in the order of terabytes or more, DL needs to be combined with high performance computing (HPC). Necessary code improvements for HPC DL are discussed with respect to the supercomputer JURECA. After optimizing the training code, 396.2 TFLOPS were achieved.


Scaling of the risk landscape drives optimal life history strategies and the evolution of grazing. Consumers face numerous risks that can be minimized by incorporating different life history strategies. How much and when a consumer adds to its energetic reserves or invests in reproduction are key behavioral and physiological adaptations that structure much of how organisms interact. Here we develop a theoretical framework that explicitly accounts for stochastic fluctuations of an individual consumer's energetic reserves while foraging and reproducing on a landscape with resources that range from uniformly distributed to highly clustered. First, we show that optimal life history strategies vary in response to changes in the mean productivity of the resource landscape, where depleted environments promote reproduction at lower energetic states, greater investment in each reproduction event, and smaller litter sizes. We then show that if resource variance scales with body size due to landscape clustering, consumers that forage for clustered foods are susceptible to strong Allee effects, increasing extinction risk. Finally, we show that the proposed relationship between consumer body size, resource clustering, and Allee effect induced population instability offers key ecological insights into the evolution of large bodied grazing herbivores from small bodied browsing ancestors.


A near optimal direct sum theorem for communication complexity. We show a near optimal direct sum theorem for the two party randomized communication complexity. Let f subseteq X times Y times Z be a relation, varepsilon 0 and k be an integer. We show, mathrm R mathrm pub varepsilon(f k) cdot log( mathrm R mathrm pub varepsilon(f k)) ge Omega(k cdot mathrm R mathrm pub varepsilon(f)) enspace, where f k f times ldots times f ( k times) and mathrm R mathrm pub varepsilon( cdot) represents the public coin randomized communication complexity with worst case error varepsilon . Given a protocol mathcal P for f k with communication cost c cdot k and worst case error varepsilon , we exhibit a protocol mathcal Q for f with external information cost O(c) and worst error varepsilon . We then use a message compression protocol due to Barak, Braverman, Chen and Rao 2013 for simulating mathcal Q with communication O(c cdot log(c cdot k)) to arrive at our result. To show this reduction we show some new chain rules for capacity, the maximum information that can be transmitted by a communication channel. We use the powerful concept of Nash Equilibrium in game theory, and its existence in suitably defined games, to arrive at the chain rules for capacity. These chain rules are of independent interest.


SURFACE A Practical Blockchain Consensus Algorithm for Real World Networks. SURFACE, standing for Secure, Use case adaptive, and Relatively Fork free Approach of Chain Extension, is a consensus algorithm that is designed for real world networks and enjoys the benefits from both the Nakamoto consensus and Byzantine Fault Tolerance (BFT) consensus. In SURFACE, a committee is randomly selected every round to validate and endorse the proposed new block. The size of the committee can be adjusted according to the underlying network to make the blockchain mostly fork free with a reasonable overhead in communication. Consequently, the blockchain can normally achieve fast probabilistic confirmation with high throughput and low latency. SURFACE also provides a BFT mechanism to guarantee ledger consistency in case of an extreme network situation such as large network partition or being under massive DDoS attacks.


Mass conservative and positivity preserving second order semi implicit methods for high order parabolic equations. We consider a class of finite element approximations for fourth order parabolic equations that can be written as a system of second order equations by introducing an auxiliary variable. In our approach, we first solve a variational problem and then an optimization problem to satisfy the desired physical properties of the solution such as conservation of mass, positivity (non negativity) of solution and dissipation of energy. Furthermore, we show existence and uniqueness of the solution to the optimization problem and we prove that the methods converge to the truncation schemes cite Berger1975 . We also propose new conservative truncation methods for high order parabolic equations. A numerical convergence study is performed and a series of numerical tests are presented to show and compare the efficiency and robustness of the different schemes.


Speed of transverse waves in a string revisited. In many introductory level physics textbooks, the derivation of the formula for the speed of transverse waves in a string is either omitted altogether or presented under physically overly idealized assumptions about the shape of the considered wave pulse and the related velocity and acceleration distributions. In the paper, we derive the named formula by applying Newton's second law or the work energy theorem to a finite element of the string, making no assumptions about the shape of the wave. We argue that the suggested method can help the student gain a deeper insight into the nature of waves and the related process of energy transport, as well as provide a new experience with the fundamental principles of mechanics as applied to extended and deformable bodies.


Adversarial Training with Fast Gradient Projection Method against Synonym Substitution based Text Attacks. Adversarial training is the most empirically successful approach in improving the robustness of deep neural networks for image classification.For text classification, however, existing synonym substitution based adversarial attacks are effective but not efficient to be incorporated into practical text adversarial training. Gradient based attacks, which are very efficient for images, are hard to be implemented for synonym substitution based text attacks due to the lexical, grammatical and semantic constraints and the discrete text input space. Thereby, we propose a fast text adversarial attack method called Fast Gradient Projection Method (FGPM) based on synonym substitution, which is about 20 times faster than existing text attack methods and could achieve similar attack performance. We then incorporate FGPM with adversarial training and propose a text defense method called Adversarial Training with FGPM enhanced by Logit pairing (ATFL). Experiments show that ATFL could significantly improve the model robustness and block the transferability of adversarial examples.


A note on Hang Wang's hemisphere rigidity theorem. Let (M,g) be a compact manifold with boundary and Ric g geq (n 1)g , Hang and Wang proved that (M,g) is isometric to the standard hemisphere if partial M is convex and isometric to mathbb S n 1 (1) . We prove some rigidity theorems when partial M is isometric to a product manifold where one factor is the standard sphere.


On the geometric Andr 'e Oort conjecture for variations of Hodge structures. Let mathbb V be a polarized variation of integral Hodge structure on a smooth complex quasi projective variety S . In this paper, we show that the union of the non factor special subvarieties for (S, mathbb V ) , which are of Shimura type with dominant period maps, is a finite union of special subvarieties of S . This generalizes previous results of Clozel and Ullmo arXiv math 0404131, Ullmo cite Ullmo07 on the distribution of the non factor (in particular, strongly) special subvarieties in a Shimura variety to the non classical setting and also answers positively the geometric part of a conjecture of Klingler on the Andr 'e Oort conjecture for variations of Hodge structures.


Tracking sex The implications of widespread sexual data leakage and tracking on porn websites. This paper explores tracking and privacy risks on pornography websites. Our analysis of 22,484 pornography websites indicated that 93 leak user data to a third party. Tracking on these sites is highly concentrated by a handful of major companies, which we identify. We successfully extracted privacy policies for 3,856 sites, 17 of the total. The policies were written such that one might need a two year college education to understand them. Our content analysis of the sample's domains indicated 44.97 of them expose or suggest a specific gender sexual identity or interest likely to be linked to the user. We identify three core implications of the quantitative results 1) the unique elevated risks of porn data leakage versus other types of data, 2) the particular risks impact for vulnerable populations, and 3) the complications of providing consent for porn site users and the need for affirmative consent in these online sexual interactions.