Hyperbolic model of internal solitary waves in a three layer stratified fluid. We derive a new hyperbolic model describing the propagation of internal waves in a stratified shallow water with a non hydrostatic pressure distribution. The construction of the hyperbolic model is based on the use of additional instantaneous' variables. This allows one to reduce the dispersive multi layer Green Naghdi model to a first order system of evolution equations. The main attention is paid to the study of three layer flows over uneven bottom in the Boussinesq approximation with the additional assumption of hydrostatic pressure in the intermediate layer. The hyperbolicity conditions of the obtained equations of three layer flows are formulated and solutions in the class of travelling waves are studied. Based on the proposed hyperbolic and dispersive models, numerical calculations of the generation and propagation of internal solitary waves are carried out and their comparison with experimental data is given. Within the framework of the proposed three layer hyperbolic model, a numerical study of the propagation and interaction of symmetric and non symmetric soliton like waves is performed.


The sets of flattened partitions with forbidden patterns. The study of pattern avoidance in permutations, and specifically in flattened partitions is an active area of current research. In this paper, we count the number of distinct flattened partitions over n avoiding a single pattern, as well as a pair of two patterns. Several counting sequences, namely Catalan numbers, powers of two, Fibonacci numbers and Motzkin numbers arise. We also consider other combinatorial statistics, namely runs and inversions, and establish some bijections in situations where the statistics coincide.


Unbounded expectations to some von Neumann algebras. For any injective von Neumann algebra R and any discrete, countable group G, which acts by automorphisms on R, we construct an idempotent mapping of an ultra weakly dense subspace of B(H) onto the reducerd crossed product von Neumann algebra, such that it is R bimodular and satisfies some nice relations with respect to positivity. In the case of an amenable group our unbounded expectation turns into a usual conditional expectation of norm 1.


On Memory Mechanism in Multi Agent Reinforcement Learning. Multi agent reinforcement learning (MARL) extends (single agent) reinforcement learning (RL) by introducing additional agents and (potentially) partial observability of the environment. Consequently, algorithms for solving MARL problems incorporate various extensions beyond traditional RL methods, such as a learned communication protocol between cooperative agents that enables exchange of private information or adaptive modeling of opponents in competitive settings. One popular algorithmic construct is a memory mechanism such that an agent's decisions can depend not only upon the current state but also upon the history of observed states and actions. In this paper, we study how a memory mechanism can be useful in environments with different properties, such as observability, internality and presence of a communication channel. Using both prior work and new experiments, we show that a memory mechanism is helpful when learning agents need to model other agents and or when communication is constrained in some way however we must to be cautious of agents achieving effective memoryfulness through other means.


Solving Parabolic Moving Interface Problems with Dynamical Immersed Spaces on Unfitted Meshes Fully Discrete Analysis. Immersed finite element (IFE) methods are a group of long existing numerical methods for solving interface problems on unfitted meshes. A core argument of the methods is to avoid mesh regeneration procedure when solving moving interface problems. Despite the various applications in moving interface problems, a complete theoretical study on the convergence behavior is still missing. This research is devoted to close the gap between numerical experiments and theory. We present the first fully discrete analysis including the stability and optimal error estimates for a backward Euler IFE method for solving parabolic moving interface problems. Numerical results are also presented to validate the analysis.


Torus actions, Morse homology, and the Hilbert scheme of points on affine space. We formulate a conjecture on actions of the multiplicative group in motivic homotopy theory. In short, if the multiplicative group G m acts on a quasi projective scheme U such that U is attracted as t approaches 0 in G m to a closed subset Y in U, then the inclusion from Y to U should be an A 1 homotopy equivalence. We prove several partial results. In particular, over the complex numbers, the inclusion is a homotopy equivalence on complex points. The proofs use an analog of Morse theory for singular varieties. Application the Hilbert scheme of points on affine n space is homotopy equivalent to the subspace consisting of schemes supported at the origin.


RLCard A Toolkit for Reinforcement Learning in Card Games. RLCard is an open source toolkit for reinforcement learning research in card games. It supports various card environments with easy to use interfaces, including Blackjack, Leduc Hold'em, Texas Hold'em, UNO, Dou Dizhu and Mahjong. The goal of RLCard is to bridge reinforcement learning and imperfect information games, and push forward the research of reinforcement learning in domains with multiple agents, large state and action space, and sparse reward. In this paper, we provide an overview of the key components in RLCard, a discussion of the design principles, a brief introduction of the interfaces, and comprehensive evaluations of the environments. The codes and documents are available at https github.com datamllab rlcard


A Denotational Engineering of Programming Languages. The book is devoted to two research areas (1) Designing programming languages along with their denotational models. A denotational model of a language consists of two many sorted algebras an algebra of syntax and an algebra of denotations and a (unique) homomorphism from syntax to denotations called the semantics of the language. (2) Designing sound program constructors for languages with denotational models. In our approach programs syntactically contain their total correctness specifications. A program is said to be correct if it is correct wrt its specification. A program constructor is sound if given correct component programs yields a correct resulting program. Both methods are illustrated on an example language Lingua.


Deep learning based numerical BSDE method for barrier options. As is known, an option price is a solution to a certain partial differential equation (PDE) with terminal conditions (payoff functions). There is a close association between the solution of PDE and the solution of a backward stochastic differential equation (BSDE). We can either solve the PDE to obtain option prices or solve its associated BSDE. Recently a deep learning technique has been applied to solve option prices using the BSDE approach. In this approach, deep learning is used to learn some deterministic functions, which are used in solving the BSDE with terminal conditions. In this paper, we extend the deep learning technique to solve a PDE with both terminal and boundary conditions. In particular, we will employ the technique to solve barrier options using Brownian motion bridges.


FKAConv Feature Kernel Alignment for Point Cloud Convolution. Recent state of the art methods for point cloud processing are based on the notion of point convolution, for which several approaches have been proposed. In this paper, inspired by discrete convolution in image processing, we provide a formulation to relate and analyze a number of point convolution methods. We also propose our own convolution variant, that separates the estimation of geometry less kernel weights and their alignment to the spatial support of features. Additionally, we define a point sampling strategy for convolution that is both effective and fast. Finally, using our convolution and sampling strategy, we show competitive results on classification and semantic segmentation benchmarks while being time and memory efficient.


Numerical methods for the mass conserved Ohta Kawasaki equation. In this paper, we propose a numerical method to solve the mass conserved Ohta Kawasaki equation with finite element discretization. An unconditional stable convex split ting scheme is applied to time approximation. The Newton method and its variant are used to address the implicitly nonlinear term. We rigorously analyze the convergence of the Newton iteration methods. Theoretical results demonstrate that two Newton iteration methods have the same convergence rate, and the Newton method has a smaller convergent factor than the variant one. To reduce the condition number of discretized linear system, we design two efficient block preconditioners and analyze their spectral distribution. Finally, we offer numerical examples to support the theoretical analysis and indicate the efficiency of the proposed numerical methods for the mass conserved Ohta Kawasaki equation.


The universal sheaf as an operator. We compute the universal sheaf of moduli spaces M of sheaves on a surface S, as an operator Symmetric Polynomials rightarrow K(M), thus generalizing the viewpoint of Carlsson Nekrasov Okounkov to arbitrary rank and general smooth surfaces.


Coordinate spaces of graphs approaching interior faces. We consider the cell decomposition of the moduli space of real genus two curves with a marked point on the only real oval. The cells are enumerated by certain graphs with their weights describing the complex structure on a curve. We show that collapse of the edge of the graph results in a root like singularity of the natural mapping from the graph weights to the moduli space of curves.


Role of Ligand Conformation on Nanoparticle Protein Interactions. Engineered biomedical nanoparticles (NP) administered via intravenous routes are prone to associate to serum proteins. The protein corona can mask the NP surface functionalization and hamper the delivery of the NP to its biological target. The design of corona free NPs relies on our understanding of the chemical physical features of the NP surface driving the interaction with serum proteins. Here we address, by computational means, the interaction between human serum albumin (HSA) and a prototypical monolayer protected Au nanoparticle. We show that both the chemical composition (charge, hydrophobicity) and the conformational preferences of the ligands decorating the NP surface affect the NP propensity to bind HSA.


Dynamic Geometric Independent Set. We present fully dynamic approximation algorithms for the Maximum Independent Set problem on several types of geometric objects intervals on the real line, arbitrary axis aligned squares in the plane and axis aligned d dimensional hypercubes. It is known that a maximum independent set of a collection of n intervals can be found in O(n log n) time, while it is already textsf NP hard for a set of unit squares. Moreover, the problem is inapproximable on many important graph families, but admits a textsf PTAS for a set of arbitrary pseudo disks. Therefore, a fundamental question in computational geometry is whether it is possible to maintain an approximate maximum independent set in a set of dynamic geometric objects, in truly sublinear time per insertion or deletion. In this work, we answer this question in the affirmative for intervals, squares and hypercubes. First, we show that for intervals a (1 varepsilon) approximate maximum independent set can be maintained with logarithmic worst case update time. This is achieved by maintaining a locally optimal solution using a constant number of constant size exchanges per update. We then show how our interval structure can be used to design a data structure for maintaining an expected constant factor approximate maximum independent set of axis aligned squares in the plane, with polylogarithmic amortized update time. Our approach generalizes to d dimensional hypercubes, providing a O(4 d) approximation with polylogarithmic update time. Those are the first approximation algorithms for any set of dynamic arbitrary size geometric objects previous results required bounded size ratios to obtain polylogarithmic update time. Furthermore, it is known that our results for squares (and hypercubes) cannot be improved to a (1 varepsilon) approximation with the same update time.


Random geometric complexes and graphs on Riemannian manifolds in the thermodynamic limit. We investigate some topological properties of random geometric complexes and random geometric graphs on Riemannian manifolds in the thermodynamic limit. In particular, for random geometric complexes we prove that the normalized counting measure of connected components, counted according to isotopy type, converges in probability to a deterministic measure. More generally, we also prove similar convergence results for the counting measure of types of components of each k skeleton of a random geometric complex. As a consequence, in the case of the 1 skeleton (i.e. for random geometric graphs) we show that the empirical spectral measure associated to the normalized Laplace operator converges to a deterministic measure.


Relation Entity Centric Reading Comprehension. Constructing a machine that understands human language is one of the most elusive and long standing challenges in artificial intelligence. This thesis addresses this challenge through studies of reading comprehension with a focus on understanding entities and their relationships. More specifically, we focus on question answering tasks designed to measure reading comprehension. We focus on entities and relations because they are typically used to represent the semantics of natural language.


On Packing Low Diameter Spanning Trees. Edge connectivity of a graph is one of the most fundamental graph theoretic concepts. The celebrated tree packing theorem of Tutte and Nash Williams from 1961 states that every k edge connected graph G contains a collection cal T of lfloor k 2 rfloor edge disjoint spanning trees, that we refer to as a tree packing the diameter of the tree packing cal T is the largest diameter of any tree in cal T . A desirable property of a tree packing, that is both sufficient and necessary for leveraging the high connectivity of a graph in distributed communication, is that its diameter is low. Yet, despite extensive research in this area, it is still unclear how to compute a tree packing, whose diameter is sublinear in V(G) , in a low diameter graph G , or alternatively how to show that such a packing does not exist. In this paper we provide first non trivial upper and lower bounds on the diameter of tree packing. First, we show that, for every k edge connected n vertex graph G of diameter D , there is a tree packing cal T of size Omega(k) , diameter O((101k log n) D) , that causes edge congestion at most 2 . Second, we show that for every k edge connected n vertex graph G of diameter D , the diameter of G p is O(k D(D 1) 2 ) with high probability, where G p is obtained by sampling each edge of G independently with probability p Theta( log n k) . This provides a packing of Omega(k log n) edge disjoint trees of diameter at most O(k (D(D 1) 2) ) each. We then prove that these two results are nearly tight. Lastly, we show that if every pair of vertices in a graph has k edge disjoint paths of length at most D connecting them, then there is a tree packing of size k , diameter O(D log n) , causing edge congestion O( log n) . We also provide several applications of low diameter tree packing in distributed computation.


Part based Multi stream Model for Vehicle Searching. Due to the enormous requirement in public security and intelligent transportation system, searching an identical vehicle has become more and more important. Current studies usually treat vehicle as an integral object and then train a distance metric to measure the similarity among vehicles. However, these raw images may be exactly similar to ones with different identification and include some pixels in background that may disturb the distance metric learning. In this paper, we propose a novel and useful method to segment an original vehicle image into several discriminative foreground parts, and these parts consist of some fine grained regions that are named discriminative patches. After that, these parts combined with the raw image are fed into the proposed deep learning network. We can easily measure the similarity of two vehicle images by computing the Euclidean distance of the features from FC layer. Two main contributions of this paper are as follows. Firstly, a method is proposed to estimate if a patch in a raw vehicle image is discriminative or not. Secondly, a new Part based Multi Stream Model (PMSM) is designed and optimized for vehicle retrieval and re identification tasks. We evaluate the proposed method on the VehicleID dataset, and the experimental results show that our method can outperform the baseline.


Named Entity Extraction with Finite State Transducers. We describe a named entity tagging system that requires minimal linguistic knowledge and can be applied to more target languages without substantial changes. The system is based on the ideas of the Brill's tagger which makes it really simple. Using supervised machine learning, we construct a series of automatons (or transducers) in order to tag a given text. The final model is composed entirely of automatons and it requires a lineal time for tagging. It was tested with the Spanish data set provided in the CoNLL 2002 attaining an overall F beta 1 measure of 60 . Also, we present an algorithm for the construction of the final transducer used to encode all the learned contextual rules.


Global algebraic K theory. We introduce a global equivariant refinement of algebraic K theory here global equivariant' refers to simultaneous and compatible actions of all finite groups. Our construction turns a specific kind of categorical input data into a global Omega spectrum that keeps track of genuine G equivariant infinite loop spaces, for all finite groups G . The resulting global algebraic K theory spectrum is a rigid way of packaging the representation K theory, or Swan K theory' into one highly structured object.


Picosecond Ultrasonics with Miniaturized Semiconductor Lasers. There is a great desire to extend ultrasonic techniques to the imaging and characterization of nanoobjects. This can be achieved by picosecond ultrasonics, where by using ultrafast lasers it is possible to generate and detect acoustic waves with frequencies up to terahertz and wavelengths down to nanometers. In our work we present a picosecond ultrasonics setup based on miniaturized mode locked semiconductor lasers, whose performance allows us to obtain the necessary power, pulse duration and repetition rate. Using such a laser, we measure the ultrasonic echo signal with picosecond resolution in a Al film deposited on a semiconductor substrate. We show that the obtained signal is as good as the signal obtained with a standard bulky mode locked Ti Sa laser. The experiments pave the way for designing integrated portable picosecond ultrasonic setups on the basis of miniaturized semiconductor lasers.


Global Sentiment Analysis Of COVID 19 Tweets Over Time. The Coronavirus pandemic has affected the normal course of life. People around the world have taken to social media to express their opinions and general emotions regarding this phenomenon that has taken over the world by storm. The social networking site, Twitter showed an unprecedented increase in tweets related to the novel Coronavirus in a very short span of time. This paper presents the global sentiment analysis of tweets related to Coronavirus and how the sentiment of people in different countries has changed over time. Furthermore, to determine the impact of Coronavirus on daily aspects of life, tweets related to Work From Home (WFH) and Online Learning were scraped and the change in sentiment over time was observed. In addition, various Machine Learning models such as Long Short Term Memory (LSTM) and Artificial Neural Networks (ANN) were implemented for sentiment classification and their accuracies were determined. Exploratory data analysis was also performed for a dataset providing information about the number of confirmed cases on a per day basis in a few of the worst hit countries to provide a comparison between the change in sentiment with the change in cases since the start of this pandemic till June 2020.


Cross lingual Supervision Improves Unsupervised Neural Machine Translation. Neural machine translation (NMT) is ineffective for zero resource languages. Recent works exploring the possibility of unsupervised neural machine translation (UNMT) with only monolingual data can achieve promising results. However, there are still big gaps between UNMT and NMT with parallel supervision. In this work, we introduce a multilingual unsupervised NMT ( method) framework to leverage weakly supervised signals from high resource language pairs to zero resource translation directions. More specifically, for unsupervised language pairs texttt En De , we can make full use of the information from parallel dataset texttt En Fr to jointly train the unsupervised translation directions all in one model. method is based on multilingual models which require no changes to the standard unsupervised NMT. Empirical results demonstrate that method significantly improves the translation quality by more than 3 BLEU score on six benchmark unsupervised translation directions.


Number Field Sieve with Provable Complexity. In this thesis we give an in depth introduction to the General Number Field Sieve, as it was used by Buhler, Lenstra, and Pomerance, before looking at one of the modern developments of this algorithm A randomized version with provable complexity. This version was posited in 2017 by Lee and Venkatesan and will be preceded by ample material from both algebraic and analytic number theory, Galois theory, and probability theory.


A Survey on Deep Learning of Small Sample in Biomedical Image Analysis. The success of deep learning has been witnessed as a promising technique for computer aided biomedical image analysis, due to end to end learning framework and availability of large scale labelled samples. However, in many cases of biomedical image analysis, deep learning techniques suffer from the small sample learning (SSL) dilemma caused mainly by lack of annotations. To be more practical for biomedical image analysis, in this paper we survey the key SSL techniques that help relieve the suffering of deep learning by combining with the development of related techniques in computer vision applications. In order to accelerate the clinical usage of biomedical image analysis based on deep learning techniques, we intentionally expand this survey to include the explanation methods for deep models that are important to clinical decision making. We survey the key SSL techniques by dividing them into five categories (1) explanation techniques, (2) weakly supervised learning techniques, (3) transfer learning techniques, (4) active learning techniques, and (5) miscellaneous techniques involving data augmentation, domain knowledge, traditional shallow methods and attention mechanism. These key techniques are expected to effectively support the application of deep learning in clinical biomedical image analysis, and furtherly improve the analysis performance, especially when large scale annotated samples are not available. We bulid demos at https github.com PengyiZhang MIADeepSSL.


Run Distribution Over Flattened Partitions. The study of flattened partitions is an active area of current research. In this paper, our study unexpectedly leads us to the OEIS numbers A124324. We provide a new combinatorial interpretation of these numbers. A combinatorial bijection between flattened partitions over n 1 and the partitions of n is also given in a separate section. We introduce the numbers f n, k which count the number of flattened partitions over n having k runs. We give recurrence relations defining them, as well as their exponential generating function in differential form. It should be appreciated if its closed form is established. We extend the results to flattened partitions where the first s integers belong to different runs. Combinatorial proofs are given.


On conditioning a self similar growth fragmentation by its intrinsic area. The genealogical structure of self similar growth fragmentations can be described in terms of a branching random walk. The so called intrinsic area mathrm A arises in this setting as the terminal value of a remarkable additive martingale. Motivated by connections with some models of random planar geometry, the purpose of this work is to investigate the effect of conditioning a self similar growth fragmentation on its intrinsic area. The distribution of mathrm A satisfies a useful smoothing transform which enables us to establish the existence of a regular density a and to determine the asymptotic behavior of a(r) as r to infty (this can be seen as a local version of Kesten Grincevicius Goldie theorem's for random affine fixed point equations in a particular setting). In turn, this yields a family of martingales from which the formal conditioning on mathrm A r can be realized by probability tilting. We point at a limit theorem for the conditional distribution given mathrm A r as r to infty , and also observe that such conditioning still makes sense under the so called canonical measure for which the growth fragmentation starts from 0


Fundamental Decompositions and Multistationarity of Power Law Kinetic Systems. The fundamental decomposition of a chemical reaction network (also called its " mathscr F decomposition") is the set of subnetworks generated by the partition of its set of reactions into the "fundamental classes" introduced by Ji and Feinberg in 2011 as the basis of their "higher deficiency algorithm" for mass action systems. The first part of this paper studies the properties of the mathscr F decomposition, in particular, its independence (i.e., the network's stoichiometric subspace is the direct sum of the subnetworks' stoichiometric subspaces) and its incidence independence (i.e., the image of the network's incidence map is the direct sum of the incidence maps' images of the subnetworks). We derive necessary and sufficient conditions for these properties and identify network classes where the mathscr F decomposition coincides with other known decompositions. The second part of the paper applies the above mentioned results to improve the Multistationarity Algorithm for power law kinetic systems (MSA), a general computational approach that we introduced in previous work. We show that for systems with non reactant determined interactions but with an independent mathscr F decomposition, the transformation to a dynamically equivalent system with reactant determined interactions required in the original MSA is not necessary. We illustrate this improvement with the subnetwork of Schmitz's carbon cycle model recently analyzed by Fortun et al.


A Probabilistic approach for Learning Embeddings without Supervision. For challenging machine learning problems such as zero shot learning and fine grained categorization, embedding learning is the machinery of choice because of its ability to learn generic notions of similarity, as opposed to class specific concepts in standard classification models. Embedding learning aims at learning discriminative representations of data such that similar examples are pulled closer, while pushing away dissimilar ones. Despite their exemplary performances, supervised embedding learning approaches require huge number of annotations for training. This restricts their applicability for large datasets in new applications where obtaining labels require extensive manual efforts and domain knowledge. In this paper, we propose to learn an embedding in a completely unsupervised manner without using any class labels. Using a graph based clustering approach to obtain pseudo labels, we form triplet based constraints following a metric learning paradigm. Our novel embedding learning approach uses a probabilistic notion, that intuitively minimizes the chances of each triplet violating a geometric constraint. Due to nature of the search space, we learn the parameters of our approach using Riemannian geometry. Our proposed approach performs competitive to state of the art approaches.


Recovering unitary calculus from calculus with reality. By analogy with complex K theory and K theory with reality, there are theories of unitary functor calculus and unitary functor calculus with reality, both of which are generalisations of Weiss' orthogonal calculus. In this paper we show that unitary functor calculus can be completely recovered from the unitary functor calculus with reality, in analogy to how complex topological K theory is completely recovered from K theory with reality via forgetting the C 2 action.


Enhanced four wave mixing with 2D layered graphene oxide films integrated with CMOS compatible micro ring resonators. Layered 2D graphene oxide (GO) films are integrated with microring resonators (MRRs) to experimentally demonstrate enhanced nonlinear optics in the form of four wave mixing (FWM). Both uniformly coated and patterned GO films are integrated on CMOS compatible doped silica MRRs using a large area, transfer free, layer by layer GO coating method together with photolithography and lift off processes, yielding precise control of the film thickness, placement, and coating length. The high Kerr nonlinearity and low loss of the GO films combined with the strong light matter interaction within the MRRs results in a significant improvement in the FWM efficiency in the hybrid MRRs. Detailed FWM measurements are performed at different pump powers and resonant wavelengths for the uniformly coated MRRs with 1 to 5 layers of GO as well as the patterned devices with 10 to 50 layers of GO. The experimental results show good agreement with theory, achieving up to 7.6 dB enhancement in the FWM conversion efficiency (CE) for an MRR uniformly coated with 1 layer of GO and 10.3 dB for a patterned device with 50 layers of GO. By fitting the measured CE as a function of pump power for devices with different numbers of GO layers, we also extract the dependence of the third order nonlinearity on layer number and pump power, revealing interesting physical insights about the evolution of the layered GO films from 2D monolayers to quasi bulk like behavior. These results confirm the high nonlinear optical performance of integrated photonic resonators incorporated with 2D layered GO films.


Capacity and Price Competition in Markets with Congestion Effects. We study oligopolistic competition in service markets where firms offer a service to customers. The service quality of a firm from the perspective of a customer depends on the congestion and the charged price. A firm can set a price for the service offered and additionally decides on the service capacity in order to mitigate congestion. The total profit of a firm is derived from the gained revenue minus the capacity investment cost. Firms simultaneously set capacities and prices in order to maximize their profit and customers subsequently choose the services with lowest combined cost (congestion and price). For this basic model, Johari et al. (2010) derived the first existence and uniqueness results of pure Nash equilibria (PNE) assuming mild conditions on congestion functions. Their existence proof relies on Kakutani's fixed point theorem and a key assumption for the theorem to work is that demand for service is elastic (modeled by a smooth and strictly decreasing inverse demand function). In this paper, we consider the case of perfectly inelastic demand, i.e. there is a fixed volume of customers requesting service. This scenario applies to realistic cases where customers are not willing to drop out of the market, e.g. if prices are regulated by reasonable price caps. We investigate existence, uniqueness and quality of PNE for models with inelastic demand and price caps. We show that for linear congestion cost functions, there exists a PNE. This result requires a completely new proof approach compared to previous approaches, since the best response correspondences of firms may be empty, thus standard fixed point arguments are not directly applicable. We show that the game is C secure (see McLennan et al. (2011)), which leads to the existence of PNE. We furthermore show that the PNE is unique, and that the efficiency compared to a social optimum is unbounded in general.


On algebra of big zeta values. The algebra of big zeta values we introduce in this paper is an intermediate object between multiple zeta values and periods of the multiple zeta motive. It consists of number series generalizing multiple zeta values, the simplest examples, which are not multiple zeta series, are Tornheim sums. We show that convergent big zeta values are periods of the moduli space of stable curves of genus zero on one hand and multiple zeta values on the other hand. It gives an alternative way to prove that any such period may be expressed as a rational linear combination of multiple zeta values and a simple algorithm for finding such an expression.


Cosheaf Theory and Overconvergent Verdier Duality for Rigid Analytic Spaces. This paper develops aspects of cosheaf theory on rigid analytic spaces, and demonstrates a sheaf cosheaf Verdier duality equivalence theorem for overconvergent sheaves on separated, paracompact spaces, analogous to Jacob Lurie's treatment of Verdier duality for locally compact, Hausdorff topological spaces.


Emotions Don't Lie An Audio Visual Deepfake Detection Method Using Affective Cues. We present a learning based method for detecting real and fake deepfake multimedia content. To maximize information for learning, we extract and analyze the similarity between the two audio and visual modalities from within the same video. Additionally, we extract and compare affective cues corresponding to perceived emotion from the two modalities within a video to infer whether the input video is "real" or "fake". We propose a deep learning network, inspired by the Siamese network architecture and the triplet loss. To validate our model, we report the AUC metric on two large scale deepfake detection datasets, DeepFake TIMIT Dataset and DFDC. We compare our approach with several SOTA deepfake detection methods and report per video AUC of 84.4 on the DFDC and 96.6 on the DF TIMIT datasets, respectively. To the best of our knowledge, ours is the first approach that simultaneously exploits audio and video modalities and also perceived emotions from the two modalities for deepfake detection.


Derived PD Hirsch extensions of filtered crystalline complexes and filtered crysalline dga's. We construct a theory of the derived PD Hirsch extension of the log crystalline complex of a log smooth scheme and we construct a fundamental filtered dga (H rm zar , rm TW ,P) and a fundamental filtered complex (H rm zar ,P) for a simple normal crossing log scheme X over a family of log points by using the log crystalline method in order to overcome obstacles arising from the incompatibility of the p adic Steenbrink complexes in M and Nak4 with the cup product of the log crystalline complex of X . When the base log scheme is the log point of a perfect field of characteristic p 0 , we prove that (H rm zar , rm TW ,P) and (H rm zar ,P) is canonically isomorphic to Kim and Hain's filtered dga and their filtered complex in KH , respectively.


Translation, Sentiment and Voices A Computational Model to Translate and Analyse Voices from Real Time Video Calling. With internet quickly becoming an easy access to many, voice calling over internet is slowly gaining momentum. Individuals has been engaging in video communication across the world in different languages. The decade saw the emergence of language translation using neural networks as well. With more data being generated in audio and visual forms, there has become a need and a challenge to analyse such information for many researchers from academia and industry. The availability of video chat corpora is limited as organizations protect user privacy and ensure data security. For this reason, an audio visual communication system (VidALL) has been developed and audio speeches were extracted. To understand human nature while answering a video call, an analysis was conducted where polarity and vocal intensity were considered as parameters. Simultaneously, a translation model using a neural approach was developed to translate English sentences to French. Simple RNN based and Embedded RNN based models were used for the translation model. BLEU score and target sentence comparators were used to check sentence correctness. Embedded RNN showed an accuracy of 88.71 percentage and predicted correct sentences. A key finding suggest that polarity is a good estimator to understand human emotion.


Mesoscopic modeling of heptane A surface tension calculation. Accurate and efficient flow models for hydrocarbons are important in the development of enhanced geotechnical engineering for energy source recovery and carbon capture storage in low porosity, low permeability rock formations. This work reports an atomistically validated, mesoscopic model for heptane based on a many body dissipative particle dynamics (mDPD) method. In this model, each heptane molecule is coarse grained in one mDPD bead and the mDPD model parameters are calibrated with a rigorous approach using reference data, including experimental measurements and or molecular dynamics (MD) simulations. Results show that this mDPD model accurately predicts the bulk pressure density relation of heptane and surface tension. Notice that our approach can be used to calibrate the mDPD model for other hydrocarbons as well, though heptane is chosen as a representative source fluid for its abundance in source rocks. Further, our timing test indicates that the mDPD model is three orders of magnitude faster than its MD counterpart for simulations of bulk heptane in equivalent volumes. Overall, this work serves as a key prerequisite for the development of accurate and efficient mesoscale models for the flow of hydrocarbons confined in mesoporous rock formations.


On the Leaders' Graphical Characterization for Controllability of Path Related Graphs. The problem of leaders location plays an important role in the controllability of undirected graphs.The concept of minimal perfect critical vertex set is introduced by drawing support from the eigenvector of Laplace matrix. Using the notion of minimal perfect critical vertex set, the problem of finding the minimum number of controllable leader vertices is transformed into the problem of finding all minimal perfect critical vertex sets. Some necessary and sufficient conditions for special minimal perfect critical vertex sets are provided, such as minimal perfect critical 2 vertex set, and minimal perfect critical vertex set of path or path related graphs. And further, the leaders location problem for path graphs is solved completely by the algorithm provided in this paper. An interesting result that there never exist a minimal perfect critical 3 vertex set is proved, too.


Machine learning materials physics Multi resolution neural networks learn the free energy and nonlinear elastic response of evolving microstructures. Many important multi component crystalline solids undergo mechanochemical spinodal decomposition a phase transformation in which the compositional redistribution is coupled with structural changes of the crystal, resulting in dynamically evolving microstructures. The ability to rapidly compute the macroscopic behavior based on these detailed microstructures is of paramount importance for accelerating material discovery and design. Here, our focus is on the macroscopic, nonlinear elastic response of materials harboring microstructure. Because of the diversity of microstructural patterns that can form, there is interest in taking a purely computational approach to predicting their macroscopic response. However, the evaluation of macroscopic, nonlinear elastic properties purely based on direct numerical simulations (DNS) is computationally very expensive, and hence impractical for material design when a large number of microstructures need to be tested. A further complexity of a hierarchical nature arises if the elastic free energy and its variation with strain is a small scale fluctuation on the dominant trajectory of the total free energy driven by microstructural dynamics. To address these challenges, we present a data driven approach, which combines advanced neural network (NN) models with DNS to predict the homogenized, macroscopic, mechanical free energy and stress fields arising in a family of multi component crystalline solids that develop microstructure. The hierarchical structure of the free energy's evolution induces a multi resolution character to the machine learning paradigm We construct knowledge based neural networks (KBNNs) with either pre trained fully connected deep neural networks (DNNs), or pre trained convolutional neural networks (CNNs) that describe the dominant characteristic of the data to fully represent the hierarchically evolving free energy.


The prestige and status of research fields within mathematics. While the hierarchy of science'' has been widely analysed, there is no corresponding study of the status of subfields within a given scientific field. We use bibliometric data to show that subfields of mathematics have a different standing'' within the mathematics community. Highly ranked departments tend to specialize in some subfields more than in others, and the same subfields are also over represented in the most selective mathematics journals or among recipients of top prizes. Moreover this status of subfields evolves markedly over the period of observation (1984 2016), with some subfields gaining and others losing in standing. The status of subfields is related to different publishing habits, but some of those differences are opposite to those observed when considering the hierarchy of scientific fields. We examine possible explanations for the status'' of different subfields. Some natural explanations availability of funding, importance of applications do not appear to function, suggesting that factors internal to the discipline are at work. We propose a different type of explanation, based on a notion of focus'' of a subfield, that might or might not be specific to mathematics.


An Asymptotic Form of the Generating Function prod k 1 infty (1 x k k) . It is shown that the sequence of rational numbers r(k) generated by the ordinary generating function prod k 1 infty (1 x k k) converges to a limit C 0 . C can be expressed as C exp Bigl( sum k 2 infty frac ( 1) k k zeta(k) Bigr) where zeta() denotes the Riemann zeta function.


The Newer College Dataset Handheld LiDAR, Inertial and Vision with Ground Truth. In this paper we present a large dataset with a variety of mobile mapping sensors collected using a handheld device carried at typical walking speeds for nearly 2.2 km through New College, Oxford. The dataset includes data from two commercially available devices a stereoscopic inertial camera and a multi beam 3D LiDAR, which also provides inertial measurements. Additionally, we used a tripod mounted survey grade LiDAR scanner to capture a detailed millimeter accurate 3D map of the test location (containing sim 290 million points). Using the map we inferred centimeter accurate 6 Degree of Freedom (DoF) ground truth for the position of the device for each LiDAR scan to enable better evaluation of LiDAR and vision localisation, mapping and reconstruction systems. This ground truth is the particular novel contribution of this dataset and we believe that it will enable systematic evaluation which many similar datasets have lacked. The dataset combines both built environments, open spaces and vegetated areas so as to test localization and mapping systems such as vision based navigation, visual and LiDAR SLAM, 3D LIDAR reconstruction and appearance based place recognition. The dataset is available at ori.ox.ac.uk datasets newer college dataset


On the number of intersection points of lines and circles in mathbb R 3 . We consider the following question Given n lines and n circles in mathbb R 3 , what is the maximum number of intersection points lying on at least one line and on at least one circle of these families. We prove that if there are no n 1 2 curves (lines or circles) lying on an algebraic surface of degree at most two, then the number of these intersection points is O(n 3 2 ) .


No Jackson type estimates for piecewise q monotone, q ge3 , trigonometric approximation. We say that a function f in C a,b is q monotone, q ge3 , if f in C q 2 (a,b) and f (q 2) is convex in (a,b) . Let f be continuous and 2 pi periodic, and change its q monotonicity finitely many times in pi, pi . We are interested in estimating the degree of approximation of f by trigonometric polynomials which are co q monotone with it, namely, trigonometric polynomials that change their q monotonicity exactly at the points where f does. Such Jackson type estimates are valid for piecewise monotone ( q 1 ) and piecewise convex (q 2) approximations. However, we prove, that no such estimates are valid, in general, for co q monotone approximation, when q ge3 .


How do eyes and brain search a randomly structured uninformative scene? Exploiting a basic interplay of attention and memory. We tracked the eye movements of seven young and seven older adults performing a conjunctive visual search task similar to that performed by two highly trained monkeys in an original influential study of Motter and Belky (1998a, 1998b). We obtained results consistent with theirs regarding elements of perception, selection, attention and object recognition, but we found a much greater role played by long range memory. A design inadequacy in the original Motter Belky study is not sufficient to explain such discrepancy, nor is the high level of training of their monkeys. Perhaps monkeys and humans do not use mnemonic resources compatibly already in basic visual search tasks, contrary to a common expectation, further supported by cortical representation studies. We also found age related differences in various measures of eye movements, consistently indicating slightly reduced conspicuity areas for the older adults, hence, correspondingly reduced processing and memory capacities. However, because of sample size and age differential limitations, statistically significant differences were found only for a few variables, most notably overall reaction times. Results reported here provide the basis for demonstrating the formation of spiraling or circulating patterns in the eye movement trajectories and for developing corresponding computational models and simulations.


Differential graded Lie groups and their differential graded Lie algebras. In this paper we discuss the question of integrating differential graded Lie algebras (DGLA) to differential graded Lie groups (DGLG). We first recall the classical problem of integration in the context, and present the construction for (non graded) differential Lie algebras. Then, we define the category of differential graded Lie groups and study its properties. We show how to associate a differential graded Lie algebra to every differential graded Lie group and vice versa. For the DGLA to DGLG direction, the main tools'' are graded Hopf algebras and Harish Chandra pairs (HCP) we define the category of graded and differential graded HCPs and explain how those are related to the desired construction. We describe some near at hand examples and mention possible generalizations.


Is Each Layer Non trivial in CNN?. Convolutional neural network (CNN) models have achieved great success in many fields. With the advent of ResNet, networks used in practice are getting deeper and wider. However, is each layer non trivial in networks? To answer this question, we trained a network on the training set, then we replace the network convolution kernels with zeros and test the result models on the test set. We compared experimental results with baseline and showed that we can reach similar or even the same performances. Although convolution kernels are the cores of networks, we demonstrate that some of them are trivial and regular in ResNet.


Maximum time step for the BDF3 scheme applied to gradient flows. For backward differentiation formulae (BDF) applied to gradient flows of semiconvex functions, quadratic stability implies the existence of a Lyapunov functional. We compute the maximum time step which can be derived from quadratic stability for the 3 step BDF method (BDF3). Applications to the asymptotic behaviour of sequences generated by the BDF3 scheme are given.


When Costly Punishment Becomes Evolutionarily Beneficial. Cooperation in evolutionary biology means paying a cost, c, to enjoy benefits, b. A defector is one who does not pay any cost but enjoys the benefits of cooperators. Human societies, especially, have evolved a strategy to discourage defection, punishment. Costly punishment is a type of punishment where an agent in a biological network or some cooperative scheme pays a cost to ensure another agent incurs some cost. A previous study shows how parameters like diversity in neighbors across games, density of connectivity, and costly punishment influence the evolution of cooperation in non regular networks. In this study, evolution in regular networks due to the influence of costly punishment is also considered, specifically spatial lattices. This study compares observations between non regular and regular networks as these parameters change and brings a clearer understanding of interactions that occur in these networks. The models, results and analysis bring a new understanding to game theory and punishment. The results show that costly punishment never arises as a sole evolutionary strategy. However, in evolutionary games where costly punishers could evolve more favorable strategies, the initial presence of costly punishers would bring about high average payoffs in all types of regular networks and heterogeneous networks. In regular networks, every node has the same degree, k. Although punishment is conventionally thought to be anti progressive, in the presence of diversity in neighbors, it magnifies the payoff of a group for all heterogeneous networks. In regular networks however, diversity in neighbors is not required for costly punishment to boost average payoff. This suggests an answer to the question on why costly punishment has been favored by natural selection, which is particularly obvious in human populations.


Random discrete concave functions on an equilateral lattice with periodic Hessians. Motivated by connections to random matrices, Littlewood Richardson coefficients and tilings, we study random discrete concave functions on an equilateral lattice. We show that such functions having a periodic Hessian of a fixed average value s concentrate around a quadratic function. We consider the set of all concave functions g on an equilateral lattice mathbb L that when shifted by an element of n mathbb L have a periodic discrete Hessian, with period n mathbb L . We add a convex quadratic of Hessian s the sum is then periodic with period n mathbb L , and view this as a mean zero function g on the set of vertices V( mathbb T n) of a torus mathbb T n frac mathbb Z n mathbb Z times frac mathbb Z n mathbb Z whose Hessian is dominated by s . The resulting set of semiconcave functions forms a convex polytope P n(s) . The ell infty diameter of P n(s) is bounded below by c(s) n 2 , where c(s) is a positive constant depending only on s . Our main result is that under certain conditions, that are met for example when s 0 s 1 leq s 2 , for any epsilon 0, we have lim n rightarrow 0 mathbb P left g infty n frac 7 4 epsilon right 0 if g is sampled from the uniform measure on P n(s) . Each g in P n(s) corresponds to a kind of honeycomb. We obtain concentration results for these as well.


Mixed precision matrix interpolative decompositions for model reduction. Renewed interest in mixed precision algorithms has emerged due to growing data capacity and bandwidth concerns, as well as the advancement of GPUs, which enable significant speedup for low precision arithmetic. In light of this, we propose a mixed precision algorithm to generate a double precision accurate matrix interpolative decomposition approximation under a given set of criteria. Though low precision arithmetic suffers from quicker accumulation of round off error, for many data rich applications we nevertheless attain viable approximation accuracy, as the error incurred using low precision arithmetic is dominated by the error inherent to low rank approximation. We then conduct several simulated numerical tests to demonstrate the efficacy of the algorithms and the corresponding error estimates. Finally, we present the application of our algorithms to a problem in model reduction for particle laden turbulent flow.


Accelerated Dual Averaging Methods for Decentralized Constrained Optimization. In this work, we study decentralized convex constrained optimization problems in networks. We focus on the dual averaging based algorithmic framework that is well documented to be superior in handling constraints and complex communication environments simultaneously. Two new decentralized dual averaging (DDA) algorithms are proposed. In the first one, a second order dynamic average consensus protocol is tailored for DDA type algorithms, which equips each agent with a provably more accurate estimate of the global dual variable than conventional schemes. We rigorously prove that the proposed algorithm attains mathcal O (1 t) convergence for general convex and smooth problems, for which existing DDA methods were only known to converge at mathcal O (1 sqrt t ) prior to our work. In the second one, we use the extrapolation technique to accelerate the convergence of DDA. Compared to existing accelerated algorithms, where typically two different variables are exchanged among agents at each time, the proposed algorithm only seeks consensus on local gradients. Then, the extrapolation is performed based on two sequences of primal variables which are determined by the accumulations of gradients at two consecutive time instants, respectively. The algorithm is proved to converge at mathcal O (1) left( frac 1 t 2 frac 1 t(1 beta) 2 right) , where beta denotes the second largest singular value of the mixing matrix. We remark that the condition for the algorithmic parameter to guarantee convergence does not rely on the spectrum of the mixing matrix, making itself easy to satisfy in practice. Finally, numerical results are presented to demonstrate the efficiency of the proposed methods.


Local Uniqueness of Ground States for Rotating Bose Einstein Condensates with Attractive Interactions. We study ground states of two dimensional Bose Einstein condensates with attractive interactions in a trap V(x) rotating at the velocity Omega . It is known that there exist a critical rotational velocity 0 Omega Omega (V) leq infty and a critical number 0 a infty such that for any rotational velocity 0 le Omega Omega , ground states exist if and only if the coupling constant a satisfies a a . For a general class of traps V(x) , which may not be symmetric, we prove in this paper that up to a constant phase, there exists a unique ground state as a nearrow a , where Omega in(0, Omega ) is fixed. This result extends essentially our recent uniqueness result, where only the radially symmetric traps V(x) could be handled with.


On Azuma type inequalities for Banach space valued martingales. In this paper, we will study concentration inequalities for Banach space valued martingales. Firstly, we prove that a Banach space X is linearly isomorphic to a p uniformly smooth space ( 1 p leq 2 ) if and only if an Azuma type inequality holds for X valued martingales. This can be viewed as a generalization of Pinelis' work on Azuma inequality for martingales with values in 2 uniformly smooth space. Secondly, Azuma type inequality for self normalized sums will be presented. Finally, some further inequalities for Banach space valued martingales, such as moment inequalities for double indexed dyadic martingales and the De la Pe n a type inequalities for conditionally symmetric martingales, will also be discussed.


CNN based Steganalysis and Parametric Adversarial Embedding a Game Theoretic Framework. CNN based steganalysis has recently achieved very good performance in detecting content adaptive steganography. At the same time, recent works have shown that, by adopting an approach similar to that used to build adversarial examples, a steganographer can adopt an adversarial embedding strategy to effectively counter a target CNN steganalyzer. In turn, the good performance of the steganalyzer can be restored by retraining the CNN with adversarial stego images. A problem with this model is that, arguably, at training time the steganalizer is not aware of the exact parameters used by the steganograher for adversarial embedding and, vice versa, the steganographer does not know how the images that will be used to train the steganalyzer are generated. In order to exit this apparent deadlock, we introduce a game theoretic framework wherein the problem of setting the parameters of the steganalyzer and the steganographer is solved in a strategic way. More specifically, a non zero sum game is first formulated to model the problem, and then instantiated by considering a specific adversarial embedding scheme setting its operating parameters in a game theoretic fashion. Our analysis shows that the equilibrium solution of the non zero sum game can be conveniently found by solving an associated zero sum game, thus reducing greatly the complexity of the problem. Then we run several experiments to derive the optimum strategies for the steganographer and the staganalyst in a game theoretic sense, and to evaluate the performance of the game at the equilibrium, characterizing the loss with respect to the conventional non adversarial case. Eventually, by leveraging on the analysis of the equilibrium point of the game, we introduce a new strategy to improve the reliability of the steganalysis, which shows the benefits of addressing the security issue in a game theoretic perspective.


Posterior Re calibration for Imbalanced Datasets. Neural Networks can perform poorly when the training label distribution is heavily imbalanced, as well as when the testing data differs from the training distribution. In order to deal with shift in the testing label distribution, which imbalance causes, we motivate the problem from the perspective of an optimal Bayes classifier and derive a post training prior rebalancing technique that can be solved through a KL divergence based optimization. This method allows a flexible post training hyper parameter to be efficiently tuned on a validation set and effectively modify the classifier margin to deal with this imbalance. We further combine this method with existing likelihood shift methods, re interpreting them from the same Bayesian perspective, and demonstrating that our method can deal with both problems in a unified way. The resulting algorithm can be conveniently used on probabilistic classification problems agnostic to underlying architectures. Our results on six different datasets and five different architectures show state of art accuracy, including on large scale imbalanced datasets such as iNaturalist for classification and Synthia for semantic segmentation. Please see https github.com GT RIPL UNO IC.git for implementation.


The annihilation number does not bound the 2 domination number from the above. The 2 domination number gamma 2(G) of a graph G is the minimum cardinality of a set S subseteq V(G) such that every vertex from V(G) setminus S is adjacent to at least two vertices in S . The annihilation number a(G) is the largest integer k such that the sum of the first k terms of the non decreasing degree sequence of G is at most the number of its edges. It was conjectured that gamma 2(G) leq a(G) 1 holds for every connected graph G . The conjecture was earlier confirmed, in particular, for graphs of minimum degree 3 , for trees, and for block graphs. In this paper, we disprove the conjecture by proving that the 2 domination number can be arbitrarily larger than the annihilation number. On the positive side we prove the conjectured bound for a large subclass of bipartite, connected cacti, thus generalizing a result of Jakovac from Discrete Appl. Math. 260 (2019) 178 187 .


Automatic Analysis of Sewer Pipes Based on Unrolled Monocular Fisheye Images. The task of detecting and classifying damages in sewer pipes offers an important application area for computer vision algorithms. This paper describes a system, which is capable of accomplishing this task solely based on low quality and severely compressed fisheye images from a pipe inspection robot. Relying on robust image features, we estimate camera poses, model the image lighting, and exploit this information to generate high quality cylindrical unwraps of the pipes' surfaces.Based on the generated images, we apply semantic labeling based on deep convolutional neural networks to detect and classify defects as well as structural elements.


Large scale parallel server system with multi component jobs. A broad class of parallel server systems is considered, for which we prove the steady state asymptotic independence of server workloads, as the number of servers goes to infinity, while the system load remains sub critical. Arriving jobs consist of multiple components. There are multiple job classes, and each class may be of one of two types, which determines the rule according to which the job components add workloads to the servers. The model is broad enough to include as special cases some popular queueing models with redundancy, such as cancel on start and cancel on completion redundancy. Our analysis uses mean field process representation and the corresponding mean field limits. In essence, our approach relies almost exclusively on three fundamental properties of the model (a) monotonicity, (b) work conservation, (c) the property that, on average, "new arriving workload prefers to go to servers with lower workloads."


Rainbow cycles vs. rainbow paths. An edge colored graph F is it rainbow if each edge of F has a unique color. The it rainbow Tur 'an number mathrm ex (n,F) of a graph F is the maximum possible number of edges in a properly edge colored n vertex graph with no rainbow copy of F . The study of rainbow Tur 'an numbers was introduced by Keevash, Mubayi, Sudakov, and Verstra "ete. Johnson and Rombach introduced the following rainbow version of generalized Tur 'an problems for fixed graphs H and F , let mathrm ex (n,H,F) denote the maximum number of rainbow copies of H in an n vertex properly edge colored graph with no rainbow copy of F . In this paper we investigate the case mathrm ex (n,C ell,P ell) and give a general upper bound as well as exact results for ell 3,4,5 . Along the way we establish a new best upper bound on mathrm ex (n,P 5) . Our main motivation comes from an attempt to improve bounds on mathrm ex (n,P ell) , which has been the subject of several recent manuscripts.


High Reynolds number Taylor Couette turbulence. Taylor Couette flow the flow between two coaxial co or counter rotating cylinders is one of the paradigmatic systems in physics of fluids. The (dimensionless) control parameters are the Reynolds numbers of the inner and outer cylinder, the ratio of the cylinder radii, and the aspect ratio. The response of the system is the torque required to retain constant angular velocities, which can be connected to the angular velocity transport through the gap. While the low Reynolds number regime has been very well explored in the '80s and '90s of the last century, in the fully turbulent regime major research activity only developed in the last decade. In this paper we review this recent progress in our understanding of fully developed Taylor Couette turbulence, from the experimental, numerical, and theoretical point of view. We will focus on the parameter dependence of the global torque and on the local flow organisation, including velocity profiles and boundary layers. Next, we will discuss transitions between different (turbulent) flow states. We will also elaborate on the relevance of this system for astrophysical disks (Keplerian flows). The review ends with a list of challenges for future research on turbulent Taylor Couette flow. The published version in ARFM Annu. Rev. Fluid Mech. 48 53 80 (2016).


Seeing Both the Forest and the Trees Multi head Attention for Joint Classification on Different Compositional Levels. In natural languages, words are used in association to construct sentences. It is not words in isolation, but the appropriate combination of hierarchical structures that conveys the meaning of the whole sentence. Neural networks can capture expressive language features however, insights into the link between words and sentences are difficult to acquire automatically. In this work, we design a deep neural network architecture that explicitly wires lower and higher linguistic components we then evaluate its ability to perform the same task at different hierarchical levels. Settling on broad text classification tasks, we show that our model, MHAL, learns to simultaneously solve them at different levels of granularity by fluidly transferring knowledge between hierarchies. Using a multi head attention mechanism to tie the representations between single words and full sentences, MHAL systematically outperforms equivalent models that are not incentivized towards developing compositional representations. Moreover, we demonstrate that, with the proposed architecture, the sentence information flows naturally to individual words, allowing the model to behave like a sequence labeller (which is a lower, word level task) even without any word supervision, in a zero shot fashion.


Towards Building Knowledge by Merging Multiple Ontologies with CoMerger A Partitioning based Approach. Ontologies are the prime way of organizing data in the Semantic Web. Often, it is necessary to combine several, independently developed ontologies to obtain a knowledge graph fully representing a domain of interest. The complementarity of existing ontologies can be leveraged by merging them. Existing approaches for ontology merging mostly implement a binary merge. However, with the growing number and size of relevant ontologies across domains, scalability becomes a central challenge. A multi ontology merging technique offers a potential solution to this problem. We present CoMerger, a scalable multiple ontologies merging method. For efficient processing, rather than successively merging complete ontologies pairwise, we group related concepts across ontologies into partitions and merge first within and then across those partitions. The experimental results on well known datasets confirm the feasibility of our approach and demonstrate its superiority over binary strategies. A prototypical implementation is freely accessible through a live web portal.


Burnett Spectral Method for High Speed Rarefied Gas Flows. We introduce a numerical solver for the spatially inhomogeneous Boltzmann equation using the Burnett spectral method. The modelling and discretization of the collision operator are based on the previous work Z. Cai, Y. Fan, and Y. Wang, Burnett spectral method for the spatially homogeneous Boltzmann equation, arXiv 1810.07804 , which is the hybridization of the BGK operator for higher moments and the quadratic collision operator for lower moments. To ensure the preservation of the equilibrium state, we introduce an additional term to the discrete collision operator, which equals zero when the number of degrees of freedom tends to infinity. Compared with the previous work Z. Hu, Z. Cai, and Y. Wang,Numerical simulation of microflows using Hermite spectral methods, arXiv 1807.06236 , the computational cost is reduced by one order. Numerical experiments such as shock structure calculation and Fourier flows are carried out to show the efficiency and accuracy of our numerical method.


Advection diffusion equations with Sobolev velocity field. In this note we study advection diffusion equations associated to incompressible W 1,p velocity fields with p 2 . We present new estimates on the energy dissipation rate and we discuss applications to the study of upper bounds on the enhancing dissipation rate, lower bounds on the L 2 norm of the density, and quantitative vanishing viscosity estimates. The key tools employed in our argument are a propagation of regularity result, coming from the study of transport equations, and a new result connecting the energy dissipation rate to regularity estimates for transport equations. Eventually we provide examples which underline the sharpness of our estimates.


Pell surfaces. In 1826 Abel started the study of the polynomial Pell equation x 2 g(u)y 2 1 . Its solvability in polynomials x(u), y(u) depends on a certain torsion point on the Jacobian of the hyperelliptic curve v 2 g(u) . In this paper we study the affine surfaces defined by the Pell equations in 3 space with coordinates x, y,u , and aim to describe all affine lines on it. These are polynomial solutions of the equation x(t) 2 g(u(t))y(t) 2 1 . Our results are rather complete when the degree of g is even but the odd degree cases are left completely open. For even degrees we also describe all curves on these Pell surfaces that have only 1 place at infinity.


A multi layer approach to disinformation detection on Twitter. We tackle the problem of classifying news articles pertaining to disinformation vs mainstream news by solely inspecting their diffusion mechanisms on Twitter. Our technique is inherently simple compared to existing text based approaches, as it allows to by pass the multiple levels of complexity which are found in news content (e.g. grammar, syntax, style). We employ a multi layer representation of Twitter diffusion networks, and we compute for each layer a set of global network features which quantify different aspects of the sharing process. Experimental results with two large scale datasets, corresponding to diffusion cascades of news shared respectively in the United States and Italy, show that a simple Logistic Regression model is able to classify disinformation vs mainstream networks with high accuracy (AUROC up to 94 ), also when considering the political bias of different sources in the classification task. We also highlight differences in the sharing patterns of the two news domains which appear to be country independent. We believe that our network based approach provides useful insights which pave the way to the future development of a system to detect misleading and harmful information spreading on social media.


Phase transition for the non symmetric Continuum Potts model. We prove phase transition for the non symmetric continuum Potts model with background interaction, by generalizing the methods introduced in the symmetric case by Georgii and H "aggstr "om. The proof relies on a Fortuin Kasteleyn representation, percolation and stochastic domination arguments.


Deep Declarative Networks A New Hope. We explore a new class of end to end learnable models wherein data processing nodes (or network layers) are defined in terms of desired behavior rather than an explicit forward function. Specifically, the forward function is implicitly defined as the solution to a mathematical optimization problem. Consistent with nomenclature in the programming languages community, we name these models deep declarative networks. Importantly, we show that the class of deep declarative networks subsumes current deep learning models. Moreover, invoking the implicit function theorem, we show how gradients can be back propagated through many declaratively defined data processing nodes thereby enabling end to end learning. We show how these declarative processing nodes can be implemented in the popular PyTorch deep learning software library allowing declarative and imperative nodes to co exist within the same network. We also provide numerous insights and illustrative examples of declarative nodes and demonstrate their application for image and point cloud classification tasks.


Near Optimal Reactive Synthesis Incorporating Runtime Information. We consider the problem of optimal reactive synthesis compute a strategy that satisfies a mission specification in a dynamic environment, and optimizes a performance metric. We incorporate task critical information, that is only available at runtime, into the strategy synthesis in order to improve performance. Existing approaches to utilising such time varying information require online re synthesis, which is not computationally feasible in real time applications. In this paper, we pre synthesize a set of strategies corresponding to candidate instantiations (pre specified representative information scenarios). We then propose a novel switching mechanism to dynamically switch between the strategies at runtime while guaranteeing all safety and liveness goals are met. We also characterize bounds on the performance suboptimality. We demonstrate our approach on two examples robotic motion planning where the likelihood of the position of the robot's goal is updated in real time, and an air traffic management problem for urban air mobility.


A Core Calculus for Static Latency Tracking with Placement Types. Developing efficient geo distributed applications is challenging as programmers can easily introduce computations that entail high latency communication. We propose a language design which makes latency explicit and extracts type level bounds for a computation's runtime latency. We present our initial steps with a core calculus that enables extracting provably correct latency bounds and outline future work.


The Art of Social Bots A Review and a Refined Taxonomy. Social bots represent a new generation of bots that make use of online social networks (OSNs) as a command and control (C C) channel. Malicious social bots were responsible for launching large scale spam campaigns, promoting low cap stocks, manipulating user's digital influence and conducting political astroturf. This paper presents a detailed review on current social bots and proper techniques that can be used to fly under the radar of OSNs defences to be undetectable for long periods of time. We also suggest a refined taxonomy of detection approaches from social network perspective, as well as commonly used datasets and their corresponding findings. Our study can help OSN administrators and researchers understand the destructive potential of malicious social bots and can improve the current defence strategies against them.


Dimensions of modular irreducible representations of semisimple Lie algebras. In this paper we classify and give Kazhdan Lusztig type character formulas for equivariantly irreducible representations of Lie algebras of reductive algebraic groups over a field of large positive characteristic. The equivariance is with respect to a group whose connected component is a torus. Character computation is done in two steps. First, we treat the case of distinguished p characters those that are not contained in a proper Levi. Here we essentially show that the category of equivariant modules we consider is a cell quotient of an affine parabolic category mathcal O . For this, we prove an equivalence between two categorifications of a parabolically induced module over the affine Hecke algebra conjectured by the first named author. For the general nilpotent p character, we get character formulas by explicitly computing the duality operator on a suitable equivariant K group.


Social Media Information Sharing for Natural Disaster Response. Social media has become an essential channel for posting disaster related information, which provide governments and relief agencies real time data for better disaster management. However, research in this field has not received sufficient attention and extracting useful information is still challenging. This paper aims to improve disaster relief efficiency via mining and analyzing social media data like public attitudes towards disaster response and public demands for targeted relief supplies during different types of disasters. We focus on different natural disasters based on properties such as types, durations, and damages, which contains a total of 41,993 tweets. In this paper, public perception is assessed qualitatively by manually classified tweets, which contain information like the demand for targeted relief supplies, satisfactions of disaster response, and public fear. Public attitudes to natural disasters are studied via a quantitative analysis using eight machine learning models. To better provide decision makers with the appropriate model, the comparison of machine learning models based on computational time and prediction accuracy is conducted. The change of public opinion during different natural disasters and the evolution of people's behavior of using social media for disaster relief in the face of the identical type of natural disasters as Twitter continues to evolve are studied. The results in this paper demonstrate the feasibility and validation of the proposed research approach and provide relief agencies with insights into better disaster management.


Gated Convolutional Bidirectional Attention based Model for Off topic Spoken Response Detection. Off topic spoken response detection, the task aiming at predicting whether a response is off topic for the corresponding prompt, is important for an automated speaking assessment system. In many real world educational applications, off topic spoken response detectors are required to achieve high recall for off topic responses not only on seen prompts but also on prompts that are unseen during training. In this paper, we propose a novel approach for off topic spoken response detection with high off topic recall on both seen and unseen prompts. We introduce a new model, Gated Convolutional Bidirectional Attention based Model (GCBiA), which applies bi attention mechanism and convolutions to extract topic words of prompts and key phrases of responses, and introduces gated unit and residual connections between major layers to better represent the relevance of responses and prompts. Moreover, a new negative sampling method is proposed to augment training data. Experiment results demonstrate that our novel approach can achieve significant improvements in detecting off topic responses with extremely high on topic recall, for both seen and unseen prompts.


RecNMP Accelerating Personalized Recommendation with Near Memory Processing. Personalized recommendation systems leverage deep learning models and account for the majority of data center AI cycles. Their performance is dominated by memory bound sparse embedding operations with unique irregular memory access patterns that pose a fundamental challenge to accelerate. This paper proposes a lightweight, commodity DRAM compliant, near memory processing solution to accelerate personalized recommendation inference. The in depth characterization of production grade recommendation models shows that embedding operations with high model , operator and data level parallelism lead to memory bandwidth saturation, limiting recommendation inference performance. We propose RecNMP which provides a scalable solution to improve system throughput, supporting a broad range of sparse embedding models. RecNMP is specifically tailored to production environments with heavy co location of operators on a single server. Several hardware software co optimization techniques such as memory side caching, table aware packet scheduling, and hot entry profiling are studied, resulting in up to 9.8x memory latency speedup over a highly optimized baseline. Overall, RecNMP offers 4.2x throughput improvement and 45.8 memory energy savings.


Dreaming machine learning Lipschitz extensions for reinforcement learning on financial markets. We consider a quasi metric topological structure for the construction of a new reinforcement learning model in the framework of financial markets. It is based on a Lipschitz type extension of reward functions defined in metric spaces. Specifically, the McShane and Whitney extensions are considered for a reward function which is defined by the total evaluation of the benefits produced by the investment decision at a given time. We define the metric as a linear combination of a Euclidean distance and an angular metric component. All information about the evolution of the system from the beginning of the time interval is used to support the extension of the reward function, but in addition this data set is enriched by adding some artificially produced states. Thus, the main novelty of our method is the way we produce more states which we call "dreams" to enrich learning. Using some known states of the dynamical system that represents the evolution of the financial market, we use our technique to simulate new states by interpolating real states and introducing some random variables. These new states are used to feed a learning algorithm designed to improve the investment strategy by following a typical reinforcement learning scheme.


RAIST Learning Risk Aware Traffic Interactions via Spatio Temporal Graph Convolutional Networks. A key aspect of driving a road vehicle is to interact with the other road users, assess their intentions and make risk aware tactical decisions. An intuitive approach of enabling an intelligent automated driving system would be to incorporate some aspects of the human driving behavior. To this end, we propose a novel driving framework for egocentric views, which is based on spatio temporal traffic graphs. The traffic graphs not only model the spatial interactions amongst the road users, but also their individual intentions through temporally associated message passing. We leverage spatio temporal graph convolutional network (ST GCN) to train the graph edges. These edges are formulated using parameterized functions of 3D positions and scene aware appearance features of road agents. Along with tactical behavior prediction, it is crucial to evaluate the risk assessing ability of the proposed framework. We claim that our framework learns risk aware representations by improving on the task of risk object identification, especially in identifying objects with vulnerable interactions like pedestrians and cyclists.


Cryptographic key distribution over a public network via variance based watermarking in compressive measurements. The optical communication has an increasing need for security in public transmission scenarios. Here we present a protocol for cryptographic key distribution over a public network via photon counting compressive imaging system with watermarking, which utilizes watermarking technique to distribute secure keys, and uses reconstructed images for simultaneous identity authentication and tampering identification. The watermark is embedded in the rearranged compressed measurements of the object, and then the signal is transmitted through a public network. At the receiving terminal, the legitimate users can easily extract the watermark as the cryptographic key by using initial keys and the variance characteristic of random measurements. Artificial tampering and attacks can be detected by the accurately retrieved images. The realization of this protocol is a step forward toward the practical applications, and will be beneficial for the broader fields of optical security in many ways.


Bayesian gradient sensing in the presence of rotational diffusion. Biological cells estimate concentration gradients of signaling molecules with a precision that is limited not only by sensing noise, but additionally by the cell's own stochastic motion. We ask for the theoretical limits of gradient estimation in the presence of both motility and sensing noise. We introduce a minimal model of a stationary chemotactic agent in the plane subject to rotational diffusion, which uses Bayesian estimation to optimally infer a gradient direction from noisy concentration measurements. Contrary to the known case of gradient sensing by temporal comparison, we show that for spatial comparison, the ultimate precision of gradient sensing scales not with the rotational diffusion time, but with its square root. To achieve this precision, an individual agent needs to know its own rotational diffusion coefficient. This agent can accurately estimate the expected variability within an ensemble of agents. If an agent, however, does not account for its own motility noise, Bayesian estimation fails in a characteristic manner.


Gradient Magnet Design for Simultaneous Detection of Electrons and Positrons in the Intermediate MeV Range. We report the design and development of a compact electron and positron spectrometer based on tapered Neodymium Iron Boron magnets. We show that the tapered design forms a gradient magnetic field component allowing energy dependent focusing of the dispersed charged particles along a chosen detector plane using RADIA, a code developed by European Synchrotron Radiation Facility for solving three dimensional magnetostatics configuration, and a fourth order Runge Kutta Particle Tracking code. The mirror symmetric design allows for simultaneous detection of pairs i.e. electrons and positrons with energies from 2 MeV to 500 MeV. We have developed a prototype matching the design specifications. We investigate the effects of beam divergence on the energy resolution and signal conversion efficiency for a photo stimulated luminescencebased Imaging Plates (IPs). The optimal entrance aperture of the magnet is found to be elliptical and bigger than that of conventional pinhole aperture based spectrometer designs even for a divergent beam originating from a point source at 20 cm away (i.e. solid angle of 8 milli steradians). The signal efficiency in BAS IP of SR type ranges from 1 to 5 for a parallel beam incident on a circular aperture of 20 mm diameter type at a chosen detection plane whereas it drops by up to a factor of 3 in the presence of divergence of 8 milli steradians. The proposed gradient magnet is suitable for the detection of low flux and or monoenergetic type electron positron signals with finite transverse sizes. It offers unparalleled advantages for gammaray spectroscopy in the intermediate MeV range.


3D human pose estimation with adaptive receptive fields and dilated temporal convolutions. In this work, we demonstrate that receptive fields in 3D pose estimation can be effectively specified using optical flow. We introduce adaptive receptive fields, a simple and effective method to aid receptive field selection in pose estimation models based on optical flow inference. We contrast the performance of a benchmark state of the art model running on fixed receptive fields with their adaptive field counterparts. By using a reduced receptive field, our model can process slow motion sequences (10x longer) 23 faster than the benchmark model running at regular speed. The reduction in computational cost is achieved while producing a pose prediction accuracy to within 0.36 of the benchmark model.


Ants can orienteer a thief in their robbery. The Thief Orienteering Problem (ThOP) is a multi component problem that combines features of two classic combinatorial optimization problems Orienteering Problem and Knapsack Problem. The ThOP is challenging due to the given time constraint and the interaction between its components. We propose an Ant Colony Optimization algorithm together with a new packing heuristic to deal individually and interactively with problem components. Our approach outperforms existing work on more than 90 of the benchmarking instances, with an average improvement of over 300 .


Hybrid Attention Based Transformer Block Model for Distant Supervision Relation Extraction. With an exponential explosive growth of various digital text information, it is challenging to efficiently obtain specific knowledge from massive unstructured text information. As one basic task for natural language processing (NLP), relation extraction aims to extract the semantic relation between entity pairs based on the given text. To avoid manual labeling of datasets, distant supervision relation extraction (DSRE) has been widely used, aiming to utilize knowledge base to automatically annotate datasets. Unfortunately, this method heavily suffers from wrong labelling due to the underlying strong assumptions. To address this issue, we propose a new framework using hybrid attention based Transformer block with multi instance learning to perform the DSRE task. More specifically, the Transformer block is firstly used as the sentence encoder to capture syntactic information of sentences, which mainly utilizes multi head self attention to extract features from word level. Then, a more concise sentence level attention mechanism is adopted to constitute the bag representation, aiming to incorporate valid information of each sentence to effectively represent the bag. Experimental results on the public dataset New York Times (NYT) demonstrate that the proposed approach can outperform the state of the art algorithms on the evaluation dataset, which verifies the effectiveness of our model for the DSRE task.


Efficient Construction of Nonlinear Models over Normalized Data. Machine Learning (ML) applications are proliferating in the enterprise. Relational data which are prevalent in enterprise applications are typically normalized as a result, data has to be denormalized via primary foreign key joins to be provided as input to ML algorithms. In this paper, we study the implementation of popular nonlinear ML models, Gaussian Mixture Models (GMM) and Neural Networks (NN), over normalized data addressing both cases of binary and multi way joins over normalized relations. For the case of GMM, we show how it is possible to decompose computation in a systematic way both for binary joins and for multi way joins to construct mixture models. We demonstrate that by factoring the computation, one can conduct the training of the models much faster compared to other applicable approaches, without any loss in accuracy. For the case of NN, we propose algorithms to train the network taking normalized data as the input. Similarly, we present algorithms that can conduct the training of the network in a factorized way and offer performance advantages. The redundancy introduced by denormalization can be exploited for certain types of activation functions. However, we demonstrate that attempting to explore this redundancy is helpful up to a certain point exploring redundancy at higher layers of the network will always result in increased costs and is not recommended. We present the results of a thorough experimental evaluation, varying several parameters of the input relations involved and demonstrate that our proposals for the training of GMM and NN yield drastic performance improvements typically starting at 100 , which become increasingly higher as parameters of the underlying data vary, without any loss in accuracy.


On Policy Learning Robust to Irreversible Events An Application to Robotic In Hand Manipulation. In this letter, we present an approach for learning in hand manipulation skills with a low cost, underactuated prosthetic hand in the presence of irreversible events. Our approach combines reinforcement learning based on visual perception with low level reactive control based on tactile perception, which aims to avoid slipping. The objective of the reinforcement learning level consists not only in fulfilling the in hand manipulation goal, but also in minimizing the intervention of the tactile reactive control. This way, the occurrence of object slipping during the learning procedure, which we consider an irreversible event, is significantly reduced. When an irreversible event occurs, the learning process is considered failed. We show the performance in two tasks, which consist in reorienting a cup and a bottle only using the fingers. The experimental results show that the proposed architecture allows reaching the goal in the Cartesian space and reduces significantly the occurrence of object slipping during the learning procedure. Moreover, without the proposed synergy between reactive control and reinforcement learning it was not possible to avoid irreversible events and, therefore, to learn the task.


Multicritera Cuts and Size Constrained k cuts in Hypergraphs. We address counting and optimization variants of multicriteria global min cut and size constrained min k cut in hypergraphs. 1. For an r rank n vertex hypergraph endowed with t hyperedge cost functions, we show that the number of multiobjective min cuts is O(r2 tr n 3t 1 ) . In particular, this shows that the number of parametric min cuts in constant rank hypergraphs for a constant number of criteria is strongly polynomial, thus resolving an open question by Aissi, Mahjoub, McCormick, and Queyranne (Math Programming, 2015). In addition, we give randomized algorithms to enumerate all multiobjective min cuts and all pareto optimal cuts in strongly polynomial time. 2. We also address node budgeted multiobjective min cuts For an n vertex hypergraph endowed with t vertex weight functions, we show that the number of node budgeted multiobjective min cuts is O(r2 r n t 2 ) , where r is the rank of the hypergraph, and the number of node budgeted b multiobjective min cuts for a fixed budget vector b is O(n 2) . 3. We show that min k cut in hypergraphs subject to constant lower bounds on part sizes is solvable in polynomial time for constant k , thus resolving an open problem posed by Queyranne. Our technique also shows that the number of optimal solutions is polynomial. All of our results build on the random contraction approach of Karger (SODA, 1993). Our techniques illustrate the versatility of the random contraction approach to address counting and algorithmic problems concerning multiobjective min cuts and size constrained k cuts in hypergraphs.


A new intrinsic metric and quasiregular maps. We introduce a new intrinsic metric in subdomains of a metric space and give upper and lower bounds for it in terms of well known metrics. We also prove distortion results for this metric under quasiregular maps.


Simple, Deterministic, Constant Round Coloring in the Congested Clique. We settle the complexity of the ( Delta 1) coloring and ( Delta 1) list coloring problems in the CONGESTED CLIQUE model by presenting a simple deterministic algorithm for both problems running in a constant number of rounds. This matches the complexity of the recent breakthrough randomized constant round ( Delta 1) list coloring algorithm due to Chang et al. (PODC'19), and significantly improves upon the state of the art O( log Delta) round deterministic ( Delta 1) coloring bound of Parter (ICALP'18). A remarkable property of our algorithm is its simplicity. Whereas the state of the art randomized algorithms for this problem are based on the quite involved local coloring algorithm of Chang et al. (STOC'18), our algorithm can be described in just a few lines. At a high level, it applies a careful derandomization of a recursive procedure which partitions the nodes and their respective palettes into separate bins. We show that after O(1) recursion steps, the remaining uncolored subgraph within each bin has linear size, and thus can be solved locally by collecting it to a single node. This algorithm can also be implemented in the Massively Parallel Computation (MPC) model provided that each machine has linear (in n , the number of nodes in the input graph) space. We also show an extension of our algorithm to the MPC regime in which machines have sublinear space we present the first deterministic ( Delta 1) list coloring algorithm designed for sublinear space MPC, which runs in O( log Delta log log n) rounds.


The It o integral with respect to an infinite dimensional L ' e vy process A series approach. We present an alternative construction of the infinite dimensional It o integral with respect to a Hilbert space valued L ' e vy process. This approach is based on the well known theory of real valued stochastic integration, and the respective It o integral is given by a series of It o integrals with respect to standard L ' e vy processes. We also prove that this stochastic integral coincides with the It o integral that has been developed in the literature.


On the Second order Frechet Derivatives of Eigenvalues of Sturm Liouville Problems in Potentials. The works of V. A. Vinokurov have shown that eigenvalues and normalized eigenfunctions of Sturm Liouville problems are analytic in potentials, considered as mappings from the Lebesgue space to the space of real numbers and the Banach space of continuous functions respectively. Moreover, the first order Frechet derivatives are known and paly an important role in many problems. In this paper, we will find the second order Frechet derivatives of eigenvalues in potentials, which are also proved to be negative definite quadratic forms for some cases.


DCANet Learning Connected Attentions for Convolutional Neural Networks. While self attention mechanism has shown promising results for many vision tasks, it only considers the current features at a time. We show that such a manner cannot take full advantage of the attention mechanism. In this paper, we present Deep Connected Attention Network (DCANet), a novel design that boosts attention modules in a CNN model without any modification of the internal structure. To achieve this, we interconnect adjacent attention blocks, making information flow among attention blocks possible. With DCANet, all attention blocks in a CNN model are trained jointly, which improves the ability of attention learning. Our DCANet is generic. It is not limited to a specific attention module or base network architecture. Experimental results on ImageNet and MS COCO benchmarks show that DCANet consistently outperforms the state of the art attention modules with a minimal additional computational overhead in all test cases. All code and models are made publicly available.