Self Supervised Learning of State Estimation for Manipulating Deformable Linear Objects. We demonstrate model based, visual robot manipulation of linear deformable objects. Our approach is based on a state space representation of the physical system that the robot aims to control. This choice has multiple advantages, including the ease of incorporating physics priors in the dynamics model and perception model, and the ease of planning manipulation actions. In addition, physical states can naturally represent object instances of different appearances. Therefore, dynamics in the state space can be learned in one setting and directly used in other visually different settings. This is in contrast to dynamics learned in pixel space or latent space, where generalization to visual differences are not guaranteed. Challenges in taking the state space approach are the estimation of the high dimensional state of a deformable object from raw images, where annotations are very expensive on real data, and finding a dynamics model that is both accurate, generalizable, and efficient to compute. We are the first to demonstrate self supervised training of rope state estimation on real images, without requiring expensive annotations. This is achieved by our novel self supervising learning objective, which is generalizable across a wide range of visual appearances. With estimated rope states, we train a fast and differentiable neural network dynamics model that encodes the physics of mass spring systems. Our method has a higher accuracy in predicting future states compared to models that do not involve explicit state estimation and do not use any physics prior, while only using 3 of training data. We also show that our approach achieves more efficient manipulation, both in simulation and on a real robot, when used within a model predictive controller.


How to Train PointGoal Navigation Agents on a (Sample and Compute) Budget. PointGoal navigation has seen significant recent interest and progress, spurred on by the Habitat platform and associated challenge. In this paper, we study PointGoal navigation under both a sample budget (75 million frames) and a compute budget (1 GPU for 1 day). We conduct an extensive set of experiments, cumulatively totaling over 50,000 GPU hours, that let us identify and discuss a number of ostensibly minor but significant design choices the advantage estimation procedure (a key component in training), visual encoder architecture, and a seemingly minor hyper parameter change. Overall, these design choices to lead considerable and consistent improvements over the baselines present in Savva et al. Under a sample budget, performance for RGB D agents improves 8 SPL on Gibson (14 relative improvement) and 20 SPL on Matterport3D (38 relative improvement). Under a compute budget, performance for RGB D agents improves by 19 SPL on Gibson (32 relative improvement) and 35 SPL on Matterport3D (220 relative improvement). We hope our findings and recommendations will make serve to make the community's experiments more efficient.


Relating tangle invariants for Khovanov homology and knot Floer homology. Ozsvath and Szabo recently constructed an algebraically defined invariant of tangles which takes the form of a DA bimodule. This invariant is expected to compute knot Floer homology. The authors have a similar construction for open braids and their plat closures which can be viewed as a filtered DA bimodule over the same algebras. For a closed diagram, this invariant computes the Khovanov homology of the knot or link. We show that forgetting the filtration, our DA bimodules are homotopy equivalent to a suitable version of the Ozsvath Szabo bimodules. In addition to giving a relationship between tangle invariants for Khovanov homology and knot Floer homology, this gives an oriented skein exact triangle for the Ozsvath Szabo bimodules which can be iterated to give an oriented cube of resolutions for the global construction.


Targeted Sentiment Analysis A Data Driven Categorization. Targeted sentiment analysis (TSA), also known as aspect based sentiment analysis (ABSA), aims at detecting fine grained sentiment polarity towards targets in a given opinion document. Due to the lack of labeled datasets and effective technology, TSA had been intractable for many years. The newly released datasets and the rapid development of deep learning technologies are key enablers for the recent significant progress made in this area. However, the TSA tasks have been defined in various ways with different understandings towards basic concepts like target' and aspect'. In this paper, we categorize the different tasks and highlight the differences in the available datasets and their specific tasks. We then further discuss the challenges related to data collection and data annotation which are overlooked in many previous studies.


Civil Wars A New Lotka Volterra Competitive System and Analysis of Winning Strategies. We introduce a new model in population dynamics that describes two species sharing the same environmental resources in a situation of open hostility. The interactions among these populations is described not in terms of random encounters but via the strategic decisions of one population that can attack the other according to different levels of aggressiveness. This leads to a non variational model for the two populations at war, taking into account structural parameters such as the relative fit of the two populations with respect to the available resources and the effectiveness of the attack strikes of the aggressive population. The analysis that we perform is rigorous and focuses on the dynamical properties of the system, by detecting and describing all the possible equilibria and their basins of attraction. Moreover, we will analyze the strategies that may lead to the victory of the aggressive population, i.e. the choices of the aggressiveness parameter, in dependence of the structural constants of the system and possibly varying in time in order to optimize the efficacy of the attacks, which take to the extinction in finite time of the defensive population. The model that we present is flexible enough to include also technological competition models of aggressive companies releasing computer viruses to set a rival companies out of the market.


Non Convex Planar Harmonic Maps. We formulate a novel characterization of a family of invertible maps between two dimensional domains. Our work follows two classic results The Rad 'o Kneser Choquet (RKC) theorem, which establishes the invertibility of harmonic maps into a convex planer domain and Tutte's embedding theorem for planar graphs RKC's discrete counterpart which proves the invertibility of piecewise linear maps of triangulated domains satisfying a discrete harmonic principle, into a convex planar polygon. In both theorems, the convexity of the target domain is essential for ensuring invertibility. We extend these characterizations, in both the continuous and discrete cases, by replacing convexity with a less restrictive condition. In the continuous case, Alessandrini and Nesi provide a characterization of invertible harmonic maps into non convex domains with a smooth boundary by adding additional conditions on orientation preservation along the boundary. We extend their results by defining a condition on the normal derivatives along the boundary, which we call the cone condition this condition is tractable and geometrically intuitive, encoding a weak notion of local invertibility. The cone condition enables us to extend Alessandrini and Nesi to the case of harmonic maps into non convex domains with a piecewise smooth boundary. In the discrete case, we use an analog of the cone condition to characterize invertible discrete harmonic piecewise linear maps of triangulations. This gives an analog of our continuous results and characterizes invertible discrete harmonic maps in terms of the orientation of triangles incident on the boundary.


Adjoint based trailing edge shape optimization of a transonic turbine vane using large eddy simulations. The shape of the trailing edge of a gas turbine nozzle guide vane has a significant effect on the downstream stagnation pressure loss and heat transfer over the surface of the vane. Traditionally, adjoint based design optimization methods for turbomachinery components have used low fidelity simulations like Reynolds averaged Navier Stokes. To reliably capture the complex flow phenomena involved in turbulent flow over a turbine vane, high fidelity simulations like large eddy simulation (LES) are required. In this paper, an adjoint based trailing edge shape optimization using LES is performed to reduce pressure loss and heat transfer over the surface of the vane. The chaotic dynamics of turbulence limits the effectiveness of the adjoint method for long time averaged objective functions computed from LES. A viscosity stabilized unsteady adjoint method is used to obtain gradients of the design objective function with reasonable accuracy. A gradient utilizing Bayesian optimization is used to robustly handle noise in the objective function and gradient evaluations. The trailing edge shape is parameterized using a linear combination of 5 convex designs. Results from the optimization, performed on the supercomputer Mira, are compared with optimal designs generated using derivative free design optimization of the same problem.


Validating fast ion wall load IR analysis methods against W7 X NBI empty torus experiment. The first neutral beam injection (NBI) experiments in Wendelstein 7 X (W7 X) stellarator were conducted in the summer of 2018. The NBI system is used to heat the magnetically confined plasma by neutralising an accelerated hydrogen ion beam and directing it into the plasma, where the resulting energetic ions release their energy to heat the plasma. The modelling of the NBI fast ion experiments has commenced, including estimation of the shine through and the orbit losses. The stellarator has a wide angle infra red (IR) imaging system to monitor the machine plasma facing component surface temperatures. This work validates the NBI model "Beamlet Based NBI (BBNBI)" and the newly written synthetic IR camera model. The validation is accomplished by comparing the measured and the synthetic IR camera measurements of an experiment where the NBI was injected into the vacuum vessel without a plasma. A good qualitative and quantitative match was found. This agreement is further supported by spectroscopic and calibration measurements of the NBI and and IR camera systems.


On relationship between trigonal and cubic symmetry classes of an elasticity tensor. In the literature, there is an ambiguity in defining the relationship between trigonal and cubic symmetry classes of an elasticity tensor. We discuss the issue by examining the eigensystems and symmetry groups of trigonal and cubic tensors. Additionally, we present numerical examples indicating that the sole verification of the eigenvalues can lead to confusion in the identification of the elastic symmetry.


Low Power Optical Traps using Anisotropic Metasurfaces Asymmetric Potential Barriers and Broadband Response. We propose the optical trapping of Rayleigh particles using tailored anisotropic and hyperbolic metasurfaces illuminated with a linearly polarized Gaussian beam. This platform permits to engineer optical traps at the beam axis with a response governed by nonconservative and giant recoil forces coming from the directional excitation of ultra confined surface plasmons during the light scattering process. Compared to optical traps set over bulk metals, the proposed traps are broadband in the sense that can be set with beams oscillating at any frequency within the wide range in which the metasurface supports surface plasmons. Over that range, the metasurface evolves from an anisotropic elliptic to a hyperbolic regime through a topological transition and enables optical traps with distinctive spatially asymmetric potential distribution, local potential barriers arising from the momentum imbalance of the excited plasmons, and an enhanced potential depth that permits the stable trapping of nanoparticles using low intensity laser beams. To investigate the performance of this platform, we develop a rigorous formalism based on the Lorentz force within the Rayleigh approximation combined with anisotropic Green's functions and calculate the trapping potential of nonconservative forces using the Helmholtz Hodge decomposition method. Tailored anisotropic and hyperbolic metasurfaces, commonly implemented by nanostructuring thin metallic layers, enables using low intensity laser sources operating in the visible or the IR to trap and manipulate particles at the nanoscale, and may enable a wide range of applications in bioengineering, physics, and chemistry.


Antipalindromic numbers. Everybody has certainly heard about palindromes words that stay the same when read backwards. For instance kayak, radar, or rotor. Mathematicians are interested in palindromic numbers positive integers whose expansion in a certain integer base is a palindrome. The following problems are studied palindromic primes, palindromic squares and higher powers, multibased palindromic numbers, etc. In this paper, we define and study antipalindromic numbers positive integers whose expansion in a certain integer base is an antipalindrome. We present new results concerning divisibility and antipalindromic primes, antipalindromic squares and higher powers, and multibased antipalindromic numbers. We provide a user friendly application for all studied questions.


Multilevel Picard approximations for high dimensional semilinear second order PDEs with Lipschitz nonlinearities. The recently introduced full history recursive multilevel Picard (MLP) approximation methods have turned out to be quite successful in the numerical approximation of solutions of high dimensional nonlinear PDEs. In particular, there are mathematical convergence results in the literature which prove that MLP approximation methods do overcome the curse of dimensionality in the numerical approximation of nonlinear second order PDEs in the sense that the number of computational operations of the proposed MLP approximation method grows at most polynomially in both the reciprocal 1 epsilon of the prescribed approximation accuracy epsilon 0 and the PDE dimension d in mathbb N 1,2,3, ldots . However, in each of the convergence results for MLP approximation methods in the literature it is assumed that the coefficient functions in front of the second order differential operator are affine linear. In particular, until today there is no result in the scientific literature which proves that any semilinear second order PDE with a general time horizon and a non affine linear coefficient function in front of the second order differential operator can be approximated without the curse of dimensionality. It is the key contribution of this article to overcome this obstacle and to propose and analyze a new type of MLP approximation method for semilinear second order PDEs with possibly nonlinear coefficient functions in front of the second order differential operators. In particular, the main result of this article proves that this new MLP approximation method does indeed overcome the curse of dimensionality in the numerical approximation of semilinear second order PDEs.


Ancient Luoyang Bridge reveals a simple metagrating model in optics. The ancient Chinese bridge, Luoyang Bridge, has been revealed to obey similar laws to diminish waves, like an optical model, metagrating. Numerical simulations have been performed to verify this finding.


Characterizing the impact of using features extracted from pre trained models on the quality of video captioning sequence to sequence models. The task of video captioning, that is, the automatic generation of sentences describing a sequence of actions in a video, has attracted an increasing attention recently. The complex and high dimensional representation of video data makes it difficult for a typical encoder decoder architectures to recognize relevant features and encode them in a proper format. Video data contains different modalities that can be recognized using a mix image, scene, action and audio features. In this paper, we characterize the different features affecting video descriptions and explore the interactions among these features and how they affect the final quality of a video representation. Building on existing encoder decoder models that utilize limited range of video information, our comparisons show how the inclusion of multi modal video features can make a significant effect on improving the quality of generated statements. The work is of special interest to scientists and practitioners who are using sequence to sequence models to generate video captions.


Refinements of Young's integral inequality via fundamental inequalities and mean value theorems for derivatives. In the paper, the authors review several refinements of Young's integral inequality via several mean value theorems, such as Lagrange's and Taylor's mean value theorems of Lagrange's and Cauchy's type remainders, and via several fundamental inequalities, such as v C eby v s ev's integral inequality, Hermite Hadamard's type integral inequalities, H "older's integral inequality, and Jensen's discrete and integral inequalities, in terms of higher order derivatives and their norms, survey several applications of several refinements of Young's integral inequality, and further refine Young's integral inequality via P 'olya's type integral inequalities.


Tight Polynomial Worst Case Bounds for Loop Programs. In 2008, Ben Amram, Jones and Kristiansen showed that for a simple programming language representing non deterministic imperative programs with bounded loops, and arithmetics limited to addition and multiplication it is possible to decide precisely whether a program has certain growth rate properties, in particular whether a computed value, or the program's running time, has a polynomial growth rate. A natural and intriguing problem was to move from answering the decision problem to giving a quantitative result, namely, a tight polynomial upper bound. This paper shows how to obtain asymptotically tight, multivariate, disjunctive polynomial bounds for this class of programs. This is a complete solution whenever a polynomial bound exists it will be found. A pleasant surprise is that the algorithm is quite simple but it relies on some subtle reasoning. An important ingredient in the proof is the forest factorization theorem, a strong structural result on homomorphisms into a finite monoid.


Fast and Accurate Optical Flow based Depth Map Estimation from Light Fields. Depth map estimation is a crucial task in computer vision, and new approaches have recently emerged taking advantage of light fields, as this new imaging modality captures much more information about the angular direction of light rays compared to common approaches based on stereoscopic images or multi view. In this paper, we propose a novel depth estimation method from light fields based on existing optical flow estimation methods. The optical flow estimator is applied on a sequence of images taken along an angular dimension of the light field, which produces several disparity map estimates. Considering both accuracy and efficiency, we choose the feature flow method as our optical flow estimator. Thanks to its spatio temporal edge aware filtering properties, the different disparity map estimates that we obtain are very consistent, which allows a fast and simple aggregation step to create a single disparity map, which can then converted into a depth map. Since the disparity map estimates are consistent, we can also create a depth map from each disparity estimate, and then aggregate the different depth maps in the 3D space to create a single dense depth map.


The Uniformed Patroller Game. In the recently introduced network patrolling game, an Attacker carries out an attack on a node of her choice, for a given number m of consecutive periods. The parameter m indicates the difficulty of the attack at a given node. To thwart such an attack, the Patroller adopts a walk on the network, hoping to be at the attacked node during one of the m periods. If this occurs, the attack is interrupted and the Patroller wins otherwise the Attacker wins. In the original setting, the Attacker has no knowledge of the Patroller's location at any time. Here, to model the important alternative where the Patroller can be identified when he is at the Attacker's node (e.g. the Patroller wears a uniform), we allow the Attacker to initiate her attack after waiting for a chosen number d of consecutive periods in which the Patroller has been away. We solve this version of the game for various networks star, line, circle and a mixture. We restrict the Patroller to Markovian strategies, which cover the whole network.


Exploiting Sentence Order in Document Alignment. We present a simple document alignment method that incorporates sentence order information in both candidate generation and candidate re scoring. Our method results in 61 relative reduction in error compared to the best previously published result on the WMT16 document alignment shared task. Our method improves downstream MT performance on web scraped Sinhala English documents from ParaCrawl, outperforming the document alignment method used in the most recent ParaCrawl release. It also outperforms a comparable corpora method which uses the same multilingual embeddings, demonstrating that exploiting sentence order is beneficial even if the end goal is sentence level bitext.


Subshifts, lambda graph bisystems and C algebras. We introduce a notion of lambda graph bisystem. It consists of a pair ( frak L , frak L ) of two labeled Bratteli diagrams frak L , frak L over alphabets Sigma , Sigma , respectively, and satisfy certain compatibility condition of their labeling on edges. Its matrix presentation is called a symbolic matrix bisystem. We first show that any lambda graph bisystem presents subshifts and conversely any subshift is presented by a lambda graph bisystem, called the canonical lambda graph bisystem for the subshift. We introduce a notion of properly strong shift equivalence on symbolic matrix bisystems and show that two subshifts are topologically conjugate if and only if their canonical symbolic matrix bisystems are properly strong shift equivalent. A lambda graph bisystem ( frak L , frak L ) yields a pair of C algebra written mathcal O frak L , mathcal O frak L . We show that the C algebras are universal unique C algebras subject to certain operator relations among canonical generators encoded by lambda graph bisystem ( frak L , frak L ). If a lambda graph bisystem comes from a lambda graph system of a finite directed graph, then the associated subshift is the two sided topological Markov shift ( Lambda A, sigma A) by its transition matrix A of the graph, and the associated C algebra mathcal O frak L is isomorphic to mathcal O A, whereas the other C algebra mathcal O frak L is isomorphic to C( Lambda A) rtimes sigma A mathbb Z of the commutative C algebra C( Lambda A) on Lambda A by the automorphism induced by the homeomorphism of the shift sigma A. This phenomena shows a duality between mathcal O A and C( Lambda A) rtimes sigma A mathbb Z .


The concentration compactness principles for W s,p( cdot, cdot) ( mathbb R N) and application. We obtain a critical imbedding and then, concentration compactness principles for fractional Sobolev spaces with variable exponents. As an application of these results, we obtain the existence of many solutions for a class of critical nonlocal problems with variable exponents, which is even new for constant exponent case.


Intermittent Inverse Square L 'evy Walks are Optimal for Finding Targets of All Sizes. L 'evy walks are random walk processes whose step lengths follow a long tailed power law distribution. Due to their abundance as movement patterns of biological organisms, significant theoretical efforts have been devoted to identifying the foraging circumstances that would make such patterns advantageous. However, despite extensive research, there is currently no mathematical proof indicating that L 'evy walks are, in any manner, preferable strategies in higher dimensions than one. Here we prove that in finite two dimensional terrains, the inverse square L 'evy walk strategy is extremely efficient at finding sparse targets of arbitrary size and shape. Moreover, this holds even under the weak model of intermittent detection. Conversely, any other intermittent L 'evy walk fails to efficiently find either large targets or small ones. Our results shed new light on the emph L 'evy foraging hypothesis , and are thus expected to impact future experiments on animals performing L 'evy walks.


Finite Groups with Some s semipermutable subgroups. Suppose that G is a finite group and H is a subgroup of G . We say that H is s semipermutable in G if HG p G pH for any Sylow p subgroup G p of G with (p, H ) 1 . We investigate the influence of s semipermutable subgroups on the structure of finite groups. Some recent results are generalized.


Dual reference Age Synthesis. Age synthesis methods typically take a single image as input and use a specific number to control the age of the generated image. In this paper, we propose a novel framework taking two images as inputs, named dual reference age synthesis (DRAS), which approaches the task differently instead of using "hard" age information, i.e. a fixed number, our model determines the target age in a "soft" way, by employing a second reference image. Specifically, the proposed framework consists of an identity agent, an age agent and a generative adversarial network. It takes two images as input an identity reference and an age reference and outputs a new image that shares corresponding features with each. Experimental results on two benchmark datasets (UTKFace and CACD) demonstrate the appealing performance and flexibility of the proposed framework.


Multi Component V2X Applications Placement in Edge Computing Environment. Vehicle to everything (V2X) services are attracting a lot of attention in the research and industry communities due to their applicability in the landscape of connected and autonomous vehicles. Such applications have stringent performance requirements in terms of complex data processing and low latency communications which are utilized to ensure road safety and improve road conditions. To address these challenges, the placement of V2X applications through leveraging of edge computing paradigm, that distributes the computing capabilities to access points in proximity to the vehicles, presents itself as a viable solution. However, the realistic implementation of the edge enabled V2X applications is hindered by the limited computational power provided at the edge and the nature of V2X applications that are composed of multiple independent V2X basic services. To address these challenges, this work targets the efficient placement of V2X basic services in a highway scenario subject to the delay constraints of V2X applications using them and the limited computational resources at the edge. To that end, this work formulates a binary integer linear programming model that minimizes the delay of V2X applications while satisfying the resource requirements of V2X basic services. To demonstrate the soundness of the approach, simulations with varying vehicle densities were conducted, and the results reported show that it can satisfy the delay requirements of V2X applications.


Impact of Accuracy on Model Interpretations. Model interpretations are often used in practice to extract real world insights from machine learning models. These interpretations have a wide range of applications they can be presented as business recommendations or used to evaluate model bias. It is vital for a data scientist to choose trustworthy interpretations to drive real world impact. Doing so requires an understanding of how the accuracy of a model impacts the quality of standard interpretation tools. In this paper, we will explore how a model's predictive accuracy affects interpretation quality. We propose two metrics to quantify the quality of an interpretation and design an experiment to test how these metrics vary with model accuracy. We find that for datasets that can be modeled accurately by a variety of methods, simpler methods yield higher quality interpretations. We also identify which interpretation method works the best for lower levels of model accuracy.


Compose Like Humans Jointly Improving the Coherence and Novelty for Modern Chinese Poetry Generation. Chinese poetry is an important part of worldwide culture, and classical and modern sub branches are quite different. The former is a unique genre and has strict constraints, while the latter is very flexible in length, optional to have rhymes, and similar to modern poetry in other languages. Thus, it requires more to control the coherence and improve the novelty. In this paper, we propose a generate retrieve then refine paradigm to jointly improve the coherence and novelty. In the first stage, a draft is generated given keywords (i.e., topics) only. The second stage produces a "refining vector" from retrieval lines. At last, we take into consideration both the draft and the "refining vector" to generate a new poem. The draft provides future sentence level information for a line to be generated. Meanwhile, the "refining vector" points out the direction of refinement based on impressive words detection mechanism which can learn good patterns from references and then create new ones via insertion operation. Experimental results on a collected large scale modern Chinese poetry dataset show that our proposed approach can not only generate more coherent poems, but also improve the diversity and novelty.


An Efficient Scheme for the Generation of Ordered Trees in Constant Amortized Time. Trees are useful entities allowing to model data structures and hierarchical relationships in networked decision systems ubiquitously. An ordered tree is a rooted tree where the order of the subtrees (children) of a node is significant. In combinatorial optimization, generating ordered trees is relevant to evaluate candidate combinatorial objects. In this paper, we present an algebraic scheme to generate ordered trees with n vertices with utmost efficiency whereby our approach uses mathcal O (n) space and mathcal O (1) time in average per tree. Our computational studies have shown the feasibility and efficiency to generate ordered trees in constant time in average, in about one tenth of a millisecond per ordered tree. Due to the 1 1 bijective nature to other combinatorial classes, our approach is favorable to study the generation of binary trees with n external nodes, trees with n nodes, legal sequences of n pairs of parentheses, triangulated n gons, gambler's sequences and lattice paths. We believe our scheme may find its use in devising algorithms for planning and combinatorial optimization involving Catalan numbers.


Asymptotic dynamics of high dynamic range stratified turbulence. Direct numerical simulations of homogeneous sheared and stably stratified turbulence are considered to probe the asymptotic high dynamic range regime suggested by Gargett et al. 1984 and Shih et al. 2005. We consider statistically stationary configurations of the flow that span three decades in dynamic range defined by the separation between the Ozmidov length scale, L O sqrt epsilon N 3 , and the Kolmogorov length scale, L K ( nu 3 epsilon) 1 4 , up to mathrm Re b equiv (L O L K) 4 3 epsilon ( nu N 2) sim O(1000) , where epsilon is the mean turbulent kinetic energy dissipation rate, nu is the kinematic viscosity, and N is the buoyancy frequency. We isolate the effects of mathrm Re b , particularly on irreversible mixing, from the effects of other flow parameters of stratified and sheared turbulence. Specifically, we evaluate the influence of dynamic range independent of initial conditions. We present evidence that the flow approaches an asymptotic state for mathrm Re b gtrapprox 300 , characterized both by an asymptotic partitioning between the potential and kinetic energies and by the approach of components of the dissipation rate to their expected values under the assumption of isotropy. As mathrm Re b increases above 100, there is a slight decrease in the turbulent flux coefficient Gamma chi epsilon , where chi is the dissipation rate of buoyancy variance, but, for this flow, there is no evidence of the commonly suggested Gamma propto mathrm Re b 1 2 dependence when 100 leq mathrm Re b leq 1000 .


Artificial Intelligence Development Races in Heterogeneous Settings. Regulation of advanced technologies such as Artificial Intelligence (AI) has become increasingly important, given the associated risks and apparent ethical issues. With the great benefits promised from being able to first supply such technologies, safety precautions and societal consequences might be ignored or shortchanged in exchange for speeding up the development, therefore engendering a racing narrative among the developers. Starting from a game theoretical model describing an idealised technology race in a fully connected world of players, here we investigate how different interaction structures among race participants can alter collective choices and requirements for regulatory actions. Our findings indicate that, when participants portray a strong diversity in terms of connections and peer influence (e.g., when scale free networks shape interactions among parties), the conflicts that exist in homogeneous settings are significantly reduced, thereby lessening the need for regulatory actions. Furthermore, our results suggest that technology governance and regulation may profit from the world's patent heterogeneity and inequality among firms and nations, so as to enable the design and implementation of meticulous interventions on a minority of participants, which is capable of influencing an entire population towards an ethical and sustainable use of advanced technologies.


A note on bilinear wave Schr "odinger interactions. We consider bilinear restriction estimates for wave Schr "odinger interactions and provided a sharp condition to ensure that the product belongs to L q t L r x in the full bilinear range frac 2 q frac d 1 r d 1 , 1 leqslant q, r leqslant 2 . Moreover, we give a counter example which shows that the bilinear restriction estimate can fail, even in the transverse setting. This failure is closely related to the lack of curvature of the cone. Finally we mention extensions of these estimates to adapted function spaces. In particular we give a general transference type principle for U 2 type spaces that roughly implies that if an estimate holds for homogeneous solutions, then it also holds in U 2 . This transference argument can be used to obtain bilinear and multilinear estimates in U 2 from the corresponding bounds for homogeneous solutions.


On integral basis of pure number fields. Let K mathbb Q ( sqrt n a ) be an extension of degree n of the field Q of rational numbers, where the integer a is such that for each prime p dividing n either p nmid a or the highest power of p dividing a is coprime to p this condition is clearly satisfied when a, n are coprime or a is squarefree. The present paper gives explicit construction of an integral basis of K along with applications. This construction of an integral basis of K extends a result proved in J. Number Theory, 173 (2017), 129 146 regarding periodicity of integral bases of mathbb Q ( sqrt n a ) when a is squarefree.


Generalizations of degeneracy second main theorem and Schmidt's subspace theorem. In this paper, by introducing the notion of " textit distributive constant " of a family of hypersurfaces with respect to a projective variety, we prove a second main theorem in Nevanlinna theory for meromorphic mappings with arbitrary families of hypersurfaces in projective varieties. Our second main theorem generalizes and improves previous results for meromorphic mappings with hypersurfaces, in particular for algebraically degenerate mappings and for the families of hypersurfaces in subgeneral position. The analogous results for the holomorphic curves with finite growth index from a complex disc into a project variety, and for meromorphic mappings on a complete K " a hler manifold are also given. For the last aim, we will prove a Schmidt's subspace theorem for an arbitrary families of homogeneous polynomials, which is the counterpart in Number theory of our second main theorem. Our these results are generalizations and improvements of all previous results.


The mergegram of a dendrogram and its stability. This paper extends the key concept of persistence within Topological Data Analysis (TDA) in a new direction. TDA quantifies topological shapes hidden in unorganized data such as clouds of unordered points. In the 0 dimensional case the distance based persistence is determined by a single linkage (SL) clustering of a finite set in a metric space. Equivalently, the 0D persistence captures only edge lengths of a Minimum Spanning Tree (MST). Both SL dendrogram and MST are unstable under perturbations of points. We define the new stable under noise mergegram, which outperforms previous isometry invariants on a classification of point clouds by PersLay.


Multilingual Twitter Corpus and Baselines for Evaluating Demographic Bias in Hate Speech Recognition. Existing research on fairness evaluation of document classification models mainly uses synthetic monolingual data without ground truth for author demographic attributes. In this work, we assemble and publish a multilingual Twitter corpus for the task of hate speech detection with inferred four author demographic factors age, country, gender and race ethnicity. The corpus covers five languages English, Italian, Polish, Portuguese and Spanish. We evaluate the inferred demographic labels with a crowdsourcing platform, Figure Eight. To examine factors that can cause biases, we take an empirical analysis of demographic predictability on the English corpus. We measure the performance of four popular document classifiers and evaluate the fairness and bias of the baseline classifiers on the author level demographic attributes.


Delay and reliability constrained VNF placement on mobile and volatile 5G infrastructure. The ongoing research and industrial exploitation of SDN and NFV technologies promise higher flexibility on network automation and infrastructure optimization. Choosing the location of Virtual Network Functions is a central problem in the automation and optimization of the software defined, virtualization based next generation of networks such as 5G and beyond. Network services provided for autonomous vehicles, factory automation, e health and cloud robotics often require strict delay bounds and reliability constraints, which are influenced by the location of its composing Virtual Network Functions. Robots, vehicles and other end devices provide significant capabilities such as actuators, sensors and local computation which are essential for some services. Moreover, these devices are continuously on the move and might lose network connection or run out of battery power, which further challenge service delivery in this dynamic environment. This work tackles the mobility, and battery restrictions as well as the temporal aspects and conflicting traits of reliable, low latency service deployment over a volatile network, where mobile compute nodes act as an extension of the cloud and edge computing infrastructure. The problem is formulated as a cost minimizing Virtual Network Function placement optimization and an efficient heuristic is proposed. The algorithms are extensively evaluated from various aspects by simulation on detailed real world scenarios.


Towards Fine Grained Billing For Cloud Networking. We revisit multi tenant network virtualization in data centers, and make the case for tenant specific virtual switches. In particular, tenant specific virtual switches allow cloud providers to extend fine grained billing (known, e.g., from serverless architectures) to the network, accounting not only for IO, but also CPU or energy. We sketch an architecture and present economical motivation and recent technological enablers. We also find that virtual switches today do not offer sufficient multi tenancy and can introduce artificial performance bottlenecks, e.g., in load balancers. We conclude by discussing additional use cases for tentant specific switches.


Distance Geometric Graph Convolutional Network (DG GCN) for Three Dimensional (3D) Graphs. The distance geometric graph representation adopts a unified scheme (distance) for representing the geometry of three dimensional(3D) graphs. It is invariant to rotation and translation of the graph and it reflects pair wise node interactions and their generally local nature. To facilitate the incorporation of geometry in deep learning on 3D graphs, we propose a message passing graph convolutional network based on the distance geometric graph representation DG GCN (distance geometric graph convolution network). It utilizes continuous filter convolutional layers, with filter generating networks, that enable learning of filter weights from distances, thereby incorporating the geometry of 3D graphs in graph convolutions. Our results for the ESOL and FreeSolv datasets show major improvement over those of standard graph convolutions. They also show significant improvement over those of geometric graph convolutions employing edge weight edge distance power laws. Our work demonstrates the utility and value of DG GCN for end to end deep learning on 3D graphs, particularly molecular graphs.


The role of time scale in the spreading of asymmetrically interacting diseases. Diseases and other contagion phenomena in nature and society can interact asymmetrically, such that one can benefit from the other, which in turn impairs the first, in analogy with predator prey systems. Here, we consider two models for interacting disease like dynamics with asymmetric interactions and different associated time scales. Using rate equations for homogeneously mixed populations, we show that the stationary prevalences and phase diagrams of each model behave differently with respect to variations of the relative time scales. We also characterize in detail the regime where transient oscillations are observed, a pattern that is inherent to asymmetrical interactions but often ignored in the literature. Our results contribute to a better understanding of disease dynamics in particular, and interacting processes in general, and could provide interesting insights for real world applications, most notably, the interplay between the dynamics of fact checked and fake news.


Attractive or Faithful? Popularity Reinforced Learning for Inspired Headline Generation. With the rapid proliferation of online media sources and published news, headlines have become increasingly important for attracting readers to news articles, since users may be overwhelmed with the massive information. In this paper, we generate inspired headlines that preserve the nature of news articles and catch the eye of the reader simultaneously. The task of inspired headline generation can be viewed as a specific form of Headline Generation (HG) task, with the emphasis on creating an attractive headline from a given news article. To generate inspired headlines, we propose a novel framework called POpularity Reinforced Learning for inspired Headline Generation (PORL HG). PORL HG exploits the extractive abstractive architecture with 1) Popular Topic Attention (PTA) for guiding the extractor to select the attractive sentence from the article and 2) a popularity predictor for guiding the abstractor to rewrite the attractive sentence. Moreover, since the sentence selection of the extractor is not differentiable, techniques of reinforcement learning (RL) are utilized to bridge the gap with rewards obtained from a popularity score predictor. Through quantitative and qualitative experiments, we show that the proposed PORL HG significantly outperforms the state of the art headline generation models in terms of attractiveness evaluated by both human (71.03 ) and the predictor (at least 27.60 ), while the faithfulness of PORL HG is also comparable to the state of the art generation model.


Unified Semantic Parsing with Weak Supervision. Semantic parsing over multiple knowledge bases enables a parser to exploit structural similarities of programs across the multiple domains. However, the fundamental challenge lies in obtaining high quality annotations of (utterance, program) pairs across various domains needed for training such models. To overcome this, we propose a novel framework to build a unified multi domain enabled semantic parser trained only with weak supervision (denotations). Weakly supervised training is particularly arduous as the program search space grows exponentially in a multi domain setting. To solve this, we incorporate a multi policy distillation mechanism in which we first train domain specific semantic parsers (teachers) using weak supervision in the absence of the ground truth programs, followed by training a single unified parser (student) from the domain specific policies obtained from these teachers. The resultant semantic parser is not only compact but also generalizes better, and generates more accurate programs. It further does not require the user to provide a domain label while querying. On the standard Overnight dataset (containing multiple domains), we demonstrate that the proposed model improves performance by 20 in terms of denotation accuracy in comparison to baseline techniques.


On Hom pre Lie bialgebras. In this paper we introduce the notion of Hom pre Lie bialgebra in the general framework of the cohomology theory for Hom Lie algebras. We show that Hom pre Lie bialgebras, standard Manin triples for Hom pre Lie algebras and certain matched pairs of Hom pre Lie algebras are equivalent. Due to the usage of the cohomology theory, it makes us successfully study the coboundary Hom pre Lie bialgebras. The notion of Hom s matrix is introduced, by which we can construct Hom pre Lie bialgebras naturally. Finally we introduce the notions of Hom O operators on Hom pre Lie algebras and Hom L dendriform algebras, by which we construct Hom s matrices.


Dynamics of shadow system of a singular Gierer Meinhardt system on an evolving domain. The main purpose of the current paper is to contribute towards the comprehension of the dynamics of the shadow system of a singular Gierer Meinhardt model on an isotropically evolving domain. In the case where the inhibitor's response to the activator's growth is rather weak, then the shadow system of the Gierer Meinhardt model is reduced to a single though non local equation whose dynamics is thoroughly investigated throughout the manuscript. The main focus is on the derivation of blow up results for this non local equation, which can be interpreted as instability patterns of the shadow system. In particular, a it diffusion driven instability (DDI) , or it Turing instability , in the neighbourhood of a constant stationary solution, which then is destabilised via diffusion driven blow up, is observed. The latter indicates the formation of some unstable patterns, whilst some stability results of global in time solutions towards non constant steady states guarantee the occurrence of some stable patterns. Most of the derived results are confirmed numerically and also compared with the ones in the case of a stationary domain.


Arcs in finite projective spaces. This is an expository article detailing results concerning large arcs in finite projective spaces, which attempts to cover the most relevant results on arcs, simplifying and unifying proofs of known old and more recent theorems. The article is mostly self contained and includes a proof of the most general form of Segre's lemma of tangents and a short proof of the MDS conjecture over prime fields based on this lemma.


Selective Attention Encoders by Syntactic Graph Convolutional Networks for Document Summarization. Abstractive text summarization is a challenging task, and one need to design a mechanism to effectively extract salient information from the source text and then generate a summary. A parsing process of the source text contains critical syntactic or semantic structures, which is useful to generate more accurate summary. However, modeling a parsing tree for text summarization is not trivial due to its non linear structure and it is harder to deal with a document that includes multiple sentences and their parsing trees. In this paper, we propose to use a graph to connect the parsing trees from the sentences in a document and utilize the stacked graph convolutional networks (GCNs) to learn the syntactic representation for a document. The selective attention mechanism is used to extract salient information in semantic and structural aspect and generate an abstractive summary. We evaluate our approach on the CNN Daily Mail text summarization dataset. The experimental results show that the proposed GCNs based selective attention approach outperforms the baselines and achieves the state of the art performance on the dataset.


Evaluation of surface roughness of metal films using plasmonic Fano resonance in attenuated total reflection. Attenuated total reflection (ATR) by surface plasmon polariton (SPP) is a method for evaluating the dispersion relation of SPP from the position of a dip in the reflection spectrum. However, recent studies have shown that the dips are displaced from SPP resonance because they are produced by a type of Fano resonance, i.e., the interference between the resonant reflection process accompanied by resonant excitation of SPP and the direct reflection process without resonant excitation. This result suggests that the system properties difficult to be achieved in the dispersion relation of SPP can be characterized using the ATR method. In this study, we investigate the effect of surface roughness due to nanosized dimples created in the initial stage of pitting corrosion on the ATR spectrum, from the viewpoint of Fano resonance. Using the temporal coupled mode method, it is shown that the Fano resonance in ATR is caused by the phase change of direct reflection because of the absorption on the metal surface, and the spectral shape is determined by this phase, along with the ratio of the external (radiative) decay rate to the total decay rate of the resonant mode. Moreover, it is clarified that the internal and external decay rates extracted from the ATR spectrum provide information on corrosion, such as the effective thickness of the metal film and the randomness in dimple distribution.


Lieb, Entropy and Logarithmic uncertainty principles for the multivariate continuous quaternion Shearlet Transform. In this paper, we generalize the continuous quaternion shearlet transform on mathbb R 2 to mathbb R 2d , called the multivariate two sided continuous quaternion shearlet transform. Using the two sided quaternion Fourier transform, we derive several important properties such as (reconstruction formula, reproducing kernel, plancherel's formula, etc.). We present several example of the multivariate two sided continuous quaternion shearlet transform. We apply the multivariate two sided continuous quaternion shearlet transform properties and the two sided quaternion Fourier transform to establish Lieb uncertainty principle and the Logarithmic uncertainty principle. Last we study the Beckner's uncertainty principle in term of entropy for the multivariate two sided continuous quaternion shearlet transform.


Multi Level Temporal Pyramid Network for Action Detection. Currently, one stage frameworks have been widely applied for temporal action detection, but they still suffer from the challenge that the action instances span a wide range of time. The reason is that these one stage detectors, e.g., Single Shot Multi Box Detector (SSD), extract temporal features only applying a single level layer for each head, which is not discriminative enough to perform classification and regression. In this paper, we propose a Multi Level Temporal Pyramid Network (MLTPN) to improve the discrimination of the features. Specially, we first fuse the features from multiple layers with different temporal resolutions, to encode multi layer temporal information. We then apply a multi level feature pyramid architecture on the features to enhance their discriminative abilities. Finally, we design a simple yet effective feature fusion module to fuse the multi level multi scale features. By this means, the proposed MLTPN can learn rich and discriminative features for different action instances with different durations. We evaluate MLTPN on two challenging datasets THUMOS'14 and Activitynet v1.3, and the experimental results show that MLTPN obtains competitive performance on Activitynet v1.3 and outperforms the state of the art approaches on THUMOS'14 significantly.


A locally F finite Noetherian domain that is not F finite. Using an old example of Nagata, we construct a Noetherian ring of prime characteristic p, whose Frobenius morphism is locally finite, but not finite.


Theory of Edge Localized Mode Suppression by Static Resonant Magnetic Perturbations in the DIII D Tokamak. The plasma response to an externally generated, static, n 2, resonant magnetic perturbation (RMP) in the pedestal region of DIII D discharge 158115 is investigated. In this particular discharge, the resonant amplitudes of the RMP are modulated in a cycloidal manner at a frequency of 1 Hz. Adopting the plausible hypothesis that mode penetration at the top of the pedestal is a necessary and sufficient condition for the RMP induced suppression of edge localized modes (ELMs), recent cylindrical, nonlinear, reduced magnetohydrodynamical (MHD) simulations performed by Hu, Nazikian, et al., (2019) can account, in a quantitative fashion, for the density pump out and RMP induced ELM suppression threshold observed in DIII D discharge 158115. The primary aim of this paper is to employ analytic theory to further simplify the model of Hu, Nazikian, et al., in such a manner that a complete simulation of RMP induced ELM suppression in a DIII D H mode discharge can be performed in a matter of minutes of real time. A secondary aim is to gain a more exact understanding of the physical mechanism that underlies RMP induced ELM suppression in the DIII D tokamak.


Secure Hot Path Crowdsourcing with Local Differential Privacy under Fog Computing Architecture. Crowdsourcing plays an essential role in the Internet of Things (IoT) for data collection, where a group of workers is equipped with Internet connected geolocated devices to collect sensor data for marketing or research purpose. In this paper, we consider crowdsourcing these worker's hot travel path. Each worker is required to report his real time location information, which is sensitive and has to be protected. Encryption based methods are the most direct way to protect the location, but not suitable for resource limited devices. Besides, local differential privacy is a strong privacy concept and has been deployed in many software systems. However, the local differential privacy technology needs a large number of participants to ensure the accuracy of the estimation, which is not always the case for crowdsourcing. To solve this problem, we proposed a trie based iterative statistic method, which combines additive secret sharing and local differential privacy technologies. The proposed method has excellent performance even with a limited number of participants without the need of complex computation. Specifically, the proposed method contains three main components iterative statistics, adaptive sampling, and secure reporting. We theoretically analyze the effectiveness of the proposed method and perform extensive experiments to show that the proposed method not only provides a strict privacy guarantee, but also significantly improves the performance from the previous existing solutions.


Small weight code words arising from the incidence of points and hyperplanes in PG( boldsymbol n,q ). Let C n 1 (n,q) be the code arising from the incidence of points and hyperplanes in the Desarguesian projective space PG( n,q ). Recently, Polverino and Zullo proved that within this code, all non zero code words of weight at most 2q n 1 are scalar multiples of either the incidence vector of one hyperplane, or the difference of the incidence vectors of two distinct hyperplanes. We improve this result, proving that when q 17 and q notin 25,27,29,31,32,49,121 , all code words of weight at most (4q sqrt 8q frac 33 2 )q n 2 are linear combinations of incidence vectors of hyperplanes through a fixed (n 3) space. Depending on the omitted value for q , we can lower the bound on the weight of c to obtain the same results.


Are Deep Neural Networks "Robust"?. Separating outliers from inliers is the definition of robustness in computer vision. This essay delineates how deep neural networks are different than typical robust estimators. Deep neural networks not robust by this traditional definition.


Rarefied gas dynamics with external fields under specular reflection boundary condition. We consider the Boltzmann equation with external fields in strictly convex domains with the specular reflection boundary condition. We construct classical C 1 solutions away from the grazing set under the assumption that the external field is C 2 and the normal derivative of the field is positive and bounded away from 0 .


Generalization and development of the Malliavin Rubel theorem on small entire functions of exponential type with given zeros. Previously, we developed the technique of balayage of measures or charges and ( delta )subharmonic functions of finite order onto an closed system of rays S with a vertex at zero on the complex plane mathbb C . In this article, we use only two kinds of balayage of measure and charge, as well as of subharmonic functions of finite type under the order 1 and their differences. First, it is a classical balayage of the genus q 0 on a system of four closed rays positive and negative, and real and imaginary semi axis mathbb R , mathbb R , i mathbb R , i mathbb R . Second, it is two sided balayage of genus q 1 from the open right and left half planes mathbb C rm rh and mathbb C rm lh onto the imaginary axis i mathbb R . The classical Malliavin Rubel theorem gives necessary and sufficient conditions of the existence of an entire function of exponential type (we write e.f.e.t.) f not equiv 0 , vanishing on the given positive sequence sf Z sf z k k in mathbb N subset mathbb R and satisfying the constraint f leq g on i mathbb R , where g is an e.f.e.t., vanishing on positive sequence sf W sf w k k in mathbb N subset mathbb R . A combination of these special balayage processes of genus q 0 and q 1 allows us to extend the Malliavin Rubel theorem to arbitrary complex sequences sf Z sf z k k in mathbb N subset mathbb C separated by a pair of vertical angles from the imaginary axis i mathbb R , with much more general restrictions ln f leq M on the imaginary axis i mathbb R , where M is an subharmonic function of finite type under the order 1 .


Non uniqueness for the ab family of equations in periodic case. For the cubic ab family of equations with a neq0 , it is proved that there exists an initial data in the Sobolev space H s , s 3 2 , with non unique solutions on the circle.


Massive MIMO for Cellular Connected UAV Challenges and Promising Solutions. Massive multiple input multiple output (MIMO) is a promising technology for enabling cellular connected unmanned aerial vehicle (UAV) communications in the future. Equipped with full dimensional large arrays, ground base stations (GBSs) can apply adaptive fine grained three dimensional (3D) beamforming to mitigate the strong interference between high altitude UAVs and low altitude terrestrial users, thus significantly enhancing the network spectral efficiency. However, the performance gain of massive MIMO critically depends on the accurate channel state information (CSI) of both UAVs and terrestrial users at the GBSs, which is practically difficult to achieve due to UAV induced pilot contamination and UAV's high mobility in 3D. Moreover, the increasingly popular applications relying on a large group of coordinated UAVs or UAV swarm as well as the practical hybrid GBS beamforming architecture for massive MIMO further complicate the pilot contamination and channel beam tracking problems. In this article, we provide an overview of the above challenging issues, propose new solutions to cope with them, and discuss about promising directions for future research. Preliminary simulation results are also provided to validate the effectiveness of proposed solutions.


Stabilizing Generative Adversarial Networks A Survey. Generative Adversarial Networks (GANs) are a type of generative model which have received much attention due to their ability to model complex real world data. Despite their recent successes, the process of training GANs remains challenging, suffering from instability problems such as non convergence, vanishing or exploding gradients, and mode collapse. In recent years, a diverse set of approaches have been proposed which focus on stabilizing the GAN training procedure. The purpose of this survey is to provide a comprehensive overview of the GAN training stabilization methods which can be found in the literature. We discuss the advantages and disadvantages of each approach, offer a comparative summary, and conclude with a discussion of open problems.


Endoscopy for unitary symmetric spaces. Motivated by global applications, we propose a theory of relative endoscopic data and transfer factors for the symmetric pair (U(2n),U(n) times U(n)) over a local field. We then formulate the smooth transfer conjecture and fundamental lemma, establish the existence of smooth transfer for many test functions, and prove the fundamental lemma for the symmetric pair (U(4),U(2) times U(2)) .


CUSUM Filter for Brain Segmentation on DSC Perfusion MR Head Scans with Abnormal Brain Anatomy. This paper presents a new approach for relatively accurate brain region of interest (ROI) detection from dynamic susceptibility contrast (DSC) perfusion magnetic resonance (MR) images of a human head with abnormal brain anatomy. Such images produce problems for automatic brain segmentation algorithms, and as a result, poor perfusion ROI detection affects both quantitative measurements and visual assessment of perfusion data. In the proposed approach image segmentation is based on CUSUM filter usage that was adapted to be applicable to process DSC perfusion MR images. The result of segmentation is a binary mask of brain ROI that is generated via usage of brain boundary location. Each point of the boundary between the brain and surrounding tissues is detected as a change point by CUSUM filter. Proposed adopted CUSUM filter operates by accumulating the deviations between the observed and expected intensities of image points at the time of moving on a trajectory. Motion trajectory is created by the iterative change of movement direction inside the background region in order to reach brain region, and vice versa after boundary crossing. Proposed segmentation approach was evaluated with Dice index comparing obtained results to the reference standard. Manually marked brain region pixels (reference standard), as well as visual inspection of detected with CUSUM filter usage brain ROI, were provided by experienced radiologists. The results showed that proposed approach is suitable to be used for brain ROI detection from DSC perfusion MR images of a human head with abnormal brain anatomy and can, therefore, be applied in the DSC perfusion data analysis.


A note on finite determinacy of matrices. In this note, we give a necessary and sufficient condition for a matrix A in M to be finitely G determined, where M is the ring of 2 x 2 matrices whose entries are formal power series over an infinite field, and G is a group acting on M by change of coordinates together with multiplication by invertible matrices from both sides.


Novel, simple and robust contact discontinuity capturing schemes for high speed compressible flows. The nonlinear convection terms in the governing equations of compressible fluid flows are hyperbolic in nature and are nontrivial for modelling and numerical simulation. Many numerical methods have been developed in the last few decades for this purpose and are typically based on Riemann solvers, which are strongly dependent on the underlying eigen structure of the governing equations. Objective of the present work is to develop simple algorithms which are not dependent on the eigen structure and yet can tackle easily the hyperbolic parts. Central schemes with smart diffusion mechanisms are apt for this purpose. For fixing the numerical diffusion, the basic ideas of satisfying the Rankine Hugoniot (RH) conditions along with generalized Riemann invariants are proposed. Two such interesting algorithms are presented, which capture grid aligned steady contact discontinuities exactly and yet have sufficient numerical diffusion to avoid numerical shock instabilities. Both the algorithms presented are robust in avoiding shock instabilities, apart from being accurate in capturing contact discontinuities, do not need wave speed corrections and are independent of eigen strutures of the underlying hyperbolic parts of the systems.


UFOMap An Efficient Probabilistic 3D Mapping Framework That Embraces the Unknown. 3D models are an essential part of many robotic applications. In applications where the environment is unknown a priori, or where only a part of the environment is known, it is important that the 3D model can handle the unknown space efficiently. Path planning, exploration, and reconstruction all fall into this category. In this paper we present an extension to OctoMap which we call UFOMap. UFOMap uses an explicit representation of all three states in the map, i.e., occupied, free, and unknown. This gives, surprisingly, a more memory efficient representation. Furthermore, we provide methods that allow for significantly faster insertions into the octree. This enables real time colored volumetric mapping at high resolution (below 1 cm). UFOMap is contributed as a C library that can be used standalone but is also integrated into ROS.


Large self similar solutions of the parabolic elliptic Keller Segel model. We construct radial self similar solutions of the, so called, minimal parabolic elliptic Keller Segel model in several space dimensions with radial, nonnegative initial conditions with are below the Chandrasekhar solution the singular stationary solution of this system.


Some results on a question of M. Newman on isomorphic subgroups of solvable groups. In this paper, we focus on a question of M. Newman on isomorphic subgroups of solvable groups. We get a reduction theorem of this question for each prime q, assume that this question holds for every characteristic q groups, then this question holds for every finite solvable groups. Using this reduction theorem, we get some partial answers about this question.


Using Formal Methods for Autonomous Systems Five Recipes for Formal Verification. Formal Methods are mathematically based techniques for software design and engineering, which enable the unambiguous description of and reasoning about a system's behaviour. Autonomous systems use software to make decisions without human control, are often embedded in a robotic system, are often safety critical, and are increasingly being introduced into everyday settings. Autonomous systems need robust development and verification methods, but formal methods practitioners are often asked Why use Formal Methods for Autonomous Systems? To answer this question, this position paper describes five recipes for formally verifying aspects of an autonomous system, collected from the literature. The recipes are examples of how Formal Methods can be an effective tool for the development and verification of autonomous systems. During design, they enable unambiguous description of requirements in development, formal specifications can be verified against requirements software components may be synthesised from verified specifications and behaviour can be monitored at runtime and compared to its original specification. Modern Formal Methods often include highly automated tool support, which enables exhaustive checking of a system's state space. This paper argues that Formal Methods are a powerful tool for the repertoire of development techniques for safe autonomous systems, alongside other robust software engineering techniques.


Method for Searching of an Optimal Scenario of Impact in Cognitive Maps during Information Operations Recognition. In this paper, we consider the problem of choosing the optimal scenario of the impact between nodes based on of the introduced criteria for the optimality of the impact. Two criteria for the optimality of the impact, which are called the force of impact and the speed of implementation of the scenario, are considered. To obtain a unique solution of the problem, a multi criterial assessment of the received scenarios using the Pareto principle was applied. Based on the criteria of a force of impact and the speed of implementation of the scenario, the choice of the optimal scenario of impact was justified. The results and advantages of the proposed approach in comparison with the Kosko model are presented.


A probabilistic protocol for the assessment of transition and control. Transition to turbulence dramatically alters the properties of fluid flows. In most canonical shear flows, the laminar flow is linearly stable and a finite amplitude perturbation is necessary to trigger transition. Controlling transition to turbulence is achieved via the broadening or narrowing of the basin of attraction of the laminar flow. In this paper, a novel methodology to assess the robustness of the laminar flow and the efficiency of control strategies is introduced. It relies on the statistical sampling of the phase space neighborhood around the laminar flow in order to assess the transition probability of perturbations as a function of their energy. This approach is applied to a canonical flow (plane Couette flow) and provides invaluable insight in the presence of the chosen control, transition is significantly suppressed whereas plausible scalar indicators of the nonlinear stability of the flow, such as the edge state energy, do not provide conclusive predictions. The methodology presented here in the context of transition to turbulence is applicable to any nonlinear system displaying finite amplitude instability.


Evaluating Computational Language Models with Scaling Properties of Natural Language. In this article, we evaluate computational models of natural language with respect to the universal statistical behaviors of natural language. Statistical mechanical analyses have revealed that natural language text is characterized by scaling properties, which quantify the global structure in the vocabulary population and the long memory of a text. We study whether five scaling properties (given by Zipf's law, Heaps' law, Ebeling's method, Taylor's law, and long range correlation analysis) can serve for evaluation of computational models. Specifically, we test n gram language models, a probabilistic context free grammar (PCFG), language models based on Simon Pitman Yor processes, neural language models, and generative adversarial networks (GANs) for text generation. Our analysis reveals that language models based on recurrent neural networks (RNNs) with a gating mechanism (i.e., long short term memory, LSTM a gated recurrent unit, GRU and quasi recurrent neural networks, QRNNs) are the only computational models that can reproduce the long memory behavior of natural language. Furthermore, through comparison with recently proposed model based evaluation methods, we find that the exponent of Taylor's law is a good indicator of model quality.


Multiscale analysis for traveling pulse solutions to the stochastic FitzHugh Nagumo equations. We investigate the stability of traveling pulse solutions to the stochastic FitzHughNagumo equations with additive noise. Special attention is given to the effect of small noise on the classical deterministically stable fast traveling pulse. Our method is based on adapting the velocity of the traveling wave by solving a scalar stochastic ordinary differential equation (SODE) and tracking perturbations to the wave meeting a system of a scalar stochastic partial differential equation (SPDE) coupled to a scalar ordinary differential equation (ODE). This approach has been recently employed by Kr "uger and Stannat for scalar stochastic bistable reaction diffusion equations such as the Nagumo equation. A main difference in our situation of an SPDE coupled to an ODE is that the linearization has essential spectrum parallel to the imaginary axis and thus only generates a strongly continuous semigroup. Furthermore, the linearization around the traveling wave is not self adjoint anymore, so that fluctuations around the wave cannot be expected to be orthogonal in a corresponding inner product. We demonstrate that this problem can be overcome by making use of Riesz instead of orthogonal spectral projections as recently employed in a series of papers by Hamster and Hupkes in case of analytic semigroups. We expect that our approach can also be applied to traveling waves and other patterns in more general situations such as systems of SPDEs with linearizations only generating a strongly continuous semigroup. This provides a relevant generalization as these systems are prevalent in many applications.


Timeline based Planning and Execution with Uncertainty Theory, Modeling Methodologies and Practice. Automated Planning is one of the main research field of Artificial Intelligence since its beginnings. Research in Automated Planning aims at developing general reasoners (i.e., planners) capable of automatically solve complex problems. Broadly speaking, planners rely on a general model characterizing the possible states of the world and the actions that can be performed in order to change the status of the world. Given a model and an initial known state, the objective of a planner is to synthesize a set of actions needed to achieve a particular goal state. The classical approach to planning roughly corresponds to the description given above. The timeline based approach is a particular planning paradigm capable of integrating causal and temporal reasoning within a unified solving process. This approach has been successfully applied in many real world scenarios although a common interpretation of the related planning concepts is missing. Indeed, there are significant differences among the existing frameworks that apply this technique. Each framework relies on its own interpretation of timeline based planning and therefore it is not easy to compare these systems. Thus, the objective of this work is to investigate the timeline based approach to planning by addressing several aspects ranging from the semantics of the related planning concepts to the modeling and solving techniques. Specifically, the main contributions of this PhD work consist of (i) the proposal of a formal characterization of the timeline based approach capable of dealing with temporal uncertainty (ii) the proposal of a hierarchical modeling and solving approach (iii) the development of a general purpose framework for planning and execution with timelines (iv) the validation dag of this approach in real world manufacturing scenarios.


Prevalence of Low Credibility Information on Twitter During the COVID 19 Outbreak. As the novel coronavirus spreads across the world, concerns regarding the spreading of misinformation about it are also growing. Here we estimate the prevalence of links to low credibility information on Twitter during the outbreak, and the role of bots in spreading these links. We find that the combined volume of tweets linking to low credibility information is comparable to the volume of New York Times articles and CDC links. Content analysis reveals a politicization of the pandemic. The majority of this content spreads via retweets. Social bots are involved in both posting and amplifying low credibility information, although the majority of volume is generated by likely humans. Some of these accounts appear to amplify low credibility sources in a coordinated fashion.


A Complete Transient Analysis for the Incremental LMS Algorithm. The incremental least mean square (ILMS) algorithm was presented in cite Lopes2007 . The article included theoretical analysis of the algorithm along with simulation results under different scenarios. However, the transient analysis was left incomplete. This work presents the complete transient analysis, including the learning behavior. The analysis results are verified through several experimental results.


AutoSUM Automating Feature Extraction and Multi user Preference Simulation for Entity Summarization. Withthegrowthofknowledgegraphs, entity descriptions are becoming extremely lengthy. Entity summarization task, aiming to generate diverse, comprehensive, and representative summaries for entities, has received increasing interest recently. In most previous methods, features are usually extracted by the handcrafted templates. Then the feature selection and multi user preference simulation take place, depending too much on human expertise. In this paper, a novel integration method called AutoSUM is proposed for automatic feature extraction and multi user preference simulation to overcome the drawbacks of previous methods. There are two modules in AutoSUM extractor and simulator. The extractor module operates automatic feature extraction based on a BiLSTM with a combined input representation including word embeddings and graph embeddings. Meanwhile, the simulator module automates multi user preference simulation based on a well designed two phase attention mechanism (i.e., entity phase attention and user phase attention). Experimental results demonstrate that AutoSUM produces state of the art performance on two widely used datasets (i.e., DBpedia and LinkedMDB) in both F measure and MAP.


Who did They Respond to? Conversation Structure Modeling using Masked Hierarchical Transformer. Conversation structure is useful for both understanding the nature of conversation dynamics and for providing features for many downstream applications such as summarization of conversations. In this work, we define the problem of conversation structure modeling as identifying the parent utterance(s) to which each utterance in the conversation responds to. Previous work usually took a pair of utterances to decide whether one utterance is the parent of the other. We believe the entire ancestral history is a very important information source to make accurate prediction. Therefore, we design a novel masking mechanism to guide the ancestor flow, and leverage the transformer model to aggregate all ancestors to predict parent utterances. Our experiments are performed on the Reddit dataset (Zhang, Culbertson, and Paritosh 2017) and the Ubuntu IRC dataset (Kummerfeld et al. 2019). In addition, we also report experiments on a new larger corpus from the Reddit platform and release this dataset. We show that the proposed model, that takes into account the ancestral history of the conversation, significantly outperforms several strong baselines including the BERT model on all datasets


Finite Time Singularity Formation for C 1, alpha Solutions to the Incompressible Euler Equations on mathbb R 3 . It has been known since work of Lichtenstein 42 and Gunther 29 in the 1920's that the 3D incompressible Euler equation is locally well posed in the class of velocity fields with H "older continuous gradient and suitable decay at infinity. It is shown here that these local solutions can develop singularities in finite time, even for some of the simplest three dimensional flows.


On the linear independence of radicals. We provide an alternative proof that the finite rational linear combination of radicals, under certain constraint, are linearly independent over mathbb Q .


Effect of Boundary Constraints on the Nonlinear Flapping of Filaments Animated by Follower Forces. Elastically driven filaments subjected to animating compressive follower forces provide a synthetic way to mimic the oscillatory beating of active biological filaments such as eukaryotic cilia. The dynamics of such active filaments can, under favorable conditions, exhibit stable time periodic responses that result due to the interplay of elastic buckling instabilities, geometric constraints, boundary conditions, and dissipation due to fluid drag. In this paper, we use a continuum elastic rod model to estimate the critical follower force required for the onset of the stable time periodic flapping oscillations in pre stressed rods subjected to fluid drag. The pre stress is generated by imposing either clamped clamped or clamped pinned boundary constraints and the results are compared with those of clamped free case, which is without pre stress. We find that the critical value increases with the initial slack that quantifies the pre stress, and strongly depends on the type of the constraints at the boundaries. The frequency of oscillations far from the onset, however, depends primarily on the magnitude of the follower force, not on the boundary constraints. Interestingly, oscillations for the clamped pinned case are observed only when the follower forces are directed towards the clamped end. This finding can be exploited to design a mechanical switch to initiate or quench the oscillations by reversing the direction of the follower force or altering the boundary conditions.


Rate of approximation by new variants of Bernstein Durrmeyer operators. In this paper, we give direct theorems on point wise and global approximation by new variants of Bernstein Durrmeyer operator, introduced by A. M. et al. 1 .


Benchmarking Network Embedding Models for Link Prediction Are We Making Progress?. Network embedding methods map a network's nodes to vectors in an embedding space, in such a way that these representations are useful for estimating some notion of similarity or proximity between pairs of nodes in the network. The quality of these node representations is then showcased through results of downstream prediction tasks. Commonly used benchmark tasks such as link prediction, however, present complex evaluation pipelines and an abundance of design choices. This, together with a lack of standardized evaluation setups can obscure the real progress in the field. In this paper, we aim to shed light on the state of the art of network embedding methods for link prediction and show, using a consistent evaluation pipeline, that only thin progress has been made over the last years. The newly conducted benchmark that we present here, including 17 embedding methods, also shows that many approaches are outperformed even by simple heuristics. Finally, we argue that standardized evaluation tools can repair this situation and boost future progress in this field.


A Convergence Result for Dirichlet Semigroups on Tubular Neighbourhoods and the Marginals of Conditional Brownian Motion. We investigate yet another approach to understand the limit behaviour of Brownian motion conditioned to stay within a tubular neighbourhood around a closed and connected submanifold of a Riemannian manifold. In this context, we identify a second order generator subject to Dirichlet conditions on the boundary of the tube and study its associated semigroups. After a suitable rescaling and renormalization procedure, we obtain convergence of these semigroups, both in L 2 and in Sobolev spaces of arbitrarily large index, to a limit semigroup, as the tube diameter tends to zero. As a byproduct, we conclude that the conditional Brownian motion converges in finite dimensional distributions to a limit process supported by the path space of the submanifold.


Graph Homomorphisms Based On Particular Total Colorings of Graphs and Graphic Lattices. Lattice based cryptography is not only for thwarting future quantum computers, and is also the basis of Fully Homomorphic Encryption. Motivated from the advantage of graph homomorphisms we combine graph homomorphisms with graph total colorings together for designing new types of graph homomorphisms totally colored graph homomorphisms, graphic lattice homomorphisms from sets to sets, every zero graphic group homomorphisms from sets to sets. Our graph homomorphism lattices are made up by graph homomorphisms. These new homomorphisms induce some problems of graph theory, for example, Number String Decomposition and Graph Homomorphism Problem.


Approximate Dynamic Programming for Delivery Time Slot Pricing a Sensitivity Analysis. We consider the revenue management problem of finding profit maximising prices for delivery time slots in the context of attended home delivery. This multi stage optimal control problem admits a dynamic programming formulation that is intractable for realistic problem sizes due to the so called "curse of dimensionality". Therefore, we study three approximate dynamic programming algorithms both from a control theoretical perspective and in a parametric numerical case study. Our numerical analysis is based on real world data, from which we generate multiple scenarios to stress test the robustness of the pricing policies to errors in model parameter estimates. Our theoretical analysis and numerical benchmark tests show that one of these algorithms, namely gradient bounded dynamic programming, dominates the others with respect to computation time and profit generation capabilities of the delivery slot pricing policies that it generates. Finally, we show that uncertainty in the estimates of the model parameters further increases the profit generation dominance of this approach.


Hurricanes and hashtags Characterizing online collective attention for natural disasters. We study collective attention paid towards hurricanes through the lens of n grams on Twitter, a social media platform with global reach. Using hurricane name mentions as a proxy for awareness, we find that the exogenous temporal dynamics are remarkably similar across storms, but that overall collective attention varies widely even among storms causing comparable deaths and damage. We construct hurricane attention maps' and observe that hurricanes causing deaths on (or economic damage to) the continental United States generate substantially more attention in English language tweets than those that do not. We find that a hurricane's Saffir Simpson wind scale category assignment is strongly associated with the amount of attention it receives. Higher category storms receive higher proportional increases of attention per proportional increases in number of deaths or dollars of damage, than lower category storms. The most damaging and deadly storms of the 2010s, Hurricanes Harvey and Maria, generated the most attention and were remembered the longest, respectively. On average, a category 5 storm receives 4.6 times more attention than a category 1 storm causing the same number of deaths and economic damage.


Discrete Optimization Methods for Group Model Selection in Compressed Sensing. In this article we study the problem of signal recovery for group models. More precisely for a given set of groups, each containing a small subset of indices, and for given linear sketches of the true signal vector which is known to be group sparse in the sense that its support is contained in the union of a small number of these groups, we study algorithms which successfully recover the true signal just by the knowledge of its linear sketches. We derive model projection complexity results and algorithms for more general group models than the state of the art. We consider two versions of the classical Iterative Hard Thresholding algorithm (IHT). The classical version iteratively calculates the exact projection of a vector onto the group model, while the approximate version (AM IHT) uses a head and a tail approximation iteratively. We apply both variants to group models and analyse the two cases where the sensing matrix is a Gaussian matrix and a model expander matrix. To solve the exact projection problem on the group model, which is known to be equivalent to the maximum weight coverage problem, we use discrete optimization methods based on dynamic programming and Benders' Decomposition. The head and tail approximations are derived by a classical greedy method and LP rounding, respectively.


Meta Graph Based HIN Spectral Embedding Methods, Analyses, and Insights. In this work, we propose to study the utility of different meta graphs, as well as how to simultaneously leverage multiple meta graphs for HIN embedding in an unsupervised manner. Motivated by prolific research on homogeneous networks, especially spectral graph theory, we firstly conduct a systematic empirical study on the spectrum and embedding quality of different meta graphs on multiple HINs, which leads to an efficient method of meta graph assessment. It also helps us to gain valuable insight into the higher order organization of HINs and indicates a practical way of selecting useful embedding dimensions. Further, we explore the challenges of combining multiple meta graphs to capture the multi dimensional semantics in HIN through reasoning from mathematical geometry and arrive at an embedding compression method of autoencoder with ell 2,1 loss, which finds the most informative meta graphs and embeddings in an end to end unsupervised manner. Finally, empirical analysis suggests a unified workflow to close the gap between our meta graph assessment and combination methods. To the best of our knowledge, this is the first research effort to provide rich theoretical and empirical analyses on the utility of meta graphs and their combinations, especially regarding HIN embedding. Extensive experimental comparisons with various state of the art neural network based embedding methods on multiple real world HINs demonstrate the effectiveness and efficiency of our framework in finding useful meta graphs and generating high quality HIN embeddings.


Counting Condorcet Domains. A Condorcet domain is a collection of linear orders which satisfy an acyclic majority relation. In this paper we describe domains as collections of directed Hamilton paths. We prove that while Black's single peaked domains are defined by their extremal paths, Arrow's single peaked domains are not. We also introduce domain contractions and domain extensions as well as self paired domains, and describe some properties of these. We give a formula for the number of isomorphism classes of Arrow's single peaked domains in terms of the number of self paired domains, and give upper and lower bounds on this number. We also enumerate the distinct maximal Arrow's single peaked domains for A 5,6,7, 8 . Finally, we show that all of the observations in this paper can be translated to single dipped domains, that is, Condorcet domains with complete "never top" conditions.


Versatile Mixed Methods for Non Isothermal Incompressible Flows. The purpose of this paper is to extend the versatile mixed methods originally developed by Chen and Williams for isothermal flows in "Versatile Mixed Methods for the Incompressible Navier Stokes Equations," Computers Mathematics with Applications, 2020, (under review), to simulate non isothermal incompressible flows. These new mixed methods are particularly interesting, as with only minor modifications they can be applied to a much broader range of flows, including non isothermal weakly compressible flows, and fully compressible flows. In the main body of this paper, we carefully develop these mixed methods for solving the Boussinesq model equations. Thereafter, we prove the L2 stability of the discrete temperature field, and assess the practical behavior of the methods by applying them to a set of well known convection problems.


Lines on cubic surfaces and Witt invariants. The aim of this note is to give a formula expressing the trace form associated with the 27 lines of a cubic surface.


Deformations of Adjoint orbits for semisimple Lie algebras and Lagrangian submanifolds. We give a coadjoint orbit's diffeomorphic deformation between the classical semisimple case and the semi direct product given by a Cartan decomposition. The two structures admit the Hermitian symplectic form defined in a semisimple complex Lie algebra. We provide some applications such as the constructions of Lagrangian submanifolds.


Self stabilizing Graph Exploration by a Single Agent. In this paper, we give two self stabilizing algorithms that solve graph exploration by a single (mobile) agent. The proposed algorithms are self stabilizing the agent running each of the algorithms visits all nodes starting from any initial configuration where the state of the agent and the states of all nodes are arbitrary and the agent is located at an arbitrary node. We evaluate algorithms with two metrics, the cover time, that is the number of moves required to visit all nodes, and the amount of space to store the state of the agent and the states of the nodes. The first algorithm is a randomized one. The cover time of this algorithm is optimal ( ie O(m) ) in expectation and it uses O( log n) bits for both the agent and each node, where n and m are the number of agents and the number of edges in a given graph, respectively. The second algorithm is deterministic. The cover time is O(m nD) , where D is the diameter of the graph. It uses O( log n) bits for the agent memory and O( delta log n) bits for the memory of each node with degree delta . We require the knowledge of an upper bound on n (resp. D ) for the first (resp. the second) algorithm. However, this is a weak assumption from a practical point of view because the knowledge of any value ge n (resp. ge D ) in O(poly(n)) is sufficient to obtain the above time and space complexity.


Arbitrary amplitude nucleus acoustic solitary waves in thermally degenerate plasma systems. A rigorous theoretical investigation is made of arbitrary amplitude nucleus acoustic solitary waves (SWs) in a fully ionized multi nucleus plasma system (consisting of thermally degenerate electron species and non degenerate warm light as well as heavy nucleus species). The pseudo potential approach, which is valid for the arbitrary amplitude SWs, is employed. The subsonic and supersonic nucleus acoustic SWs (which are found to be compressive) along with their basic features are identified. The basic properties of these subsonic and supersonic nucleus acoustic SWs are found to be significantly modified by the effects of non and ultra relativistically degenerate electron species, dynamics of heavy nucleus species, number densities as well as adiabatic temperatures of light and heavy nucleus species, etc. It shown that the presence of heavy nucleus species with non degenerate (isothermal) electron species supports the existence of subsonic nucleus acoustic SWs, and that the effects of electron degeneracies and light and heavy nucleus temperatures reduce the possibility for the formation of these subsonic nucleus acoustic SWs. The amplitude of the supersonic nucleus acoustic SWs in the situation of non relativistically degenerate electron species is much smaller than that of ultra relativistically degenerate electron species, but is much larger than that of isothermal electron species. The rise of adiabatic temperature of light or heavy nucleus species causes to decrease (increase) the amplitude (width) of the subsonic and supersonic nucleus acoustic SWs. On the other hand, the increase in the number density of light or heavy nucleus species causes to increase (decrease) the amplitude (width) of the subsonic and supersonic nucleus acoustic SWs. The results of this investigation are found to be applicable in laboratory, space, and astrophysical plasma systems.


One Size Does Not Fit All Modeling Users' Personal Curiosity in Recommender Systems. Today's recommender systems are criticized for recommending items that are too obvious to arouse users' interest. That's why the recommender systems research community has advocated some "beyond accuracy" evaluation metrics such as novelty, diversity, coverage, and serendipity with the hope of promoting information discovery and sustain users' interest over a long period of time. While bringing in new perspectives, most of these evaluation metrics have not considered individual users' difference an open minded user may favor highly novel or diversified recommendations whereas a conservative user's appetite for novelty or diversity may not be that large. In this paper, we developed a model to approximate an individual's curiosity distribution over different levels of stimuli guided by the well known Wundt curve in Psychology. We measured an item's surprise level to assess the stimulation level and whether it is in the range of the user's appetite for stimulus. We then proposed a recommendation system framework that considers both user preference and appetite for stimulus where the curiosity is maximally aroused. Our framework differs from a typical recommender system in that it leverages human's curiosity to promote intrinsic interest with the system. A series of evaluation experiments have been conducted to show that our framework is able to rank higher the items with not only high ratings but also high response likelihood. The recommendation list generated by our algorithm has higher potential of inspiring user curiosity compared to traditional approaches. The personalization factor for assessing the stimulus (surprise) strength further helps the recommender achieve smaller (better) inter user similarity.


It's not Greek to mBERT Inducing Word Level Translations from Multilingual BERT. Recent works have demonstrated that multilingual BERT (mBERT) learns rich cross lingual representations, that allow for transfer across languages. We study the word level translation information embedded in mBERT and present two simple methods that expose remarkable translation capabilities with no fine tuning. The results suggest that most of this information is encoded in a non linear way, while some of it can also be recovered with purely linear tools. As part of our analysis, we test the hypothesis that mBERT learns representations which contain both a language encoding component and an abstract, cross lingual component, and explicitly identify an empirical language identity subspace within mBERT representations.