Computing Multiplicative Relations between Roots of a Polynomial. Multiplicative relations between the roots of a polynomial in mathbb Q x have drawn much attention in the field of arithmetic and algebra, while the problem of computing these relations is interesting to researchers in many other fields. In this paper, a sufficient condition is given for a polynomial f in mathbb Q x to have only trivial multiplicative relations between its roots, which is a generalization of those sufficient conditions proposed in C. J. Smyth, emph J. Number Theory , 23 (1986), pp. 243 254 , G. Baron emph et al ., emph J. Algebra , 177 (1995), pp. 827 846 and J. D. Dixon, emph Acta Arith. 82 (1997), pp. 293 302 . Based on the new condition, a subset E subset mathbb Q x is defined and proved to be genetic (i.e., the set mathbb Q x backslash E is very small). We develop an algorithm deciding whether a given polynomial f in mathbb Q x is in E and returning a basis of the lattice consisting of the multiplicative relations between the roots of f whenever f in E . The numerical experiments show that the new algorithm is very efficient for the polynomials in E . A large number of polynomials with much higher degrees, which were intractable before, can be handled successfully with the algorithm.


ProphetNet Ads A Looking Ahead Strategy for Generative Retrieval Models in Sponsored Search Engine. In a sponsored search engine, generative retrieval models are recently proposed to mine relevant advertisement keywords for users' input queries. Generative retrieval models generate outputs token by token on a path of the target library prefix tree (Trie), which guarantees all of the generated outputs are legal and covered by the target library. In actual use, we found several typical problems caused by Trie constrained searching length. In this paper, we analyze these problems and propose a looking ahead strategy for generative retrieval models named ProphetNet Ads. ProphetNet Ads improves the retrieval ability by directly optimizing the Trie constrained searching space. We build a dataset from a real word sponsored search engine and carry out experiments to analyze different generative retrieval models. Compared with Trie based LSTM generative retrieval model proposed recently, our single model result and integrated result improve the recall by 15.58 and 18.8 respectively with beam size 5. Case studies further demonstrate how these problems are alleviated by ProphetNet Ads clearly.


On the cycles of components of disconnected Julia sets. For any integers d ge 3 and n ge 1 , we construct a hyperbolic rational map of degree d such that it has n cycles of the connected components of its Julia set except single points and Jordan curves.


Cohomological dimension of ideals defining Veronese subrings. Given a standard graded polynomial ring over a commutative Noetherian ring A , we prove that the cohomological dimension and the height of the ideals defining any of its Veronese subrings are equal. This result is due to Ogus when A is a field of characteristic zero, and follows from a result of Peskine and Szpiro when A is a field of positive characteristic our result applies, for example, when A is the ring of integers.


Using Orthophoto for Building Boundary Sharpening in the Digital Surface Model. Nowadays dense stereo matching has become one of the dominant tools in 3D reconstruction of urban regions for its low cost and high flexibility in generating dense 3D points. However, state of the art stereo matching algorithms usually apply a semi global matching (SGM) strategy. This strategy normally assumes the surface geometry pieceswise planar, where a smooth penalty is imposed to deal with non texture or repeating texture areas. This on one hand, generates much smooth surface models, while on the other hand, may partially leads to smoothing on depth discontinuities, particularly for fence shaped regions or densely built areas with narrow streets. To solve this problem, in this work, we propose to use the line segment information extracted from the corresponding orthophoto as a pose processing tool to sharpen the building boundary of the Digital Surface Model (DSM) generated by SGM. Two methods which are based on graph cut and plane fitting are proposed and compared. Experimental results on several satellite datasets with ground truth show the robustness and effectiveness of the proposed DSM sharpening method.


mu VulDeePecker A Deep Learning Based System for Multiclass Vulnerability Detection. Fine grained software vulnerability detection is an important and challenging problem. Ideally, a detection system (or detector) not only should be able to detect whether or not a program contains vulnerabilities, but also should be able to pinpoint the type of a vulnerability in question. Existing vulnerability detection methods based on deep learning can detect the presence of vulnerabilities (i.e., addressing the binary classification or detection problem), but cannot pinpoint types of vulnerabilities (i.e., incapable of addressing multiclass classification). In this paper, we propose the first deep learning based system for multiclass vulnerability detection, dubbed mu VulDeePecker. The key insight underlying mu VulDeePecker is the concept of code attention, which can capture information that can help pinpoint types of vulnerabilities, even when the samples are small. For this purpose, we create a dataset from scratch and use it to evaluate the effectiveness of mu VulDeePecker. Experimental results show that mu VulDeePecker is effective for multiclass vulnerability detection and that accommodating control dependence (other than data dependence) can lead to higher detection capabilities.


Vibration Reduction by Stiffness Modulation a Theoretical Study. Semi active vibration reduction techniques are defined as techniques in which controlled actions do not operate directly on the system's degrees of freedom (as in the case of active vibration control) but on the system's parameters, i.e., mass, damping, or stiffness. Cyclic variations in the stiffness of a structural system have been addressed in several previous studies as an effective semi active vibration reduction method. The proposed applications of this idea, denoted here as stiffness modulation, range from stepwise stiffness variations on a simple spring mass system to continuous stiffness changes on rotor blades under aerodynamic loads. Semi active systems are generally claimed to be energetically passive. However, changes in stiffness directly affect the elastic potential energy of the system and require external work under given conditions. In most cases, such injection or extraction of energy (performed by the device in charge of the stiffness variation and denoted as the pseudo active effect) usually coexists with the semi active effect, which operates by redistributing the potential energy within the system in such a way that it can be dissipated more efficiently. This work focuses on the discrimination between these two effects, which is absent in previous literature. A first study on their dependence on the process parameters of stiffness modulation is presented here, with emphasis on the spatial distribution of the stiffness changes. It is shown that localized changes tend to result in a larger semi active share of vibration attenuation, whereas a spatially homogeneous stiffness modulation only generates a pseudo active effect.


Proving Data Poisoning Robustness in Decision Trees. Machine learning models are brittle, and small changes in the training data can result in different predictions. We study the problem of proving that a prediction is robust to data poisoning, where an attacker can inject a number of malicious elements into the training set to influence the learned model. We target decision tree models, a popular and simple class of machine learning models that underlies many complex learning techniques. We present a sound verification technique based on abstract interpretation and implement it in a tool called Antidote. Antidote abstractly trains decision trees for an intractably large space of possible poisoned datasets. Due to the soundness of our abstraction, Antidote can produce proofs that, for a given input, the corresponding prediction would not have changed had the training set been tampered with or not. We demonstrate the effectiveness of Antidote on a number of popular datasets.


A lower bound for the K "ahler Einstein distance from the Diederich Forn ae ss index. In this note we establish a lower bound for the distance induced by the K "ahler Einstein metric on pseudoconvex domains with positive hyperconvexity index (e.g. positive Diederich Fornaess index). A key step is proving an analog of the Hopf lemma for Riemannian manifolds with Ricci curvature bounded from below.


Joint Learning of Assignment and Representation for Biometric Group Membership. This paper proposes a framework for group membership protocols preventing the curious but honest server from reconstructing the enrolled biometric signatures and inferring the identity of querying clients. This framework learns the embedding parameters, group representations and assignments simultaneously. Experiments show the trade off between security privacy and verification identification performances.


Vaught's Conjecture for Almost Chainable Theories. A structure mathbb Y of a relational language L is called almost chainable iff there are a finite set F subset Y and a linear order on the set Y setminus F such that for each partial automorphism varphi (i.e., local automorphism, in Fra " i ss ' e 's terminology) of the linear order langle Y setminus F, rangle the mapping mathrm id F cup varphi is a partial automorphism of mathbb Y . By a theorem of Fra " i ss ' e , if L omega , then mathbb Y is almost chainable iff the profile of mathbb Y is bounded namely, iff there is a positive integer m such that mathbb Y has leq m non isomorphic substructures of size n , for each positive integer n . A complete first order L theory mathcal T having infinite models is called almost chainable iff all models of mathcal T are almost chainable and it is shown that the last condition is equivalent to the existence of one countable almost chainable model of mathcal T . In addition, it is proved that an almost chainable theory has either one or continuum many non isomorphic countable models and, thus, the Vaught conjecture is confirmed for almost chainable theories.


Autonomous Navigation with Mobile Robots using Deep Learning and the Robot Operating System. Autonomous navigation is a long standing field of robotics research, which provides an essential capability for mobile robots to execute a series of tasks on the same environments performed by human everyday. In this chapter, we present a set of algorithms to train and deploy deep networks for autonomous navigation of mobile robots using the Robot Operation System (ROS). We describe three main steps to tackle this problem i) collecting data in simulation environments using ROS and Gazebo ii) designing deep network for autonomous navigation, and iii) deploying the learned policy on mobile robots in both simulation and real world. Theoretically, we present deep learning architectures for robust navigation in normal environments (e.g., man made houses, roads) and complex environments (e.g., collapsed cities, or natural caves). We further show that the use of visual modalities such as RGB, Lidar, and point cloud is essential to improve the autonomy of mobile robots. Our project website and demonstration video can be found at https sites.google.com site autonomousnavigationros.


DIABLO Dictionary based Attention Block for Deep Metric Learning. Recent breakthroughs in representation learning of unseen classes and examples have been made in deep metric learning by training at the same time the image representations and a corresponding metric with deep networks. Recent contributions mostly address the training part (loss functions, sampling strategies, etc.), while a few works focus on improving the discriminative power of the image representation. In this paper, we propose DIABLO, a dictionary based attention method for image embedding. DIABLO produces richer representations by aggregating only visually related features together while being easier to train than other attention based methods in deep metric learning. This is experimentally confirmed on four deep metric learning datasets (Cub 200 2011, Cars 196, Stanford Online Products, and In Shop Clothes Retrieval) for which DIABLO shows state of the art performances.


MEME Generating RNN Model Explanations via Model Extraction. Recurrent Neural Networks (RNNs) have achieved remarkable performance on a range of tasks. A key step to further empowering RNN based approaches is improving their explainability and interpretability. In this work we present MEME a model extraction approach capable of approximating RNNs with interpretable models represented by human understandable concepts and their interactions. We demonstrate how MEME can be applied to two multivariate, continuous data case studies Room Occupation Prediction, and In Hospital Mortality Prediction. Using these case studies, we show how our extracted models can be used to interpret RNNs both locally and globally, by approximating RNN decision making via interpretable concept interactions.


Self Adjusting Linear Networks. Emerging networked systems become increasingly flexible and reconfigurable. This introduces an opportunity to adjust networked systems in a demand aware manner, leveraging spatial and temporal locality in the workload for online optimizations. However, it also introduces a trade off while more frequent adjustments can improve performance, they also entail higher reconfiguration costs. This paper initiates the formal study of linear networks which self adjust to the demand in an online manner, striking a balance between the benefits and costs of reconfigurations. We show that the underlying algorithmic problem can be seen as a distributed generalization of the classic dynamic list update problem known from self adjusting datastructures in a network, requests can occur between node pairs. This distributed version turns out to be significantly harder than the classical problem in generalizes. Our main results are a Omega( log n ) lower bound on the competitive ratio, and a (distributed) online algorithm that is O( log n ) competitive if the communication requests are issued according to a linear order.


Search Based Online Trajectory Planning for Car like Robots in Highly Dynamic Environments. This paper presents a search based partial motion planner to generate dynamically feasible trajectories for car like robots in highly dynamic environments. The planner searches for smooth, safe, and near time optimal trajectories by exploring a state graph built on motion primitives, which are generated by discretizing the time dimension and the control space. To enable fast online planning, we first propose an efficient path searching algorithm based on the aggregation and pruning of motion primitives. We then propose a fast collision checking algorithm that takes into account the motions of moving obstacles. The algorithm linearizes relative motions between the robot and obstacles and then checks collisions by comparing a point line distance. Benefiting from the fast searching and collision checking algorithms, the planner can effectively and safely explore the state time space to generate near time optimal solutions. The results through extensive experiments show that the proposed method can generate feasible trajectories within milliseconds while maintaining a higher success rate than up to date methods, which significantly demonstrates its advantages.


A weak maximum principle based approach for input to state stability analysis of nonlinear parabolic PDEs with boundary disturbances. In this paper, we introduce a weak maximum principle based approach to input to state stability (ISS) analysis for certain nonlinear partial differential equations (PDEs) with boundary disturbances. Based on the weak maximum principle, a classical result on the maximum estimate of solutions to linear parabolic PDEs has been extended, which enables the ISS analysis for certain nonlinear parabolic PDEs with boundary disturbances. To illustrate the application of this method, we establish ISS estimates for a linear reaction diffusion PDE and a generalized Ginzburg Landau equation with mixed boundary disturbances. Compared to some existing methods, the scheme proposed in this paper involves less intensive computations and can be applied to the ISS analysis for a wide class of nonlinear PDEs with boundary disturbances.


Towards Totally Asynchronous Primal Dual Convex Optimization in Blocks. We present a parallelized primal dual algorithm for solving constrained convex optimization problems. The algorithm is "block based," in that vectors of primal and dual variables are partitioned into blocks, each of which is updated only by a single processor. We consider four possible forms of asynchrony in updates to primal variables, updates to dual variables, communications of primal variables, and communications of dual variables. We explicitly construct a family of counterexamples to rule out permitting asynchronous communication of dual variables, though the other forms of asynchrony are permitted, all without requiring bounds on delays. A first order update law is developed and shown to be robust to asynchrony. We then derive convergence rates to a Lagrangian saddle point in terms of the operations agents execute, without specifying any timing or pattern with which they must be executed. These convergence rates contain a synchronous algorithm as a special case and are used to quantify an "asynchrony penalty." Numerical results illustrate these developments.


Contrastive Attention Mechanism for Abstractive Sentence Summarization. We propose a contrastive attention mechanism to extend the sequence to sequence framework for abstractive sentence summarization task, which aims to generate a brief summary of a given source sentence. The proposed contrastive attention mechanism accommodates two categories of attention one is the conventional attention that attends to relevant parts of the source sentence, the other is the opponent attention that attends to irrelevant or less relevant parts of the source sentence. Both attentions are trained in an opposite way so that the contribution from the conventional attention is encouraged and the contribution from the opponent attention is discouraged through a novel softmax and softmin functionality. Experiments on benchmark datasets show that, the proposed contrastive attention mechanism is more focused on the relevant parts for the summary than the conventional attention mechanism, and greatly advances the state of the art performance on the abstractive sentence summarization task. We release the code at https github.com travel go Abstractive Text Summarization


The EPIC KITCHENS Dataset Collection, Challenges and Baselines. Since its introduction in 2018, EPIC KITCHENS has attracted attention as the largest egocentric video benchmark, offering a unique viewpoint on people's interaction with objects, their attention, and even intention. In this paper, we detail how this large scale dataset was captured by 32 participants in their native kitchen environments, and densely annotated with actions and object interactions. Our videos depict nonscripted daily activities, as recording is started every time a participant entered their kitchen. Recording took place in 4 countries by participants belonging to 10 different nationalities, resulting in highly diverse kitchen habits and cooking styles. Our dataset features 55 hours of video consisting of 11.5M frames, which we densely labelled for a total of 39.6K action segments and 454.2K object bounding boxes. Our annotation is unique in that we had the participants narrate their own videos after recording, thus reflecting true intention, and we crowd sourced ground truths based on these. We describe our object, action and. anticipation challenges, and evaluate several baselines over two test splits, seen and unseen kitchens. We introduce new baselines that highlight the multimodal nature of the dataset and the importance of explicit temporal modelling to discriminate fine grained actions e.g. 'closing a tap' from 'opening' it up.


Pricing equity linked life insurance contracts with multiple risk factors by neural networks. This paper considers the pricing of equity linked life insurance contracts with death and survival benefits in a general model with multiple stochastic risk factors interest rate, equity, volatility, unsystematic and systematic mortality. We price the equity linked contracts by assuming that the insurer hedges the risks to reduce the local variance of the net asset value process and requires a compensation for the non hedgeable part of the liability in the form of an instantaneous standard deviation risk margin. The price can then be expressed as the solution of a system of non linear partial differential equations. We reformulate the problem as a backward stochastic differential equation with jumps and solve it numerically by the use of efficient neural networks. Sensitivity analysis is performed with respect to initial parameters and an analysis of the accuracy of the approximation of the true price with our neural networks is provided.


Dialogue Coherence Assessment Without Explicit Dialogue Act Labels. Recent dialogue coherence models use the coherence features designed for monologue texts, e.g. nominal entities, to represent utterances and then explicitly augment them with dialogue relevant features, e.g., dialogue act labels. It indicates two drawbacks, (a) semantics of utterances is limited to entity mentions, and (b) the performance of coherence models strongly relies on the quality of the input dialogue act labels. We address these issues by introducing a novel approach to dialogue coherence assessment. We use dialogue act prediction as an auxiliary task in a multi task learning scenario to obtain informative utterance representations for coherence assessment. Our approach alleviates the need for explicit dialogue act labels during evaluation. The results of our experiments show that our model substantially (more than 20 accuracy points) outperforms its strong competitors on the DailyDialogue corpus, and performs on par with them on the SwitchBoard corpus for ranking dialogues concerning their coherence.


Willump A Statistically Aware End to end Optimizer for Machine Learning Inference. Systems for ML inference are widely deployed today, but they typically optimize ML inference workloads using techniques designed for conventional data serving workloads and miss critical opportunities to leverage the statistical nature of ML. In this paper, we present Willump, an optimizer for ML inference that introduces two statistically motivated optimizations targeting ML applications whose performance bottleneck is feature computation. First, Willump automatically cascades feature computation for classification queries Willump classifies most data inputs using only high value, low cost features selected through empirical observations of ML model performance, improving query performance by up to 5x without statistically significant accuracy loss. Second, Willump accurately approximates ML top K queries, discarding low scoring inputs with an automatically constructed approximate model and then ranking the remainder with a more powerful model, improving query performance by up to 10x with minimal accuracy loss. Willump automatically tunes these optimizations' parameters to maximize query performance while meeting an accuracy target. Moreover, Willump complements these statistical optimizations with compiler optimizations to automatically generate fast inference code for ML applications. We show that Willump improves the end to end performance of real world ML inference pipelines curated from major data science competitions by up to 16x without statistically significant loss of accuracy.


Model theory of differential henselian pre H fields. Pre H fields are ordered valued differential fields satisfying some basic axioms coming from transseries and Hardy fields. We study pre H fields that are differential Hensel Liouville closed, that is, differential henselian, real closed, and closed under exponential integration, establishing an Ax Kochen Ershov theorem for such structures the theory of a differential Hensel Liouville closed pre H field is determined by the theory of its ordered differential residue field this result fails if the assumption of closure under exponential integration is dropped. In a two sorted setting with one sort for a differential Hensel Liouville closed pre H field and one sort for its ordered differential residue field, we eliminate quantifiers from the pre H field sort, from which we deduce that the ordered differential residue field is stably embedded and if it has NIP, then so does the two sorted structure. Similarly, the one sorted theory of differential Hensel Liouville closed pre H fields with closed ordered differential residue field has quantifier elimination, is the model completion of the theory of pre H fields with gap 0 , and is complete, distal, and locally o minimal.


Aesthetic Attributes Assessment of Images. Image aesthetic quality assessment has been a relatively hot topic during the last decade. Most recently, comments type assessment (aesthetic captions) has been proposed to describe the general aesthetic impression of an image using text. In this paper, we propose Aesthetic Attributes Assessment of Images, which means the aesthetic attributes captioning. This is a new formula of image aesthetic assessment, which predicts aesthetic attributes captions together with the aesthetic score of each attribute. We introduce a new dataset named emph DPC Captions which contains comments of up to 5 aesthetic attributes of one image through knowledge transfer from a full annotated small scale dataset. Then, we propose Aesthetic Multi Attribute Network (AMAN), which is trained on a mixture of fully annotated small scale PCCD dataset and weakly annotated large scale DPC Captions dataset. Our AMAN makes full use of transfer learning and attention model in a single framework. The experimental results on our DPC Captions and PCCD dataset reveal that our method can predict captions of 5 aesthetic attributes together with numerical score assessment of each attribute. We use the evaluation criteria used in image captions to prove that our specially designed AMAN model outperforms traditional CNN LSTM model and modern SCA CNN model of image captions.


DOI 2 . We discuss some seemingly unrelated observations on integers, whose close or farther away neighbors show a complex of combinatorial, ordering, arithmetical or probabilistic properties, emphasizing puzzlement in more common expectations.


OFDMA Resource Allocation for Real Time Applications in IEEE 802.11ax Networks. Support of real time applications that impose strict requirements on packet loss ratio and latency is an essential feature of the next generation Wi Fi networks. Initially introduced in the 802.11ax amendment to the Wi Fi standard, uplink OFDMA seems to be a promising solution for supported low latency data transmission from the numerous stations to an access point. In this paper, we study how to allocate OFDMA resources in an 802.11ax network and propose an algorithm aimed at providing the delay less than one millisecond and reliability up to 99.999 as required by numerous real time applications. We design a resource allocation algorithm and with extensive simulation, show that it decreases delays for real time traffic by orders of magnitude, while the throughput for non real time traffic is reduced insignificantly.


Control of A High Performance Bipedal Robot using Viscoelastic Liquid Cooled Actuators. This paper describes the control, and evaluation of a new human scaled biped robot with liquid cooled viscoelastic actuators (VLCA). Based on the lessons learned from previous work from our team on VLCA 1 , we present a new system design embodying a Reaction Force Sensing Series Elastic Actuator (RFSEA) and a Force Sensing Series Elastic Actuator (FSEA). These designs are aimed at reducing the size and weight of the robot's actuation system while inheriting the advantages of our designs such as energy efficiency, torque density, impact resistance and position force controllability. The system design takes into consideration human inspired kinematics and range of motion (ROM), while relying on foot placement to balance. In terms of actuator control, we perform a stability analysis on a Disturbance Observer (DOB) designed for force control. We then evaluate various position control algorithms both in the time and frequency domains for our VLCA actuators. Having the low level baseline established, we first perform a controller evaluation on the legs using Operational Space Control (OSC) 2 . Finally, we move on to evaluating the full bipedal robot by accomplishing unsupported dynamic walking by means of the algorithms to appear in 3 .


Automatic differentiation of Sylvester, Lyapunov, and algebraic Riccati equations. Sylvester, Lyapunov, and algebraic Riccati equations are the bread and butter of control theorists. They are used to compute infinite horizon Gramians, solve optimal control problems in continuous or discrete time, and design observers. While popular numerical computing frameworks (e.g., scipy) provide efficient solvers for these equations, these solvers are still largely missing from most automatic differentiation libraries. Here, we derive the forward and reverse mode derivatives of the solutions to all three types of equations, and showcase their application on an inverse control problem.


Ultrashort pulse generation from binary temporal phase modulation. We propose and numerically validate an all optical scheme to generate a train of optical pulses. Modulation of a continuous wave with a periodic binary temporal phase pattern followed by a spectral phase shaping enables us to obtain ultrashort pulse trains. An ideal step phase profile as well as a profile arisen from a bandwidth limited device are investigated. Analytical guidelines describing pulse trains formation and their characteristics are provided.


Jantzen filtration of Weyl modules, product of Young symmetrizers and denominator of Young's seminormal basis. Let G be a connected reductive algebraic group over an algebraically closed field of characteristic p 0 , Delta( lambda) denote the Weyl module of G of highest weight lambda and iota lambda, mu Delta( lambda mu) to Delta( lambda) otimes Delta( mu) be the canonical G morphism. We study the split condition for iota lambda, mu over mathbb Z (p) , and apply this as an approach to compare the Jantzen filtrations of the Weyl modules Delta( lambda) and Delta( lambda mu) . In the case when G is of type A , we show that the split condition is closely related to the product of certain Young symmetrizers and, under some mild conditions, is further characterized by the denominator of a certain Young's seminormal basis vector. We obtain explicit formulas for the split condition in some cases.


Belief Regulated Dual Propagation Nets for Learning Action Effects on Groups of Articulated Objects. In recent years, graph neural networks have been successfully applied for learning the dynamics of complex and partially observable physical systems. However, their use in the robotics domain is, to date, still limited. In this paper, we introduce Belief Regulated Dual Propagation Networks (BRDPN), a general purpose learnable physics engine, which enables a robot to predict the effects of its actions in scenes containing groups of articulated multi part objects. Specifically, our framework extends recently proposed propagation networks (PropNets) and consists of two complementary components, a physics predictor and a belief regulator. While the former predicts the future states of the object(s) manipulated by the robot, the latter constantly corrects the robot's knowledge regarding the objects and their relations. Our results showed that after training in a simulator, the robot can reliably predict the consequences of its actions in object trajectory level and exploit its own interaction experience to correct its belief about the state of the environment, enabling better predictions in partially observable environments. Furthermore, the trained model was transferred to the real world and verified in predicting trajectories of pushed interacting objects whose joint relations were initially unknown. We compared BRDPN against PropNets, and showed that BRDPN performs consistently well. Moreover, BRDPN can adapt its physic predictions, since the relations can be predicted online.


Minimax periodic orbits of convex Lagrangian systems on complete Riemannian manifolds. In this paper we study the existence of periodic orbits with prescribed energy levels of convex Lagrangian systems on complete Riemannian manifolds. We extend the existence results of Contreras by developing a modified minimax principal to a class of Lagrangian systems on noncompact Riemannian manifolds, namely the so called lsh Lagrangian systems. In particular, we prove that for almost every k in(0,c u(L)) the exact magnetic flow associated to a lsh Lagrangian has a contractible periodic orbit with energy k . We also discuss the existence and non existence of closed geodesics on the product Riemannian manifold R times M .


Span core Decomposition for Temporal Networks Algorithms and Applications. When analyzing temporal networks, a fundamental task is the identification of dense structures (i.e., groups of vertices that exhibit a large number of links), together with their temporal span (i.e., the period of time for which the high density holds). In this paper we tackle this task by introducing a notion of temporal core decomposition where each core is associated with two quantities, its coreness, which quantifies how densely it is connected, and its span, which is a temporal interval we call such cores emph span cores . For a temporal network defined on a discrete temporal domain T , the total number of time intervals included in T is quadratic in T , so that the total number of span cores is potentially quadratic in T as well. Our first main contribution is an algorithm that, by exploiting containment properties among span cores, computes all the span cores efficiently. Then, we focus on the problem of finding only the emph maximal span cores , i.e., span cores that are not dominated by any other span core by both their coreness property and their span. We devise a very efficient algorithm that exploits theoretical findings on the maximality condition to directly extract the maximal ones without computing all span cores. Finally, as a third contribution, we introduce the problem of emph temporal community search , where a set of query vertices is given as input, and the goal is to find a set of densely connected subgraphs containing the query vertices and covering the whole underlying temporal domain T . We derive a connection between this problem and the problem of finding (maximal) span cores. Based on this connection, we show how temporal community search can be solved in polynomial time via dynamic programming, and how the maximal span cores can be profitably exploited to significantly speed up the basic algorithm.


Pseudo rotations and Steenrod squares revisited. In this note we prove that if a closed monotone symplectic manifold admits a Hamiltonian pseudo rotation, which may be degenerate, then the quantum Steenrod square of the cohomology class Poincar ' e dual to the point must be deformed. This result gives restrictions on the existence of pseudo rotations, implying a form of uniruledness by pseudo holomorphic spheres, and generalizes a recent result of the author. The new component in the proof consists in an elementary calculation with capped periodic orbits.


Existence of solutions for a fractional Choquard type equation in mathbb R with critical exponential growth. In this paper we study the following class of fractional Choquard type equations ( Delta) 1 2 u u Big( I mu ast F(u) Big)f(u), quad x in mathbb R , where ( Delta) 1 2 denotes the 1 2 Laplacian operator, I mu is the Riesz potential with 0 mu 1 and F is the primitive function of f . We use Variational Methods and minimax estimates to study the existence of solutions when f has critical exponential growth in the sense of Trudinger Moser inequality.


Hopf algebra structure of symmetric and quasisymmetric functions in superspace. We show that the ring of symmetric functions in superspace is a cocommutative and self dual Hopf algebra. We provide formulas for the action of the coproduct and the antipode on various bases of that ring. We introduce the ring sQSym of quasisymmetric functions in superspace and show that it is a Hopf algebra. We give explicitly the product, coproduct and antipode on the basis of monomial quasisymmetric functions in superspace. We prove that the Hopf dual of sQSym, the ring sNSym of noncommutative symmetric functions in superspace, has a multiplicative basis dual to the monomial quasisymmetric functions in superspace.


Hyperbolic Image Embeddings. Computer vision tasks such as image classification, image retrieval and few shot learning are currently dominated by Euclidean and spherical embeddings, so that the final decisions about class belongings or the degree of similarity are made using linear hyperplanes, Euclidean distances, or spherical geodesic distances (cosine similarity). In this work, we demonstrate that in many practical scenarios hyperbolic embeddings provide a better alternative.


Characterisation of the parameters of maximum weight spectrum codes according to their spread. We introduce the concept of spread of a code, and we specialize it to the case of maximum weight spectrum (MWS) codes. We classify two newly defined sub families of MWS codes according to their weight distributions, and completely describe their fundamental parameters. We focus on one of these families, the strictly compact MWS codes, proving their optimality as MWS codes and linking them to known codes.


Are Pre trained Language Models Knowledgeable to Ground Open Domain Dialogues?. We study knowledge grounded dialogue generation with pre trained language models. Instead of pursuing new state of the art on benchmarks, we try to understand if the knowledge stored in parameters of the pre trained models is already enough to ground open domain dialogues, and thus allows us to get rid of the dependency on external knowledge sources in generation. Through extensive experiments on benchmarks, we find that by fine tuning with a few dialogues containing knowledge, the pre trained language models can outperform the state of the art model that requires external knowledge in automatic evaluation and human judgment, suggesting a positive answer to the question we raised.


Pricing with Variance Gamma Information. In the information based pricing framework of Brody, Hughston and Macrina, the market filtration mathcal F t t geq 0 is generated by an information process xi t t geq0 defined in such a way that at some fixed time T an mathcal F T measurable random variable X T is "revealed". A cash flow H T is taken to depend on the market factor X T , and one considers the valuation of a financial asset that delivers H T at T . The value S t of the asset at any time t in 0,T) is the discounted conditional expectation of H T with respect to mathcal F t , where the expectation is under the risk neutral measure and the interest rate is constant. Then S T H T , and S t 0 for t geq T . In the general situation one has a countable number of cash flows, and each cash flow can depend on a vector of market factors, each associated with an information process. In the present work, we construct a new class of models for the market filtration based on the variance gamma process. The information process is obtained by subordinating a particular type of Brownian random bridge with a gamma process. The filtration is taken to be generated by the information process together with the gamma bridge associated with the gamma subordinator. We show that the resulting extended information process has the Markov property and hence can be used to price a variety of different financial assets, several examples of which are discussed in detail.


Unique continuation properties for abstract Schroedinger equations and applications. In this paper, Hardy's uncertainty principle and unique continuation properties of Schrodinger equations with operator potentials in Hilbert space valued classes are obtained. Since the Hilbert space H and linear operators are arbitrary, by choosing the appropriate spaces and operators we obtain numerous classes of Schrodinger type equations and its finite and infinite many systems which occur in a wide variety of physical systems.


On critical renormalization of complex polynomials. Holomorphic renormalization plays an important role in complex polynomial dynamics. We consider certain conditions guaranteeing that a polynomial which does not admit a polynomial like connected Julia set still admits an invariant continuum on which it is topologically conjugate to a lower degree polynomial. This invariant continuum may contain extra critical points of the original polynomial that are not visible in the dynamical plane of the conjugate polynomial. Thus, we extend the notions of holomorphic renormalization and polynomial like maps and describe a setup where new generalized versions of these notions are applicable and yield useful topological conjugacies.


On Generalizations of the Newton Raphson Simpson Method. We present generalizations of the Newton Raphson Simpson method. Specifically, for a positive integer m and the sequence of coefficients of a Taylor series of a function f(z) , we define an algorithm we denote by NRS( m ) which is a way to evaluate, in our terminology, a sum of m formal zeros of f(z) . We prove that NRS(1) yields the familiar iterations of the Newton Raphson Simpson method. We also prove that NRS( m ) is way to evaluate certain mathscr A hypergeometric series defined by Sturmfels. In order to define these algorithms, we make use of combinatorial objects which we call trees with negative vertex degree.


Uniform in time convergence of numerical methods for non linear degenerate parabolic equations. Gradient schemes is a framework that enables the unified convergence analysis of many numerical methods for elliptic and parabolic partial differential equations conforming and non conforming Finite Element, Mixed Finite Element and Finite Volume methods. We show here that this framework can be applied to a family of degenerate non linear parabolic equations (which contain in particular the Richards', Stefan's and Leray Lions' models), and we prove a uniform in time strong in space convergence result for the gradient scheme approximations of these equations. In order to establish this convergence, we develop several discrete compactness tools for numerical approximations of parabolic models, including a discontinuous Ascoli Arzel a theorem and a uniform in time weak in space discrete Aubin Simon theorem. The model's degeneracies, which occur both in the time and space derivatives, also requires us to develop a discrete compensated compactness result.


Multiplayer Support for the Arcade Learning Environment. The Arcade Learning Environment ("ALE") is a widely used library in the reinforcement learning community that allows easy programmatic interfacing with Atari 2600 games, via the Stella emulator. We introduce a publicly available extension to the ALE that extends its support to multiplayer games and game modes. This interface is additionally integrated with PettingZoo to allow for a simple Gym like interface in Python to interact with these games. We additionally introduce experimental baselines for all environments included.


Fast Coherent Point Drift. Nonrigid point set registration is widely applied in the tasks of computer vision and pattern recognition. Coherent point drift (CPD) is a classical method for nonrigid point set registration. However, to solve spatial transformation functions, CPD has to compute inversion of a M M matrix per iteration with time complexity O(M3). By introducing a simple corresponding constraint, we develop a fast implementation of CPD. The most advantage of our method is to avoid matrix inverse operation. Before the iteration begins, our method requires to take eigenvalue decomposition of a M M matrix once. After iteration begins, our method only needs to update a diagonal matrix with linear computational complexity, and perform matrix multiplication operation with time complexity approximately O(M2) in each iteration. Besides, our method can be further accelerated by the low rank matrix approximation. Experimental results in 3D point cloud data show that our method can significantly reduce computation burden of the registration process, and keep comparable performance with CPD on accuracy.


Improving spatial resolution in X ray microscopy by using tilted angle detector A simulation study. Conventional x ray imaging detectors suffer from parallax error when the radiation beam arrives at the detector surface at tilted angle. The image blurring occurs as the radiation penetrates detector material in lateral direction at tilted angle. However, at the photon energies used in x ray microscopy the attenuation length of the x rays in the detector material is shorter and consequently the parallax error due to the tilted angle irradiation can be smaller. In these cases, the tilted angle irradiation can be beneficial because it will expand the beam projection ("footprint") at the detector surface, improve spatial resolution and help to overcome inherent resolution limit of the detector. We have performed a simulation study to investigate the above trade off between the parallax error and improved spatial resolution when tilted angle irradiation is used. Our simulation study showed that tilted angle irradiation at 2 5keV x ray energies can provide substantial improvements of spatial resolution. We used in our studies the indirect conversion x ray microscopy detectors based on scintillators optically coupled to CCD and CMOS cameras, as well as direct conversion detectors based on back illuminated (back thinned) CCD and CMOS cameras. We have demonstrated also that the tilted angle irradiation can prevent radiation damage of the direct conversion back illuminated CCD and CMOS cameras due to the shallow x ray attenuation depths with tilted angle geometry.


On cyclic left modules and arbitrary bimodules over the octonions. Qinghai Huo, Yong Li, Guangbin Ren described the structure of left mathbb O modules in great detail in arXiv 1911.08282. However, they left open a question on cyclic left mathbb O modules. This note intends to close this gap and provide a complete description of bimodules.


What Makes for Good Views for Contrastive Learning?. Contrastive learning between multiple views of the data has recently achieved state of the art performance in the field of self supervised representation learning. Despite its success, the influence of different view choices has been less studied. In this paper, we use theoretical and empirical analysis to better understand the importance of view selection, and argue that we should reduce the mutual information (MI) between views while keeping task relevant information intact. To verify this hypothesis, we devise unsupervised and semi supervised frameworks that learn effective views by aiming to reduce their MI. We also consider data augmentation as a way to reduce MI, and show that increasing data augmentation indeed leads to decreasing MI and improves downstream classification accuracy. As a by product, we achieve a new state of the art accuracy on unsupervised pre training for ImageNet classification ( 73 top 1 linear readout with a ResNet 50). In addition, transferring our models to PASCAL VOC object detection and COCO instance segmentation consistently outperforms supervised pre training. Code http github.com HobbitLong PyContrast


Open Systems A Double Categorical Perspective. Fong developed decorated cospans' to model various kinds of open systems that is, systems with inputs and outputs. In this framework, open systems are seen as the morphisms of a category and can be composed as such, allowing larger open systems to be built up from smaller ones. Much work has already been done in this direction, but there is a problem the notion of isomorphism between decorated cospans is often too restrictive. Here we introduce and compare two ways around this problem structured cospans, and a new version of decorated cospans. Structured cospans are very simple given a functor L colon mathsf A to mathsf X , a structured cospan' is a diagram in mathsf X of the form L(a) rightarrow x leftarrow L(b) . If mathsf A and mathsf X have finite colimits and L is a left adjoint, there is a symmetric monoidal category whose objects are those of mathsf A and whose morphisms are isomorphism classes of structured cospans. However, this category arises from a more fundamental structure a symmetric monoidal double category. Under certain conditions this symmetric monoidal double category is equivalent to one built using our new version of decorated cospans. We apply these ideas to symmetric monoidal double categories of open electrical circuits, open Markov processes and open Petri nets.


The Cauchy problem for heat equation with fractional Laplacian and exponential nonlinearity. We consider the Cauchy problem for heat equation with fractional Laplacian and exponential nonlinearity. We establish local well posedness result in Orlicz spaces. We derive the existence of global solutions for small initial data. We obtain decay estimates for large time in Lebesgue spaces.


Dynamic Fusion Attentional Language Model for Neural Machine Translation. Neural Machine Translation (NMT) can be used to generate fluent output. As such, language models have been investigated for incorporation with NMT. In prior investigations, two models have been used a translation model and a language model. The translation model's predictions are weighted by the language model with a hand crafted ratio in advance. However, these approaches fail to adopt the language model weighting with regard to the translation history. In another line of approach, language model prediction is incorporated into the translation model by jointly considering source and target information. However, this line of approach is limited because it largely ignores the adequacy of the translation output. Accordingly, this work employs two mechanisms, the translation model and the language model, with an attentive architecture to the language model as an auxiliary element of the translation model. Compared with previous work in English Japanese machine translation using a language model, the experimental results obtained with the proposed Dynamic Fusion mechanism improve BLEU and Rank based Intuitive Bilingual Evaluation Scores (RIBES) scores. Additionally, in the analyses of the attention and predictivity of the language model, the Dynamic Fusion mechanism allows predictive language modeling that conforms to the appropriate grammatical structure.


Experiments on transfer learning architectures for biomedical relation extraction. Relation extraction (RE) consists in identifying and structuring automatically relations of interest from texts. Recently, BERT improved the top performances for several NLP tasks, including RE. However, the best way to use BERT, within a machine learning architecture, and within a transfer learning strategy is still an open question since it is highly dependent on each specific task and domain. Here, we explore various BERT based architectures and transfer learning strategies (i.e., frozen or fine tuned) for the task of biomedical RE on two corpora. Among tested architectures and strategies, our BERT segMCNN with finetuning reaches performances higher than the state of the art on the two corpora (1.73 and 32.77 absolute improvement on ChemProt and PGxCorpus corpora respectively). More generally, our experiments illustrate the expected interest of fine tuning with BERT, but also the unexplored advantage of using structural information (with sentence segmentation), in addition to the context classically leveraged by BERT.


Characterizing Online Vandalism A Rational Choice Perspective. What factors influence the decision to vandalize? Although the harm is clear, the benefit to the vandal is less clear. In many cases, the thing being damaged may itself be something the vandal uses or enjoys. Vandalism holds communicative value perhaps to the vandal themselves, to some audience at whom the vandalism is aimed, and to the general public. Viewing vandals as rational community participants despite their antinormative behavior offers the possibility of engaging with or countering their choices in novel ways. Rational choice theory (RCT) as applied in value expectancy theory (VET) offers a strategy for characterizing behaviors in a framework of rational choices, and begins with the supposition that subject to some weighting of personal preferences and constraints, individuals maximize their own utility by committing acts of vandalism. This study applies the framework of RCT and VET to gain insight into vandals' preferences and constraints. Using a mixed methods analysis of Wikipedia, I combine social computing and criminological perspectives on vandalism to propose an ontology of vandalism for online content communities. I use this ontology to categorize 141 instances of vandalism and find that the character of vandalistic acts varies by vandals' relative identifiability, policy history with Wikipedia, and the effort required to vandalize.


An Axiomatic Approach to Regularizing Neural Ranking Models. Axiomatic information retrieval (IR) seeks a set of principle properties desirable in IR models. These properties when formally expressed provide guidance in the search for better relevance estimation functions. Neural ranking models typically contain a large number of parameters. The training of these models involve a search for appropriate parameter values based on large quantities of labeled examples. Intuitively, axioms that can guide the search for better traditional IR models should also help in better parameter estimation for machine learning based rankers. This work explores the use of IR axioms to augment the direct supervision from labeled data for training neural ranking models. We modify the documents in our dataset along the lines of well known axioms during training and add a regularization loss based on the agreement between the ranking model and the axioms on which version of the document the original or the perturbed should be preferred. Our experiments show that the neural ranking model achieves faster convergence and better generalization with axiomatic regularization.


Migration of Cytotoxic T Lymphocytes in 3D Collagen Matrices. To fulfill their killing functions, cytotoxic T lymphocytes (CTLs) need to migrate to search for their target cells in complex biological microenvironments, a key component of which is extracellular matrix (ECM). The mechanisms underlying CTL's navigation are not well understood so far. Here we use a collagen assay as a model for the ECM and analyze the migration trajectories of primary human CTLs in collagen matrices with different concentrations. We observe different migration patterns for individual T cells. Three different motility types can be distinguished slow, fast and mixed motilities. Slow CTLs remain nearly stationary within the collagen matrix and show slightly anti persistent motility, while the fast ones move quickly and persistent (i.e. with not too large turning angles). The dynamics of the mixed type consists of periods of slow and fast motions both states are persistent, but they have different persistencies. The dynamics can be well described by a two state persistent random walk model. We extract the parameters of the model by analyzing experimental data. The mean square displacements predicted by the model and those measured experimentally are in very good agreement, without any fitting parameter. Potential reasons for the observed two state motility are discussed. T cells dig the collagen during their migration and form channels, which facilitate the movement of other CTLs in the collagen network.


Learning to Sort Image Sequences via Accumulated Temporal Differences. Consider a set of n images of a scene with dynamic objects captured with a static or a handheld camera. Let the temporal order in which these images are captured be unknown. There can be n! possibilities for the temporal order in which these images could have been captured. In this work, we tackle the problem of temporally sequencing the unordered set of images of a dynamic scene captured with a hand held camera. We propose a convolutional block which captures the spatial information through 2D convolution kernel and captures the temporal information by utilizing the differences present among the feature maps extracted from the input images. We evaluate the performance of the proposed approach on the dataset extracted from a standard action recognition dataset, UCF101. We show that the proposed approach outperforms the state of the art methods by a significant margin. We show that the network generalizes well by evaluating it on a dataset extracted from the DAVIS dataset, a dataset meant for video object segmentation, when the same network was trained with a dataset extracted from UCF101, a dataset meant for action recognition.


Superlinear Lower Bounds Based on ETH. We introduce techniques for proving superlinear conditional lower bounds for polynomial time problems. In particular, we show that CircuitSAT for circuits with m gates and log(m) inputs (denoted by log CircuitSAT) is not decidable in essentially linear time unless the exponential time hypothesis (ETH) is false and k Clique is decidable in essentially linear time in terms of the graph's size for all fixed k. Such conditional lower bounds have previously only been demonstrated relative to the strong exponential time hypothesis (SETH). Our results therefore offer significant progress towards proving unconditional superlinear time complexity lower bounds for natural problems in polynomial time.


Stackelberg Punishment and Bully Proofing Autonomous Vehicles. Mutually beneficial behavior in repeated games can be enforced via the threat of punishment, as enshrined in game theory's well known "folk theorem." There is a cost, however, to a player for generating these disincentives. In this work, we seek to minimize this cost by computing a "Stackelberg punishment," in which the player selects a behavior that sufficiently punishes the other player while maximizing its own score under the assumption that the other player will adopt a best response. This idea generalizes the concept of a Stackelberg equilibrium. Known efficient algorithms for computing a Stackelberg equilibrium can be adapted to efficiently produce a Stackelberg punishment. We demonstrate an application of this idea in an experiment involving a virtual autonomous vehicle and human participants. We find that a self driving car with a Stackelberg punishment policy discourages human drivers from bullying in a driving scenario requiring social negotiation.


Amenability, proximality and higher order syndeticity. We show that the universal minimimal proximal flow and the universal minimal strongly proximal flow of a discrete group can be realized as the Stone spaces of translation invariant Boolean algebras of subsets of the group satisfying a higher order notion of syndeticity. We establish algebraic, combinatorial and topological dynamical characterizations of these subsets that we use to obtain new necessary and sufficient conditions for strong amenability and amenability. We also characterize dense orbit sets, answering a question of Glasner, Tsankov, Weiss and Zucker.


Deep Entity Matching with Pre Trained Language Models. We present Ditto, a novel entity matching system based on pre trained Transformer based language models. We fine tune and cast EM as a sequence pair classification problem to leverage such models with a simple architecture. Our experiments show that a straightforward application of language models such as BERT, DistilBERT, or RoBERTa pre trained on large text corpora already significantly improves the matching quality and outperforms previous state of the art (SOTA), by up to 29 of F1 score on benchmark datasets. We also developed three optimization techniques to further improve Ditto's matching capability. Ditto allows domain knowledge to be injected by highlighting important pieces of input information that may be of interest when making matching decisions. Ditto also summarizes strings that are too long so that only the essential information is retained and used for EM. Finally, Ditto adapts a SOTA technique on data augmentation for text to EM to augment the training data with (difficult) examples. This way, Ditto is forced to learn "harder" to improve the model's matching capability. The optimizations we developed further boost the performance of Ditto by up to 9.8 . Perhaps more surprisingly, we establish that Ditto can achieve the previous SOTA results with at most half the number of labeled data. Finally, we demonstrate Ditto's effectiveness on a real world large scale EM task. On matching two company datasets consisting of 789K and 412K records, Ditto achieves a high F1 score of 96.5 .


Towards Causal Explanation Detection with Pyramid Salient Aware Network. Causal explanation analysis (CEA) can assist us to understand the reasons behind daily events, which has been found very helpful for understanding the coherence of messages. In this paper, we focus on Causal Explanation Detection, an important subtask of causal explanation analysis, which determines whether a causal explanation exists in one message. We design a Pyramid Salient Aware Network (PSAN) to detect causal explanations on messages. PSAN can assist in causal explanation detection via capturing the salient semantics of discourses contained in their keywords with a bottom graph based word level salient network. Furthermore, PSAN can modify the dominance of discourses via a top attention based discourse level salient network to enhance explanatory semantics of messages. The experiments on the commonly used dataset of CEA shows that the PSAN outperforms the state of the art method by 1.8 F1 value on the Causal Explanation Detection task.


Sentiment and position taking analysis of parliamentary debates A systematic literature review. Parliamentary and legislative debate transcripts provide access to information concerning the opinions, positions and policy preferences of elected politicians. They attract attention from researchers from a wide variety of backgrounds, from political and social sciences to computer science. As a result, the problem of automatic sentiment and position taking analysis has been tackled from different perspectives, using varying approaches and methods, and with relatively little collaboration or cross pollination of ideas. The existing research is scattered across publications from various fields and venues. In this article we present the results of a systematic literature review of 61 studies, all of which address the automatic analysis of the sentiment and opinions expressed and positions taken by speakers in parliamentary (and other legislative) debates. In this review, we discuss the available research with regard to the aims and objectives of the researchers who work on these problems, the automatic analysis tasks they undertake, and the approaches and methods they use. We conclude by summarizing their findings, discussing the challenges of applying computational analysis to parliamentary debates, and suggesting possible avenues for further research.


Conditional Wasserstein GAN based Oversampling of Tabular Data for Imbalanced Learning. Class imbalance is a common problem in supervised learning and impedes the predictive performance of classification models. Popular countermeasures include oversampling the minority class. Standard methods like SMOTE rely on finding nearest neighbours and linear interpolations which are problematic in case of high dimensional, complex data distributions. Generative Adversarial Networks (GANs) have been proposed as an alternative method for generating artificial minority examples as they can model complex distributions. However, prior research on GAN based oversampling does not incorporate recent advancements from the literature on generating realistic tabular data with GANs. Previous studies also focus on numerical variables whereas categorical features are common in many business applications of classification methods such as credit scoring. The paper propoes an oversampling method based on a conditional Wasserstein GAN that can effectively model tabular datasets with numerical and categorical variables and pays special attention to the down stream classification task through an auxiliary classifier loss. We benchmark our method against standard oversampling methods and the imbalanced baseline on seven real world datasets. Empirical results evidence the competitiveness of GAN based oversampling.


Tweet to News Conversion An Investigation into Unsupervised Controllable Text Generation. Text generator systems have become extremely popular with the advent of recent deep learning models such as encoder decoder. Controlling the information and style of the generated output without supervision is an important and challenging Natural Language Processing (NLP) task. In this paper, we define the task of constructing a coherent paragraph from a set of disaster domain tweets, without any parallel data. We tackle the problem by building two systems in pipeline. The first system focuses on unsupervised style transfer and converts the individual tweets into news sentences. The second system stitches together the outputs from the first system to form a coherent news paragraph. We also propose a novel training mechanism, by splitting the sentences into propositions and training the second system to merge the sentences. We create a validation and test set consisting of tweet sets and their equivalent news paragraphs to perform empirical evaluation. In a completely unsupervised setting, our model was able to achieve a BLEU score of 19.32, while successfully transferring styles and joining tweets to form a meaningful news paragraph.


The Unexpected Unexpected and the Expected Unexpected How People's Conception of the Unexpected is Not That Unexpected. The answers people give when asked to 'think of the unexpected' for everyday event scenarios appear to be more expected than unexpected. There are expected unexpected outcomes that closely adhere to the given information in a scenario, based on familiar disruptions and common plan failures. There are also unexpected unexpected outcomes that are more inventive, that depart from given information, adding new concepts actions. However, people seem to tend to conceive of the unexpected as the former more than the latter. Study 1 tests these proposals by analysing the object concepts people mention in their reports of the unexpected and the agreement between their answers. Study 2 shows that object choices are weakly influenced by recency, the order of sentences in the scenario. The implications of these results for ideas in philosophy, psychology and computing is discussed


A Benchmark Suite for Evaluating Caches' Vulnerability to Timing Attacks. Timing based side or covert channels in processor caches continue to present a threat to computer systems, and they are the key to many of the recent Spectre and Meltdown attacks. Based on improvements to an existing three step model for cache timing based attacks, this work presents 88 Strong types of theoretical timing based vulnerabilities in processor caches. To understand and evaluate all possible types of vulnerabilities in processor caches, this work further presents and implements a new benchmark suite which can be used to test to which types of cache timing based attacks a given processor or cache design is vulnerable. In total, there are 1094 automatically generated test programs which cover the 88 theoretical vulnerabilities. The benchmark suite generates the Cache Timing Vulnerability Score which can be used to evaluate how vulnerable a specific cache implementation is to different attacks. A smaller Cache Timing Vulnerability Score means the design is more secure, and the scores among different machines can be easily compared. Evaluation is conducted on commodity Intel and AMD processors and shows the differences in processor implementations can result in different types of attacks that they are vulnerable to. Beyond testing commodity processors, the benchmarks and the Cache Timing Vulnerability Score can be used to help designers of new secure processor caches evaluate their design's susceptibility to cache timing based attacks.


Gated Recurrent Neural Network Approach for Multilabel Emotion Detection in Microblogs. People express their opinions and emotions freely in social media posts and online reviews that contain valuable feedback for multiple stakeholders such as businesses and political campaigns. Manually extracting opinions and emotions from large volumes of such posts is an impossible task. Therefore, automated processing of these posts to extract opinions and emotions is an important research problem. However, human emotion detection is a challenging task due to the complexity and nuanced nature. To overcome these barriers, researchers have extensively used techniques such as deep learning, distant supervision, and transfer learning. In this paper, we propose a novel Pyramid Attention Network (PAN) based model for emotion detection in microblogs. The main advantage of our approach is that PAN has the capability to evaluate sentences in different perspectives to capture multiple emotions existing in a single text. The proposed model was evaluated on a recently released dataset and the results achieved the state of the art accuracy of 58.9 .


Searching a Raw Video Database using Natural Language Queries. The number of videos being produced and consequently stored in databases for video streaming platforms has been increasing exponentially over time. This vast database should be easily index able to find the requisite clip or video to match the given search specification, preferably in the form of a textual query. This work aims to provide an end to end pipeline to search a video database with a voice query from the end user. The pipeline makes use of Recurrent Neural Networks in combination with Convolutional Neural Networks to generate captions of the video clips present in the database.


Gelfand's trick for the spherical derived Hecke algebra. Gelfand's trick shows that the spherical Hecke algebra of a p adic split reductive group is commutative. We adapt this strategy in order to show that the spherical derived Hecke algebra is graded commutative under mild assumptions on the coefficient ring.


Search and rescue at sea aided by hidden flow structures. Every year hundreds of people die at sea because of vessel and airplane accidents. A key challenge in reducing the number of these fatalities is to make Search and Rescue (SAR) algorithms more efficient. Here we address this challenge by uncovering hidden TRansient Attracting Profiles (TRAPs) in ocean surface velocity data. Computable from a single velocity field snapshot, TRAPs act as short term attractors for all floating objects. In three different ocean field experiments, we show that TRAPs computed from measured as well as modelled velocities attract deployed drifters and manikins emulating people fallen in the water. TRAPs, which remain hidden to prior flow diagnostics, thus provide critical information for hazard responses, such as SAR and oil spill containment, and hence have the potential to save lives and limit environmental disasters.


Square permutations are typically rectangular. We describe the limit (for two topologies) of large uniform random square permutations, i.e., permutations where every point is a record. The starting point for all our results is a sampling procedure for asymptotically uniform square permutations. Building on that, we first describe the global behavior by showing that these permutations have a permuton limit which can be described by a random rectangle. We also explore fluctuations about this random rectangle, which we can describe through coupled Brownian motions. Second, we consider the limiting behavior of the neighborhood of a point in the permutation through local limits. As a byproduct, we also determine the random limits of the proportion of occurrences (and consecutive occurrences) of any given pattern in a uniform random square permutation.


Improved Extractors for Small Space Sources. We study the problem of extracting random bits from weak sources that are sampled by algorithms with limited memory. This model of small space sources was introduced by Kamp, Rao, Vadhan and Zuckerman (STOC'06), and falls into a line of research initiated by Trevisan and Vadhan (FOCS'00) on extracting randomness from weak sources that are sampled by computationally bounded algorithms. Our main results are the following. 1. We obtain near optimal extractors for small space sources in the polynomial error regime. For space s sources over n bits, our extractors require just k geq s cdot polylog (n) entropy. This is an exponential improvement over the previous best result, which required k geq s 1.1 cdot2 log 0.51 n (Chattopadhyay and Li, STOC'16). 2. We obtain improved extractors for small space sources in the negligible error regime. For space s sources over n bits, our extractors require entropy k geq n 1 2 delta cdot s 1 2 delta , whereas the previous best result required k geq n 2 3 delta cdot s 1 3 delta (Chattopadhyay, Goodman, Goyal and Li, STOC'20). To obtain our first result, the key ingredient is a new reduction from small space sources to affine sources, allowing us to simply apply a good affine extractor. To obtain our second result, we must develop some new machinery, since we do not have low error affine extractors that work for low entropy. Our main tool is a significantly improved extractor for adversarial sources, which is built via a simple framework that makes novel use of a certain kind of leakage resilient extractors (known as cylinder intersection extractors), by combining them with a general type of extremal designs. Our key ingredient is the first derandomization of these designs, which we obtain using new connections to coding theory and additive combinatorics.


Sensitive Data Detection with High Throughput Neural Network Models for Financial Institutions. Named Entity Recognition has been extensively investigated in many fields. However, the application of sensitive entity detection for production systems in financial institutions has not been well explored due to the lack of publicly available, labeled datasets. In this paper, we use internal and synthetic datasets to evaluate various methods of detecting NPI (Nonpublic Personally Identifiable) information commonly found within financial institutions, in both unstructured and structured data formats. Character level neural network models including CNN, LSTM, BiLSTM CRF, and CNN CRF are investigated on two prediction tasks (i) entity detection on multiple data formats, and (ii) column wise entity prediction on tabular datasets. We compare these models with other standard approaches on both real and synthetic data, with respect to F1 score, precision, recall, and throughput. The real datasets include internal structured data and public email data with manually tagged labels. Our experimental results show that the CNN model is simple yet effective with respect to accuracy and throughput and thus, is the most suitable candidate model to be deployed in the production environment(s). Finally, we provide several lessons learned on data limitations, data labelling and the intrinsic overlap of data entities.


Legendre's Singular Modulus. We elaborate Legendre's original proof of his discovery of the first singular modulus in the history of mathematics, as well as its appearance in Ramanujan's formula for the arc length of an ellipse with said singular modulus as eccentricity, and its appearance in the three body choreography of Bernoulli's lemniscate.


Speculative Beam Search for Simultaneous Translation. Beam search is universally used in full sentence translation but its application to simultaneous translation remains non trivial, where output words are committed on the fly. In particular, the recently proposed wait k policy (Ma et al., 2019a) is a simple and effective method that (after an initial wait) commits one output word on receiving each input word, making beam search seemingly impossible. To address this challenge, we propose a speculative beam search algorithm that hallucinates several steps into the future in order to reach a more accurate decision, implicitly benefiting from a target language model. This makes beam search applicable for the first time to the generation of a single word in each step. Experiments over diverse language pairs show large improvements over previous work.


The mathcal R bounded operator families arising from the study of the barotropic compressible flows with free surface. In this paper, we study some model problem associated to the free boundary value problem of the barotropic compressible Navier Stokes equations in general smooth domain with taking surface tension into account. To obtain the maximal L p L q regularity property of the model problem, we prove the existence of mathcal R bounded operator families of the resolvent problem via Weis' theory on operator valued Fourier multipliers.


Exact Distribution Optimal Power Flow (D OPF)Model using Convex Iteration Technique. The distribution optimal power flow (D OPF) models have gained attention in recent years to optimally operate acentrally managed distribution grid. On account of nonconvex formulation that is difficult to solve, several relaxation methods have been proposed the exactness of the solutions obtained from the relaxed models, however, remain a concern. In this paper, we identify one such problem related to radial distribution feeder where second order cone program (SOCP) relaxation does not yield a solution that is feasible with respect to the original nonlinear OPF model. Specifically, we formulate an OPF model for PV hosting capacity problem to obtain maximum PV capacity that a feeder can integrate without violating the operating constraints. The SOCP relaxation for this problem yields infeasible solutions. To address this concern, we propose a convex iteration technique to simultaneously achieve optimal and feasible OPF solution for the PV hosting (maximization) problem. The proposed approach minimizes the feasibility gap with respect to original nonlinear constraints at each SOCP iteration. The effectiveness of the proposed approach is validated using IEEE 13 node and IEEE 123 node test systems.


Definable f Generic Groups over p Adic Numbers. The aim of this paper is to develop the theory for emph definable f generic groups in the p adic field within the framework of definable topological dynamics, here the "definable f generic" means a definable group admits a global f generic type which is definable over a small submodel. This "definable f generic" is a dual concept to "finitely satisfiable generic", and a useful tool to describe the analogue of torsion free o minimal groups in the p adic context. In this paper we will show that every definable f generic group definable in Q is eventually isomorphic to a finite index subgroup of a trigonalizable algebraic group over Q . This is analogous to the o minimal context, where every connected torsion free group definable in R is isomorphic to a trigonalizable algebraic group (Lemma 3.4, cite COS ). We will also show that every open definable f generic subgroup of a definable f generic group has finite index, and every f generic type of a definable f generic group is almost periodic, which gives a positive answer on the problem raised in cite P Y of whether f generic types coincide with almost periodic types in the p adic case.


The Semiclassical Resolvent on Conic Manifolds and Application to Schr "odinger Equations. In this article, we shall construct the resolvent of Laplacian at high energies near the spectrum on non product conic manifolds with a single cone tip. Microlocally, the resolvent kernel is the sum of b pseudodifferential operators, scattering pseudodifferential operators and intersecting Legendrian distributions. As an application, we shall establish Strichartz estimates for Schr "odinger equations on non compact manifolds with multiple non product conic singularities.


Isometry theorem of Cartan Hadamard manifold. Cartan Hadamard manifold is a simply connected Riemannian manifold with non positive sectional curvature. In this article, we have proved that a Cartan Hadamard manifold satisfying steady gradient Ricci soliton with the integral condition of potential function is isometric to the Euclidean space. Next we have proved a compactness theorem for gradient shrinking Ricci soliton satisfying some scalar curvature condition. Finally, we have showed that a gradient expanding Ricci soliton with linear volume growth and positive potential function is an Einstein manifold.


The third homology of mathrm SL 2( mathbb Q ) . We calculate the third homology of mathrm SL 2( mathbb Q ) with half integral coefficients. Corresponding to each prime p there is an operator on this group with square the identity. The kernel of the (split surjective) homomorphism to the indecomposable K 3 of mathbb Q is a the direct sum over all primes of the ( 1) eigenspaces of these operators. The ( 1) eigenspace of the operator corresponding to the prime p is cyclic of order the odd part of p 1 .


Monotonicity preserving finite element schemes with adaptive mesh refinement for hyperbolic problems. This work is focused on the extension and assessment of the monotonicity preserving scheme in 3 and the local bounds preserving scheme in 5 to hierarchical octree adaptive mesh refinement (AMR). Whereas the former can readily be used on this kind of meshes, the latter requires some modifications. A key question that we want to answer in this work is whether to move from a linear to a nonlinear stabilization mechanism pays the price when combined with shock adapted meshes. Whereas nonlinear (or shock capturing) stabilization leads to improved accuracy compared to linear schemes, it also negatively hinders nonlinear convergence, increasing computational cost. We compare linear and nonlinear schemes in terms of the required computational time versus accuracy for several steady benchmark problems. Numerical results indicate that, in general, nonlinear schemes can be cost effective for sufficiently refined meshes. Besides, it is also observed that it is better to refine further around shocks rather than use sharper shock capturing terms, which usually yield stiffer nonlinear problems. In addition, a new refinement criterion has been proposed. The proposed criterion is based on the graph Laplacian used in the definition of the stabilization method. Numerical results show that this shock detector performs better than the well known Kelly estimator for problems with shocks or discontinuities.


Motives with modulus, III The categories of motives. We construct and study a triangulated category of motives with modulus mathbf MDM mathrm gm mathrm eff over a field k that extends Voevodsky's category mathbf DM mathrm gm mathrm eff in such a way as to encompass non homotopy invariant phenomena. In a similar way as mathbf DM mathrm gm mathrm eff is constructed out of smooth k varieties, mathbf MDM mathrm gm mathrm eff is constructed out of proper modulus pairs, introduced in Part I of this work. To such a modulus pair we associate its motive in mathbf MDM mathrm gm mathrm eff . In some cases the mathrm Hom group in mathbf MDM mathrm gm mathrm eff between the motives of two modulus pairs can be described in terms of Bloch's higher Chow groups.


Fast Spatio Temporal Residual Network for Video Super Resolution. Recently, deep learning based video super resolution (SR) methods have achieved promising performance. To simultaneously exploit the spatial and temporal information of videos, employing 3 dimensional (3D) convolutions is a natural approach. However, straight utilizing 3D convolutions may lead to an excessively high computational complexity which restricts the depth of video SR models and thus undermine the performance. In this paper, we present a novel fast spatio temporal residual network (FSTRN) to adopt 3D convolutions for the video SR task in order to enhance the performance while maintaining a low computational load. Specifically, we propose a fast spatio temporal residual block (FRB) that divide each 3D filter to the product of two 3D filters, which have considerably lower dimensions. Furthermore, we design a cross space residual learning that directly links the low resolution space and the high resolution space, which can greatly relieve the computational burden on the feature fusion and up scaling parts. Extensive evaluations and comparisons on benchmark datasets validate the strengths of the proposed approach and demonstrate that the proposed network significantly outperforms the current state of the art methods.


Compressed Coding, AMP Based Decoding and Analog Spatial Coupling. This paper considers a compressed coding scheme that combines compressed sensing with forward error control coding. Approximate message passing (AMP) is used to decode the message. Based on the state evolution analysis of AMP, we derive the performance limit of compressed coding. We show that compressed coding can approach Gaussian capacity at a very low compression ratio. Further, the results are extended to systems involving non linear effects such as clipping. We show that the capacity approaching property can still be maintained when generalized AMP is used to decode the message. To approach the capacity, a low rate underlying code should be designed according to the curve matching principle, which is complicated in practice. Instead, analog spatial coupling is used to avoid sophisticated low rate code design. In the end, we study the coupled scheme in a multiuser environment, where spatial coupling can be realized in a distributive way. The overall block length can be shared by many users, which reduces block length per user.


Subdifferentials and Stability Analysis of Feasible Set and Pareto Front Mappings in Linear Multiobjective Optimization. The paper concerns multiobjective linear optimization problems in R n that are parameterized with respect to the right hand side perturbations of inequality constraints. Our focus is on measuring the variation of the feasible set and the Pareto front mappings around a nominal element while paying attention to some specific directions. This idea is formalized by means of the so called epigraphical multifunction, which is defined by adding a fixed cone to the images of the original mapping. Through the epigraphical feasible and Pareto front mappings we describe the corresponding vector subdifferentials, and employ them to verifying Lipschitzian stability of the perturbed mappings with computing the associated Lipschitz moduli. The particular case of ordinary linear programs is analyzed, where we show that the subdifferentials of both multifunctions are proportional subsets. We also provide a method for computing the optimal value of linear programs without knowing any optimal solution. Some illustrative examples are also given in the paper.


Positivity preserving finite difference WENO scheme for Ten Moment equations with source term. We develop a positivity preserving finite difference WENO scheme for the Ten Moment equations with body forces acting as a source in the momentum and energy equations. A positive forward Euler scheme under a CFL condition is first constructed which is combined with an operator splitting approach together with an integrating factor, strong stability preserving Runge Kutta scheme. The positivity of the forward Euler scheme is obtained under a CFL condition by using a scaling type limiter, while the solution of the source operator is performed exactly and is positive without any restriction on the time step. The proposed method can be used with any WENO reconstruction scheme and we demonstrate it with fifth order accurate WENO JS, WENO Z and WENO AO schemes. An adaptive CFL strategy is developed which can be more efficient than the use of reduced CFL for positivity preservation. Numerical results show that high order accuracy and positivity preservation are achieved on a range of test problems.


Metric connections with parallel twistor free torsion. The torsion of every metric connection on a Riemannian manifold has three components one totally skew symmetric, one of vectorial type, and one of twistorial type. In this paper we classify complete simply connected Riemannian manifolds carrying a metric connection whose torsion is parallel, has non zero vectorial component and vanishing twistorial component.


Coupling Machine Learning and Crop Modeling Improves Crop Yield Prediction in the US Corn Belt. This study investigates whether coupling crop modeling and machine learning (ML) improves corn yield predictions in the US Corn Belt. The main objectives are to explore whether a hybrid approach (crop modeling ML) would result in better predictions, investigate which combinations of hybrid models provide the most accurate predictions, and determine the features from the crop modeling that are most effective to be integrated with ML for corn yield prediction. Five ML models (linear regression, LASSO, LightGBM, random forest, and XGBoost) and six ensemble models have been designed to address the research question. The results suggest that adding simulation crop model variables (APSIM) as input features to ML models can decrease yield prediction root mean squared error (RMSE) from 7 to 20 . Furthermore, we investigated partial inclusion of APSIM features in the ML prediction models and we found soil moisture related APSIM variables are most influential on the ML predictions followed by crop related and phenology related variables. Finally, based on feature importance measure, it has been observed that simulated APSIM average drought stress and average water table depth during the growing season are the most important APSIM inputs to ML. This result indicates that weather information alone is not sufficient and ML models need more hydrological inputs to make improved yield predictions.


Revisiting Transactional Statistics of High scalability Blockchains. Scalability has been a bottleneck for major blockchains such as Bitcoin and Ethereum. Despite the significantly improved scalability claimed by several high profile blockchain projects, there has been little effort to understand how their transactional throughput is being used. In this paper, we examine recent network traffic of three major high scalability blockchains EOSIO, Tezos and XRP Ledger (XRPL) over a period of seven months. Our analysis reveals that only a small fraction of the transactions are used for value transfer purposes. In particular, 96 of the transactions on EOSIO were triggered by the airdrop of a currently valueless token on Tezos, 76 of throughput was used for maintaining consensus and over 94 of transactions on XRPL carried no economic value. We also identify a persisting airdrop on EOSIO as a DoS attack and detect a two month long spam attack on XRPL. The paper explores the different designs of the three blockchains and sheds light on how they could shape user behavior.


Cross Lingual Machine Reading Comprehension. Though the community has made great progress on Machine Reading Comprehension (MRC) task, most of the previous works are solving English based MRC problems, and there are few efforts on other languages mainly due to the lack of large scale training data. In this paper, we propose Cross Lingual Machine Reading Comprehension (CLMRC) task for the languages other than English. Firstly, we present several back translation approaches for CLMRC task, which is straightforward to adopt. However, to accurately align the answer into another language is difficult and could introduce additional noise. In this context, we propose a novel model called Dual BERT, which takes advantage of the large scale training data provided by rich resource language (such as English) and learn the semantic relations between the passage and question in a bilingual context, and then utilize the learned knowledge to improve reading comprehension performance of low resource language. We conduct experiments on two Chinese machine reading comprehension datasets CMRC 2018 and DRCD. The results show consistent and significant improvements over various state of the art systems by a large margin, which demonstrate the potentials in CLMRC task. Resources available https github.com ymcui Cross Lingual MRC


Modelling the second wave of COVID 19 infections in France and Italy via a Stochastic SEIR model. COVID 19 has forced quarantine measures in several countries across the world. These measures have proven to be effective in significantly reducing the prevalence of the virus. To date, no effective treatment or vaccine is available. In the effort of preserving both public health as well as the economical and social textures, France and Italy governments have partially released lockdown measures. Here we extrapolate the long term behavior of the epidemics in both countries using a Susceptible Exposed Infected Recovered (SEIR) model where parameters are stochastically perturbed to handle the uncertainty in the estimates of COVID 19 prevalence. Our results suggest that uncertainties in both parameters and initial conditions rapidly propagate in the model and can result in different outcomes of the epidemics leading or not to a second wave of infections. Using actual knowledge, asymptotic estimates of COVID 19 prevalence can fluctuate of order of ten millions units in both countries.


Dampening effect of logistic source in a two dimensional haptotaxis system with nonlinear zero order interaction. This paper deals with the oncolytic virotherapy model begin equation begin split begin cases u t Delta u nabla cdot (u nabla v) uz mu u(1 u), 2ex v t (u w)v, 2ex w t D w Delta w w uz, 2ex z t D z Delta z z uz beta w, end cases end split end equation in a bounded domain Omega subset Bbb R 2 with smooth boundary, where mu , D w , D z and beta are prescribed positive parameters. For any given suitably regular initial data, the global existence of classical solution to the corresponding homogeneous Neumann initial boundary problem for a more general model allowing mu 0 was previously verified in Y. Tao M. Winkler, J. Differential Equations mathbf 268 (2020), 4973 4997 . This work further shows that whenever mu 0 , the above mentioned global classical solution to the above equation is uniformly bounded and moreover, if beta 1 , then the solution (u, v, w, z) stabilizes to the constant equilibrium (1, 0, 0, 0) in the topology L p( Omega) times (L infty( Omega)) 3 with any p 1 in a large time limit.


DBCSR A Library for Dense Matrix Multiplications on Distributed GPU Accelerated Systems. Most, if not all the modern scientific simulation packages utilize matrix algebra operations. Among the operation of the linear algebra, one of the most important kernels is the multiplication of matrices, dense and sparse. Examples of application of such a kernel are in electronic structure calculations, machine learning, data mining, graph processing, and digital signal processing. Several optimized libraries exist that can achieve high performance on distributed systems. Only a few of them target distributed GPU accelerated systems. In most of the cases, these libraries are provided and optimized by system vendors for their specific computer systems. In this paper, we present the DBCSR library (Distributed Block Compressed Sparse Row) for the distributed dense matrix matrix multiplications. Although the library is specifically designed for block sparse matrix matrix multiplications, we optimized it for the dense case on GPU accelerated systems. We show that the DBCSR outperforms the multiplication of matrices of different sizes and shapes provided by a vendor optimized GPU version of the ScaLAPACK library up to 2.5x (1.4x on average).


q-bio.QM physics.bio-ph physics.data-an physics.ins-det

Improving Baseline Subtraction for Increased Sensitivity of Quantitative PCR Measurements. Motivated by the current COVID 19 health crisis, we examine the task of baseline subtraction for quantitative polymerase chain reaction (qPCR) measurements. In particular, we present an algorithm that leverages information obtained from non template and or DNA extraction control experiments to remove systematic bias from amplification curves. We recast this problem in terms of mathematical optimization, i.e. by finding the amount of control signal that, when subtracted from an amplification curve, minimizes background noise. We demonstrate that this approach can yield a decade improvement in sensitivity relative to standard approaches, especially for data exhibiting late cycle amplification. Critically, this increased sensitivity and accuracy promises more effective screening of viral DNA and a reduction in the rate of false negatives in diagnostic settings.