Conversational Document Prediction to Assist Customer Care Agents. A frequent pattern in customer care conversations is the agents responding with appropriate webpage URLs that address users' needs. We study the task of predicting the documents that customer care agents can use to facilitate users' needs. We also introduce a new public dataset which supports the aforementioned problem. Using this dataset and two others, we investigate state of the art deep learning (DL) and information retrieval (IR) models for the task. Additionally, we analyze the practicality of such systems in terms of inference time complexity. Our show that an hybrid IR DL approach provides the best of both worlds.


Regularization of Cylindrical Processes In Locally Convex Spaces. Let Phi be a locally convex space and let Phi' denote its strong dual. In this paper we introduce sufficient conditions for the existence of a continuous or a c a dl a g Phi' valued version to a cylindrical process defined on Phi . Our result generalizes many other known results on the literature and their different connections will be discussed. As an application, we use our results to show the existence of a Phi' valued c a dl a g L ' e vy process version to a given cylindrical L ' e vy process in Phi' .


Real Time Prediction of BITCOIN Price using Machine Learning Techniques and Public Sentiment Analysis. Bitcoin is the first digital decentralized cryptocurrency that has shown a significant increase in market capitalization in recent years. The objective of this paper is to determine the predictable price direction of Bitcoin in USD by machine learning techniques and sentiment analysis. Twitter and Reddit have attracted a great deal of attention from researchers to study public sentiment. We have applied sentiment analysis and supervised machine learning principles to the extracted tweets from Twitter and Reddit posts, and we analyze the correlation between bitcoin price movements and sentiments in tweets. We explored several algorithms of machine learning using supervised learning to develop a prediction model and provide informative analysis of future market prices. Due to the difficulty of evaluating the exact nature of a Time Series(ARIMA) model, it is often very difficult to produce appropriate forecasts. Then we continue to implement Recurrent Neural Networks (RNN) with long short term memory cells (LSTM). Thus, we analyzed the time series model prediction of bitcoin prices with greater efficiency using long short term memory (LSTM) techniques and compared the predictability of bitcoin price and sentiment analysis of bitcoin tweets to the standard method (ARIMA). The RMSE (Root mean square error) of LSTM are 198.448 (single feature) and 197.515 (multi feature) whereas the ARIMA model RMSE is 209.263 which shows that LSTM with multi feature shows the more accurate result.


Pseudo amenability of Brandt semigroup algebras. The pseudo amenability of Brandt Banach semigroup algebras is considered.


Factorized Neural Processes for Neural Processes K Shot Prediction of Neural Responses. In recent years, artificial neural networks have achieved state of the art performance for predicting the responses of neurons in the visual cortex to natural stimuli. However, they require a time consuming parameter optimization process for accurately modeling the tuning function of newly observed neurons, which prohibits many applications including real time, closed loop experiments. We overcome this limitation by formulating the problem as K shot prediction to directly infer a neuron's tuning function from a small set of stimulus response pairs using a Neural Process. This required us to developed a Factorized Neural Process, which embeds the observed set into a latent space partitioned into the receptive field location and the tuning function properties. We show on simulated responses that the predictions and reconstructed receptive fields from the Factorized Neural Process approach ground truth with increasing number of trials. Critically, the latent representation that summarizes the tuning function of a neuron is inferred in a quick, single forward pass through the network. Finally, we validate this approach on real neural data from visual cortex and find that the predictive accuracy is comparable to and for small K even greater than optimization based approaches, while being substantially faster. We believe this novel deep learning systems identification framework will facilitate better real time integration of artificial neural network modeling into neuroscience experiments.


Depth Descent Synchronization in mathrm SO (D) . We give robust recovery results for synchronization on the rotation group, mathrm SO (D) . In particular, we consider an adversarial corruption setting, where a limited percentage of the observations are arbitrarily corrupted. We give a novel algorithm that exploits Tukey depth in the tangent space, which exactly recovers the underlying rotations up to an outlier percentage of 1 (D(D 1) 2) . This corresponds to an outlier fraction of 1 4 for mathrm SO (2) and 1 8 for mathrm SO (3) . In the case of D 2 , we demonstrate that a variant of this algorithm converges linearly to the ground truth rotations. We finish by discussing this result in relation to a simpler nonconvex energy minimization framework based on least absolute deviations, which exhibits spurious fixed points.


Heuristic adaptive fast gradient method in stochastic optimization tasks. In this paper, we present a heuristic adaptive fast gradient method. We show that in practice our method has a better convergence rate than popular today optimization methods. Moreover, we justify our method and point out some problems that do not allow us to obtain theoretical estimates.


An Average Compress Algorithm for the Sample Mean Problem under Dynamic Time Warping. Computing a sample mean of time series under dynamic time warping (DTW) is NP hard. Consequently, there is an ongoing research effort to devise efficient heuristics. The majority of heuristics have been developed for the constrained sample mean problem that assumes a solution of predefined length. In contrast, research on the unconstrained sample mean problem is underdeveloped. In this article, we propose a generic average compress (AC) algorithm for solving the unconstrained problem. The algorithm alternates between averaging (A step) and compression (C step). The A step takes an initial guess as input and returns an approximation of a sample mean. Then the C step reduces the length of the approximate solution. The compressed approximation serves as initial guess of the A step in the next iteration. The purpose of the C step is to direct the algorithm to more promising solutions of shorter length. The proposed algorithm is generic in the sense that any averaging and any compression method can be used. Experimental results show that the AC algorithm substantially outperforms current state of the art algorithms for time series averaging.


Instabilities in Multi Asset and Multi Agent Market Impact Games. We consider the general problem of a set of agents trading a portfolio of assets in the presence of transient price impact and additional quadratic transaction costs and we study, with analytical and numerical methods, the resulting Nash equilibria. Extending significantly the framework of Schied Zhang (2019) and Luo Schied (2020), who considered the single asset case, we prove the existence and uniqueness of the corresponding Nash equilibria for the related mean variance optimization problem. We then focus our attention on the conditions on the model parameters making the trading profile of the agents at equilibrium, and as a consequence the price trajectory, wildly oscillating and the market unstable. While Schied Zhang (2019) and Luo Schied (2020) highlighted the importance of the value of transaction cost in determining the transition between a stable and an unstable phase, we show that also the scaling of market impact with the number of agents J and the number of assets M determines the asymptotic stability (in J and M ) of markets.


Subdifferentials of Value Functions in Nonconvex Dynamic Programming for Nonstationary Stochastic Processes. The main goal of this paper is to apply the machinery of variational analysis and generalized differentiation to study infinite horizon stochastic dynamic programming (DP) with discrete time in the Banach space setting without convexity assumptions. Unlike to standard stochastic DP with stationary Markov processes, we investigate here stochastic DP in L p spaces to deal with nonstationary stochastic processes, which describe a more flexible learning procedure for the decision maker. Our main concern is to calculate generalized subgradients of the corresponding value function and to derive necessary conditions for optimality in terms of the stochastic Euler inclusion under appropriate Lipschitzian assumptions. The usage of the subdifferential formula for integral functionals on L p spaces allows us, in particular, to find verifiable conditions to ensure smoothness of the value function without any convexity and or interiority assumptions.


Discovering New Runge Kutta Methods Using Unstructured Numerical Search. Runge Kutta methods are a popular class of numerical methods for solving ordinary differential equations. Every Runge Kutta method is characterized by two basic parameters its order, which measures the accuracy of the solution it produces, and its number of stages, which measures the amount of computational work it requires. The primary goal in constructing Runge Kutta methods is to maximize order using a minimum number of stages. However, high order Runge Kutta methods are difficult to construct because their parameters must satisfy an exponentially large system of polynomial equations. This paper presents the first known 10th order Runge Kutta method with only 16 stages, breaking a 40 year standing record for the number of stages required to achieve 10th order accuracy. It also discusses the tools and techniques that enabled the discovery of this method using a straightforward numerical search.


On forbidden poset problems in the linear lattice. In this note, we determine the maximum size of a V k , Lambda l free family in the lattice of vector subspaces of a finite vector space both in the non induced case as well as the induced case, for a large range of parameters k and l . These results generalize earlier work by Shahriari and Yu. We also prove a general LYM type lemma for the linear lattice which resolves a conjecture of Shahriari and Yu.


BMO and the John Nirenberg Inequality on Measure Spaces. We study the space BMO in the general setting of a measure space mathbb X with a fixed collection mathscr G of measurable sets of positive and finite measure, consisting of functions of bounded mean oscillation on sets in mathscr G . The aim is to see how much of the familiar BMO machinery holds when metric notions have been replaced by measure theoretic ones. In particular, three aspects of BMO are considered its properties as a Banach space, its relation with Muckenhoupt weights, and the John Nirenberg inequality. We give necessary and sufficient conditions on a decomposable measure space mathbb X for BMO to be a Banach space modulo constants. We also develop the notion of a Denjoy family mathscr G , which guarantees that functions in BMO satisfy the John Nirenberg inequality on the elements of mathscr G .


Equivariant one parameter formal deformations of Hom Leibniz algebras. Aim of this paper is to define a new type of cohomology for multiplicative Hom Leibniz algebras which controls deformations of Hom Leibniz algebra structure. The cohomology and the associated deformation theory for Hom Leibniz algebras as developed here are also extended to equvariant context, under the presence of finite group actions on Hom Leibniz algebras.


Cross Lingual Semantic Role Labeling with High Quality Translated Training Corpus. Many efforts of research are devoted to semantic role labeling (SRL) which is crucial for natural language understanding. Supervised approaches have achieved impressing performances when large scale corpora are available for resource rich languages such as English. While for the low resource languages with no annotated SRL dataset, it is still challenging to obtain competitive performances. Cross lingual SRL is one promising way to address the problem, which has achieved great advances with the help of model transferring and annotation projection. In this paper, we propose a novel alternative based on corpus translation, constructing high quality training datasets for the target languages from the source gold standard SRL annotations. Experimental results on Universal Proposition Bank show that the translation based method is highly effective, and the automatic pseudo datasets can improve the target language SRL performances significantly.


An analytic approximate solution of the SIR model. The SIR(D) epidemiological model is defined through a system of transcendental equations, not solvable by elementary functions. In the present paper those equations are successfully replaced by approximate ones, whose solutions are given explicitly in terms of elementary functions, originating, piece wisely, from generalized logistic functions they ensure em exact (in the numerical sense) asymptotic values, besides to be quite practical to use, for example with fit to data algorithms moreover they unveil a useful feature, that in fact, at least with very strict approximation, is also owned by the (numerical) solutions of the em exact equations. The novelties in the work are the way the approximate equations are obtained, using simple, analytic geometry considerations the easy and practical formulation of the final approximate solutions the mentioned useful feature, never disclosed before. The work's method and result prove to be robust over a range of values of the well known non dimensional parameter called em basic reproduction ratio , that covers at least all the known epidemic cases, from influenza to measles this is a point which doesn't appear much discussed in analogous works.


Integer Programming for Multi Robot Planning A Column Generation Approach. We consider the problem of coordinating a fleet of robots in a warehouse so as to maximize the reward achieved within a time limit while respecting problem and robot specific constraints. We formulate the problem as a weighted set packing problem where elements are defined as being the space time positions a robot can occupy and the items that can be picked up and delivered. We enforce that robots do not collide, that each item is delivered at most once, and that the number of robots active at any time does not exceed the total number available. Since the set of robot routes is not enumerable, we attack optimization using column generation where pricing is a resource constrained shortest path problem.


Schur indices for noncommutative reality based algebras with two nonreal basis elements. This article discusses the representation theory of noncommutative algebras reality based algebras with positive degree map over their field of definition. When the standard basis contains exactly two nonreal elements, the main result expresses the noncommutative simple component as a generalized quaternion algebra over its field of definition. The field of real numbers will always be a splitting field for this algebra, but there are noncommutative table algebras of dimension 6 with rational field of definition for which it is a division algebra. The approach has other applications, one of which shows noncommutative association scheme of rank 7 must have at least three symmetric relations.


Optimized Directed Roadmap Graph for Multi Agent Path Finding Using Stochastic Gradient Descent. We present a novel approach called Optimized Directed Roadmap Graph (ODRM). It is a method to build a directed roadmap graph that allows for collision avoidance in multi robot navigation. This is a highly relevant problem, for example for industrial autonomous guided vehicles. The core idea of ODRM is, that a directed roadmap can encode inherent properties of the environment which are useful when agents have to avoid each other in that same environment. Like Probabilistic Roadmaps (PRMs), ODRM's first step is generating samples from C space. In a second step, ODRM optimizes vertex positions and edge directions by Stochastic Gradient Descent (SGD). This leads to emergent properties like edges parallel to walls and patterns similar to two lane streets or roundabouts. Agents can then navigate on this graph by searching their path independently and solving occurring agent agent collisions at run time. Using the graphs generated by ODRM compared to a non optimized graph significantly fewer agent agent collisions happen. We evaluate our roadmap with both, centralized and decentralized planners. Our experiments show that with ODRM even a simple centralized planner can solve problems with high numbers of agents that other multi agent planners can not solve. Additionally, we use simulated robots with decentralized planners and online collision avoidance to show how agents are a lot faster on our roadmap than on standard grid maps.


Siamese Tracking with Lingual Object Constraints. Classically, visual object tracking involves following a target object throughout a given video, and it provides us the motion trajectory of the object. However, for many practical applications, this output is often insufficient since additional semantic information is required to act on the video material. Example applications of this are surveillance and target specific video summarization, where the target needs to be monitored with respect to certain predefined constraints, e.g., 'when standing near a yellow car'. This paper explores, tracking visual objects subjected to additional lingual constraints. Differently from Li et al., we impose additional lingual constraints upon tracking, which enables new applications of tracking. Whereas in their work the goal is to improve and extend upon tracking itself. To perform benchmarks and experiments, we contribute two datasets c MOT16 and c LaSOT, curated through appending additional constraints to the frames of the original LaSOT and MOT16 datasets. We also experiment with two deep models SiamCT DFG and SiamCT CA, obtained through extending a recent state of the art Siamese tracking method and adding modules inspired from the fields of natural language processing and visual question answering. Through experimental results, we show that the proposed model SiamCT CA can significantly outperform its counterparts. Furthermore, our method enables the selective compression of videos, based on the validity of the constraint.


Filter Bubbles, Echo Chambers, and Reinforcement Tracing Populism in Election Data. We present a novel model for the effect of echo chambers, filter bubbles, and reinforcement on election results. Our model extends the well known voter model with zealots to include reinforcement. We analyze the behaviour of the model, determine the invariant measure, and show that reinforcement may 1) shift the distribution of votes compared to the voter model, and 2) lead to phase transitions. We test whether the model with reinforcement fit better than under its absence in election data from US presidential elections, the Brexit referendum, and parliamentary elections in France, The Netherlands, and Germany. We find in many cases that populist parties and candidates can be clearly identified by a high level of reinforcement. Furthermore, we find the phase transition predicted by the model back in data. We finally discuss the implications and relevance of our findings and possible origins of the reinforcement behaviour in modern societies.


Revisiting the relation between subspaces and sublocales. We revisit results concerning the connection between subspaces of a space and sublocales of its locale of open sets. The approach we present is based on the observation that for every locale L its spatial sublocales mathsf sp mathsf S (L) form a coframe which is isomorphic to the coframe mathsf sob mathcal P ( mathsf pt (L)) of sober subspaces of mathsf pt (L) . We characterize the frames L such that the spatial sublocales of mathsf S (L) perfectly represent the subspaces of mathsf pt (L) . We prove choice free, weak versions of the results by Niefield and Rosenthal characterizing those frames such that all their sublocales are spatial (i.e., those such that the sober subspaces of mathsf pt (L) perfectly represent the sublocales of L ). We do so by using a notion of essential prime which does not rely on the existence of enough minimal primes above every element. We will re prove Simmons' result that spaces such that the sublocales of Omega (X) perfectly represent their subspaces are exactly the scattered spaces. We will characterize scattered spaces in terms of a strong form of essentiality for primes. We apply these characterizations to show that, when L is a spatial frame and a coframe, mathsf pt (L) is scattered if and only if it is T D , and this holds if and only if all the primes of L are completely prime.


The weak converse of Zeckendorf's Theorem. By Zeckendorf's Theorem, every positive integer is uniquely written as a sum of non adjacent terms of the Fibonacci sequence, and its converse states that if a sequence in the positive integers has this property, it must be the Fibonacci sequence. If we instead consider the problem of finding a monotone sequence with such a property, we call it the weak converse of Zeckendorf's theorem. In this paper, we first introduce a generalization of Zeckendorf conditions, and subsequently, Zeckendorf's theorems and their weak converses for the general Zeckendorf conditions. We also extend the generalization and results to the real numbers in the interval (0,1) , and to p adic integers.


A high order discretization of nonlinear poroelasticity. In this work we construct and analyze a nonconforming high order discretization method for the quasi static single phase nonlinear poroelasticity problem describing Darcean flow in a deformable porous medium saturated by a slightly compressible fluid. The nonlinear elasticity operator is discretized using a Hybrid High Order method, while the Darcy operator relies on a Symmetric Weighted Interior Penalty discontinuous Galerkin scheme. The method is valid in two and three space dimensions, delivers an inf sup stable discretization on general meshes including polyhedral elements and nonmatching interfaces, supports arbitrary approximation orders, and has a reduced cost thanks to the possibility of statically condensing a large subset of the unknowns for linearized versions of the problem. Moreover, the proposed construction can handle both nonzero and vanishing specific storage coefficients.


An Explainable Model for EEG Seizure Detection based on Connectivity Features. Epilepsy which is characterized by seizures is studied using EEG signals by recording the electrical activity of the brain. Different types of communication between different parts of the brain are characterized by many state of the art connectivity measures which can be directed and undirected. We propose to employ a set of undirected (spectral matrix, the inverse of the spectral matrix, coherence, partial coherence, and phaselocking value) and directed features (directed coherence, the partial directed coherence) to learn a deep neural network that detects whether a particular data window belongs to a seizure or not, which is a new approach to standard seizure classification. Taking our data as a sequence of ten sub windows, we aim at designing an optimal deep learning model using attention, CNN, BiLstm, and fully connected layers. We also compute the relevance using the weights of the learned model based on the activation values of the receptive fields at a particular layer. Our best model architecture resulted in 97.03 accuracy using balanced MITBIH data subset. Also, we were able to explain the relevance of each feature across all patients. We were able to experimentally validate some of the scientific facts concerning seizures by studying the impact of the contributions of the activations on the decision.


Approximately counting and sampling small witnesses using a colourful decision oracle. In this paper, we design efficient algorithms to approximately count the number of edges of a given k hypergraph, and to sample an approximately uniform random edge. The hypergraph is not given explicitly, and can be accessed only through its colourful independence oracle The colourful independence oracle returns yes or no depending on whether a given subset of the vertices contains an edge that is colourful with respect to a given vertex colouring. Our results extend and or strengthen recent results in the graph oracle literature due to Beame et al. (ITCS 2018), Dell and Lapinskas (STOC 2018), and Bhattacharya et al. (ISAAC 2019). Our results have consequences for approximate counting sampling We can turn certain kinds of decision algorithms into approximate counting sampling algorithms without causing much overhead in the running time. We apply this approximate counting sampling to decision reduction to key problems in fine grained complexity (such as k SUM, k OV and weighted k Clique) and parameterised complexity (such as induced subgraphs of size k or weight k solutions to CSPs).


The genus zero, 3 component fibered links in S 3 . The open book decompositions of the 3 sphere whose pages are pairs of pants have been fully understood for some time, through the lens of contact geometry. The purpose of this note is to exhibit a purely topological derivation of the classification of such open books, in terms of the links that form their bindings and the corresponding monodromies. We construct all of the links and their pair of pants fiber surfaces from the simplest example, a connected sum of two Hopf links, through performing (generalized) Stallings twists. Then, by applying the now classical theory of genus two Heegaard diagrams in S 3 , we verify that the monodromies of the links in this family are the only ones corresponding to pair of pants open book decompositions of S 3 .


Grounded Compositional Outputs for Adaptive Language Modeling. Language models have emerged as a central component across NLP, and a great deal of progress depends on the ability to cheaply adapt them (e.g., through finetuning) to new domains and tasks. A language model's vocabulary typically selected before training and permanently fixed later affects its size and is part of what makes it resistant to such adaptation. Prior work has used compositional input embeddings based on surface forms to ameliorate this issue. In this work, we go one step beyond and propose a fully compositional output embedding layer for language models, which is further grounded in information from a structured lexicon (WordNet), namely semantically related words and free text definitions. To our knowledge, the result is the first word level language model with a size that does not depend on the training vocabulary. We evaluate the model on conventional language modeling as well as challenging cross domain settings with an open vocabulary, finding that it matches or outperforms previous state of the art output embedding methods and adaptation approaches. Our analysis attributes the improvements to sample efficiency our model is more accurate for low frequency words.


Concentration Bound Analysis for Probabilistic Programs and Probabilistic Recurrence Relations. Analyzing probabilistic programs and randomized algorithms are classical problems in computer science. The first basic problem in the analysis of stochastic processes is to consider the expectation or mean, and another basic problem is to consider concentration bounds, i.e. showing that large deviations from the mean have small probability. Similarly, in the context of probabilistic programs and randomized algorithms, the analysis of expected termination time running time and their concentration bounds are fundamental problems.In this work, we focus on concentration bounds for probabilistic programs and probabilistic recurrences of randomized algorithms. For probabilistic programs, the basic technique to achieve concentration bounds is to consider martingales and apply the classical Azuma's inequality. For probabilistic recurrences of randomized algorithms, Karp's classical "cookbook" method, which is similar to the master theorem for recurrences, is the standard approach to obtain concentration bounds. In this work, we propose a novel approach for deriving concentration bounds for probabilistic programs and probabilistic recurrence relations through the synthesis of exponential supermartingales. For probabilistic programs, we present algorithms for synthesis of such supermartingales in several cases. We also show that our approach can derive better concentration bounds than simply applying the classical Azuma's inequality over various probabilistic programs considered in the literature. For probabilistic recurrences, our approach can derive tighter bounds than the Karp's well established methods on classical algorithms. Moreover, we show that our approach could derive bounds comparable to the optimal bound for quicksort, proposed by McDiarmid and Hayward. We also present a prototype implementation that can automatically infer these bounds


A commented translation of Hans Richter's early work "The isotropic law of elasticity". We provide a faithful translation of Hans Richter's important 1948 paper "Das isotrope Elastizit "atsgesetz" from its original German version into English. Our introduction summarizes Richter's achievements.


Quantitative Diffractometric Biosensing. Diffractometric biosensing is a promising technology to overcome critical limitations of refractometric biosensors, the dominant class of label free optical transducers. These limitations manifest themselves by higher noise and drifts due to insufficient rejection of refractive index fluctuations caused by variation in temperature, solvent concentration, and most prominently, non specific binding. Diffractometric biosensors overcome these limitations with inherent self referencing on the submicron scale with no compromise on resolution. Despite this highly promising attribute, the field of diffractometric biosensors has only received limited recognition. A major reason is the lack of a general quantitative analysis. This hinders comparison to other techniques and amongst different diffractometric biosensors. For refractometric biosensors, on the other hand, such a comparison is possible by means of the refractive index unit (RIU). In this publication, we suggest the coherent surface mass density, Gamma rm coh , as a quantity for label free diffractometric biosensors with the same purpose as RIU in refractometric sensors. It is easy to translate Gamma rm coh to the total surface mass density Gamma rm tot , which is an important parameter for many assays. We provide a generalized framework to determine Gamma rm coh for various diffractometric biosensing arrangements which enables quantitative comparison. Additionally, the formalism can be used to estimate background scattering in order to further optimize sensor configurations. Finally, a practical guide with important experimental considerations is given to enable readers of any background to apply the theory. Therefore, this paper provides a powerful tool for the development of diffractometric biosensors and will help the field to mature and unveil its full potential.


Eigenvalue Estimates on Bakry Emery Manifolds. We demonstrate lower bounds for the eigenvalues of compact Bakry Emery manifolds with and without boundary. The lower bounds for the first eigenvalue rely on a generalised maximum principle which allows gradient estimates in the Riemannian setting to be directly applied to the Bakry Emery setting. Lower bounds for all eigenvalues are demonstrated using heat kernel estimates and a suitable Sobolev inequality.


A remark on an obstacle problem with lower regularity. We construct a monotone quantity for the classical obstacle problem with non smooth obstacle, and show that the blow ups are homogeneous functions of degree alpha 2 .


WOLI at SemEval 2020 Task 12 Arabic Offensive Language Identification on Different Twitter Datasets. Communicating through social platforms has become one of the principal means of personal communications and interactions. Unfortunately, healthy communication is often interfered by offensive language that can have damaging effects on the users. A key to fight offensive language on social media is the existence of an automatic offensive language detection system. This paper presents the results and the main findings of SemEval 2020, Task 12 OffensEval Sub task A Zampieri et al. (2020), on Identifying and categorising Offensive Language in Social Media. The task was based on the Arabic OffensEval dataset Mubarak et al. (2020). In this paper, we describe the system submitted by WideBot AI Lab for the shared task which ranked 10th out of 52 participants with Macro F1 86.9 on the golden dataset under CodaLab username "yasserotiefy". We experimented with various models and the best model is a linear SVM in which we use a combination of both character and word n grams. We also introduced a neural network approach that enhanced the predictive ability of our system that includes CNN, highway network, Bi LSTM, and attention layers.


Variance Reduced EXTRA and DIGing and Their Optimal Acceleration for Strongly Convex Decentralized Optimization. We study stochastic decentralized optimization for the problem of training machine learning models with large scale distributed data. We extend the widely used EXTRA and DIGing methods with variance reduction (VR), and propose two methods VR EXTRA and VR DIGing. The proposed VR EXTRA requires the time of O(( kappa s n) log frac 1 epsilon ) stochastic gradient evaluations and O(( kappa b kappa c) log frac 1 epsilon ) communication rounds to reach precision epsilon , where kappa s and kappa b are the stochastic condition number and batch condition number for strongly convex and smooth problems, respectively, kappa c is the condition number of the communication network, and n is the sample size on each distributed node. The proposed VR DIGing has a little higher communication cost of O(( kappa b kappa c 2) log frac 1 epsilon ) . Our stochastic gradient computation complexities are the same as the ones of single machine VR methods, such as SAG, SAGA, and SVRG, and our communication complexities keep the same as those of EXTRA and DIGing, respectively. To further speed up the convergence, we also propose the accelerated VR EXTRA and VR DIGing with both the optimal O(( sqrt n kappa s n) log frac 1 epsilon ) stochastic gradient computation complexity and O( sqrt kappa b kappa c log frac 1 epsilon ) communication complexity. Our stochastic gradient computation complexity is also the same as the ones of single machine accelerated VR methods, such as Katyusha, and our communication complexity keeps the same as those of accelerated full batch decentralized methods, such as MSDA.


Delay Compensated Control of Sandwiched ODE PDE ODE Hyperbolic Systems for Oil Drilling and Disaster Relief. Motivated by engineering applications of subsea installation by deepwater construction vessels in oil drilling, and of aid delivery by unmanned aerial vehicles in disaster relief, we develop output feedback boundary control of heterodirectional coupled hyperbolic PDEs sandwiched between two ODEs, where the measurement is the output state of one ODE and suffers a time delay. After rewriting the time delay dynamics as a transport PDE of which the left boundary connects with the sandwiched system, a state observer is built to estimate the states of the overall system of ODE heterodirectional coupled hyperbolic PDEs ODE transport PDE using the right boundary state of the last transport PDE. An observer based output feedback controller acting at the first ODE is designed to stabilize the overall system using backstepping transformations and frequency domain designs. The exponential stability results of the closed loop system, boundedness and exponential convergence of the control input are proved. The obtained theoretical result is applied to control of a deepwater oil drilling construction vessel as a simulation case, where the simulation results show the proposed control design reduces cable oscillations and places the oil drilling equipment to be installed in the target area on the sea floor. Performance deterioration under extreme and unmodeled disturbances is also illustrated.


FedOCR Communication Efficient Federated Learning for Scene Text Recognition. While scene text recognition techniques have been widely used in commercial applications, data privacy has rarely been taken into account by this research community. Most existing algorithms have assumed a set of shared or centralized training data. However, in practice, data may be distributed on different local devices that can not be centralized to share due to the privacy restrictions. In this paper, we study how to make use of decentralized datasets for training a robust scene text recognizer while keeping them stay on local devices. To the best of our knowledge, we propose the first framework leveraging federated learning for scene text recognition, which is trained with decentralized datasets collaboratively. Hence we name it FedOCR. To make FedCOR fairly suitable to be deployed on end devices, we make two improvements including using lightweight models and hashing techniques. We argue that both are crucial for FedOCR in terms of the communication efficiency of federated learning. The simulations on decentralized datasets show that the proposed FedOCR achieves competitive results to the models that are trained with centralized data, with fewer communication costs and higher level privacy preserving.


Active compensation of extrinsic polarization errors using adaptive optics. We present a scheme for active compensation of complex extrinsic polarization perturbations introduced into an optical system. Imaging polarimeter is used to measure the polarization state across a beam profile and a liquid crystal spatial light modulator controls the polarization of the input beam. A sequence of measurements permits determination of the birefringence properties of a perturbing specimen. The necessary correction is calculated and fed back to the polarization modulator to compensate for the polarization perturbation. The system capabilities are demonstrated on a range of birefringent specimens.


Deep Bayesian Local Crystallography. The advent of high resolution electron and scanning probe microscopy imaging has opened the floodgates for acquiring atomically resolved images of bulk materials, 2D materials, and surfaces. This plethora of data contains an immense volume of information on materials structures, structural distortions, and physical functionalities. Harnessing this knowledge regarding local physical phenomena necessitates the development of the mathematical frameworks for extraction of relevant information. However, the analysis of atomically resolved images is often based on the adaptation of concepts from macroscopic physics, notably translational and point group symmetries and symmetry lowering phenomena. Here, we explore the bottom up definition of structural units and symmetry in atomically resolved data using a Bayesian framework. We demonstrate the need for a Bayesian definition of symmetry using a simple toy model and demonstrate how this definition can be extended to the experimental data using deep learning networks in a Bayesian setting, namely rotationally invariant variational autoencoders.


Lower bound for class number of certain real quadratic fields. Let d be a square free positive integer and h(d) the class number of the real quadratic field mathbb Q ( sqrt d ) . In this paper we give an explicit lower bound for h(n 2 r) , where r 1,4 , and also establish an equivalent criteria to attain this lower bound in terms of special value of Dedekind zeta function. Our bounds enable us to reduce the real quadratic families considered in Chowla and Yokoi's conjecture to comparatively small subfamily. We also give an equivalent criteria for having an alternate proof of both the conjectures. Also applying our results, we obtain some criteria for class group of prime power order to be cyclic.


The conformal group of a compact simply connected Lorentzian manifold. We prove that the conformal group of a closed, simply connected, real analytic Lorentzian manifold is compact. D'Ambra proved in 1988 that the isometry group of such a manifold is compact. Our result implies the Lorentzian Lichnerowicz Conjecture for real analytic Lorentzian manifolds with finite fundamental group. Third version includes corrections and clarifications, particularly in section 6.


Characterizing consensus in the Heard Of model. The Heard Of model is a simple and relatively expressive model of distributed computation. Because of this, it has gained a considerable attention of the verification community. We give a characterization of all algorithms solving consensus in a fragment of this model. The fragment is big enough to cover many prominent consensus algorithms. The characterization is purely syntactic it is expressed in terms of some conditions on the text of the algorithm. One of the recent methods of verification of distributed algorithms is to abstract an algorithm to the Heard Of model and then to verify the abstract algorithm using semi automatic procedures. Our results allow, in some cases, to avoid the second step in this methodology.


Manipulation Motion Taxonomy and Coding for Robots. This paper introduces a taxonomy of manipulations as seen especially in cooking for 1) grouping manipulations from the robotics point of view, 2) consolidating aliases and removing ambiguity for motion types, and 3) provide a path to transferring learned manipulations to new unlearned manipulations. Using instructional videos as a reference, we selected a list of common manipulation motions seen in cooking activities grouped into similar motions based on several trajectory and contact attributes. Manipulation codes are then developed based on the taxonomy attributes to represent the manipulation motions. The manipulation taxonomy is then used for comparing motion data in the Daily Interactive Manipulation (DIM) data set to reveal their motion similarities.


Strong localization of invariant metrics. A quantitative version of strong localization of the Kobayashi, Azukawa and Sibony metrics, as well as of the squeezing function, near a plurisubharmonic peak boundary point of a domain in Bbb C n is given. As an application, the behavior of these metrics near a strictly pseudoconvex boundary point is studied. A weak localization of the three metrics and the squeezing function is also given near a plurisubharmonic antipeak boundary point.


Focusing on Bandwidth Achromatic Metalens Limits. Metalenses have shown great promise in their ability to function as ultracompact optical systems for focusing and imaging. Remarkably, several designs have been recently demonstrated that operate over a large range of frequencies with minimized chromatic aberrations, potentially paving the way for ultrathin achromatic optics. Here, we derive fundamental bandwidth limits that apply to broadband optical metalenses, regardless of their implementation. Specifically, we discuss how the product between achievable time delay and bandwidth is limited in any time invariant system, and we apply well established bounds on this product to a general focusing system. We then show that all metalenses designed thus far obey the appropriate bandwidth limit. The derived physical bounds provide a useful metric to compare and assess the performance of different devices, and offer fundamental insight into how to design better broadband metalenses.


Comparison of Wiener index and Zagreb eccentricity indices. The first and the second Zagreb eccentricity index of a graph G are defined as E 1(G) sum v in V(G) varepsilon G (v) 2 and E 2(G) sum uv in E(G) varepsilon G (u) varepsilon G (v) , respectively, where varepsilon G(v) is the eccentricity of a vertex v . In this paper the invariants E 1 , E 2 , and the Wiener index are compared on graphs with diameter 2 , on trees, on a newly introduced class of universally diametrical graphs, and on Cartesian product graphs. In particular, if the diameter of a tree T is not too big, then W(T) ge E 2(T) holds, and if the diameter of T is large, then W(T) E 1(T) holds.


Decentralized Cross Blockchain Asset Transfers. Today, several solutions for cross blockchain asset transfers exist. However, these solutions are either tailored to specific assets or neglect finality guarantees that prevent assets from getting lost in transit. In this paper, we present a cross blockchain asset transfer protocol that supports arbitrary assets and adheres to finality requirements. The ability to freely transfer assets between blockchains may increase transaction throughput and provide developers with more flexibility by allowing them to design digital assets that leverage the capacities and capabilities of multiple blockchains.


Facebook AI's WMT20 News Translation Task Submission. This paper describes Facebook AI's submission to WMT20 shared news translation task. We focus on the low resource setting and participate in two language pairs, Tamil English and Inuktitut English, where there are limited out of domain bitext and monolingual data. We approach the low resource problem using two main strategies, leveraging all available data and adapting the system to the target news domain. We explore techniques that leverage bitext and monolingual data from all languages, such as self supervised model pretraining, multilingual models, data augmentation, and reranking. To better adapt the translation system to the test domain, we explore dataset tagging and fine tuning on in domain data. We observe that different techniques provide varied improvements based on the available data of the language pair. Based on the finding, we integrate these techniques into one training pipeline. For En Ta, we explore an unconstrained setup with additional Tamil bitext and monolingual data and show that further improvement can be obtained. On the test set, our best submitted systems achieve 21.5 and 13.7 BLEU for Ta En and En Ta respectively, and 27.9 and 13.0 for Iu En and En Iu respectively.


Relativistic kinetic theory for spin 1 2 particles Conservation laws, thermodynamics, and linear waves. We study a recently derived fully relativistic kinetic model for spin 1 2 particles. Firstly, the full set of conservation laws for energy, momentum and angular momentum are given, together with an expression for the (non symmetric) stress energy tensor. Next, the thermodynamic equilibrium distribution is given in different limiting cases. Furthermore, we address the analytical complexity that arises when the spin and momentum eigenfunctions are coupled in linear theory, by calculating the linear dispersion relation for such a case. Finally, we discuss the model and give some context by comparing with potentially relevant phenomena that are not included, such as radiation reaction and vacuum polarization.


Reliable Federated Learning for Mobile Networks. Federated learning, as a promising machine learning approach, has emerged to leverage a distributed personalized dataset from a number of nodes, e.g., mobile devices, to improve performance while simultaneously providing privacy preservation for mobile users. In the federated learning, training data is widely distributed and maintained on the mobile devices as workers. A central aggregator updates a global model by collecting local updates from mobile devices using their local training data to train the global model in each iteration. However, unreliable data may be uploaded by the mobile devices (i.e., workers), leading to frauds in tasks of federated learning. The workers may perform unreliable updates intentionally, e.g., the data poisoning attack, or unintentionally, e.g., low quality data caused by energy constraints or high speed mobility. Therefore, finding out trusted and reliable workers in federated learning tasks becomes critical. In this article, the concept of reputation is introduced as a metric. Based on this metric, a reliable worker selection scheme is proposed for federated learning tasks. Consortium blockchain is leveraged as a decentralized approach for achieving efficient reputation management of the workers without repudiation and tampering. By numerical analysis, the proposed approach is demonstrated to improve the reliability of federated learning tasks in mobile networks.


EDropout Energy Based Dropout and Pruning of Deep Neural Networks. Dropout is a well known regularization method by sampling a sub network from a larger deep neural network and training different sub networks on different subsets of the data. Inspired by the dropout concept, we propose EDropout as an energy based framework for pruning neural networks in classification tasks. In this approach, a set of binary pruning state vectors (population) represents a set of corresponding sub networks from an arbitrary provided original neural network. An energy loss function assigns a scalar energy loss value to each pruning state. The energy based model stochastically evolves the population to find states with lower energy loss. The best pruning state is then selected and applied to the original network. Similar to dropout, the kept weights are updated using backpropagation in a probabilistic model. The energy based model again searches for better pruning states and the cycle continuous. Indeed, this procedure is in fact switching between the energy model, which manages the pruning states, and the probabilistic model, which updates the temporarily unpruned weights, in each iteration. The population can dynamically converge to a pruning state. This can be interpreted as dropout leading to pruning the network. From an implementation perspective, EDropout can prune typical neural networks without modification of the network architecture. We evaluated the proposed method on different flavours of ResNets, AlexNet, and SqueezeNet on the Kuzushiji, Fashion, CIFAR 10, CIFAR 100, and Flowers datasets, and compared the pruning rate and classification performance of the models. On average the networks trained with EDropout achieved a pruning rate of more than 50 of the trainable parameters with approximately 5 and 1 drop of Top 1 and Top 5 classification accuracy, respectively.


A relative spannedness for log canonical pairs and quasi log canonical pairs. We establish a relative spannedness for log canonical pairs, which is a generalization of the basepoint freeness for varieties with log terminal singularities by Andreatta Wi 'sniewski. Moreover, we establish a generalization for quasi log canonical pairs.


Data Engineering for HPC with Python. Data engineering is becoming an increasingly important part of scientific discoveries with the adoption of deep learning and machine learning. Data engineering deals with a variety of data formats, storage, data extraction, transformation, and data movements. One goal of data engineering is to transform data from original data to vector matrix tensor formats accepted by deep learning and machine learning applications. There are many structures such as tables, graphs, and trees to represent data in these data engineering phases. Among them, tables are a versatile and commonly used format to load and process data. In this paper, we present a distributed Python API based on table abstraction for representing and processing data. Unlike existing state of the art data engineering tools written purely in Python, our solution adopts high performance compute kernels in C , with an in memory table representation with Cython based Python bindings. In the core system, we use MPI for distributed memory computations with a data parallel approach for processing large datasets in HPC clusters.


Towards direct numerical simulation of turbulent co current Taylor bubble flow. This paper present a simulation strategy for DNS of turbulent co current Taylor bubble flow. This is a continuation of the work presented in 2 in which Large Eddy Simulation (LES) of co current turbulent Taylor bubble flow was presented. It was observed that one of the main challenges is the physically accurate prediction of the behavior of the Taylor bubble skirt, and the related bubble shedding. An underestimation of the turbulent fluctuations in the wake of the Taylor bubble was observed in the LES results. It was suggested that this is related to over prediction of the loss of void of the Taylor bubble due to bubble shedding induced by an LES mesh resolution which is not sufficient to capture the break up and bubble formation accurately. To counter this, in the current work we present a DNS approach of co current turbulent Taylor bubble flow called RK Basilisk, based on the Basilisk code with local adaptive grid refinement. This strategy allows for very high mesh resolution near the bubble's interface while elsewhere the grid is allowed to be coarser. Each time step, the mesh is adapted based on a void fraction criterion. Basilisk's underlying data structure which is based on an 'octree' allows for much faster solution procedures and, therefore, a much greater number of grid points as compared to the LES simulations which were performed using the more general OpenFOAM code. We compare the results against experimental data of the same setting, as well as the co current LES OpenFOAM results. The setting of turbulent Taylor bubble flow in co current conditions allows for both lower order turbulence model development and the validation of more general two phase modeling strategies. Taylor bubble flow in itself also bears relevance to specific two phase flow situations. The current work contributes to an advancement in simulation capability for such situations.


Born Identity Network Multi way Counterfactual Map Generation to Explain a Classifier's Decision. There exists an apparent negative correlation between performance and interpretability of deep learning models. In an effort to reduce this negative correlation, we propose a Born Identity Network (BIN), which is a post hoc approach for producing multi way counterfactual maps. A counterfactual map transforms an input sample to be conditioned and classified as a target label, which is similar to how humans process knowledge through counterfactual thinking. For example, a counterfactual map can localize hypothetical abnormalities from a normal brain image that may cause it to be diagnosed with a disease. Specifically, our proposed BIN consists of two core components Counterfactual Map Generator and Target Attribution Network. The Counterfactual Map Generator is a variation of conditional GAN which can synthesize a counterfactual map conditioned on an arbitrary target label. The Target Attribution Network provides adequate assistance for generating synthesized maps by conditioning a target label into the Counterfactual Map Generator. We have validated our proposed BIN in qualitative and quantitative analysis on MNIST, 3D Shapes, and ADNI datasets, and showed the comprehensibility and fidelity of our method from various ablation studies.


Designing Environments Conducive to Interpretable Robot Behavior. Designing robots capable of generating interpretable behavior is a prerequisite for achieving effective human robot collaboration. This means that the robots need to be capable of generating behavior that aligns with human expectations and, when required, provide explanations to the humans in the loop. However, exhibiting such behavior in arbitrary environments could be quite expensive for robots, and in some cases, the robot may not even be able to exhibit the expected behavior. Given structured environments (like warehouses and restaurants), it may be possible to design the environment so as to boost the interpretability of the robot's behavior or to shape the human's expectations of the robot's behavior. In this paper, we investigate the opportunities and limitations of environment design as a tool to promote a type of interpretable behavior known in the literature as explicable behavior. We formulate a novel environment design framework that considers design over multiple tasks and over a time horizon. In addition, we explore the longitudinal aspect of explicable behavior and the trade off that arises between the cost of design and the cost of generating explicable behavior over a time horizon.


Mechanism Design of a Bio inspired Armwing Mechanism for Mimicking Bat Flapping Gait. The objective of this work is to design and develop a bio inspired soft and articulated armwing structure which will be an integral component of a morphing aerial co bot, Aerobat. In our design, we draw inspiration from bats. Bat membranous wings possess unique functions that make them a good example to take inspiration from and transform current aerial drones. In contrast with other flying vertebrates, bats have an extremely articulated musculoskeletal system, key to their body impact survivability and deliver an impressively adaptive and multimodal locomotion behavior. Bats exclusively use this capability with structural flexibility to generate the controlled force distribution on each wing membrane. The wing flexibility, complex wing kinematics, and fast muscle actuation allow these creatures to change the body configuration within a few tens of milliseconds. These characteristics are crucial to the unrivaled agility of bats and copying them can potentially transform the state of the art aerial drone design.


Optimal transportation and stationary measures for Iterated Function Systems. In this article we show how ideas, methods and results from optimal transportation can be used to study various aspects of the stationary measuresof Iterated Function Systems equipped with a probability distribution. We recover a classical existence and uniqueness result under a contraction on average assumption, prove generalized moment bounds from which tail estimates can be deduced, consider the convergence of the empirical measure of an associated Markov chain, and prove in many cases the Lipschitz continuity of the stationary measure when the system is perturbed, with as a consequence a "linear response formula" at almost every parameter of the perturbation.


Spectral Sparsification via Bounded Independence Sampling. We give a deterministic, nearly logarithmic space algorithm for mild spectral sparsification of undirected graphs. Given a weighted, undirected graph G on n vertices described by a binary string of length N , an integer k leq log n , and an error parameter epsilon 0 , our algorithm runs in space tilde O (k log (N cdot w mathrm max w mathrm min )) where w mathrm max and w mathrm min are the maximum and minimum edge weights in G , and produces a weighted graph H with tilde O (n 1 2 k epsilon 2) edges that spectrally approximates G , in the sense of Spielmen and Teng ST04 , up to an error of epsilon . Our algorithm is based on a new bounded independence analysis of Spielman and Srivastava's effective resistance based edge sampling algorithm SS08 and uses results from recent work on space bounded Laplacian solvers MRSV17 . In particular, we demonstrate an inherent tradeoff (via upper and lower bounds) between the amount of (bounded) independence used in the edge sampling algorithm, denoted by k above, and the resulting sparsity that can be achieved.


Credit migration Generating generators. Markovian credit migration models are a reasonably standard tool nowadays, but there are fundamental difficulties with calibrating them. We show how these are resolved using a simplified form of matrix generator and explain why risk neutral calibration cannot be done without volatility information. We also show how to use elementary ideas from differential geometry to make general inferences about calibration stability. This the longer version of an article published by RISK (Feb 2021).


Classifier Pool Generation based on a Two level Diversity Approach. This paper describes a classifier pool generation method guided by the diversity estimated on the data complexity and classifier decisions. First, the behavior of complexity measures is assessed by considering several subsamples of the dataset. The complexity measures with high variability across the subsamples are selected for posterior pool adaptation, where an evolutionary algorithm optimizes diversity in both complexity and decision spaces. A robust experimental protocol with 28 datasets and 20 replications is used to evaluate the proposed method. Results show significant accuracy improvements in 69.4 of the experiments when Dynamic Classifier Selection and Dynamic Ensemble Selection methods are applied.


Exact splitting methods for semigroups generated by inhomogeneous quadratic differential operators. We introduce some general tools to design exact splitting methods to compute numerically semigroups generated by inhomogeneous quadratic differential operators. More precisely, we factorize these semigroups as products of semigroups that can be approximated efficiently, using, for example, pseudo spectral methods. We highlight the efficiency of these new methods on the examples of the magnetic linear Schr "o dinger equations with quadratic potentials, some transport equations and some Fokker Planck equations.


The nonmodal kinetic theory for the electrostatic instabilities of a plasma with a sheared Hall current. The kinetic theory for the instabilities driven by the Hall current with a sheared current velocity, which has the method of the shearing modes or the so called non modal approach as its foundation, is developed. The developed theory predicts that in the Hall plasma with the inhomogeneous electric field, the separate spatial Fourier mode of the perturbations is determined in the frame convected with one of the plasma components. Because of the different shearing of the ion and electron flows in the Hall plasma, this mode is perceived by the second component as the Doppler shifted continuously sheared mode with time dependent wave numbers. Due to this effect, the interaction of the plasma components forms the nonmodal time dependent process, which should be investigated as the initial value problem. The developed approach is applied to the solutions of the linear initial value problems for the hydrodynamic modified two stream instability and the kinetic ion sound instability of the plasma with a sheared Hall current with a uniform velocity shear. These solutions reveal that the uniform part of the current velocity is responsible for the modal evolution of the instability, whereas the current velocity shear is the source of the development of the nonmodal instability with exponent growing with time as sim left(t t 0 right) 3 .


Radiation dose simulation during laser plasma proton acceleration experiments and method to increase the measurement resolution of the proton energy spectrum. The paper discusses some 3D simulations to compute the ionizing radiation dose during laser plasma experiments leading to the generation of accelerated protons and electrons. Also, we suggest a new method to increase the measurement resolution of the proton energy spectrum. Monte Carlo simulations of the radiation doses map around the laser foil interaction point are performed using Geant4 General Particle Source code and the particular geometry chosen for the experimental setup. We obtain the map of the radiation dose distribution for high power laser thin solid target experiments, considering a cubic geometry of the interaction chamber. The computed radiation dose distribution shows a good agreement with various, previously obtained experimental results, and could be a step towards simulating the radiation environment inside of a spacecraft. To characterize the laser plasma accelerated protons, we introduce a new method to enhance the measurement resolution of the proton energy spectrum by employing a stack of thin solid detectors, preferably CR 39. Each detector is thinner than the Bragg peak region on the Bragg curve that characterizes the loss of kinetic energy as a function of the particle penetration depth in the detector material. The relevance of this method for space radiation characterization and cybersecurity insurance is highlighted.


TruPercept Trust Modelling for Autonomous Vehicle Cooperative Perception from Synthetic Data. Inter vehicle communication for autonomous vehicles (AVs) stands to provide significant benefits in terms of perception robustness. We propose a novel approach for AVs to communicate perceptual observations, tempered by trust modelling of peers providing reports. Based on the accuracy of reported object detections as verified locally, communicated messages can be fused to augment perception performance beyond line of sight and at great distance from the ego vehicle. Also presented is a new synthetic dataset which can be used to test cooperative perception. The TruPercept dataset includes unreliable and malicious behaviour scenarios to experiment with some challenges cooperative perception introduces. The TruPercept runtime and evaluation framework allows modular component replacement to facilitate ablation studies as well as the creation of new trust scenarios we are able to show.


Regularizing Attention Networks for Anomaly Detection in Visual Question Answering. For stability and reliability of real world applications, the robustness of DNNs in unimodal tasks has been evaluated. However, few studies consider abnormal situations that a visual question answering (VQA) model might encounter at test time after deployment in the real world. In this study, we evaluate the robustness of state of the art VQA models to five different anomalies, including worst case scenarios, the most frequent scenarios, and the current limitation of VQA models. Different from the results in unimodal tasks, the maximum confidence of answers in VQA models cannot detect anomalous inputs, and post training of the outputs, such as outlier exposure, is ineffective for VQA models. Thus, we propose an attention based method, which uses confidence of reasoning between input images and questions and shows much more promising results than the previous methods in unimodal tasks. In addition, we show that a maximum entropy regularization of attention networks can significantly improve the attention based anomaly detection of the VQA models. Thanks to the simplicity, attention based anomaly detection and the regularization are model agnostic methods, which can be used for various cross modal attentions in the state of the art VQA models. The results imply that cross modal attention in VQA is important to improve not only VQA accuracy, but also the robustness to various anomalies.


A Deep Learning Approach for COVID 19 Trend Prediction. In this work, we developed a deep learning model based approach to forecast the spreading trend of SARS CoV 2 in the United States. We implemented the designed model using the United States to confirm cases and state demographic data and achieved promising trend prediction results. The model incorporates demographic information and epidemic time series data through a Gated Recurrent Unit structure. The identification of dominating demographic factors is delivered in the end.


Entropy of tropical holonomic sequences. We introduce tropical holonomic sequences of a given order and calculate their entropy in case of the second order.


Mixing time and cutoff phenomenon for the interchange process on dumbbell graphs and the labelled exclusion process on the complete graph. We find the total variation mixing time of the interchange process on the dumbbell graph (two complete graphs, K n and K m , connected by a single edge), and show that this sequence of chains exhibits the cutoff phenomenon precisely when the smaller size m goes to infinity. The mixing time undergoes a phase transition at m asymp sqrt n . We also state a conjecture on when exactly cutoff holds for the interchange process on general graphs. Our proofs use coupling methods, and they also give the mixing time of the simple exclusion process of k labelled particles in the complete graph K n , for any k leq n , with cutoff, as conjectured by Lacoin and Leblond (2011). In particular, this is a new probabilistic proof for the mixing time of random transpositions, first established by Diaconis and Shahshahani (1981).


Stochastic Geometry Based Analysis of Airborne Base Stations with Laser powered UAVs. One of the most promising solutions to the problem of limited flight time of unmanned aerial vehicles (UAVs), is providing the UAVs with power through laser beams emitted from Laser Beam Directors (LBDs) deployed on the ground. In this letter, we study the performance of a laser powered UAV enabled communication system using tools from stochastic geometry. We first derive the energy coverage probability, which is defined as the probability of the UAV receiving enough energy to ensure successful operation (hovering and communication). Our results show that to ensure energy coverage, the distance between the UAV and its dedicated LBD must be below a certain threshold, for which we derive an expression as a function of the system parameters. Considering simultaneous information and power transmission through the laser beam using power splitting technique, we also derive the joint energy and the Signal to noise Ratio (SNR) coverage probability. The analytical and simulation results reveal some interesting insights. For instance, our results show that we need at least 6 LBDs 10km 2 to ensure a reliable performance in terms of energy coverage probability.


Intra day Equity Price Prediction using Deep Learning as a Measure of Market Efficiency. In finance, the weak form of the Efficient Market Hypothesis asserts that historic stock price and volume data cannot inform predictions of future prices. In this paper we show that, to the contrary, future intra day stock prices could be predicted effectively until 2009. We demonstrate this using two different profitable machine learning based trading strategies. However, the effectiveness of both approaches diminish over time, and neither of them are profitable after 2009. We present our implementation and results in detail for the period 2003 2017 and propose a novel idea the use of such flexible machine learning methods as an objective measure of relative market efficiency. We conclude with a candidate explanation, comparing our returns over time with high frequency trading volume, and suggest concrete steps for further investigation.


Timelike surfaces in the de Sitter space mathbb S 3 1(1) subset mathbb R 4 1 . This paper studies timelike minimal surfaces in the De Sitter space mathbb S 3 1(1) subset mathbb R 4 1 via a complex variable. Using complex analysis and stereographic projection of lightlike vectors we obtain a representation formula. Real and complex special quadrics in mathbb CP 3 are identified with the grassmannians of spacelike and timelike oriented 2 planes of mathbb R 4 1 , and the normal frame is written in terms of certain complex valued functions x and y , which may be considered holomorphic functions as a special case. Then several results describing the analytic restrictions via solutions of certain PDE in complex variable, are shown. Finding solutions allows us to identify explicitly the representation of the associated surfaces. Moreover, using our technique we find a new kind of complex function which we call quasi holomorphic and which satisfy a generalized version of the Cauchy Riemann equations. Our technique allows the explicit construction of many families of minimal timelike surfaces in mathbb S 3 1(1) whose intrinsic Gauss map will also belong to the same class of surfaces.


Nonuniqueness of nonrunaway solutions of Abraham Lorentz Dirac equation in an external laser pulse. In the paper cite carati95 it was shown that, for motions on a line under the action of a potential barrier, the third order Abraham Lorentz Dirac equation presents the phenomenon of nonuniqueness of nonrunaway solutions. Namely, at least for a sufficiently steep barrier, the physical solutions of the equation are not determined by the "mechanical state" of position and velocity, and knowledge of the initial acceleration too is required. Due to recent experiments, both in course and planned, on the interactions between strong laser pulses and ultra relativistic electrons, it becomes interesting to establish whether such a nonuniqueness phenomenon extends to the latter case, and for which ranges of the parameters. In the present work we will consider just the simplest model, i.e., the case of an electromagnetic plane wave, and moreover for the Abraham Lorentz Dirac equation dealt with in the nonrelativistic approximation. The result we found is that the nonuniqueness phenomenon occurs if, at a given frequency of the incoming wave, the field intensity is sufficiently large. An analytic estimate of such a threshold is also given. At the moment it is unclear whether such a phenomenon applies also in the full relativistic case, which is the one of physical interest.


3D fluid modeling of positive streamer discharges in air with stochastic photoionization. Streamer discharges are thin plasma channels that precede lightning and sparks. They usually evolve in bundles as stochastic tree like structures and are inherently difficult to model due to their multiscale nature. In this paper, we perform a computer investigation of positive streamer discharges in air using contemporary photoionization models. We report on three dimensional computer simulations under conditions that are available in laboratory spark gap experiments. The solutions demonstrate a multiscale morphology consisting of streamer fluctuations, branching, and the formation of a discharge tree. Some branches are comparatively thick and noisy, while others are thin, smooth, and carry electric fields exceeding 250 , textrm kV cm at their tips. Our results are consistent with past experiments and clarify the puzzling branching dynamics and stochastic morphology of positive streamer discharges.


Bi Directional Generation for Unsupervised Domain Adaptation. Unsupervised domain adaptation facilitates the unlabeled target domain relying on well established source domain information. The conventional methods forcefully reducing the domain discrepancy in the latent space will result in the destruction of intrinsic data structure. To balance the mitigation of domain gap and the preservation of the inherent structure, we propose a Bi Directional Generation domain adaptation model with consistent classifiers interpolating two intermediate domains to bridge source and target domains. Specifically, two cross domain generators are employed to synthesize one domain conditioned on the other. The performance of our proposed method can be further enhanced by the consistent classifiers and the cross domain alignment constraints. We also design two classifiers which are jointly optimized to maximize the consistency on target sample prediction. Extensive experiments verify that our proposed model outperforms the state of the art on standard cross domain visual benchmarks.


Voltage Controlled Reversible Modulation of Colloidal Quantum Dot Thin Film Photoluminescence. Active modulation of quantum dot thin film photoluminescence (PL) has far reaching potential applications in biomedical and optoelectronic systems, but challenges remain in achieving large PL modulation depth and fast temporal response. Here we report an efficient voltage controlled optical down converter by optically exciting a colloidal quantum dot thin film within a quantum dot light emitting diode (QD LED) under reverse bias. Utilizing field induced luminescence quenching, we show that a large electric field can strongly modify carrier dynamics in this nanostructured device, resulting in stable and reversible photoluminescence quenching. The device exhibits photoluminescence reduction of up to 99.5 , corresponding to a contrast ratio of 200 1, under the applied electric field of 3 MV cm, with a 300 nanosecond response time. Using excitation wavelength dependent and transient PL spectroscopy, we further show that the high degree of quenching is achieved by a synergistic interplay of quantum confined Stark effect (QCSE) and field induced exciton dissociation.


Matrix embedding method in match for session based recommendation. Session based model is widely used in recommend system. It use the user click sequence as input of a Recurrent Neural Network (RNN), and get the output of the RNN network as the vector embedding of the session, and use the inner product of the vector embedding of session and the vector embedding of the next item as the score that is the metric of the interest to the next item. This method can be used for the "match" stage for the recommendation system whose item number is very big by using some index method like KD Tree or Ball Tree and etc.. But this method repudiate the variousness of the interest of user in a session. We generated the model to modify the vector embedding of session to a symmetric matrix embedding, that is equivalent to a quadratic form on the vector space of items. The score is builded as the value of the vector embedding of next item under the quadratic form. The eigenvectors of the symmetric matrix embedding corresponding to the positive eigenvalues are conjectured to represent the interests of user in the session. This method can be used for the "match" stage also. The experiments show that this method is better than the method of vector embedding.


The IMS CUBoulder System for the SIGMORPHON 2020 Shared Task on Unsupervised Morphological Paradigm Completion. In this paper, we present the systems of the University of Stuttgart IMS and the University of Colorado Boulder (IMS CUBoulder) for SIGMORPHON 2020 Task 2 on unsupervised morphological paradigm completion (Kann et al., 2020). The task consists of generating the morphological paradigms of a set of lemmas, given only the lemmas themselves and unlabeled text. Our proposed system is a modified version of the baseline introduced together with the task. In particular, we experiment with substituting the inflection generation component with an LSTM sequence to sequence model and an LSTM pointer generator network. Our pointer generator system obtains the best score of all seven submitted systems on average over all languages, and outperforms the official baseline, which was best overall, on Bulgarian and Kannada.


Tibial Implant Fixation in TKA Worth A Revision? How to Avoid Stress Shielding Even for Stiff Metallic Implants. In total knee arthroplasty (TKA) force is transmitted into the tibia by a combined plate stem device along with cemented or cementless stem fixation. The present work analyzes this force transmission in finite element simulations with the main aim to avoid reported postsurgical bone density reduction as a consequence of a reduced tibial bone loading. In the numerical analysis different implant materials, stem extension lengths and implant to stem interface conditions are considered, from a stiff fully cemented fixation to sliding contact conditions with a low friction coefficient. The impact of these variations on bone loading changes are measured by (i) decomposing the total force into parts mediated by the plate and by the stem and by (ii) post surgery strain energy density (SED) deviations. Based on a bionics inspired perspective on how nature in pre operative conditions carries out force transfer from the knee joint into the tibia, a modified implant bone interface is suggested that alters force transmission towards physiological conditions while preserving the geometries of the standard plate stem endoprosthesis design. The key aspect is that the axial force is predominantly transmitted through the plate into proximal bone which requires a compliant bone stem interface as realized by sliding friction conditions at a low friction coefficient. These interface conditions avoid stress shielding almost completely, preserve pre surgery bone loading such that bone resorption is not likely to occur.


New preconditioners for Laplace and Helmholtz integral equations on open curves Analytical framework and Numerical results. The Helmholtz wave scattering problem by screens in 2D can be recast into first kind integral equations which lead to ill conditioned linear systems after discretization. We introduce two new preconditioners, in the form of square roots of local operators respectively for the corresponding problems with Dirichlet and Neumann conditions on the arc. They generalize the so called "analytical" preconditioners available for Lipschitz scatterers. We introduce a functional setting adapted to the singularity of the problem and enabling the analysis of those preconditioners. The efficiency of the method is demonstrated on several numerical examples.


DashNet A Hybrid Artificial and Spiking Neural Network for High speed Object Tracking. Computer science oriented artificial neural networks (ANNs) have achieved tremendous success in a variety of scenarios via powerful feature extraction and high precision data operations. It is well known, however, that ANNs usually suffer from expensive processing resources and costs. In contrast, neuroscience oriented spiking neural networks (SNNs) are promising for energy efficient information processing benefit from the event driven spike activities, whereas, they are yet be evidenced to achieve impressive effectiveness on real complicated tasks. How to combine the advantage of these two model families is an open question of great interest. Two significant challenges need to be addressed (1) lack of benchmark datasets including both ANN oriented (frames) and SNN oriented (spikes) signal resources (2) the difficulty in jointly processing the synchronous activation from ANNs and event driven spikes from SNNs. In this work, we proposed a hybrid paradigm, named as DashNet, to demonstrate the advantages of combining ANNs and SNNs in a single model. A simulator and benchmark dataset NFS DAVIS is built, and a temporal complementary filter (TCF) and attention module are designed to address the two mentioned challenges, respectively. In this way, it is shown that DashNet achieves the record breaking speed of 2083FPS on neuromorphic chips and the best tracking performance on NFS DAVIS and PRED18 datasets. To the best of our knowledge, DashNet is the first framework that can integrate and process ANNs and SNNs in a hybrid paradigm, which provides a novel solution to achieve both effectiveness and efficiency for high speed object tracking.


Advances to tackle backbone flexibility in protein docking. Computational docking methods can provide structural models of protein protein complexes, but protein backbone flexibility upon association often thwarts accurate predictions. In recent blind challenges, medium or high accuracy models were submitted in less than 20 of the "difficult" targets (with significant backbone change or uncertainty). Here, we describe recent developments in protein protein docking and highlight advances that tackle backbone flexibility. In molecular dynamics and Monte Carlo approaches, enhanced sampling techniques have reduced time scale limitations. Internal coordinate formulations can now capture realistic motions of monomers and complexes using harmonic dynamics. And machine learning approaches adaptively guide docking trajectories or generate novel binding site predictions from deep neural networks trained on protein interfaces. These tools poise the field to break through the longstanding challenge of correctly predicting complex structures with significant conformational change.


LinearPartition Linear Time Approximation of RNA Folding Partition Function and Base Pairing Probabilities. RNA secondary structure prediction is widely used to understand RNA function. Recently, there has been a shift away from the classical minimum free energy (MFE) methods to partition function based methods that account for folding ensembles and can therefore estimate structure and base pair probabilities. However, the classical partition function algorithm scales cubically with sequence length, and is therefore a slow calculation for long sequences. This slowness is even more severe than cubic time MFE based methods due to a larger constant factor in runtime. Inspired by the success of our recently proposed LinearFold algorithm that predicts the approximate MFE structure in linear time, we design a similar linear time heuristic algorithm, LinearPartition, to approximate the partition function and base pairing probabilities, which is shown to be orders of magnitude faster than Vienna RNAfold and CONTRAfold (e.g., 2.5 days vs. 1.3 minutes on a sequence with length 32,753 nt). More interestingly, the resulting base pairing probabilities are even better correlated with the ground truth structures. LinearPartition also leads to a small accuracy improvement when used for downstream structure prediction on families with the longest length sequences (16S and 23S rRNA), as well as a substantial improvement on long distance base pairs (500 nt apart).


Superelliptic curves with large Galois images. Let r 2 and l be primes. In this paper we study the mod l Galois representations attached to curves of the form y r f(x) where f is monic and has coefficients belonging to the r th cyclotomic field. We provide conditions on the coefficients (and degree) of f which allow one to verify the mod l image is large outside of a (typically small) finite explicit set of primes. We allow all values of r for which the r th cyclotomic field has odd class number. This appears to be the first explicit result for abelian varieties of dimension greater than two and not of GL 2 type which allows the ground field to have unramified extensions. In proving the large image result we give a classification of the maximal subgroups containing transvections of certain classical groups and describe (in many cases) the images of inertia groups. The exact mod l image is governed by the "endomorphism character", a certain algebraic Hecke character which generalises the CM character. When r 3, we depict the image in its entirety. To the author's knowledge, this is the first accurate description in the literature. Finally, we give several examples with genus ranging from 10 to 36. Applications to the Inverse Galois Problem are also included.


Some results on Simpson type conformable fractional inequalities. In this paper we established a new Simpson type conformable fractional integral equality for convex functions. Based on this identity, some results related to Simpson like type inequalities are obtained. These results are then applied to some special means of real numbers and two special functions, modified Bessel function and q digamma function, respectively.


I'm a doctor, not a mathematician! Homeostasis as a proportional integral control system. The distinction between "healthy" and "unhealthy" patients is commonly based on single, discrete values taken at an isolated point in time (e.g., blood pressure or core temperature). Perhaps a more robust and insightful diagnosis can be obtained by studying the functional interdependence of such indicators and the homeostasis that controls them. This requires quasi continuous measurements and a procedure to map the data onto a parsimonious control model with a degree of universality. The current research illustrates this approach using glucose homeostasis as a target. Data were obtained from 41 healthy subjects wearing over the counter glucose monitors, and projected onto a simple proportional integral (PI) controller, widely used in engineering applications. The indicators quantifying the control function are clustered for the great majority of subjects, while a few outliers exhibit less efficient homeostasis. Practical implications for healthcare and education are further discussed.


Generalized One to One Mappings between Homomorphism Sets of Digraphs. Structural properties of finite digraphs R and S are studied which enforce cal H (G,R) leq cal H (G,S) for every finite digraph G in mathfrak D ' , where cal H (G,H) is the set of homomorphisms from G to H , and mathfrak D ' is a class of digraphs. In a previous study, we have seen that the key for such a relation between R and S is the existence of a strong S scheme from R to S . Such an S scheme rho defines a one to one mapping rho G cal S (G,R) rightarrow cal S (G,S) for every G in mathfrak D ' , where cal S (G,H) is the set of homomorphisms from G to H mapping proper arcs of G to proper arcs of H . In the present article, we characterize S schemes rho which are induced by strict homomorphisms epsilon cal E (R) rightarrow cal E (S) between auxiliary systems of R and S , and we analyze the mutual dependency between the properties of rho and epsilon . Wide applicability of the theory is ensured by specifying the auxiliary systems cal E (R) and cal E (S) as EV systems of R and S . The results are applied on a rearrangement method for digraphs and on undirected graphs.


Accurate Determination of the Charge Transfer Efficiency of Photoanodes for Solar Water Splitting. The oxygen evolution reaction (OER) at the surface of semiconductor photoanodes involves photo generated holes that oxidize water. A certain fraction of the holes that reach the surface recombine with electrons from the conduction band, giving rise to the surface recombination loss. The charge transfer efficiency, xt, defined as the ratio between the flux of holes that contribute to the water oxidation reaction and the total flux of holes that reach the surface, is an important parameter that helps to distinguish between bulk and surface recombination losses. However, accurate determination of xt by conventional voltammetry measurements is complicated because only the total current is measured and it is difficult to discern between different contributions to the current. Chopped light measurement and hole scavenger measurement techniques are widely employed to determine xt, but they often lead to errors. Intensity modulated photocurrent spectroscopy (IMPS) is better suited for accurate determination of xt because it provides direct information on both the total photocurrent and the surface recombination current. Careful analysis of IMPS measurements at different light intensities is required to account for nonlinear effects. We compare the xt values obtained by these methods using heteroepitaxial hematite photoanodes. A wide spread of xt values is obtained by different analysis methods and different light sources and light intensities. Statistical analysis of the results show good correlation between different methods for measurements carried out with the same light source, light intensity and potential. However, there is a considerable spread in the results obtained by different methods. For accurate determination of xt, we recommend IMPS measurements with a bias light intensity such that the irradiance is as close as possible to the standard solar spectrum.


Describing meta atoms using the exact higher order polarizability tensors. In nanophotonics, multipole framework has become an indispensable theoretical tool for analyzing subwavelength meta atoms and their radiation properties. This work presents higher order exact dynamic polarizability (alpha) tensors, which can fully represent anisotropic meta atoms with higher order multipole transitions. By using the irreducible exact Cartesian multipoles and field components as the basis, the exact alpha tensor rigorously reflects symmetry information of particles including reciprocity. In addition, the exact alpha tensor can be obtained from T matrix simply using basis transformation. Finally, we show that description of meta atoms using alpha tensors incorporated with multiple scattering theory vastly extends the applicability of the multipole framework in nanophotonics, allowing accurate and efficient depiction of complicated, random, multi scale systems.


Curved Text Detection in Natural Scene Images with Semi and Weakly Supervised Learning. Detecting curved text in the wild is very challenging. Recently, most state of the art methods are segmentation based and require pixel level annotations. We propose a novel scheme to train an accurate text detector using only a small amount of pixel level annotated data and a large amount of data annotated with rectangles or even unlabeled data. A baseline model is first obtained by training with the pixel level annotated data and then used to annotate unlabeled or weakly labeled data. A novel strategy which utilizes ground truth bounding boxes to generate pseudo mask annotations is proposed in weakly supervised learning. Experimental results on CTW1500 and Total Text demonstrate that our method can substantially reduce the requirement of pixel level annotated data. Our method can also generalize well across two datasets. The performance of the proposed method is comparable with the state of the art methods with only 10 pixel level annotated data and 90 rectangle level weakly annotated data.


Compact Method for Proton Range Verification Based on Coaxial Prompt Gamma Ray Monitoring a Theoretical Study. Range uncertainties in proton therapy hamper treatment precision. Prompt gamma rays were suggested 16 years ago for real time range verification, and have already shown promising results in clinical studies with collimated cameras. Simultaneously, alternative imaging concepts without collimation are investigated to reduce the footprint and price of current prototypes. In this manuscript, a compact range verification method is presented. It monitors prompt gamma rays with a single scintillation detector positioned coaxially to the beam and behind the patient. Thanks to the solid angle effect, proton range deviations can be derived from changes in the number of gamma rays detected per proton, provided that the number of incident protons is well known. A theoretical background is formulated and the requirements for a future proof of principle experiment are identified. The potential benefits and disadvantages of the method are discussed, and the prospects and potential obstacles for its use during patient treatments are assessed. The final milestone is to monitor proton range differences in clinical cases with a statistical precision of 1 mm, a material cost of 25000 USD and a weight below 10 kg. This technique could facilitate the widespread application of in vivo range verification in proton therapy and eventually the improvement of treatment quality.


Planning and Execution using Inaccurate Models with Provable Guarantees. Models used in modern planning problems to simulate outcomes of real world action executions are becoming increasingly complex, ranging from simulators that do physics based reasoning to precomputed analytical motion primitives. However, robots operating in the real world often face situations not modeled by these models before execution. This imperfect modeling can lead to highly suboptimal or even incomplete behavior during execution. In this paper, we propose CMAX an approach for interleaving planning and execution. CMAX adapts its planning strategy online during real world execution to account for any discrepancies in dynamics during planning, without requiring updates to the dynamics of the model. This is achieved by biasing the planner away from transitions whose dynamics are discovered to be inaccurately modeled, thereby leading to robot behavior that tries to complete the task despite having an inaccurate model. We provide provable guarantees on the completeness and efficiency of the proposed planning and execution framework under specific assumptions on the model, for both small and large state spaces. Our approach CMAX is shown to be efficient empirically in simulated robotic tasks including 4D planar pushing, and in real robotic experiments using PR2 involving a 3D pick and place task where the mass of the object is incorrectly modeled, and a 7D arm planning task where one of the joints is not operational leading to discrepancy in dynamics. The video of our physical robot experiments can be found at https youtu.be eQmAeWIhjO8


Controlling the non linear emission of upconversion nanoparticles to enhance super resolution imaging performance. Upconversion nanoparticles (UCNPs) exhibit unique optical properties such as photo emission stability, large anti Stokes shift, and long excited state lifetimes, allowing significant advances in a broad range of applications from biomedical sensing to super resolution microscopy. In recent years, progress on nanoparticle synthesis led to the development of many strategies for enhancing their upconversion luminescence, focused in particular on heavy doping of lanthanide ions and core shell structures. In this article, we investigate the non linear emission properties of fully Yb based core shell UCNPs and their impact on the super resolution performance of stimulated excitation depletion (STED) microscopy and super linear excitation emission (uSEE) microscopy. Controlling the power dependent emission curve enables us to relax constraints on the doping concentrations and to reduce the excitation power required for accessing sub diffraction regimes. We take advantage of this feature to implement multiplexed super resolution imaging of a two sample mixture.


UBER GNN A User Based Embeddings Recommendation based on Graph Neural Networks. The problem of session based recommendation aims to predict user next actions based on session histories. Previous methods models session histories into sequences and estimate user latent features by RNN and GNN methods to make recommendations. However under massive scale and complicated financial recommendation scenarios with both virtual and real commodities , such methods are not sufficient to represent accurate user latent features and neglect the long term characteristics of users. To take long term preference and dynamic interests into account, we propose a novel method, i.e. User Based Embeddings Recommendation with Graph Neural Network, UBER GNN for brevity. UBER GNN takes advantage of structured data to generate longterm user preferences, and transfers session sequences into graphs to generate graph based dynamic interests. The final user latent feature is then represented as the composition of the long term preferences and the dynamic interests using attention mechanism. Extensive experiments conducted on real Ping An scenario show that UBER GNN outperforms the state of the art session based recommendation methods.