On time inhomogeneous stochastic It o equations with drift in L d 1 . We prove the solvability of It o stochastic equations with uniformly nondegenerate, bounded, measurable diffusion and drift in L d 1 ( mathbb R d 1 ) . Actually, the powers of summability of the drift in x and t could be different. Our results seem to be new even if the diffusion is constant. The method of proving the solvability belongs to A.V. Skorokhod. Weak uniqueness of solutions is an open problem even if the diffusion is constant.


Strong angular momentum mixing in ultracold atom ion excitation exchange. Atom ion interactions occur through the electric dipole which is induced by the ion on the neutral atom. In a Langevin collision, in which the atom and ion overcome the centrifugal barrier and reach a short internuclear distance, their internal electronic states deform due to their interaction and can eventually alter. Here we explore the outcome products and the energy released from a single Langevin collision between a single cold 88 Sr ion initialized in the metastable 4d 2D 5 2,3 2 states, and a cold 87 Rb atom in the 5s 2S 1 2 ground state. We found that the long lived D 5 2 and D 3 2 states quench after roughly three Langevin collisions, transforming the excitation energy into kinetic energy. We identify two types of collisional quenching. One is an Electronic Excitation Exchange process, during which the ion relaxes to the S state and the atom is excited to the P state, followed by energy release of sim 3000 K cdot k B . The second is Spin Orbit Change where the ion relaxes from the higher fine structure D 5 2 level to the lower D 3 2 level releasing sim 400 K cdot k B into kinetic motion. These processes are theoretically understood to occur through Landau Zener avoided crossings between the different molecular potential curves. We also found that these relaxation rates are insensitive to the mutual spin orientation of the ion and atoms. This is explained by the strong inertial Coriolis coupling present in ultracold atom ion collisions due to the high partial wave involved, which strongly mixes different angular momentum states. This inertial coupling explains the loss of the total electronic angular momentum which is transferred to the external rotation of nuclei. Our results provide deeper understanding of ultracold atom ion inelastic collisions and offer additional quantum control tools for the cold chemistry field.


A perturbed collage theorem and its application to inverse interval integral problems. This paper deals with inverse problems subject to imprecise or vague information of some involved data by means of interval valued functions. To provide interval solutions to the inverse problems we have adopted a perturbed collage based approach and we have also introduced a numerical procedure by means of the use of interval bases in a sense. To illustrate the results, and as an application, we have studied the Volterra interval valued integral equation, and provide some computational examples.


Inverse acoustic scattering problems with multi frequency sparse backscattering far field data. The inverse acoustic scattering problems using multi frequency backscattering far field patterns at isolated directions are studied. The underlying object could be point like scatterers, small scatterers, extended inhomogeneities and obstacles. A fast and robust direct sampling method is proposed for location and shape reconstruction of the underlying objects. To our best knowledge, this is the first numerical method for inverse obstacle medium scattering problems with the multi frequency sparse backscattering data. Some approximate uniqueness results have also been showed based on the weak scattering approximation and the Kirchhoff approximation. The theoretical basis of the direct sampling method is initially established based on these two approximations. Numerical examples in two dimensions are presented to validity the effectiveness and robustness of the proposed direct sampling method. In particular, the numerical reconstructions indicate that the direct sampling method also works very well beyond these two approximations.


The Effects of Object Shape, Fidelity, Color, and Luminance on Depth Perception in Handheld Mobile Augmented Reality. Depth perception of objects can greatly affect a user's experience of an augmented reality (AR) application. Many AR applications require depth matching of real and virtual objects and have the possibility to be influenced by depth cues. Color and luminance are depth cues that have been traditionally studied in two dimensional (2D) objects. However, there is little research investigating how the properties of three dimensional (3D) virtual objects interact with color and luminance to affect depth perception, despite the substantial use of 3D objects in visual applications. In this paper, we present the results of a paired comparison experiment that investigates the effects of object shape, fidelity, color, and luminance on depth perception of 3D objects in handheld mobile AR. The results of our study indicate that bright colors are perceived as nearer than dark colors for a high fidelity, simple 3D object, regardless of hue. Additionally, bright red is perceived as nearer than any other color. These effects were not observed for a low fidelity version of the simple object or for a more complex 3D object. High fidelity objects had more perceptual differences than low fidelity objects, indicating that fidelity interacts with color and luminance to affect depth perception. These findings reveal how the properties of 3D models influence the effects of color and luminance on depth perception in handheld mobile AR and can help developers select colors for their applications.


Refinements of norm and numerical radius inequalities. Several refinements of norm and numerical radius inequalities of bounded linear operators on a complex Hilbert space are given. In particular, we show that if A is a bounded linear operator on a complex Hilbert space, then frac 1 4 A A AA leq frac 1 8 bigg( A A 2 A A 2 c 2(A A ) c 2(A A ) bigg) leq w 2(A) and begin eqnarray frac 1 2 A A AA frac 1 4 bigg (A A ) 2 (A A ) 2 bigg 1 2 leq w 2(A) leq frac 1 2 A A AA , end eqnarray frac 1 4 A A AA leq frac 1 2 w 2(A) frac 1 8 bigg (A A ) 2 (A A ) 2 bigg 1 2 leq w 2(A), where . , w(.) and c(.) are the operator norm, the numerical radius and the Crawford number, respectively. Further, we prove that if A,D are bounded linear operators on a complex Hilbert space, then begin eqnarray AD leq left int 0 1 left( (1 t) left( frac A 2 D 2 2 right) t AD I right) 2dt right 1 2 leq frac 1 2 left A 2 D 2 right , end eqnarray where A (A A) 1 2 and D (D D) 1 2 . This is a refinement of well known inequality obtained by Bhatia and Kittaneh.


The first eigenvalue of a homogeneous CROSS. We provide explicit formulae for the first eigenvalue of the Laplace Beltrami operator on a compact rank one symmetric space (CROSS) endowed with any homogeneous metric. As consequences, we prove that homogeneous metrics on CROSSes are isospectral if and only if they are isometric, and also discuss their stability (or lack thereof) as solutions to the Yamabe problem.


Understanding the Schrodinger equation as a kinematic statement A probability first approach to quantum. Quantum technology is seeing a remarkable explosion in interest due to a wave of successful commercial technology. As a wider array of engineers and scientists are needed, it is time we rethink quantum educational paradigms. Current approaches often start from classical physics, linear algebra, or differential equations. This chapter advocates for beginning with probability theory. In the approach outlined in this chapter, there is less in the way of explicit axioms of quantum mechanics. Instead the historically problematic measurement axiom is inherited from probability theory where many philosophical debates remain. Although not a typical route in introductory material, this route is nonetheless a standard vantage on quantum mechanics. This chapter outlines an elementary route to arrive at the Schr "odinger equation by considering allowable transformations of quantum probability functions (density matrices). The central tenet of this chapter is that probability theory provides the best conceptual and mathematical foundations for introducing the quantum sciences.


Differential Evolution for Neural Architecture Search. Neural architecture search (NAS) methods rely on a search strategy for deciding which architectures to evaluate next and a performance estimation strategy for assessing their performance (e.g., using full evaluations, multi fidelity evaluations, or the one shot model). In this paper, we focus on the search strategy. We introduce the simple yet powerful evolutionary algorithm of differential evolution to the NAS community. Using the simplest performance evaluation strategy of full evaluations, we comprehensively compare this search strategy to regularized evolution and Bayesian optimization and demonstrate that it yields improved and more robust results for 13 tabular NAS benchmarks based on NAS Bench 101, NAS Bench 1Shot1, NAS Bench 201 and NAS HPO bench.


Representation formulae for the determinant in a neighborhood of the identity. We prove an integral representation and a power series expansion for the function det(A) 1 in a small neighborhood of the identity matrix. Both results are closely linked to the formula for the change of coordinates of the Dirac delta distribution in mathbb R m .


Angled crested like water waves with surface tension Wellposedness of the problem. We consider the capillary gravity water wave equation in two dimensions. We assume that the fluid is inviscid, incompressible, irrotational and the air density is zero. We construct an energy functional and prove a local wellposedness result without assuming the Taylor sign condition. When the surface tension sigma is zero, the energy reduces to a lower order version of the energy obtained by Kinsey and Wu 23 and allows angled crest interfaces. For positive surface tension, the energy does not allow angled crest interfaces but admits initial data with large curvature of the order of sigma frac 1 3 epsilon for any epsilon 0 .


Improving Aspect Level Sentiment Analysis with Aspect Extraction. Aspect based sentiment analysis (ABSA), a popular research area in NLP has two distinct parts aspect extraction (AE) and labeling the aspects with sentiment polarity (ALSA). Although distinct, these two tasks are highly correlated. The work primarily hypothesize that transferring knowledge from a pre trained AE model can benefit the performance of ALSA models. Based on this hypothesis, word embeddings are obtained during AE and subsequently, feed that to the ALSA model. Empirically, this work show that the added information significantly improves the performance of three different baseline ALSA models on two distinct domains. This improvement also translates well across domains between AE and ALSA tasks.


The didactic potential of virtual information educational environment as a tool of geography students training. The article clarifies the concept of "virtual information educational environment" (VIEE) and examines the researchers' views on its meaning exposed in the scientific literature. The article determines the didactic potential of the virtual information educational environment for the geography students training based on the analysis of the authors' experience of blended learning by means of the Google Classroom. It also specifies the features (immersion, interactivity, and dynamism, sense of presence, continuity, and causality). The authors highlighted the advantages of virtual information educational environment implementation, such as increase of the efficiency of the educational process by intensifying the process of cognition and interpersonal interactive communication continuous access to multimedia content both in Google Classroom and beyond saving student time due to the absence of necessity to work out the training material "manually" availability of virtual pages of the virtual class individualization of the educational process formation of informational culture of the geography students and more productive learning of the educational material at the expense of IT educational facilities. Among the disadvantages the article mentions low level of computerization, insignificant quantity and low quality of software products, underestimation of the role of VIEE in the professional training of geography students, and the lack of economic stimuli, etc.


Cognitive Radio Networks An Information Theoretic Perspective. Information theoretic limits of it cognitive radio networks have been under exploration for more than a decade. Although such limits are unknown for many networks, including the simplest case with two pairs of transmitter receiver, there are several cases for which the capacity limits are obtained either exactly or up to a constant gap. The goal of this chapter is to provide insights into the nature of transmission techniques associated with optimal communication when cognitive radio technology is used. , with an emphasis on 5G networks. Outlining the state of the art in the information theoretic analysis of different cognitive systems, we highlight the salient features points of the capacity achieving or capacity approaching strategies that should be considered in wireless network design paradigms based on this technology. In particular, we emphasize the interaction of cognitive radio with emerging technologies for 5G networks.


Detecting Automatically Managed Accounts in Online Social Networks Graph Embedding Approach. The widespread of Online Social Networks and the opportunity to commercialize popular accounts have attracted a large number of automated programs, known as artificial accounts. This paper focuses on the classification of human and fake accounts on the social network, by employing several graph neural networks, to efficiently encode attributes and network graph features of the account. Our work uses both network structure and attributes to distinguish human and artificial accounts and compares attributed and traditional graph embeddings. Separating complex, human like artificial accounts into a standalone task demonstrates significant limitations of profile based algorithms for bot detection and shows the efficiency of network structure based methods for detecting sophisticated bot accounts. Experiments show that our approach can achieve competitive performance compared with existing state of the art bot detection systems with only network driven features. The source code of this paper is available at http github.com karpovilia botdetection.


The Yamada model for a self pulsing laser bifurcation structure for non identical decay times of gain and absorber. We consider self pulsing in lasers with a gain section and an absorber section via a mechanism known as Q switching, as described mathematically by the Yamada ordinary differential equation model for the gain, the absorber and the laser intensity. More specifically, we are interested in the case that gain and absorber decay on different time scales. We present the overall bifurcation structure by showing how the two parameter bifurcation diagram in the plane of pump strength versus decay rate of the gain changes with the ratio between the two decay rates. In total, there are ten cases BI to BX of qualitatively different two parameter bifurcation diagrams, which we present with an explanation of the transitions between them. Moroever, we show for each of the associated eleven cases of structurally stable phase portraits (in open regions of the parameter space) a three dimensional representation of the organisation of phase space by the two dimensional manifolds of saddle equilibria and saddle periodic orbits. The overall bifurcation structure constitutes a comprehensive picture of the exact nature of the observable dynamics, including multi stability and excitability, which we expect to be of relevance for experimental work on Q switching lasers with different kinds of saturable absorbers.


Applying r spatiogram in object tracking for occlusion handling. Object tracking is one of the most important problems in computer vision. The aim of video tracking is to extract the trajectories of a target or object of interest, i.e. accurately locate a moving target in a video sequence and discriminate target from non targets in the feature space of the sequence. So, feature descriptors can have significant effects on such discrimination. In this paper, we use the basic idea of many trackers which consists of three main components of the reference model, i.e., object modeling, object detection and localization, and model updating. However, there are major improvements in our system. Our forth component, occlusion handling, utilizes the r spatiogram to detect the best target candidate. While spatiogram contains some moments upon the coordinates of the pixels, r spatiogram computes region based compactness on the distribution of the given feature in the image that captures richer features to represent the objects. The proposed research develops an efficient and robust way to keep tracking the object throughout video sequences in the presence of significant appearance variations and severe occlusions. The proposed method is evaluated on the Princeton RGBD tracking dataset considering sequences with different challenges and the obtained results demonstrate the effectiveness of the proposed method.


Is density functional theory accurate for lytic polysaccharide monooxygenase enzymes?. The lytic polysaccharide monooxygenase (LPMO) enzymes boost polysaccharide depolymerization through oxidative chemistry, which has fueled the hope for more energy efficient production of biofuel. We have recently proposed a mechanism for the oxidation of the polysaccharide substrate (Hedeg aa rd Ryde, Chem. Sci. 2018, 9, 3866). In this mechanism, complexes with superoxide, oxyl, as well as hydroxyl (i.e. CuO2 , CuO and CuOH 2 ) cores were involved. These complexes can have both singlet and triplet spin states, and both spin states may be important for how LPMOs function during catalytic turnover. Previous calculations on LPMOs have exclusively been based on density functional theory (DFT). However, different DFT functionals are known to display large differences for spin state splittings in transition metal complexes, and this has also been an issue for LPMOs. In this paper, we study the accuracy of DFT for spin state splittings in superoxide, oxyl, and hydroxyl intermediates involved in LPMO turnover. As reference we employ multiconfigurational perturbation theory (CASPT2).


Trend to Equilibrium for the Kinetic Fokker Planck Equation via the Neural Network Approach. The issue of the relaxation to equilibrium has been at the core of the kinetic theory of rarefied gas dynamics. In the paper, we introduce the Deep Neural Network (DNN) approximated solutions to the kinetic Fokker Planck equation in a bounded interval and study the large time asymptotic behavior of the solutions and other physically relevant macroscopic quantities. We impose the varied types of boundary conditions including the inflow type and the reflection type boundaries as well as the varied diffusion and friction coefficients and study the boundary effects on the asymptotic behaviors. These include the predictions on the large time behaviors of the pointwise values of the particle distribution and the macroscopic physical quantities including the total kinetic energy, the entropy, and the free energy. We also provide the theoretical supports for the pointwise convergence of the neural network solutions to the textit a priori analytic solutions. We use the library textit PyTorch , the activation function textit tanh between layers, and the textit Adam optimizer for the Deep Learning algorithm.


On the privacy of a code based single server computational PIR scheme. We show that the single server computational PIR protocol proposed by Holzbaur, Hollanti and Wachter Zeh in 2020 is not private, in the sense that the server can recover in polynomial time the index of the desired file with very high probability. The attack relies on the following observation. Removing rows of the query matrix corresponding to the desired file yields a large decrease of the dimension over mathbb F q of the vector space spanned by the rows of this punctured matrix. Such a dimension loss only shows up with negligible probability when rows unrelated to the requested file are deleted.


SubGraph2Vec Highly Vectorized Tree likeSubgraph Counting. Subgraph counting aims to count occurrences of a template T in a given network G(V, E). It is a powerful graph analysis tool and has found real world applications in diverse domains. Scaling subgraph counting problems is known to be memory bounded and computationally challenging with exponential complexity. Although scalable parallel algorithms are known for several graph problems such as Triangle Counting and PageRank, this is not common for counting complex subgraphs. Here we address this challenge and study connected acyclic graphs or trees. We propose a novel vectorized subgraph counting algorithm, named Subgraph2Vec, as well as both shared memory and distributed implementations 1) reducing algorithmic complexity by minimizing neighbor traversal 2) achieving a highly vectorized implementation upon linear algebra kernels to significantly improve performance and hardware utilization. 3) Subgraph2Vec improves the overall performance over the state of the art work by orders of magnitude and up to 660x on a single node. 4) Subgraph2Vec in distributed mode can scale up the template size to 20 and maintain good strong scalability. 5) enabling portability to both CPU and GPU.


An Improved Physics Based Numerical Model of Tunnel FET Using 2D NEGF Formalism. In this work, we have investigated a 2D model of band to band tunneling based on 2 band model and implemented it using 2D NEGF formalism. Being 2D in nature, this model better addresses the variation in the directionality of the tunneling process occurring in most practical TFET device structures. It also works as a compromise between semi classical and multiband quantum simulation of TFETs. In this work, we have presented a sound step by step mathematical development of the numerical model. We have also discussed how this model can be implemented in simulators and pointed out a few optimizations that can be made to reduce complexity and to save time. Finally, we have performed elaborate simulations for a practical TFET design and compared the results with commercially available TCAD simulations, to point out the limitations of the simplistic models that are frequently used, and how our model overcomes these limitations.


CARLA Real Traffic Scenarios novel training ground and benchmark for autonomous driving. This work introduces interactive traffic scenarios in the CARLA simulator, which are based on real world traffic. We concentrate on tactical tasks lasting several seconds, which are especially challenging for current control methods. The CARLA Real Traffic Scenarios (CRTS) is intended to be a training and testing ground for autonomous driving systems. To this end, we open source the code under a permissive license and present a set of baseline policies. CRTS combines the realism of traffic scenarios and the flexibility of simulation. We use it to train agents using a reinforcement learning algorithm. We show how to obtain competitive polices and evaluate experimentally how observation types and reward schemes affect the training process and the resulting agent's behavior.


Descent equalities and the inductive McKay condition for types B and E. We establish the inductive McKay condition introduced by Isaacs Malle Navarro cite IMN for finite simple groups of Lie types tB l ( l geq 2 ), tE 6 , 2 tE 6 and tE 7 , thus leaving open only the types tD and 2 tD . We bring to the methods previously used by the authors for type tC cite CS17C some descent arguments using Shintani's norm map. This provides for types different from tA, tD, 2 tD a uniform proof of the so called global requirement of the criterion given by the second author in cite 2.12 S12 . The local requirements from that criterion are verified through a detailed study of the normalizers of relevant Levi subgroups and their characters.


From constant to variable density inverse extended Born modelling. For quantitative seismic imaging, iterative least squares reverse time migration is the recommended approach. The existence of an inverse of the forward modelling operator would considerably reduce the number of required iterations. In the context of the extended model, such a pseudo inverse exists, built as a weighted version of the adjoint and accounts for the deconvolution, geometrical spreading and uneven illumination. The application of the pseudo inverse Born modelling is based on constant density acoustic media, which is a limiting factor for practical applications. To consider density perturbation, we propose and investigate two approaches. The first one is a generalization of a recent study proposing to recover acoustic perturbations from angle dependent response of the pseudo inverse Born modelling operator. The new version is based on weighted least squares objective function. The method not only provides more robust results, but also offers the flexibility to include constrains in the objective function in order to reduce the parameters cross talk. We also propose an alternative approach based on Taylor expansion that does not require any Radon transform. Numerical examples based on simple and the Marmousi2 models using correct and incorrect background models for the variable density Born modelling, verify the effectiveness of the weighted least squares method when compared with the other two approaches. The Taylor expansion approach appears to contain too many artifacts for a successful applicability.


Mechanistic Modeling of Longitudinal Shape Changes equations of motion and inverse problems. This paper examines a longitudinal shape evolution model in which a 3D volume progresses through a family of elastic equilibria in response to the time derivative of an internal force, or yank, with an additional regularization to ensure diffeomorphic transformations. We consider two different models of yank and address the long time existence and uniqueness of solutions for the equations of motion in both models. In addition, we derive sufficient conditions for the existence of an optimal yank that best describes the change from an observed initial volume to an observed volume at a later time. The main motivation for this work is the understanding of processes such as growth and atrophy in anatomical structures, where the yank could be roughly interpreted as a metabolic event triggering morphological changes. We provide preliminary results on simple examples to illustrate, under this model, the retrievability of some attributes of such events.


Nondense orbits on homogeneous spaces and applications to geometry and number theory. Let G be a Lie group, Gamma subset G a discrete subgroup, X G Gamma , and f an affine map from X to itself. We give conditions on a submanifold Z of X guaranteeing that the set of points x in X with f trajectories avoiding Z is hyperplane absolute winning (a property which implies full Hausdorff dimension and is stable under countable intersections). A similar result is proved for one parameter actions on X . This has applications to constructing exceptional geodesics on locally symmetric spaces, and to non density of the set of values of certain functions at integer points.


RfD Net Point Scene Understanding by Semantic Instance Reconstruction. Semantic scene understanding from point clouds is particularly challenging as the points reflect only a sparse set of the underlying 3D geometry. Previous works often convert point cloud into regular grids (e.g. voxels or bird eye view images), and resort to grid based convolutions for scene understanding. In this work, we introduce RfD Net that jointly detects and reconstructs dense object surfaces directly from raw point clouds. Instead of representing scenes with regular grids, our method leverages the sparsity of point cloud data and focuses on predicting shapes that are recognized with high objectness. With this design, we decouple the instance reconstruction into global object localization and local shape prediction. It not only eases the difficulty of learning 2 D manifold surfaces from sparse 3D space, the point clouds in each object proposal convey shape details that support implicit function learning to reconstruct any high resolution surfaces. Our experiments indicate that instance detection and reconstruction present complementary effects, where the shape prediction head shows consistent effects on improving object detection with modern 3D proposal network backbones. The qualitative and quantitative evaluations further demonstrate that our approach consistently outperforms the state of the arts and improves over 11 of mesh IoU in object reconstruction.


Age Delay Tradeoffs in Queueing Systems. We consider an M server system in which each server can service at most one update packet at a time. The system designer controls (1) scheduling the order in which the packets get serviced, (2) routing the server that an arriving update packet joins for service, and (3) the service time distribution with fixed service rate. Given a fixed update generation process, we prove a strong age delay and age delay variance tradeoff, wherein, as the average AoI approaches its minimum, the packet delay and its variance approach infinity. In order to prove this result, we consider two special cases of the M server system, namely, a single server system with last come first server with preemptive service and an infinite server system. In both these cases, we derive sufficient conditions to show that three heavy tailed service time distributions, namely Pareto, log normal, and Weibull, asymptotically minimize the average AoI as their tail gets heavier, and establish the age delay tradeoff results. We provide an intuitive explanation as to why such a seemingly counter intuitive age delay tradeoff is natural, and that it should exist in many systems.


Traffic Optimization for TCP based Massive Multiplayer Online Games. This paper studies the use of a traffic optimization technique named TCM (Tunneling, Compressing and Multiplexing) to reduce the bandwidth of MMORPGs (Massively Multiplayer Online Role Playing Games), which employ TCP to provide a soft real time service. In order to optimize the traffic and to improve bandwidth efficiency, TCM can be applied when the packets of a number of players share the same link, which occurs in some scenarios, as e.g. the traffic between proxies and servers of game supporting infrastructures. First, TCP IP headers are compressed using standard algorithms that avoid sending repeated fields next, a number of packets are blended into a bigger one and finally, they are sent using a tunnel. The expected compressed header size has been obtained using traffic traces of a real game. Next, simulations using a traffic model of a popular MMORPG have been performed in order to estimate the expected bandwidth savings and the reduction in packets per second. The obtained bandwidth saving is about 60 percent. Packets per second are also significantly reduced. In addition, the added delays are shown to be small enough so as not to impair layers' experienced quality.


Separating k Player from t Player One Way Communication, with Applications to Data Streams. In a k party communication problem, the k players with inputs x 1, x 2, ldots, x k , respectively, want to evaluate a function f(x 1, x 2, ldots, x k) using as little communication as possible. We consider the message passing model, in which the inputs are partitioned in an arbitrary, possibly worst case manner, among a smaller number t of players ( t k ). The t player communication cost of computing f can only be smaller than the k player communication cost, since the t players can trivially simulate the k player protocol. But how much smaller can it be? We study deterministic and randomized protocols in the one way model, and provide separations for product input distributions, which are optimal for low error probability protocols. We also provide much stronger separations when the input distribution is non product. A key application of our results is in proving lower bounds for data stream algorithms. In particular, we give an optimal Omega( epsilon 2 log(N) log log(mM)) bits of space lower bound for the fundamental problem of (1 pm epsilon) approximating the number x 0 of non zero entries of an n dimensional vector x after m integer updates each of magnitude at most M , and with success probability ge 2 3 , in a strict turnstile stream. We additionally prove the matching Omega( epsilon 2 log(N) log log(T)) space lower bound for the problem when we have access to a heavy hitters oracle with threshold T . Our results match the best known upper bounds when epsilon ge 1 operatorname polylog (mM) and when T 2 operatorname poly (1 epsilon) respectively. It also improves on the prior Omega( epsilon 2 log(mM) ) lower bound and separates the complexity of approximating L 0 from approximating the p norm L p for p bounded away from 0 , since the latter has an O( epsilon 2 log (mM)) bit upper bound.


The Angel is in the Priors Improving GAN based Image and Sequence Inpainting with Better Noise and Structural Priors. Contemporary deep learning based inpainting algorithms are mainly based on a hybrid dual stage training policy of supervised reconstruction loss followed by an unsupervised adversarial critic loss. However, there is a dearth of literature for a fully unsupervised GAN based inpainting framework. The primary aversion towards the latter genre is due to its prohibitively slow iterative optimization requirement during inference to find a matching noise prior for a masked image. In this paper, we show that priors matter in GAN we learn a data driven parametric network to predict a matching prior for a given image. This converts an iterative paradigm to a single feed forward inference pipeline with a massive 1500X speedup and simultaneous improvement in reconstruction quality. We show that an additional structural prior imposed on GAN model results in higher fidelity outputs. To extend our model for sequence inpainting, we propose a recurrent net based grouped noise prior learning. To our knowledge, this is the first demonstration of an unsupervised GAN based sequence inpainting. A further improvement in sequence inpainting is achieved with an additional subsequence consistency loss. These contributions improve the spatio temporal characteristics of reconstructed sequences. Extensive experiments conducted on SVHN, Standford Cars, CelebA and CelebA HQ image datasets, synthetic sequences and ViDTIMIT video datasets reveal that we consistently improve upon previous unsupervised baseline and also achieve comparable performances(sometimes also better) to hybrid benchmarks.


Moderate deviation and exit time estimates for stationary Last Passage Percolation. We consider planar stationary exponential Last Passage Percolation in the positive quadrant with boundary weights. For rho in (0,1) and points v N ((1 rho) 2 N, rho 2 N) going to infinity along the characteristic direction, we establish right tail estimates with the optimal exponent for the exit time of the geodesic, along with optimal exponent estimates for the upper tail moderate deviations for the passage time. For the case rho frac 1 2 in the stationary model, we establish the lower bound estimate with the optimal exponent for the lower tail of the passage time. Our arguments are based on moderate deviation estimates for point to point and point to line exponential Last Passage Percolation which are obtained via random matrix estimates.


Switching Identities by Probabilistic Means. Switching identities have a long history in potential theory and stochastic analysis. In recent work of Cox and Wang, a switching identity was used to connect an optimal stopping problem and the Skorokhod embedding problem (SEP). Typically switching identies of this form are derived using deep analytic connections. In this paper, we prove the switching identities using a simple probabilistic argument, which furthermore highlights a previously unexplored symmetry between the Root and Rost solutions to the SEP.


Low Mach number limit of full compressible Navier Stokes equations with revised Maxwell law. In this paper, we study the low Mach number limit of the full compressible Navier Stokes equations with revised Maxwell law. By applying the uniform estimation of the error system, we prove that the solutions of the full compressible Navier Stokes equations with time relaxation converge to that of the incompressible Navier Stokes equations as the Mach number tends to zero. Moreover, the convergence rates are also obtained.


A Simple Derivation of AMP and its State Evolution via First Order Cancellation. We consider the linear regression problem, where the goal is to recover the vector boldsymbol x in mathbb R n from measurements boldsymbol y boldsymbol A boldsymbol x boldsymbol w in mathbb R m under known matrix boldsymbol A and unknown noise boldsymbol w . For large i.i.d. sub Gaussian boldsymbol A , the approximate message passing (AMP) algorithm is precisely analyzable through a state evolution (SE) formalism, which furthermore shows that AMP is Bayes optimal in certain regimes. The rigorous SE proof, however, is long and complicated. And, although the AMP algorithm can be derived as an approximation of loop belief propagation (LBP), this viewpoint provides little insight into why large i.i.d. boldsymbol A matrices are important for AMP, and why AMP has a state evolution. In this work, we provide a heuristic derivation of AMP and its state evolution, based on the idea of "first order cancellation," that provides insights missing from the LBP derivation while being much shorter than the rigorous SE proof.


Structure of elementary operators defining m left invertible, m selfadjoint and related classes of operators. We use elementary algebraic properties of left, right multiplication operators to prove some deep structural properties of left m invertible, m isometric, m selfadjoint and other related classes of Banach space operators, often adding value to extant results.


Generating unseen complex scenes are we there yet?. Although recent complex scene conditional generation models generate increasingly appealing scenes, it is very hard to assess which models perform better and why. This is often due to models being trained to fit different data splits, and defining their own experimental setups. In this paper, we propose a methodology to compare complex scene conditional generation models, and provide an in depth analysis that assesses the ability of each model to (1) fit the training distribution and hence perform well on seen conditionings, (2) to generalize to unseen conditionings composed of seen object combinations, and (3) generalize to unseen conditionings composed of unseen object combinations. As a result, we observe that recent methods are able to generate recognizable scenes given seen conditionings, and exploit compositionality to generalize to unseen conditionings with seen object combinations. However, all methods suffer from noticeable image quality degradation when asked to generate images from conditionings composed of unseen object combinations. Moreover, through our analysis, we identify the advantages of different pipeline components, and find that (1) encouraging compositionality through instance wise spatial conditioning normalizations increases robustness to both types of unseen conditionings, (2) using semantically aware losses such as the scene graph perceptual similarity helps improve some dimensions of the generation process, and (3) enhancing the quality of generated masks and the quality of the individual objects are crucial steps to improve robustness to both types of unseen conditionings.


Towards Efficient Processing and Learning with Spikes New Approaches for Multi Spike Learning. Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remains as a challenging problem. In this paper, we make our contributions towards this direction. A simplified spiking neuron model is firstly introduced with effects of both synaptic input and firing output on membrane potential being modeled with an impulse function. An event driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multi spike learning rules which demonstrate better performance over other baselines on various tasks including association, classification, feature detection. In addition to efficiency, our learning rules demonstrate a high robustness against strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably single neuron is capable of solving multi category classifications with our learning rules. In the feature detection task, we re examine the ability of unsupervised STDP with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules can not only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.


Periodic particle arrangements using standing acoustic waves. We determine crystal like materials that can be fabricated by using a standing acoustic wave to arrange small particles in a non viscous liquid resin, which is cured afterwards to keep the particles in the desired locations. For identical spherical particles with the same physical properties and small compared to the wavelength, the locations where the particles are trapped correspond to the minima of an acoustic radiation potential which describes the net forces that a particle is subject to. We show that the global minima of spatially periodic acoustic radiation potentials can be predicted by the eigenspace of a small real symmetric matrix corresponding to its smallest eigenvalue. We relate symmetries of this eigenspace to particle arrangements composed of points, lines or planes. Since waves are used to generate the particle arrangements, the arrangement's periodicity is limited to certain Bravais lattice classes that we enumerate in two and three dimensions.


Deep Learning Towards Edge Computing Neural Networks Straight from Compressed Data. Due to the popularization and grow in computational power of mobile phones, as well as advances in artificial intelligence, many intelligent applications have been developed, meaningfully enriching people's life. For this reason, there is a growing interest in the area of edge intelligence, that aims to push the computation of data to the edges of the network, in order to make those applications more efficient and secure. Many intelligent applications rely on deep learning models, like convolutional neural networks (CNNs). Over the past decade, they have achieved state of the art performance in many computer vision tasks. To increase the performance of these methods, the trend has been to use increasingly deeper architectures and with more parameters, leading to a high computational cost. Indeed, this is one of the main problems faced by deep architectures, limiting their applicability in domains with limited computational resources, like edge devices. To alleviate the computational complexity, we propose a deep neural network capable of learning straight from the relevant information pertaining to visual content readily available in the compressed representation used for image and video storage and transmission. The novelty of our approach is that it was designed to operate directly on frequency domain data, learning with DCT coefficients rather than RGB pixels. This enables to save high computational load in full decoding the data stream and therefore greatly speed up the processing time, which has become a big bottleneck of deep learning. We evaluated our network on two challenging tasks (1) image classification on the ImageNet dataset and (2) video classification on the UCF 101 and HMDB 51 datasets. Our results demonstrate comparable effectiveness to the state of the art methods in terms of accuracy, with the advantage of being more computationally efficient.


Study of silicon sensors for precise timing measurement. Silicon sensors with high time resolution can help particle identification in the International Linear Collider (ILC). We are studying Low Gain Avalanche Diodes (LGADs) as a high timing resolution sensor. As a step to develop LGADs, we are now focusing to characterize Avalanche Photo Diode (APD)s, because the APDs has the same multiplication structure as LGADs. We studied the characteristics of APDs with particles from radioisotopes.


Communication complexity of Nash equilibrium in potential games. We prove communication complexity lower bounds for (possibly mixed) Nash equilibrium in potential games. In particular, we show that finding a Nash equilibrium requires poly(N) communication in two player N times N potential games, and 2 poly(n) communication in n player two action games. To the best of our knowledge, these are the first results to demonstrate hardness in any model of (possibly mixed) Nash equilibrium in potential games.


Solving Financial Regulatory Compliance Using Software Contracts. Ensuring compliance with various laws and regulations is of utmost priority for financial institutions. Traditional methods in this area have been shown to be inefficient. Manual processing does not scale well. Automated efforts are hindered due to the lack of formalization of domain knowledge and problems of integrating such knowledge into software systems. In this work we propose an approach to tackle these issues by encoding them into software contracts using a Controlled Natural Language. In particular, we encode a portion of the Money Market Statistical Reporting (MMSR) regulations into contracts specified by the clojure.spec framework. We show how various features of a contract framework, in particular clojure.spec, can help to tackle issues that occur when dealing with compliance validation with explanations and test data generation. We benchmark our proposed solution and show that this approach can effectively solve compliance issues in this particular use case.


Effects of alpha proton differential flow on proton temperature anisotropy instabilities in the solar wind Wind observations. Plasma kinetic waves and alpha proton differential flow are two important subjects on the topic of evolution of the solar wind. Based on the Wind data during 2005 2015, this paper reports that the occurrence of electromagnetic cyclotron waves (ECWs) near the proton cyclotron frequency significantly depends on the direction of alpha proton differential flow Vd. As Vd rotates from anti Sunward direction to Sunward direction, the occurrence rate of ECWs as well as the percentage of left handed (LH) polarized ECWs decreases considerably. In particular, it is shown that the dominant polarization changes from LH polarization to right handed polarization during the rotation. The investigation on proton and alpha particle parameters ordered by the direction of Vd further illustrates that large kinetic energies of alpha proton differential flow correspond to high occurrence rates of ECWs. These results are well consistent with theoretical predictions for effects of alpha proton differential flow on proton temperature anisotropy instabilities.


Variational Representations related to Quantum R ' e nyi Relative Entropies. In this paper, we focus on variational representations of some matrix symmetric norm functions that are related to the quantum R ' e nyi relative entropy. Concretely, we obtain variational representations of the function (A,B) mapsto normmm (B q 2 K A pKB q 2 ) s for symmetric norms by using the H " o lder inequality and Young inequality. These variational expressions enable us to make the proofs of the convexity concavity of the trace function (A,B) mapsto tr (B q 2 K A pKB q 2 ) s more clear.


It's Not Whom You Know, It's What You (or Your Friends) Can Do Succint Coalitional Frameworks for Network Centralities. We investigate the representation of measures of network centrality using a framework that blends a social network representation with the succint formalism of cooperative skill games. We discuss the expressiveness of the new framework and highlight some of its advantages, including a fixed parameter tractability result for computing centrality measures under such representations. As an application we introduce new network centrality measures that capture the extent to which neighbors of a certain node can help it complete relevant tasks.


Set theoretic solutions of the Yang Baxter equation, associated quadratic algebras and the minimality condition. Given a finite non degenerate set theoretic solution (X,r) of the Yang Baxter equation and a field K , the structure K algebra of (X,r) is A A(K,X,r) K langle X mid xy uv mbox whenever r(x,y) (u,v) rangle . Note that A oplus n geq 0 A n is a graded algebra, where A n is the linear span of all the elements x 1 cdots x n , for x 1, dots ,x n in X . One of the known results asserts that the maximal possible value of dim (A 2) corresponds to involutive solutions and implies several deep and important properties of A(K,X,r) . Following recent ideas of Gateva Ivanova cite GI2018 , we focus on the minimal possible values of the dimension of A 2 . We determine lower bounds and completely classify solutions (X,r) for which these bounds are attained in the general case and also in the square free case. This is done in terms of the so called derived solution, introduced by Soloviev and closely related with racks and quandles. Several problems posed in cite GI2018 are solved.


Smart cathodic protection system for real time quantitative assessment of corrosion of sacrificial anode based on Electro Mechanical Impedance (EMI). Corrosion of metal structures is often prevented using cathodic protection systems, that employ sacrificial anodes that corrode more preferentially relative to the metal to be protected. In situ monitoring of these sacrificial anodes during early stages of their useful life could offer several insights into deterioration of the material surrounding the infrastructure as well as serve as early warning indicator for preventive maintenance of critical infrastructure. In this paper, we present an Electro Mechanical Impedance (EMI) measurement based technique to quantify extent of corrosion of a zinc sacrificial anode without manual intervention. The detection apparatus consists of a lead zirconate titanate (PZT) transducer affixed onto a circular zinc disc, with waterproofing epoxy protecting the transducer element when the assembly is submerged in liquid electrolyte (salt solution) for accelerated corrosion by means of impressed current. We develop an analytical model for discerning the extent of corrosion by monitoring shift in resonance frequency for in plane radial expansion mode of the disc, that also accurately models the nonlinearity introduced by partial delamination of the corrosion product (zinc oxide) from the disc. The analytical model thus developed shows excellent agreement with Finite Element Analysis (FEA) and experimental results. Our work establishes the efficacy of the proposed technique for monitoring the state of health of sacrificial anodes in their early stage of deterioration and could thus be widely adopted for structural health monitoring applications within the internet of things.


A Convex Geometric Approach to Ensemble Control Analysis and Design in a Hilbert Space. In this paper, we tackle the long standing challenges of ensemble control analysis and design using a convex geometric approach in a Hilbert space setting. Specifically, we formulate the control of linear ensemble systems as a convex feasibility problem in a Hilbert space, which can be solved by iterative weighted projections. Such a non trivial geometric interpretation not only enables a systematic design principle for constructing feasible, optimal, and constrained ensemble control signals, but also makes it possible for numerical examination of ensemble reachability and controllability. Furthermore, we incorporate this geometric approach into an iterative framework and illustrate its capability to derive feasible controls for steering bilinear ensemble systems. We conduct various numerical experiments on the control of linear and bilinear ensembles to validate the theoretical developments and demonstrate the applicability of the proposed convex geometric approach.


Lecture Note on LCSSX's Lower Bounds for Non Adaptive Distribution free Property Testing. In this lecture note we give Liu Chen Servedio Sheng Xie's (LCSSX) lower bound for property testing in the non adaptive distribution free.


Weak stuffle algebras. Motivated by q shuffle products determined by Singer from q analogues of multiple zeta values, we build in this article a generalisation of the shuffle and stuffle products in terms of weak shuffle and stuffle products. Then, we characterise weak shuffle products and give as examples the case of an alphabet of cardinality two or three. We focus on a comparison between algebraic structures respected in the classical case and in the weak case. As in the classical case, each weak shuffle product can be equipped with a dendriform structure. However, they have another behaviour towards the quadri algebra and the Hopf algebra structure. We give some relations satisfied by weak stuffle products.


LBfoam An open source software package for the simulation of foaming using the Lattice Boltzmann Method. This paper presents a 2D 3D Free Surface Lattice Boltzmann Method simulation package called LBfoam for the simulation of foaming processes. The model incorporates the essential physics of foaming phenomena gas diffusion into nucleated bubbles, bubble dynamics and coalescence, surface tension, the stabilizing disjoining pressure between bubbles, and Newtonian and non Newtonian rheological models. The software can simulate the growth and interaction of bubbles, and predict final foam structures. The implementation is based on the Palabos library (in C ), which enables large scale parallel simulations. The software is freely available under the GNU Affero General Public License version 3 at https github.com mehdiataei LBfoam


Encoder Decoder Models Can Benefit from Pre trained Masked Language Models in Grammatical Error Correction. This paper investigates how to effectively incorporate a pre trained masked language model (MLM), such as BERT, into an encoder decoder (EncDec) model for grammatical error correction (GEC). The answer to this question is not as straightforward as one might expect because the previous common methods for incorporating a MLM into an EncDec model have potential drawbacks when applied to GEC. For example, the distribution of the inputs to a GEC model can be considerably different (erroneous, clumsy, etc.) from that of the corpora used for pre training MLMs however, this issue is not addressed in the previous methods. Our experiments show that our proposed method, where we first fine tune a MLM with a given GEC corpus and then use the output of the fine tuned MLM as additional features in the GEC model, maximizes the benefit of the MLM. The best performing model achieves state of the art performances on the BEA 2019 and CoNLL 2014 benchmarks. Our code is publicly available at https github.com kanekomasahiro bert gec.


Regular graphs with linearly many triangles. A d regular graph on n nodes has at most T max frac n 3 tbinom d 2 triangles. We compute the leading asymptotics of the probability that a large random d regular graph has at least c cdot T max triangles, and provide a strong structural description of such graphs. When d is fixed, we show that such graphs typically consist of many disjoint d 1 cliques and an almost triangle free part. When d is allowed to grow with n , we show that such graphs typically consist of d o(d) sized almost cliques together with an almost triangle free part. This confirms a conjecture of Collet and Eckmann from 2002 and considerably strengthens their observation that the triangles cannot be totally scattered in typical instances of regular graphs with many triangles.


Data aided Sensing for Distributed Detection. In this paper, we study data aided sensing (DAS) for distributed detection in wireless sensor networks (WSNs) when sensors' measurements are correlated. In particular, we derive a node selection criterion based on the J divergence in DAS for reliable decision subject to a decision delay constraint. Based on the proposed J divergence based DAS, the nodes can be selected to rapidly increase the log likelihood ratio (LLR), which leads to a reliable decision with a smaller number of the sensors that upload measurements for a shorter decision delay. From simulation results, it is confirmed that the J divergence based DAS can provide a reliable decision with a smaller number of sensors compared to other approaches.


Non Linearity Measure for POMDP based Motion Planning. Motion planning under uncertainty is essential for reliable robot operation. Despite substantial advances over the past decade, the problem remains difficult for systems with complex dynamics. Most state of the art methods perform search that relies on a large number of forward simulations. For systems with complex dynamics, this generally require costly numerical integrations which significantly slows down the planning process. Linearization based methods have been proposed that can alleviate the above problem. However, it is not clear how linearization affects the quality of the generated motion strategy, and when such simplifications are admissible. We propose a non linearity measure, called Statistical distance based Non linearity Measure (SNM), that can identify where linearization is beneficial and where it should be avoided. We show that when the problem is framed as the Partially Observable Markov Decision Process, the value difference between the optimal strategy for the original model and the linearized model can be upper bounded by a function linear in SNM. Comparisons with an existing measure on various scenarios indicate that SNM is more suitable in estimating the effectiveness of linearization based solvers. To test the applicability of SNM in motion planning, we propose a simple on line planner that uses SNM as a heuristic to switch between a general and a linearization based solver. Results on a car like robot with second order dynamics and 4 DOFs and 7 DOFs torque controlled manipulators indicate that SNM can appropriately decide if and when a linearization based solver should be used.


Offline handwritten mathematical symbol recognition utilising deep learning. This paper describes an approach for offline recognition of handwritten mathematical symbols. The process of symbol recognition in this paper includes symbol segmentation and accurate classification for over 300 classes. Many multidimensional mathematical symbols need both horizontal and vertical projection to be segmented. However, some symbols do not permit to be projected and stop segmentation, such as the root symbol. Besides, many mathematical symbols are structurally similar, specifically in handwritten such as 0 and null. There are more than 300 Mathematical symbols. Therefore, designing an accurate classifier for more than 300 classes is required. This paper initially addresses the issue regarding segmentation using Simple Linear Iterative Clustering (SLIC). Experimental results indicate that the accuracy of the designed kNN classifier is 84 for salient, 57 Histogram of Oriented Gradient (HOG), 53 for Linear Binary Pattern (LBP) and finally 43 for pixel intensity of raw image for 66 classes. 87 classes using modified LeNet represents 90 accuracy. Finally, for 101 classes, SqueezeNet ac


On some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton Jacobi partial differential equations. We propose novel connections between several neural network architectures and viscosity solutions of some Hamilton Jacobi (HJ) partial differential equations (PDEs) whose Hamiltonian is convex and only depends on the spatial gradient of the solution. To be specific, we prove that under certain assumptions, the two neural network architectures we proposed represent viscosity solutions to two sets of HJ PDEs with zero error. We also implement our proposed neural network architectures using Tensorflow and provide several examples and illustrations. Note that these neural network representations can avoid curve of dimensionality for certain HJ PDEs, since they do not involve neither grids nor discretization. Our results suggest that efficient dedicated hardware implementation for neural networks can be leveraged to evaluate viscosity solutions of certain HJ PDEs.


Covers of generalized quadrangles, 2. Kantor Knuth covers and embedded ovoids. In this paper, which is a sequel to cite part1 , we proceed with our study of covers and decomposition laws for geometries related to generalized quadrangles. In particular, we obtain a higher decomposition law for all Kantor Knuth generalized quadrangles which generalizes one of the main results in cite part1 . In a second part of the paper, we study the set of all Kantor Knuth ovoids (with given parameter) in a fixed finite parabolic quadrangle, and relate this set to embeddings of parabolic quadrangles into Kantor Knuth quadrangles. This point of view gives rise to an answer of a question posed in cite JATSEP .


Programming Technologies for the Development of Web Based Platform for Digital Psychological Tools. The choice of the tools and programming technologies for information systems creation is relevant. For every projected system, it is necessary to define a number of criteria for development environment, used libraries and technologies. The paper describes the choice of technological solutions using the example of the developed web based platform of the Russian Academy of Education. This platform is used to provide information support for the activities of psychologists in their research (including population and longitudinal researches). There are following system features large scale and significant amount of developing time that needs implementation and ensuring the guaranteed computing reliability of a wide range of digital tools used in psychological research ensuring functioning in different environments when conducting mass research in schools that have different characteristics of computing resources and communication channels possibility of services scaling security and privacy of data use of technologies and programming tools that would ensure the compatibility and conversion of data with other tools of psychological research processing. Some criteria were introduced for the developed system. These criteria take into account the feature of the functioning and life cycle of the software. A specific example shows the selection of appropriate technological solutions.


An Improved Convolutional Neural Network System for Automatically Detecting Rebar in GPR Data. As a mature technology, Ground Penetration Radar (GPR) is now widely employed in detecting rebar and other embedded elements in concrete structures. Manually recognizing rebar from GPR data is a time consuming and error prone procedure. Although there are several approaches to automatically detect rebar, it is still challenging to find a high resolution and efficient method for different rebar arrangements, especially for closely spaced rebar meshes. As an improved Convolution Neural Network (CNN), AlexNet shows superiority over traditional methods in image recognition domain. Thus, this paper introduces AlexNet as an alternative solution for automatically detecting rebar within GPR data. In order to show the efficiency of the proposed approach, a traditional CNN is built as the comparative option. Moreover, this research evaluates the impacts of different rebar arrangements and different window sizes on the accuracy of results. The results revealed that (1) AlexNet outperforms the traditional CNN approach, and its superiority is more notable when the rebar meshes are densely distributed (2) the detection accuracy significantly varies with changing the size of splitting window, and a proper window should contain enough information about rebar (3) uniformly and sparsely distributed rebar meshes are more recognizable than densely or unevenly distributed items, due to lower chances of signal interferences.


Doodles and commutator identities. A doodle is a collection of immersed circles without triple intersections in the 2 sphere. It was shown by the second author and P. Tayler that doodles induce commutator identities (identities amongst commutators) in a free group. In this paper we observe this idea more closely by concentrating on doodles with proper noose systems and elementary commutator identities. In particular we show that there is a bijection between cobordism classes of colored doodles and weak equivalence classes of elementary commutator identities.


A Very High Velocity Acoustic Wave on a LiNbO 3 Sapphire Substrate for Use in Sub 6 GHz Devices. This letter presents a numerical investigation of acoustic modes propagating in an LiNbO 3 sapphire substrate under a periodic Al grating, demonstrating the occurrence of longitudinal leaky SAWs (LLSAWs) with a unique combination of very high velocities exceeding 10 000 m s, an electromechanical coupling coefficients of 4.5 , and negligible leakage into the substrate. The leakage was suppressed by optimizing the LiNbO 3 (LN) plate and Al electrode thickness. Compared with conventional SAW substrates, the LN sapphire substrate offers 2 to 2.5 fold higher frequencies for periodic electrode structures and enables the production of 6 GHz devices by standard photolithographic processes. Moreover, the required LN plate and Al electrode thicknesses remain compatible with existing wafer bonding technologies. An analysis of LLSAW dispersion in a resonator reveals that the wave behaves as a perfect Rayleigh SAW unperturbed by interactions with spurious modes. The found optimal LN sapphire substrates are perfect candidates for high performance SAW devices operating in the sub 6 GHz spectrum.


On measure preserving rank one transformations. Rank one transformations serve as a source of examples in ergodic theory, showing variety of algebraic, asymptotic and spectral properties of dynamical systems. The properties of a rank one transformation are closely related to the weak closure of its action. In this direction, known and new constructions of transformations and related problems are studied.


Let's Make It Personal, A Challenge in Personalizing Medical Inter Human Communication. Current AI approaches have frequently been used to help personalize many aspects of medical experiences and tailor them to a specific individuals' needs. However, while such systems consider medically relevant information, they ignore socially relevant information about how this diagnosis should be communicated and discussed with the patient. The lack of this capability may lead to mis communication, resulting in serious implications, such as patients opting out of the best treatment. Consider a case in which the same treatment is proposed to two different individuals. The manner in which this treatment is mediated to each should be different, depending on the individual patient's history, knowledge, and mental state. While it is clear that this communication should be conveyed via a human medical expert and not a software based system, humans are not always capable of considering all of the relevant aspects and traversing all available information. We pose the challenge of creating Intelligent Agents (IAs) to assist medical service providers (MSPs) and consumers in establishing a more personalized human to human dialogue. Personalizing conversations will enable patients and MSPs to reach a solution that is best for their particular situation, such that a relation of trust can be built and commitment to the outcome of the interaction is assured. We propose a four part conceptual framework for personalized social interactions, expand on which techniques are available within current AI research and discuss what has yet to be achieved.


A note on dense bipartite induced subgraphs. This exposition contains a short and streamlined proof of the recent result of Kwan, Letzter, Sudakov and Tran that every triangle free graph with minimum degree d contains an induced bipartite subgraph with average degree Omega( ln d ln ln d) .


Computational Aspects of Geometric Algebra Products of Two Homogeneous Multivectors. Studies on time and memory costs of products in geometric algebra have been limited to cases where multivectors with multiple grades have only non zero elements. This allows to design efficient algorithms for a generic purpose however, it does not reflect the practical usage of geometric algebra. Indeed, in applications related to geometry, multivectors are likely to be full homogeneous, having their non zero elements over a single grade. In this paper, we provide a complete computational study on geometric algebra products of two full homogeneous multivectors, that is, the outer, inner, and geometric products of two full homogeneous multivectors. We show tight bounds on the number of the arithmetic operations required for these products. We also show that algorithms exist that achieve this number of arithmetic operations.


LSTM LM with Long Term History for First Pass Decoding in Conversational Speech Recognition. LSTM language models (LSTM LMs) have been proven to be powerful and yielded significant performance improvements over count based n gram LMs in modern speech recognition systems. Due to its infinite history states and computational load, most previous studies focus on applying LSTM LMs in the second pass for rescoring purpose. Recent work shows that it is feasible and computationally affordable to adopt the LSTM LMs in the first pass decoding within a dynamic (or tree based) decoder framework. In this work, the LSTM LM is composed with a WFST decoder on the fly for the first pass decoding. Furthermore, motivated by the long term history nature of LSTM LMs, the use of context beyond the current utterance is explored for the first pass decoding in conversational speech recognition. The context information is captured by the hidden states of LSTM LMs across utterance and can be used to guide the first pass search effectively. The experimental results in our internal meeting transcription system show that significant performance improvements can be obtained by incorporating the contextual information with LSTM LMs in the first pass decoding, compared to applying the contextual information in the second pass rescoring.


Poisson Structures on Moduli Spaces of Higgs Bundles over Stacky Curves. We demonstrate the construction of Poisson structures via Lie algebroids on moduli spaces of stable Higgs bundles over stacky curves. Considering specific cases of such Deligne Mumford stacks, as well as of twistings, provides various important examples of moduli spaces that can be equipped with a Poisson structure. Special attention is given to moduli spaces of parabolic Higgs bundles and of Higgs bundles over root stacks.


Deep Learning Based Chatbot Models. A conversational agent (chatbot) is a piece of software that is able to communicate with humans using natural language. Modeling conversation is an important task in natural language processing and artificial intelligence. While chatbots can be used for various tasks, in general they have to understand users' utterances and provide responses that are relevant to the problem at hand. In my work, I conduct an in depth survey of recent literature, examining over 70 publications related to chatbots published in the last 3 years. Then, I proceed to make the argument that the very nature of the general conversation domain demands approaches that are different from current state of of the art architectures. Based on several examples from the literature I show why current chatbot models fail to take into account enough priors when generating responses and how this affects the quality of the conversation. In the case of chatbots, these priors can be outside sources of information that the conversation is conditioned on like the persona or mood of the conversers. In addition to presenting the reasons behind this problem, I propose several ideas on how it could be remedied. The next section focuses on adapting the very recent Transformer model to the chatbot domain, which is currently state of the art in neural machine translation. I first present experiments with the vanilla model, using conversations extracted from the Cornell Movie Dialog Corpus. Secondly, I augment the model with some of my ideas regarding the issues of encoder decoder architectures. More specifically, I feed additional features into the model like mood or persona together with the raw conversation data. Finally, I conduct a detailed analysis of how the vanilla model performs on conversational data by comparing it to previous chatbot models and how the additional features affect the quality of the generated responses.


Massive Access for Future Wireless Communication Systems. Multiple access technology played an important role in wireless communication in the last decades it increases the capacity of the channel and allows different users to access the system simultaneously. However, the conventional multiple access technology, as originally designed for current human centric wireless networks, is not scalable for future machine centric wireless networks. Massive access (studied in the literature under such names as massive device multiple access, unsourced massive random access, massive connectivity, massive machine type communication, and many access channels) exhibits a clean break with current networks by potentially supporting millions of devices in each cellular network. The tremendous growth in the number of connected devices requires a fundamental rethinking of the conventional multiple access technologies in favor of new schemes suited for massive random access. Among the many new challenges arising in this setting, the most relevant are the fundamental limits of communication from a massive number of bursty devices transmitting simultaneously with short packets, the design of low complexity and energy efficient massive access coding and communication schemes, efficient methods for the detection of a relatively small number of active users among a large number of potential user devices with sporadic transmission pattern, and the integration of massive access with massive MIMO and other important wireless communication technologies. This paper presents an overview of the concept of massive access wireless communication and of the contemporary research on this important topic.


physics.app-ph physics.bio-ph physics.chem-ph physics.flu-dyn

Modulation of heterogeneous surface charge and flow pattern in electrically gated converging diverging nanochannel. The present study aims at utilizing field effect phenomenon to induce heterogeneous surface charge and consequently changing the fluid flow in a solid state nanochannel with converging diverging periodicity. It is shown that the proposed geometry causes non uniform radial field adjacent to channel walls which is stronger around the diverging section and weaker next to the converging part of the wall. The later generates heterogeneous surface charge at channel walls depending on the applied gate potential i.e. applying low gate potential enables effective modulation of surface charge with the same polarity of the intrinsic charge at channel walls, while moderate gate potential causes charge inversion in diverging sections of the channel and generates reverse flow and thus results in fluid flow circulation. The potential application of flow circulation for trapping and rejection of particles is also demonstrated.


On a counting theorem for weakly admissible lattices. We give a precise estimate for the number of lattice points in certain bounded subsets of mathbb R n that involve hyperbolic spikes' and occur naturally in multiplicative Diophantine approximation. We use Wilkie's o minimal structure mathbb R exp and expansions thereof to formulate our counting result in a general setting. We give two different applications of our counting result. The first one establishes nearly sharp upper bounds for sums of reciprocals of fractional parts, and thereby sheds light on a question raised by L e and Vaaler, extending previous work of Widmer and of the author. The second application establishes new examples of linear subspaces of Khintchine type thereby refining a theorem by Huang and Liu. For the proof of our counting result we develop a sophisticated partition method which is crucial for further upcoming work on sums of reciprocals of fractional parts over distorted boxes.


4D Spatio Temporal ConvNets Minkowski Convolutional Neural Networks. In many robotics and VR AR applications, 3D videos are readily available sources of input (a continuous sequence of depth images, or LIDAR scans). However, those 3D videos are processed frame by frame either through 2D convnets or 3D perception algorithms. In this work, we propose 4 dimensional convolutional neural networks for spatio temporal perception that can directly process such 3D videos using high dimensional convolutions. For this, we adopt sparse tensors and propose the generalized sparse convolution that encompasses all discrete convolutions. To implement the generalized sparse convolution, we create an open source auto differentiation library for sparse tensors that provides extensive functions for high dimensional convolutional neural networks. We create 4D spatio temporal convolutional neural networks using the library and validate them on various 3D semantic segmentation benchmarks and proposed 4D datasets for 3D video perception. To overcome challenges in the 4D space, we propose the hybrid kernel, a special case of the generalized sparse convolution, and the trilateral stationary conditional random field that enforces spatio temporal consistency in the 7D space time chroma space. Experimentally, we show that convolutional neural networks with only generalized 3D sparse convolutions can outperform 2D or 2D 3D hybrid methods by a large margin. Also, we show that on 3D videos, 4D spatio temporal convolutional neural networks are robust to noise, outperform 3D convolutional neural networks and are faster than the 3D counterpart in some cases.


Future Climate Change Projections over the Indian Region. Assessments of impacts of climate change and future projections over the Indian region, have so far relied on a single regional climate model (RCM) eg., the PRECIS RCM of the Hadley Centre, UK. While these assessments have provided inputs to various reports (e.g., INCCA 2010 NATCOMM2 2012), it is important to have an ensemble of climate projections drawn from multiple RCMs due to large uncertainties in regional scale climate projections. Ensembles of multi RCM projections driven under different perceivable socio economic scenarios are required to capture the probable path of growth, and provide the behavior of future climate and impacts on various biophysical systems and economic sectors dependent on such systems. The Centre for Climate Change Research, Indian Institute of Tropical Meteorology (CCCR IITM) has generated an ensemble of high resolution downscaled projections of regional climate and monsoon over South Asia until 2100 for the Intergovernmental Panel for Climate Change (IPCC)using a RCM (ICTP RegCM4) at 50 km horizontal resolution, by driving the regional model with lateral and lower boundary conditions from multiple global atmosphere ocean coupled models from the Coupled Model Intercomparison Project Phase 5 (CMIP5). The future projections are based on three Representation Concentration Pathway (RCP) scenarios (viz., RCP2.6, RCP4.5, RCP8.5) of the IPCC.


UniformAugment A Search free Probabilistic Data Augmentation Approach. Augmenting training datasets has been shown to improve the learning effectiveness for several computer vision tasks. A good augmentation produces an augmented dataset that adds variability while retaining the statistical properties of the original dataset. Some techniques, such as AutoAugment and Fast AutoAugment, have introduced a search phase to find a set of suitable augmentation policies for a given model and dataset. This comes at the cost of great computational overhead, adding up to several thousand GPU hours. More recently RandAugment was proposed to substantially speedup the search phase by approximating the search space by a couple of hyperparameters, but still incurring non negligible cost for tuning those. In this paper we show that, under the assumption that the augmentation space is approximately distribution invariant, a uniform sampling over the continuous space of augmentation transformations is sufficient to train highly effective models. Based on that result we propose UniformAugment, an automated data augmentation approach that completely avoids a search phase. In addition to discussing the theoretical underpinning supporting our approach, we also use the standard datasets, as well as established models for image classification, to show that UniformAugment's effectiveness is comparable to the aforementioned methods, while still being highly efficient by virtue of not requiring any search.


A Language for Autonomous Vehicles Testing Oracles. Testing autonomous vehicles (AVs) requires complex oracles to determine if the AVs behavior conforms with specifications and humans' expectations. Available open source oracles are tightly embedded in the AV simulation software and are developed and implemented in an ad hoc way. We propose a domain specific language that enables defining oracles independent of the AV solutions and the simulator. A testing analyst can encode safety, liveness, timeliness and temporal properties in our language. To show the expressiveness of our language we implement three different types of available oracles. We find that the same AV solutions may be ranked significantly differently across existing oracles, thus existing oracles do not evaluate AVs in a consistent manner.


Sharp lower error bounds for strong approximation of SDEs with discontinuous drift coefficient by coupling of noise. In the past decade, an intensive study of strong approximation of stochastic differential equations (SDEs) with a drift coefficient that has discontinuities in space has begun. In the majority of these results it is assumed that the drift coefficient satisfies piecewise regularity conditions and that the diffusion coefficient is globally Lipschitz continuous and non degenerate at the discontinuities of the drift coefficient. Under this type of assumptions the best L p error rate obtained so far for approximation of scalar SDEs at the final time is 3 4 in terms of the number of evaluations of the driving Brownian motion. In the present article we prove for the first time in the literature sharp lower error bounds for such SDEs. We show that for a huge class of additive noise driven SDEs of this type the L p error rate 3 4 can not be improved. For the proof of this result we employ a novel technique by studying equations with coupled noise we reduce the analysis of the L p error of an arbitrary approximation based on evaluation of the driving Brownian motion at finitely many times to the analysis of the L p distance of two solutions of the same equation that are driven by Brownian motions that are coupled at the given time points and independent, conditioned on their values at these points. To obtain lower bounds for the latter quantity, we prove a new quantitative version of positive association for bivariate normal random variables (Y,Z) by providing explict lower bounds for the covariance text Cov (f(Y),g(Z)) in case of piecewise Lipschitz continuous functions f and g . In addition it turns out that our proof technique also leads to lower error bounds for estimating occupation time functionals int 0 1 f(W t) , dt of a Brownian motion W , which substantially extends known results for the case of f being an indicator function.


Iterative Methods for Computing Eigenvectors of Nonlinear Operators. In this chapter we are examining several iterative methods for solving nonlinear eigenvalue problems. These arise in variational image processing, graph partition and classification, nonlinear physics and more. The canonical eigenproblem we solve is T(u) lambda u , where T R n to R n is some bounded nonlinear operator. Other variations of eigenvalue problems are also discussed. We present a progression of 5 algorithms, coauthored in recent years by the author and colleagues. Each algorithm attempts to solve a unique problem or to improve the theoretical foundations. The algorithms can be understood as nonlinear PDE's which converge to an eigenfunction in the continuous time domain. This allows a unique view and understanding of the discrete iterative process. Finally, it is shown how to evaluate numerically the results, along with some examples and insights related to priors of nonlinear denoisers, both classical algorithms and ones based on deep networks.


Self supervised monocular depth estimation from oblique UAV videos. UAVs have become an essential photogrammetric measurement as they are affordable, easily accessible and versatile. Aerial images captured from UAVs have applications in small and large scale texture mapping, 3D modelling, object detection tasks, DTM and DSM generation etc. Photogrammetric techniques are routinely used for 3D reconstruction from UAV images where multiple images of the same scene are acquired. Developments in computer vision and deep learning techniques have made Single Image Depth Estimation (SIDE) a field of intense research. Using SIDE techniques on UAV images can overcome the need for multiple images for 3D reconstruction. This paper aims to estimate depth from a single UAV aerial image using deep learning. We follow a self supervised learning approach, Self Supervised Monocular Depth Estimation (SMDE), which does not need ground truth depth or any extra information other than images for learning to estimate depth. Monocular video frames are used for training the deep learning model which learns depth and pose information jointly through two different networks, one each for depth and pose. The predicted depth and pose are used to reconstruct one image from the viewpoint of another image utilising the temporal information from videos. We propose a novel architecture with two 2D CNN encoders and a 3D CNN decoder for extracting information from consecutive temporal frames. A contrastive loss term is introduced for improving the quality of image generation. Our experiments are carried out on the public UAVid video dataset. The experimental results demonstrate that our model outperforms the state of the art methods in estimating the depths.


Rogue waves, self similar statistics, and self similar intermediate asymptotics. We advance a statistical theory of extreme event emergence in random nonlinear wave systems with self similar intermediate asymptotics. We show, within the framework of a generic (1 1)D nonlinear Schrodinger equation with linear gain, that extreme events and even rogue waves in weakly nonlinear, statistical open systems emerge as parabolic shape giant fluctuations in the self similar asymptotic propagation regime. We analytically demonstrate the self similar structure of the non Gaussian statistics of emergent rogue waves and validate our results with numerical simulations. Our results shed new light on generic statistical features of extreme events in nonlinear open systems with self similar intermediate asymptotics.


Business Negotiation Definition Language. The target of this paper is to present an industry ready prototype software for general game playing. This software can also be used as the central element for experimental economics research, interfacing of game theoretic libraries, AI driven software testing, algorithmic trade, human behavior mining and simulation of (strategic) interactions. The software is based on a domain specific language for electronic business to business negotiations SIDL3.0. The paper also contains many examples to prove the power of this language.


A Talenti type comparison theorem for mathrm RCD (K,N) spaces and applications. We prove pointwise and L p gradient comparison results for solutions to elliptic Dirichlet problems defined on open subsets of a (possibly non smooth) space with positive Ricci curvature (more precisely of an mathrm RCD (K,N) metric measure space, with K 0 and N in (1, infty) ). The obtained Talenti type comparison is sharp, rigid and stable with respect to L 2 measured Gromov Hausdorff topology moreover, several aspects seem new even for smooth Riemannian manifolds. As applications of such Talenti type comparison, we prove a series of improved Sobolev type inequalities, and an mathrm RCD version of the St. Venant P 'olya torsional rigidity comparison theorem (with associated rigidity and stability statements). Finally, we give a probabilistic interpretation (in the setting of smooth Riemannian manifolds) of the aforementioned comparison results, in terms of exit time from an open subset for the Brownian motion.


Double Layer Metasurface for Enhanced Photon Up Conversion. We present a double layer dielectric metasurface obtained by stacking a silicon nanodisc array and a silicon photonic crystal slab with equal periodicity on top of each other. We focus on the investigation of electric near field enhancement effects occurring at resonant excitation of the metasurface and study its optical properties numerically and experimentally. We find that the major difference in multi layer metasurfaces when compared to conventional single layer structures appears to be in Rayleigh Wood anomalies they are split into multiple different modes which are themselves spectrally broadened. As a proof of concept we cover a double layer metasurface with a lanthanide doped up conversion particle layer and study its interaction with a 1550 nm photoexcitation. We observe a 2.7 fold enhancemed up conversion photoluminescence by using the stacked metasurface instead of a planar substrate, although only around 1 of the up conversion material is exposed to enhanced near fields. Two mechanisms are identified explaining this behavior First, enhanced near fields when exciting the metasurface resonantly, and second, light trapping by total internal reflection in the particle layer when the metasurface redirects light into high angle diffraction orders. These results pave the way for low threshold and, in particular, broadband photon up conversion in future solar energy and biosensing applications.


Video Instance Segmentation. In this paper we present a new computer vision task, named video instance segmentation. The goal of this new task is simultaneous detection, segmentation and tracking of instances in videos. In words, it is the first time that the image instance segmentation problem is extended to the video domain. To facilitate research on this new task, we propose a large scale benchmark called YouTube VIS, which consists of 2883 high resolution YouTube videos, a 40 category label set and 131k high quality instance masks. In addition, we propose a novel algorithm called MaskTrack R CNN for this task. Our new method introduces a new tracking branch to Mask R CNN to jointly perform the detection, segmentation and tracking tasks simultaneously. Finally, we evaluate the proposed method and several strong baselines on our new dataset. Experimental results clearly demonstrate the advantages of the proposed algorithm and reveal insight for future improvement. We believe the video instance segmentation task will motivate the community along the line of research for video understanding.


Positivity preserving hybrid DG FV method with subcell resolution for compressible Euler equations with stiff source terms. In numerical investigations of stringent problems in science and engineering research, non physical negative density or pressure may emerge and cause blow ups of the computation. We build on the realization that the positivity of density and pressure can be preserved in an efficient way of exploiting the advantage of discontinuous Galerkin and finite volume (DG FV) hybrid computation framework. We thus present an effective and simple method with great practical significance to maintain the positivity of density and pressure in solving the reactive Euler equations. The approach is able to maximize the multiscale capability of the DG method by achieving both positivity preserving and oscillation free solution in the subgrid level. In the designed scheme, a priori detection and computation with hyperbolic tangent function prevent the occurrence of negativity in the flux evaluation, while a posteriori detection and computation with the first order Godunov scheme guarantee the positivity of subcell solution. The a priori computation achieves bounded reconstruction and less oscillatory solution so that the a posteriori computation can be active in few cells where the extremely complex computation condition appears. Furthermore, the valuable information from the reconstruction process is utilized to design the indication strategy that identifies the DG and FV cells, and the technique of adaptively choosing reconstruction candidates is adopted to overcome the excessive numerical dissipation in the shock capturing scheme. Numerical tests, including demanding examples in stiff detonation simulation, demonstrate the positivity preserving, non oscillatory and subcell resolution property of the present method.


Adjoint method and inverse design for diffractive beam splitters. Diffractive optical elements with a large diffraction angle require feature sizes down to sub wavelength dimensions, which require a rigorous electromagnetic computational model for calculation. However, the computational optimization of these diffractive elements is often limited by the large number of design parameters, making parametric optimization practically impossible due to large computation times. The adjoint method allows calculating the gradient of the target function with respect to all design variables with only two electromagnetic simulations, thus enabling gradient optimization. Here, we present the adjoint method for modeling wide angle diffractive optical elements like 7x7 beam splitters with a maximum 53 deg diffraction angle and a non square 5x7 array generating beam splitter. After optimization we obtained beam splitter designs with a uniformity error of 16.35 (7x7) and 6.98 (5x7), respectively. After reviewing the experimental results obtained from fabricated elements based on our designs, we found that the adjoint optimization method is an excellent and fast method to design wide angle diffractive fan out beam splitters.


Enhancing Geometric Factors in Model Learning and Inference for Object Detection and Instance Segmentation. Deep learning based object detection and instance segmentation have achieved unprecedented progress. In this paper, we propose Complete IoU (CIoU) loss and Cluster NMS for enhancing geometric factors in both bounding box regression and Non Maximum Suppression (NMS), leading to notable gains of average precision (AP) and average recall (AR), without the sacrifice of inference efficiency. In particular, we consider three geometric factors, i.e., overlap area, normalized central point distance and aspect ratio, which are crucial for measuring bounding box regression in object detection and instance segmentation. The three geometric factors are then incorporated into CIoU loss for better distinguishing difficult regression cases. The training of deep models using CIoU loss results in consistent AP and AR improvements in comparison to widely adopted ell n norm loss and IoU based loss. Furthermore, we propose Cluster NMS, where NMS during inference is done by implicitly clustering detected boxes and usually requires less iterations. Cluster NMS is very efficient due to its pure GPU implementation, and geometric factors can be incorporated to improve both AP and AR. In the experiments, CIoU loss and Cluster NMS have been applied to state of the art instance segmentation (e.g., YOLACT and BlendMask RT), and object detection (e.g., YOLO v3, SSD and Faster R CNN) models. Taking YOLACT on MS COCO as an example, our method achieves performance gains as 1.7 AP and 6.2 AR 100 for object detection, and 0.9 AP and 3.5 AR 100 for instance segmentation, with 27.1 FPS on one NVIDIA GTX 1080Ti GPU. All the source code and trained models are available at https github.com Zzh tju CIoU


Sufficient and necessary conditions for local rigidity of CR mappings and higher order infinitesimal deformations. In this paper we continue our study of local rigidity for maps of CR submanifolds of the complex space. We provide a linear sufficient condition for local rigidity of finitely nondegenerate maps between minimal CR manifolds. Furthermore, we show higher order infinitesimal conditions can be used to give a characterization of local rigidity.