Observation of persistent orientation of chiral molecules by laser field with twisted polarization. Molecular chirality is an omnipresent phenomenon of fundamental significance in physics, chemistry and biology. For this reason, search for novel techniques for enantioselective control, detection and separation of chiral molecules is of particular importance. It has been recently predicted that laser fields with twisted polarization may induce persistent enantioselective field free orientation of chiral molecules. Here we report the first experimental observation of this phenomenon using propylene oxide molecules ( mathrm CH 3 CHCH 2 O , or PPO) spun by an optical centrifuge a laser pulse, whose linear polarization undergoes an accelerated rotation around its propagation direction. We show that PPO molecules remain oriented on a time scale exceeding the duration of the centrifuge pulse by several orders of magnitude. The demonstrated long time field free enantioselective orientation opens new avenues for optical manipulation, discrimination, and, potentially, separation of molecular enantiomers.


On Stability of Distributed Averaging Proportional Integral Frequency Control in Power Systems. Distributed consensus based controllers for optimal secondary frequency regulation of microgrids and power systems have received substantial attention in recent years. This paper provides a Lyapunov based proof that, under a time scale separation, these control schemes are stabilizing for a wide class of nonlinear power system models, and under weak assumptions on (i) the objective functions used for resource allocation, and (ii) the graph topology describing communication between agents in the consensus protocol. The results are illustrated via simulation on a detailed test system.


The generating graph of a profinite group. Let G be 2 generated group. The generating graph Gamma(G) of G is the graph whose vertices are the elements of G and where two vertices g and h are adjacent if G langle g, h rangle. This definition can be extended to a 2 generated profinite group G, considering in this case topological generation. We prove that the set V(G) of non isolated vertices of Gamma(G) is closed in G and that, if G is prosoluble, then the graph Delta(G) obtained from Gamma(G) by removing its isolated vertices is connected with diameter at most 3. However we construct an example of a 2 generated profinite group G with the property that Delta(G) has 2 aleph 0 connected components. This implies that the so called "swap conjecture" does not hold for finitely generated profinite groups. We also prove that if an element of V(G) has finite degree in the graph Gamma(G), then G is finite.


Fast optimization via inertial dynamics with closed loop damping. In a Hilbert space H , in order to develop fast optimization methods, we analyze the asymptotic behavior, as time t tends to infinity, of inertial continuous dynamics where the damping acts as a closed loop control. The function f H to R to be minimized (not necessarily convex) enters the dynamic through it gradient, which is assumed to be Lipschitz continuous on the bounded subsets of H . This gives autonomous dynamical systems with nonlinear damping and nonlinear driving force. We first consider the case where the damping term partial phi ( dot x (t)) acts as a closed loop control of the velocity. The damping potential phi H to 0, infty) is a convex continuous function which achieves its minimum at the origin. We show the existence and uniqueness of a global solution to the associated Cauchy problem. Then, we analyze the asymptotic convergence properties of the generated trajectories generated. We use techniques from optimization, control theory, and PDE's Lyapunov analysis based on the decreasing property of an energy like function, quasi gradient and Kurdyka Lojasiewicz theory, monotone operator theory for wave like equations. Convergence rates are obtained based on the geometric properties of the data f and phi . When f is strongly convex, we give general conditions which provide exponential convergence rates. Then, we extend the results to the case where an additional Hessian driven damping enters the dynamic, which reduces the oscillations. Finally, we consider an inertial system involving jointly the velocity dot x (t) and the gradient nabla f(x(t)) . In addition to its original results, this work surveys the numerous works devoted in recent years to the interaction between continuous damped inertial dynamics and numerical algorithms for optimization, with the emphasis on autonomous systems, closed loop adaptive procedures, and convergence rates.


Fractional flow equations. A model for pressure deficit in an oil well. This article presents a novel system of flow equations that models the pressure deficit of a reservoir considered as a triple continuous medium formed by the rock matrix, vugular medium and fracture. In non conventional reservoirs, the velocity of the fluid particles is altered due to physical and chemical phenomena caused by the interaction of the fluid with the medium, this behavior is defined as anomalous. A more exact model can be obtained with the inclusion of the memory formalism concept that can be expressed through the use of fractional derivatives. Using Laplace transform of the Caputo fractional derivative and Bessel functions, a semi analytical solution is reached in the Laplace space.


Conceptual Design of Human Drone Communication in Collaborative Environments. Autonomous robots and drones will work collaboratively and cooperatively in tomorrow's industry and agriculture. Before this becomes a reality, some form of standardised communication between man and machine must be established that specifically facilitates communication between autonomous machines and both trained and untrained human actors in the working environment. We present preliminary results on a human drone and a drone human language situated in the agricultural industry where interactions with trained and untrained workers and visitors can be expected. We present basic visual indicators enhanced with flight patterns for drone human interaction and human signaling based on aircraft marshaling for humane drone interaction. We discuss preliminary results on image recognition and future work.


Explore Entity Embedding Effectiveness in Entity Retrieval. This paper explores entity embedding effectiveness in ad hoc entity retrieval, which introduces distributed representation of entities into entity retrieval. The knowledge graph contains lots of knowledge and models entity semantic relations with the well formed structural representation. Entity embedding learns lots of semantic information from the knowledge graph and represents entities with a low dimensional representation, which provides an opportunity to establish interactions between query related entities and candidate entities for entity retrieval. Our experiments demonstrate the effectiveness of entity embedding based model, which achieves more than 5 improvement than the previous state of the art learning to rank based entity retrieval model. Our further analysis reveals that the entity semantic match feature effective, especially for the scenario which needs more semantic understanding.


Blockchain Solutions for Forensic Evidence Preservation in IoT Environments. The technological evolution brought by the Internet of things (IoT) comes with new forms of cyber attacks exploiting the complexity and heterogeneity of IoT networks, as well as, the existence of many vulnerabilities in IoT devices. The detection of compromised devices, as well as the collection and preservation of evidence regarding alleged malicious behavior in IoT networks emerge as a areas of high priority. This paper presents a blockchain based solution, which is designed for the smart home domain, dealing with the collection and preservation of digital forensic evidence. The system utilizes a private forensic evidence database, where the captured evidence is stored, along with a permissioned blockchain that allows providing security services like integrity, authentication, and non repudiation, so that the evidence can be used in a court of law. The blockchain stores evidences' metadata, which are critical for providing the aforementioned services, and interacts via smart contracts with the different entities involved in an investigation process, including Internet service providers, law enforcement agencies and prosecutors. A high level architecture of the blockchain based solution is presented that allows tackling the unique challenges posed by the need for digitally handling forensic evidence collected from IoT networks.


Segmenting Scientific Abstracts into Discourse Categories A Deep Learning Based Approach for Sparse Labeled Data. The abstract of a scientific paper distills the contents of the paper into a short paragraph. In the biomedical literature, it is customary to structure an abstract into discourse categories like BACKGROUND, OBJECTIVE, METHOD, RESULT, and CONCLUSION, but this segmentation is uncommon in other fields like computer science. Explicit categories could be helpful for more granular, that is, discourse level search and recommendation. The sparsity of labeled data makes it challenging to construct supervised machine learning solutions for automatic discourse level segmentation of abstracts in non bio domains. In this paper, we address this problem using transfer learning. In particular, we define three discourse categories BACKGROUND, TECHNIQUE, OBSERVATION for an abstract because these three categories are the most common. We train a deep neural network on structured abstracts from PubMed, then fine tune it on a small hand labeled corpus of computer science papers. We observe an accuracy of 75 on the test corpus. We perform an ablation study to highlight the roles of the different parts of the model. Our method appears to be a promising solution to the automatic segmentation of abstracts, where the labeled data is sparse.


Subsonic and supersonic nucleus acoustic solitary waves in thermally degenerate plasmas with heavy nucleus species. A fully ionized multi nucleus plasma system (containing thermally degenerate electron species, non degenerate warm light nucleus species, and low dense stationary heavy nucleus species) is considered. The basic features of thermal and degenerate pressure driven small and arbitrary amplitude subsonic and supersonic nucleus acoustic solitary waves in such a plasma system are studied by the pseudo potential approach. The effects of stationary heavy nucleus, non relativistically and ultra relativistically electron degeneracies, and light nucleus temperature on small and arbitrary amplitude subsonic and supersonic nucleus acoustic solitary waves are also examined. It is found that (i) the presence of stationary heavy nucleus species with Bolttzmann distributed electron species supports the existence of subsonic nucleus acoustic solitary waves, and that the effects of electron degeneracies and light nucleus temperature reduce the possibility for the formation of these subsonic nucleus acoustic solitary waves (ii) the amplitude (width) of the subsonic nucleus acoustic solitary waves increases (decreases) with the rise of the number density of heavy nucleus species (iii) the amplitude of the supersonic nucleus acoustic solitary waves in the situation of no relativistically degenerate electron species is much smaller than that of ultra relativistically degenerate electron species, but is much larger than that of isothermal electron species (iv) their width in the situation of non relativistically degenerate electron species is much wider than that of ultra relativistically degenerate electron species (v) their amplitude (width) decreases (increases) with the rise of the light nucleus temperature. The applications of the results in astrophysical, space, and laboratory plasma situations are briefly discussed.


A deep learning method for solving Fokker Planck equations. The time evolution of the probability distribution of a stochastic differential equation follows the Fokker Planck equation, which usually has an unbounded, high dimensional domain. Inspired by our early study in cite li2018data , we propose a mesh free Fokker Planck solver, in which the solution to the Fokker Planck equation is now represented by a neural network. The presence of the differential operator in the loss function improves the accuracy of the neural network representation and reduces the the demand of data in the training process. Several high dimensional numerical examples are demonstrated.


Perturbed minimizing movements of families of functionals. We consider the well known minimizing movement approach to the definition of a solution of gradient flow type equations by means of an implicit Euler scheme depending on an energy and a dissipation term. We perturb the energy by considering a ( Gamma converging) sequence and the dissipation by varying multiplicative terms. The scheme depends on two small parameters varepsilon and tau , governing energy and time scales, respectively. We characterize the extreme cases when varepsilon tau and tau varepsilon converges to 0 sufficiently fast, and exhibit a sufficient condition that guarantees that the limit is indeed independent of varepsilon and tau . We give examples showing that this in general is not the case, and apply this approach to study some discrete approximations, the homogenization of wiggly energies and geometric crystalline flows obtained as limits of ferromagnetic energies.


Basis divisors and balanced metrics. Using log canonical thresholds and basis divisors Fujita Odaka introduced purely algebro geometric invariants delta m whose limit in m is now known to characterize uniform K stability on a Fano variety. As shown by Blum Jonsson this carries over to a general polarization, and together with work of Berman, Boucksom, and Jonsson, it is now known that the limit of these delta m invariants characterizes uniform Ding stability. A basic question since Fujita Odaka's work has been to find an analytic interpretation of these invariants. We show that each delta m is the coercivity threshold of a quantized Ding functional on the m th Bergman space and thus characterizes the existence of balanced metrics. This approach has a number of applications. The most basic one is that it provides an alternative way to compute these invariants, which is new even for mathbb P n . Second, it allows us to introduce algebraically defined invariants that characterize the existence of K "ahler Ricci solitons (and the more general g solitons of Berman Witt Nystr "om), as well as coupled versions thereof. Third, it leads to approximation results involving balanced metrics in the presence of automorphisms that extend some results of Donaldson.


The Resolution Matrix for Visualizing Functional Network Connectivity. The resolution matrix is a mathematical tool for analyzing inverse problems such as computational imaging systems. When treating network connectivity estimation as an inverse problem, the resolution matrix describes the degree to which network nodes and edges can be resolved. This is useful both for quantifying robustness of the network estimate, as well as identifying correlated activity. In this report we analyze the resolution matrix for functional MRI data from the Human Connectome project. We find that common metrics of the resolution metric can be used to identify networked activity, though with a new twist on the relationship between default mode network and the frontoparietal attention network.


Online Carpooling using Expander Decompositions. We consider the online carpooling problem given n vertices, a sequence of edges arrive over time. When an edge e t (u t, v t) arrives at time step t , the algorithm must orient the edge either as v t rightarrow u t or u t rightarrow v t , with the objective of minimizing the maximum discrepancy of any vertex, i.e., the absolute difference between its in degree and out degree. Edges correspond to pairs of persons wanting to ride together, and orienting denotes designating the driver. The discrepancy objective then corresponds to every person driving close to their fair share of rides they participate in. In this paper, we design efficient algorithms which can maintain polylog (n,T) maximum discrepancy (w.h.p) over any sequence of T arrivals, when the arriving edges are sampled independently and uniformly from any given graph G . This provides the first polylogarithmic bounds for the online (stochastic) carpooling problem. Prior to this work, the best known bounds were O( sqrt n log n ) discrepancy for any adversarial sequence of arrivals, or O( log ! log n) discrepancy bounds for the stochastic arrivals when G is the complete graph. The technical crux of our paper is in showing that the simple greedy algorithm, which has provably good discrepancy bounds when the arriving edges are drawn uniformly at random from the complete graph, also has polylog discrepancy when G is an expander graph. We then combine this with known expander decomposition results to design our overall algorithm.


A primal dual interior point relaxation method with adaptively updating barrier for nonlinear programs. Based on solving an equivalent parametric equality constrained mini max problem of the classic logarithmic barrier subproblem, we present a novel primal dual interior point relaxation method for nonlinear programs. In the proposed method, the barrier parameter is updated in every step as done in interior point methods for linear programs, which is prominently different from the existing interior point methods and the relaxation methods for nonlinear programs. Since our update for the barrier parameter is autonomous and adaptive, the method has potential of avoiding the possible difficulties caused by the unappropriate initial selection of the barrier parameter and speeding up the convergence to the solution. Moreover, it can circumvent the jamming difficulty of global convergence caused by the interior point restriction for nonlinear programs and improve the ill conditioning of the existing primal dual interiorpoint methods as the barrier parameter is small. Under suitable assumptions, our method is proved to be globally convergent and locally quadratically convergent. The preliminary numerical results on a well posed problem for which many line search interior point methods fail to find the minimizer and a set of test problems from the CUTE collection show that our method is efficient.


The CROSS Experiment Rejecting Surface Events by PSD Induced by Superconducting Films. Neutrinoless double beta ( 0 nu beta beta ) decay is a hypothetical rare nuclear transition ( T 1 2 10 26 y). Its observation would provide an important insight about the nature of neutrinos (Dirac or Majorana particle) demonstrating that the lepton number is not conserved. This decay can be investigated with bolometers embedding the double beta decay isotope ( 76 Ge, 82 Se, 100 Mo, 116 Cd, 130 Te...), which perform as low temperature calorimeters (10 mK) detecting particle interactions via a small temperature rise read out by a dedicated thermometer. CROSS (Cryogenic Rare event Observatory with Surface Sensitivity) aims at the development of bolometric detectors (Li 2 MoO 4 and TeO 2 ) capable of discriminating surface alpha and beta interactions by exploiting superconducting properties of Al film deposited on the crystal surface. We report in this paper the results of tests on prototypes performed at CSNSM (Orsay, France) that showed the capability of a few mu m thick superconducting Al film deposited on crystal surface to discriminate surface alpha from bulk events, thus providing the detector with the required surface sensitivity capability. The CROSS technology would further improve the background suppression and simplify the detector construction with a view to future competitive double beta decay searches.


physics.comp-ph cs.NA math.NA physics.data-an

Temperature expressions and ergodicity of the Nos 'e Hoover deterministic schemes. Thermostats are dynamic equations used to model thermodynamic variables in molecular dynamics. The applicability of thermostats is based on the ergodic hypothesis. The most commonly used thermostats are designed according to the Nos 'e Hoover scheme, although it is known that it often violates ergodicity. Here, following a method from our recent study citep SamoletovVasiev2017 , we have extended the classic Nos 'e Hoover scheme with an additional temperature control tool. However, as with the NH scheme, a single thermostat variable is used. In the present study we analyze the statistical properties of the modified equations of motion with an emphasis on ergodicity. Simultaneous thermostatting of all phase variables with minimal extra computational costs is an advantage of the specific theoretical scheme presented here.


Zooming Into Video Conferencing Privacy and Security Threats. The COVID 19 pandemic outbreak, with its related social distancing and shelter in place measures, has dramatically affected ways in which people communicate with each other, forcing people to find new ways to collaborate, study, celebrate special occasions, and meet with family and friends. One of the most popular solutions that have emerged is the use of video conferencing applications to replace face to face meetings with virtual meetings. This resulted in unprecedented growth in the number of video conferencing users. In this study, we explored privacy issues that may be at risk by attending virtual meetings. We extracted private information from collage images of meeting participants that are publicly posted on the Web. We used image processing, text recognition tools, as well as social network analysis to explore our web crawling curated dataset of over 15,700 collage images, and over 142,000 face images of meeting participants. We demonstrate that video conference users are facing prevalent security and privacy threats. Our results indicate that it is relatively easy to collect thousands of publicly available images of video conference meetings and extract personal information about the participants, including their face images, age, gender, usernames, and sometimes even full names. This type of extracted data can vastly and easily jeopardize people's security and privacy both in the online and real world, affecting not only adults but also more vulnerable segments of society, such as young children and older adults. Finally, we show that cross referencing facial image data with social network data may put participants at additional privacy risks they may not be aware of and that it is possible to identify users that appear in several video conference meetings, thus providing a potential to maliciously aggregate different sources of information about a target individual.


Learning Constitutive Relations using Symmetric Positive Definite Neural Networks. We present the Cholesky factored symmetric positive definite neural network (SPD NN) for modeling constitutive relations in dynamical equations. Instead of directly predicting the stress, the SPD NN trains a neural network to predict the Cholesky factor of a tangent stiffness matrix, based on which the stress is calculated in the incremental form. As a result of the special structure, SPD NN weakly imposes convexity on the strain energy function, satisfies time consistency for path dependent materials, and therefore improves numerical stability, especially when the SPD NN is used in finite element simulations. Depending on the types of available data, we propose two training methods, namely direct training for strain and stress pairs and indirect training for loads and displacement pairs. We demonstrate the effectiveness of SPD NN on hyperelastic, elasto plastic, and multiscale fiber reinforced plate problems from solid mechanics. The generality and robustness of the SPD NN make it a promising tool for a wide range of constitutive modeling applications.


K Adapter Infusing Knowledge into Pre Trained Models with Adapters. We study the problem of injecting knowledge into large pre trained models like BERT and RoBERTa. Existing methods typically update the original parameters of pre trained models when injecting knowledge. However, when multiple kinds of knowledge are injected, the historically injected knowledge would be flushed away. To address this, we propose K Adapter, a framework that retains the original parameters of the pre trained model fixed and supports the development of versatile knowledge infused model. Taking RoBERTa as the backbone model, K Adapter has a neural adapter for each kind of infused knowledge, like a plug in connected to RoBERTa. There is no information flow between different adapters, thus multiple adapters can be efficiently trained in a distributed way. As a case study, we inject two kinds of knowledge in this work, including (1) factual knowledge obtained from automatically aligned text triplets on Wikipedia and Wikidata and (2) linguistic knowledge obtained via dependency parsing. Results on three knowledge driven tasks, including relation classification, entity typing, and question answering, demonstrate that each adapter improves the performance and the combination of both adapters brings further improvements. Further analysis indicates that K Adapter captures versatile knowledge than RoBERTa.


Scalable spaces. emph Scalable spaces are simply connected compact manifolds or finite complexes whose real cohomology algebra embeds in their algebra of (flat) differential forms. This is a rational homotopy invariant property and all scalable spaces are formal indeed, scalability can be thought of as a metric version of formality. They are also characterized by particularly nice behavior from the point of view of quantitative homotopy theory. Among other results, we show that spaces which are formal but not scalable provide counterexamples to Gromov's long standing conjecture on distortion in higher homotopy groups.


Quasi powerful p groups. In this paper we introduce the notion of a quasi powerful p group for odd primes p . These are the finite p groups G such that G Z(G) is powerful in the sense of Lubotzky and Mann. We show that this large family of groups shares many of the same properties as powerful p groups. For example, we show that they have a regular power structure, and we generalise a result of Fern 'andez Alcober on the order of commutators in powerful p groups to this larger family of groups. We also obtain a bound on the number of generators of a subgroup of a quasi powerful p group, expressed in terms of the number of generators of the group. We give an infinite family of examples which demonstrates this bound is close to best possible.


On the Merge of k NN Graph. k nearest neighbor graph is a fundamental data structure in many disciplines such as information retrieval, data mining, pattern recognition, and machine learning, etc. In the literature, considerable research has been focusing on how to efficiently build an approximate k nearest neighbor graph (k NN graph) for a fixed dataset. Unfortunately, a closely related issue of how to merge two existing k NN graphs has been overlooked. In this paper, we address the issue of k NN graph merging in two different scenarios. In the first scenario, a symmetric merge algorithm is proposed to combine two approximate k NN graphs. The algorithm facilitates large scale processing by the efficient merging of k NN graphs that are produced in parallel. In the second scenario, a joint merge algorithm is proposed to expand an existing k NN graph with a raw dataset. The algorithm enables the incremental construction of a hierarchical approximate k NN graph. Superior performance is attained when leveraging the hierarchy for NN search of various data types, dimensionality, and distance measures.


Monotonicity based reconstruction of extreme inclusions in electrical impedance tomography. The monotonicity based approach has become one of the fundamental methods for reconstructing inclusions in the inverse problem of electrical impedance tomography. Thus far the method has not been proven to be able to handle extreme inclusions that correspond to some parts of the studied domain becoming either perfectly conducting or perfectly insulating. The main obstacle has arguably been establishing suitable monotonicity principles for the corresponding Neumann to Dirichlet boundary maps. In this work, we tackle this shortcoming by first giving a convergence result in the operator norm for the Neumann to Dirichlet map when the conductivity coefficient decays to zero and or grows to infinity in some given parts of the domain. This allows passing the necessary monotonicity principles to the limiting case. Subsequently, we show how the monotonicity method generalizes to the definite case of reconstructing either perfectly conducting or perfectly insulating inclusions, as well as to the indefinite case where the perturbed conductivity can take any values between, and including, zero and infinity.


Performances of C V2X Communication on Highway under Varying Channel Propagation Models. In recent decades, both the industry and the academy society are sparing no efforts to develop and standardize the Cellular Vehicle to Everything (C V2X) communication which is one of the prominent emerging services of the next generation of wireless network (5G). C V2X communication is used for information exchange among the traffic participants with network assisted which can reduce traffic accidents and improve traffic efficiency. And it is also the primary enabler for cooperative driving. But C V2X communication has to meet different Quality of Service (QoS) requirements (e.g., ultra high reliability (99.999 ) and ultra low latency).


Staggered DG method for coupling of the Stokes and Darcy Forchheimer problems. In this paper we develop a staggered discontinuous Galerkin method for the Stokes and Darcy Forchheimer problems coupled with the Red Beavers Joseph Saffman conditions. The method is defined by imposing staggered continuity for all the variables involved and the interface conditions are enforced by switching the roles of the variables met on the interface, which eliminate the hassle of introducing additional variables. This method can be flexibly applied to rough grids such as the highly distorted grids and the polygonal grids. In addition, the method allows nonmatching grids on the interface thanks to the special inclusion of the interface conditions, which is highly appreciated from a practical point of view. A new discrete trace inequality and a generalized Poincar ' e Friedrichs inequality are proved, which enables us to prove the optimal convergence estimates under reasonable regularity assumptions. Finally, several numerical experiments are given to illustrate the performances of the proposed method, and the numerical results indicate that the proposed method is accurate and efficient, in addition, it is a good candidate for practical applications.


Variants of Khintchine's theorem in metric Diophantine approximation. New results towards the Duffin Schaeffer conjecture, which is a fundamental unsolved problem in metric number theory, have been established recently assuming extra divergence. Given a non negative function psi mathbb N to mathbb R we denote by W( psi) the set of all x in mathbb R such that nx a psi(n) for infinitely many a,n . Analogously, denote W'( psi) if we additionally require a,n to be coprime. Aistleitner et al. 1 proved that W'( psi) is of full Lebesgue measure if there exist an varepsilon 0 such that sum n 2 infty psi(n) varphi(n) (n( log n) varepsilon) infty . This result seems to be the best one can expect from the method used. Assuming the extra divergence sum n 2 infty psi(n) ( log n) varepsilon infty we prove that W( psi) is of full measure. This could also be deduced from the result in 1 , but we believe that our proof is of independent interest, since its method is totally different from the one in 1 . As a further application of our method, we prove that a variant of Khintchine's theorem is true without monotonicity, subject to an additional condition on the set of divisors of the support of psi .


Electronic interaction of slow hydrogen and helium ions in the nickel silicon system. Electronic stopping cross sections (SCS) of nickel, silicon and nickel silicon alloys for protons and helium (He) ions are studied in the regime of medium and low energy ion scattering, i.e., for ion energies in the range from 500 eV to 200 keV. For protons, at velocities below the Bohr velocity the deduced SCS is proportional to the ion velocity for all investigated materials. In contrast, for He ions non linear velocity scaling is observed in all investigated materials. Static calculations using density functional theory (DFT) available from literature accurately predict the SCS of Ni and Ni Si alloy in the regime with observed velocity proportionality. At higher energies, the energy dependence of the deduced SCS of Ni for protons and He ions agrees with the prediction by recent time dependent DFT calculations. The measured SCS of the Ni Si alloy was compared to the SCS obtained from Bragg's rule based on SCS for Ni and Si deduced in this study, yielding good agreement for protons, but systematic deviations for He projectiles, by almost 20 . Overall, the obtained data indicate the importance of non adiabatic processes such as charge exchange for proper modelling of electronic stopping of in particular medium energy ions heavier than protons in solids.


The Littlewood Offord Problem for Markov Chains. The celebrated Littlewood Offord problem asks for an upper bound on the probability that the random variable epsilon 1 v 1 cdots epsilon n v n lies in the Euclidean unit ball, where epsilon 1, ldots, epsilon n in 1, 1 are independent Rademacher random variables and v 1, ldots, v n in mathbb R d are fixed vectors of at least unit length.We extend many known results to the case that the epsilon i are obtained from a Markov chain, including the general bounds first shown by Erd H o s in the scalar case and Kleitman in the vector case, and also under the restriction that the v i are distinct integers due to S 'ark "ozy and Szemeredi. In all extensions, the upper bound includes an extra factor depending on the spectral gap. We also construct a pseudorandom generator for the Littlewood Offord problem using similar techniques.


Uniform Sobolev Estimates on compact manifolds involving singular potentials. We obtain generalizations of the uniform Sobolev inequalities of Kenig, Ruiz and the fourth author cite KRS for Euclidean spaces and Dos Santos Ferreira, Kenig and Salo cite DKS for compact Riemannian manifolds involving critically singular potentials V in L n 2 . We also obtain the analogous improved quasimode estimates of the the first, third and fourth authors cite BSS , Hassell and Tacy cite HassellTacy , the first and fourth author cite SBLog , and Hickman cite Hickman as well as analogues of the improved uniform Sobolev estimates of cite BSSY and cite Hickman involving such potentials. Additionally, on S n , we obtain sharp uniform Sobolev inequalities involving such potentials for the optimal range of exponents, which extend the results of S. Huang and the fourth author cite SHSo . For general Riemannian manifolds we improve the earlier results in cite BSS by obtaining quasimode estimates for a larger (and optimal) range of exponents under the weaker assumption that V in L n 2 .


CGPOPS A C Software for Solving Multiple Phase Optimal Control Problems Using Adaptive Gaussian Quadrature Collocation and Sparse Nonlinear Programming. A general purpose C software program called mathbb CGPOPS is described for solving multiple phase optimal control problems using adaptive Gaussian quadrature collocation. The software employs a Legendre Gauss Radau direct orthogonal collocation method to transcribe the continuous time optimal control problem into a large sparse nonlinear programming problem. A class of hp mesh refinement methods are implemented which determine the number of mesh intervals and the degree of the approximating polynomial within each mesh interval to achieve a specified accuracy tolerance. The software is interfaced with the open source Newton NLP solver IPOPT. All derivatives required by the NLP solver are computed using either central finite differencing, bicomplex step derivative approximation, hyper dual derivative approximation, or automatic differentiation. The key components of the software are described in detail and the utility of the software is demonstrated on five optimal control problems of varying complexity. The software described in this article provides a computationally efficient and accurate approach for solving a wide variety of complex constrained optimal control problems.


Establishing a New State of the Art for French Named Entity Recognition. The French TreeBank developed at the University Paris 7 is the main source of morphosyntactic and syntactic annotations for French. However, it does not include explicit information related to named entities, which are among the most useful information for several natural language processing tasks and applications. Moreover, no large scale French corpus with named entity annotations contain referential information, which complement the type and the span of each mention with an indication of the entity it refers to. We have manually annotated the French TreeBank with such information, after an automatic pre annotation step. We sketch the underlying annotation guidelines and we provide a few figures about the resulting annotations.


Making Predictive Coding Networks Generative. Predictive coding (PC) networks are a biologically interesting class of neural networks. Their layered hierarchy mimics the reciprocal connectivity pattern observed in the mammalian cortex, and they can be trained using local learning rules that approximate backpropagation Bogacz, 2017 . However, despite having feedback connections that enable information to flow down the network hierarchy, discriminative PC networks are not generative. Clamping the output class and running the network to equilibrium yields an input sample that typically does not resemble the training input. This paper studies this phenomenon, and proposes a simple solution that promotes the generation of input samples that resemble the training inputs. Simple decay, a technique already in wide use in neural networks, pushes the PC network toward a unique minimum 2 norm solution, and that unique solution provably (for linear networks) matches the training inputs. The method also vastly improves the samples generated for nonlinear networks, as we demonstrate on MNIST.


Quantifying and managing uncertainty in piecewise deterministic Markov processes. In piecewise deterministic Markov processes (PDMP) the state of a finite dimensional system evolves dynamically, but the evolutive equation may change randomly as a result of discrete switches. A running cost is integrated along the corresponding piecewise deterministic trajectory up to the termination to produce the cumulative cost of the process. We address three natural questions related to uncertainty in cumulative cost of PDMP models (1) how to compute the Cumulative Distribution Function (CDF) when the switching rates are fully known (2) how to accurately bound the CDF when the switching rates are uncertain and (3) assuming the PDMP is controlled, how to select a control to optimize that CDF. In all three cases, our approach requires posing a (weakly coupled) system of suitable hyperbolic partial differential equations, which are then solved numerically on an augmented state space. We illustrate our method using simple examples of trajectory planning under uncertainty.


Deep Learning Based Average Consensus. In this study, we analyzed the problem of accelerating the linear average consensus algorithm for complex networks. We propose a data driven approach to tuning the weights of temporal (i.e., time varying) networks using deep learning techniques. Given a finite time window, the proposed approach first unfolds the linear average consensus protocol to obtain a feedforward signal flow graph, which is regarded as a neural network. The edge weights of the obtained neural network are then trained using standard deep learning techniques to minimize consensus error over a given finite time window. Through this training process, we obtain a set of optimized time varying weights, which yield faster consensus for a complex network. We also demonstrate that the proposed approach can be extended for infinite time window problems. Numerical experiments revealed that our approach can achieve a significantly smaller consensus error compared to baseline strategies.


Data driven Computing in Elasticity via Chebyshev Approximation. This paper proposes a data driven approach for computing elasticity by means of a non parametric regression approach rather than an optimization approach. The Chebyshev approximation is utilized for tackling the material data sets non linearity of the elasticity. Also, additional efforts have been taken to compare the results with several other state of the art methodologies.


Online Energy Harvesting Problem Over An Arbitrary Directed Acyclic Graph Network. A communication network modelled by a directed acyclic graph (DAG) is considered, over which a source wishes to send a specified number of bits to a destination node. Each node of the DAG is powered by a separate renewable energy source, and the harvested energy is used to facilitate the source destination data flow. The challenge here is to find the optimal rate and power allocations across time for each node on its outgoing edges so as to minimize the time by which the destination receives a specified number of bits. An online setting is considered where an algorithm only has causal information about the energy arrivals. Using the competitive ratio as the performance metric, i.e. the ratio of the cost of the online algorithm and the optimal offline algorithm, maximized over all inputs, a it lazy online algorithm with a competitive ratio of 2 delta for any delta 0 is proposed. Incidentally, 2 is also a lower bound to the competitive ratio of any online algorithm for this problem. Our lazy online algorithm is described and analyzed via defining a novel max flow problem over a DAG, where the rate on the subset of outgoing edges of any node are related constrained. An optimal algorithm to find max flow with these constraints is also provided, which may be of independent interest.


Quantum generalized Kac Moody algebras via Hall algebras of complexes. We establish an embedding of the quantum enveloping algebra of a symmetric generalized Kac Moody algebra into a localized Hall algebra of mathbb Z 2 graded complexes of representations of a quiver with (possible) loops. To overcome difficulties resulting from the existence of infinite dimensional projective objects, we consider the category of finitely presented representations and the category of mathbb Z 2 graded complexes of projectives with finite homology.


Pattern statistics in faro words and permutations. We study the distribution and the popularity of some patterns in k ary faro words, i.e. words over the alphabet 1, 2, ldots, k obtained by interlacing the letters of two nondecreasing words of lengths differing by at most one. We present a bijection between these words and dispersed Dyck paths (i.e. Motzkin paths with all level steps on the x axis) with a given number of peaks. We show how the bijection maps statistics of consecutive patterns of faro words into linear combinations of other pattern statistics on paths. Then, we deduce enumerative results by providing multivariate generating functions for the distribution and the popularity of patterns of length at most three. Finally, we consider some interesting subclasses of faro words that are permutations, involutions, derangements, or subexcedent words.


The Cost of Training NLP Models A Concise Overview. We review the cost of training large scale language models, and the drivers of these costs. The intended audience includes engineers and scientists budgeting their model training experiments, as well as non practitioners trying to make sense of the economics of modern day Natural Language Processing (NLP).


DmifNet 3D Shape Reconstruction Based on Dynamic Multi Branch Information Fusion. 3D object reconstruction from a single view image is a long standing challenging problem. Previous work was difficult to accurately reconstruct 3D shapes with a complex topology which has rich details at the edges and corners. Moreover, previous works used synthetic data to train their network, but domain adaptation problems occurred when tested on real data. In this paper, we propose a Dynamic Multi branch Information Fusion Network (DmifNet) which can recover a high fidelity 3D shape of arbitrary topology from a 2D image. Specifically, we design several side branches from the intermediate layers to make the network produce more diverse representations to improve the generalization ability of network. In addition, we utilize DoG (Difference of Gaussians) to extract edge geometry and corners information from input images. Then, we use a separate side branch network to process the extracted data to better capture edge geometry and corners feature information. Finally, we dynamically fuse the information of all branches to gain final predicted probability. Extensive qualitative and quantitative experiments on a large scale publicly available dataset demonstrate the validity and efficiency of our method. Code and models are publicly available at https github.com leilimaster DmifNet.


Complete cohomology for extriangulated categories. Let ( mathcal C , mathbb E , mathfrak s ) be an extriangulated category with a proper class xi of mathbb E triangles. In this paper, we study complete cohomology of objects in ( mathcal C , mathbb E , mathfrak s ) by applying xi projective resolutions and xi injective coresolutions constructed in ( mathcal C , mathbb E , mathfrak s ) . Vanishing of complete cohomology detects objects with finite xi projective dimension and finite xi injective dimension. As a consequence, we obtain some criteria for the validity of the Wakamatsu Tilting Conjecture and give a necessary and sufficient condition for a virtually Gorenstein algebra to be Gorenstein. Moreover, we give a general technique for computing complete cohomology of objects with finite xi mathcal G projective dimension. As an application, the relationships between xi projective dimensions and xi mathcal G projective dimensions for objects in ( mathcal C , mathbb E , mathfrak s ) are given.


AdaLAM Revisiting Handcrafted Outlier Detection. Local feature matching is a critical component of many computer vision pipelines, including among others Structure from Motion, SLAM, and Visual Localization. However, due to limitations in the descriptors, raw matches are often contaminated by a majority of outliers. As a result, outlier detection is a fundamental problem in computer vision, and a wide range of approaches have been proposed over the last decades. In this paper we revisit handcrafted approaches to outlier filtering. Based on best practices, we propose a hierarchical pipeline for effective outlier detection as well as integrate novel ideas which in sum lead to AdaLAM, an efficient and competitive approach to outlier rejection. AdaLAM is designed to effectively exploit modern parallel hardware, resulting in a very fast, yet very accurate, outlier filter. We validate AdaLAM on multiple large and diverse datasets, and we submit to the Image Matching Challenge (CVPR2020), obtaining competitive results with simple baseline descriptors. We show that AdaLAM is more than competitive to current state of the art, both in terms of efficiency and effectiveness.


Stability of the saddle solutions for the Allen Cahn equation. We are concerned with the saddle solutions of the Allen Cahn equation constructed by Cabr ' e and Terra cite C,C2 in mathbb R 2m mathbb R m times mathbb R m . These solutions vanish precisely on the Simons cone. The existence and uniqueness of saddle solution are shown in cite C,C2,C1 . Regarding the stability, Schatzman cite Sch proved that the saddle solution is unstable for m 1, Cabr ' e cite C1 showed the instability for m 2,3 and stability for m geq7 . This has left open the case of m 4,5,6 . In this paper we show that the saddle solutions are stable when m 4,5,6 , thereby confirming Cabr ' e 's conjecture in cite C1 . The conjecture that saddle solutions in dimensions 2m geq8 should be global minimizers of the energy functional remains open.


Finding polynomial roots by dynamical systems a case study. We investigate two well known dynamical systems that are designed to find roots of univariate polynomials by iteration the methods known by Newton and by Ehrlich Aberth. Both are known to have found all roots of high degree polynomials with good complexity. Our goal is to determine in which cases which of the two algorithms is more efficient. We come to the conclusion that Newton is faster when the polynomials are given by recursion so they can be evaluated in logarithmic time with respect to the degree, or when all the roots are all near the boundary of their convex hull. Conversely, Ehrlich Aberth has the advantage when no fast evaluation of the polynomials is available, and when roots are in the interior of the convex hull of other roots.


b Coloring Parameterized by Clique Width. We provide a polynomial time algorithm for b Coloring on graphs of constant clique width. This unifies and extends previously known polynomial time results on several graph classes, and answers open questions posed by Campos and Silva Algorithmica, 2018 and Bonomo et al. Graphs Combin., 2009 . This constitutes the first result concerning structural parameterizations of this problem. We show that the problem is FPT when parameterized by the vertex cover number on general graphs, and on chordal graphs when parameterized by the number of colors. Additionally, we observe that our algorithm for graphs of bounded clique width can be adapted to solve the Fall Coloring problem within the same runtime bound.


Coding for Optimized Writing Rate in DNA Storage. A method for encoding information in DNA sequences is described. The method is based on the precision resolution framework, and is aimed to work in conjunction with a recently suggested terminator free template independent DNA synthesis method. The suggested method optimizes the amount of information bits per synthesis time unit, namely, the writing rate. Additionally, the encoding scheme studied here takes into account the existence of multiple copies of the DNA sequence, which are independently distorted. Finally, quantizers for various run length distributions are designed.


Minimal universality criterion sets on the representations of quadratic forms. For a set S of (positive definite and integral) quadratic forms with bounded rank, a quadratic form f is called S universal if it represents all quadratic forms in S . A subset S 0 of S is called an S universality criterion set if any S 0 universal quadratic form is S universal. We say S 0 is minimal if there does not exist a proper subset of S 0 that is an S universality criterion set. In this article, we study various properties of minimal universality criterion sets. In particular, we show that for most' binary quadratic forms f , minimal S universality criterion sets are unique in the case when S is the set of all subforms of the binary form f .


A parallel dynamic overset grid framework for immersed boundary methods. A parallel dynamic overset framework has been developed for the curvilinear immersed boundary (overset CURVIB) method to enable tackling a wide range of challenging flow problems. The dynamic overset grids are used to locally increase the grid resolution near complex immersed bodies, which are handled using a sharp interface immersed boundary method, undergoing large movements as well as arbitrary relative motions. The new framework extends the previous overset CURVIB method with fixed overset grids and a sequential grid assembly to moving overset grids with an efficient parallel grid assembly. In addition, a new method for the interpolation of variables at the grid boundaries is developed which can drastically decrease the execution time and increase the parallel efficiency of our framework compared to the previous strategy. The moving rotating overset grids are solved in a non inertial frame of reference to avoid recalculating the curvilinear metrics of transformation while the background stationary grids are solved in the inertial frame. The new framework is verified and validated against experimental data, and analytical benchmark solutions. In addition, the results of the overset grid are compared with results over a similar single grid. The method is shown to be 2nd order accurate, decrease the computational cost relative to a single grid, and good overall parallel speedup. The grid assembly takes less than 7 of the total CPU time even at the highest number of CPUs tested in this work. The capabilities of our method are demonstrated by simulating the flow past a school of self propelled aquatic swimmers arranged initially in a diamond pattern.


Adversarial Examples in Constrained Domains. Machine learning algorithms have been shown to be vulnerable to adversarial manipulation through systematic modification of inputs (e.g., adversarial examples) in domains such as image recognition. Under the default threat model, the adversary exploits the unconstrained nature of images each feature (pixel) is fully under control of the adversary. However, it is not clear how these attacks translate to constrained domains that limit which and how features can be modified by the adversary (e.g., network intrusion detection). In this paper, we explore whether constrained domains are less vulnerable than unconstrained domains to adversarial example generation algorithms. We create an algorithm for generating adversarial sketches targeted universal perturbation vectors which encode feature saliency within the envelope of domain constraints. To assess how these algorithms perform, we evaluate them in constrained (e.g., network intrusion detection) and unconstrained (e.g., image recognition) domains. The results demonstrate that our approaches generate misclassification rates in constrained domains that were comparable to those of unconstrained domains (greater than 95 ). Our investigation shows that the narrow attack surface exposed by constrained domains is still sufficiently large to craft successful adversarial examples and thus, constraints do not appear to make a domain robust. Indeed, with as little as five randomly selected features, one can still generate adversarial examples.


Average Bias and Polynomial Sources. We identify a new notion of pseudorandomness for randomness sources, which we call the average bias. Given a distribution Z over 0,1 n , its average bias is b text av (Z) 2 n sum c in 0,1 n mathbb E z sim Z ( 1) langle c, z rangle . A source with average bias at most 2 k has min entropy at least k , and so low average bias is a stronger condition than high min entropy. We observe that the inner product function is an extractor for any source with average bias less than 2 n 2 . The notion of average bias especially makes sense for polynomial sources, i.e., distributions sampled by low degree n variate polynomials over mathbb F 2 . For the well studied case of affine sources, it is easy to see that min entropy k is exactly equivalent to average bias of 2 k . We show that for quadratic sources, min entropy k implies that the average bias is at most 2 Omega( sqrt k ) . We use this relation to design dispersers for separable quadratic sources with a min entropy guarantee.


From a discrete model of chemotaxis with volume filling to a generalised Patlak Keller Segel model. We present a discrete model of chemotaxis whereby cells responding to a chemoattractant are seen as individual agents whose movement is described through a set of rules that result in a biased random walk. In order to take into account possible alterations in cellular motility observed at high cell densities (i.e. volume filling), we let the probabilities of cell movement be modulated by a decaying function of the cell density. We formally show that a general form of the celebrated Patlak Keller Segel (PKS) model of chemotaxis can be formally derived as the appropriate continuum limit of this discrete model. The family of steady state solutions of such a generalised PKS model are characterised and the conditions for the emergence of spatial patterns are studied via linear stability analysis. Moreover, we carry out a systematic quantitative comparison between numerical simulations of the discrete model and numerical solutions of the corresponding PKS model, both in one and in two spatial dimensions. The results obtained indicate that there is excellent quantitative agreement between the spatial patterns produced by the two models. Finally, we numerically show that the outcomes of the two models faithfully replicate those of the classical PKS model in a suitable asymptotic regime.


Event based Star Tracking via Multiresolution Progressive Hough Transforms. Star trackers are state of the art attitude estimation devices which function by recognising and tracking star patterns. Most commercial star trackers use conventional optical sensors. A recent alternative is to use event sensors, which could enable more energy efficient and faster star trackers. However, this demands new algorithms that can efficiently cope with high speed asynchronous data, and are feasible on resource constrained computing platforms. To this end, we propose an event based processing approach for star tracking. Our technique operates on the event stream from a star field, by using multiresolution Hough Transforms to time progressively integrate event data and produce accurate relative rotations. Optimisation via rotation averaging is then used to fuse the relative rotations and jointly refine the absolute orientations. Our technique is designed to be feasible for asynchronous operation on standard hardware. Moreover, compared to state of the art event based motion estimation schemes, our technique is much more efficient and accurate.


Layer wise training convolutional neural networks with smaller filters for human activity recognition using wearable sensors. Recently, convolutional neural networks (CNNs) have set latest state of the art on various human activity recognition (HAR) datasets. However, deep CNNs often require more computing resources, which limits their applications in embedded HAR. Although many successful methods have been proposed to reduce memory and FLOPs of CNNs, they often involve special network architectures designed for visual tasks, which are not suitable for deep HAR tasks with time series sensor signals, due to remarkable discrepancy. Therefore, it is necessary to develop lightweight deep models to perform HAR. As filter is the basic unit in constructing CNNs, it deserves further research whether re designing smaller filters is applicable for deep HAR. In the paper, inspired by the idea, we proposed a lightweight CNN using Lego filters for HAR. A set of lower dimensional filters is used as Lego bricks to be stacked for conventional filters, which does not rely on any special network structure. The local loss function is used to train model. To our knowledge, this is the first paper that proposes lightweight CNN for HAR in ubiquitous and wearable computing arena. The experiment results on five public HAR datasets, UCI HAR dataset, OPPORTUNITY dataset, UNIMIB SHAR dataset, PAMAP2 dataset, and WISDM dataset collected from either smartphones or multiple sensor nodes, indicate that our novel Lego CNN with local loss can greatly reduce memory and computation cost over CNN, while achieving higher accuracy. That is to say, the proposed model is smaller, faster and more accurate. Finally, we evaluate the actual performance on an Android smartphone.


Learning Preferences and Demands in Visual Recommendation. Visual information is an important factor in recommender systems, in which users' selections consist of two components emph preferences and emph demands . Some studies has been done for modeling users' preferences in visual recommendation. However, conventional methods models items in a common visual feature space, which may fail in capturing emph styles of items. We propose a DeepStyle method for learning style features of items. DeepStyle eliminates the categorical information of items, which is dominant in the original visual feature space, based on a Convolutional Neural Networks (CNN) architecture. For modeling users' demands on different categories of items, the problem can be formulated as recommendation with contextual and sequential information. To solve this problem, we propose a Context Aware Gated Recurrent Unit (CA GRU) method, which can capture sequential and contextual information simultaneously. Furthermore, the aggregation of prediction on preferences and demands, i.e., prediction generated by DeepStyle and CA GRU, can model users' selection behaviors more completely. Experiments conducted on real world datasets illustrates the effectiveness of our proposed methods in visual recommendation.


LoRa beyond ALOHA An Investigation of Alternative Random Access Protocols. We present a stochastic geometry based model to investigate alternative medium access choices for LoRaWAN a widely adopted low power wide area networking (LPWAN) technology for the Internet of things (IoT). LoRaWAN adoption is driven by its simplified network architecture, air interface, and medium access. The physical layer, known as LoRa, provides quasi orthogonal virtual channels through spreading factors (SFs) and time power capture gains. However, the adopted pure ALOHA access mechanism suffers, in terms of scalability, under the same channel same SF transmissions from a large number of devices. In this paper, our objective is to explore access mechanisms beyond ALOHA for LoRaWAN. Using recent results on time and power capture effects of LoRa, we develop a unified model for the comparative study of other choices, i.e., slotted ALOHA and carrier sense multiple access (CSMA). The model includes the necessary design parameters of these access mechanisms, such as guard time and synchronization accuracy for slotted ALOHA, carrier sensing threshold for CSMA. It also accounts for the spatial interaction of devices in annular shaped regions, characteristic of LoRa, for CSMA. The performance derived from the model in terms of coverage probability, channel throughput, and energy efficiency are validated using Monte Carlo simulations. Our analysis shows that slotted ALOHA indeed has higher reliability than pure ALOHA but at the cost of lower energy efficiency for low device densities. Whereas, CSMA outperforms slotted ALOHA at smaller SFs in terms of reliability and energy efficiency, with its performance degrading to pure ALOHA at higher SFs.


What does BERT know about books, movies and music? Probing BERT for Conversational Recommendation. Heavily pre trained transformer models such as BERT have recently shown to be remarkably powerful at language modelling by achieving impressive results on numerous downstream tasks. It has also been shown that they are able to implicitly store factual knowledge in their parameters after pre training. Understanding what the pre training procedure of LMs actually learns is a crucial step for using and improving them for Conversational Recommender Systems (CRS). We first study how much off the shelf pre trained BERT "knows" about recommendation items such as books, movies and music. In order to analyze the knowledge stored in BERT's parameters, we use different probes that require different types of knowledge to solve, namely content based and collaborative based. Content based knowledge is knowledge that requires the model to match the titles of items with their content information, such as textual descriptions and genres. In contrast, collaborative based knowledge requires the model to match items with similar ones, according to community interactions such as ratings. We resort to BERT's Masked Language Modelling head to probe its knowledge about the genre of items, with cloze style prompts. In addition, we employ BERT's Next Sentence Prediction head and representations' similarity to compare relevant and non relevant search and recommendation query document inputs to explore whether BERT can, without any fine tuning, rank relevant items first. Finally, we study how BERT performs in a conversational recommendation downstream task. Overall, our analyses and experiments show that (i) BERT has knowledge stored in its parameters about the content of books, movies and music (ii) it has more content based knowledge than collaborative based knowledge and (iii) fails on conversational recommendation when faced with adversarial data.


Prototyping of Open Source NB IoT Network. Narrowband Internet of Things (NB IoT) is one of the major access technologies proposed to support massive machine type communications (mMTC) services for the 5th generation (5G) mobile networks. Many emerging services and networking paradigms are expected to be developed on top of NB IoT networks. This paper summarizes the steps required to build up an open source narrowband Internet of Things (NB IoT) network. This work is a joint research and development (R D) result from industry and academic collaboration. The open source NB IoT enhanced Node B (eNB) is jointly developed by B COM and NTUST based on the well known OpenAirInterfaceTM (OAI) open source Long Term Evolution (LTE) eNB developed by EURECOM. The NB IoT eNB is successfully connected to an evolved packet core (EPC) developed by Nokia Bell Lab. We demonstrate how to use commercial off the shelf (COTS) NB IoT module to forward its sensing data to the Internet via the open source NB IoT network.


Representation stability for diagram algebras. We introduce stability categories for diagram algebras analogues to Randal Williams and Wahl's homogeneous categories. We use these to study representation stability properties of the Temperley Lieb algebras, the Brauer algebras, and the partition algebras.


Reconstruction of Protein Structures from Single Molecule Time Series. Single molecule experimental techniques track the real time dynamics of molecules by recording a small number of experimental observables. Following these observables provides a coarse grained, low dimensional representation of the conformational dynamics but does not furnish an atomistic representation of the instantaneous molecular structure. Takens' Delay Embedding Theorem asserts that, under quite general conditions, these low dimensional time series can contain sufficient information to reconstruct the full molecular configuration of the system up to an a priori unknown transformation. By combining Takens' Theorem with tools from statistical thermodynamics, manifold learning, artificial neural networks, and rigid graph theory, we establish an approach Single molecule TAkens Reconstruction (STAR) to learn this transformation and reconstruct molecular configurations from time series in experimentally measurable observables such as intramolecular distances accessible to single molecule F "orster resonance energy transfer. We demonstrate the approach in applications to molecular dynamics simulations of a C24H50 polymer chain and the artificial mini protein Chignolin. The trained models reconstruct molecular configurations from synthetic time series data in the head to tail molecular distances with atomistic root mean squared deviation accuracies better than 0.2 nm. This work demonstrates that it is possible to accurately reconstruct protein structures from time series in experimentally measurable observables and establishes the theoretical and algorithmic foundations to do so in applications to real experimental data.


Multi Fingered Grasp Planning via Inference in Deep Neural Networks. We propose a novel approach to multi fingered grasp planning leveraging learned deep neural network models. We train a voxel based 3D convolutional neural network to predict grasp success probability as a function of both visual information of an object and grasp configuration. We can then formulate grasp planning as inferring the grasp configuration which maximizes the probability of grasp success. In addition, we learn a prior over grasp configurations as a mixture density network conditioned on our voxel based object representation. We show that this object conditional prior improves grasp inference when used with the learned grasp success prediction network when compared to a learned, object agnostic prior, or an uninformed uniform prior. Our work is the first to directly plan high quality multi fingered grasps in configuration space using a deep neural network without the need of an external planner. We validate our inference method performing multi finger grasping on a physical robot. Our experimental results show that our planning method outperforms existing grasp planning methods for neural networks.


Optimization and stabilization of a kilohertz laser plasma accelerator. Laser plasma acceleration at kilohertz repetition rate has recently been shown to work in two different regimes, with pulse lengths of either 30 fs or 3.5 fs. We now report on a systematic study in which a large range of pulse durations and plasma densities were investigated through continuous tuning of the laser spectral bandwidth. Indeed, two LPA processes can be distinguished, where beams of the highest quality, with 5.4 pC charge and a spectrum peaked at 2 2.5 MeV are obtained with short pulses propagating in moderate plasma densities. Through Particle in Cell simulations the two different acceleration processes are thoroughly explained. Finally, we proceed to show the results of a 5 hour continuous and stable run of our LPA accelerator accumulating more than mathrm 18 times10 6 consecutive shots, with 2.6 pC charge and peaked 2.5 MeV spectrum. A parametric study of the influence of the laser driver energy through PIC simulations underlines that this unprecedented stability was obtained thanks to micro scale density gradient injection. Together, these results represent an important step towards stable laser plasma accelerated electron beams at kilohertz repetition rate.


Spectral distribution of random matrices from Mutually Unbiased Bases. We consider the random matrix obtained by picking vectors randomly from a large collection of mutually unbiased bases of mathbb C n , and prove that the spectral distribution converges to the Marchenko Pastur law. This shows that vectors in mutually unbiased bases behave like random vectors. This phenomenon is similar to that of binary linear codes of dual distance at least 5, which was studied in previous work.


CoT Decentralized Elastic Caches for Cloud Environments. Distributed caches are widely deployed to serve social networks and web applications at billion user scales. This paper presents Cache on Track (CoT), a decentralized, elastic, and predictive caching framework for cloud environments. CoT proposes a new cache replacement policy specifically tailored for small front end caches that serve skewed workloads. Front end servers use a heavy hitter tracking algorithm to continuously track the top k hot keys. CoT dynamically caches the hottest C keys out of the tracked keys. Our experiments show that CoT's replacement policy consistently outperforms the hit rates of LRU, LFU, and ARC for the same cache size on different skewed workloads. Also, algoname slightly outperforms the hit rate of LRU 2 when both policies are configured with the same tracking (history) size. CoT achieves server size load balance with 50 to 93.75 less front end cache in comparison to other replacement policies.


Self Training for Unsupervised Neural Machine Translation in Unbalanced Training Data Scenarios. Unsupervised neural machine translation (UNMT) that relies solely on massive monolingual corpora has achieved remarkable results in several translation tasks. However, in real world scenarios, massive monolingual corpora do not exist for some extremely low resource languages such as Estonian, and UNMT systems usually perform poorly when there is not adequate training corpus for one language. In this paper, we first define and analyze the unbalanced training data scenario for UNMT. Based on this scenario, we propose UNMT self training mechanisms to train a robust UNMT system and improve its performance in this case. Experimental results on several language pairs show that the proposed methods substantially outperform conventional UNMT systems.


Christoffel equation in the polarization variables. We formulate the classic Christoffel equation in the polarization variables and solve it for the slowness vectors of plane waves corresponding to a given unit polarization vector. Our analysis shows that, unless the equation degenerates and yields an infinite number of different slowness vectors, the finite nonzero number of its legitimate solutions varies from 1 to 4. Also we find a subset of triclinic solids in which the polarization field can have holes there exist finite size solid angles of polarization directions unattainable to any plane wave.


On the Count Probability of Many Correlated Symmetric Events. We consider N events that are defined on a common probability space. Those events shell have a common probability function that is symmetric with respect to interchanging the events. We ask for the probability distribution of the number of events that occur. If the probability of a single event is proportional to 1 N the resulting count probability is Poisson distributed in the limit of N rightarrow infty for independent events. In this paper we calculate the characteristic function of the limiting count probability distribution for events that are correlated up to an arbitrary but finite order.


Triposes as a Generalization of Localic Geometric Morphisms. We discuss how triposes may be understood as generalizations of localic geometric morphisms.


A universal form of arrays with spectral singularities. An array of non Hermitian optical waveguides can operate as a laser or as a coherent perfect absorber, which corresponds to a spectral singularity of the underlying discrete complex potential. We show that all lattice potentials with spectral singularities are characterized by the universal form of the gain and loss distribution. Using this result we systematically construct potentials characterized by several spectral singularities at arbitrary wavelengths, as well as potentials with second order spectral singularities in their spectra. Higher order spectral singularities demonstrate a greatly enhanced response to incident beams resulting in the excitation of high intensity lasing modes.


Flower Interaction Subsystem for a Precision Pollination Robot. Robotic pollinators not only can aid farmers by providing more cost effective and stable methods for pollinating plants but also benefit crop production in environments not suitable for bees such as greenhouses, growth chambers, and in outer space. Robotic pollination requires a high degree of precision and autonomy but few systems have addressed both of these aspects in practice. In this paper, a fully autonomous robot is presented, capable of precise pollination of individual small flowers. Experimental results show that the proposed system is able to achieve a 93.1 detection accuracy and a 76.9 'pollination' success rate tested with high fidelity artificial flowers.


3D Aggregated Faster R CNN for General Lesion Detection. Lesions are damages and abnormalities in tissues of the human body. Many of them can later turn into fatal diseases such as cancers. Detecting lesions are of great importance for early diagnosis and timely treatment. To this end, Computed Tomography (CT) scans often serve as the screening tool, allowing us to leverage the modern object detection techniques to detect the lesions. However, lesions in CT scans are often small and sparse. The local area of lesions can be very confusing, leading the region based classifier branch of Faster R CNN easily fail. Therefore, most of the existing state of the art solutions train two types of heterogeneous networks (multi phase) separately for the candidate generation and the False Positive Reduction (FPR) purposes. In this paper, we enforce an end to end 3D Aggregated Faster R CNN solution by stacking an "aggregated classifier branch" on the backbone of RPN. This classifier branch is equipped with Feature Aggregation and Local Magnification Layers to enhance the classifier branch. We demonstrate our model can achieve the state of the art performance on both LUNA16 and DeepLesion dataset. Especially, we achieve the best single model FROC performance on LUNA16 with the inference time being 4.2s per processed scan.


Using Relational Problems to Teach Property Based Testing. Context The success of QuickCheck has led to the development of property based testing (PBT) libraries for many languages and the process is getting increasing attention. However, unlike regular testing, PBT is not widespread in collegiate curricula. Furthermore, the value of PBT is not limited to software testing. The growing use of formal methods in, and the growth of software synthesis, all create demand for techniques to train students and developers in the art of specification writing. We posit that PBT forms a strong bridge between testing and the act of specification it's a form of testing where the tester is actually writing abstract specifications. Inquiry Even well informed technologists mention the difficulty of finding good motivating examples for its use. We take steps to fill this lacuna. Approach Knowledge We find that the use of "relational" problems those for which an input may admit multiple valid outputs easily motivates the use of PBT. We also notice that such problems are readily available in the computer science pantheon of problems (e.g., many graph and sorting algorithms). We have been using these for some years now to teach PBT in collegiate courses. Grounding In this paper, we describe the problems we use and report on students? completion of them. We believe the problems overcome some of the motivation issues described above. We also show that students can do quite well at PBT for these problems, suggesting that the topic is well within their reach. In the process, we introduce a simple method to evaluate the accuracy of their specifications, and use it to characterize their common mistakes. Importance Based on our findings, we believe that relational problems are an underutilized motivating example for PBT. We hope this paper initiates a catalog of such problems for educators (and developers) to use, and also provides a concrete (though by no means exclusive) method to analyze the quality of PBT.


Existence of Regular Nut Graphs and the Fowler Construction. In this paper the problem of the existence of regular nut graphs is addressed. A generalization of Fowler's Construction which is a local enlargement applied to a vertex in a graph is introduced to generate nut graphs of higher order. Let N( rho) denote the set of integers n such that there exists a regular nut graph of degree rho and order n . It is proven that N(3) 12 cup 2k k geq 9 and that N(4) 8,10,12 cup n n geq 14 . The problem of determining N( rho) for rho 4 remains completely open.


The Kronecker Weyl equidistribution theorem and geodesics in 3 manifolds. Given any rectangular polyhedron 3 manifold P tiled with unit cubes, we find infinitely many explicit directions related to cubic algebraic numbers such that all half infinite geodesics in these directions are uniformly distributed in P .


Direct and inverse approximation theorems of functions in the Musielak Orlicz type spaces. In Musilak Orlicz type spaces mathcal S bf M , direct and inverse approximation theorems are obtained in terms of the best approximations of functions and generalized moduli of smoothness. The question of the exact constants in Jackson type inequalities is studied.


Zeroth Order Regularized Optimization (ZORO) Approximately Sparse Gradients and Adaptive Sampling. We consider the problem of minimizing a high dimensional objective function, which may include a regularization term, using (possibly noisy) evaluations of the function. Such optimization is also called derivative free, zeroth order, or black box optimization. We propose a new textbf Z eroth textbf O rder textbf R egularized textbf O ptimization method, dubbed ZORO. When the underlying gradient is approximately sparse at an iterate, ZORO needs very few objective function evaluations to obtain a new iterate that decreases the objective function. We achieve this with an adaptive, randomized gradient estimator, followed by an inexact proximal gradient scheme. Under a novel approximately sparse gradient assumption and various different convex settings, we show the (theoretical and empirical) convergence rate of ZORO is only logarithmically dependent on the problem dimension. Numerical experiments show that ZORO outperforms the existing methods with similar assumptions, on both synthetic and real datasets.


Neighborhood Watch Representation Learning with Local Margin Triplet Loss and Sampling Strategy for K Nearest Neighbor Image Classification. Deep representation learning using triplet network for classification suffers from a lack of theoretical foundation and difficulty in tuning both the network and classifiers for performance. To address the problem, local margin triplet loss along with local positive and negative mining strategy is proposed with theory on how the strategy integrate nearest neighbor hyper parameter with triplet learning to increase subsequent classification performance. Results in experiments with 2 public datasets, MNIST and Cifar 10, and 2 small medical image datasets demonstrate that proposed strategy outperforms end to end softmax and typical triplet loss in settings without data augmentation while maintaining utility of transferable feature for related tasks. The method serves as a good performance baseline where end to end methods encounter difficulties such as small sample data with limited allowable data augmentation.


UTxO vs account based smart contract blockchain programming paradigms. We implement two versions of a simple but illustrative smart contract one in Solidity on the Ethereum blockchain platform, and one in Plutus on the Cardano platform, with annotated code excerpts and with source code attached. We get a clearer view of the Cardano programming model in particular by introducing a novel mathematical abstraction which we call Idealised EUTxO. For each version of the contract, we trace how the architectures of the underlying platforms and their mathematics affects the natural programming styles and natural classes of errors. We prove some simple but novel results about alpha conversion and observational equivalence for Cardano, and explain why Ethereum does not have them. We conclude with a wide ranging and detailed discussion in the light of the examples, mathematical model, and mathematical results so far.


A Globally Convergent Newton Method for Polynomials. Newton's method for polynomial root finding is one of mathematics' most well known algorithms. The method also has its shortcomings it is undefined at critical points, it could exhibit chaotic behavior and is only guaranteed to converge locally. Based on the it Geometric Modulus Principle for a complex polynomial p(z) , together with a it Modulus Reduction Theorem proved here, we develop the it Robust Newton's method (RNM), defined everywhere with a step size that guarantees an it a priori reduction in polynomial modulus in each iteration. Furthermore, we prove RNM iterates converge globally, either to a root or a critical point. Specifically, given varepsilon and any seed z 0 , in t O(1 varepsilon 2 ) iterations of RNM, independent of degree of p(z) , either p(z t) leq varepsilon or p(z t) p'(z t) leq varepsilon . By adjusting the iterates at it near critical points , we describe a it modified RNM that necessarily convergence to a root. In combination with Smale's point estimation, RNM results in a globally convergent Newton's method having a locally quadratic rate. We present sample polynomiographs that demonstrate how in contrast with Newton's method RNM smooths out the fractal boundaries of basins of attraction of roots. RNM also finds potentials in computing all roots of arbitrary degree polynomials. A particular consequence of RNM is a simple algorithm for solving cubic equations.


A Stay in a Set Game without a Stationary Equilibrium. We give an example of a finite state two player turn based stochastic game with safety objectives for both players which has no stationary Nash equilibrium. This answers an open question of Secchi and Sudderth.


On the geometry of sharply 2 transitive groups. We show that the geometry associated to certain non split sharply 2 transitive groups does not contain a proper projective plane. For a sharply 2 transitive group of finite Morley rank we improve known rank inequalities for this geometry and conclude that a sharply 2 transitive group of Morley rank 6 must be of the form K rtimes K for some algebraically closed field K .


Communication Efficient String Sorting. There has been surprisingly little work on algorithms for sorting strings on distributed memory parallel machines. We develop efficient algorithms for this problem based on the multi way merging principle. These algorithms inspect only characters that are needed to determine the sorting order. Moreover, communication volume is reduced by also communicating (roughly) only those characters and by communicating repetitions of the same prefixes only once. Experiments on up to 1280 cores reveal that these algorithm are often more than five times faster than previous algorithms.


Situational Fusion of Visual Representation for Visual Navigation. A complex visual navigation task puts an agent in different situations which call for a diverse range of visual perception abilities. For example, to "go to the nearest chair", the agent might need to identify a chair in a living room using semantics, follow along a hallway using vanishing point cues, and avoid obstacles using depth. Therefore, utilizing the appropriate visual perception abilities based on a situational understanding of the visual environment can empower these navigation models in unseen visual environments. We propose to train an agent to fuse a large set of visual representations that correspond to diverse visual perception abilities. To fully utilize each representation, we develop an action level representation fusion scheme, which predicts an action candidate from each representation and adaptively consolidate these action candidates into the final action. Furthermore, we employ a data driven inter task affinity regularization to reduce redundancies and improve generalization. Our approach leads to a significantly improved performance in novel environments over ImageNet pretrained baseline and other fusion methods.


Turn key, high efficiency Kerr comb source. We demonstrate an approach for automated Kerr comb generation in the normal group velocity dispersion (GVD) regime. Using a coupled ring geometry in silicon nitride, we precisely control the wavelength location and splitting strength of avoided mode crossings to generate low noise frequency combs with pump to comb conversion efficiencies of up to 41 , which is the highest reported to date for normal GVD Kerr combs. Our technique enables on demand generation of a high power comb source for applications such as wavelength division multiplexing in optical communications.


A Turing Kernelization Dichotomy for Structural Parameterizations of mathcal F Minor Free Deletion. For a fixed finite family of graphs mathcal F , the mathcal F Minor Free Deletion problem takes as input a graph G and an integer ell and asks whether there exists a set X subseteq V(G) of size at most ell such that G X is mathcal F minor free. For mathcal F K 2 and mathcal F K 3 this encodes Vertex Cover and Feedback Vertex Set respectively. When parameterized by the feedback vertex number of G these two problems are known to admit a polynomial kernelization. Such a polynomial kernelization also exists for any mathcal F containing a planar graph but no forests. In this paper we show that mathcal F Minor Free Deletion parameterized by the feedback vertex number is MK 2 hard for mathcal F P 3 . This rules out the existence of a polynomial kernel assuming NP subseteq coNP poly , and also gives evidence that the problem does not admit a polynomial Turing kernel. Our hardness result generalizes to any mathcal F not containing a P 3 subgraph free graph, using as parameter the vertex deletion distance to treewidth mintw( mathcal F ) , where mintw( mathcal F ) denotes the minimum treewidth of the graphs in mathcal F . For the other case, where mathcal F contains a P 3 subgraph free graph, we present a polynomial Turing kernelization. Our results extend to mathcal F Subgraph Free Deletion.


The Symbiotic Contact Process. We consider a contact process on Z d with two species that interact in a symbiotic manner. Each site can either be vacant or occupied by individuals of species A and or B . Multiple occupancy by the same species at a single site is prohibited. The name symbiotic comes from the fact that if only one species is present at a site then that particle dies with rate 1 but if both species are present then the death rate is reduced to mu le 1 for each particle at that site. We show the critical birth rate lambda c( mu) for weak survival is of order sqrt mu as mu to 0 . Mean field calculations predict that when mu 1 2 there is a discontinuous transition as lambda is varied. In contrast, we show that, in any dimension, the phase transition is continuous. To be fair to physicists the paper that introduced the model, the authors say that the symbiotic contact process is in the directed percolation universality class and hence has a continuous transition. However, a 2018 paper asserts that the transition is discontinuous above the upper critical dimension, which is 4 for oriented percolation.


On inclusion chromatic index of a graph. Let chi' subset(G) be the least number of colours necessary to properly colour the edges of a graph G with minimum degree delta geq 2 so that the set of colours incident with any vertex is not contained in a set of colours incident to any its neighbour. We provide an infinite family of examples of graphs G with chi' subset(G) geq (1 frac 1 delta 1 ) Delta , where Delta is the maximum degree of G , and we conjecture that chi' subset(G) leq lceil(1 frac 1 delta 1 ) Delta rceil for every connected graph with delta geq 2 which is not isomorphic to C 5 . The equality here is attained e.g. for the family of complete bipartite graphs. Using a probabilistic argument we support this conjecture by proving that for any fixed delta ge2 , chi' subset(G) le (1 frac 4 delta ) Delta (1 o(1)) (for Delta to infty ), what implies that chi' subset(G) le (1 frac 4 delta 1 ) Delta for Delta large enough.


Two dimensional PS2 a promising anode material for sodium ion batteries and a potential superconductor. Two dimensional materials as electrodes have shown unique advantages such as the infinite planar lengths, broad electrochemical window, and much exposed active sites. In this work, by means of density functional theory computations, we demonstrate that two dimensional PS2 with the 1T Type structure as many two dimensional disulfides is a promising anode material for sodium ion batteries application. Different from many two dimensional disulfides (e.g. MoS2, TiS2, CrS2) compounds that are semiconducting, PS2 monolayer exhibits metallic character with considerable electronic states at the Fermi level, which can provide good electrical conductivity during the battery cycle and also suggest the potential superconductivity. Remarkably, PS2 monolayer has a considerably high theoretical capacity of 1692 mAh g, a rather small sodium diffusion barrier of 0.17 eV, and a low average open circuit voltage of 0.18 V. These results suggest that PS2 monolayer can be utilized as a promising anode material for the application in sodium ion batteries with high power density and fast charge discharge rates. In addition, estimated by first principle calculations, PS2 is found to be an intrinsic phonon mediated superconductor with a relatively high critical superconducting temperature of about 10 K.


Fair Clustering with Multiple Colors. A fair clustering instance is given a data set A in which every point is assigned some color. Colors correspond to various protected attributes such as sex, ethnicity, or age. A fair clustering is an instance where membership of points in a cluster is uncorrelated with the coloring of the points. Of particular interest is the case where all colors are equally represented. If we have exactly two colors, Chierrichetti, Kumar, Lattanzi and Vassilvitskii (NIPS 2017) showed that various k clustering objectives admit a constant factor approximation. Since then, a number of follow up work has attempted to extend this result to a multi color case, though so far, the only known results either result in no constant factor approximation, apply only to special clustering objectives such as k center, yield bicrititeria approximations, or require k to be constant. In this paper, we present a simple reduction from unconstrained k clustering to fair k clustering for a large range of clustering objectives including k median, k means, and k center. The reduction loses only a constant factor in the approximation guarantee, marking the first true constant factor approximation for many of these problems.


Impact of Information Placement and User Representations in VR on Performance and Embodiment. Human sensory processing is sensitive to the proximity of stimuli to the body. It is therefore plausible that these perceptual mechanisms also modulate the detectability of content in VR, depending on its location. We evaluate this in a user study and further explore the impact of the user's representation during interaction. We also analyze how embodiment and motor performance are influenced by these factors. In a dual task paradigm, participants executed a motor task, either through virtual hands, virtual controllers, or a keyboard. Simultaneously, they detected visual stimuli appearing in different locations. We found that, while actively performing a motor task in the virtual environment, performance in detecting additional visual stimuli is higher when presented near the user's body. This effect is independent of how the user is represented and only occurs when the user is also engaged in a secondary task. We further found improved motor performance and increased embodiment when interacting through virtual tools and hands in VR, compared to interacting with a keyboard. This study contributes to better understanding the detectability of visual content in VR, depending on its location in the virtual environment, as well as the impact of different user representations on information processing, embodiment, and motor performance.


Generalized Schur function determinants using the Bazin identity. In the literature there are several determinant formulas for Schur functions the Jacobi Trudi formula, the dual Jacobi Trudi formula, the Giambelli formula, the Lascoux Pragacz formula, and the Hamel Goulden formula, where the Hamel Goulden formula implies the others. In this paper we use an identity proved by Bazin in 1851 to derive determinant identities involving Macdonald's 9th variation of Schur functions. As an application we prove a determinant identity for factorial Schur functions conjectured by Morales, Pak, and Panova. We also obtain a generalization of the Hamel Goulden formula, which contains a result of Jin, and prove a converse of the Hamel Goulden theorem and its generalization.


On a thin film model with insoluble surfactant. This paper studies the existence and asymptotic behavior of global weak solutions for a thin film equation with insoluble surfactant under the influence of gravitational, capillary and van der Waals forces. We prove the existence of global weak solutions for emph medium sized initial data in emph large function spaces . Moreover, exponential decay towards the flat equilibrium state is established, where an estimate on the decay rate can be computed explicitly.


Multi layer Optimizations for End to End Data Analytics. We consider the problem of training machine learning models over multi relational data. The mainstream approach is to first construct the training dataset using a feature extraction query over input database and then use a statistical software package of choice to train the model. In this paper we introduce Iterative Functional Aggregate Queries (IFAQ), a framework that realizes an alternative approach. IFAQ treats the feature extraction query and the learning task as one program given in the IFAQ's domain specific language, which captures a subset of Python commonly used in Jupyter notebooks for rapid prototyping of machine learning applications. The program is subject to several layers of IFAQ optimizations, such as algebraic transformations, loop transformations, schema specialization, data layout optimizations, and finally compilation into efficient low level C code specialized for the given workload and data. We show that a Scala implementation of IFAQ can outperform mlpack, Scikit, and TensorFlow by several orders of magnitude for linear regression and regression tree models over several relational datasets.


Perfect 2 colorings of the generalized Petersen graph GP(n,3). In this paper we enumerate the parameter matrices of all perfect 2 colorings of the generalized Petersen graphs GP(n 3), where n 7. We also give some basic results for GP(n k).