Optimal Join Algorithms Meet Top k. Top k queries have been studied intensively in the database community and they are an important means to reduce query cost when only the "best" or "most interesting" results are needed instead of the full output. While some optimality results exist, e.g., the famous Threshold Algorithm, they hold only in a fairly limited model of computation that does not account for the cost incurred by large intermediate results and hence is not aligned with typical database optimizer cost models. On the other hand, the idea of avoiding large intermediate results is arguably the main goal of recent work on optimal join algorithms, which uses the standard RAM model of computation to determine algorithm complexity. This research has created a lot of excitement due to its promise of reducing the time complexity of join queries with cycles, but it has mostly focused on full output computation. We argue that the two areas can and should be studied from a unified point of view in order to achieve optimality in the common model of computation for a very general class of top k style join queries. This tutorial has two main objectives. First, we will explore and contrast the main assumptions, concepts, and algorithmic achievements of the two research areas. Second, we will cover recent, as well as some older, approaches that emerged at the intersection to support efficient ranked enumeration of join query results. These are related to classic work on k shortest path algorithms and more general optimization problems, some of which dates back to the 1950s. We demonstrate that this line of research warrants renewed attention in the challenging context of ranked enumeration for general join queries.


Variational approximation of functionals defined on 1 dimensional connected sets in mathbb R n . In this paper we consider the Euclidean Steiner tree problem and, more generally, (single sink) Gilbert Steiner problems as prototypical examples of variational problems involving 1 dimensional connected sets in mathbb R n . Following the the analysis for the planar case presented in 4 , we provide a variational approximation through Ginzburg Landau type energies proving a Gamma convergence result for n geq 3 .


A Critical View on CIS Controls. CIS Controls is a set of 20 controls and 171 sub controls that were created with an idea of having a list of something to implement so that organizations can increase their security. While good in theory, it is a big question of how viable this approach is in practice, and does it really help. There is only a minor number of critical views of CIS Controls and since CIS Controls are marketed by two very influential organizations they are very popular. Yet, there are alternatives published by ISO, NIST and even PCI consortium. In this paper we critically assess CIS Controls, assumptions on which they are based as well as validity of approach and claims made in its favor. The conclusion is that scientific community should be more active regarding this topic, but also that more material is necessary. This is something that CIS and SANS should support if they want to make CIS Controls viable alternative to other approaches.


A motivic Segal theorem for open pairs of smooth schemes over an infinite perfect field. V. Voevodsyky laid the groundwork of delooping motivic spaces in order to provide a new, more computation friendly, construction of the stable motivic category SH(k) , G. Garkusha and I. Panin made that project a reality, while collaborating with A. Ananievsky, A. Neshitov and A. Druzhinin. In particular, G. Garkusha and I. Panin proved that for an infinite perfect field k and any k smooth scheme X the canonical morphism of motivic spaces C Fr(X) to Omega infty mathbb P 1 Sigma infty mathbb P 1 (X ) is Nisnevich locally a group completion. In the present work, a generalisation of that theorem to the case of smooth open pairs (X,U), where X is a k smooth scheme, U is its open subscheme intersecting each component of X in a nonempty subscheme. We claim that in this case the motivic space C Fr((X,U)) is Nisnevich locally connected, and the motivic space morphism C Fr((X,U)) to Omega infty mathbb P 1 Sigma infty mathbb P 1 (X U) is Nisnevich locally a weak equivalence. Moreover, we show that if the codimension of S X U in each component of X is greater than r geq 0, the simplicial sheaf C Fr((X,U)) is locally r connected.


A power sum formula by Carlitz and its applications to permutation rational functions of finite fields. A formula discovered by L. Carlitz in 1935 finds an interesting application in permutation rational functions of finite fields. It allows us to determine all rational functions of degree three that permute the projective line Bbb P 1( Bbb F q) over Bbb F q , a result previously obtained by Ferraguti and Micheli through a different method. It also allows us to determine all rational functions of degree four that permute Bbb P 1( Bbb F q) under a certain condition. (A complete determination of all rational functions of degree four that permute Bbb P 1( Bbb F q) without any condition will appear in a separate forthcoming paper.)


Total Roman Domination Edge Critical Graphs. A total Roman dominating function on a graph G is a function f V(G) rightarrow 0,1,2 such that every vertex v with f(v) 0 is adjacent to some vertex u with f(u) 2 , and the subgraph of G induced by the set of all vertices w such that f(w) 0 has no isolated vertices. The weight of f is Sigma v in V(G) f(v) . The total Roman domination number gamma tR (G) is the minimum weight of a total Roman dominating function on G . A graph G is k gamma tR edge critical if gamma tR (G e) gamma tR (G) k for every edge e in E( overline G ) neq emptyset , and k gamma tR edge supercritical if it is k gamma tR edge critical and gamma tR (G e) gamma tR (G) 2 for every edge e in E( overline G ) neq emptyset . We present some basic results on gamma tR edge critical graphs and characterize certain classes of gamma tR edge critical graphs. In addition, we show that, when k is small, there is a connection between k gamma tR edge critical graphs and graphs which are critical with respect to the domination and total domination numbers.


PRSNet Part Relation and Selection Network for Bone Age Assessment. Bone age is one of the most important indicators for assessing bone's maturity, which can help to interpret human's growth development level and potential progress. In the clinical practice, bone age assessment (BAA) of X ray images requires the joint consideration of the appearance and location information of hand bones. These kinds of information can be effectively captured by the relation of different anatomical parts of hand bone. Recently developed methods differ mostly in how they model the part relation and choose useful parts for BAA. However, these methods neglect the mining of relationship among different parts, which can help to improve the assessment accuracy. In this paper, we propose a novel part relation module, which accurately discovers the underlying concurrency of parts by using multi scale context information of deep learning feature representation. Furthermore, based on the part relation, we explore a new part selection module, which comprehensively measures the importance of parts and select the top ranking parts for assisting BAA. We jointly train our part relation and selection modules in an end to end way, achieving state of the art performance on the public RSNA 2017 Pediatric Bone Age benchmark dataset and outperforming other competitive methods by a significant margin.


Control Flow Obfuscation for FJ using Continuation Passing. Control flow obfuscation deters software reverse engineering attempts by altering the program's control flow transfer. The alternation should not affect the software's run time behaviour. In this paper, we propose a control flow obfuscation approach for FJ with exception handling. The approach is based on a source to source transformation using continuation passing style (CPS). We argue that the proposed CPS transformation causes malicious attacks using context insensitive static analysis and context sensitive analysis with fixed call string to lose precision.


Fast optical absorption spectra calculations for periodic solid state systems. We present a method to construct an efficient approximation to the bare exchange and screened direct interaction kernels of the Bethe Salpeter Hamiltonian for periodic solid state systems via the interpolative separable density fitting technique. We show that the cost of constructing the approximate Bethe Salpeter Hamiltonian scales nearly optimally as mathcal O (N k) with respect to the number of samples in the Brillouin zone N k . In addition, we show that the cost for applying the Bethe Salpeter Hamiltonian to a vector scales as mathcal O (N k log N k) . Therefore the optical absorption spectrum, as well as selected excitation energies can be efficiently computed via iterative methods such as the Lanczos method. This is a significant reduction from the mathcal O (N k 2) and mathcal O (N k 3) scaling associated with a brute force approach for constructing the Hamiltonian and diagonalizing the Hamiltonian respectively. We demonstrate the efficiency and accuracy of this approach with both one dimensional model problems and three dimensional real materials (graphene and diamond). For the diamond system with N k 2197 , it takes 6 hours to assemble the Bethe Salpeter Hamiltonian and 4 hours to fully diagonalize the Hamiltonian using 169 cores when the brute force approach is used. The new method takes less than 3 minutes to set up the Hamiltonian and 24 minutes to compute the absorption spectrum on a single core.


A Chinese Corpus for Fine grained Entity Typing. Fine grained entity typing is a challenging task with wide applications. However, most existing datasets for this task are in English. In this paper, we introduce a corpus for Chinese fine grained entity typing that contains 4,800 mentions manually labeled through crowdsourcing. Each mention is annotated with free form entity types. To make our dataset useful in more possible scenarios, we also categorize all the fine grained types into 10 general types. Finally, we conduct experiments with some neural models whose structures are typical in fine grained entity typing and show how well they perform on our dataset. We also show the possibility of improving Chinese fine grained entity typing through cross lingual transfer learning.


Co uniform and hollow S acts over monoids. In this paper, we first introduce the notions of superfluous and coessential subacts. Then hollow and co uniform S acts are defined as the acts that all proper subacts are superfluous and coessential, respectively. Also it is indicated that the class of hollow S acts is properly between two classes of indecomposable and locally cyclic S acts. Moreover, using the notion of radical of an S act as the intersection of all maximal subact, the relations between hollow and local S acts are investigated. Ultimately, the notion of a supplement of a subact is defined to characterize the union of hollow S act.


A proof of Ringel's Conjecture. A typical decomposition question asks whether the edges of some graph G can be partitioned into disjoint copies of another graph H . One of the oldest and best known conjectures in this area, posed by Ringel in 1963, concerns the decomposition of complete graphs into edge disjoint copies of a tree. It says that any tree with n edges packs 2n 1 times into the complete graph K 2n 1 . In this paper, we prove this conjecture for large n .


FANTrack 3D Multi Object Tracking with Feature Association Network. We propose a data driven approach to online multi object tracking (MOT) that uses a convolutional neural network (CNN) for data association in a tracking by detection framework. The problem of multi target tracking aims to assign noisy detections to a priori unknown and time varying number of tracked objects across a sequence of frames. A majority of the existing solutions focus on either tediously designing cost functions or formulating the task of data association as a complex optimization problem that can be solved effectively. Instead, we exploit the power of deep learning to formulate the data association problem as inference in a CNN. To this end, we propose to learn a similarity function that combines cues from both image and spatial features of objects. Our solution learns to perform global assignments in 3D purely from data, handles noisy detections and a varying number of targets, and is easy to train. We evaluate our approach on the challenging KITTI dataset and show competitive results. Our code is available at https git.uwaterloo.ca wise lab fantrack.


Sub surface H2S detection by a Surface Acoustic Wave passive wireless sensor interrogated with a ground penetrating radar. Long term monitoring of organic pollutants in the soil is a major environmental challenge. We propose to meet this issue by the development of a polymer dedicated to selectively react with H2S, coating surface acoustic wave transducers designed as passive cooperative targets with the compound, and probing their response using Ground Penetrating RADAR, thus providing the capability to monitor the presence of H2S in the subsurface environment. The selectivity is brought by including lead(II) cation in a reticulated polymer matrix which can be deposited as a thin layer on a surface acoustic wave sensor. We demonstrate a signal enhancement mechanism in which water absorption magnifies the signal detection, making the sensor most sensitive to H2S in an underground environment saturated with moisture.


Power bounded operators and the mean ergodic theorem for subsequences. Let T be a power bounded Hilbert space operator without unimodular eigenvalues. We show that the subsequential ergodic averages N 1 sum n 1 N T a n converge in the strong operator topology for a wide range of sequences (a n) , including the integer part of most of subpolynomial Hardy functions. Moreover, we show that the weighted averages N 1 sum n 1 N e 2 pi i g(n) T a n also converge for many reasonable functions g . In particular, we generalize the polynomial mean ergodic theorem for power bounded operators due to ter Elst and the second author cite tEM to real polynomials and polynomial weights.


Tricontrollable pixelated metasurface for absorbing terahertz radiation. The incorporation of materials with controllable electromagnetic constitutive parameters allows the conceptualization and realization of controllable metasurfaces. With the aim of formulating and investigating a tricontrollable metasurface for efficiently absorbing terahertz radiation, we adopted a pixel based approach in which the meta atoms are biperiodic assemblies of discrete pixels. We patched some pixels with indium antimonide (InSb) and some with graphene, leaving the others unpatched. The bottom of each meta atom was taken to comprise a metal backed substrate of silicon nitride. The InSb patched pixels facilitate the thermal and magnetic control modalities, whereas the graphene patched pixels facilitate the electrical control modality. With proper configuration of patched and unpatched pixels and with proper selection of the patching material for each patched pixel, the absorptance spectrums of the pixelated metasurface were found to contain peak shaped features with maximum absorptance exceeding 0.95, full width at half maximum bandwidth of less than 0.7 THz, and the maximum absorptance frequency lying between 2 THz and 4 THz. The location of the maximum absorptance frequency can be thermally, magnetically, and electrically controllable. The lack of rotational invariance of the optimal meta atom adds mechanical rotation as the fourth control modality.


A residual a posteriori error estimate for the time domain boundary element method. This article investigates residual a posteriori error estimates and adaptive mesh refinements for time dependent boundary element methods for the wave equation. We obtain reliable estimates for Dirichlet and acoustic boundary conditions which hold for a large class of discretizations. Efficiency of the error estimate is shown for a natural discretization of low order. Numerical examples confirm the theoretical results. The resulting adaptive mesh refinement procedures in 3d recover the adaptive convergence rates known for elliptic problems.


C adl ag Rough Differential Equations with Reflecting Barriers. We investigate rough differential equations with a time dependent reflecting lower barrier, where both the driving (rough) path and the barrier itself may have jumps. Assuming the driving signals allow for Young integration, we provide existence, uniqueness and stability results. When the driving signal is a c adl ag p rough path for p in 2,3) , we establish existence to general reflected rough differential equations, as well as uniqueness in the one dimensional case.


Existence of solutions for Kirchhoff type fractional Dirichlet problem with p Laplacian. In this paper, we investigate the existence of solutions for a class of p Laplacian fractional order Kirchhoff type system with Riemann Liouville fractional derivatives and a parameter lambda . By mountain pass theorem, we obtain that system has at least one non trivial weak solution u lambda under some local superquadratic conditions for each given large parameter lambda . We get a concrete lower bound of the parameter lambda , and then obtain two estimates of weak solutions u lambda . We also obtain that u lambda to 0 if lambda tends to infty . Finally, we present an example as an application of our results.


Large deviation principles for stochastic volatility models with reflection and three faces of the Stein and Stein model. We introduce stochastic volatility models, in which the volatility is described by a time dependent nonnegative function of a reflecting diffusion. The idea to use reflecting diffusions as building blocks of the volatility came into being because of a certain volatility misspecification in the classical Stein and Stein model. A version of this model that uses the reflecting Ornstein Uhlenbeck process as the volatility process is a special example of a stochastic volatility model with reflection. The main results obtained in the present paper are sample path and small noise large deviation principles for the log price process in a stochastic volatility model with reflection under rather mild restrictions. We use these results to study the asymptotic behavior of binary barrier options and call prices in the small noise regime.


Posing Fair Generalization Tasks for Natural Language Inference. Deep learning models for semantics are generally evaluated using naturalistic corpora. Adversarial methods, in which models are evaluated on new examples with known semantic properties, have begun to reveal that good performance at these naturalistic tasks can hide serious shortcomings. However, we should insist that these evaluations be fair that the models are given data sufficient to support the requisite kinds of generalization. In this paper, we define and motivate a formal notion of fairness in this sense. We then apply these ideas to natural language inference by constructing very challenging but provably fair artificial datasets and showing that standard neural models fail to generalize in the required ways only task specific models that jointly compose the premise and hypothesis are able to achieve high performance, and even these models do not solve the task perfectly.


Performance Evaluation of VDI Environment. Virtualization technology is widely used for sharing the abilities of computer systems by splitting the resources among various virtual PCs. In traditional computer systems, the utilization of hardware is not maximized and the resources are not fully consumed. By using the virtualization technology, the maximum utilization of computer system hardware is possible. Today, many organizations especially educational institutes are adopting virtualization technology to minimize the costs and increase the flexibility, responsiveness, and efficiency. In this paper, we built a virtual educational lab in which we successfully implemented Virtual Desktop Infrastructure (VDI) and created more than 30 virtual desktops. The virtual desktops are created on the Citrix XenServer hypervisor using the Citrix XenDesktop. Finally, we used benchmarking software tool called Login VSI in order to measure the performance of the virtual desktop infrastructure and the XenServer hypervisor. The results have shown that the system performs well with 30 virtual desktops without reaching the saturation point.


Characterizing the Universal Rigidity of Generic Tensegrities. A tensegrity is a structure made from cables, struts and stiff bars. A d dimensional tensegirty is universally rigid if it is rigid in any dimension d' with d' geq d . The celebrated super stability condition due to Connelly gives a sufficient condition for a tensegrity to be universally rigid. Gortler and Thurston showed that super stability characterizes universal rigidity when the point configuration is generic and every member is a stiff bar. We extend this result in two directions. We first show that a generic universally rigid tensegrity is super stable. We then extend it to tensegrities with point group symmetry, and show that this characterization still holds as long as a tensegrity is generic modulo symmetry. Our strategy is based on the block diagonalization technique for symmetric semidefinite programming problems, and our proof relies on the theory of real irreducible representation of finite groups.


Quantum Mean Force Kinetic Theory General Formulation and Application to Electron Ion Transport in Warm Dense Matter. We present an approach to extend plasma transport theory into the Warm Dense Matter (WDM) regime characterized by moderate Coulomb coupling and electron degeneracy. It is based on a recently proposed closure of the BBGKY hierarchy that expands in terms of the departure of correlations from their equilibrium value, rather than in terms of the strength of correlations. This kinetic equation contains modifications to the collision term in addition to a second term that models the non ideal contributions to the equation of state. An explicit collision operator is derived in the semiclassical limit that is similar to that of the Uehling Uhlenbeck equation, but where scattering is mediated by the potential of mean force (PMF). As a demonstration, we use this collision integral to evaluate temperature and momentum relaxation rates in dense plasmas. We obtain degeneracy and coupling dependent 'Coulomb integrals' that take the place of ln Lambda in the scattering rates. We additionally find a novel difference in the way in which degeneracy influences momentum relaxation in comparison to temperature relaxation. Finally, we evaluate electron ion relaxation rates for the case of warm dense deuterium over a range of density and temperature spanning the classical to quantum and weak to strong coupling transitions. Results are compared with the Landau Spitzer rate and rates obtained from the quantum Landau Fokker Planck equation and Lee More model. We find that the models diverge significantly in the degenerate and moderately coupled regime and attribute this difference to how the various models treat the physics of Pauli blocking, correlations, large angle scattering, and diffraction.


A Tchebycheffian extension of multi degree B splines Algorithmic computation and properties. In this paper we present an efficient and robust approach to compute a normalized B spline like basis for spline spaces with pieces drawn from extended Tchebycheff spaces. The extended Tchebycheff spaces and their dimensions are allowed to change from interval to interval. The approach works by constructing a matrix that maps a generalized Bernstein like basis to the B spline like basis of interest. The B spline like basis shares many characterizing properties with classical univariate B splines and may easily be incorporated in existing spline codes. This may contribute to the full exploitation of Tchebycheffian splines in applications, freeing them from the restricted role of an elegant theoretical extension of polynomial splines. Numerical examples are provided that illustrate the procedure described.


Semi closed form prices of barrier options in the Hull White model. In this paper we derive semi closed form prices of barrier (perhaps, time dependent) options for the Hull White model, ie., where the underlying follows a time dependent OU process with a mean reverting drift. Our approach is similar to that in (Carr and Itkin, 2020) where the method of generalized integral transform is applied to pricing barrier options in the time dependent OU model, but extends it to an infinite domain (which is an unsolved problem yet). Alternatively, we use the method of heat potentials for solving the same problems. By semi closed solution we mean that first, we need to solve numerically a linear Volterra equation of the first kind, and then the option price is represented as a one dimensional integral. Our analysis shows that computationally our method is more efficient than the backward and even forward finite difference methods (if one uses them to solve those problems), while providing better accuracy and stability.


FollowMeUp Sports New Benchmark for 2D Human Keypoint Recognition. Human pose estimation has made significant advancement in recent years. However, the existing datasets are limited in their coverage of pose variety. In this paper, we introduce a novel benchmark FollowMeUp Sports that makes an important advance in terms of specific postures, self occlusion and class balance, a contribution that we feel is required for future development in human body models. This comprehensive dataset was collected using an established taxonomy of over 200 standard workout activities with three different shot angles. The collected videos cover a wider variety of specific workout activities than previous datasets including push up, squat and body moving near the ground with severe self occlusion or occluded by some sport equipment and outfits. Given these rich images, we perform a detailed analysis of the leading human pose estimation approaches gaining insights for the success and failures of these methods.


Assembly of multiscale linear PDE operators. In numerous applications the mathematical model consists of different processes coupled across a lower dimensional manifold. Due to the multiscale coupling, finite element discretization of such models presents a challenge. Assuming that only singlescale finite element forms can be assembled we present here a simple algorithm for representing multiscale models as linear operators suitable for Krylov methods. Flexibility of the approach is demonstrated by numerical examples with coupling across dimensionality gap 1 and 2. Preconditioners for several of the problems are discussed.


Perverse Monodromic Sheaves. We introduce and study the category of modular (i.e. with coefficient of positive characteristic) monodromic perverse sheaves on complex stratified T varieties, with T a complex algebraic torus. In particular, we show that under appropriate assumptions this category has a natural highest weight structure.


Implementing SCADA Scenarios and Introducing Attacks to Obtain Training Data for Intrusion Detection Methods. There are hardly any data sets publicly available that can be used to evaluate intrusion detection algorithms. The biggest threat for industrial applications arises from state sponsored and criminal groups. Often, formerly unknown exploits are employed by these attackers, so called 0 day exploits. They cannot be discovered with signature based intrusion detection. Thus, statistical or machine learning based anomaly detection lends itself readily. These methods especially, however, need a large amount of labelled training data. In this work, an exemplary industrial use case with real world industrial hardware is presented. Siemens S7 Programmable Logic Controllers are used to control a real world based control application using the OPC UA protocol A pump, filling and emptying water tanks. This scenario is used to generate application specific network data. Furthermore, attacks are introduced into this data set. This is done in three ways First, the normal process is monitored and captured. Common attacks are then synthetically introduced into this data set. Second, malicious behaviour is implemented on the Programmable Logic Controller program and executed live, the traffic is captured as well. Third, malicious behaviour is implemented on the Programmable Logic Controller while still keeping the same output behaviour as in normal operation. An attacker could exploit an application but forge valid sensor output so that no anomaly is detected. Sensors are employed, capturing temperature, sound and flow of water to create data that can be correlated to the network data and used to still detect the attack. All data is labelled, containing the ground truth, meaning all attacks are known and no unknown attacks occur. This makes them perfect for training of anomaly detection algorithms. The data is published to enable security researchers to evaluate intrusion detection solutions.


A robust quasi optimal test norm for a DPG discretization of the convection diffusion equation. In this work, we propose a new quasi optimal test norm for a discontinuous Petrov Galerkin (DPG) discretization of the ultra weak formulation of the convection diffusion equation. We prove theoretically that the proposed test norm leads to bounds between the target norm and the energy norm induced by the test norm which are robust with respect to the diffusion parameter in the solution and gradient components and have favorable scalings in the trace components. We conclude with numerical experiments to confirm our theoretical results.


Mobility based network lifetime in wireless sensor networks A review. Increasingly emerging technologies in micro electromechanical systems and wireless communications allows a mobile wireless sensor networks (MWSN) to be a more and more powerful mean in many applications such as habitat and environmental monitoring, traffic observing, battlefield surveillance, smart homes and smart cities. Nevertheless, due to sensor battery constraints, energy efficiently operating a MWSN is paramount importance in those applications and a plethora of approaches have been proposed to elongate the network longevity at most possible. Therefore, this paper provides a comprehensive review on the developed methods that exploit mobility of sensor nodes and or sink(s) to effectively maximize the lifetime of a MWSN. The survey systematically classifies the algorithms into categories where the MWSN is equipped with mobile sensor nodes, one mobile sink or multiple mobile sinks. How to drive the mobile sink(s) for energy efficiency in the network is also fully reviewed and reported.


Another approach to track reconstruction cluster analysis. A novel combination of data analysis techniques is proposed for the reconstruction of all tracks of primary charged particles, as well as of daughters of displaced vertices (decays, photon conversions, nuclear interactions), created in high energy collisions. Instead of performing a classical trajectory building or an image transformation, an efficient use of both local and global information is undertaken while keeping competing choices open. The measured hits of adjacent tracking layers are clustered first with the help of a mutual nearest neighbor search in the angular distance. The resulted chains of connected hits are used as initial clusters and as input for cluster analysis algorithms, such as the robust k medians clustering. This latter proceeds by alternating between the hit to track assignment and the track fit update steps, until convergence. The calculation of the hit to track distance and that of the track fit chi 2 is performed through the global covariance of the measured hits. The clustering is complemented with elements from a more sophisticated Metropolis Hastings MCMC algorithm, with the possibility of adding new track hypotheses or removing unnecessary ones. Simplified but realistic models of today's silicon trackers, including the relevant physics processes, are employed to test and study the performance (efficiency, purity) of the proposed method as a function of the particle multiplicity in the collision event.


Detecting coherent explorations in SQL workloads. This paper presents a proposal aiming at better understanding a workload of SQL queries and detecting coherent explorations hidden within the workload. In particular, our work investigates SQLShare 11 , a database as a service platform targeting scientists and data scientists with minimal database experience, whose workload was made available to the research community. According to the authors of 11 , this workload is the only one containing primarily ad hoc hand written queries over user uploaded datasets. We analyzed this workload by extracting features that characterize SQL queries and we show how to use these features to separate sequences of SQL queries into meaningful explorations. We ran several tests over various query workloads to validate empirically our approach.


Integral representation of local left invariant functionals in Carnot groups. The aim of this note is to prove a representation theorem for left invariant functionals in Carnot groups. As a direct consequence, we can also provide a Gamma convergence result for a smaller class of functionals.


A Self supervised Approach for Semantic Indexing in the Context of COVID 19 Pandemic. The pandemic has accelerated the pace at which COVID 19 scientific papers are published. In addition, the process of manually assigning semantic indexes to these papers by experts is even more time consuming and overwhelming in the current health crisis. Therefore, there is an urgent need for automatic semantic indexing models which can effectively scale up to newly introduced concepts and rapidly evolving distributions of the hyperfocused related literature. In this research, we present a novel semantic indexing approach based on the state of the art self supervised representation learning and transformer encoding exclusively suitable for pandemic crises. We present a case study on a novel dataset that is based on COVID 19 papers published and manually indexed in PubMed. Our study shows that our self supervised model outperforms the best performing models of BioASQ Task 8a by micro F1 score of 0.1 and LCA F score of 0.08 on average. Our model also shows superior performance on detecting the supplementary concepts which is quite important when the focus of the literature has drastically shifted towards specific concepts related to the pandemic. Our study sheds light on the main challenges confronting semantic indexing models during a pandemic, namely new domains and drastic changes of their distributions, and as a superior alternative for such situations, propose a model founded on approaches which have shown auspicious performance in improving generalization and data efficiency in various NLP tasks. We also show the joint indexing of major Medical Subject Headings (MeSH) and supplementary concepts improves the overall performance.


Multivariate Bernoulli polynomials. We introduce a multivariate analogue of Bernoulli polynomials and give their fundamental properties difference and differential relations, symmetry, explicit formula, inversion formula, multiplication theorem, and binomial type formula. Further, we consider a multivariate analogue of the multiple Bernoulli polynomials and give their fundamental properties.


Semantic RL with Action Grammars Data Efficient Learning of Hierarchical Task Abstractions. Hierarchical Reinforcement Learning algorithms have successfully been applied to temporal credit assignment problems with sparse reward signals. However, state of the art algorithms require manual specification of sub task structures, a sample inefficient exploration phase or lack semantic interpretability. Humans, on the other hand, efficiently detect hierarchical sub structures induced by their surroundings. It has been argued that this inference process universally applies to language, logical reasoning as well as motor control. Therefore, we propose a cognitive inspired Reinforcement Learning architecture which uses grammar induction to identify sub goal policies. By treating an on policy trajectory as a sentence sampled from the policy conditioned language of the environment, we identify hierarchical constituents with the help of unsupervised grammatical inference. The resulting set of temporal abstractions is called action grammar (Pastra Aloimonos, 2012) and unifies symbolic and connectionist approaches to Reinforcement Learning. It can be used to facilitate efficient imitation, transfer and online learning.


A smile I could recognise in a thousand Automatic identification of identity from dental radiography. In this paper, we present a method to automatically compare multiple radiographs in order to find the identity of a patient out of the dental features. The method is based on the matching of image features, previously extracted by computer vision algorithms for image descriptor recognition. The principal application (being also our motivation to study the problem) of such a method would be in victim identification in mass disasters.


Grassmann geometry of zero sets in reproducing kernel Hilbert spaces. Let mathcal H be a reproducing kernel Hilbert space of functions on a set X . We study the problem of finding a minimal geodesic of the Grassmann manifold of mathcal H that joins two subspaces consisting of functions which vanish on given finite subsets of X . We establish a necessary and sufficient condition for existence and uniqueness of geodesics, and we then analyze it in examples. We discuss the relation of the geodesic distance with other known metrics when the mentioned finite subsets are singletons. We find estimates on the upper and lower eigenvalues of the unique self adjoint operators which define the minimal geodesics, which can be made more precise when the underlying space is the Hardy space. Also for the Hardy space we discuss the existence of geodesics joining subspaces of functions vanishing on infinite subsets of the disk, and we investigate when the product of projections onto this type of subspaces is compact.


Wav2Pix Speech conditioned Face Generation using Generative Adversarial Networks. Speech is a rich biometric signal that contains information about the identity, gender and emotional state of the speaker. In this work, we explore its potential to generate face images of a speaker by conditioning a Generative Adversarial Network (GAN) with raw speech input. We propose a deep neural network that is trained from scratch in an end to end fashion, generating a face directly from the raw speech waveform without any additional identity information (e.g reference image or one hot encoding). Our model is trained in a self supervised approach by exploiting the audio and visual signals naturally aligned in videos. With the purpose of training from video data, we present a novel dataset collected for this work, with high quality videos of youtubers with notable expressiveness in both the speech and visual signals.


Guiding Monocular Depth Estimation Using Depth Attention Volume. Recovering the scene depth from a single image is an ill posed problem that requires additional priors, often referred to as monocular depth cues, to disambiguate different 3D interpretations. In recent works, those priors have been learned in an end to end manner from large datasets by using deep neural networks. In this paper, we propose guiding depth estimation to favor planar structures that are ubiquitous especially in indoor environments. This is achieved by incorporating a non local coplanarity constraint to the network with a novel attention mechanism called depth attention volume (DAV). Experiments on two popular indoor datasets, namely NYU Depth v2 and ScanNet, show that our method achieves state of the art depth estimation results while using only a fraction of the number of parameters needed by the competing methods.


Scaling Entropy of Unstable Systems. In this work, we study the slow entropy type invariant of a dynamical system proposed by A. M. Vershik. We provide an explicit construction of a system whose class of scaling entropy sequences is empty. For this unstable case, we introduce an upgraded notion of the invariant, generalize subadditivity results, and provide a complete series of examples.


Partial orders on conjugacy classes in the Weyl group and on unipotent conjugacy classes. Let G be a reductive group over an algebraically closed field and let W be its Weyl group. In a series of papers, Lusztig introduced a map from the set W of conjugacy classes of W to the set G u of unipotent classes of G . This map, when restricted to the set of elliptic conjugacy classes W e of W , is injective. In this paper, we show that Lusztig's map W e to G u is order reversing, with respect to the natural partial order on W e arising from combinatorics and the natural partial order on G u arising from geometry.


Links in Surfaces and Laplacian Modules. Laplacian matrices of weighted graphs in surfaces S are used to define module and polynomial invariants of Z 2 homologically trivial links in S times 0,1 . Information about virtual genus is obtained.


ActivFORMS A Formally Founded Model Based Approach to Engineer Self Adaptive Systems. Self adaptation equips a computing system with a feedback loop that enables it dealing with change caused by uncertainties during operation, such as changing availability of resources and fluctuating workloads. To ensure that the system complies with the adaptation goals, recent research suggests the use of formal techniques at runtime. Yet, existing approaches have three limitations that affect their practical applicability (i) they ignore correctness of the behavior of the feedback loop, (ii) they rely on exhaustive verification at runtime to select adaptation options to realize the adaptation goals, which is time and resource demanding, and (iii) they provide limited or no support for changing adaptation goals at runtime. To tackle these shortcomings, we present ActivFORMS (Active FORmal Models for Self adaptation). ActivFORMS contributes an end to end approach for engineering self adaptive systems, spanning four main stages of the life cycle of a feedback loop design, deployment, runtime adaptation, and evolution. We also present ActivFORMS ta, a tool supported instance of ActivFORMS that leverages timed automata models and statistical model checking at runtime. We validate the research results using an IoT application for building security monitoring that is deployed in Leuven. The experimental results demonstrate that ActivFORMS supports correctness of the behavior of the feedback loop, achieves the adaptation goals in an efficient way, and supports changing adaptation goals at runtime.


ProDyn0 Inferring calponin homology domain stretching behavior using graph neural networks. Graph neural networks are a quickly emerging field for non Euclidean data that leverage the inherent graphical structure to predict node, edge, and global level properties of a system. Protein properties can not easily be understood as a simple sum of their parts (i.e. amino acids), therefore, understanding their dynamical properties in the context of graphs is attractive for revealing how perturbations to their structure can affect their global function. To tackle this problem, we generate a database of 2020 mutated calponin homology (CH) domains undergoing large scale separation in molecular dynamics. To predict the mechanosensitive force response, we develop neural message passing networks and residual gated graph convnets which predict the protein dependent force separation at 86.63 percent, 81.59 kJ mol nm MAE, 76.99 psec MAE for force mode classification, max force magnitude, max force time respectively significantly better than non graph based deep learning techniques. Towards uniting geometric learning techniques and biophysical observables, we premiere our simulation database as a benchmark dataset for further development evaluation of graph neural network architectures.


Modules of infinite projective dimension. We characterize the modules of infinite projective dimension over the endomorphism algebras of Opperman Thomas cluster tilting objects X in (n 2) angulated categories ( mathcal C, Sigma n, Theta) . For an indecomposable object M of mathcal C , we define in this article the ideal I M of rm End mathcal C ( Sigma nX) given by all endomorphisms that factor through rm add M , and show that the rm End mathcal C (X) module rm Hom mathcal C (X,M) has infinite projective dimension precisely when I M is non zero. As an application, we generalize a recent result by Beaudet Br " u stle Todorov for cluster tilted algebras.


Applying the Chebyshev Tau spectral method to solve the parabolic equation model of wide angle rational approximation in ocean acoustics. Solving an acoustic wave equation using a parabolic approximation is a popular approach for many existing ocean acoustic models. Commonly used parabolic equation (PE) model programs, such as the range dependent acoustic model (RAM), are discretized by the finite difference method (FDM). Considering the idea and theory of the wide angle rational approximation, a discrete PE model using the Chebyshev spectral method (CSM) is derived, and the code is developed. This method is currently suitable only for range independent waveguides. Taking three ideal fluid waveguides as examples, the correctness of using the CSM discrete PE model in solving the underwater acoustic propagation problem is verified. The test results show that compared with the RAM, the method proposed in this paper can achieve higher accuracy in computational underwater acoustics and requires fewer discrete grid points. After optimization, this method is more advantageous than the FDM in terms of speed. Thus, the CSM provides high precision reference standards for benchmark examples of the range independent PE model.


Beyond Alice and Bob Improved Inapproximability for Maximum Independent Set in CONGEST. By far the most fruitful technique for showing lower bounds for the CONGEST model is reductions to two party communication complexity. This technique has yielded nearly tight results for various fundamental problems such as distance computations, minimum spanning tree, minimum vertex cover, and more. In this work, we take this technique a step further, and we introduce a framework of reductions to t party communication complexity, for every t geq 2 . Our framework enables us to show improved hardness results for maximum independent set. Recently, Bachrach et al. PODC 2019 used the two party framework to show hardness of approximation for maximum independent set. They show that finding a (5 6 epsilon) approximation requires Omega(n log 6 n) rounds, and finding a (7 8 epsilon) approximation requires Omega(n 2 log 7 n) rounds, in the CONGEST model where n in the number of nodes in the network. We improve the results of Bachrach et al. by using reductions to multi party communication complexity. Our results (1) Any algorithm that finds a (1 2 epsilon) approximation for maximum independent set in the CONGEST model requires Omega(n log 3 n) rounds. (2) Any algorithm that finds a (3 4 epsilon) approximation for maximum independent set in the CONGEST model requires Omega(n 2 log 3 n) rounds.


L p optimal prediction of the last zero of a spectrally negative L 'evy process. Given a spectrally negative L 'evy process X drifting to infinity, (inspired on the early ideas of Shiryaev (2002)) we are interested in finding a stopping time that minimises the L p distance ( p 1 ) with g , the last time X is negative. The solution is substantially more difficult compared to the case p 1 , for which it was shown in Baurdoux and Pedraza (2020b) that it is optimal to stop as soon as X exceeds a constant barrier. In the case of p 1 treated here, we prove that solving this optimal prediction problem is equivalent to solving an optimal stopping problem in terms of a two dimensional strong Markov process that incorporates the length of the current excursion away from 0 . We show that an optimal stopping time is now given by the first time that X exceeds a non increasing and non negative curve depending on the length of the current excursion away from 0 . We further characterise the optimal boundary and the value function as the unique solution of a non linear system of integral equations within a subclass of functions. As examples, the case of a Brownian motion with drift and a Brownian motion with drift perturbed by a Poisson process with exponential jumps are considered.


DINGO an ontology for projects and grants linked data. We present DINGO (Data INtegration for Grants Ontology), an ontology that provides a machine readable extensible framework to model data for semantically enabled applications relative to projects, funding, actors, and, notably, funding policies in the research landscape. DINGO is designed to yield high modeling power and elasticity to cope with the huge variety in funding, research and policy practices, which makes it applicable also to other areas besides research where funding is an important aspect. We discuss its main features, the principles followed for its development, its community uptake, its maintenance and evolution.


Convergent numerical approximation of the stochastic total variation flow. We study the stochastic total variation flow (STVF) equation with linear multiplicative noise. By considering a limit of a sequence of regularized stochastic gradient flows with respect to a regularization parameter varepsilon we obtain the existence of a unique variational solution of the STVF equation which satisfies a stochastic variational inequality. We propose an energy preserving fully discrete finite element approximation for the regularized gradient flow equation and show that the numerical solution converges to the solution of the unregularized STVF equation. We perform numerical experiments to demonstrate the practicability of the proposed numerical approximation.


Learning to Profile User Meta Profile Network for Few Shot Learning. Meta learning approaches have shown great success in vision and language domains. However, few studies discuss the practice of meta learning for large scale industrial applications. Although e commerce companies have spent many efforts on learning representations to provide a better user experience, we argue that such efforts cannot be stopped at this step. In addition to learning a strong profile, the challenging question about how to effectively transfer the learned representation is raised simultaneously. This paper introduces the contributions that we made to address these challenges from three aspects. 1) Meta learning model In the context of representation learning with e commerce user behavior data, we propose a meta learning framework called the Meta Profile Network, which extends the ideas of matching network and relation network for knowledge transfer and fast adaptation 2) Encoding strategy To keep high fidelity of large scale long term sequential behavior data, we propose a time heatmap encoding strategy that allows the model to encode data effectively 3) Deep network architecture A multi modal model combined with multi task learning architecture is utilized to address the cross domain knowledge learning and insufficient label problems. Moreover, we argue that an industrial model should not only have good performance in terms of accuracy, but also have better robustness and uncertainty performance under extreme conditions. We evaluate the performance of our model with extensive control experiments in various extreme scenarios, i.e. out of distribution detection, data insufficiency and class imbalance scenarios. The Meta Profile Network shows significant improvement in the model performance when compared to baseline models.


From computation to comparison of tensor decompositions. Decompositions of higher order tensors into sums of simple terms are ubiquitous. We show that in order to verify that two tensors are generated by the same (possibly scaled) terms it is not necessary to compute the individual decompositions. In general the explicit computation of such a decomposition may have high complexity and can be ill conditioned. We now show that under some assumptions the verification can be reduced to a comparison of both the column and row spaces of the corresponding matrix representations of the tensors. We consider rank 1 terms as well as low multilinear rank terms (also known as block terms) and show that the number of the terms and their multilinear rank can be inferred as well. The comparison relies only on numerical linear algebra and can be done in a numerically reliable way. We also illustrate how our results can be applied to solve a multi label classification problem that appears in the context of blind source separation.


Authorship Attribution of Source Code A Language Agnostic Approach and Applicability in Software Engineering. Authorship attribution (i.e., determining who is the author of a piece of source code) is an established research topic. State of the art results for the authorship attribution problem look promising for the software engineering field, where they could be applied to detect plagiarized code and prevent legal issues. With this article, we first introduce a new language agnostic approach to authorship attribution of source code. Then, we discuss limitations of existing synthetic datasets for authorship attribution, and propose a data collection approach that delivers datasets that better reflect aspects important for potential practical use in software engineering. Finally, we demonstrate that high accuracy of authorship attribution models on existing datasets drastically drops when they are evaluated on more realistic data. We outline next steps for the design and evaluation of authorship attribution models that could bring the research efforts closer to practical use for software engineering.


A review of information security aspects of the emerging COVID 19 contact tracing mobile phone applications. This paper discusses the aspects of data reliability and user privacy for the emerging practice of mobile phone based contact tracing for the COVID 19 pandemic. Various countries and large technology companies have already used or plan to design and use mobile phone based solutions, in an effort to urgently expedite the process of identifying people who may have been exposed to the disease and limit its spread to the general population. However, serious concerns have been raised both in terms of the validity of the collected data as well as the extent to which implemented approaches can breach the privacy of the mobile phone users. This review examines the weaknesses of existing implementations and concludes with specific recommendations that can contribute towards increasing the safety of infrastructures that collect and process this kind of information, as well as the adoption and acceptance of these solutions from the public.


Superconvexity of the Heat Kernel on Hyperbolic Space. We prove a conjecture of Bernstein that the superconvexity of the heat kernel on hyperbolic space holds in all dimensions and, hence, there is an analog of Huisken's monotonicity formula for mean curvature flow in hyperbolic space of all dimensions.


COVID 19 and Income Profile How People in Different Income Groups Responded to Disease Outbreak, Case Study of the United States. Due to immature treatment and rapid transmission of COVID 19, mobility interventions play a crucial role in containing the outbreak. Among various non pharmacological interventions, community infection control is considered to be a quite promising approach. However, there is a lack of research on improving community level interventions based on a community's real conditions and characteristics using real world observations. Our paper aims to investigate the different responses to mobility interventions between communities in the United States with a specific focus on different income levels. We produced six daily mobility metrics for all communities using the mobility location data from over 100 million anonymous devices on a monthly basis. Each metric is tabulated by three performance indicators "best performance," "effort," and "consistency." We found that being high income improves social distancing behavior after controlling multiple confounding variables in each of the eighteen scenarios. In addition to the reality that it is more difficult for low income communities to comply with social distancing, the comparisons between scenarios raise concerns on the employment status, working condition, accessibility to life supplies, and exposure to the virus of low income communities.


The Selectivity and Competition of the Mind's Eye in Visual Perception. Research has shown that neurons within the brain are selective to certain stimuli. For example, the fusiform face area (FFA) region is known by neuroscientists to selectively activate when people see faces over non face objects. However, the mechanisms by which the primary visual system directs information to the correct higher levels of the brain are currently unknown. In our work, we mimic several high level neural mechanisms of perception by creating a novel computational model that incorporates lateral and top down feedback in the form of hierarchical competition. Not only do we show that these elements can help explain the information flow and selectivity of high level areas within the brain, we also demonstrate that these neural mechanisms provide the foundation of a novel classification framework that rivals traditional supervised learning in computer vision. Additionally, we present both quantitative and qualitative results that demonstrate that our generative framework is consistent with neurological themes and enables simple, yet robust category level classification.


A positive proportion of cubic fields are not monogenic yet have no local obstruction to being so. We show that a positive proportion of cubic fields are not monogenic, despite having no local obstruction to being monogenic. Our proof involves the comparison of 2 descent and 3 descent in a certain family of Mordell curves E k colon y 2 x 3 k . As a by product of our methods, we show that, for every r geq 0 , a positive proportion of curves E k have Tate Shafarevich group with 3 rank at least r .


Verified computation of matrix gamma function. Two numerical algorithms are proposed for computing an interval matrix containing the matrix gamma function. In 2014, the author presented algorithms for enclosing all the eigenvalues and basis of invariant subspaces of A in mathbb C n times n . As byproducts of these algorithms, we can obtain interval matrices containing small matrices whose spectrums are included in that of A . In this paper, we interpret the interval matrices containing the basis and small matrices as a result of verified block diagonalization (VBD), and establish a new framework for enclosing matrix functions using the VBD. To achieve enclosure for the gamma function of the small matrices, we derive computable perturbation bounds. We can apply these bounds if input matrices satisfy conditions. We incorporate matrix argument reductions (ARs) to force the input matrices to satisfy the conditions, and develop theories for accelerating the ARs. The first algorithm uses the VBD based on a numerical spectral decomposition, and involves only cubic complexity under an assumption. The second algorithm adopts the VBD based on a numerical Jordan decomposition, and is applicable even for defective matrices. Numerical results show efficiency and robustness of the algorithms.


A note on arithmetic Breuil Kisin Fargues modules. Let K be a discrete valuation field, we combine the construction of Fargues Fontaine of G K equivariant modifications of vector bundles over the Fargues Fontaine curve X FF using weakly admissible filtered ( varphi,N,G K) modules over K , with Scholze and Fargues' theorems that relate modifications of vector bundles over the Fargues Fontaine curve with mixed characteristic shtukas and Breuil Kisin Fargues modules. We give a characterization of Breuil Kisin Fargues modules with semilinear G K actions that produced in this way and compare those Breuil Kisin Fargues modules with Kisin modules.


Separating invariants for multisymmetric polynomials. This article studies separating invariants for the ring of multisymmetric polynomials in m sets of n variables over an arbitrary field mathbb K . We prove that in order to obtain separating sets it is enough to consider polynomials that depend only on lfloor frac n 2 rfloor 1 sets of these variables. This improves a general result by Domokos about separating invariants. In addition, for n leq 4 we explicitly give minimal separating sets (with respect to inclusion) for all m in case text char ( mathbb K ) 0 or text char ( mathbb K ) n .


Solving Mixed Integer Programs Using Neural Networks. Mixed Integer Programming (MIP) solvers rely on an array of sophisticated heuristics developed with decades of research to solve large scale MIP instances encountered in practice. Machine learning offers to automatically construct better heuristics from data by exploiting shared structure among instances in the data. This paper applies learning to the two key sub tasks of a MIP solver, generating a high quality joint variable assignment, and bounding the gap in objective value between that assignment and an optimal one. Our approach constructs two corresponding neural network based components, Neural Diving and Neural Branching, to use in a base MIP solver such as SCIP. Neural Diving learns a deep neural network to generate multiple partial assignments for its integer variables, and the resulting smaller MIPs for un assigned variables are solved with SCIP to construct high quality joint assignments. Neural Branching learns a deep neural network to make variable selection decisions in branch and bound to bound the objective value gap with a small tree. This is done by imitating a new variant of Full Strong Branching we propose that scales to large instances using GPUs. We evaluate our approach on six diverse real world datasets, including two Google production datasets and MIPLIB, by training separate neural networks on each. Most instances in all the datasets combined have 10 3 10 6 variables and constraints after presolve, which is significantly larger than previous learning approaches. Comparing solvers with respect to primal dual gap averaged over a held out set of instances, the learning augmented SCIP is 2x to 10x better on all datasets except one on which it is 10 5 x better, at large time limits. To the best of our knowledge, ours is the first learning approach to demonstrate such large improvements over SCIP on both large scale real world application datasets and MIPLIB.


Quantifying the Semantic Core of Gender Systems. Many of the world's languages employ grammatical gender on the lexeme. For example, in Spanish, the word for 'house' (casa) is feminine, whereas the word for 'paper' (papel) is masculine. To a speaker of a genderless language, this assignment seems to exist with neither rhyme nor reason. But is the assignment of inanimate nouns to grammatical genders truly arbitrary? We present the first large scale investigation of the arbitrariness of noun gender assignments. To that end, we use canonical correlation analysis to correlate the grammatical gender of inanimate nouns with an externally grounded definition of their lexical semantics. We find that 18 languages exhibit a significant correlation between grammatical gender and lexical semantics.


Learning Modulated Loss for Rotated Object Detection. Popular rotated detection methods usually use five parameters (coordinates of the central point, width, height, and rotation angle) to describe the rotated bounding box and l1 loss as the loss function. In this paper, we argue that the aforementioned integration can cause training instability and performance degeneration, due to the loss discontinuity resulted from the inherent periodicity of angles and the associated sudden exchange of width and height. This problem is further pronounced given the regression inconsistency among five parameters with different measurement units. We refer to the above issues as rotation sensitivity error (RSE) and propose a modulated rotation loss to dismiss the loss discontinuity. Our new loss is combined with the eight parameter regression to further solve the problem of inconsistent parameter regression. Experiments show the state of art performances of our method on the public aerial image benchmark DOTA and UCAS AOD. Its generalization abilities are also verified on ICDAR2015, HRSC2016, and FDDB. Qualitative improvements can be seen in Fig 1, and the source code will be released with the publication of the paper.


Deformation of Dirac operators along orbits and quantization of non compact Hamiltonian torus manifolds. We give a formulation of a deformation of Dirac operator along orbits of a group action on a possibly non compact manifold to get an equivariant index and a K homology cycle representing the index. We apply this framework to non compact Hamiltonian torus manifolds to define geometric quantization from the view point of index theory. We give two applications. The first one is a proof of a Q,R 0 type theorem, which can be regarded as a proof of the Vergne conjecture for Abelian case. The other is a Danilov type formula for toric case in the non compact setting, which shows that this geometric quantization is independent of the choice of polarization. The proofs are based on the localization of index to lattice points.


Multi Task Learning of Height and Semantics from Aerial Images. Aerial or satellite imagery is a great source for land surface analysis, which might yield land use maps or elevation models. In this investigation, we present a neural network framework for learning semantics and local height together. We show how this joint multi task learning benefits to each task on the large dataset of the 2018 Data Fusion Contest. Moreover, our framework also yields an uncertainty map which allows assessing the prediction of the model. Code is available at https github.com marcelampc mtl aerial images .


On Endpoint Regularity Criterion of the 3D Navier Stokes equations. Let (u, pi) with u (u 1,u 2,u 3) be a suitable weak solution of the three dimensional Navier Stokes equations in mathbb R 3 times 0, T . Denote by dot mathcal B 1 infty, infty the closure of C 0 infty in dot B 1 infty, infty . We prove that if u in L infty(0, T dot B 1 infty, infty ) , u(x, T) in dot mathcal B 1 infty, infty ) , and u 3 in L infty(0, T L 3, infty ) or u 3 in L infty(0, T dot B 1 3 p p, q ) with 3 p, q infty , then u is smooth in mathbb R 3 times 0, T . Our result improves a previous result established by Wang and Zhang Sci. China Math. 60, 637 650 (2017) .


The monodromy conjecture for a space monomial curve with a plane semigroup. This article investigates the monodromy conjecture for a space monomial curve that appears as the special fiber of an equisingular family of curves with a plane branch as generic fiber. Roughly speaking, the monodromy conjecture states that every pole of the motivic, or related, Igusa zeta function induces an eigenvalue of monodromy. As the poles of the motivic zeta function associated with such a space monomial curve have been determined in earlier work, it remains to study the eigenvalues of monodromy. After reducing the problem to the curve seen as a Cartier divisor on a generic embedding surface, we construct an embedded mathbb Q resolution of this pair and use an A'Campo formula in terms of this resolution to compute the zeta function of monodromy. Combining all results, we prove the monodromy conjecture for this class of monomial curves.


Observable sets, potentials and Schr " o dinger equations. We characterize observable sets for 1 dim Schr " o dinger equations in mathbb R i partial t u ( partial x 2 x 2m )u (with m in mathbb N 0,1, dots ). More precisely, we obtain what follows First, when m 0 , E subset mathbb R is an observable set at some time if and only if it is thick, namely, there is gamma 0 and L 0 so that left E bigcap x, x L right geq gamma L mbox for each x in mathbb R Second, when m 1 ( m geq 2 resp.), E is an observable set at some time (at any time resp. ) if and only if it is weakly thick, namely varliminf x rightarrow infty frac E bigcap x, x x 0. From these, we see how potentials x 2m affect the observability (including the geometric structures of observable sets and the minimal observable time). Besides, we obtain several supplemental theorems for the above results, in particular, we find that a half line is an observable set at time T 0 for the above equation with m 1 if and only if T frac pi 2 .


Multi hypothesis classifier. Accuracy is the most important parameter among few others which defines the effectiveness of a machine learning algorithm. Higher accuracy is always desirable. Now, there is a vast number of well established learning algorithms already present in the scientific domain. Each one of them has its own merits and demerits. Merits and demerits are evaluated in terms of accuracy, speed of convergence, complexity of the algorithm, generalization property, and robustness among many others. Also the learning algorithms are data distribution dependent. Each learning algorithm is suitable for a particular distribution of data. Unfortunately, no dominant classifier exists for all the data distribution, and the data distribution task at hand is usually unknown. Not one classifier can be discriminative well enough if the number of classes are huge. So the underlying problem is that a single classifier is not enough to classify the whole sample space correctly. This thesis is about exploring the different techniques of combining the classifiers so as to obtain the optimal accuracy. Three classifiers are implemented namely plain old nearest neighbor on raw pixels, a structural feature extracted neighbor and Gabor feature extracted nearest neighbor. Five different combination strategies are devised and tested on Tibetan character images and analyzed


Pricing FX Options under Intermediate Currency. We suggest an intermediate currency approach that allows us to price options on all FX markets simultaneously under the same risk neutral measure which ensures consistency of FX option prices across all markets. In particular, it is sufficient to calibrate a model to the volatility smile on the domestic market as, due to the consistency of pricing formulas, the model automatically reproduces the correct smile for the inverse pair (the foreign market). We first consider the case of two currencies and then the multi currency setting. We illustrate the intermediate currency approach by applying it to the Heston and SABR stochastic volatility models, to the model in which exchange rates are described by an extended skewed normal distribution, and also to the model free approach of option pricing


Large scale, Language agnostic Discourse Classification of Tweets During COVID 19. Quantifying the characteristics of public attention is an essential prerequisite for appropriate crisis management during severe events such as pandemics. For this purpose, we propose language agnostic tweet representations to perform large scale Twitter discourse classification with machine learning. Our analysis on more than 26 million COVID 19 tweets shows that large scale surveillance of public discourse is feasible with computationally lightweight classifiers by out of the box utilization of these representations.


Rigidity of elliptic genera from number theory to geometry and back. In this paper we derive topological and number theoretical consequences of the rigidity of elliptic genera, which are special modular forms associated to each compact almost complex manifold. In particular, on the geometry side, we prove that rigidity implies relations between the Betti numbers and the index of a compact symplectic manifold of dimension 2n admitting a Hamiltonian action of a circle with isolated fixed points. We investigate the case of maximal index and toric actions. On the number theoretical side we prove that from each compact almost complex manifold of index greater than one, that can be endowed with the action of a circle with isolated fixed points, one can derive non trivial relations among Eisenstein series. We give explicit formulas coming from the standard action on mathbb C P n .


Anisotropic Isoperimetric Inequality outside Euclidean Ball. We prove an sharp anisotropic isoperimetric inequality for a domain outside an Euclidean ball in mathbb R n for n geq 2 . The proof applies the ABP method to a Neumann boundary value problem.


A Survey on Human Machine Interaction in Industry 4.0. Industry 4.0 or Industrial IoT both describe new paradigms for seamless interaction between humans and machines. Both concepts rely on intelligent, inter connected cyber physical production systems that are able to control the process flow of industrial production. As those machines take many decisions autonomously and further interact with production and manufacturing planning systems, the integration of human users requires new paradigms. In this paper, we provide an analysis of the current state of the art in human machine interaction in the Industry 4.0 domain.We focus on new paradigms that integrate the application of augmented and virtual reality technology. Based on our analysis, we further provide a discussion of research challenges.


The complexity of solution sets to equations in hyperbolic groups. We show that the full set of solutions to systems of equations and inequations in a hyperbolic group, as shortlex geodesic words (or any regular set of quasigeodesic normal forms), is an EDT0L language whose specification can be computed in NSPACE (n 2 log n) for the torsion free case and NSPACE (n 4 log n) in the torsion case. Furthermore, in the presence of quasi isometrically embeddable rational constraints, we show that the full set of solutions to systems of equations in a hyperbolic group remains EDT0L. Our work combines the geometric results of Rips, Sela, Dahmani and Guirardel on the decidability of the existential theory of hyperbolic groups with the work of computer scientists including Plandowski, Je .z, Diekert and others on PSPACE algorithms to solve equations in free monoids and groups using compression, and involves an intricate language theoretic analysis.


Machine Translation Evaluation with BERT Regressor. We introduce the metric using BERT (Bidirectional Encoder Representations from Transformers) (Devlin et al., 2019) for automatic machine translation evaluation. The experimental results of the WMT 2017 Metrics Shared Task dataset show that our metric achieves state of the art performance in segment level metrics task for all to English language pairs.


Featured Games. Feature based SPL analysis and family based model checking have seen rapid development. Many model checking problems can be reduced to two player games on finite graphs. A prominent example is mu calculus model checking, which is generally done by translating to parity games, but also many quantitative model checking problems can be reduced to (quantitative) games. In their FASE'20 paper, ter Beek et al. introduce parity games with variability in order to develop family based mu calculus model checking of featured transition systems. We generalize their model to general featured games and show how these may be analysed in a family based manner. We introduce featured reachability games, featured minimum reachability games, featured discounted games, featured energy games, and featured parity games. We show how to compute winners and values of such games in a family based manner. We also show that all these featured games admit optimal featured strategies, which project to optimal strategies for any product. Further, we develop family based algorithms, using late splitting, to compute winners, values, and optimal strategies for all the featured games we have introduced.


High Performance Logistic Regression for Privacy Preserving Genome Analysis. In this paper, we present a secure logistic regression training protocol and its implementation, with a new subprotocol to securely compute the activation function. To the best of our knowledge, we present the fastest existing secure Multi Party Computation implementation for training logistic regression models on high dimensional genome data distributed across a local area network.


Amnesic Probing Behavioral Explanation with Amnesic Counterfactuals. A growing body of work makes use of probing to investigate the working of neural models, often considered black boxes. Recently, an ongoing debate emerged surrounding the limitations of the probing paradigm. In this work, we point out the inability to infer behavioral conclusions from probing results and offer an alternative method that focuses on how the information is being used, rather than on what information is encoded. Our method, Amnesic Probing, follows the intuition that the utility of a property for a given task can be assessed by measuring the influence of a causal intervention that removes it from the representation. Equipped with this new analysis tool, we can ask questions that were not possible before, e.g. is part of speech information important for word prediction? We perform a series of analyses on BERT to answer these types of questions. Our findings demonstrate that conventional probing performance is not correlated to task importance, and we call for increased scrutiny of claims that draw behavioral or causal conclusions from probing results.


Analysis and Design of Vehicle Platooning Operations on Mixed Traffic Highways. Platooning of connected and autonomous vehicles (CAVs) has a significant potential for throughput improvement. However, the interaction between CAVs and non CAVs may limit the practically attainable improvement due to platooning. To better understand and address this limitation, we introduce a new fluid model of mixed autonomy traffic flow and use this model to analyze and design platoon coordination strategies. We propose tandem link fluid model that considers randomly arriving platoons sharing highway capacity with non CAVs. We derive verifiable conditions for stability of the fluid model by analyzing an underlying M D 1 queuing process and establishing a Foster Lyapunov drift condition for the fluid model. These stability conditions enable a quantitative analysis of highway throughput under various scenarios. The model is useful for designing platoon coordination strategies that maximize throughput and minimize delay. Such coordination strategies are provably optimal in the fluid model and are practically relevant. We also validate our results using standard macroscopic (cell transmission model, CTM) and microscopic (Simulation for Urban Mobility, SUMO) simulation models.


Tiramisu Fast and General Network Verification. Today's distributed network control planes support multiple routing protocols, filtering mechanisms, and route selection policies. These protocols operate at different layers, e.g. BGP operates at the EGP layer, OSPF at the IGP layer, and VLANs at layer 2. The behavior of a network's control plane depends on how these protocols interact with each other. This makes network configurations highly complex and error prone. State of the art control plane verifiers are either too slow, or do not model certain features of the network. In this paper, we propose a new multilayer hedge graph abstraction, Tiramisu, that supports fast verification of the control plane. Tiramisu uses a combination of graph traversal algorithms and ILPs (Integer Linear Programs) to check different network policies. We use Tiramisu to verify policies of various real world and synthetic configurations. Our experiments show that Tiramisu can verify any policy in 0.08 s in small networks ( 35 devices) and 0.12 s in large networks ( 160 devices), and it is 10 600X faster than state of the art without losing generality.


EHSOD CAM Guided End to end Hybrid Supervised Object Detection with Cascade Refinement. Object detectors trained on fully annotated data currently yield state of the art performance but require expensive manual annotations. On the other hand, weakly supervised detectors have much lower performance and cannot be used reliably in a realistic setting. In this paper, we study the hybrid supervised object detection problem, aiming to train a high quality detector with only a limited amount of fullyannotated data and fully exploiting cheap data with imagelevel labels. State of the art methods typically propose an iterative approach, alternating between generating pseudo labels and updating a detector. This paradigm requires careful manual hyper parameter tuning for mining good pseudo labels at each round and is quite time consuming. To address these issues, we present EHSOD, an end to end hybrid supervised object detection system which can be trained in one shot on both fully and weakly annotated data. Specifically, based on a two stage detector, we proposed two modules to fully utilize the information from both kinds of labels 1) CAMRPN module aims at finding foreground proposals guided by a class activation heat map 2) hybrid supervised cascade module further refines the bounding box position and classification with the help of an auxiliary head compatible with image level data. Extensive experiments demonstrate the effectiveness of the proposed method and it achieves comparable results on multiple object detection benchmarks with only 30 fully annotated data, e.g. 37.5 mAP on COCO. We will release the code and the trained models.


Bounded Degree Cut is Fixed Parameter Tractable. In the bounded degree cut problem, we are given a multigraph G (V,E) , two disjoint vertex subsets A,B subseteq V , two functions mathrm u A, mathrm u B V to 0,1, ldots, E on V , and an integer k geq 0 . The task is to determine whether there is a minimal (A,B) cut (V A,V B) of size at most k such that the degree of each vertex v in V A in the induced subgraph G V A is at most mathrm u A(v) and the degree of each vertex v in V B in the induced subgraph G V B is at most mathrm u B(v) . In this paper, we show that the bounded degree cut problem is fixed parameter tractable by giving a 2 18k G O(1) time algorithm. This is the first single exponential FPT algorithm for this problem. The core of the algorithm lies two new lemmas based on important cuts, which give some upper bounds on the number of candidates for vertex subsets in one part of a minimal cut satisfying some properties. These lemmas can be used to design fixed parameter tractable algorithms for more related problems.


On Connectivity and Robustness in Random Intersection Graphs. Random intersection graphs have received much attention recently and been used in a wide range of applications ranging from key predistribution in wireless sensor networks to modeling social networks. For these graphs, each node is equipped with a set of objects in a random manner, and two nodes have an undirected edge in between if they have at least one object in common. In this paper, we investigate connectivity and robustness in a general random intersection graph model. Specifically, we establish sharp asymptotic zero one laws for k connectivity and k robustness, as well as the asymptotically exact probability of k connectivity, for any positive integer k. The k connectivity property quantifies how resilient is the connectivity of a graph against node or edge failures, while k robustness measures the effectiveness of local information based consensus algorithms (that do not use global graph topology information) in the presence of adversarial nodes. In addition to presenting the results under the general random intersection graph model, we consider two special cases of the general model, a binomial random intersection graph and a uniform random intersection graph, which both have numerous applications as well. For these two specialized graphs, our results on asymptotically exact probabilities of k connectivity and asymptotic zero one laws for k robustness are also novel in the literature.


Program Controls Effectiveness Measurement Framework Metrics. Any program that is designed to accomplish certain objectives, needs to establish program level controls pertaining to the overall goal. A critical aspect that determines the success of a program is the quality of the controls and their effectiveness in accomplishing the goal. Traditional Control Maturity Models primarily focus on the efficiency, management, and optimization of controls, while only indirectly measuring control effectiveness which neglects an essential aspect of control efficacy. In this paper, we highlight the ineffectiveness of these models, outline an adaptable program controls framework, and provide an approach to define measurable attributes (metrics) that enable a zero defect program. To the best of our knowledge, we believe this is the first paper that provides a structured approach to defining a controls measurement framework and creation of effectiveness metrics that can be adopted by a variety of program use cases.


Coarse Grained Complexity for Dynamic Algorithms. To date, the only way to argue polynomial lower bounds for dynamic algorithms is via fine grained complexity arguments. These arguments rely on strong assumptions about specific problems such as the Strong Exponential Time Hypothesis (SETH) and the Online Matrix Vector Multiplication Conjecture (OMv). While they have led to many exciting discoveries, dynamic algorithms still miss out some benefits and lessons from the traditional coarse grained'' approach that relates together classes of problems such as P and NP. In this paper we initiate the study of coarse grained complexity theory for dynamic algorithms. Below are among questions that this theory can answer. What if dynamic Orthogonal Vector (OV) is easy in the cell probe model? A research program for proving polynomial unconditional lower bounds for dynamic OV in the cell probe model is motivated by the fact that many conditional lower bounds can be shown via reductions from the dynamic OV problem. Since the cell probe model is more powerful than word RAM and has historically allowed smaller upper bounds, it might turn out that dynamic OV is easy in the cell probe model, making this research direction infeasible. Our theory implies that if this is the case, there will be very interesting algorithmic consequences If dynamic OV can be maintained in polylogarithmic worst case update time in the cell probe model, then so are several important dynamic problems such as k edge connectivity, (1 epsilon) approximate mincut, (1 epsilon) approximate matching, planar nearest neighbors, Chan's subset union and 3 vs 4 diameter. The same conclusion can be made when we replace dynamic OV by, e.g., subgraph connectivity, single source reachability, Chan's subset union, and 3 vs 4 diameter. Lower bounds for k edge connectivity via dynamic OV? (see the full abstract in the pdf file).


Poincar ' e series of relative symmetric invariants for SL n( mathbb C ) . Let (N, G), where N is a normal subgroup of G SL n(C), be a pair of finite groups and V a finite dimensional fundamental G module. We study the G invariants in the symmetric algebra S(V) by giving explicit formulas of the Poincar ' e series for the induced modules and restriction modules. In particular, this provides a uniform formula of the Poincar ' e series for the symmetric invariants in terms of the McKay Slodowy correspondence. Moreover, we also derive a global version of the Poincar 'e series in terms of Tchebychev polynomials in the sense that one needs only the dimensions of the subgroups and their group types to completely determine the Poincar 'e series.


Reputation (In)dependence in Ranking Systems Demographics Influence Over Output Disparities. Recent literature on ranking systems (RS) has considered users' exposure when they are the object of the ranking. Although items are the object of reputation based RS, users have a central role also in this class of algorithms. Indeed, when ranking the items, user preferences are weighted by how relevant this user is in the platform (i.e., their reputation). In this paper, we formulate the concept of disparate reputation (DR) and study if users characterized by sensitive attributes systematically get a lower reputation, leading to a final ranking that reflects less their preferences. We consider two demographic attributes, i.e., gender and age, and show that DR systematically occurs. Then, we propose mitigation, which ensures that reputation is independent of the users' sensitive attributes. Experiments on real world data show that our approach can overcome DR and also improve ranking effectiveness.


On the Steady Prandtl Boundary Layer Expansions. In this paper, we consider the zero viscosity limit of the 2D steady Navier Stokes equations in (0,L) times mathbb R with non slip boundary conditions. By estimating the stream function of the remainder, we justify the validity of the Prandtl boundary layer expansions.


Single particle tracking uncertainties in ion imaging. An extensive comparison of the path uncertainty in single particle tracking systems for ion imaging was carried out based on Monte Carlo simulations. The spatial resolution as function of system parameters such as geometry, detector properties and the energy of proton and helium beams was investigated to serve as a guideline for hardware developments. Primary particle paths were sampled within a water volume and compared to the most likely path estimate obtained from detector measurements, yielding a depth dependent uncertainty envelope. The maximum uncertainty along this curve was converted to a conservative estimate of the minimal radiographic pixel spacing for a single set of parameter values. Simulations with various parameter settings were analysed to obtain an overview of the reachable pixel spacing as function of system parameters. The results were used to determine intervals of detector material budget and position resolution that yield a pixel spacing small enough for clinical dose calculation. To ensure a pixel spacing below 2 mm, the material budget of a detector should remain below 0.25 for a position resolution of 200 mathrm mu m or below 0.75 for a resolution of 10 mathrm mu m . Using protons, a sub millimetre pixel size could not be achieved for a phantom size of 300 mm or at a large clearance. With helium ions, a sub millimetre pixel spacing could be achieved even for a large phantom size and clearance, provided the position resolution was less than 100 mathrm mu m and material budget was below 0.75 .


Service Center Location with Decision Dependent Utilities. We study a service center location problem with ambiguous utility gains upon receiving service. The model is motivated by the problem of deciding medical clinic service centers, possibly in rural communities, where residents need to visit the clinics to receive health services. A resident gains his utility based on travel distance, waiting time, and service features of the facility that depend on the clinic location. The elicited location dependent utilities are assumed to be ambiguously described by an expected value and variance constraint. We show that despite a non convex nonlinearity, given by a constraint specified by a maximum of two second order conic functions, the model admits a mixed 0 1 second order cone (MISOCP) formulation. We study the non convex substructure of the problem, and present methods for developing its strengthened formulations by using valid tangent inequalities. Computational study shows the effectiveness of solving the strengthened formulations. Examples are used to illustrate the importance of including decision dependent ambiguity.


M setminus L near 3. We construct four new elements 3.11 m 1 m 2 m 3 m 4 of M backslash L lying in distinct connected components of mathbb R setminus L , where M is the Markov spectrum and L is the Lagrange spectrum. These elements are part of a decreasing sequence (m k) k in mathbb N of elements in M converging to 3 and we give some evidence towards the possibility that m k in M setminus L for all k geq 1 . In particular, this indicates that 3 might belong to the closure of M setminus L , so that the answer to Bousch's question about the closedness of M setminus L might be negative.


Semi supervised reward learning for offline reinforcement learning. In offline reinforcement learning (RL) agents are trained using a logged dataset. It appears to be the most natural route to attack real life applications because in domains such as healthcare and robotics interactions with the environment are either expensive or unethical. Training agents usually requires reward functions, but unfortunately, rewards are seldom available in practice and their engineering is challenging and laborious. To overcome this, we investigate reward learning under the constraint of minimizing human reward annotations. We consider two types of supervision timestep annotations and demonstrations. We propose semi supervised learning algorithms that learn from limited annotations and incorporate unlabelled data. In our experiments with a simulated robotic arm, we greatly improve upon behavioural cloning and closely approach the performance achieved with ground truth rewards. We further investigate the relationship between the quality of the reward model and the final policies. We notice, for example, that the reward models do not need to be perfect to result in useful policies.


On the interplay between mobility and hospitalization capacity during the COVID 19 pandemic The SEIRHUD model. Measures to reduce the impact of the COVID 19 pandemic require a mix of logistic, political and social capacity. Depending on the country, different approaches to increase hospitalization capacity or to properly apply lock downs are observed. In order to better understand the impact of these measures we have developed a compartmental model which, on the one hand allows to calibrate the reduction of movement of people within and among different areas, and on the other hand it incorporates a hospitalization dynamics that differentiates the available kinds of treatment that infected people can receive. By bounding the hospitalization capacity, we are able to study in detail the interplay between mobility and hospitalization capacity.


Recurrence relations satisfied by the traces of singular moduli for Gamma 0(N) . We compute the divisor of the modular equation on the modular curve Gamma 0(N) backslash mathbb H and then find recurrence relations satisfied by the modular traces of the Hauptmodul for any congruence subgroup Gamma 0(N) of genus zero. We also introduce the notions and properties of Gamma equivalence and Gamma reduced forms about binary quadratic forms. Using these, we can explicitly compute the recurrence relations for N 2, 3, 4, 5 .


A Topological Characterization of Modulo p Arguments and Implications for Necklace Splitting. The classes PPA p have attracted attention lately, because they are the main candidates for capturing the complexity of Necklace Splitting with p thieves, for prime p . However, these classes were not known to have complete problems of a topological nature, which impedes any progress towards settling the complexity of the Necklace Splitting problem. On the contrary, topological problems have been pivotal in obtaining completeness results for PPAD and PPA, such as the PPAD completeness of finding a Nash equilibrium Daskalakis et al., 2009, Chen et al., 2009b and the PPA completeness of Necklace Splitting with 2 thieves Filos Ratsikas and Goldberg, 2019 . In this paper, we provide the first topological characterization of the classes PPA p . First, we show that the computational problem associated with a simple generalization of Tucker's Lemma, termed p polygon Tucker, as well as the associated Borsuk Ulam type theorem, p polygon Borsuk Ulam, are PPA p complete. Then, we show that the computational version of the well known BSS Theorem Barany et al., 1981 , as well as the associated BSS Tucker problem are PPA p complete. Finally, using a different generalization of Tucker's Lemma (termed mathbb Z p star Tucker), which we prove to be PPA p complete, we prove that p thief Necklace Splitting is in PPA p . This latter result gives a new combinatorial proof for the Necklace Splitting theorem, the only proof of this nature other than that of Meunier 2014 . All of our containment results are obtained through a new combinatorial proof for mathbb Z p versions of Tucker's lemma that is a natural generalization of the standard combinatorial proof of Tucker's lemma by Freund and Todd 1981 . We believe that this new proof technique is of independent interest.


Few shot learning using pre training and shots, enriched by pre trained samples. We use the EMNIST dataset of handwritten digits to test a simple approach for few shot learning. A fully connected neural network is pre trained with a subset of the 10 digits and used for few shot learning with untrained digits. Two basic ideas are introduced during few shot learning the learning of the first layer is disabled, and for every shot a previously unknown digit is used together with four previously trained digits for the gradient descend, until a predefined threshold condition is fulfilled. This way we reach about 90 accuracy after 10 shots.