E2EET From Pipeline to End to end Entity Typing via Transformer Based Embeddings. Entity Typing (ET) is the process of identifying the semantic types of every entity within a corpus. In contrast to Named Entity Recognition, where each token in a sentence is labelled with zero or one class label, ET involves labelling each entity mention with one or more class labels. Existing entity typing models, which operate at the mention level, are limited by two key factors they do not make use of recently proposed context dependent embeddings, and are trained on fixed context windows. They are therefore sensitive to window size selection and are unable to incorporate the context of the entire document. In light of these drawbacks we propose to incorporate context using transformer based embeddings for a mention level model, and an end to end model using a Bi GRU to remove the dependency on window size. An extensive ablative study demonstrates the effectiveness of contextualised embeddings for mention level models and the competitiveness of our end to end model for entity typing.


POWER SUPPLaY Leaking Data from Air Gapped Systems by Turning the Power Supplies Into Speakers. It is known that attackers can exfiltrate data from air gapped computers through their speakers via sonic and ultrasonic waves. To eliminate the threat of such acoustic covert channels in sensitive systems, audio hardware can be disabled and the use of loudspeakers can be strictly forbidden. Such audio less systems are considered to be textit audio gapped , and hence immune to acoustic covert channels. In this paper, we introduce a technique that enable attackers leak data acoustically from air gapped and audio gapped systems. Our developed malware can exploit the computer power supply unit (PSU) to play sounds and use it as an out of band, secondary speaker with limited capabilities. The malicious code manipulates the internal textit switching frequency of the power supply and hence controls the sound waveforms generated from its capacitors and transformers. Our technique enables producing audio tones in a frequency band of 0 24khz and playing audio streams (e.g., WAV) from a computer power supply without the need for audio hardware or speakers. Binary data (files, keylogging, encryption keys, etc.) can be modulated over the acoustic signals and sent to a nearby receiver (e.g., smartphone). We show that our technique works with various types of systems PC workstations and servers, as well as embedded systems and IoT devices that have no audio hardware at all. We provide technical background and discuss implementation details such as signal generation and data modulation. We show that the POWER SUPPLaY code can operate from an ordinary user mode process and doesn't need any hardware access or special privileges. Our evaluation shows that using POWER SUPPLaY, sensitive data can be exfiltrated from air gapped and audio gapped systems from a distance of five meters away at a maximal bit rates of 50 bit sec.


A non archimedean definable Chow theorem. Peterzil and Starchenko have proved the following surprising generalization of Chow's theorem A closed analytic subset of a complex algebraic variety that is definable in an o minimal structure, is in fact an algebraic subset. In this paper, we prove a non archimedean analogue of this result.


Averaged Invariants in Storage Rings with Synchrotron Motion. In an ideal accelerator, the single particle dynamics can be decoupled into transverse motion the betatron oscillations and longitudinal motion the synchrotron oscillations. Chromatic and dispersive effects introduce a coupling between these dynamics, the so called synchro betatron coupling. We present an analysis of the fully coupled dynamics over a single synchrotron oscillation that leads to an averaged invariant with synchro betatron coupling in a generic lattice. We apply this analysis to two problems first, a toy lattice where the computations are analytically tractable, then a design for a rapid cycling synchrotron built using the integrable optics described by Danilov and Nagaitsev, showing that although there is fairly complex behavior over the course of a synchrotron oscillation, the Danilov Nagaitsev invariants are nevertheless periodic with the synchrotron motion.


Reductions of some two dimensional crystalline representations via Kisin modules. We determine rational Kisin modules associated with two dimensional, irreducible, crystalline representations of mathrm Gal ( overline mathbb Q p mathbb Q p) of Hodge Tate weights 0, k 1 . If the slope is larger than lfloor frac k 1 p rfloor , we further identify an integral Kisin module, which we use to calculate the semisimple reduction of the Galois representation. In that range, we find that the reduction is constant, thereby improving on a theorem of Berger, Li, and Zhu.


Optimal governance and implementation of vaccination programmes to contain the COVID 19 pandemic. Since the recent introduction of several viable vaccines for SARS CoV 2, vaccination uptake has become the key factor that will determine our success in containing the COVID 19 pandemic. We argue that game theory and social network models should be used to guide decisions pertaining to vaccination programmes for the best possible results. In the months following the introduction of vaccines, their availability and the human resources needed to run the vaccination programmes have been scarce in many countries. Vaccine hesitancy is also being encountered from some sections of the general public. We emphasize that decision making under uncertainty and imperfect information, and with only conditionally optimal outcomes, is a unique forte of established game theoretic modelling. Therefore, we can use this approach to obtain the best framework for modelling and simulating vaccination prioritization and uptake that will be readily available to inform important policy decisions for the optimal control of the COVID 19 pandemic.


pCAMP Performance Comparison of Machine Learning Packages on the Edges. Machine learning has changed the computing paradigm. Products today are built with machine intelligence as a central attribute, and consumers are beginning to expect near human interaction with the appliances they use. However, much of the deep learning revolution has been limited to the cloud. Recently, several machine learning packages based on edge devices have been announced which aim to offload the computing to the edges. However, little research has been done to evaluate these packages on the edges, making it difficult for end users to select an appropriate pair of software and hardware. In this paper, we make a performance comparison of several state of the art machine learning packages on the edges, including TensorFlow, Caffe2, MXNet, PyTorch, and TensorFlow Lite. We focus on evaluating the latency, memory footprint, and energy of these tools with two popular types of neural networks on different edge devices. This evaluation not only provides a reference to select appropriate combinations of hardware and software packages for end users but also points out possible future directions to optimize packages for developers.


physics.soc-ph cs.HC cs.LG cs.SI math.MG

How to choose the most appropriate centrality measure?. We propose a new method to select the most appropriate network centrality measure based on the user's opinion on how such a measure should work on a set of simple graphs. The method consists in (1) forming a set cal F of candidate measures (2) generating a sequence of sufficiently simple graphs that distinguish all measures in cal F on some pairs of nodes (3) compiling a survey with questions on comparing the centrality of test nodes (4) completing this survey, which provides a centrality measure consistent with all user responses. The developed algorithms make it possible to implement this approach for any finite set cal F of measures. This paper presents its realization for a set of 40 centrality measures. The proposed method called culling can be used for rapid analysis or combined with a normative approach by compiling a survey on the subset of measures that satisfy certain normative conditions (axioms). In the present study, the latter was done for the subsets determined by the Self consistency or Bridge axioms.


Spherically symmetric density and potential of a hydrogen molecule. Using a hydrogen molecule as a test system we demonstrate how to compute the effective potential according to the formalism of the new density functional theory (DFT), in which the basic variable is the set of spherically averaged densities instead of the total density, used in the traditional DFT. The effective potential together the external potential, nuclear Coulomb potential, can be substituted in the Schr "odinger like differential equation to obtain the spherically averaged electron density of the system. In the new method instead of one three dimensional low symmetry equation one has to solve as many spherically symmetric equations as there are atoms in the system.


Improved Approximation Algorithms for Tverberg Partitions. newcommand floor 1 left lfloor 1 right rfloor renewcommand Re mathbb R Tverberg's theorem states that a set of n points in Re d can be partitioned into floor n (d 1) sets with a common intersection. A point in this intersection (aka Tverberg point) is a centerpoint of the input point set, and the Tverberg partition provides a compact proof of this, which is algorithmically useful. Unfortunately, computing a Tverberg point exactly requires n O(d 2) time. We provide several new approximation algorithms for this problem, which improve either the running time or quality of approximation, or both. In particular, we provide the first strongly polynomial (in both n and d ) approximation algorithm for finding a Tverberg point.


L 2 Betti numbers arising from the lamplighter group. We apply a construction developed in a previous paper by the authors in order to obtain a formula which enables us to compute ell 2 Betti numbers coming from a family of group algebras representable as crossed product algebras. As an application, we obtain a whole family of irrational ell 2 Betti numbers arising from the lamplighter group algebra K mathbb Z 2 wr mathbb Z , being K a subfield of the complex numbers closed under complex conjugation. This procedure is constructive, in the sense that one has an explicit description of the elements realizing such irrational numbers. This extends the work made by Grabowski, who first computed irrational ell 2 Betti numbers from the algebras mathbb Q mathbb Z n wr mathbb Z , where n geq 2 is a natural number. We also apply the techniques developed to the (generalized) odometer algebra mathcal O ( overline n ) , where overline n is a supernatural number. We compute its regular closure, and this allows us to fully characterize the set of ell 2 Betti numbers arising from mathcal O ( overline n ) .


Synthetic construction of the Hopf fibration in a double orthogonal projection of 4 space. The Hopf fibration mapping circles on a 3 sphere to points on a 2 sphere is well known to topologists. While the 2 sphere is embedded in 3 space, four dimensional Euclidean space is needed to visualize the 3 sphere. Visualizing objects in 4 space using computer graphics based on their analytical representations has become popular in recent decades. For purely synthetic constructions, we apply the recently introduced method of visualization of 4 space by its double orthogonal projection onto two mutually perpendicular 3 spaces to investigate the Hopf fibration as a four dimensional relation without analogy in lower dimensions. In this paper, the method of double orthogonal projection is used for a direct synthetic construction of the fibers of a 3 sphere from the corresponding points on a 2 sphere. The fibers of great circles on the 2 sphere create nested tori visualized in a stereographic projection onto the modeling 3 space. The step by step construction is supplemented by dynamic three dimensional models showing simultaneously the 3 sphere, 2 sphere, and stereographic images of the fibers and mutual interrelations. Each step of the synthetic construction is supported by its analytical representation to highlight connections between the two interpretations.


An End to End Framework for Unsupervised Pose Estimation of Occluded Pedestrians. Pose estimation in the wild is a challenging problem, particularly in situations of (i) occlusions of varying degrees and (ii) crowded outdoor scenes. Most of the existing studies of pose estimation did not report the performance in similar situations. Moreover, pose annotations for occluded parts of human figures have not been provided in any of the relevant standard datasets which in turn creates further difficulties to the required studies for pose estimation of the entire figure of occluded humans. Well known pedestrian detection datasets such as CityPersons contains samples of outdoor scenes but it does not include pose annotations. Here, we propose a novel multi task framework for end to end training towards the entire pose estimation of pedestrians including in situations of any kind of occlusion. To tackle this problem for training the network, we make use of a pose estimation dataset, MS COCO, and employ unsupervised adversarial instance level domain adaptation for estimating the entire pose of occluded pedestrians. The experimental studies show that the proposed framework outperforms the SOTA results for pose estimation, instance segmentation and pedestrian detection in cases of heavy occlusions (HO) and reasonable heavy occlusions (R HO) on the two benchmark datasets.


Multi type Disentanglement without Adversarial Training. Controlling the style of natural language by disentangling the latent space is an important step towards interpretable machine learning. After the latent space is disentangled, the style of a sentence can be transformed by tuning the style representation without affecting other features of the sentence. Previous works usually use adversarial training to guarantee that disentangled vectors do not affect each other. However, adversarial methods are difficult to train. Especially when there are multiple features (e.g., sentiment, or tense, which we call style types in this paper), each feature requires a separate discriminator for extracting a disentangled style vector corresponding to that feature. In this paper, we propose a unified distribution controlling method, which provides each specific style value (the value of style types, e.g., positive sentiment, or past tense) with a unique representation. This method contributes a solid theoretical basis to avoid adversarial training in multi type disentanglement. We also propose multiple loss functions to achieve a style content disentanglement as well as a disentanglement among multiple style types. In addition, we observe that if two different style types always have some specific style values that occur together in the dataset, they will affect each other when transferring the style values. We call this phenomenon training bias, and we propose a loss function to alleviate such training bias while disentangling multiple types. We conduct experiments on two datasets (Yelp service reviews and Amazon product reviews) to evaluate the style disentangling effect and the unsupervised style transfer performance on two style types sentiment and tense. The experimental results show the effectiveness of our model.


Restricted Chase Termination for Existential Rules a Hierarchical Approach and Experimentation. The chase procedure for existential rules is an indispensable tool for several database applications, where its termination guarantees the decidability of these tasks. Most previous studies have focused on the skolem chase variant and its termination analysis. It is known that the restricted chase variant is a more powerful tool in termination analysis provided a database is given. But all instance termination presents a challenge since the critical database and similar techniques do not work. In this paper, we develop a novel technique to characterize the activeness of all possible cycles of a certain length for the restricted chase, which leads to the formulation of a parameterized class of the finite restricted chase, called k mathsf safe ( Phi) . This approach applies to any class of finite skolem chase identified with a condition of acyclicity. More generally, we show that the approach can be applied to the hierarchy of bounded rule sets previously only defined for the skolem chase. Experiments on a collection of ontologies from the web show the applicability of the proposed methods on real world ontologies. Under consideration in Theory and Practice of Logic Programming (TPLP).


Dynamics Landscape for Acoustic Superradiance. We analyze the behaviour of acoustic vortex beams interacting with rotating, fluid saturated porous materials. Regions of the parameter space that exhibit distinct dynamical features are identified, with a focus on features that are relevant to the characterization of rotational superradiance. We discuss the similarities and differences between two recent proposals to observe acoustic superradiance with rotating, air saturated sound absorbers. Finally, theoretical predictions for macroscopic acoustic scattering, obtained by averaging over interactions between the fluid and the porous material at the microscopic level, are compared with predictions of the first Born approximation.


Non Parametric Priors For Generative Adversarial Networks. The advent of generative adversarial networks (GAN) has enabled new capabilities in synthesis, interpolation, and data augmentation heretofore considered very challenging. However, one of the common assumptions in most GAN architectures is the assumption of simple parametric latent space distributions. While easy to implement, a simple latent space distribution can be problematic for uses such as interpolation. This is due to distributional mismatches when samples are interpolated in the latent space. We present a straightforward formalization of this problem using basic results from probability theory and off the shelf optimization tools, we develop ways to arrive at appropriate non parametric priors. The obtained prior exhibits unusual qualitative properties in terms of its shape, and quantitative benefits in terms of lower divergence with its mid point distribution. We demonstrate that our designed prior helps improve image generation along any Euclidean straight line during interpolation, both qualitatively and quantitatively, without any additional training or architectural modifications. The proposed formulation is quite flexible, paving the way to impose newer constraints on the latent space statistics.


Character correspondeces in solvable groups with a self normalizing Sylow subgroup. In 1973, I. M. Isaacs described a correspondence between characters of degree not divisible by a fixed prime p of a finite solvable group G and those of the normalizer of Sylow p subgroup of G , whenever the index of the normalizer in G is odd. This correspondence is natural in the sense that an algorithm is provided to compute it, and the result of the application of the algorithm does not depend on choices made. Later on, for p solvable groups with self normalizing Sylow p subgroup, G. Navarro showed that every irreducible character of degree not divisible by p has a unique linear constituent when restricted to a Sylow p subgroup. Furthermore, the process of choosing the unique linear constituent of the restriction defines a bijection. Navarro's bijection is obviously natural in the sense described above. We show that these two correspondences are the same under the intersection of the hypotheses.


MLQA Evaluating Cross lingual Extractive Question Answering. Question answering (QA) models have shown rapid progress enabled by the availability of large, high quality benchmark datasets. Such annotated datasets are difficult and costly to collect, and rarely exist in languages other than English, making training QA systems in other languages challenging. An alternative to building large monolingual training datasets is to develop cross lingual systems which can transfer to a target language without requiring training data in that language. In order to develop such systems, it is crucial to invest in high quality multilingual evaluation benchmarks to measure progress. We present MLQA, a multi way aligned extractive QA evaluation benchmark intended to spur research in this area. MLQA contains QA instances in 7 languages, namely English, Arabic, German, Spanish, Hindi, Vietnamese and Simplified Chinese. It consists of over 12K QA instances in English and 5K in each other language, with each QA instance being parallel between 4 languages on average. MLQA is built using a novel alignment context strategy on Wikipedia articles, and serves as a cross lingual extension to existing extractive QA datasets. We evaluate current state of the art cross lingual representations on MLQA, and also provide machine translation based baselines. In all cases, transfer results are shown to be significantly behind training language performance.


Foliations on the open 3 ball by complete surfaces. When is a manifold a leaf of a complete closed foliation on the open unit ball? We give some answers to this question.


A note on a straight gravity tunnel through a rotating body. It is well known that the straight gravity tunnel between any two different positions on a non rotating Earth, which has uniform density, is traversable, i.e., an object initially at rest will reach its destination through the gravity tunnel in both directions. Moreover, the time taken to fall is always constant. These facts are no longer true if rotation is allowed. The aim of this note is to derive the necessary and sufficient condition for traversability of straight gravity tunnels through a rotating physical body with spherically symmetric gravitational field. Fall through times are expressed in a closed form for linear and constant gravitational fields. In conclusion, these models are compared to numerically obtained data using the internal structure of the Earth.


CsPbBr(Cl,I)3 quantum dots in fluorophosphate glasses. For the first time the quantum dots CsPbX 3 (X Cl, Br, I) in the fluorophosphate glasses were prepared. The samples were precipitated by two methods (i) through self crystallization during cooling of the glass melt and (ii) heat treatment of the glass. Controlled formation of CsPbX 3 quantum dots was realized by adjustment of cooling rate and heat treatment conditions. The X ray diffraction data was confirmed CsPbCl 3(Br 3, I 3) quantum dots formation. It was shown that, CsPbX 3 (X Cl, I) quantum dots are formed in a cubic modification, while CsPbBr 3 in orthorhombic one. The photoluminescence of quantum dots have high intensity with quantum yield 45 50 and narrow band emission. The combined introduction of two anions (Cl Br and Br I) led to the simultaneous formation of two types of quantum dots, and indicates the difficulty of the anion exchange.


Harnack type inequalities for operators in logarithmic submajorisation. The aim of this paper is to study the Harnack type logarithmic submajorisation and Fuglede Kadison determinant inequalities for operators in a finite von Neumann algebra. In particular, the Harnack type determinant inequalities due to Lin Zhang 15 and Yang Zhang 27 are extended to the case of operators in a finite von Neumann algebra.


On the generic behavior of the metric entropy, and related quantities, of uniformly continuous maps over Polish metric spaces. In this work, we show that if f is a uniformly continuous map defined over a Polish metric space, then the set of f invariant measures with zero metric entropy is a G delta set (in the weak topology). In particular, this set is generic if the set of f periodic measures is dense in the set of f invariant measures. This settles a conjecture posed by Sigmund (Sigmund, K. On dynamical systems with the specification property. Trans. Amer. Math. Soc. 190 (1974), 285 299) which states that the metric entropy of an invariant measure of a topological dynamical system that satisfies the periodic specification property is typically zero. We also show that if X is compact and if f is an expansive or a Lipschitz map with a dense set of periodic measures, typically the lower correlation entropy for q in(0,1) is equal to zero. Moreover, we show that if X is a compact metric space and if f is an expanding map with a dense set of periodic measures, then the set of invariant measures with packing dimension, upper rate of recurrence and upper quantitative waiting time indicator equal to zero is residual. Finally, we present an alternative proof of the fact that the set of expansive measures is a G delta sigma set in the set of probability measures M(X) , if X is a Polish metric space and if f is uniformly continuous this result was originally proved by Lee, Morales and Shin (Lee, K., Morales, C. A., and Shin, B. On the set of expansive measures. Commun. Contemp. Math. 20, 7 (2018), 1750086, 10) for compact metric spaces.


On some finiteness results in real 'etale cohomology. We show that for quasi compact quasi separated schemes of finite dimension, the constructibility condition in real 'etale cohomology agrees with a notion of constructibility arising naturally from topology. As application we prove that the derived direct image functor preserves constructibility under some assumptions, and compute the Grothendieck group of the constructible rational stable motivic homotopy category for reasonable schemes. We prove the generic base change property for constructible real 'etale sheaves, and deduce the same property for rational motivic spectra and b sheaves.


Privacy Preserving Stochastic Channel Based Federated Learning with Neural Network Pruning. Artificial neural network has achieved unprecedented success in a wide variety of domains such as classifying, predicting and recognizing objects. This success depends on the availability of big data since the training process requires massive and representative data sets. However, data collection is often prevented by privacy concerns and people want to take control over their sensitive information during both training and using processes. To address this problem, we propose a privacy preserving method for the distributed system, Stochastic Channel Based Federated Learning (SCBF), which enables the participants to train a high performance model cooperatively without sharing their inputs. We design, implement and evaluate a channel based update algorithm for the central server in a distributed system, which selects the channels with regard to the most active features in a training loop and uploads them as learned information from local datasets. A pruning process is applied to the algorithm based on the validation set, which serves as a model accelerator. In the experiment, our model presents equal performances and higher saturating speed than the Federated Averaging method which reveals all the parameters of local models to the server when updating. We also demonstrate that the converging rates could be increased by introducing a pruning process.


Combining Physical Simulators and Object Based Networks for Control. Physics engines play an important role in robot planning and control however, many real world control problems involve complex contact dynamics that cannot be characterized analytically. Most physics engines therefore employ . approximations that lead to a loss in precision. In this paper, we propose a hybrid dynamics model, simulator augmented interaction networks (SAIN), combining a physics engine with an object based neural network for dynamics modeling. Compared with existing models that are purely analytical or purely data driven, our hybrid model captures the dynamics of interacting objects in a more accurate and data efficient manner.Experiments both in simulation and on a real robot suggest that it also leads to better performance when used in complex control tasks. Finally, we show that our model generalizes to novel environments with varying object shapes and materials.


Simultaneous indivisibility of class numbers of pairs of real quadratic fields. For a square free integer t , Byeon cite byeon proved the existence of infinitely many pairs of quadratic fields mathbb Q ( sqrt D ) and mathbb Q ( sqrt tD ) with D 0 such that the class numbers of all of them are indivisible by 3 . In the same spirit, we prove that for a given integer t geq 1 with t equiv 0 pmod 4 , a positive proportion of fundamental discriminants D 0 exist for which the class numbers of both the real quadratic fields mathbb Q ( sqrt D ) and mathbb Q ( sqrt D t ) are indivisible by 3 . This also addresses the complement of a weak form of a conjecture of Iizuka in cite iizuka . As an application of our main result, we obtain that for any integer t geq 1 with t equiv 0 pmod 12 , there are infinitely many pairs of real quadratic fields mathbb Q ( sqrt D ) and mathbb Q ( sqrt D t ) such that the Iwasawa lambda invariants associated with the basic mathbb Z 3 extensions of both mathbb Q ( sqrt D ) and mathbb Q ( sqrt D t ) are 0 . For p 3 , this supports Greenberg's conjecture which asserts that lambda p (K) 0 for any prime number p and any totally real number field K .


On Newton polytope type sufficiency conditions for coercivity of polynomials. We identify new sufficiency conditions for coercivity of general multivariate polynomials f in mathbb R x which are expressed in terms of their Newton polytopes at infinity and which consist of a system of affine linear inequalities in the space of polynomial coefficients. By sharpening the already existing necessary conditions for coercivity for a class of gem irregular polynomials we provide a characterization of coercivity of circuit polynomials, which extends the known results on this well studied class of polynomials. For the already existing sufficiency conditions for coercivity which contain a description involving a set projection operation, we identify an equivalent description involving a single posynomial inequality. This makes them more easy to apply and hence also more appealing from the practical perspective. We relate our results to the existing literature and we illustrate our results with several examples.


QLens Visual Analytics of Multi step Problem solving Behaviors for Improving Question Design. With the rapid development of online education in recent years, there has been an increasing number of learning platforms that provide students with multi step questions to cultivate their problem solving skills. To guarantee the high quality of such learning materials, question designers need to inspect how students' problem solving processes unfold step by step to infer whether students' problem solving logic matches their design intent. They also need to compare the behaviors of different groups (e.g., students from different grades) to distribute questions to students with the right level of knowledge. The availability of fine grained interaction data, such as mouse movement trajectories from the online platforms, provides the opportunity to analyze problem solving behaviors. However, it is still challenging to interpret, summarize, and compare the high dimensional problem solving sequence data. In this paper, we present a visual analytics system, QLens, to help question designers inspect detailed problem solving trajectories, compare different student groups, distill insights for design improvements. In particular, QLens models problem solving behavior as a hybrid state transition graph and visualizes it through a novel glyph embedded Sankey diagram, which reflects students' problem solving logic, engagement, and encountered difficulties. We conduct three case studies and three expert interviews to demonstrate the usefulness of QLens on real world datasets that consist of thousands of problem solving traces.


Adversarial Crowdsourcing Through Robust Rank One Matrix Completion. We consider the problem of reconstructing a rank one matrix from a revealed subset of its entries when some of the revealed entries are corrupted with perturbations that are unknown and can be arbitrarily large. It is not known which revealed entries are corrupted. We propose a new algorithm combining alternating minimization with extreme value filtering and provide sufficient and necessary conditions to recover the original rank one matrix. In particular, we show that our proposed algorithm is optimal when the set of revealed entries is given by an Erd H o s R 'enyi random graph. These results are then applied to the problem of classification from crowdsourced data under the assumption that while the majority of the workers are governed by the standard single coin David Skene model (i.e., they output the correct answer with a certain probability), some of the workers can deviate arbitrarily from this model. In particular, the "adversarial" workers could even make decisions designed to make the algorithm output an incorrect answer. Extensive experimental results show our algorithm for this problem, based on rank one matrix completion with perturbations, outperforms all other state of the art methods in such an adversarial scenario.


Which graphs are rigid in ell p d ?. We present three results which support the conjecture that a graph is minimally rigid in d dimensional ell p space, where p in (1, infty) and p not 2 , if and only if it is (d,d) tight. Firstly, we introduce a graph bracing operation which preserves independence in the generic rigidity matroid when passing from ell p d to ell p d 1 . We then prove that every (d,d) sparse graph with minimum degree at most d 1 and maximum degree at most d 2 is independent in ell p d . Finally, we prove that every triangulation of the projective plane is minimally rigid in ell p 3 . A catalogue of rigidity preserving graph moves is also provided for the more general class of strictly convex and smooth normed spaces and we show that every triangulation of the sphere is independent for 3 dimensional spaces in this class.


Degenerate perturbation theory in thermoacoustics high order sensitivities and exceptional points. In this study, we connect concepts that have been recently developed in thermoacoustics, specifically, (i) high order spectral perturbation theory, (ii) symmetry induced degenerate thermoacoustic modes, (iii) intrinsic thermoacoustic modes, and (iv) exceptional points. Their connection helps gain physical insight into the behaviour of the thermoacoustic spectrum when parameters of the system are varied. First, we extend high order adjoint based perturbation theory of thermoacoustic modes to the degenerate case. We provide explicit formulae for the calculation of the eigenvalue corrections to any order. These formulae are valid for self adjoint, non self adjoint or even non normal systems therefore, they can be applied to a large range of problems, including fluid dynamics. Second, by analysing the expansion coefficients of the eigenvalue corrections as a function of a parameter of interest, we accurately estimate the radius of convergence of the power series. Third, we connect the existence of a finite radius of convergence to the existence of singularities in parameter space. We identify these singularities as exceptional points, which correspond to defective thermoacoustic eigenvalues, with infinite sensitivity to infinitesimal changes in the parameters. At an exceptional point, two eigenvalues and their associated eigenvectors coalesce. Close to an exceptional point, strong veering of the eigenvalue trajectories is observed. As demonstrated in recent work, exceptional points naturally arise in thermoacoustic systems due to the interaction between modes of acoustic and intrinsic origin. The role of exceptional points in thermoacoustic systems sheds new light on the physics and sensitivity of thermoacoustic stability, which can be leveraged for passive control by small design modifications.


User Intent Inference for Web Search and Conversational Agents. User intent understanding is a crucial step in designing both conversational agents and search engines. Detecting or inferring user intent is challenging, since the user utterances or queries can be short, ambiguous, and contextually dependent. To address these research challenges, my thesis work focuses on 1) Utterance topic and intent classification for conversational agents 2) Query intent mining and classification for Web search engines, focusing on the e commerce domain. To address the first topic, I proposed novel models to incorporate entity information and conversation context clues to predict both topic and intent of the user's utterances. For the second research topic, I plan to extend the existing state of the art methods in Web search intent prediction to the e commerce domain, via 1) Developing a joint learning model to predict search queries' intents and the product categories associated with them, 2) Discovering new hidden users' intents. All the models will be evaluated on the real queries available from a major e commerce site search engine. The results from these studies can be leveraged to improve performance of various tasks such as natural language understanding, query scoping, query suggestion, and ranking, resulting in an enriched user experience.


Learning Node Representations from Noisy Graph Structures. Learning low dimensional representations on graphs has proved to be effective in various downstream tasks. However, noises prevail in real world networks, which compromise networks to a large extent in that edges in networks propagate noises through the whole network instead of only the node itself. While existing methods tend to focus on preserving structural properties, the robustness of the learned representations against noises is generally ignored. In this paper, we propose a novel framework to learn noise free node representations and eliminate noises simultaneously. Since noises are often unknown on real graphs, we design two generators, namely a graph generator and a noise generator, to identify normal structures and noises in an unsupervised setting. On the one hand, the graph generator serves as a unified scheme to incorporate any useful graph prior knowledge to generate normal structures. We illustrate the generative process with community structures and power law degree distributions as examples. On the other hand, the noise generator generates graph noises not only satisfying some fundamental properties but also in an adaptive way. Thus, real noises with arbitrary distributions can be handled successfully. Finally, in order to eliminate noises and obtain noise free node representations, two generators need to be optimized jointly, and through maximum likelihood estimation, we equivalently convert the model into imposing different regularization constraints on the true graph and noises respectively. Our model is evaluated on both real world and synthetic data. It outperforms other strong baselines for node classification and graph reconstruction tasks, demonstrating its ability to eliminate graph noises.


A First Look at Privacy Analysis of COVID 19 Contact Tracing Mobile Applications. Today's smartphones are equipped with a large number of powerful value added sensors and features such as a low power Bluetooth sensor, powerful embedded sensors such as the digital compass, accelerometer, GPS sensors, Wi Fi capabilities, microphone, humidity sensors, health tracking sensors, and a camera, etc. These value added sensors have revolutionized the lives of the human being in many ways such, as tracking the health of the patients and movement of doctors, tracking employees movement in large manufacturing units, and monitoring the environment, etc. These embedded sensors could also be used for large scale personal, group, and community sensing applications especially tracing the spread of certain diseases. Governments and regulators are turning to use these features to trace the people thought to have symptoms of certain diseases or virus e.g. COVID 19. The outbreak of COVID 19 in December 2019, has seen a surge of the mobile applications for tracing, tracking and isolating the persons showing COVID 19 symptoms to limit the spread of disease to the larger community. The use of embedded sensors could disclose private information of the users thus potentially bring threat to the privacy and security of users. In this paper, we analyzed a large set of smartphone applications that have been designed to contain the spread of the COVID 19 virus and bring the people back to normal life. Specifically, we have analyzed what type of permission these smartphone apps require, whether these permissions are necessary for the track and trace, how data from the user devices is transported to the analytic center, and analyzing the security measures these apps have deployed to ensure the privacy and security of users.


Translate to Recognize Networks for RGB D Scene Recognition. Cross modal transfer is helpful to enhance modality specific discriminative power for scene recognition. To this end, this paper presents a unified framework to integrate the tasks of cross modal translation and modality specific recognition, termed as Translate to Recognize Network (TRecgNet). Specifically, both translation and recognition tasks share the same encoder network, which allows to explicitly regularize the training of recognition task with the help of translation, and thus improve its final generalization ability. For translation task, we place a decoder module on top of the encoder network and it is optimized with a new layer wise semantic loss, while for recognition task, we use a linear classifier based on the feature embedding from encoder and its training is guided by the standard cross entropy loss. In addition, our TRecgNet allows to exploit large numbers of unlabeled RGB D data to train the translation task and thus improve the representation power of encoder network. Empirically, we verify that this new semi supervised setting is able to further enhance the performance of recognition network. We perform experiments on two RGB D scene recognition benchmarks NYU Depth v2 and SUN RGB D, demonstrating that TRecgNet achieves superior performance to the existing state of the art methods, especially for recognition solely based on a single modality.


Task Planning with a Weighted Functional Object Oriented Network. In reality, there is still much to be done for robots to be able to perform manipulation actions with full autonomy. Complicated manipulation tasks, such as cooking, may still require a person to perform some actions that are very risky for a robot to perform. On the other hand, some other actions may be very risky for a human with physical disabilities to perform. Therefore, it is necessary to balance the workload of a robot and a human based on their limitations while minimizing the effort needed from a human in a collaborative robot (cobot) set up. This paper proposes a new version of our functional object oriented network (FOON) that integrates weights in its functional units to reflect a robot's chance of successfully executing an action of that functional unit. The paper also presents a task planning algorithm for the weighted FOON to allocate manipulation action load to the robot and human to achieve optimal performance while minimizing human effort. Through a number of experiments, this paper shows several successful cases in which using the proposed weighted FOON and the task planning algorithm allow a robot and a human to successfully complete complicated tasks together with higher success rates than a robot doing them alone.


State Classification of Cooking Objects Using a VGG CNN. In machine learning, it is very important for a robot to know the state of an object and recognize particular desired states. This is an image classification problem that can be solved using a convolutional neural network. In this paper, we will discuss the use of a VGG convolutional neural network to recognize those states of cooking objects. We will discuss the uses of activation functions, optimizers, data augmentation, layer additions, and other different versions of architectures. The results of this paper will be used to identify alternatives to the VGG convolutional neural network to improve accuracy.


Spectrum decomposition of translation operators in periodic waveguide. Scattering problems in periodic waveguides are interesting but also challenging topics in mathematics, both theoretically and numerically. Due to the existence of eigenvalues, the unique solvability of these problems is not always guaranteed. To obtain a unique solution that is "physically meaningful", the limiting absorption principle (LAP) is a commonly used method. LAP assumes that the limit of a family of solutions with absorbing media converges, as the absorption parameter tends to 0, and the limit is the "physically meaningful solution". It is also called the LAP solution in this paper. It has been proved that the LAP holds for periodic waveguides in Hoa11 . In this paper, we consider the spectrum decomposition of periodic translation operators. With the curve integral formulation and a generalized Residue theorem, the operator is explicitly described by its eigenvalues and generalized eigenfunctions, which are closely related to Bloch wave solutions. Then the LAP solution is decomposed into generalized eigenfunctions. This gives a better understanding of structure of the scattered fields.


Handwriting Prediction Considering Inter Class Bifurcation Structures. Temporal prediction is a still difficult task due to the chaotic behavior, non Markovian characteristics, and non stationary noise of temporal signals. Handwriting prediction is also challenging because of uncertainty arising from inter class bifurcation structures, in addition to the above problems. For example, the classes '0' and '6' are very similar in terms of their beginning parts therefore it is nearly impossible to predict their subsequent parts from the beginning part. In other words, '0' and '6' have a bifurcation structure due to ambiguity between classes, and we cannot make a long term prediction in this context. In this paper, we propose a temporal prediction model that can deal with this bifurcation structure. Specifically, the proposed model learns the bifurcation structure explicitly as a Gaussian mixture model (GMM) for each class as well as the posterior probability of the classes. The final result of prediction is represented as the weighted sum of GMMs using the class probabilities as weights. When multiple classes have large weights, the model can handle a bifurcation and thus avoid an inaccurate prediction. The proposed model is formulated as a neural network including long short term memories and is thus trained in an end to end manner. The proposed model was evaluated on the UNIPEN online handwritten character dataset, and the results show that the model can catch and deal with the bifurcation structures.


Semantic Regularization Improve Few shot Image Classification by Reducing Meta Shift. Few shot image classification requires the classifier to robustly cope with unseen classes even if there are only a few samples for each class. Recent advances benefit from the meta learning process where episodic tasks are formed to train a model that can adapt to class change. However, these task sare independent to each other and existing works mainly rely on limited samples of individual support set in a single meta task. This strategy leads to severe meta shift issues across multiple tasks, meaning the learned prototypes or class descriptors are not stable as each task only involves their own support set. To avoid this problem, we propose a concise Semantic RegularizationNetwork to learn a common semantic space under the framework of meta learning. In this space, all class descriptors can be regularized by the learned semantic basis, which can effectively solve the meta shift problem. The key is to train a class encoder and decoder structure that can encode the sample embedding features into the semantic domain with trained semantic basis, and generate a more stable and general class descriptor from the decoder. We evaluate our work by extensive comparisons with previous methods on three benchmark datasets (MiniImageNet, TieredImageNet, and CUB). The results show that the semantic regularization module improves performance by 4 7 over the baseline method, and achieves competitive results over the current state of the art models.


On Entry II.16.12 A continued fraction of Ramanujan. We study a continued fraction due to Ramanujan, that he recorded as Entry 12 in Chapter 16 of his second notebook. It is presented in Part III of Berndt's volumes on Ramanujan's notebooks. We give two alternate approaches to proving Ramanujan's Entry 12, one using a method of Euler, and another using the theory of orthogonal polynomials. We consider a natural generalization of Entry 12 suggested by the theory of orthogonal polynomials.


Spontaneous dynamics of two dimensional Leidenfrost wheels. Recent experiments have shown that liquid Leidenfrost drops levitated by their vapor above a flat hot surface can exhibit symmetry breaking spontaneous dynamics (A. Bouillant et al., Nature Physics, 14 1188 1192, 2018). Motivated by these observations, we theoretically investigate the translational and rotational dynamics of Leidenfrost drops on the basis of a simplified two dimensional model, focusing on near circular drops small relative to the capillary length. The model couples the equations of motion of the drop, which flows as a rigid wheel, and thin film equations governing the vapor flow, the profile of the deformable vapor liquid interface and thus the hydrodynamic forces and torques on the drop. In contrast to previous analytical models of Leidenfrost drops levitating above a flat surface, which predict only symmetric solutions, we find that the symmetric Leidenfrost state is unstable above a critical drop radius R 1 for a free drop and R 2 R 1 for an immobilized drop. In these respective cases, symmetry breaking is manifested in supercritical pitchfork bifurcations into steady states of pure rolling and constant angular velocity. In further qualitative agreement with the experiments, when a symmetry broken immobilized drop is suddenly released it initially moves at an acceleration alpha g , where alpha is an angle characterizing the slope of the liquid vapor profile and g is the gravitational acceleration moreover, alpha exhibits a maximum with respect to the drop radius, at a radius increasing with the temperature difference between the surface and the drop.


A New Mask R CNN Based Method for Improved Landslide Detection. This paper presents a novel method of landslide detection by exploiting the Mask R CNN capability of identifying an object layout by using a pixel based segmentation, along with transfer learning used to train the proposed model. A data set of 160 elements is created containing landslide and non landslide images. The proposed method consists of three steps (i) augmenting training image samples to increase the volume of the training data, (ii) fine tuning with limited image samples, and (iii) performance evaluation of the algorithm in terms of precision, recall and F1 measure, on the considered landslide images, by adopting ResNet 50 and 101 as backbone models. The experimental results are quite encouraging as the proposed method achieves Precision equals to 1.00, Recall 0.93 and F1 measure 0.97, when ResNet 101 is used as backbone model, and with a low number of landslide photographs used as training samples. The proposed algorithm can be potentially useful for land use planners and policy makers of hilly areas where intermittent slope deformations necessitate landslide detection as prerequisite before planning.


LOL Lidar Only Odometry and Localization in 3D Point Cloud Maps. In this paper we deal with the problem of odometry and localization for Lidar equipped vehicles driving in urban environments, where a premade target map exists to localize against. In our problem formulation, to correct the accumulated drift of the Lidar only odometry we apply a place recognition method to detect geometrically similar locations between the online 3D point cloud and the a priori offline map. In the proposed system, we integrate a state of the art Lidar only odometry algorithm with a recently proposed 3D point segment matching method by complementing their advantages. Also, we propose additional enhancements in order to reduce the number of false matches between the online point cloud and the target map, and to refine the position estimation error whenever a good match is detected. We demonstrate the utility of the proposed LOL system on several Kitti datasets of different lengths and environments, where the relocalization accuracy and the precision of the vehicle's trajectory were significantly improved in every case, while still being able to maintain real time performance.


A Step Towards Exposing Bias in Trained Deep Convolutional Neural Network Models. We present Smooth Grad CAM , a technique which combines two recent techniques SMOOTHGRAD and Grad CAM . Smooth Grad CAM has the capability of either visualizing a layer, subset of feature maps, or subset of neurons within a feature map at each instance. We experimented with few images, and we discovered that Smooth Grad CAM produced more visually sharp maps with larger number of salient pixels highlighted in the given input images when compared with other methods. Smooth Grad CAM will give insight into what our deep CNN models (including models trained on medical scan or imagery) learn. Hence informing decisions on creating a representative training set.


A MacCormack Method for Complete Shallow Water Equations with Source Terms. In the last decades, more or less complex physically based hydrological models, have been developed to solve the shallow water equations or their approximations using various numerical methods. The MacCormack method was developed for simulating overland flow with spatially variable infiltration and microtopography using the hydrodynamic flow equations. The basic MacCormack scheme is enhanced when it uses the method of fractional steps to treat the friction slope or a stiff source term and to upwind the convection term in order to control the numerical oscillations and stability. In this paper we describe, the MacCormack scheme for 1D complete shallow water equations with source terms, analyze the stability condition of the method and we provide the convergence rate of the algorithm. This work improves some well known results deeply studied in the literature which concern the Saint Venant problem and it represents an extension of the time dependent shallow water equations without source terms. The numerical evidences consider the rate of convergence of the method and compares the numerical solution respect to the analytical one.


Optimal synthesis in the simplest time optimal problem with a linear state constraint. We consider the time optimal problem for a classical system of "double integrator" under the presence of a linear state constraint. By using the Maximum Principle of Dubovitskii and Milyutin, we determine a complete synthesis of optimal trajectories and qualitatively analyze the corresponding Lagrange multipliers.


Google Auto ML versus Apple Create ML for Histopathologic Cancer Diagnosis Which Algorithms Are Better?. Artificial Intelligence is set to revolutionize multiple fields in the coming years. One subset of AI, machine learning, shows immense potential for application in a diverse set of medical specialties, including diagnostic pathology. In this study, we investigate the utility of the Apple Create ML and Google Cloud Auto ML, two machine learning platforms, in a variety of pathological scenarios involving lung and colon pathology. First, we evaluate the ability of the platforms to differentiate normal lung tissue from cancerous lung tissue. Also, the ability to accurately distinguish two subtypes of lung cancer (adenocarcinoma and squamous cell carcinoma) is examined and compared. Similarly, the ability of the two programs to differentiate colon adenocarcinoma from normal colon is assessed as is done with lung tissue. Also, cases of colon adenocarcinoma are evaluated for the presence or absence of a specific gene mutation known as KRAS. Finally, our last experiment examines the ability of the Apple and Google platforms to differentiate between adenocarcinomas of lung origin versus colon origin. In our trained models for lung and colon cancer diagnosis, both Apple and Google machine learning algorithms performed very well individually and with no statistically significant differences found between the two platforms. However, some critical factors set them apart. Apple Create ML can be used on local computers but is limited to an Apple ecosystem. Google Auto ML is not platform specific but runs only in Google Cloud with associated computational fees. In the end, both are excellent machine learning tools that have great potential in the field of diagnostic pathology, and which one to choose would depend on personal preference, programming experience, and available storage space.


On A Special Type Of Ma Minda Function. This paper deals with a special type of Ma Minda function introduced here with many fascinating facts and interesting applications. It is much akin in all aspects but differs by a condition from its Ma Minda counterpart. Further, we consider the function 1 log(1 z) , a special Ma Minda of the type introduced here, to define a subclass of starlike functions in a similar fashion as we do with Ma Minda function and is studied for establishing inclusion and radius results. Apart from that, we also deal with the majorization and Bloch function norm problems for the same class. In addition, we obtain the bounds of fourth coefficient a 4 and second Hankel determinant H 2(2) for the functions belonging to a newly defined class using convolution, which generalizes many earlier known results and its association with the special type of Ma Minda function is also pointed out.


Dynamic Origin Destination Estimation Using Smart Card Data An Entropy Maximisation Approach. Problems of dynamic origin destination (OD) estimation using smart card data can be modelled using entropy maximisation and solved for large networks using solution techniques such as Lagrangian relaxation. In this paper, we give an overview of the research literature about OD estimation. We show how entropy maximisation can be used to model this problem in case station entry data from smart cards is the only available information, i.e. number of entries is known but not exits nor the flow between the stations. The large entropy maximisation program is solved using Lagrangian relaxation. The model is tested on a case study from the commuter train service in Stockholm with smart card entry data from a working day in 2015. The results show that, given the entry data, the entropy maximisation based model and methods allows to find an OD estimate that is as accurate as the reported estimates from manual observations. The estimates are further improved when using relevant assumptions and additional available data.


High resolution imaging of molecular collisions using a Zeeman decelerator. We present the first crossed beam scattering experiment using a Zeeman decelerated molecular beam. The narrow velocity spreads of Zeeman decelerated NO ( X 2 Pi 3 2 , j 3 2 ) radicals result in high resolution scattering images, thereby fully resolving quantum diffraction oscillations in the angular scattering distribution for inelastic NO Ne collisions, and product pair correlations in the radial scattering distribution for inelastic NO O 2 collisions. These measurements demonstrate similar resolution and sensitivity as in experiments using Stark decelerators, opening up possibilities for controlled and low energy scattering experiments using chemically relevant species such as H and O atoms, O 2 molecules or NH radicals.


Reliable Real Time Ball Tracking for Robot Table Tennis. Robot table tennis systems require a vision system that can track the ball position with low latency and high sampling rate. Altering the ball to simplify the tracking using for instance infrared coating changes the physics of the ball trajectory. As a result, table tennis systems use custom tracking systems to track the ball based on heuristic algorithms respecting the real time constrains applied to RGB images captured with a set of cameras. However, these heuristic algorithms often report erroneous ball positions, and the table tennis policies typically need to incorporate additional heuristics to detect and possibly correct outliers. In this paper, we propose a vision system for object detection and tracking that focus on reliability while providing real time performance. Our assumption is that by using multiple cameras, we can find and discard the errors obtained in the object detection phase by checking for consistency with the positions reported by other cameras. We provide an open source implementation of the proposed tracking system to simplify future research in robot table tennis or related tracking applications with strong real time requirements. We evaluate the proposed system thoroughly in simulation and in the real system, outperforming previous work. Furthermore, we show that the accuracy and robustness of the proposed system increases as more cameras are added. Finally, we evaluate the table tennis playing performance of an existing method in the real robot using the proposed vision system. We measure a slight increase in performance compared to a previous vision system even after removing all the heuristics previously present to filter out erroneous ball observations.


A Direct Sampling Method for Simultaneously Recovering Inhomogeneous Inclusions of Different Nature. In this work, we investigate a class of elliptic inverse problems and aim to simultaneously recover multiple inhomogeneous inclusions arising from two different physical parameters, using very limited boundary Cauchy data collected only at one or two measurement events. We propose a new fast, stable and highly parallelable direct sampling method (DSM) for the simultaneous reconstruction process. Two groups of probing and index functions are constructed, and their desired properties are analyzed. In order to identify and decouple the multiple inhomogeneous inclusions of different physical nature, we introduce a new concept of mutually almost orthogonality property that generalizes the important concept of almost orthogonality property in classical DSMs for inhomogeneous inclusions of same physical nature. With the help of this new concept, we develop a reliable strategy to distinguish two different types of inhomogeneous inclusions with noisy data collected at one or two measurement events. We further improve the decoupling effect by choosing an appropriate boundary influx. Numerical experiments are presented to illustrate the robustness and efficiency of the proposed method.


Variations of largest rectangle recognition amidst a bichromatic point set. Classical separability problem involving multi color point sets is an important area of study in computational geometry. In this paper, we study different separability problems for bichromatic point set P P r cup P b on a plane, where P r and P b represent the set of n red points and m blue points respectively, and the objective is to compute a monochromatic object of the desired type and of maximum size. We propose in place algorithms for computing (i) an arbitrarily oriented monochromatic rectangle of maximum size in R 2, (ii) an axis parallel monochromatic cuboid of maximum size in R 3. The time complexities of the algorithms for problems (i) and (ii) are O(m(m n)(m sqrt n m log m n log n)) and O(m 3 sqrt n m 2n log n), respectively. As a prerequisite, we propose an in place construction of the classic data structure the k d tree, which was originally invented by J. L. Bentley in 1975. Our in place variant of the k d tree for a set of n points in R k supports both orthogonal range reporting and counting query using O(1) extra workspace, and these query time complexities are the same as the classical complexities, i.e., O(n 1 1 k mu) and O(n 1 1 k ), respectively, where mu is the output size of the reporting query. The construction time of this data structure is O(n log n). Both the construction and query algorithms are non recursive in nature that do not need O( log n) size recursion stack compared to the previously known construction algorithm for in place k d tree and query in it. We believe that this result is of independent interest. We also propose an algorithm for the problem of computing an arbitrarily oriented rectangle of maximum weight among a point set P P r cup P b, where each point in P b (resp. P r) is associated with a negative (resp. positive) real valued weight that runs in O(m 2(n m) log(n m)) time using O(n) extra space.


Regular sets in Cayley graphs. In a graph Gamma with vertex set V , a subset C of V is called an (a,b) perfect set if every vertex in C has exactly a neighbors in C and every vertex in V setminus C has exactly b neighbors in C , where a and b are nonnegative integers. In the literature (0,1) perfect sets are known as perfect codes and (1,1) perfect sets are known as total perfect codes. In this paper we prove that, for any finite group G , if a non trivial normal subgroup H of G is a perfect code in some Cayley graph of G , then it is also an (a,b) perfect set in some Cayley graph of G for any pair of integers a and b with 0 leqslant a leqslant H 1 and 0 leqslant b leqslant H such that gcd(2, H 1) divides a . A similar result involving total perfect codes is also proved in the paper.


Typical dynamics and fluctuation analysis of slow fast systems driven by fractional Brownian motion. This article studies typical dynamics and fluctuations for a slow fast dynamical system perturbed by a small fractional Brownian noise. Based on an ergodic theorem with explicit rates of convergence, which may be of independent interest, we characterize the asymptotic dynamics of the slow component to two orders (i.e., the typical dynamics and the fluctuations). The limiting distribution of the fluctuations turns out to depend upon the manner in which the small noise parameter is taken to zero relative to the scale separation parameter. We study also an extension of the original model in which the relationship between the two small parameters leads to a qualitative difference in limiting behavior. The results of this paper provide an approximation, to two orders, to dynamical systems perturbed by small fractional Brownian noise and subject to multiscale effects.


Flexible stability and nonsoficity. A sofic group G is said to be flexibly stable if every sofic approximation to G can converted to a sequence of disjoint unions of Schreier graphs by modifying an asymptotically vanishing proportion of edges. We establish that if mathrm PSL d( mathbb Z ) is flexibly stable for some d geq 5 then there exists a group which is not sofic.


Reinforcement Learning for Test Case Prioritization. In modern software engineering, Continuous Integration (CI) has become an indispensable step towards systematically managing the life cycles of software development. Large companies struggle with keeping the pipeline updated and operational, in useful time, due to the large amount of changes and addition of features, that build on top of each other and have several developers, working on different platforms. Associated with such software changes, there is always a strong component of Testing. As teams and projects grow, exhaustive testing quickly becomes inhibitive, becoming adamant to select the most relevant test cases earlier, without compromising software quality. This paper extends recent studies on applying Reinforcement Learning to optimize testing strategies. We test its ability to adapt to new environments, by testing it on novel data extracted from a financial institution, yielding a Normalized percentage of Fault Detection (NAPFD) of over 0.6 using the Network Approximator and Test Case Failure Reward. Additionally, we studied the impact of using Decision Tree (DT) Approximator as a model for memory representation, which failed to produce significant improvements relative to Artificial Neural Networks.


On Polynomial Modular Number Systems over mathbb Z p mathbb Z . Since their introduction in 2004, Polynomial Modular Number Systems (PMNS) have become a very interesting tool for implementing cryptosystems relying on modular arithmetic in a secure and efficient way. However, while their implementation is simple, their parameterization is not trivial and relies on a suitable choice of the polynomial on which the PMNS operates. The initial proposals were based on particular binomials and trinomials. But these polynomials do not always provide systems with interesting characteristics such as small digits, fast reduction, etc. In this work, we study a larger family of polynomials that can be exploited to design a safe and efficient PMNS. To do so, we first state a complete existence theorem for PMNS which provides bounds on the size of the digits for a generic polynomial, significantly improving previous bounds. Then, we present classes of suitable polynomials which provide numerous PMNS for safe and efficient arithmetic.


An alternative extended linear system for boundary value problems on locally perturbed geometries. This manuscript presents a new extended linear system for integral equation based techniques for solving boundary value problems on locally perturbed geometries. The new extended linear system is similar to a previously presented technique for which the authors have constructed a fast direct solver. The key features of the work presented in this paper are that the fast direct solver is more efficient for the new extended linear system and that problems involving specialized quadrature for weakly singular kernels can be easily handled. Numerical results illustrate the improved performance of the fast direct solver for the new extended system when compared to the fast direct solver for the original extended system.


Tracking Emerges by Looking Around Static Scenes, with Neural 3D Mapping. We hypothesize that an agent that can look around in static scenes can learn rich visual representations applicable to 3D object tracking in complex dynamic scenes. We are motivated in this pursuit by the fact that the physical world itself is mostly static, and multiview correspondence labels are relatively cheap to collect in static scenes, e.g., by triangulation. We propose to leverage multiview data of textit static points in arbitrary scenes (static or dynamic), to learn a neural 3D mapping module which produces features that are correspondable across time. The neural 3D mapper consumes RGB D data as input, and produces a 3D voxel grid of deep features as output. We train the voxel features to be correspondable across viewpoints, using a contrastive loss, and correspondability across time emerges automatically. At test time, given an RGB D video with approximate camera poses, and given the 3D box of an object to track, we track the target object by generating a map of each timestep and locating the object's features within each map. In contrast to models that represent video streams in 2D or 2.5D, our model's 3D scene representation is disentangled from projection artifacts, is stable under camera motion, and is robust to partial occlusions. We test the proposed architectures in challenging simulated and real data, and show that our unsupervised 3D object trackers outperform prior unsupervised 2D and 2.5D trackers, and approach the accuracy of supervised trackers. This work demonstrates that 3D object trackers can emerge without tracking labels, through multiview self supervision on static data.


An outline of obstruction theories of extensions via track categories. Abelian track categories can be classified via the third Baues Wirsching cohomology of small categories. This approach is used in this paper to compare and classify different generalisations of the obstruction theory of non abelian group extensions, due to Cegarra, Garz 'on and Grandjean, Cegarra, Garz 'on and Ortega, and Chen, Du and Wang.


DockerizeMe Automatic Inference of Environment Dependencies for Python Code Snippets. Platforms like Stack Overflow and GitHub's gist system promote the sharing of ideas and programming techniques via the distribution of code snippets designed to illustrate particular tasks. Python, a popular and fast growing programming language, sees heavy use on both sites, with nearly one million questions asked on Stack Overflow and 400 thousand public gists on GitHub. Unfortunately, around 75 of the Python example code shared through these sites cannot be directly executed. When run in a clean environment, over 50 of public Python gists fail due to an import error for a missing library. We present DockerizeMe, a technique for inferring the dependencies needed to execute a Python code snippet without import error. DockerizeMe starts with offline knowledge acquisition of the resources and dependencies for popular Python packages from the Python Package Index (PyPI). It then builds Docker specifications using a graph based inference procedure. Our inference procedure resolves import errors in 892 out of nearly 3,000 gists from the Gistable dataset for which Gistable's baseline approach could not find and install all dependencies.


Moral decisions in the age of COVID 19 your choices really matter. The moral decisions we make during this period, such as deciding whether to comply with quarantine rules, have unprecedented societal effects. We simulate the "escape from Milan" that occurred on March 7th 8th 2020, when many travelers moved from a high risk zone (Milan) to southern regions of Italy (Campania and Lazio) immediately after an imminent lockdown was announced. Our simulations show that fewer than 50 active cases might have caused the sudden spread of the virus observed afterwards in these regions. The surprising influence of the actions of few individuals on societal dynamics challenges our cognitive expectations as in normal conditions, collective dynamics are rather robust to the decisions of few "cheaters". This situation therefore requires novel educational strategies that increase our awareness and understanding of the unprecedented effects of our individual moral decisions.


Dilations of markovian semigroups of measurable Schur multipliers. Using probabilistic tools, we prove that any weak continuous semigroup (T t) t geq 0 of selfadjoint unital completely positive measurable Schur multipliers acting on the space mathrm B ( mathrm L 2(X)) of bounded operators on the Hilbert space mathrm L 2(X) , where X is a finite measure space, can be dilated by a weak continuous group of Markov automorphisms on a bigger von Neumann algebra. We also construct a Markov dilation of these semigroups. Our results imply the boundedness of the McIntosh's mathrm H infty functional calculus of the generators of these semigroups on the associated Schatten spaces and some interpolation results connected to mathrm BMO spaces.


Quantum Optimal Control Theory for Solvated Systems. In this work, we extend the quantum optimal control theory of molecules subject to ultrashort laser pulses to the case of solvated systems, explicitly including the solvent dielectric properties in the system Hamiltonian. A reliable description of the solvent polarization is accounted for within the Polarizable Continuum Model (PCM). The electronic dynamics for the molecule in solution is coupled with the dynamics of the surrounding polarizable environment, that affects the features of the optimized light pulse. Examples on test molecules are presented and discussed to illustrate such effects.


Combining Deep Learning Classifiers for 3D Action Recognition. The popular task of 3D human action recognition is almost exclusively solved by training deep learning classifiers. To achieve a high recognition accuracy, the input 3D actions are often pre processed by various normalization or augmentation techniques. However, it is not computationally feasible to train a classifier for each possible variant of training data in order to select the best performing subset of pre processing techniques for a given dataset. In this paper, we propose to train an independent classifier for each available pre processing technique and fuse the classification results based on a strict majority vote rule. Together with a proposed evaluation procedure, we can very efficiently determine the best combination of normalization and augmentation techniques for a specific dataset. For the best performing combination, we can retrospectively apply the normalized augmented variants of input data to train only a single classifier. This also allows us to decide whether it is better to train a single model, or rather a set of independent classifiers.


Probabilistic Conditional System Invariant Generation with Bayesian Inference. Invariants are a set of properties over program attributes that are expected to be true during the execution of a program. Since developing those invariants manually can be costly and challenging, there are a myriad of approaches that support automated mining of likely invariants from sources such as program traces. Existing approaches, however, are not equipped to capture the rich states that condition the behavior of autonomous mobile robots, or to manage the uncertainty associated with many variables in these systems. This means that valuable invariants that appear only under specific states remain uncovered. In this work we introduce an approach to infer conditional probabilistic invariants to assist in the characterization of the behavior of such rich stateful, stochastic systems. These probabilistic invariants can encode a family of conditional patterns, are generated using Bayesian inference to leverage observed trace data against priors gleaned from previous experience and expert knowledge, and are ranked based on their surprise value and information content. Our studies on two semi autonomous mobile robotic systems show how the proposed approach is able to generate valuable and previously hidden stateful invariants.


Automated Metadata Harmonization Using Entity Resolution Contextual Embedding. ML Data Curation process typically consist of heterogeneous federated source systems with varied schema structures requiring curation process to standardize metadata from different schemas to an inter operable schema. This manual process of Metadata Harmonization cataloging slows efficiency of ML Ops lifecycle. We demonstrate automation of this step with the help of entity resolution methods also by using Cogntive Database's Db2Vec embedding approach to capture hidden inter column intra column relationships which detect similarity of metadata and then predict metadata columns from source schemas to any standardized schemas. Apart from matching schemas, we demonstrate that it can also infer the correct ontological structure of the target data model.


A long neck principle for Riemannian spin manifolds with positive scalar curvature. We develop index theory on compact Riemannian spin manifolds with boundary in the case when the topological information is encoded by bundles which are supported away from the boundary. As a first application, we establish a "long neck principle" for a compact Riemannian spin n manifold with boundary X , stating that if textrm scal (X) geq n(n 1) and there is a nonzero degree map into the sphere f colon X to S n which is strictly area decreasing, then the distance between the support of textrm d f and the boundary of X is at most pi n . This answers, in the spin setting and for strictly area decreasing maps, a question recently asked by Gromov. As a second application, we consider a Riemannian manifold X obtained by removing k pairwise disjoint embedded n balls from a closed spin n manifold Y . We show that if textrm scal (X) sigma 0 and Y satisfies a certain condition expressed in terms of higher index theory, then the radius of a geodesic collar neighborhood of partial X is at most pi sqrt (n 1) (n sigma) . Finally, we consider the case of a Riemannian n manifold V diffeomorphic to N times 1,1 , with N a closed spin manifold with nonvanishing Rosenberg index. In this case, we show that if textrm scal (V) geq sigma 0 , then the distance between the boundary components of V is at most 2 pi sqrt (n 1) (n sigma) . This last constant is sharp by an argument due to Gromov.


A converging finite element scheme for motion by curvature of a network with a triple junction. A new semi discrete finite element scheme for the evolution of three parametrized curves by curvature flow that are connected by a triple junction is presented and analyzed. In this triple junction, conditions are imposed on the angles at which the curves meet. One of the key problems in analyzing motion of networks by curvature law is the choice of a tangential velocity that allows for motion of the triple junction, does not lead to mesh degeneration, and is amenable to an error analysis. Our approach consists in considering a perturbation of a classical smooth formulation. The problem we propose admits a natural variational formulation that can be discretized with finite elements. The perturbation can be made arbitrarily small when a regularization parameter shrinks to zero. Convergence of the new scheme including optimal error estimates are proved. These results are supported by some numerical tests. Finally, the influence of the small regularization parameter on the properties of scheme and the accuracy of the results is numerically investigated.


Makespan Minimization with OR Precedence Constraints. We consider a variant of the NP hard problem of assigning jobs to machines to minimize the completion time of the last job. Usually, precedence constraints are given by a partial order on the set of jobs, and each job requires all its predecessors to be completed before it can start. In his seminal paper, Graham (1966) presented a simple 2 approximation algorithm, and, more than 40 years later, Svensson (2010) proved that 2 is essentially the best approximation ratio one can hope for in general. In this paper, we consider a different type of precedence relation that has not been discussed as extensively and is called OR precedence. In order for a job to start, we require that at least one of its predecessors is completed in contrast to all its predecessors. Additionally, we assume that each job has a release date before which it must not start. We prove that Graham's algorithm has an approximation guarantee of 2 also in this setting, and present a polynomial time algorithm that solves the problem to optimality, if preemptions are allowed. The latter result is in contrast to classical precedence constraints, for which Ullman (1975) showed that the preemptive variant is already NP hard. Our algorithm generalizes a result of Johannes (2005) who gave a polynomial time algorithm for unit processing time jobs subject to OR precedence constraints, but without release dates. The performance guarantees presented here match the best known ones for special cases where classical precedence constraints and OR precedence constraints coincide.


Uniform Steiner bundles. In this work we study k type uniform Steiner bundles, being k the lowest degree of the splitting. We prove sharp upper and lower bounds for the rank in the case k 1 and moreover we give families of examples for every allowed possible rank and explain which relation exists between the families. After dealing with the case k in general, we conjecture that every k type uniform Steiner bundle is obtained through the proposed construction technique.


Machine Learning and Big Scientific Data. This paper reviews some of the challenges posed by the huge growth of experimental data generated by the new generation of large scale experiments at UK national facilities at the Rutherford Appleton Laboratory site at Harwell near Oxford. Such "Big Scientific Data" comes from the Diamond Light Source and Electron Microscopy Facilities, the ISIS Neutron and Muon Facility, and the UK's Central Laser Facility. Increasingly, scientists are now needing to use advanced machine learning and other AI technologies both to automate parts of the data pipeline and also to help find new scientific discoveries in the analysis of their data. For commercially important applications, such as object recognition, natural language processing and automatic translation, deep learning has made dramatic breakthroughs. Google's DeepMind has now also used deep learning technology to develop their AlphaFold tool to make predictions for protein folding. Remarkably, they have been able to achieve some spectacular results for this specific scientific problem. Can deep learning be similarly transformative for other scientific problems? After a brief review of some initial applications of machine learning at the Rutherford Appleton Laboratory, we focus on challenges and opportunities for AI in advancing materials science. Finally, we discuss the importance of developing some realistic machine learning benchmarks using Big Scientific Data coming from a number of different scientific domains. We conclude with some initial examples of our "SciML" benchmark suite and of the research challenges these benchmarks will enable.


The Santal 'o point for the Holmes Thompson boundary area. We explore the notion of Santal 'o point for the Holmes Thompson boundary area of a convex body in a normed space. In the case where the norm is C 1 , and in the case where unit ball and convex body coincide, we prove existence and uniqueness. When the normed space has a smooth positively curved unit ball, we exhibit a dual Santal 'o point expressed as an average of centroids of projections of the dual body.


Uniqueness in the Calder 'on problem and bilinear restriction estimates. Uniqueness in the Calder 'on problem in dimension bigger than two was usually studied under the assumption that conductivity has bounded gradient. For conductivities with unbounded gradients uniqueness results have not been known until recent years. The latest result due to Haberman basically relies on the optimal L 2 restriction estimate for hypersurface which is known as the Tomas Stein restriction theorem. In the course of developments of the Fourier restriction problem bilinear and multilinear generalizations of the (adjoint) restriction estimates under suitable transversality condition between surfaces have played important roles. Since such advanced machineries usually provide strengthened estimates, it seems natural to attempt to utilize these estimates to improve the known results. In this paper, we make use of the sharp bilinear restriction estimates, which is due to Tao, and relax the regularity assumption on conductivity. We also consider the inverse problem for the Schr "odinger operator with potentials contained in the Sobolev spaces of negative orders.


Colored version for Lawrence representations. We give an explicit isomorphism between the Gassner representation and the first weight level of a representation of quantum sl(2). Then we construct and provide matrices for colored versions of the BKL representation and higher Lawrence's representations.


A Brief Survey of Multilingual Neural Machine Translation. We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of knowledge transfer. MNMT is more promising and interesting than its statistical machine translation counterpart because end to end modeling and distributed representations open new avenues. Many approaches have been proposed in order to exploit multilingual parallel corpora for improving translation quality. However, the lack of a comprehensive survey makes it difficult to determine which approaches are promising and hence deserve further exploration. In this paper, we present an in depth survey of existing literature on MNMT. We categorize various approaches based on the resource scenarios as well as underlying modeling principles. We hope this paper will serve as a starting point for researchers and engineers interested in MNMT.


Optimal bases for direct images of p adic differential modules over discs. Let (k, cdot ) be a complete and algebraically closed valued field extension of ( mathbb Q p, cdot p) . Given a finite morphism varphi mathscr D 1 to mathscr D 2 of unit discs over k , a differential module (M,D) on mathscr D 1 and a point b in mathscr D 2(k) , we construct explicitly an optimal basis of space of horizontal elements for the direct image varphi (M,D) at b in terms of the suitable chosen optimal bases of (M,D) at preimages of b by varphi and ramification properties of the morphism.


QPDAS Dual Active Set Solver for Mixed Constraint Quadratic Programming. We present a method for solving the general mixed constrained convex quadratic programming problem using an active set method on the dual problem. The approach is similar to existing active set methods, but we present a new way of solving the linear systems arising in the algorithm. There are two main contributions we present a new way of factorizing the linear systems, and show how iterative refinement can be used to achieve good accuracy and to solve both types of sub problems that arise from semi definite problems.


Adaptive stabilized finite elements Continuation analysis of compaction banding in geomaterials. Under compressive creep, visco plastic solids experiencing internal mass transfer processes have been recently proposed to accommodate singular cnoidal wave solutions, as material instabilities at the stationary wave limit. These instabilities appear when the loading rate is significantly faster than the capability of the material to diffuse internal perturbations and lead to localized failure features (e.g., cracks and compaction bands). This type of solution, generally found in fluids, has strong nonlinearities and periodic patterns. Due to the singular nature of the solutions, the applicability of the theory is currently limited. Additionally, effective numerical tools require proper regularization to overcome the challenges that singularity induces. We focus on the numerical treatment of the governing equation using a nonlinear approach building on a recent adaptive stabilized finite element method. This method provides a residual representation to drive adaptive mesh refinement, a particularly useful feature for the problem at hand. We compare against analytical and standard finite element solutions to demonstrate the performance of our approach. We then investigate the sensitivity of the diffusivity ratio, main parameter of the problem, and identify multiple possible solutions, with multiple stress peaks. Finally, we show the evolution of the spacing between peaks for all solutions as a function of that parameter.


The homotopy theory of complete modules. Given a commutative ring R and finitely generated ideal I , one can consider the classes of I adically complete, L 0 I complete and derived I complete complexes. Under a mild assumption on the ideal I called weak pro regularity, these three notions of completions interact well. We consider the classes of I adically complete, L 0 I complete and derived I complete complexes and prove that they present the same homotopy theory. Given a ring homomorphism R to S , we then give necessary and sufficient conditions for the categories of complete R complexes and the categories of complete S complexes to have equivalent homotopy theories. This recovers and generalizes a result of Sather Wagstaff and Wicklein on extended local (co)homology.


Extension and trace theorems for noncompact doubling spaces. We generalize the extension and trace results of Bj "orn Bj "orn Shanmugalingam cite BBS21 to the setting of complete noncompact doubling metric measure spaces and their uniformized hyperbolic fillings. This is done through a uniformization procedure introduced by the author that uniformizes a Gromov hyperbolic space using a Busemann function instead of the distance functions considered in the work of Bonk Heinonen Koskela cite BHK . We deduce several corollaries for the Besov spaces that arise as trace spaces in this fashion, including the existence of representatives that are quasicontinuous with respect to the Besov capacity, the existence of L p Lebesgue points quasieverywhere with respect to the Besov capacity, embeddings into H "older spaces for appropriate exponents, and a stronger Lebesgue point result under an additional reverse doubling hypothesis on the measure. We also obtain several Poincar 'e type inequalities relating integrals of Besov functions over balls to integrals of upper gradients of extension of these functions to a uniformized hyperbolic filling of the space.


Effective Wadge Hierarchy in Computable Quasi Polish Spaces. We define and study an effective version of the Wadge hierarchy in computable quasi Polish spaces which include most spaces of interest for computable analysis. Along with hierarchies of sets we study hierarchies of k partitions which are interesting on their own. We show that levels of such hierarchies are preserved by the computable effectively open surjections, that if the effective Hausdorff Kuratowski theorem holds in the Baire space then it holds in every computable quasi Polish space, and we extend the effective Hausdorff theorem to k partitions.


Semidefinite programming bounds for the average kissing number. The average kissing number of mathbb R n is the supremum of the average degrees of contact graphs of packings of finitely many balls (of any radii) in mathbb R n . We provide an upper bound for the average kissing number based on semidefinite programming that improves previous bounds in dimensions 3, ldots, 9 . A very simple upper bound for the average kissing number is twice the kissing number in dimensions 6, ldots, 9 our new bound is the first to improve on this simple upper bound.


From Harnack inequality to heat kernel estimates on metric measure spaces and applications. Aim of this short note is to show that a dimension free Harnack inequality on an infinitesimally Hilbertian metric measure space where the heat semigroup admits an integral representation in terms of a kernel is suffcient to deduce a sharp upper Gaussian estimate for such kernel. As intermediate step, we prove the local logarithmic Sobolev inequality (known to be equivalent to a lower bound on the Ricci curvature tensor in smooth Riemannian manifolds). Both results are new also in the more regular framework of RCD(K, infty) spaces.


Some observations on the smallest adjacency eigenvalue of a graph. In this paper, we discuss various connections between the smallest eigenvalue of the adjacency matrix of a graph and its structure. There are several techniques for obtaining upper bounds on the smallest eigenvalue, and some of them are based on Rayleigh quotients, Cauchy interlacing using induced subgraphs, and Haemers interlacing with vertex partitions and quotient matrices. In this paper, we are interested in obtaining lower bounds for the smallest eigenvalue. Motivated by results on line graphs and generalized line graphs, we show how graph decompositions can be used to obtain such lower bounds.


Particle dynamics in deposition of porous films with a pulsed radio frequency atmospheric pressure glow discharge. Nanoparticles grown in a plasma are used to visualize the process of film deposition in a pulsed radio frequency (rf) atmospheric pressure glow discharge. Modulating the plasma makes it possible to successfully prepare porous TiO2 films. We study the trapping of the particles in the sheath during the plasma on phase and compare it with numerical simulations. During the plasma off phase, the particles are driven to the substrate by the electric field generated by residual ions, leading to the formation of porous TiO2 film. Using video microscopy, the collective dynamics of particles in the whole process is revealed at the most fundamental "kinetic" level.


Politeness for the Theory of Algebraic Datatypes. Algebraic datatypes, and among them lists and trees, have attracted a lot of interest in automated reasoning and Satisfiability Modulo Theories (SMT). Since its latest stable version, the SMT LIB standard defines a theory of algebraic datatypes, which is currently supported by several mainstream SMT solvers. In this paper, we study this particular theory of datatypes and prove that it is strongly polite, showing also how it can be combined with other arbitrary disjoint theories using polite combination. Our results cover both inductive and finite datatypes, as well as their union. The combination method uses a new, simple, and natural notion of additivity, that enables deducing strong politeness from (weak) politeness.


Modeling Hierarchical Usage Context for Software Exceptions based on Interaction Data. Traces of user interactions with a software system, captured in production, are commonly used as an input source for user experience testing. In this paper, we present an alternative use, introducing a novel approach of modeling user interaction traces enriched with another type of data gathered in production software fault reports consisting of software exceptions and stack traces. The model described in this paper aims to improve developers' comprehension of the circumstances surrounding a specific software exception and can highlight specific user behaviors that lead to a high frequency of software faults. Modeling the combination of interaction traces and software crash reports to form an interpretable and useful model is challenging due to the complexity and variance in the combined data source. Therefore, we propose a probabilistic unsupervised learning approach, adapting the Nested Hierarchical Dirichlet Process, which is a Bayesian non parametric topic model commonly applied to natural language data. This model infers a tree of topics, each of whom describes a set of commonly co occurring commands and exceptions. The topic tree can be interpreted hierarchically to aid in categorizing the numerous types of exceptions and interactions. We apply the proposed approach to large scale datasets collected from the ABB RobotStudio software application, and evaluate it both numerically and with a small survey of the RobotStudio developers.