Error bounds revisited. We propose a unifying general framework of quantitative primal and dual sufficient and necessary error bound conditions covering linear and nonlinear, local and global settings. The function is not assumed to possess any particular structure apart from the standard assumptions of lower semicontinuity in the case of sufficient conditions and (in some cases) convexity in the case of necessary conditions. We expose the roles of the assumptions involved in the error bound assertions, in particular, on the underlying space general metric, normed, Banach or Asplund. Employing special collections of slope operators, we introduce a succinct form of sufficient error bound conditions, which allows one to combine in a single statement several different assertions nonlocal and local primal space conditions in complete metric spaces, and subdifferential conditions in Banach and Asplund spaces.


Initial, inner and inner boundary problems for a fractional differential equation. While it is known that one can consider the Cauchy problem for evolution equations with Caputo derivatives, the situation for the initial value problems for the Riemann Liouville derivatives is less understood. In this paper we propose new type initial, inner and inner boundary value problems for fractional differential equations with the Riemann Liouville derivatives. The results on the existence and uniqueness are proved, and conditions on the solvability are found. The well posedness of the new type initial, inner and inner boundary conditions are also discussed. Moreover, we give explicit formulas for the solutions. As an application fractional partial differential equations for general positive operators are studied.


Vanishing Flats A Combinatorial Viewpoint on the Planarity of Functions and Their Application. For a function f from mathbb F 2 n to mathbb F 2 n , the planarity of f is usually measured by its differential uniformity and differential spectrum. In this paper, we propose the concept of vanishing flats, which supplies a combinatorial viewpoint on the planarity. First, the number of vanishing flats of f can be regarded as a measure of the distance between f and the set of almost perfect nonlinear functions. In some cases, the number of vanishing flats serves as an "intermediate" concept between differential uniformity and differential spectrum, which contains more information than differential uniformity, however less than the differential spectrum. Secondly, the set of vanishing flats forms a combinatorial configuration called partial quadruple system, since it convey detailed structural information about f . We initiate this study by considering the number of vanishing flats and the partial quadruple systems associated with monomials and Dembowski Ostrom polynomials. In addition, we present an application of vanishing flats to the partition of a vector space into disjoint equidimensional affine spaces. We conclude the paper with several further questions and challenges.


Multi dimensional Arrays with Levels. We explore a data structure that generalises rectangular multi dimensional arrays. The shape of an n dimensional array is typically given by a tuple of n natural numbers. Each element in that tuple defines the length of the corresponding axis. If we treat this tuple as an array, the shape of that array is described by the single natural number n. A natural number itself can be also treated as an array with the shape described by the natural number 1 (or the element of any singleton set). This observation gives rise to the hierarchy of array types where the shape of an array of level l 1 is a level l array of natural numbers. Such a hierarchy occurs naturally when treating arrays as containers, which makes it possible to define both rank and level polymorphic operations. The former can be found in most array languages, whereas the latter gives rise to partial selections on a large set of hyperplanes, which is often useful in practice. In this paper we present an Agda formalisation of arrays with levels. We show that the proposed formalism supports standard rank polymorphic array operations, while type system gives static guarantees that indexing is within bounds. We generalise the notion of ranked operator so that it becomes applicable on arrays of arbitrary levels and we show why this may be useful in practice.


Pretty Modular Symmetric Encryption (PMSE), compact algorithm for ''embedded cryptography'' with quite low computational cost. Nowadays, the dataflux shared between IOT systems must be secured from 8 bits to 64 bits processors systems. Several symmetric cryptographic algorithm already exist such as AES (Advanced Encryption Standard), RC4, Blowfish, etc. In this work, we propose an 8 bits encryption algorithm, combining several ideas of standard symmetric encryption algorithms. The aim is to provide a efficient, modular and compact algorithm able to tend to truly random one time pad encryption quality even for large data flux. The algorithm combines the implementation of a divergent polynomial with variable coefficients for pseudo random keys generation, variable bit swapping and bitwise operations on data, and the use of one or two passwords. The encryption has been evaluated statistically, tested for image encryption and compared with One Time Pad encryption on the same data. Three implementations have been tested respectively in C, Javascript and GNU Octave. Encryption time performances are compared with AES on a 8 bits architecture the Arduino Uno (ATmega328) microcontroller. A new concept of self decryptionable web encrypted object, called Blocksnet is also presented and tested as a potential application of the compact and embedded PMSE algorithm.


Extracting Procedural Knowledge from Technical Documents. Procedures are an important knowledge component of documents that can be leveraged by cognitive assistants for automation, question answering or driving a conversation. It is a challenging problem to parse big dense documents like product manuals, user guides to automatically understand which parts are talking about procedures and subsequently extract them. Most of the existing research has focused on extracting flows in given procedures or understanding the procedures in order to answer conceptual questions. Identifying and extracting multiple procedures automatically from documents of diverse formats remains a relatively less addressed problem. In this work, we cover some of this ground by 1) Providing insights on how structural and linguistic properties of documents can be grouped to define types of procedures, 2) Analyzing documents to extract the relevant linguistic and structural properties, and 3) Formulating procedure identification as a classification problem that leverages the features of the document derived from the above analysis. We first implemented and deployed unsupervised techniques which were used in different use cases. Based on the evaluation in different use cases, we figured out the weaknesses of the unsupervised approach. We then designed an improved version which was supervised. We demonstrate that our technique is effective in identifying procedures from big and complex documents alike by achieving accuracy of 89 .


The action of a mirabolic subgroup on a symmetric variety. Let F be a local field of character zero. Let E be a quadratic field extension of F. We show that any P invariant linear functional on a GL(n,E) distinguished irreducible smooth admissible representation of GL(2n,F) is also GL(n,E) invariant where P is a mirabolic subgroup of GL(n,E).


Embedding spanning subgraphs in uniformly dense and inseparable graphs. We consider sufficient conditions for the existence of k th powers of Hamiltonian cycles in n vertex graphs G with minimum degree mu n for arbitrarily small mu 0 . About 20 years ago Koml 'os, Sark "ozy, and Szemer 'edi resolved the conjectures of P 'osa and Seymour and obtained optimal minimum degree conditions for this problem by showing that mu frac k k 1 suffices for large n . For smaller values of mu the given graph G must satisfy additional assumptions. We show that inducing subgraphs of density d 0 on linear subsets of vertices and being inseparable, in the sense that every cut has density at least mu 0 , are sufficient assumptions for this problem and, in fact, for a variant of the bandwidth theorem. This generalises recent results of Staden and Treglown.


Random walk Based Generative Model for Classifying Document Networks. Document networks are found in various collections of real world data, such as citation networks, hyperlinked web pages, and online social networks. A large number of generative models have been proposed because they offer intuitive and useful pictures for analyzing document networks. Prominent examples are relational topic models, where documents are linked according to their topic similarities. However, existing generative models do not make full use of network structures because they are largely dependent on topic modeling of documents. In particular, centrality of graph nodes is missing in generative processes of previous models. In this paper, we propose a novel generative model for document networks by introducing random walkers on networks to integrate the node centrality into link generation processes. The developed method is evaluated in semi supervised classification tasks with real world citation networks. We show that the proposed model outperforms existing probabilistic approaches especially in detecting communities in connected networks.


Stability Analysis of Short Memory Fractional Differential Equations. In this paper, a fractional derivative with short term memory properties is defined, which can be viewed as an extension of Caputo fractional derivative. Then, some properties of the short memory fractional derivative are discussed. Also, a comparison theorem for a class of short memory fractional systems is shown, via which some relationship between short memory fractional systems and Caputo fractional systems can be established. By applying the comparison theorem and Lyapunov direct method, some sufficient criteria are obtained, which can ensure the asymptotic stability of some short memory fractional equations. Moreover, a special result is presented, by which the stability of some special systems can be judged directly. Finally, three examples are provided to demonstrate the effectiveness of the main results.


Deep ReLU neural networks in high dimensional approximation. We study the computation complexity of deep ReLU (Rectified Linear Unit) neural networks for the approximation of functions from the H "older Zygmund space of mixed smoothness defined on the d dimensional unit cube when the dimension d may be very large. The approximation error is measured in the norm of isotropic Sobolev space. For every function f from the H "older Zygmund space of mixed smoothness, we explicitly construct a deep ReLU neural network having an output that approximates f with a prescribed accuracy varepsilon , and prove tight dimension dependent upper and lower bounds of the computation complexity of this approximation, characterized as the size and the depth of this deep ReLU neural network, explicitly in d and varepsilon . The proof of these results are in particular, relied on the approximation by sparse grid sampling recovery based on the Faber series.


Helium like ions in magnetic field application of the nonperturbative relativistic method for axially symmetric systems. Dirac equation for an electron bound by a nucleus in the presence of external axially symmetric field can be solved numerically by using the dual kinetic balance conditions imposed on the finite basis set (A DKB method Rozenbaum et al, Phys. Rev. A 89, 012514 (2014) ). We present the application of this method to describe helium like ions exposed to homogeneous external magnetic field. The second order Zeeman shift and the nuclear magnetic shielding constant are evaluated for the ground state, including the leading contribution of the interelectronic interaction. The A DKB values are compared with the direct calculations by perturbation theory. The results for the nuclear magnetic shielding can serve for accurate determination of the nuclear magnetic moments. The quadratic contribution to the Zeeman effect can be relevant for high precision measurements of the transition energies in helium like ions.


Reducing Gender Bias in Word Level Language Models with a Gender Equalizing Loss Function. Gender bias exists in natural language datasets which neural language models tend to learn, resulting in biased text generation. In this research, we propose a debiasing approach based on the loss function modification. We introduce a new term to the loss function which attempts to equalize the probabilities of male and female words in the output. Using an array of bias evaluation metrics, we provide empirical evidence that our approach successfully mitigates gender bias in language models without increasing perplexity. In comparison to existing debiasing strategies, data augmentation, and word embedding debiasing, our method performs better in several aspects, especially in reducing gender bias in occupation words. Finally, we introduce a combination of data augmentation and our approach, and show that it outperforms existing strategies in all bias evaluation metrics.


Signature Based Abduction for Expressive Description Logics Technical Report. Signature based abduction aims at building hypotheses over a specified set of names, the signature, that explain an observation relative to some background knowledge. This type of abduction is useful for tasks such as diagnosis, where the vocabulary used for observed symptoms differs from the vocabulary expected to explain those symptoms. We present the first complete method solving signature based abduction for observations expressed in the expressive description logic ALC, which can include TBox and ABox axioms, thereby solving the knowledge base abduction problem. The method is guaranteed to compute a finite and complete set of hypotheses, and is evaluated on a set of realistic knowledge bases.


Asynchronous discrete dynamical systems. We study two coupled discrete time equations with different (asynchronous) periodic time scales. The coupling is of the type sample and hold, i.e., the state of each equation is sampled at its update times and held until it is read as an input at the next update time for the other equation. We construct an interpolating two dimensional complex valued system on the union of the two time scales and an extrapolating four dimensional system on the intersection of the two time scales. We discuss stability by several results, examples and counterexamples in various frameworks to show that the asynchronicity can have a significant impact on the dynamical properties.


The Brauer group of Burnside rings. The Brauer group of a commutative ring is an important invariant of a commutative ring, a common journeyman to the group of units and the Picard group. Burnside rings of finite groups play an important role in representation theory, and their groups of units and Picard groups have been studied extensively. In this short note, we completely determine the Brauer groups of Burnside rings they vanish.


Backward Stochastic Differential Equations Driven by G Brownian Motion with Double Reflections. In this paper, we study the reflected backward stochastic differential equations driven by G Brownian motion with two reflecting obstacles, which means that the solution lies between two prescribed processes. A new kind of approximate Skorohod condition is proposed to derive the uniqueness and existence of the solutions. The uniqueness can be proved by a priori estimates and the existence is obtained via a penalization method.


On Whitney embedding of o minimal manifolds. We prove a definable version of the Whitney embedding theorem for abstract definable mathcal C p manifolds with 1 leq p infty , namely every abstract definable mathcal C p manifold is abstract definable C p embedded into R N , for some positive integer N . As a consequence, we show that every abstract definable mathcal C p manifold has a compatible mathcal C p 1 atlas.


Remarks on the notion of homo derivations. The purpose of this paper is to study the (different) notions of homo derivations. These are additive mappings f of a ring R that also fulfill the identity f(xy) f(x)y xf(y) f(x)f(y) qquad left(x, y in R right), or (in case of the other notion) the system of equations f(xy) f(x)f(y) f(xy) f(x)y xf(y) qquad left(x, y in R right). Our primary aim is to investigate the above equations without additivity as well as the following Pexiderized equation f(xy) h(x)h(y) xk(y) k(x)y. The obtained results show that under rather mild assumptions homo derivations can be fully characterized, even without the additivity assumption.


Knowledge Map Toward a New Approach Supporting the Knowledge Management in Distributed Data Mining. Distributed data mining (DDM) deals with the problem of finding patterns or models, called knowledge, in an environment with distributed data and computations. Today, a massive amounts of data which are often geographically distributed and owned by different organisation are being mined. As consequence, a large mount of knowledge are being produced. This causes problems of not only knowledge management but also visualization in data mining. Besides, the main aim of DDM is to exploit fully the benefit of distributed data analysis while minimising the communication. Existing DDM techniques perform partial analysis of local data at individual sites and then generate a global model by aggregating these local results. These two steps are not independent since naive approaches to local analysis may produce an incorrect and ambiguous global data model. The integrating and cooperating of these two steps need an effective knowledge management, concretely an efficient map of knowledge in order to take the advantage of mined knowledge to guide mining the data. In this paper, we present "knowledge map", a representation of knowledge about mined knowledge. This new approach aims to manage efficiently mined knowledge in large scale distributed platform such as Grid. This knowledge map is used to facilitate not only the visualization, evaluation of mining results but also the coordinating of local mining process and existing knowledge to increase the accuracy of final model.


Unsupervised segmentation via semantic apparent feature fusion. Foreground segmentation is an essential task in the field of image understanding. Under unsupervised conditions, different images and instances always have variable expressions, which make it difficult to achieve stable segmentation performance based on fixed rules or single type of feature. In order to solve this problem, the research proposes an unsupervised foreground segmentation method based on semantic apparent feature fusion (SAFF). Here, we found that key regions of foreground object can be accurately responded via semantic features, while apparent features (represented by saliency and edge) provide richer detailed expression. To combine the advantages of the two type of features, an encoding method for unary region features and binary context features is established, which realizes a comprehensive description of the two types of expressions. Then, a method for adaptive parameter learning is put forward to calculate the most suitable feature weights and generate foreground confidence score map. Furthermore, segmentation network is used to learn foreground common features from different instances. By fusing semantic and apparent features, as well as cascading the modules of intra image adaptive feature weight learning and inter image common feature learning, the research achieves performance that significantly exceeds baselines on the PASCAL VOC 2012 dataset.


The C complex clasp number of links. In the 1980's Daryl Cooper introduced the notion of a C complex (or clasp complex) bounded by a link and explained how to compute signatures and polynomial invariants using a C complex. Since then this was extended by works of Cimasoni, Florens, Mellor, Melvin, Conway, Toffoli, Friedl, and others to compute other link invariants. Informally a C complex is a union of surfaces which are allowed to intersect each other in clasps. The purpose of the current paper is to study the minimal number of clasps amongst all C complexes bounded by a fixed link L . This measure of complexity is related to the number of crossing changes needed to reduce L to a boundary link. We prove that if L is a 2 component link with nonzero linking number, then the linking number determines the minimal number of clasps amongst all C complexes. In the case of 3 component links, the triple linking number provides an additional lower bound on the number of clasps in a C complex.


Dynamic Asynchronous Iterations. Many problems can be solved by iteration by multiple participants (processors, servers, routers etc.). Previous mathematical models for such asynchronous iterations assume a single function being iterated by a fixed set of participants. We will call such iterations static since the system's configuration does not change. However in several real world examples, such as inter domain routing, both the function being iterated and the set of participants change frequently while the system continues to function. In this paper we extend Uresin Dubois's work on static iterations to develop a model for this class of "dynamic" or "always on" asynchronous iterations. We explore what it means for such an iteration to be implemented correctly, and then prove two different conditions on the set of iterated functions that guarantee the full asynchronous iteration satisfies this new definition of correctness. These results have been formalised in Agda and the resulting library is publicly available.


D NetPAD An Explainable and Interpretable Iris Presentation Attack Detector. An iris recognition system is vulnerable to presentation attacks, or PAs, where an adversary presents artifacts such as printed eyes, plastic eyes, or cosmetic contact lenses to circumvent the system. In this work, we propose an effective and robust iris PA detector called D NetPAD based on the DenseNet convolutional neural network architecture. It demonstrates generalizability across PA artifacts, sensors and datasets. Experiments conducted on a proprietary dataset and a publicly available dataset (LivDet 2017) substantiate the effectiveness of the proposed method for iris PA detection. The proposed method results in a true detection rate of 98.58 at a false detection rate of 0.2 on the proprietary dataset and outperfoms state of the art methods on the LivDet 2017 dataset. We visualize intermediate feature distributions and fixation heatmaps using t SNE plots and Grad CAM, respectively, in order to explain the performance of D NetPAD. Further, we conduct a frequency analysis to explain the nature of features being extracted by the network. The source code and trained model are available at https github.com iPRoBe lab D NetPAD.


SiamParseNet Joint Body Parsing and Label Propagation in Infant Movement Videos. General movement assessment (GMA) of infant movement videos (IMVs) is an effective method for the early detection of cerebral palsy (CP) in infants. Automated body parsing is a crucial step towards computer aided GMA, in which infant body parts are segmented and tracked over time for movement analysis. However, acquiring fully annotated data for video based body parsing is particularly expensive due to the large number of frames in IMVs. In this paper, we propose a semi supervised body parsing model, termed SiamParseNet (SPN), to jointly learn single frame body parsing and label propagation between frames in a semi supervised fashion. The Siamese structured SPN consists of a shared feature encoder, followed by two separate branches one for intra frame body parts segmentation, and one for inter frame label propagation. The two branches are trained jointly, taking pairs of frames from the same videos as their input. An adaptive training process is proposed that alternates training modes between using input pairs of only labeled frames and using inputs of both labeled and unlabeled frames. During testing, we employ a multi source inference mechanism, where the final result for a test frame is either obtained via the segmentation branch or via propagation from a nearby key frame. We conduct extensive experiments on a partially labeled IMV dataset where SPN outperforms all prior arts, demonstrating the effectiveness of our proposed method.


Intelligent Ranking for Dynamic Restoration in Next Generation Wireless Networks. Emerging 5G and next generation 6G wireless are likely to involve myriads of connectivity, consisting of a huge number of relatively smaller cells providing ultra dense coverage. Guaranteeing seamless connectivity and service level agreements in such a dense wireless system demands efficient network management and fast service recovery. However, restoration of a wireless network, in terms of maximizing service recovery, typically requires evaluating the service impact of every network element. Unfortunately, unavailability of real time KPI information, during an outage, enforces most of the existing approaches to rely significantly on context based manual evaluation. As a consequence, configuring a real time recovery of the network nodes is almost impossible, thereby resulting in a prolonged outage duration. In this article, we explore deep learning to introduce an intelligent, proactive network recovery management scheme in anticipation of an eminent network outage. Our proposed method introduces a novel utilization based ranking scheme of different wireless nodes to minimize the service downtime and enable a fast recovery. Efficient prediction of network KPI (Key Performance Index), based on actual wireless data demonstrates up to 54 improvement in service outage.


Asymmetric Metal dielectric Meta cylinders and their Potential Applications from Engineering Scattering Patterns to Spatial Optical Signal Processing. We propose a novel type of bi anisotropic hybrid metal dielectric structure comprising dielectric and metallic cylindrical wedges wherein the composite meta cylinder enables advanced control of electric, magnetic and magnetoelectric resonances. We establish a theoretical framework in which the electromagnetic response of this meta atom is described through the electric and magneticmultipole moments. The complete dynamic polarizability tensor, expressed in a compact form, is derived as a function of the Mie scattering coefficients. Flexibility in the design makes the proposed meta cylinder a viable candidate for various applications in the microscopic (single meta atom) and macroscopic (metasurface) levels. We show that the highly versatile bi anisotropic meta atom is amenable to being designed for the desired electromagnetic response, such as electric dipole free and zero near zero (backward and forward) scattering at the microscopic level. In addition, we show that the azimuthal asymmetry gives rise to normal polarizability components which are vital elements in synthesizing asymmetric Optical Transfer Function (OTF) at the macroscopic level.We conduct a precise inspection, from the microscopic to the macroscopic level, of the metasurface synthesis for emphasizing on the role of normal polarizability components for spatial optical signal processing. It is shown that this simple two dimensional asymmetric meta atom can perform first order differentiation and edge detection at normal illumination.The results reported herein contribute toward improving the physical understanding of wave interaction with artificial materials composed of asymmetric elongated metal dielectric inclusions and open the potential of its application in spatial signal and image processing.


Enumeration of a special class of irreducible polynomials in characteristic 2. A polynomials were introduced by Meyn and play an important role in the iterative construction of high degree self reciprocal irreducible polynomials over the field F 2, since they constitute the starting point of the iteration. The exact number of A polynomials of each degree was given by Niederreiter. Kyuregyan extended the construction of Meyn to arbitrary even finite fields. We relate the A polynomials in this more general setting to inert places in a certain extension of elliptic function fields and obtain an explicit counting formula for their number. In particular, we are able to show that, except for an isolated exception, there exist A polynomials of every degree.


Frobenius bimodules and flat dominant dimensions. We establish relations between Frobenius parts and between flat dominant dimensions of algebras linked by Frobenius bimodules. This is motivated by the Nakayama conjecture and an approach of Martinez Villa to the Auslander Reiten conjecture on stable equivalences. We show that the Frobenius parts of Frobenius extensions are again Frobenius extensions. Further, let A and B be finite dimensional algebras over a field k , and let dm( AX) stand for the dominant dimension of an A module X . If BM A is a Frobenius bimodule, then dm(A) le dm( BM) and dm(B) le dm( A Hom B(M, B)) . In particular, if B subseteq A is a left split (or right split) Frobenius extension, then dm(A) dm(B) . These results are applied to calculate flat dominant dimensions of a number of algebras shew group algebras, stably equivalent algebras, trivial extensions and Markov extensions. Finally, we prove that the universal (quantised) enveloping algebras of semisimple Lie algebras are QF 3 rings in the sense of Morita.


Degenerate hypergeometric functions and degenerate hypergeometric numbers of order p. In this paper, we introduce degenertae generalized hypergeometric functions and study degenerate hypergeometric numbers of order p. These numbers involving of lambda binomial coefficients and lambda falling sequence, and can be represented by means of the degenerate generalized hypergeometric functions. we will derive some explicit expressions and combinatorial identities for those numbers. We also consider several related special numbers like lambda hypergeometric numbers of order p and Apostol type lambda hypergeometric numbers of order p, of which the latter reduce in a limiting case to the generalized p th order Franel numbers.


Polar tangential angles and free elasticae. In this note we investigate the behavior of the polar tangential angle of a general plane curve, and in particular prove its monotonicity for certain curves of monotone curvature. As an application we give (non)existence results for an obstacle problem involving free elasticae.


Detectability of labeled weighted automata over monoids. In this paper, we for the first time obtain characterization of four fundamental notions of detectability for general labeled weighted automata over monoids (denoted by mathcal A mathfrak M for short), where the four notions are strong (periodic) detectability (SD and SPD) and weak (periodic) detectability (WD and WPD). Firstly, we formulate the notions of concurrent composition, observer, and detector for mathcal A mathfrak M . Secondly, we use the concurrent composition to give an equivalent condition for SD, use the detector to give an equivalent condition for SPD, and use the observer to give equivalent conditions for WD and WPD, all for general mathcal A mathfrak M without any assumption. Thirdly, we prove that for a labeled weighted automaton over monoid ( mathbb Q k, ) (denoted by mathcal A mathbb Q k ), its concurrent composition, observer, and detector can be computed in NP, 2 EXPTIME, and 2 EXPTIME, respectively, by developing novel connections between mathcal A mathbb Q k and the NP complete exact path length problem (proved by Nyk " a nen and Ukkonen, 2002 ) and a subclass of Presburger arithmetic. As a result, we prove that for mathcal A mathbb Q k , SD can be verified in coNP, while SPD, WD, and WPD can be verified in 2 EXPTIME. Finally, we prove that the problems of verifying SD and SPD of deterministic, deadlock free, and divergence free mathcal A mathbb N over monoid ( mathbb N , ) are both coNP hard. The developed original methods will provide foundations for characterizing other fundamental properties (e.g., diagnosability, opacity) for mathcal A mathfrak M . We also initially explore detectability in labeled timed automata, and prove that the SD verification problem is PSPACE complete, while WD and WPD are undecidable.


On False Accuracy Verification of UMUSCL Scheme. In this paper, we reveal a mechanism behind a false accuracy verification encountered with unstructured grid schemes based on solution reconstruction such as UMUSCL. Third (or higher ) order of accuracy has been reported for the Euler equations in the literature, but UMUSCL is actually second order accurate at best for nonlinear equations. False high order convergence occurs generally for a scheme that is high order for linear equations but second order for nonlinear equations. It is caused by unexpected linearization of a target nonlinear equation due to too small of a perturbation added to an exact solution used for accuracy verification. To clarify the mechanism, we begin with a proof that the UMUSCL scheme is third order accurate only for linear equations. Then, we derive a condition under which the third order truncation error dominates the second order error and demonstrate it numerically for Burgers' equation. Similar results are shown for the Euler equations, which disprove some accuracy verification results in the literature. To be genuinely third order, UMUSCL must be implemented with flux reconstruction.


Learning Goal oriented Dialogue Policy with Opposite Agent Awareness. Most existing approaches for goal oriented dialogue policy learning used reinforcement learning, which focuses on the target agent policy and simply treat the opposite agent policy as part of the environment. While in real world scenarios, the behavior of an opposite agent often exhibits certain patterns or underlies hidden policies, which can be inferred and utilized by the target agent to facilitate its own decision making. This strategy is common in human mental simulation by first imaging a specific action and the probable results before really acting it. We therefore propose an opposite behavior aware framework for policy learning in goal oriented dialogues. We estimate the opposite agent's policy from its behavior and use this estimation to improve the target agent by regarding it as part of the target policy. We evaluate our model on both cooperative and competitive dialogue tasks, showing superior performance over state of the art baselines.


Zero Resource Knowledge Grounded Dialogue Generation. While neural conversation models have shown great potentials towards generating informative and engaging responses via introducing external knowledge, learning such a model often requires knowledge grounded dialogues that are difficult to obtain. To overcome the data challenge and reduce the cost of building a knowledge grounded dialogue system, we explore the problem under a zero resource setting by assuming no context knowledge response triples are needed for training. To this end, we propose representing the knowledge that bridges a context and a response and the way that the knowledge is expressed as latent variables, and devise a variational approach that can effectively estimate a generation model from a dialogue corpus and a knowledge corpus that are independent with each other. Evaluation results on three benchmarks of knowledge grounded dialogue generation indicate that our model can achieve comparable performance with state of the art methods that rely on knowledge grounded dialogues for training, and exhibits a good generalization ability over different topics and different datasets.


On Exactly 3 Deficient Perfect Numbers. Let n and k be positive integers and sigma(n) the sum of all positive divisors of n . We call n an exactly k deficient perfect number with deficient divisors d 1, d 2, ldots, d k if d 1, d 2, ldots, d k are distinct proper divisors of n and sigma (n) 2n (d 1 d 2 ldots d k) . In this article, we show that the only odd exactly 3 deficient perfect number with at most two distinct prime factors is 1521 3 2 cdot 13 2 .


LCM from FCA Point of View A CbO style Algorithm with Speed up Features. LCM is an algorithm for enumeration of frequent closed itemsets in transaction databases. It is well known that when we ignore the required frequency, the closed itemsets are exactly intents of formal concepts in Formal Concept Analysis (FCA). We describe LCM in terms of FCA and show that LCM is basically the Close by One algorithm with multiple speed up features for processing sparse data. We analyze the speed up features and compare them with those of similar FCA algorithms, like FCbO and algorithms from the In Close family.


Metric theory of Weyl sums. We prove that there exist positive constants C and c such that for any integer d ge 2 the set of mathbf x in 0,1) d satisfying cN 1 2 le left sum N n 1 exp left (2 pi i left (x 1n ldots x d n d right) right) right le C N 1 2 for infinitely many natural numbers N is of full Lebesque measure. This substantially improves the previous results where similar sets have been measured in terms of the Hausdorff dimension. We also obtain similar bounds for exponential sums with monomials xn d when d neq 4 . Finally, we obtain lower bounds for the Hausdorff dimension of large values of general exponential polynomials.


A Definitional Implementation of the Lax Logical Framework LLFP in Coq, for Supporting Fast and Loose Reasoning. The Lax Logical Framework, LLFP, was introduced, by a team including the last two authors, to provide a conceptual framework for integrating different proof development tools, thus allowing for external evidence and for postponing, delegating, or factoring out side conditions. In particular, LLFP allows for reducing the number of times a proof irrelevant check is performed. In this paper we give a shallow, actually definitional, implementation of LLFP in Coq, i.e. we use Coq both as host framework and oracle for LLFP. This illuminates the principles underpinning the mechanism of Lock types and also suggests how to possibly extend Coq with the features of LLFP. The derived proof editor is then put to use for developing case studies on an emerging paradigm, both at logical and implementation level, which we call fast and loose reasoning following Danielsson et alii 6 . This paradigm trades off efficiency for correctness and amounts to postponing, or running in parallel, tedious or computationally demanding checks, until we are really sure that the intended goal can be achieved. Typical examples are branch prediction in CPUs and optimistic concurrency control.


Unveiling Relations in the Industry 4.0 Standards Landscape based on Knowledge Graph Embeddings. Industry 4.0 (I4.0) standards and standardization frameworks have been proposed with the goal of emph empowering interoperability in smart factories. These standards enable the description and interaction of the main components, systems, and processes inside of a smart factory. Due to the growing number of frameworks and standards, there is an increasing need for approaches that automatically analyze the landscape of I4.0 standards. Standardization frameworks classify standards according to their functions into layers and dimensions. However, similar standards can be classified differently across the frameworks, producing, thus, interoperability conflicts among them. Semantic based approaches that rely on ontologies and knowledge graphs, have been proposed to represent standards, known relations among them, as well as their classification according to existing frameworks. Albeit informative, the structured modeling of the I4.0 landscape only provides the foundations for detecting interoperability issues. Thus, graph based analytical methods able to exploit knowledge encoded by these approaches, are required to uncover alignments among standards. We study the relatedness among standards and frameworks based on community analysis to discover knowledge that helps to cope with interoperability conflicts between standards. We use knowledge graph embeddings to automatically create these communities exploiting the meaning of the existing relationships. In particular, we focus on the identification of similar standards, i.e., communities of standards, and analyze their properties to detect unknown relations. We empirically evaluate our approach on a knowledge graph of I4.0 standards using the Trans family of embedding models for knowledge graph entities. Our results are promising and suggest that relations among standards can be detected accurately.


A thermal bonding method for manufacturing Micromegas detectors. For manufacturing Micromegas detectors, the "bulk" method based on photoetching, was successfully developed and widely used in nuclear and particle physics experiments. However, the complexity of the method requires a considerable number of advanced instruments and processing, limiting the accessibility of this method for production of Micromegas detectors. In view of these limitations with the bulk method, a new method based on thermal bonding technique (TBM) has been developed to manufacture Micromegas detectors in a much simplified and efficient way without etching. This paper describes the TBM in detail and presents performance of the Micromegas detectors built with the TBM. The effectiveness of this method was investigated by testing Micromegas detector prototypes built with the method. Both X rays and electron beams were used to characterize the prototypes in a gas mixture of argon and CO2 (7 ). A typical energy resolution of 16 (full width at half maximum, FWHM) and an absolute gain greater than 10 4 were obtained with 5.9 keV X rays. Detection efficiency greater than 98 and a spatial resolution of 65 mu m were achieved using a 5 GeV electron beam at the DESY test beam facility. The gas gain of a Micromegas detector could reach up to 10 5 with a uniformity of better than 10 when the size of the avalanche gap was optimized thanks to the flexibility of the TBM in defining the gap. Additionally, the TBM facilitates the exploration of new detector structures based on Micromegas owing to the much simplified operation with the method.


Parallel Training of Deep Networks with Local Updates. Deep learning models trained on large data sets have been widely successful in both vision and language domains. As state of the art deep learning architectures have continued to grow in parameter count so have the compute budgets and times required to train them, increasing the need for compute efficient methods that parallelize training. Two common approaches to parallelize the training of deep networks have been data and model parallelism. While useful, data and model parallelism suffer from diminishing returns in terms of compute efficiency for large batch sizes. In this paper, we investigate how to continue scaling compute efficiently beyond the point of diminishing returns for large batches through local parallelism, a framework which parallelizes training of individual layers in deep networks by replacing global backpropagation with truncated layer wise backpropagation. Local parallelism enables fully asynchronous layer wise parallelism with a low memory footprint, and requires little communication overhead compared with model parallelism. We show results in both vision and language domains across a diverse set of architectures, and find that local parallelism is particularly effective in the high compute regime.


How big can style be? Addressing high dimensionality for recommending with style. Using embeddings as representations of products is quite commonplace in recommender systems, either by extracting the semantic embeddings of text descriptions, user sessions, collaborative relationships, or product images. In this paper, we present an approach to extract style embeddings for using in fashion recommender systems, with a special focus on style information such as textures, prints, material, etc. The main issue of using such a type of embeddings is its high dimensionality. So, we propose feature reduction solutions alongside the investigation of its influence in the overall task of recommending products of the same style based on their main image. The feature reduction we propose allows for reducing the embedding vector from 600k features to 512, leading to a memory reduction of 99.91 without critically compromising the quality of the recommendations.


Assessing congressional districting in Maine and New Hampshire. We use voting precinct and election data to analyze the political geography of New Hampshire and Maine. We find that the location of dividing line between Congressional districts in both states are significantly different than what we would expect, which we argue is likely due to incumbent gerrymandering. We also discuss the limitations of classical fairness measures for plans with only two districts.


PointNetKL Deep Inference for GICP Covariance Estimation in Bathymetric SLAM. Registration methods for point clouds have become a key component of many SLAM systems on autonomous vehicles. However, an accurate estimate of the uncertainty of such registration is a key requirement to a consistent fusion of this kind of measurements in a SLAM filter. This estimate, which is normally given as a covariance in the transformation computed between point cloud reference frames, has been modelled following different approaches, among which the most accurate is considered to be the Monte Carlo method. However, a Monte Carlo approximation is cumbersome to use inside a time critical application such as online SLAM. Efforts have been made to estimate this covariance via machine learning using carefully designed features to abstract the raw point clouds. However, the performance of this approach is sensitive to the features chosen. We argue that it is possible to learn the features along with the covariance by working with the raw data and thus we propose a new approach based on PointNet. In this work, we train this network using the KL divergence between the learned uncertainty distribution and one computed by the Monte Carlo method as the loss. We test the performance of the general model presented applying it to our target use case of SLAM with an autonomous underwater vehicle (AUV) restricted to the 2 dimensional registration of 3D bathymetric point clouds.


On the effect of structural forces on a condensing film profile near a fin groove corner. Estimation of condenser performance of two phase passive heat spreaders with grooved wick structures is crucial in the prediction of the overall performance of the heat spreader. Whilst the evaporation problem in micro grooves has been widely studied, studies focusing on the condensation on fin groove systems have been scarce. Condensation on fin groove systems is actually a multi scale problem. Thickness of the film near the fin groove corner can decrease to nanoscale dimensions, which requires the inclusion of nanoscale effects into the modeling. While a few previous studies investigated the effect of dispersion forces, the effect of structural forces has never been considered in the thin film condensation modeling on fin groove systems. The present study utilizes a disjoining pressure model which considers both dispersion and structural forces. The results reveal that structural forces are able to dominate dispersion forces in certain configurations. Consequently, by intensifying the disjoining pressure, structural forces lead to a sudden change of the film profile (slope break) for subcooling values which are relevant to engineering applications.


The k Power Domination Number in Some Self Similar Graphs. The k power domination problem is a problem in graph theory, which has applications in many areas. However, it is hard to calculate the exact k power domination number since determining k power domination number of a generic graph is a NP complete problem. We determine the exact k power domination number in two graphs which have the same number of vertices and edges pseudofractal scale free web and Sierpi 'nski gasket. The k power domination number becomes 1 for k ge2 in the Sierpi 'nski gasket, while the k power domination number increases at an exponential rate with regard to the number of vertices in the pseudofractal scale free web. The scale free property may account for the difference in the behavior of two graphs.


Themis Fair and Efficient GPU Cluster Scheduling. Modern distributed machine learning (ML) training workloads benefit significantly from leveraging GPUs. However, significant contention ensues when multiple such workloads are run atop a shared cluster of GPUs. A key question is how to fairly apportion GPUs across workloads. We find that established cluster scheduling disciplines are a poor fit because of ML workloads' unique attributes ML jobs have long running tasks that need to be gang scheduled, and their performance is sensitive to tasks' relative placement. We propose Themis, a new scheduling framework for ML training workloads. It's GPU allocation policy enforces that ML workloads complete in a finish time fair manner, a new notion we introduce. To capture placement sensitivity and ensure efficiency, Themis uses a two level scheduling architecture where ML workloads bid on available resources that are offered in an auction run by a central arbiter. Our auction design allocates GPUs to winning bids by trading off efficiency for fairness in the short term but ensuring finish time fairness in the long term. Our evaluation on a production trace shows that Themis can improve fairness by more than 2.25X and is 5 to 250 more cluster efficient in comparison to state of the art schedulers.


Coding Constructions for Efficient Oblivious Transfer from Noisy Channels. We consider oblivious transfer protocols performed over binary symmetric channels in a malicious setting where parties will actively cheat if they can. We provide constructions purely based on coding theory that achieve an explicit positive rate, the essential ingredient being the existence of linear codes whose Schur products are asymptotically good.


On the dynamics of extensions of free abelian times free groups endomorphisms to the completion. We obtain conditions of uniform continuity for endomorphisms of free abelian times free groups for the product metric defined by taking the prefix metric in each component and establish an equivalence between uniform continuity for this metric and the preservation of a coarse median, which was recently introduced by Fioravanti. Considering the extension of an endomorphism to the completion we count the number of orbits for the action of the subgroup of fixed points (resp. periodic) points on the set of infinite fixed (resp. periodic) points. Finally, we study the dynamics of infinite points for some endomorphisms, defined in a precise way, fitting a classification given by Delgado and Ventura, we prove that every infinite point is either periodic or wandering, which implies that the dynamics is asymptotically periodic. We also prove the latter for the case of automorphisms.


Measure theoretic equicontinuity and rigidity. Let (X,T) be a topological dynamical system and mu be a invariant measure, we show that (X, mathcal B , mu,T) is rigid if and only if there exists some subsequence A of mathbb N such that (X,T) is mu A equicontinuous if and only if there exists some IP set A such that (X,T) is mu A equicontinuous. We show that if there exists a subsequence A of mathbb N with positive upper density such that (X,T) is mu A mean equicontinuous, then (X, mathcal B , mu,T) is rigid. We also give results with respect to functions.


The Homophily Principle in Social Network Analysis. In recent years, social media has become a ubiquitous and integral part of social networking. One of the major attentions made by social researchers is the tendency of like minded people to interact with one another in social groups, a concept which is known as Homophily. The study of homophily can provide eminent insights into the flow of information and behaviors within a society and this has been extremely useful in analyzing the formations of online communities. In this paper, we review and survey the effect of homophily in social networks and summarize the state of art methods that has been proposed in the past years to identify and measure the effect of homophily in multiple types of social networks and we conclude with a critical discussion of open challenges and directions for future research.


DPAttack Diffused Patch Attacks against Universal Object Detection. Recently, deep neural networks (DNNs) have been widely and successfully used in Object Detection, e.g. Faster RCNN, YOLO, CenterNet. However, recent studies have shown that DNNs are vulnerable to adversarial attacks. Adversarial attacks against object detection can be divided into two categories, whole pixel attacks and patch attacks. While these attacks add perturbations to a large number of pixels in images, we proposed a diffused patch attack ( textbf DPAttack ) to successfully fool object detectors by diffused patches of asteroid shaped or grid shape, which only change a small number of pixels. Experiments show that our DPAttack can successfully fool most object detectors with diffused patches and we get the second place in the Alibaba Tianchi competition Alibaba Tsinghua Adversarial Challenge on Object Detection. Our code can be obtained from https github.com Wu Shudeng DPAttack.


Learning Metrics from Teachers Compact Networks for Image Embedding. Metric learning networks are used to compute image embeddings, which are widely used in many applications such as image retrieval and face recognition. In this paper, we propose to use network distillation to efficiently compute image embeddings with small networks. Network distillation has been successfully applied to improve image classification, but has hardly been explored for metric learning. To do so, we propose two new loss functions that model the communication of a deep teacher network to a small student network. We evaluate our system in several datasets, including CUB 200 2011, Cars 196, Stanford Online Products and show that embeddings computed using small student networks perform significantly better than those computed using standard networks of similar size. Results on a very compact network (MobileNet 0.25), which can be used on mobile devices, show that the proposed method can greatly improve Recall 1 results from 27.5 to 44.6 . Furthermore, we investigate various aspects of distillation for embeddings, including hint and attention layers, semi supervised learning and cross quality distillation. (Code is available at https github.com yulu0724 EmbeddingDistillation.)


The relative Schinzel hypothesis. The Schinzel Hypothesis is a conjecture about irreducible polynomials in one variable over the integers under some standard condition, they should assume infinitely many prime values at integers. We consider a relative version if the polynomials are relatively prime and no prime number divides all their values at integers, then they assume relatively prime values at at least one integer. We extend the question to all integral domains and prove it for a number of them PIDs, UFDs containing an infinite field, polynomial rings over a UFD. Applications include a new "integral" version of the Hilbert Irreducibility Theorem, for which the irreducibility conclusion is over the ring.


Forbidden induced subgraph characterization of circle graphs within split graphs. A graph is circle if its vertices are in correspondence with a family of chords in a circle in such a way that every two distinct vertices are adjacent if and only if the corresponding chords have nonempty intersection. Even though there are diverse characterizations of circle graphs, a structural characterization by minimal forbidden induced subgraphs for the entire class of circle graphs is not known, not even restricted to split graphs (which are the graphs whose vertex set can be partitioned into a clique and a stable set). In this work, we give a characterization by minimal forbidden induced subgraphs of circle graphs, restricted to split graphs.


Intelligent Service Selection in a Multi dimensional Environment of Cloud Providers for IoT stream Data through cloudlets. The expansion of the Internet of Things(IoT) services and a huge amount of data generated by different sensors, signify the importance of cloud computing services like Storage as a Service more than ever. IoT traffic imposes such extra constraints on the cloud storage service as sensor data preprocessing capability and load balancing between data centers and servers in each data center. Also, it should be allegiant to the Quality of Service (QoS). The hybrid MWG algorithm has been proposed in this work, which considers different objectives such as energy, processing time, transmission time, and load balancing in both Fog and Cloud Layer. The MATLAB script is used to simulate and implement our algorithms, and services of different servers, e.g. Amazon, Dropbox, Google Drive, etc. have been considered. The MWG has 7 , 13 , and 25 improvement in comparison with MOWCA, KGA, and NSGAII in metric of spacing, respectively. Moreover, the MWG has 4 , 4.7 , and 7.3 optimization in metric of quality in comparison to MOWCA, KGA, and NSGAII, respectively. The overall optimization shows that the MWG algorithm has 7.8 , 17 , and 21.6 better performance in comparison with MOWCA, KGA, and NSGAII in the obtained best result by considering different objectives, respectively.


Jacobian Adversarially Regularized Networks for Robustness. Adversarial examples are crafted with imperceptible perturbations with the intent to fool neural networks. Against such attacks, adversarial training and its variants stand as the strongest defense to date. Previous studies have pointed out that robust models that have undergone adversarial training tend to produce more salient and interpretable Jacobian matrices than their non robust counterparts. A natural question is whether a model trained with an objective to produce salient Jacobian can result in better robustness. This paper answers this question with affirmative empirical results. We propose Jacobian Adversarially Regularized Networks (JARN) as a method to optimize the saliency of a classifier's Jacobian by adversarially regularizing the model's Jacobian to resemble natural training images. Image classifiers trained with JARN show improved robust accuracy compared to standard models on the MNIST, SVHN and CIFAR 10 datasets, uncovering a new angle to boost robustness without using adversarial training examples.


Radiation Brightening from Virus like Particles. Concentration quenching is a well known challenge in many fluorescence imaging applications. Here we show that the optical emission from hundreds of chromophores confined onto the surface of a virus particle 28 nm diameter can be recovered under pulsed irradiation. We have found that, as one increases the number of chromophores tightly bound to the virus surface, fluorescence quenching ensues at first, but when the number of chromophores per particle is nearing the maximum number of surface sites allowable, a sudden brightening of the emitted light and a shortening of the excited state lifetime are observed. This radiation brightening occurs only under short pulse excitation steady state excitation is characterized by conventional concentration quenching for any number of chromophores per particle. The observed suppression of fluorescence quenching is consistent with efficient, collective relaxation at room temperature. Interestingly, radiation brightening disappears when the emitters' spatial and or dynamic heterogeneity is increased, suggesting that the template structural properties may play a role and opening a way towards novel, virus enabled imaging vectors that have qualitatively different optical properties than state of the art biophotonic agents.


Understanding Neural Abstractive Summarization Models via Uncertainty. An advantage of seq2seq abstractive summarization models is that they generate text in a free form manner, but this flexibility makes it difficult to interpret model behavior. In this work, we analyze summarization decoders in both blackbox and whitebox ways by studying on the entropy, or uncertainty, of the model's token level predictions. For two strong pre trained models, PEGASUS and BART on two summarization datasets, we find a strong correlation between low prediction entropy and where the model copies tokens rather than generating novel text. The decoder's uncertainty also connects to factors like sentence position and syntactic distance between adjacent pairs of tokens, giving a sense of what factors make a context particularly selective for the model's next output token. Finally, we study the relationship of decoder uncertainty and attention behavior to understand how attention gives rise to these observed effects in the model. We show that uncertainty is a useful perspective for analyzing summarization and text generation models more broadly.


Exploring Data Efficient 3D Scene Understanding with Contrastive Scene Contexts. The rapid progress in 3D scene understanding has come with growing demand for data however, collecting and annotating 3D scenes (e.g. point clouds) are notoriously hard. For example, the number of scenes (e.g. indoor rooms) that can be accessed and scanned might be limited even given sufficient data, acquiring 3D labels (e.g. instance masks) requires intensive human labor. In this paper, we explore data efficient learning for 3D point cloud. As a first step towards this direction, we propose Contrastive Scene Contexts, a 3D pre training method that makes use of both point level correspondences and spatial contexts in a scene. Our method achieves state of the art results on a suite of benchmarks where training data or labels are scarce. Our study reveals that exhaustive labelling of 3D point clouds might be unnecessary and remarkably, on ScanNet, even using 0.1 of point labels, we still achieve 89 (instance segmentation) and 96 (semantic segmentation) of the baseline performance that uses full annotations.


CenterMask Real Time Anchor Free Instance Segmentation. We propose a simple yet efficient anchor free instance segmentation, called CenterMask, that adds a novel spatial attention guided mask (SAG Mask) branch to anchor free one stage object detector (FCOS) in the same vein with Mask R CNN. Plugged into the FCOS object detector, the SAG Mask branch predicts a segmentation mask on each box with the spatial attention map that helps to focus on informative pixels and suppress noise. We also present an improved backbone networks, VoVNetV2, with two effective strategies (1) residual connection for alleviating the optimization problem of larger VoVNet cite lee2019energy and (2) effective Squeeze Excitation (eSE) dealing with the channel information loss problem of original SE. With SAG Mask and VoVNetV2, we deign CenterMask and CenterMask Lite that are targeted to large and small models, respectively. Using the same ResNet 101 FPN backbone, CenterMask achieves 38.3 , surpassing all previous state of the art methods while at a much faster speed. CenterMask Lite also outperforms the state of the art by large margins at over 35fps on Titan Xp. We hope that CenterMask and VoVNetV2 can serve as a solid baseline of real time instance segmentation and backbone network for various vision tasks, respectively. The Code is available at https github.com youngwanLEE CenterMask.


Uniform Interpolation and Compact Congruences. Uniform interpolation properties are defined for equational consequence in a variety of algebras and related to properties of compact congruences on first the free and then the finitely presented algebras of the variety. It is also shown, following related results of Ghilardi and Zawadowski, that a combination of these properties provides a sufficient condition for the first order theory of the variety to admit a model completion.


Inferences and Modal Vocabulary. Deduction is the one of the major forms of inferences and commonly used in formal logic. This kind of inference has the feature of monotonicity, which can be problematic. There are different types of inferences that are not monotonic, e.g. abductive inferences. The debate between advocates and critics of abduction as a useful instrument can be reconstructed along the issue, how an abductive inference warrants to pick out one hypothesis as the best one. But how can the goodness of an inference be assessed? Material inferences express good inferences based on the principle of material incompatibility. Material inferences are based on modal vocabulary, which enriches the logical expressivity of the inferential relations. This leads also to certain limits in the application of labeling in machine learning. I propose a modal interpretation of implications to express conceptual relations.


Discrete subgroups of small critical exponent. We prove that finitely generated higher dimensional Kleinian groups with small critical exponent are always convex cocompact. Along the way, we also prove some geometric properties for any complete pinched negatively curved manifold with critical exponent less than 1.


Query Understanding for Natural Language Enterprise Search. Natural Language Search (NLS) extends the capabilities of search engines that perform keyword search allowing users to issue queries in a more "natural" language. The engine tries to understand the meaning of the queries and to map the query words to the symbols it supports like Persons, Organizations, Time Expressions etc.. It, then, retrieves the information that satisfies the user's need in different forms like an answer, a record or a list of records. We present an NLS system we implemented as part of the Search service of a major CRM platform. The system is currently in production serving thousands of customers. Our user studies showed that creating dynamic reports with NLS saved more than 50 of our user's time compared to achieving the same result with navigational search. We describe the architecture of the system, the particularities of the CRM domain as well as how they have influenced our design decisions. Among several submodules of the system we detail the role of a Deep Learning Named Entity Recognizer. The paper concludes with discussion over the lessons learned while developing this product.


Multiple Kernel Fisher Discriminant Metric Learning for Person Re identification. Person re identification addresses the problem of matching pedestrian images across disjoint camera views. Design of feature descriptor and distance metric learning are the two fundamental tasks in person re identification. In this paper, we propose a metric learning framework for person re identification, where the discriminative metric space is learned using Kernel Fisher Discriminant Analysis (KFDA), to simultaneously maximize the inter class variance as well as minimize the intra class variance. We derive a Mahalanobis metric induced by KFDA and argue that KFDA is efficient to be applied for metric learning in person re identification. We also show how the efficiency of KFDA in metric learning can be further enhanced for person re identification by using two simple yet efficient multiple kernel learning methods. We conduct extensive experiments on three benchmark datasets for person re identification and demonstrate that the proposed approaches have competitive performance with state of the art methods.


NLPDove at SemEval 2020 Task 12 Improving Offensive Language Detection with Cross lingual Transfer. This paper describes our approach to the task of identifying offensive languages in a multilingual setting. We investigate two data augmentation strategies using additional semi supervised labels with different thresholds and cross lingual transfer with data selection. Leveraging the semi supervised dataset resulted in performance improvements compared to the baseline trained solely with the manually annotated dataset. We propose a new metric, Translation Embedding Distance, to measure the transferability of instances for cross lingual data selection. We also introduce various preprocessing steps tailored for social media text along with methods to fine tune the pre trained multilingual BERT (mBERT) for offensive language identification. Our multilingual systems achieved competitive results in Greek, Danish, and Turkish at OffensEval 2020.


On the Robustness of Winners Counting Briberies in Elections. We study the parameterized complexity of counting variants of Swap and Shift Bribery problems, focusing on the parameterizations by the number of swaps and the number of voters. We show experimentally that Swap Bribery offers a new approach to the robustness analysis of elections.


Stability estimates for the conformal group of mathbb S n 1 in dimension n geq 3 . The purpose of this paper is to exhibit a quantitative stability result for the class of M "obius transformations of mathbb S n 1 when n geq 3 . The main estimate is of local nature and asserts that for a Lipschitz map that is apriori close to a M "obius transformation, an average conformal isoperimetric type of deficit controls the deviation (in an average sense) of the map in question from a particular M "obius map. The optimality of the result together with its link with the geometric rigidity of the special orthogonal group are also discussed.


Cohomology with local coefficients and knotted manifolds. We show how the classical notions of cohomology with local coefficients, CW complex, covering space, homeomorphism equivalence, simple homotopy equivalence, tubular neighbourhood, and spinning can be encoded on a computer and used to calculate ambient isotopy invariants of continuous embeddings N hookrightarrow M of one topological manifold into another. More specifically, we describe an algorithm for computing the homology H n(X,A) and cohomology H n(X,A) of a finite connected CW complex X with local coefficients in a mathbb Z pi 1X module A when A is finitely generated over mathbb Z . It can be used, in particular, to compute the integral cohomology H n( widetilde X H, mathbb Z) and induced homomorphism H n(X, mathbb Z) rightarrow H n( widetilde X H, mathbb Z) for the covering map p colon widetilde X H rightarrow X associated to a finite index subgroup H pi 1X , as well as the corresponding homology homomorphism. We illustrate an open source implementation of the algorithm by using it to show that (i) the degree 2 homology group H 2( widetilde X H, mathbb Z) distinguishes between the homotopy types of the complements X subset mathbb R 4 of the spun Hopf link and Satoh's tube map of the welded Hopf link (these two complements having isomorphic fundamental groups and integral homology) (ii) the degree 1 homology homomorphism H 1(p 1 (B), mathbb Z) rightarrow H 1( widetilde X H, mathbb Z) distinguishes between the homeomorphism types of the complements X subset mathbb R 3 of the granny knot and the reef knot, where B subset X is the knot boundary (these two complements again having isomorphic fundamental groups and integral homology).


Sharp Interface Limit of a Stokes Cahn Hilliard System, Part II Approximate Solutions. We construct rigorously suitable approximate solutions to the Stokes Cahn Hilliard system by using the method of matched asymptotics expansions. This is a main step in the proof of convergence given in the first part of this contribution, where the rigorous sharp interface limit of a coupled Stokes Cahn Hilliard system in a two dimensional, bounded and smooth domain is shown. As a novelty compared to earlier works, we introduce fractional order terms, which are of significant importance, but share the problematic feature that they may not be uniformly estimated in epsilon in arbitrarily strong norms. As a consequence, gaining necessary estimates for the error, which occurs when considering the approximations in the Stokes Cahn Hilliard system, is rather involved.


Synthetic ablations in the C. elegans nervous system. Synthetic lethality, the finding that the simultaneous knockout of two or more individually non essential genes leads to cell or organism death, has offered a systematic framework to explore cellular function, and also offered therapeutic applications. Yet, the concept lacks its parallel in neuroscience a systematic knowledge base on the role of double or higher order ablations in the functioning of a neural system. Here, we use the framework of network control to systematically predict the ablation of neuron pairs and triplets. We find that surprisingly small sets of 58 pairs and 46 triplets can reduce muscle controllability, and that these sets are localised in the nervous system in distinct groups. Further, they lead to highly specific experimentally testable predictions about mechanisms of loss of control, and which muscle cells are expected to experience this loss.


Indirect and Direct Training of Spiking Neural Networks for End to End Control of a Lane Keeping Vehicle. Building spiking neural networks (SNNs) based on biological synaptic plasticities holds a promising potential for accomplishing fast and energy efficient computing, which is beneficial to mobile robotic applications. However, the implementations of SNNs in robotic fields are limited due to the lack of practical training methods. In this paper, we therefore introduce both indirect and direct end to end training methods of SNNs for a lane keeping vehicle. First, we adopt a policy learned using the textcolor black Deep Q Learning (DQN) algorithm and then subsequently transfer it to an SNN using supervised learning. Second, we adopt the reward modulated spike timing dependent plasticity (R STDP) for training SNNs directly, since it combines the advantages of both reinforcement learning and the well known spike timing dependent plasticity (STDP). We examine the proposed approaches in three scenarios in which a robot is controlled to keep within lane markings by using an event based neuromorphic vision sensor. We further demonstrate the advantages of the R STDP approach in terms of the lateral localization accuracy and training time steps by comparing them with other three algorithms presented in this paper.


Extension Technique for Functions of Diffusion Operators a stochastic approach. It has recently been shown that complete Bernstein functions of the Laplace operator map the Dirichlet boundary condition of a related elliptic PDE to the Neumann boundary condition. The importance of this mapping consists in being able to convert problems involving non local operators, like fractional Laplacians, into ones that only involve differential operators. We generalise this result to diffusion operators associated with stochastic differential equations, using a method which is entirely based on stochastic analysis.


Understanding when spatial transformer networks do not support invariance, and what to do about it. Spatial transformer networks (STNs) were designed to enable convolutional neural networks (CNNs) to learn invariance to image transformations. STNs were originally proposed to transform CNN feature maps as well as input images. This enables the use of more complex features when predicting transformation parameters. However, since STNs perform a purely spatial transformation, they do not, in the general case, have the ability to align the feature maps of a transformed image with those of its original. STNs are therefore unable to support invariance when transforming CNN feature maps. We present a simple proof for this and study the practical implications, showing that this inability is coupled with decreased classification accuracy. We therefore investigate alternative STN architectures that make use of complex features. We find that while deeper localization networks are difficult to train, localization networks that share parameters with the classification network remain stable as they grow deeper, which allows for higher classification accuracy on difficult datasets. Finally, we explore the interaction between localization network complexity and iterative image alignment.


A metric version of Poincar 'e's theorem concerning biholomorphic inequivalence of domains. We show that if Y j subset mathbb C n j is a bounded strongly convex domain with C 3 boundary for j 1, dots,q , and X j subset mathbb C m j is a bounded convex domain for j 1, ldots,p , then the product domain prod j 1 p X j subset mathbb C m cannot be isometrically embedded into prod j 1 q Y j subset mathbb C n under the Kobayashi distance, if p q . This result generalises Poincar 'e's theorem which says that there is no biholomorphic map from the polydisc onto the Euclidean ball in mathbb C n for n geq 2 . The method of proof only relies on the metric geometry of the spaces and will be derived from a result for products of proper geodesic metric spaces with the sup metric. In fact, the main goal of the paper is to establish a general criterion, in terms of certain asymptotic geometric properties of the individual metric spaces, that yields an obstruction for the existence of an isometric embedding between product metric spaces.


Improved Algorithm for Tolerant Junta Testing. In this paper, we consider the problem of tolerant junta testing for boolean function. Compared with the prior work by Blais et al., we provide improved results in terms of both the parameter gap and query complexity. Compared with the prior work by De et al., our work did not close the parameter gap, but we removed the 2 k term of the query complexity.


Temporal Autoencoder with U Net Style Skip Connections for Frame Prediction. Finding sustainable and novel solutions to predict city wide mobility behaviour is an ever growing problem given increased urban complexity and growing populations. This paper seeks to address this by describing a traffic frame prediction approach that uses Convolutional LSTMs to create a Temporal Autoencoder with U Net style skip connections that marry together recurrent and traditional computer vision techniques to capture spatio temporal dependencies at different scales without losing topological details of a given city. Utilisation of Cyclical Learning Rates is also presented, improving training efficiency by achieving lower loss scores in fewer epochs than standard approaches.


Witten Deformation on Non compact Manifold Heat Kernel Expansion and Local Index Theorem. Asymptotic expansions of heat kernels and heat traces of Schr "odinger operators on non compact spaces are rarely explored, and even for cases as simple as mathbb C n with (quasi homogeneous) polynomials potentials, it's already very complicated. Motivated by path integral formulation of the heat kernel, we introduced a parabolic distance, which also appeared in Li Yau's famous work on parabolic Harnack estimate. With the help of the parabolic distance, we derive a pointwise asymptotic expansion of the heat kernel for the Witten Laplacian with strong remainder estimate. When the deformation parameter of Witten deformation and time parameter are coupled, we derive an asymptotic expansion of trace of heat kernel for small time t , and obtain a local index theorem. This is the second of our papers in understanding Landau Ginzburg B models on nontrivial spaces, and in subsequent work, we will develop the Ray Singer torsion for Witten deformation in the non compact setting.


The two dimensional fractional orthogonal derivative. This paper is an edited and shortened version of Chapter 6 from the thesis of the author. First the one dimensional orthogonal derivative will be extended to the two dimensional case. In the two dimensional case we have to define the region of integration. In this paper we treat the integration over the square region and over the triangle region where in the last case we use biorthogonal polynomials expressed in terms of Appell functions. Next the two dimensional orthogonal derivative will be extended to the two dimensional fractional orthogonal derivative. The results are highly dependent on the F 1 , F 2 and F 3 Appell functions.


What Makes a Good and Useful Summary? Incorporating Users in Automatic Summarization Research. Automatic text summarization has enjoyed great progress over the years and is used in numerous applications, impacting the lives of many. Despite this development, there is little research that meaningfully investigates how the current research focus in automatic summarization aligns with users' needs. To bridge this gap, we propose a survey methodology that can be used to investigate the needs of users of automatically generated summaries. Importantly, these needs are dependent on the target group. Hence, we design our survey in such a way that it can be easily adjusted to investigate different user groups. In this work we focus on university students, who make extensive use of summaries during their studies. We find that the current research directions of the automatic summarization community do not fully align with students' needs. Motivated by our findings, we present ways to mitigate this mismatch in future research on automatic summarization we propose research directions that impact the design, the development and the evaluation of automatically generated summaries.


An Improved Historical Embedding without Alignment. Many words have evolved in meaning as a result of cultural and social change. Understanding such changes is crucial for modelling language and cultural evolution. Low dimensional embedding methods have shown promise in detecting words' meaning change by encoding them into dense vectors. However, when exploring semantic change of words over time, these methods require the alignment of word embeddings across different time periods. This process is computationally expensive, prohibitively time consuming and suffering from contextual variability. In this paper, we propose a new and scalable method for encoding words from different time periods into one dense vector space. This can greatly improve performance when it comes to identifying words that have changed in meaning over time. We evaluated our method on dataset from Google Books N gram. Our method outperformed three other popular methods in terms of the number of words correctly identified to have changed in meaning. Additionally, we provide an intuitive visualization of the semantic evolution of some words extracted by our method


An Entropic Relevance Measure for Stochastic Conformance Checking in Process Mining. Given an event log as a collection of recorded real world process traces, process mining aims to automatically construct a process model that is both simple and provides a useful explanation of the traces. Conformance checking techniques are then employed to characterize and quantify commonalities and discrepancies between the log's traces and the candidate models. Recent approaches to conformance checking acknowledge that the elements being compared are inherently stochastic for example, some traces occur frequently and others infrequently and seek to incorporate this knowledge in their analyses. Here we present an entropic relevance measure for stochastic conformance checking, computed as the average number of bits required to compress each of the log's traces, based on the structure and information about relative likelihoods provided by the model. The measure penalizes traces from the event log not captured by the model and traces described by the model but absent in the event log, thus addressing both precision and recall quality criteria at the same time. We further show that entropic relevance is computable in time linear in the size of the log, and provide evaluation outcomes that demonstrate the feasibility of using the new approach in industrial settings.


NLPContributions An Annotation Scheme for Machine Reading of Scholarly Contributions in Natural Language Processing Literature. We describe an annotation initiative to capture the scholarly contributions in natural language processing (NLP) articles, particularly, for the articles that discuss machine learning (ML) approaches for various information extraction tasks. We develop the annotation task based on a pilot annotation exercise on 50 NLP ML scholarly articles presenting contributions to five information extraction tasks 1. machine translation, 2. named entity recognition, 3. question answering, 4. relation classification, and 5. text classification. In this article, we describe the outcomes of this pilot annotation phase. Through the exercise we have obtained an annotation methodology and found ten core information units that reflect the contribution of the NLP ML scholarly investigations. The resulting annotation scheme we developed based on these information units is called NLPContributions. The overarching goal of our endeavor is four fold 1) to find a systematic set of patterns of subject predicate object statements for the semantic structuring of scholarly contributions that are more or less generically applicable for NLP ML research articles 2) to apply the discovered patterns in the creation of a larger annotated dataset for training machine readers of research contributions 3) to ingest the dataset into the Open Research Knowledge Graph (ORKG) infrastructure as a showcase for creating user friendly state of the art overviews 4) to integrate the machine readers into the ORKG to assist users in the manual curation of their respective article contributions. We envision that the NLPContributions methodology engenders a wider discussion on the topic toward its further refinement and development. Our pilot annotated dataset of 50 NLP ML scholarly articles according to the NLPContributions scheme is openly available to the research community at https doi.org 10.25835 0019761.


A Survey on Temporal Reasoning for Temporal Information Extraction from Text (Extended Abstract). Time is deeply woven into how people perceive, and communicate about the world. Almost unconsciously, we provide our language utterances with temporal cues, like verb tenses, and we can hardly produce sentences without such cues. Extracting temporal cues from text, and constructing a global temporal view about the order of described events is a major challenge of automatic natural language understanding. Temporal reasoning, the process of combining different temporal cues into a coherent temporal view, plays a central role in temporal information extraction. This article presents a comprehensive survey of the research from the past decades on temporal reasoning for automatic temporal information extraction from text, providing a case study on the integration of symbolic reasoning with machine learning based information extraction systems.


A Distributed Multi Robot Coordination Algorithm for Navigation in Tight Environments. This work presents a distributed method for multi robot coordination based on nonlinear model predictive control (NMPC) and dual decomposition. Our approach allows the robots to coordinate in tight spaces (e.g., highway lanes, parking lots, warehouses, canals, etc.) by using a polytopic description of each robot's shape and formulating the collision avoidance as a dual optimization problem. Our method accommodates heterogeneous teams of robots (i.e., robots with different polytopic shapes and dynamic models can be part of the same team) and can be used to avoid collisions in n dimensional spaces. Starting from a centralized implementation of the NMPC problem, we show how to exploit the problem structure to allow the robots to cooperate (while communicating their intentions to the neighbors) and compute collision free paths in a distributed way in real time. By relying on a bi level optimization scheme, our design decouples the optimization of the robot states and of the collision avoidance variables to create real time coordination strategies. Finally, we apply our method for the autonomous navigation of a platoon of connected vehicles on a simulation setting. We compare our design with the centralized NMPC design to show the computational benefits of the proposed distributed algorithm. In addition, we demonstrate our method for coordination of a heterogeneous team of robots (with different polytopic shapes).


WAF A MoLE Evading Web Application Firewalls through Adversarial Machine Learning. Web Application Firewalls are widely used in production environments to mitigate security threats like SQL injections. Many industrial products rely on signature based techniques, but machine learning approaches are becoming more and more popular. The main goal of an adversary is to craft semantically malicious payloads to bypass the syntactic analysis performed by a WAF. In this paper, we present WAF A MoLE, a tool that models the presence of an adversary. This tool leverages on a set of mutation operators that alter the syntax of a payload without affecting the original semantics. We evaluate the performance of the tool against existing WAFs, that we trained using our publicly available SQL query dataset. We show that WAF A MoLE bypasses all the considered machine learning based WAFs.


Information length as a useful index to understand variability in the global circulation. With improved measurement and modelling technology, variability has emerged as an essential feature in non equilibrium processes. While traditionally, mean values and variance have been heavily used, they are not appropriate in describing extreme events where a significant deviation from mean values often occurs. Furthermore, stationary Probability Density Functions (PDFs) miss crucial information about the dynamics associated with variability. It is thus critical to go beyond a traditional approach and deal with time dependent PDFs. Here, we consider atmospheric data from the Whole Atmosphere Community Climate Model (WACCM) model and calculate time dependent PDFs and the information length from these PDFs, which is the total number of statistically different states that a system passes through in time. Time dependent PDFs are shown to be non Gaussian in general, and the information length calculated from these PDFs shed us a new perspective of understanding variabilities, correlation among different variables and regions. Specifically, we calculate time dependent PDFs and information length and show that the information length tends to increase with the altitude albeit in a complex form. This tendency is more robust for flows shears than temperature. Also, much similarity among flows and shears in the information length is found in comparison with the temperature. These results also suggest the importance of high latitude altitude in the information budge in the Earth's atmosphere, the spatial gradient of the information as a useful proxy for the transport of physical quantities.


Repurposing Decoder Transformer Language Models for Abstractive Summarization. Neural network models have shown excellent fluency and performance when applied to abstractive summarization. Many approaches to neural abstractive summarization involve the introduction of significant inductive bias, exemplified through the use of components such as pointer generator architectures, coverage, and partially extractive procedures, designed to mimic the process by which humans summarize documents. We show that it is possible to attain competitive performance by instead directly viewing summarization as a language modeling problem and effectively leveraging transfer learning. We introduce a simple procedure built upon decoder transformers to obtain highly competitive ROUGE scores for summarization performance using a language modeling loss alone, with no beam search or other decoding time optimization, and instead relying on efficient nucleus sampling and greedy decoding.


A rational Even IRA algorithm for the solution of T even polynomial eigenvalue problems. In this work we present a rational Krylov subspace method for solving real large scale polynomial eigenvalue problems with T even (that is, symmetric skew symmetric) structure. Our method is based on the Even IRA algorithm. To preserve the structure, a sparse T even linearization from the class of block minimal bases pencils is applied. Due to this linearization, the Krylov basis vectors can be computed in a cheap way. A rational decomposition is derived so that our method explicitly allows for changes of the shift during the iteration. This leads to a method that is able to compute parts of the spectrum of a T even matrix polynomial in a fast and reliable way.


Cloudy with high chance of DBMS A 10 year prediction for Enterprise Grade ML. Machine learning (ML) has proven itself in high value web applications such as search ranking and is emerging as a powerful tool in a much broader range of enterprise scenarios including voice recognition and conversational understanding for customer support, autotuning for videoconferencing, intelligent feedback loops in large scale sysops, manufacturing and autonomous vehicle management, complex financial predictions, just to name a few. Meanwhile, as the value of data is increasingly recognized and monetized, concerns about securing valuable data and risks to individual privacy have been growing. Consequently, rigorous data management has emerged as a key requirement in enterprise settings. How will these trends (ML growing popularity, and stricter data governance) intersect? What are the unmet requirements for applying ML in enterprise settings? What are the technical challenges for the DB community to solve? In this paper, we present our vision of how ML and database systems are likely to come together, and early steps we take towards making this vision a reality.


Spine representations for non compact models of random geometry. We provide a unified approach to the three main non compact models of random geometry, namely the Brownian plane, the infinite volume Brownian disk, and the Brownian half plane. This approach allows us to investigate relations between these models, and in particular to prove that complements of hulls in the Brownian plane are infinite volume Brownian disks.


Feature Extraction for Novelty Detection in Network Traffic. Data representation plays a critical role in the performance of novelty detection (or anomaly detection'') methods in machine learning. The data representation of network traffic often determines the effectiveness of these models as much as the model itself. The wide range of novel events that network operators need to detect (e.g., attacks, malware, new applications, changes in traffic demands) introduces the possibility for a broad range of possible models and data representations. In each scenario, practitioners must spend significant effort extracting and engineering features that are most predictive for that situation or application. While anomaly detection is well studied in computer networking, much existing work develops specific models that presume a particular representation often IPFIX NetFlow. Yet, other representations may result in higher model accuracy, and the rise of programmable networks now makes it more practical to explore a broader range of representations. To facilitate such exploration, we develop a systematic framework, open source toolkit, and public Python library that makes it both possible and easy to extract and generate features from network traffic and perform and end to end evaluation of these representations across most prevalent modern novelty detection models. We first develop and publicly release an open source tool, an accompanying Python library (NetML), and end to end pipeline for novelty detection in network traffic. Second, we apply this tool to five different novelty detection problems in networking, across a range of scenarios from attack detection to novel device detection. Our findings general insights and guidelines concerning which features appear to be more appropriate for particular situations.


Optimality of Treating Inter Cell Interference as Noise Under Finite Precision CSIT. In this work, we study the generalized degrees of freedom (GDoF) of downlink and uplink cellular networks, modeled as Gaussian interfering broadcast channels (IBC) and Gaussian interfering multiple access channels (IMAC), respectively. We focus on regimes of low inter cell interference, where single cell transmission with power control and treating inter cell interference as noise (mc TIN) is GDoF optimal. Recent works have identified two relevant regimes in this context one in which the GDoF region achieved through mc TIN for both the IBC and IMAC is a convex polyhedron without the need for time sharing (mc CTIN regime), and a smaller (sub)regime where mc TIN is GDoF optimal for both the IBC and IMAC (mc TIN regime). In this work, we extend the mc TIN framework to cellular scenarios where channel state information at the transmitters (CSIT) is limited to finite precision. We show that in this case, the GDoF optimality of mc TIN extends to the entire mc CTIN regime, where GDoF benefits due to interference alignment (IA) are lost. Our result constitutes yet another successful application of robust outer bounds based on the aligned images (AI) approach.


Multiple quasi phase matched second harmonic generation in phase reversal optical superlattice structure. Domain engineered quasi phase matching (QPM) devices are known for its versatility and ability to tune the nonlinear optical frequency conversion process. In this paper, a simple approach is presented to generate multiple quasi phase matched second harmonic generation (SHG) in the phase reversal optical superlattice (PROS) structure. Theoretical studies are carried out by simulation based on the domain reversed lithium niobate QPM devices. The nature of the generated multiple SHG spectra is analyzed when the phase reversal (PR) domains are distributed at equal and unequal intervals along the length of the device. The distribution of phase reversal domains at equal intervals is limited to the generation of dual SHG peaks irrespective of its number. On the contrary, we could generate equal intensity multiple SHG peaks with PR domains distribution at unequal interval. Using this scheme, five peaks QPM SHG are generated by distributing four PR domains in specific locations of the PROS QPM device. The dependency of the PR domain and its location in the PROS QPM device are analyzed to design desirable multi wavelength converters