The Dichotomy of Evaluating Homomorphism Closed Queries on Probabilistic Graphs. We study the problem of query evaluation on probabilistic graphs, namely, tuple independent probabilistic databases over signatures of arity two. We focus on the class of queries closed under homomorphisms, or, equivalently, the infinite unions of conjunctive queries. Our main result states that the probabilistic query evaluation problem is P hard for all unbounded queries from this class. As bounded queries from this class are equivalent to a union of conjunctive queries, they are already classified by the dichotomy of Dalvi and Suciu (2012). Hence, our result and theirs imply a complete data complexity dichotomy, between polynomial time and P hardness, on evaluating homomorphism closed queries over probabilistic graphs. This dichotomy covers in particular all fragments of infinite unions of conjunctive queries over arity two signatures, such as negation free (disjunctive) Datalog, regular path queries, and a large class of ontology mediated queries. The dichotomy also applies to a restricted case of probabilistic query evaluation called generalized model counting, where fact probabilities must be 0, 0.5, or 1. We show the main result by reducing from the problem of counting the valuations of positive partitioned 2 DNF formulae, or from the source to target reliability problem in an undirected graph, depending on properties of minimal models for the query.


A power Cayley Hamilton identity for nxn matrices over a Lie nilpotent ring of index k. For an nxn matrix A over a Lie nilpotent ring R of index k, we prove that an invariant "power" Cayley Hamilton identity of degree (n 2)2 k 2 holds. The right coefficients are not uniquely determined by A, and the cosets lambda i D, with D the double commutator ideal R R,R ,R R of R, appear in the so called second right characteristic polynomial of the natural image of A in the nxn matrix ring M n (R D) over the factor ring R D.


Combinatorial generation via permutation languages. I. Fundamentals. In this work we present a general and versatile algorithmic framework for exhaustively generating a large variety of different combinatorial objects, based on encoding them as permutations. This approach provides a unified view on many known results and allows us to prove many new ones. In particular, we obtain four classical Gray codes for permutations, bitstrings, binary trees and set partitions as special cases. We present two distinct applications for our new framework The first main application is the generation of pattern avoiding permutations, yielding new Gray codes for different families of permutations that are characterized by the avoidance of certain classical patterns, (bi)vincular patterns, barred patterns, boxed patterns, Bruhat restricted patterns, mesh patterns, monotone and geometric grid classes, and many others. We also obtain new Gray codes for all the combinatorial objects that are in bijection to these permutations, in particular for five different types of geometric rectangulations, also known as floorplans, which are divisions of a square into n rectangles subject to certain restrictions. The second main application of our framework are lattice congruences of the weak order on the symmetric group S n . Recently, Pilaud and Santos realized all those lattice congruences as (n 1) dimensional polytopes, called quotientopes, which generalize hypercubes, associahedra, permutahedra etc. Our algorithm generates the equivalence classes of each of those lattice congruences, by producing a Hamilton path on the skeleton of the corresponding quotientope, yielding a constructive proof that each of these highly symmetric graphs is Hamiltonian. We thus also obtain a provable notion of optimality for the Gray codes obtained from our framework They translate into walks along the edges of a polytope.


Analytic Linear Lie rack Structures on Leibniz Algebras. A linear Lie rack structure on a finite dimensional vector space V is a Lie rack operation (x,y) mapsto x rhd y pointed at the origin and such that for any x , the left translation mathrm L x y mapsto mathrm L x(y) x rhd y is linear. A linear Lie rack operation rhd is called analytic if for any x,y in V , x rhd y y sum n 1 infty A n,1 (x, ldots,x,y), where A n,1 V times ldots times V Leftarrow V is an n 1 multilinear map symmetric in the n first arguments. In this case, A 1,1 is exactly the left Leibniz product associated to rhd . Any left Leibniz algebra ( mathfrak h , , ) has a canonical analytic linear Lie rack structure given by x stackrel c rhd y exp( mathrm ad x)(y) , where mathrm ad x(y) x,y . In this paper, we show that a sequence (A n,1 ) n geq1 of n 1 multilinear maps on a vector space V defines an analytic linear Lie rack structure if and only if , A 1,1 is a left Leibniz bracket, the A n,1 are invariant for (V, , ) and satisfy a sequence of multilinear equations. Some of these equations have a cohomological interpretation and can be solved when the zero and the 1 cohomology of the left Leibniz algebra (V, , ) are trivial. On the other hand, given a left Leibniz algebra ( mathfrak h , , ) , we show that there is a large class of (analytic) linear Lie rack structures on ( mathfrak h , , ) which can be built from the canonical one and invariant multilinear symmetric maps on mathfrak h . A left Leibniz algebra on which all the analytic linear Lie rack structures are build in this way will be called rigid. We use our characterizations of analytic linear Lie rack structures to show that mathfrak sl 2( mathbb R ) and mathfrak so (3) are rigid. We conjecture that any simple Lie algebra is rigid as a left Leibniz algebra.


B rigidity of the property to be an almost Pogorelov polytope. Toric topology assigns to each n dimensional combinatorial simple convex polytope P with m facets an (m n) dimensional moment angle manifold mathcal Z P with an action of a compact torus T m such that mathcal Z P T m is a convex polytope of combinatorial type P . We study the notion of B rigidity. A property of a polytope P is called B rigid, if any isomorphism of graded rings H ( mathcal Z P, mathbb Z) H ( mathcal Z Q, mathbb Z) for a simple n polytope Q implies that it also has this property. We study families of 3 dimensional polytopes defined by their cyclic k edge connectivity. These families include flag polytopes and Pogorelov polytopes, that is polytopes realizable as bounded right angled polytopes in Lobachevsky space mathbb L 3 . Pogorelov polytopes include fullerenes simple polytopes with only pentagonal and hexagonal faces. It is known that the properties to be flag and Pogorelov polytope are B rigid. We focus on almost Pogorelov polytopes, which are strongly cyclically 4 edge connected polytopes. They correspond to right angled polytopes of finite volume in mathbb L 3 . There is a subfamily of ideal almost Pogorelov polytopes corresponding to ideal right angled polytopes. We prove that the properties to be an almost Pogorelov polytope and an ideal almost Pogorelov polytope are B rigid. As a corollary we obtain that 3 dimensional associahedron As 3 and permutohedron Pe 3 are B rigid. We generalize methods known for Pogorelov polytopes. We obtain results on B rigidity of subsets in H ( mathcal Z P, mathbb Z) and prove an analog of the so called separable circuit condition (SCC). As an example we consider the ring H ( mathcal Z As 3 , mathbb Z) .


Context Based Quotation Recommendation. While composing a new document, anything from a news article to an email or essay, authors often utilize direct quotes from a variety of sources. Although an author may know what point they would like to make, selecting an appropriate quote for the specific context may be time consuming and difficult. We therefore propose a novel context aware quote recommendation system which utilizes the content an author has already written to generate a ranked list of quotable paragraphs and spans of tokens from a given source document. We approach quote recommendation as a variant of open domain question answering and adapt the state of the art BERT based methods from open QA to our task. We conduct experiments on a collection of speech transcripts and associated news articles, evaluating models' paragraph ranking and span prediction performances. Our experiments confirm the strong performance of BERT based methods on this task, which outperform bag of words and neural ranking baselines by more than 30 relative across all ranking metrics. Qualitative analyses show the difficulty of the paragraph and span recommendation tasks and confirm the quotability of the best BERT model's predictions, even if they are not the true selected quotes from the original news articles.


Error bounds for dynamical spectral estimation. Dynamical spectral estimation is a well established numerical approach for estimating eigenvalues and eigenfunctions of the Markov transition operator from trajectory data. Although the approach has been widely applied in biomolecular simulations, its error properties remain poorly understood. Here we analyze the error of a dynamical spectral estimation method called "the variational approach to conformational dynamics" (VAC). We bound the approximation error and estimation error for VAC estimates. Our analysis establishes VAC's convergence properties and suggests new strategies for tuning VAC to improve accuracy.


On nonlinear Schr " o dinger equations on the hyperbolic space. We study existence of weak solutions for certain classes of nonlinear Schr " o dinger equations on the Poincar ' e ball model mathbb B N , N geq 3 . By using the Palais principle of symmetric criticality and suitable group theoretical arguments, we establish the existence of a nontrivial (weak) solution.


Minimizing the numbers of cliques and cycles of fixed size in an F saturated graph. This paper considers two important questions in the well studied theory of graphs that are F saturated. A graph G is called F saturated if G does not contain a subgraph isomorphic to F , but the addition of any edge creates a copy of F . We first resolve a fundamental question of minimizing the number of cliques of size r in a K s saturated graph for all sufficiently large numbers of vertices, confirming a conjecture of Kritschgau, Methuku, Tait, and Timmons. We also go further and prove a corresponding stability result. Next we minimize the number of cycles of length r in a K s saturated graph for all sufficiently large numbers of vertices, and classify the extremal graphs for most values of r , answering another question of Kritschgau, Methuku, Tait, and Timmons for most r . We then move on to a central and longstanding conjecture in graph saturation made by Tuza, which states that for every graph F , the limit lim n rightarrow infty frac sat(n, F) n exists, where sat(n, F) denotes the minimum number of edges in an n vertex F saturated graph. Pikhurko made progress in the negative direction by considering families of graphs instead of a single graph, and proved that there exists a graph family mathcal F of size 4 for which lim n rightarrow infty frac sat(n, mathcal F ) n does not exist (for a family of graphs mathcal F , a graph G is called mathcal F saturated if G does not contain a copy of any graph in mathcal F , but the addition of any edge creates a copy of a graph in mathcal F , and sat(n, mathcal F ) is defined similarly). We make the first improvement in 15 years by showing that there exist infinitely many graph families of size 3 where this limit does not exist. Our construction also extends to the generalized saturation problem when we minimize the number of fixed size cliques.


Calotropin from milk of Calotropis gigantean a potent inhibitor of COVID 19 corona virus infection by Molecular docking studies. SARS CoV 2 (COVID 19), a positive single stranded RNA virus, member of corona virus family, is spreading its tentacles across the world due to lack of drugs at present. Being associated with cough, fever, and respiratory distress, this disease caused more than 15 mortality worldwide. Due to its vital role in virus replication, Mpro 3CLpro has recently been regarded as a suitable target for drug design. The current study focused on the inhibitory activity of Calotropin, a component from milk of Calotropis gigantean, against Mpro protein from SARS CoV 2. Till date there is no work is undertaken on in silico analysis of this compound against Mpro of COVID 19 protein. In the present study, molecular docking studies were conducted by using Patchdock tool. Protein Interactions tool was used for protein interactions. The calculated parameters such as docking score indicated effective binding of Calotropin to Mpro protein. Interactions results indicated that, Mpro Calotropin complexes forms hydrophobic interactions. Therefore, Calotropin may represent potential herbal treatment to act as COVID 19 Mpro inhibitor. However, further research is necessary to investigate their potential medicinal use.


Failure of Normalization in Impredicative Type Theory with Proof Irrelevant Propositional Equality. Normalization fails in type theory with an impredicative universe of propositions and a proof irrelevant propositional equality. The counterexample to normalization is adapted from Girard's counterexample against normalization of System F equipped with a decider for type equality. It refutes Werner's normalization conjecture LMCS 2008 .


Listener Modeling and Context aware Music Recommendation Based on Country Archetypes. Music preferences are strongly shaped by the cultural and socio economic background of the listener, which is reflected, to a considerable extent, in country specific music listening profiles. Previous work has already identified several country specific differences in the popularity distribution of music artists listened to. In particular, what constitutes the "music mainstream" strongly varies between countries. To complement and extend these results, the article at hand delivers the following major contributions First, using state of the art unsupervised learning techniques, we identify and thoroughly investigate (1) country profiles of music preferences on the fine grained level of music tracks (in contrast to earlier work that relied on music preferences on the artist level) and (2) country archetypes that subsume countries sharing similar patterns of listening preferences. Second, we formulate four user models that leverage the user's country information on music preferences. Among others, we propose a user modeling approach to describe a music listener as a vector of similarities over the identified country clusters or archetypes. Third, we propose a context aware music recommendation system that leverages implicit user feedback, where context is defined via the four user models. More precisely, it is a multi layer generative model based on a variational autoencoder, in which contextual features can influence recommendations through a gating mechanism. Fourth, we thoroughly evaluate the proposed recommendation system and user models on a real world corpus of more than one billion listening records of users around the world (out of which we use 369 million in our experiments) and show its merits vis a vis state of the art algorithms that do not exploit this type of context information.


A proof of Sondow's conjecture on the Smarandache function. The Smarandache function of a positive integer n , denoted by S(n) , is defined to be the smallest positive integer j such that n divides the factorial j! . In this note, we prove that for any fixed number k 1 , the inequality n k S(n)! holds for almost all positive integers n . This confirms Sondow's conjecture which asserts that the inequality n 2 S(n)! holds for almost all positive integers n .


The Chabauty Kim Method for Relative Completions. In this thesis we develop a Chabauty Kim theory for the relative completion of motivic fundamental groups, including Selmer stacks and moduli spaces of admissible torsors for the relative completion of the de Rham fundamental group. On one hand, this work generalizes results of Kim (and therefore Chabauty) in the unipotent case by adding a reductive quotient of the fundamental group. From this perspective, the addition of a reductive part allows one to apply Chabauty type methods to fundamental groups with trivial unipotent completion, such as SL 2( mathbb Z ) . On the other hand, the unipotent part provides a natural extension of the recent work of Lawrence and Venkatesh. We show that their concern with the centralizer of Frobenius goes away as one moves up the unipotent tower and away from the reductive world of flag varieties and the Gauss Manin connection. One is tempted to hope that the relative completion will provide a unified proof of Mordell's conjecture that takes advantage of the two methods. Toward this end, we apply our work to the Legendre family on the projective line minus three points, a particular example where the method of Lawrence and Venkatesh fails.


Design and Implementation of a Maxi Sized Mobile Robot (Karo) for Rescue Missions. Rescue robots are expected to carry out reconnaissance and dexterity operations in unknown environments comprising unstructured obstacles. Although a wide variety of designs and implementations have been presented within the field of rescue robotics, embedding all mobility, dexterity, and reconnaissance capabilities in a single robot remains a challenging problem. This paper explains the design and implementation of Karo, a mobile robot that exhibits a high degree of mobility at the side of maintaining required dexterity and exploration capabilities for urban search and rescue (USAR) missions. We first elicit the system requirements of a standard rescue robot from the frameworks of Rescue Robot League (RRL) of RoboCup and then, propose the conceptual design of Karo by drafting a locomotion and manipulation system. Considering that, this work presents comprehensive design processes along with detail mechanical design of the robot's platform and its 7 DOF manipulator. Further, we present the design and implementation of the command and control system by discussing the robot's power system, sensors, and hardware systems. In conjunction with this, we elucidate the way that Karo's software system and human robot interface are implemented and employed. Furthermore, we undertake extensive evaluations of Karo's field performance to investigate whether the principal objective of this work has been satisfied. We demonstrate that Karo has effectively accomplished assigned standardized rescue operations by evaluating all aspects of its capabilities in both RRL's test suites and training suites of a fire department. Finally, the comprehensiveness of Karo's capabilities has been verified by drawing quantitative comparisons between Karo's performance and other leading robots participating in RRL.


The method of detecting online password attacks based on high level protocol analysis and clustering techniques. Although there have been many solutions applied, the safety challenges related to the password security mechanism are not reduced. The reason for this is that while the means and tools to support password attacks are becoming more and more abundant, the number of transaction systems through the Internet is increasing, and new services systems appear. For example, IoT also uses password based authentication. In this context, consolidating password based authentication mechanisms is critical, but monitoring measures for timely detection of attacks also play an important role in this battle. The password attack detection solutions being used need to be supplemented and improved to meet the new situation. In this paper we propose a solution that automatically detects online password attacks in a way that is based solely on the network, using unsupervised learning techniques and protected application orientation. Our solution, therefore, minimizes dependence on the factors encountered by host based or supervised learning solutions. The certainty of the solution comes from using the results of an in depth analysis of attack characteristics to build the detection capacity of the mechanism. The solution was implemented experimentally on the real system and gave positive results.


Para K "ahler Einstein 4 manifolds and non integrable twistor distributions. We study the local geometry of 4 manifolds equipped with a emph para K "ahler Einstein (pKE) metric, a special type of split signature pseudo Riemannian metric, and their associated emph twistor distribution , a rank 2 distribution on the 5 dimensional total space of the circle bundle of self dual null 2 planes. For pKE metrics with nonvanishing Einstein constant this twistor distribution has exactly two integral leaves and is maximally non integrable' on their complement, a so called (2,3,5) distribution. Our main result establishes a simple correspondence between the anti self dual Weyl tensor of a pKE metric with non vanishing Einstein constant and the Cartan quartic of the associated twistor distribution. This will be followed by a discussion of this correspondence for general split signature metrics which is shown to be much more involved. We use Cartan's method of equivalence to produce a large number of explicit examples of pKE metrics with nonvanishing Einstein constant whose anti self dual Weyl tensor have special real Petrov type. In the case of real Petrov type D, we obtain a complete local classification. Combined with the main result, this produces twistor distributions whose Cartan quartic has the same algebraic type as the Petrov type of the constructed pKE metrics. In a similar manner, one can obtain twistor distributions with Cartan quartic of arbitrary algebraic type. As a byproduct of our pKE examples we naturally obtain para Sasaki Einstein metrics in five dimensions. Furthermore, we study various Cartan geometries naturally associated to certain classes of pKE 4 dimensional metrics. We observe that in some geometrically distinguished cases the corresponding emph Cartan connections satisfy the Yang Mills equations. We then provide explicit examples of such Yang Mills Cartan connections.


Elastic deep learning in multi tenant GPU cluster. We study how to support elasticity, i.e., the ability to dynamically adjust the parallelism (number of GPUs), for deep neural network (DNN) training. Elasticity can benefit multi tenant GPU cluster management in many ways, e.g., achieving various scheduling objectives (e.g., job throughput, job completion time, GPU efficiency) according to cluster load variations, maximizing the use of transient idle resources, performance profiling, job migration, and straggler mitigation. However, existing parallelism adjustment strategies incur high overheads, which hinder many applications from making effective use of elasticity. We propose EDL to enable low overhead elastic deep learning with a simple API. We present techniques that are necessary to reduce the overhead of parallelism adjustments, such as stop free scaling and dynamic data pipeline. We also demonstrate that EDL can indeed bring significant benefits to the above listed applications in GPU cluster management.


Profinite groups in which many elements have prime power order. The structure of finite and locally finite groups in which every element has prime power order (CP groups) is well known. In this paper we note that the combination of our earlier results with the available information on the structure of finite CP groups yields a detailed description of profinite groups with that property. Then we deal with two generalizations of profinite CP groups. Theorem 1.2. A profinite group G is virtually pro p for some prime p if and only if for each nontrivial x in G there is a prime p (depending on x) such that the centralizer of x is virtually pro p. Theorem 1.3. Let G be a profinite group in which each element has either finite or prime power (possibly infinite) order. Then G is either torsion or virtually pro p for some prime p.


LSTM Networks Can Perform Dynamic Counting. In this paper, we systematically assess the ability of standard recurrent networks to perform dynamic counting and to encode hierarchical representations. All the neural models in our experiments are designed to be small sized networks both to prevent them from memorizing the training sets and to visualize and interpret their behaviour at test time. Our results demonstrate that the Long Short Term Memory (LSTM) networks can learn to recognize the well balanced parenthesis language (Dyck 1 ) and the shuffles of multiple Dyck 1 languages, each defined over different parenthesis pairs, by emulating simple real time k counter machines. To the best of our knowledge, this work is the first study to introduce the shuffle languages to analyze the computational power of neural networks. We also show that a single layer LSTM with only one hidden unit is practically sufficient for recognizing the Dyck 1 language. However, none of our recurrent networks was able to yield a good performance on the Dyck 2 language learning task, which requires a model to have a stack like mechanism for recognition.


Brainstorming about the geometric structures in the Wolfram model of fundamental physics. In this essay, we explore the geometric structures involved in the Wolfram model of fundamental physics. Furthermore, we propose some directions of research aiming to get the bosons and fermions out of this framework.


Absolutely Robust Controllers for Chemical Reaction Networks. In this work, we design a type of controller that consists of adding a specific set of reactions to an existing mass action chemical reaction network in order to control a target species. This set of reactions is effective for both deterministic and stochastic networks, in the latter case controlling the mean as well as the variance of the target species. We employ a type of network property called absolute concentration robustness (ACR). We provide applications to the control of a multisite phosphorylation model as well as a receptor ligand signaling system. For this framework, we use the so called deficiency zero theorem from chemical reaction network theory as well as multiscaling model reduction methods. We show that the target species has approximately Poisson distribution with the desired mean. We further show that ACR controllers can bring robust perfect adaptation to a target species and are complementary to a recently introduced antithetic feedback controller used for stochastic chemical reactions.


ChaLearn Looking at People IsoGD and ConGD Large scale RGB D Gesture Recognition. The ChaLearn large scale gesture recognition challenge has been run twice in two workshops in conjunction with the International Conference on Pattern Recognition (ICPR) 2016 and International Conference on Computer Vision (ICCV) 2017, attracting more than 200 teams round the world. This challenge has two tracks, focusing on isolated and continuous gesture recognition, respectively. This paper describes the creation of both benchmark datasets and analyzes the advances in large scale gesture recognition based on these two datasets. We discuss the challenges of collecting large scale ground truth annotations of gesture recognition, and provide a detailed analysis of the current state of the art methods for large scale isolated and continuous gesture recognition based on RGB D video sequences. In addition to recognition rate and mean jaccard index (MJI) as evaluation metrics used in our previous challenges, we also introduce the corrected segmentation rate (CSR) metric to evaluate the performance of temporal segmentation for continuous gesture recognition. Furthermore, we propose a bidirectional long short term memory (Bi LSTM) baseline method, determining the video division points based on the skeleton points extracted by convolutional pose machine (CPM). Experiments demonstrate that the proposed Bi LSTM outperforms the state of the art methods with an absolute improvement of 8.1 (from 0.8917 to 0.9639 ) of CSR.


PREStO A Systematic Framework for Blockchain Consensus Protocols. The rapid evolution of blockchain technology has brought together stakeholders from fundamentally different backgrounds. The result is a diverse ecosystem, as exemplified by the development of a wide range of different blockchain protocols. This raises questions for decision and policy makers How do different protocols compare? What are their trade offs? Existing efforts to survey the area reveal a fragmented terminology and the lack of a unified framework to reason about the properties of blockchain protocols. In this paper, we work towards bridging this gap. We present a five dimensional design space with a modular structure in which protocols can be compared and understood. Based on these five axes Optimality, Stability, Efficiency, Robustness and Persistence we organize the properties of existing protocols in subcategories of increasing granularity. The result is a dynamic scheme termed the PREStO framework which aids the interaction between stakeholders of different backgrounds, including managers and investors, and which enables systematic reasoning about blockchain protocols. We illustrate its value by comparing existing protocols and identifying research challenges, hence making a first step towards understanding the blockchain ecosystem through a more comprehensive lens.


RTOP A Conceptual and Computational Framework for General Intelligence. A novel general intelligence model is proposed with three types of learning. A unified sequence of the foreground percept trace and the command trace translates into direct and time hop observation paths to form the basis of Raw learning. Raw learning includes the formation of image image associations, which lead to the perception of temporal and spatial relationships among objects and object parts and the formation of image audio associations, which serve as the building blocks of language. Offline identification of similar segments in the observation paths and their subsequent reduction into a common segment through merging of memory nodes leads to Generalized learning. Generalization includes the formation of interpolated sensory nodes for robust and generic matching, the formation of sensory properties nodes for specific matching and superimposition, and the formation of group nodes for simpler logic pathways. Online superimposition of memory nodes across multiple predictions, primarily the superimposition of images on the internal projection canvas, gives rise to Innovative learning and thought. The learning of actions happens the same way as raw learning while the action determination happens through the utility model built into the raw learnings, the utility function being the pleasure and pain of the physical senses.


Branching processes in random environment with immigration stopped at zero. A critical branching process with immigration which evolve in a random environment is considered. Assuming that immigration is not allowed when there are no individuals in the aboriginal population we investigate the tail distribution of the so called life period of the process, i.e., the length of the time interval between the moment when the process is initiated by a positive number of particles and the moment when there are no individuals in the population for the first time.


On the distribution of the maximum of the telegraph process. In this paper we present the distribution of the maximum of the telegraph process in the cases where the initial velocity is positive or negative with an even and an odd number of velocity reversals. For the telegraph process with positive initial velocity a reflection principle is proved to be valid while in the case of an initial leftward displacement the conditional distributions are perturbed by a positive probability of never visiting the half positive axis. Various relationships are established among the mentioned four classes of conditional distributions of the maximum. The unconditional distributions of the maximum of the telegraph process are obtained for positive and negative initial steps as well as their limiting behaviour. Furthermore the cumulative distributions and the general moments of the conditional maximum are presented.


Enhanced x ray emission arising from laser plasma confinement by a strong transverse magnetic field. We analyze, using experiments and 3D MHD numerical simulations, the dynamics and radiative properties of a plasma ablated by a laser (1 ns, 10 12 10 13 W cm 2 ) from a solid target, as it expands into a homogeneous, strong magnetic field (up to 30 T) transverse to its main expansion axis. We find that as soon as 2 ns after the start of the expansion, the plasma becomes constrained by the magnetic field. As the magnetic field strength is increased, more plasma is confined close to the target and is heated by magnetic compression. We also observe a dense slab that rapidly expands into vacuum after 8 ns however, this slab contains only 2 of the total plasma. As a result of the higher density and increased heating of the confined plasma, there is a net enhancement of the total x ray emissivity induced by the magnetization.


The server is dead, long live the server Rise of Serverless Computing, Overview of Current State and Future Trends in Research and Industry. Serverless computing an emerging cloud native paradigm for the deployment of applications and services represents an evolution in cloud application development, programming models, abstractions, and platforms. It promises a real pay as you go billing (with millisecond granularity) with no waste of resources, and lowers the bar for developers by asking them to delegate all their operational complexity and scalability to the cloud provider. Delivering on these promises comes at the expense of restricting functionality. In this article we provide an overview of serverless computing, its evolution, general architecture, key characteristics and uses cases that made it an attractive option for application development. Based on discussions with academics and industry experts during a series of organized serverless computing workshops (WoSC), we also identify the technical challenges and open problems.


Detection of 3D Bounding Boxes of Vehicles Using Perspective Transformation for Accurate Speed Measurement. Detection and tracking of vehicles captured by traffic surveillance cameras is a key component of intelligent transportation systems. We present an improved version of our algorithm for detection of 3D bounding boxes of vehicles, their tracking and subsequent speed estimation. Our algorithm utilizes the known geometry of vanishing points in the surveilled scene to construct a perspective transformation. The transformation enables an intuitive simplification of the problem of detecting 3D bounding boxes to detection of 2D bounding boxes with one additional parameter using a standard 2D object detector. Main contribution of this paper is an improved construction of the perspective transformation which is more robust and fully automatic and an extended experimental evaluation of speed estimation. We test our algorithm on the speed estimation task of the BrnoCompSpeed dataset. We evaluate our approach with different configurations to gauge the relationship between accuracy and computational costs and benefits of 3D bounding box detection over 2D detection. All of the tested configurations run in real time and are fully automatic. Compared to other published state of the art fully automatic results our algorithm reduces the mean absolute speed measurement error by 32 (1.10 km h to 0.75 km h) and the absolute median error by 40 (0.97 km h to 0.58 km h).


Kendall Tau Sequence Distance Extending Kendall Tau from Ranks to Sequences. An edit distance is a measure of the minimum cost sequence of edit operations to transform one structure into another. Edit distance is most commonly encountered within the context of strings, where Wagner and Fischer's string edit distance is perhaps the most well known. However, edit distance is not limited to strings. For example, there are several edit distance measures for permutations, including Wagner and Fischer's string edit distance since a permutation is a special case of a string. However, another edit distance for permutations is Kendall tau distance, which is the number of pairwise element inversions. On permutations, Kendall tau distance is equivalent to an edit distance with adjacent swap as the edit operation. A permutation is often used to represent a total ranking over a set of elements. There exist multiple extensions of Kendall tau distance from total rankings (permutations) to partial rankings (i.e., where multiple elements may have the same rank), but none of these are suitable for computing distance between sequences. We set out to explore extending Kendall tau distance in a different direction, namely from the special case of permutations to the more general case of strings or sequences of elements from some finite alphabet. We name our distance metric Kendall tau sequence distance, and define it as the minimum number of adjacent swaps necessary to transform one sequence into the other. We provide two O(n lg n) algorithms for computing it, and experimentally compare their relative performance. We also provide reference implementations of both algorithms in an open source Java library.


No dimension Tverberg's theorem and its corollaries in Banach spaces of type p . We continue our study of 'no dimension' analogues of basic theorems in combinatorial and convex geometry in Banach spaces. We generalize some results of the paper cite adiprasito2019theorems and prove no dimension versions of colorful Tverberg's theorem, selection lemma and the weak epsilon net theorem in Banach spaces of type p 1. To prove this results we use the original ideas of cite adiprasito2019theorems for the Euclidean case and our slightly modified version of the celebrated Maurey lemma.


Sign non reversal property for totally non negative and totally positive matrices, and testing total positivity of their interval hull. A matrix A is totally positive (or non negative) of order k , denoted TP k (or TN k ), if all minors of size leq k are positive (or non negative). It is well known that such matrices are characterized by the variation diminishing property together with the sign non reversal property. We do away with the former, and show that A is TP k if and only if every submatrix formed from at most k consecutive rows and columns has the sign non reversal property. In fact this can be strengthened to only consider test vectors in mathbb R k with alternating signs. We also show a similar characterization for all TN k matrices more strongly, both of these characterizations use a single vector (with alternating signs) for each square submatrix. These characterizations are novel, and similar in spirit to the fundamental results characterizing TP matrices by Gantmacher Krein Compos. Math. 1937 and P matrices by Gale Nikaido Math. Ann. 1965 . As an application, we study the interval hull mathbb I (A,B) of two m times n matrices A (a ij ) and B (b ij ) . This is the collection of C in mathbb R m times n such that each c ij is between a ij and b ij . Using the sign non reversal property, we identify a two element subset of mathbb I (A,B) that detects the TP k property for all of mathbb I (A,B) for arbitrary k geq 1 . In particular, this provides a test for total positivity (of any order), simultaneously for an entire class of rectangular matrices. In parallel, we also provide a finite set to test the total non negativity (of any order) of an interval hull mathbb I (A,B) .


An IoT Framework for Heart Disease Prediction based on MDCNN Classifier. Nowadays, heart disease is the leading cause of death worldwide. Predicting heart disease is a complex task since it requires experience along with advanced knowledge. Internet of Things (IoT) technology has lately been adopted in healthcare systems to collect sensor values for heart disease diagnosis and prediction. Many researchers have focused on the diagnosis of heart disease, yet the accuracy of the diagnosis results is low. To address this issue, an IoT framework is proposed to evaluate heart disease more accurately using a Modified Deep Convolutional Neural Network (MDCNN). The smartwatch and heart monitor device that is attached to the patient monitors the blood pressure and electrocardiogram (ECG). The MDCNN is utilized for classifying the received sensor data into normal and abnormal. The performance of the system is analyzed by comparing the proposed MDCNN with existing deep learning neural networks and logistic regression. The results demonstrate that the proposed MDCNN based heart disease prediction system performs better than other methods. The proposed method shows that for the maximum number of records, the MDCNN achieves an accuracy of 98.2 which is better than existing classifiers.


Geosocial Location Classification Associating Type to Places Based on Geotagged Social Media Posts. Associating type to locations can be used to enrich maps and can serve a plethora of geospatial applications. An automatic method to do so could make the process less expensive in terms of human labor, and faster to react to changes. In this paper we study the problem of Geosocial Location Classification, where the type of a site, e.g., a building, is discovered based on social media posts. Our goal is to correctly associate a set of messages posted in a small radius around a given location with the corresponding location type, e.g., school, church, restaurant or museum. We explore two approaches to the problem (a) a pipeline approach, where each message is first classified, and then the location associated with the message set is inferred from the individual message labels and (b) a joint approach where the individual messages are simultaneously processed to yield the desired location type. We tested the two approaches over a dataset of geotagged tweets. Our results demonstrate the superiority of the joint approach. Moreover, we show that due to the unique structure of the problem, where weakly related messages are jointly processed to yield a single final label, linear classifiers outperform deep neural network alternatives.


Thermomechanical modelling of ceramic pressing and subsequent sintering. An elastic visco plastic thermomechanical model for the simulation of cold forming and subsequent sintering of ceramic powders is introduced and based on micromechanical modelling of the compaction process of granulates. Micromechanics leads to an upper bound estimate of the compaction curve of a granular material, which compares well with other models and finite element simulations. The parameters of the thermomechanical model are determined on the basis of available data and dilatometer experiments. Finally, after computer implementation, validation of the model is performed against experiments developed on specially designed ceramic pieces, characterized by zones of different density. The mechanical model is found to accurately describe forming and sintering of stoneware ceramics and can therefore be used to analyze and optimize industrial processes involving compaction of powders and subsequent firing of the greens.


On the conformal walk dimension Quasisymmetric uniformization for symmetric diffusions. We introduce the notion of conformal walk dimension, which serves as a bridge between elliptic and parabolic Harnack inequalities. The importance of this notion is due to the fact that, for a given strongly local, regular symmetric Dirichlet space equipped with a complete doubling metric (MMD space), the finiteness of the conformal walk dimension characterizes the elliptic Harnack inequality. Roughly speaking, the conformal walk dimension of an MMD space is defined as the infimum over all possible values of the walk dimension with which the parabolic Harnack inequality can be made to hold by a time change of the associated diffusion and by a quasisymmetric change of the metric. We show that the conformal walk dimension of any MMD space satisfying the elliptic Harnack inequality is two, and provide a necessary condition for a pair of such changes to attain the infimum defining the conformal walk dimension when it is attained for at least one such pair. We also prove a necessary condition for the existence of such a pair attaining the infimum in the setting of a self similar Dirichlet form on a self similar set, and apply it to show that the infimum fails to be attained for the Vicsek set and the N dimensional Sierpi ' n ski gasket with N geq 3 , in contrast to the attainment for the two dimensional Sierpi ' n ski gasket due to Kigami Math. Ann. 340 (2008), no. 4, 781 804 .


Sensors for expert grip force profiling towards benchmarking manual control of a robotic device for surgical tool movements. STRAS (Single access Transluminal Robotic Assistant for Surgeons) is a new robotic system for application to intraluminal surgical procedures. Preclinical testing of STRAS has recently permitted to demonstrate major advantages of the system in comparison with classic procedures. Benchmark methods permitting to establish objective criteria for expertise need to be worked out now to effectively train surgeons on this new system in the near future. STRAS consists of three cable driven subsystems, one endoscope serving as guide, and two flexible instruments. The flexible instruments have three degrees of freedom and can be teleoperated by a single user via two specially designed master interfaces. In this study here, small force sensors sewn into a wearable glove to ergonomically fit the master handles of the robotic system were employed for monitoring the forces applied by an expert and a trainee who was a complete novice during all the steps of surgical task execution in a simulator task, a four step pick and drop. Analysis of gripforce profiles is performed sensor by sensor to bring to the fore specific differences in handgrip force profiles in specific sensor locations on anatomically relevant parts of the fingers and hand controlling the master slave system.


BGM Building a Dynamic Guidance Map without Visual Images for Trajectory Prediction. Visual images usually contain the informative context of the environment, thereby helping to predict agents' behaviors. However, they hardly impose the dynamic effects on agents' actual behaviors due to the respectively fixed semantics. To solve this problem, we propose a deterministic model named BGM to construct a guidance map to represent the dynamic semantics, which circumvents to use visual images for each agent to reflect the difference of activities in different periods. We first record all agents' activities in the scene within a period close to the current to construct a guidance map and then feed it to a Context CNN to obtain their context features. We adopt a Historical Trajectory Encoder to extract the trajectory features and then combine them with the context feature as the input of the social energy based trajectory decoder, thus obtaining the prediction that meets the social rules. Experiments demonstrate that BGM achieves state of the art prediction accuracy on the two widely used ETH and UCY datasets and handles more complex scenarios.


Minimizing cones for fractional capillarity problems. We consider a fractional version of Gauss capillarity energy. A suitable extension problem is introduced to derive a boundary monotonicity formula for local minimizers of this fractional capillarity energy. As a consequence, blow up limits of local minimizers are shown to subsequentially converge to minimizing cones. Finally, we show that in the planar case there is only one possible fractional minimizing cone, the one determined by the fractional version of Young's law.


Deep Reinforcement Learning based Local Planner for UAV Obstacle Avoidance using Demonstration Data. In this paper, a deep reinforcement learning (DRL) method is proposed to address the problem of UAV navigation in an unknown environment. However, DRL algorithms are limited by the data efficiency problem as they typically require a huge amount of data before they reach a reasonable performance. To speed up the DRL training process, we developed a novel learning framework which combines imitation learning and reinforcement learning and building upon Twin Delayed DDPG (TD3) algorithm. We newly introduced both policy and Q value network are learned using the expert demonstration during the imitation phase. To tackle the distribution mismatch problem transfer from imitation to reinforcement learning, both TD error and decayed imitation loss are used to update the pre trained network when start interacting with the environment. The performances of the proposed algorithm are demonstrated on the challenging 3D UAV navigation problem using depth cameras and sketched in a variety of simulation environments.


MiNet Mixed Interest Network for Cross Domain Click Through Rate Prediction. Click through rate (CTR) prediction is a critical task in online advertising systems. Existing works mainly address the single domain CTR prediction problem and model aspects such as feature interaction, user behavior history and contextual information. Nevertheless, ads are usually displayed with natural content, which offers an opportunity for cross domain CTR prediction. In this paper, we address this problem and leverage auxiliary data from a source domain to improve the CTR prediction performance of a target domain. Our study is based on UC Toutiao (a news feed service integrated with the UC Browser App, serving hundreds of millions of users daily), where the source domain is the news and the target domain is the ad. In order to effectively leverage news data for predicting CTRs of ads, we propose the Mixed Interest Network (MiNet) which jointly models three types of user interest 1) long term interest across domains, 2) short term interest from the source domain and 3) short term interest in the target domain. MiNet contains two levels of attentions, where the item level attention can adaptively distill useful information from clicked news ads and the interest level attention can adaptively fuse different interest representations. Offline experiments show that MiNet outperforms several state of the art methods for CTR prediction. We have deployed MiNet in UC Toutiao and the A B test results show that the online CTR is also improved substantially. MiNet now serves the main ad traffic in UC Toutiao.


CAiRE HKUST at SemEval 2019 Task 3 Hierarchical Attention for Dialogue Emotion Classification. Detecting emotion from dialogue is a challenge that has not yet been extensively surveyed. One could consider the emotion of each dialogue turn to be independent, but in this paper, we introduce a hierarchical approach to classify emotion, hypothesizing that the current emotional state depends on previous latent emotions. We benchmark several feature based classifiers using pre trained word and emotion embeddings, state of the art end to end neural network models, and Gaussian processes for automatic hyper parameter search. In our experiments, hierarchical architectures consistently give significant improvements, and our best model achieves a 76.77 F1 score on the test set.


SocialIQA Commonsense Reasoning about Social Interactions. We introduce Social IQa, the first largescale benchmark for commonsense reasoning about social situations. Social IQa contains 38,000 multiple choice questions for probing emotional and social intelligence in a variety of everyday situations (e.g., Q "Jordan wanted to tell Tracy a secret, so Jordan leaned towards Tracy. Why did Jordan do this?" A "Make sure no one else could hear"). Through crowdsourcing, we collect commonsense questions along with correct and incorrect answers about social interactions, using a new framework that mitigates stylistic artifacts in incorrect answers by asking workers to provide the right answer to a different but related question. Empirical results show that our benchmark is challenging for existing question answering models based on pretrained language models, compared to human performance ( 20 gap). Notably, we further establish Social IQa as a resource for transfer learning of commonsense knowledge, achieving state of the art performance on multiple commonsense reasoning tasks (Winograd Schemas, COPA).


Relatively Projectivity and the Green correspondence for complexes. We investigate a version of the Green correspondence for categories of complexes, including homotopy categories and derived categories. The correspondence is an equivalence between a category defined over a finite group G and the same for a subgroup H , often the normalizer of a p subgroup of G . We present a basic formula for deciding when categories of modules or complexes have a Green correspondence and apply it to many examples. In several cases the equivalence is an equivalence of triangulated categories, and in special cases it is an equivalence of tensor triangulated categories.


Weak formulation of the MTW condition and convexity properties of potentials. We simplify the geometric interpretation of the weak Ma Trudinger Wang condition for regularity in optimal transportation and provide a geometric proof of the global c convexity of locally c convex potentials when the cost function c is only assumed twice differentiable.


A generalisation of Seymour's second neighbourhood conjecture. In this note we propose a generalisation of Seymour's Second Neighbourhood Conjecture to two directed graphs on a vertex set. We prove that this generalisation holds in the case of tournaments, and we show that a natural strengthening of this conjecture does not hold.


Schur ring and Codes for S subgroups over Z 2 n . In this paper the relationship between S subgroups in Z 2 n and binary codes is shown. If the codes used are both P(T) codes and G codes, then the S subgroup is free. The codes constructed are cyclic, decimated or symmetric and the S subgroups obtained are free under the action the cyclic permutation subgroup, invariants under the action the decimated permutation subgroup and symmetric under the action of symmetric permutation subgroup, respectively. Also it is shows that there is no codes generating whole Z 2 n in any G n (a) complete S set of the S ring mathfrak S ( Z 2 n ,S n ) .


Online Alternate Generator against Adversarial Attacks. The field of computer vision has witnessed phenomenal progress in recent years partially due to the development of deep convolutional neural networks. However, deep learning models are notoriously sensitive to adversarial examples which are synthesized by adding quasi perceptible noises on real images. Some existing defense methods require to re train attacked target networks and augment the train set via known adversarial attacks, which is inefficient and might be unpromising with unknown attack types. To overcome the above issues, we propose a portable defense method, online alternate generator, which does not need to access or modify the parameters of the target networks. The proposed method works by online synthesizing another image from scratch for an input image, instead of removing or destroying adversarial noises. To avoid pretrained parameters exploited by attackers, we alternately update the generator and the synthesized image at the inference stage. Experimental results demonstrate that the proposed defensive scheme and method outperforms a series of state of the art defending models against gray box adversarial attacks.


CAN NER Convolutional Attention Network for Chinese Named Entity Recognition. Named entity recognition (NER) in Chinese is essential but difficult because of the lack of natural delimiters. Therefore, Chinese Word Segmentation (CWS) is usually considered as the first step for Chinese NER. However, models based on word level embeddings and lexicon features often suffer from segmentation errors and out of vocabulary (OOV) words. In this paper, we investigate a Convolutional Attention Network called CAN for Chinese NER, which consists of a character based convolutional neural network (CNN) with local attention layer and a gated recurrent unit (GRU) with global self attention layer to capture the information from adjacent characters and sentence contexts. Also, compared to other models, not depending on any external resources like lexicons and employing small size of char embeddings make our model more practical. Extensive experimental results show that our approach outperforms state of the art methods without word embedding and external lexicon resources on different domain datasets including Weibo, MSRA and Chinese Resume NER dataset.


An Optimality Gap Test for a Semidefinite Relaxation of a Quadratic Program with Two Quadratic Constraints. We propose a necessary and sufficient test to determine whether a solution for a general quadratic program with two quadratic constraints (QC2QP) can be computed from that of a specific convex semidefinite relaxation, in which case we say that there is no optimality gap. Originally intended to solve a nonconvex optimal control problem, we consider the case in which the cost and both constraints of the QC2QP may be nonconvex. We obtained our test, which also ascertains when strong duality holds, by generalizing a closely related method by Ai and Zhang. An extension was necessary because, while the method proposed by Ai and Zhang also allows for two quadratic constraints, it requires that at least one is strictly convex. In order to illustrate the usefulness of our test, we applied it to two examples that do not satisfy the assumptions required by prior methods. Our test guarantees that there is no optimality gap for the first example a solution is also computed from the relaxation and we used it to establish that an optimality gap exists in the second.


Control of the Bilinear Indicator Cube Testing property. We show that the alpha fractional Bilinear Indicator Cube Testing Constant arising in arXiv 1906.05602 is controlled by the classical fractional Muckenhoupt constant, provided the product measure sigma x omega is diagonally reverse doubling (in particular if it is reverse doubling) with exponent exceeding 2(n alpha ). Moreover, this control is sharp within the class of diagonally reverse doubling product measures. When combined with the main results in arXiv 1906.05602, 1907.07571 and 1907.10734, the above control of BICT T alpha for alpha 0 yields a two weight T1 theorem for doubling weights with appropriate diagonal reverse doubling, i.e. the norm inequality for T alpha is controlled by cube testing constants and the alpha fractional one tailed Muckenhoupt constants (without any energy assumptions), and also yields a corresponding cancellation condition theorem for the kernel of T alpha , both of which hold for arbitrary alpha fractional Calder 'on Zygmund operators T alpha . We do not know if the analogous result for BICT H ( sigma , omega ) holds for the Hilbert transform H in case alpha 0, but we show that BICT H dy ( sigma , omega ) is not controlled by the Muckenhoupt condition for the dyadic Hilbert transform H dy and doubling weights sigma , omega .


Have convolutions already made recurrence obsolete for unconstrained handwritten text recognition ?. Unconstrained handwritten text recognition remains an important challenge for deep neural networks. These last years, recurrent networks and more specifically Long Short Term Memory networks have achieved state of the art performance in this field. Nevertheless, they are made of a large number of trainable parameters and training recurrent neural networks does not support parallelism. This has a direct influence on the training time of such architectures, with also a direct consequence on the time required to explore various architectures. Recently, recurrence free architectures such as Fully Convolutional Networks with gated mechanisms have been proposed as one possible alternative achieving competitive results. In this paper, we explore convolutional architectures and compare them to a CNN BLSTM baseline. We propose an experimental study regarding different architectures on an offline handwriting recognition task using the RIMES dataset, and a modified version of it that consists of augmenting the images with notebook backgrounds that are printed grids.


A novel energy factorization approach for the diffuse interface model with Peng Robinson equation of state. The Peng Robinson equation of state (PR EoS) has become one of the most extensively applied equations of state in chemical engineering and petroleum industry due to its excellent accuracy in predicting the thermodynamic properties of a wide variety of materials, especially hydrocarbons. Although great efforts have been made to construct efficient numerical methods for the diffuse interface models with PR EoS, there is still not a linear numerical scheme that can be proved to preserve the original energy dissipation law. In order to pursue such a numerical scheme, we propose a novel energy factorization (EF) approach, which first factorizes an energy function into a product of several factors and then treats the factors using their properties to obtain the semi implicit linear schemes. We apply the EF approach to deal with the Helmholtz free energy density determined by PR EoS, and then propose a linear semi implicit numerical scheme that inherits the original energy dissipation law. Moreover, the proposed scheme is proved to satisfy the maximum principle in both the time semi discrete form and the cell centered finite difference fully discrete form under certain conditions. Numerical results are presented to demonstrate the stability and efficiency of the proposed scheme.


Behavioral gender differences are reinforced during the COVID 19 crisis. Behavioral gender differences are known to exist for a wide range of human activities including the way people communicate, move, provision themselves, or organize leisure activities. Using mobile phone data from 1.2 million devices in Austria (15 of the population) across the first phase of the COVID 19 crisis, we quantify gender specific patterns of communication intensity, mobility, and circadian rhythms. We show the resilience of behavioral patterns with respect to the shock imposed by a strict nation wide lock down that Austria experienced in the beginning of the crisis with severe implications on public and private life. We find drastic differences in gender specific responses during the different phases of the pandemic. After the lock down gender differences in mobility and communication patterns increased massively, while sleeping patterns and circadian rhythms tend to synchronize. In particular, women had fewer but longer phone calls than men during the lock down. Mobility declined massively for both genders, however, women tend to restrict their movement stronger than men. Women showed a stronger tendency to avoid shopping centers and more men frequented recreational areas. After the lock down, males returned back to normal quicker than women young age cohorts return much quicker. Differences are driven by the young and adolescent population. An age stratification highlights the role of retirement on behavioral differences. We find that the length of a day of men and women is reduced by one hour. We discuss the findings in the light of gender specific coping strategies in response to stress and crisis.


VID Fusion Robust Visual Inertial Dynamics Odometry for Accurate External Force Estimation. Recently, quadrotors are gaining significant attention in aerial transportation and delivery. In these scenarios, an accurate estimation of the external force is as essential as the 6 degree of freedom (DoF) pose since it is of vital importance for planning and control of the vehicle. To this end, we propose a tightly coupled Visual Inertial Dynamics (VID) system that simultaneously estimates the external force applied to the quadrotor along with the 6 DoF pose. Our method builds on the state of the art optimization based Visual Inertial system, with a novel deduction of the dynamics and external force factor extended from VIMO. Utilizing the proposed dynamics and external force factor, our estimator robustly and accurately estimates the external force even when it varies widely. Moreover, since we explicitly consider the influence of the external force, when compared with VIMO and VINS Mono, our method shows comparable and superior pose accuracy, even when the external force ranges from neglectable to significant. The robustness and effectiveness of the proposed method are validated by extensive real world experiments and application scenario simulation. We will release an open source package of this method along with datasets with ground truth force measurements for the reference of the community.


Multi Type Mean Field Reinforcement Learning. Mean field theory provides an effective way of scaling multiagent reinforcement learning algorithms to environments with many agents that can be abstracted by a virtual mean agent. In this paper, we extend mean field multiagent algorithms to multiple types. The types enable the relaxation of a core assumption in mean field reinforcement learning, which is that all agents in the environment are playing almost similar strategies and have the same goal. We conduct experiments on three different testbeds for the field of many agent reinforcement learning, based on the standard MAgents framework. We consider two different kinds of mean field environments a) Games where agents belong to predefined types that are known a priori and b) Games where the type of each agent is unknown and therefore must be learned based on observations. We introduce new algorithms for each type of game and demonstrate their superior performance over state of the art algorithms that assume that all agents belong to the same type and other baseline algorithms in the MAgent framework.


Analysis of sparse grid multilevel estimators for multi dimensional Zakai equations. In this article, we analyse the accuracy and computational complexity of estimators for expected functionals of the solution to multi dimensional parabolic stochastic partial differential equations (SPDE) of Zakai type. Here, we use the Milstein scheme for time integration and an alternating direction implicit (ADI) splitting of the spatial finite difference discretisation, coupled with the sparse grid combination technique and multilevel Monte Carlo sampling (MLMC). In the two dimensional case, we find by detailed Fourier analysis that for a root mean square error (RMSE) varepsilon , MLMC on sparse grids has the optimal complexity O( varepsilon 2 ) , whereas MLMC on regular grids has O( varepsilon 2 ( log varepsilon) 2) , standard MC on sparse grids O( varepsilon 7 2 ( log varepsilon ) 5 2 ) , and MC on regular grids O( varepsilon 4 ) . Numerical tests confirm these findings empirically. We give a discussion of the higher dimensional setting without detailed proofs, which suggests that MLMC on sparse grids always leads to the optimal complexity, standard MC on sparse grids has a fixed complexity order independent of the dimension (up to a logarithmic term), whereas the cost of MLMC and MC on regular grids increases exponentially with the dimension.


Hardy fields, the intermediate value property, and omega freeness. We discuss the conjecture that every maximal Hardy field has the Intermediate Value Property for differential polynomials, and its equivalence to the statement that all maximal Hardy field are elementarily equivalent to the differential field of transseries. As a modest but essential step towards establishing the conjecture we show that every maximal Hardy field is omega free.


Detecting Human Object Interactions via Functional Generalization. We present an approach for detecting human object interactions (HOIs) in images, based on the idea that humans interact with functionally similar objects in a similar manner. The proposed model is simple and efficiently uses the data, visual features of the human, relative spatial orientation of the human and the object, and the knowledge that functionally similar objects take part in similar interactions with humans. We provide extensive experimental validation for our approach and demonstrate state of the art results for HOI detection. On the HICO Det dataset our method achieves a gain of over 2.5 absolute points in mean average precision (mAP) over state of the art. We also show that our approach leads to significant performance gains for zero shot HOI detection in the seen object setting. We further demonstrate that using a generic object detector, our model can generalize to interactions involving previously unseen objects.


A Progressive Sub Network Searching Framework for Dynamic Inference. Many techniques have been developed, such as model compression, to make Deep Neural Networks (DNNs) inference more efficiently. Nevertheless, DNNs still lack excellent run time dynamic inference capability to enable users trade off accuracy and computation complexity (i.e., latency on target hardware) after model deployment, based on dynamic requirements and environments. Such research direction recently draws great attention, where one realization is to train the target DNN through a multiple term objective function, which consists of cross entropy terms from multiple sub nets. Our investigation in this work show that the performance of dynamic inference highly relies on the quality of sub net sampling. With objective to construct a dynamic DNN and search multiple high quality sub nets with minimal searching cost, we propose a progressive sub net searching framework, which is embedded with several effective techniques, including trainable noise ranking, channel group and fine tuning threshold setting, sub nets re selection. The proposed framework empowers the target DNN with better dynamic inference capability, which outperforms prior works on both CIFAR 10 and ImageNet dataset via comprehensive experiments on different network structures. Taken ResNet18 as an example, our proposed method achieves much better dynamic inference accuracy compared with prior popular Universally Slimmable Network by 4.4 maximally and 2.3 averagely in ImageNet dataset with the same model size.


Wavefront errors in a two beam interferometer. The paper deals with the impact of wavefront errors, due to the optical aberrations of a two beam interferometer, on the period of the travelling fringe observed by integrating the interference pattern. A Monte Carlo simulation of the interferometer operation showed that the fringe period estimate is unbiased if evaluated on the basis of the angular spectrum of the beam entering the interferometer, but the wavefront errors increase the uncertainty.


Consecutive primes in short intervals. We obtain a lower bound for x 2 p n leq x p n equiv ldots equiv p n m equiv a text (mod q ) , p n m p n leq y , where p n is the n text th prime.


Brownian Aspects of the KPZ Fixed Point. The Kardar Parisi Zhang (KPZ) fixed point is a Markov process that is conjectured to be at the core of the KPZ universality class. In this article we study two aspects the KPZ fixed point that share the same Brownian limiting behaviour the local space regularity and the long time evolution. Most of the results that we will present here were obtained by either applying explicit formulas for the transition probabilities or applying the coupling method to discrete approximations. Instead we will use the variational description of the KPZ fixed point, allowing us the possibility of running the process starting from different initial data (basic coupling), to prove directly the aforementioned limiting behaviours.


Heterogeneous Coded Distributed Computing Joint Design of File Allocation and Function Assignment. This paper studies the computation communication tradeoff in a heterogeneous MapReduce computing system where each distributed node is equipped with different computation capability. We first obtain an achievable communication load for any given computation load and any given function assignment at each node. The proposed file allocation strategy has two steps first, the input files are partitioned into disjoint batches, each with possibly different size and computed by a distinct node then, each node computes additional files from its non computed files according to its redundant computation capability. In the Shuffle phase, coded multicasting opportunities are exploited thanks to the repetitive file allocation among different nodes. Based on this scheme, we further propose the computation aware and the shuffle aware function assignments. We prove that, by using proper function assignments, our achievable communication load for any given computation load is within a constant multiplicative gap to the optimum in an equivalent homogeneous system with the same average computation load. Numerical results show that our scheme with shuffle aware function assignment achieves better computation communication tradeoff than existing works in some cases.


Cooperative versus decentralized strategies in three pursuer single evader games. The value of cooperation in pursuit evasion games is investigated. The considered setting is that of three pursuers chasing one evader in a planar environment. The optimal evader trajectory for a well known decentralized pursuer strategy is characterized. This result is instrumental to derive upper and lower bounds to the game length, in the case in which the pursuers cooperate in the chasing strategy. It is shown that the cooperation cannot reduce the capture time by more than one half with respect to the decentralized case, and that such bound is tight.


Constrained Online Learning to Mitigate Distortion Effects in Pulse Agile Cognitive Radar. Pulse agile radar systems have demonstrated favorable performance in dynamic electromagnetic scenarios. However, the use of non identical waveforms within a radar's coherent processing interval may lead to harmful distortion effects when pulse Doppler processing is used. This paper presents an online learning framework to optimize detection performance while mitigating harmful sidelobe levels. The radar waveform selection process is formulated as a linear contextual bandit problem, within which waveform adaptations which exceed a tolerable level of expected distortion are eliminated. The constrained online learning approach is effective and computationally feasible, evidenced by simulations in a radar communication coexistence scenario and in the presence of intentional adaptive jamming. This approach is applied to both stochastic and adversarial contextual bandit learning models and the detection performance in dynamic scenarios is evaluated.


Quantitative decompositions of Lipschitz mappings into metric spaces. We study the quantitative properties of Lipschitz mappings from Euclidean spaces into metric spaces. We prove that it is always possible to decompose the domain of such a mapping into pieces on which the mapping "behaves like a projection mapping" along with a "garbage set" that is arbitrarily small in an appropriate sense. Moreover, our control is quantitative, i.e., independent of both the particular mapping and the metric space it maps into. This improves a theorem of Azzam Schul from the paper "Hard Sard", and answers a question left open in that paper. The proof uses ideas of quantitative differentiation, as well as a detailed study of how to supplement Lipschitz mappings by additional coordinates to form bi Lipschitz mappings.


Equivariant annular Khovanov homology. We construct an equivariant version of annular Khovanov homology via the Frobenius algebra associated with U(1) times U(1) equivariant cohomology of mathbb CP 1 . Motivated by the relationship between the Temperley Lieb algebra and annular Khovanov homology, we also introduce an equivariant analogue of the Temperley Lieb algebra.


The Douglas Rachford Algorithm Converges Only Weakly. We show that the weak convergence of the Douglas Rachford algorithm for finding a zero of the sum of two maximally monotone operators cannot be improved to strong convergence. Likewise, we show that strong convergence can fail for the method of partial inverses.


On the cardinality of sets in bf R d obeying a slightly obtuse angle bound. In this paper we explicitly estimate the number of points in a subset A subset R d as a function of the maximum angle angle A that any three of these points form, provided angle A theta d arccos( frac 1 d ) in ( pi 2, pi) . We also show angle A theta d ensures that A coincides with the vertex set of a convex polytope. This study is motivated by a question of Paul Erd H o s and indirectly by a conjecture of L 'aszl 'o Fejes T 'oth.


Ramsey's theorem for pairs, collection, and proof size. We prove that any proof of a forall Sigma 0 2 sentence in the theory mathrm WKL 0 mathrm RT 2 2 can be translated into a proof in mathrm RCA 0 at the cost of a polynomial increase in size. In fact, the proof in mathrm RCA 0 can be found by a polynomial time algorithm. On the other hand, mathrm RT 2 2 has non elementary speedup over the weaker base theory mathrm RCA 0 for proofs of Sigma 1 sentences. We also show that for n ge 0 , proofs of Pi n 2 sentences in mathrm B Sigma n 1 exp can be translated into proofs in mathrm I Sigma n exp at polynomial cost. Moreover, the Pi n 2 conservativity of mathrm B Sigma n 1 exp over mathrm I Sigma n exp can be proved in mathrm PV , a fragment of bounded arithmetic corresponding to polynomial time computation. For n ge 1 , this answers a question of Clote, H 'ajek, and Paris.


A Closer Look at the Tropical Cryptography. We examine two public key exchange protocols proposed recently by Grigoriev and Shpilrain (arXiv 1811.06386), which use tropical algebra. We introduce a fast attack on the first protocol, and we show that the second protocol cannot be implemented as described.


A Reynolds robust preconditioner for the Scott Vogelius discretization of the stationary incompressible Navier Stokes equations. Augmented Lagrangian preconditioners have successfully yielded Reynolds robust preconditioners for the stationary incompressible Navier Stokes equations, but only for specific discretizations. The discretizations for which these preconditioners have been designed possess error estimates which depend on the Reynolds number, with the discretization error deteriorating as the Reynolds number is increased. In this paper we present an augmented Lagrangian preconditioner for the Scott Vogelius discretization on barycentrically refined meshes. This achieves both Reynolds robust performance and Reynolds robust error estimates. A key consideration is the design of a suitable space decomposition that captures the kernel of the grad div term added to control the Schur complement the same barycentric refinement that guarantees inf sup stability also provides a local decomposition of the kernel of the divergence. The robustness of the scheme is confirmed by numerical experiments in two and three dimensions.


Stochastic Graphon Games I. The Static Case. We consider static finite player network games and their continuum analogs, graphon games. Existence and uniqueness results are provided, as well as convergence of the finite player network game optimal strategy profiles to their analogs for the graphon games. We also show that equilibrium strategy profiles of a graphon game provide approximate Nash equilibria for the finite player games. Connections with mean field games and central planner optimization problems are discussed. Motivating applications are presented and explicit computations of their Nash equilibria and social optimal strategies are provided.


Detect Camouflaged Spam Content via StoneSkipping Graph and Text Joint Embedding for Chinese Character Variation Representation. The task of Chinese text spam detection is very challenging due to both glyph and phonetic variations of Chinese characters. This paper proposes a novel framework to jointly model Chinese variational, semantic, and contextualized representations for Chinese text spam detection task. In particular, a Variation Family enhanced Graph Embedding (VFGE) algorithm is designed based on a Chinese character variation graph. The VFGE can learn both the graph embeddings of the Chinese characters (local) and the latent variation families (global). Furthermore, an enhanced bidirectional language model, with a combination gate function and an aggregation learning function, is proposed to integrate the graph and text information while capturing the sequential information. Extensive experiments have been conducted on both SMS and review datasets, to show the proposed method outperforms a series of state of the art models for Chinese spam detection.


Asynchronous Byzantine Approximate Consensus in Directed Networks. In this work, we study the approximate consensus problem in asynchronous message passing networks where some nodes may become Byzantine faulty. We answer an open problem raised by Tseng and Vaidya, 2012, proposing the first algorithm of optimal resilience for directed networks. Interestingly, our results show that the tight condition on the underlying communication networks for asynchronous Byzantine approximate consensus coincides with the tight condition for synchronous Byzantine exact consensus. Our results can be viewed as a non trivial generalization of the algorithm by Abraham et al., 2004, which applies to the special case of complete networks. The tight condition and techniques identified in the paper shed light on the fundamental properties for solving approximate consensus in asynchronous directed networks.


Sampling Arbitrary Subgraphs Exactly Uniformly in Sublinear Time. We present a simple sublinear time algorithm for sampling an arbitrary subgraph H emph exactly uniformly from a graph G with m edges, to which the algorithm has access by performing the following types of queries (1) degree queries, (2) neighbor queries, (3) pair queries and (4) edge sampling queries. The query complexity and running time of our algorithm are tilde O ( min m, frac m rho(H) H ) and tilde O ( frac m rho(H) H ) , respectively, where rho(H) is the fractional edge cover of H and H is the number of copies of H in G . For any clique on r vertices, i.e., H K r , our algorithm is almost optimal as any algorithm that samples an H from any distribution that has Omega(1) total probability mass on the set of all copies of H must perform Omega( min m, frac m rho(H) H cdot (cr) r ) queries. Together with the query and time complexities of the (1 pm varepsilon) approximation algorithm for the number of subgraphs H by Assadi, Kapralov and Khanna ITCS 2018 and the lower bound by Eden and Rosenbaum APPROX 2018 for approximately counting cliques, our results suggest that in our query model, approximately counting cliques is "equivalent to" exactly uniformly sampling cliques, in the sense that the query and time complexities of exactly uniform sampling and randomized approximate counting are within a polylogarithmic factor of each other. This stands in interesting contrast to an analogous relation between approximate counting and almost uniformly sampling for self reducible problems in the polynomial time regime by Jerrum, Valiant and Vazirani TCS 1986 .


Eraser morphisms and membership problem in groups and monoids. We develop the theory of fragile words by introducing the concept of eraser morphism and extending the concept to more general contexts such as (free) inverse monoids. We characterize the image of the eraser morphism in the free group case, and show that it has decidable membership problem. We establish several algorithmic properties of the class of finite cal J above (inverse) monoids. We prove that the image of the eraser morphism in the free inverse monoid case (and more generally, in the finite cal J above case) has decidable membership problem, and relate its kernel to the free group fragile words.


Computing singularities of the spectra of representation rings of finite groups. Let G be a finite group of order n , and xi an n th primitive root of unity. Consider the affine scheme C mbox Spc ( mathbb Z xi otimes mathbb Z R(G)) where R(G) is the representation ring of G . We study the fibers of the formal tangent sheaf of C by computing their dimension and also finding (and measuring) the singularities of C . We present explicit computations for noncommutative groups of small order, and develop practical methods to compute these invariants for an arbitrary finite group.


Detection of Genuine and Posed Facial Expressions of Emotion A Review. Facial expressions of emotion play an important role in human social interactions. However, posed acting is not always the same as genuine feeling. Therefore, the credibility assessment of facial expressions, namely, the discrimination of genuine (spontaneous) expressions from posed(deliberate volitional deceptive) ones, is a crucial yet challenging task in facial expression understanding. Rapid progress has been made in recent years for automatic detection of genuine and posed facial expressions. This paper presents a general review of the relevant research, including several spontaneous vs. posed (SVP) facial expression databases and various computer vision based detection methods. In addition, a variety of factors that will influence the performance of SVP detection methods are discussed along with open issues and technical challenges.


Free potential functions. We show that the derivative of a noncommutative free analytic map must be free curl free an analog of having zero curl. Moreover, under the assumption that the free domain is connected, this necessary condition is sufficient. Specifically, if T is analytic free demilinear (linear in half its variables) map defined on a connected free domain then DT(X,H) K,0 DT(X,K) H,0 if and only if there exists an analytic free map f such that Df(X) H T(X,H) .


Lambda coalescents arising in populations with dormancy. Consider a population evolving from year to year through three seasons spring, summer and winter. Every spring starts with N dormant individuals waking up independently of each other according to a given distribution. Once an individual is awake, it starts reproducing at a constant rate. By the end of spring, all individuals are awake and continue reproducing independently as Yule processes during the whole summer. In the winter, N individuals chosen uniformly at random go to sleep until the next spring, and the other individuals die. We show that because an individual that wakes up unusually early can have a large number of surviving descendants, for some choices of model parameters the genealogy of the population will be described by a Lambda coalescent. In particular, the beta coalescent can describe the genealogy when the rate at which individuals wake up increases exponentially over time. We also characterize the set of all Lambda coalescents that can arise in this framework.


Is vortex stretching the main cause of the turbulent energy cascade?. In three dimensional turbulence there is on average a cascade of kinetic energy from the largest to the smallest scales of the flow. While the dominant idea is that the cascade occurs through the physical process of vortex stretching, evidence for this is debated. In the framework of the Karman Howarth equation for the two point turbulent kinetic energy, we derive a new result for the average flux of kinetic energy between two points in the flow that reveals the role of vortex stretching. However, the result shows that vortex stretching is in fact not the main contributor to the average energy cascade the main contributor is the self amplification of the strain rate field. We emphasize the need to correctly distinguish and not conflate the roles of vortex stretching and strain self amplification in order to correctly understand the physics of the cascade, and also resolve a paradox regarding the differing role of vortex stretching on the mechanisms of the energy cascade and energy dissipation rate. Direct numerical simulations are used to confirm the results, as well as provide further results and insights on vortex stretching and strain self amplification at different scales in the flow. Interestingly, the results imply that while vortex stretching plays a sub leading role in the average cascade, it may play a leading order role during large fluctuations of the energy cascade about its average behavior.


Irregularly Tabulated MLP for Fast Point Feature Embedding. Aiming at drastic speedup for point feature embeddings at test time, we propose a new framework that uses a pair of multi layer perceptrons (MLP) and a lookup table (LUT) to transform point coordinate inputs into high dimensional features. When compared with PointNet's feature embedding part realized by MLP that requires millions of dot products, the proposed framework at test time requires no such layers of matrix vector products but requires only looking up the nearest entities from the tabulated MLP followed by interpolation, defined over discrete inputs on a 3D lattice that is substantially arranged irregularly. We call this framework LUTI MLP LUT Interpolation ML that provides a way to train end to end irregularly tabulated MLP coupled to a LUT in a specific manner without the need for any approximation at test time. LUTI MLP also provides significant speedup for Jacobian computation of the embedding function wrt global pose coordinate on Lie algebra mathfrak se (3) at test time, which could be used for point set registration problems. After extensive evaluation using the ModelNet40, we confirmed that the LUTI MLP even with a small (e.g., 4 3 ) lattice yields performance comparable to that of the MLP while achieving significant speedup 100 times for the embedding, 12 times for the approximate Jacobian, and 860 times for the canonical Jacobian.


An integral model of the perfectoid modular curve. We construct an integral model of the perfectoid modular curve. Studying this object, we prove some vanishing results for the coherent cohomology at perfectoid level. We use a local duality theorem at finite level to compute duals for the coherent cohomology of the integral perfectoid curve. Specializing to the structural sheaf, we can describe the dual of the completed cohomology as the inverse limit of the integral cusp forms of weight 2 and trace maps.


The Spectral Theorem for Quaternionic Normal Operators. Let mathcal H be a right quaternionic Hilbert space and let T be a bounded normal right quaternionic linear operator on mathcal H . In this paper, we prove that there exists a unique spectral measure E in mathcal H such that T int sigma S(T) lambda dE lambda, where sigma S(T) denotes the spherical spectrum of T .


CaCL Class aware Codebook Learning for Weakly Supervised Segmentation on Diffuse Image Patterns. Weakly supervised learning has been rapidly advanced in biomedical image analysis to achieve pixel wise labels (segmentation) from image wise annotations (classification), as biomedical images naturally contain image wise labels in many scenarios. The current weakly supervised learning algorithms from the computer vision community are largely designed for focal objects (e.g., dogs and cats). However, such algorithms are not optimized for diffuse patterns in biomedical imaging (e.g., stains and fluorescence in microscopy imaging). In this paper, we propose a novel class aware codebook learning (CaCL) algorithm to perform weakly supervised learning for diffuse image patterns. Specifically, the CaCL algorithm is deployed to segment protein expressed brush border regions from histological images of human duodenum. Our contribution is three fold (1) we approach the weakly supervised segmentation from a novel codebook learning perspective (2) the CaCL algorithm segments diffuse image patterns rather than focal objects and (3) the proposed algorithm is implemented in a multi task framework based on Vector Quantised Variational AutoEncoder (VQ VAE) via joint image reconstruction, classification, feature embedding, and segmentation. The experimental results show that our method achieved superior performance compared with baseline weakly supervised algorithms. The code is available at https github.com ddrrnn123 CaCL.


Fair Integral Submodular Flows. Integer valued elements of an integral submodular flow polyhedron Q are investigated which are decreasingly minimal (dec min) in the sense that their largest component is as small as possible, within this, the second largest component is as small as possible, and so on. As a main result, we prove that the set of dec min integral elements of Q is the set of integral elements of another integral submodular flow polyhedron arising from Q by intersecting a face of Q with a box. Based on this description, we develop a strongly polynomial algorithm for computing not only a dec min integer valued submodular flow but even a cheapest one with respect to a linear cost function. A special case is the problem of finding a strongly connected (or k edge connected) orientation of a mixed graph whose in degree vector is decreasingly minimal.


Privacy Preservation for Wireless Sensor Networks in Healthcare State of the Art, and Open Research Challenges. The advent of miniature biosensors has generated numerous opportunities for deploying wireless sensor networks in healthcare. However, an important barrier is that acceptance by healthcare stakeholders is influenced by the effectiveness of privacy safeguards for personal and intimate information which is collected and transmitted over the air, within and beyond these networks. In particular, these networks are progressing beyond traditional sensors, towards also using multimedia sensors, which raise further privacy concerns. Paradoxically, less research has addressed privacy protection, compared to security. Nevertheless, privacy protection has gradually evolved from being assumed an implicit by product of security measures, and it is maturing into a research concern in its own right. However, further technical and socio technical advances are needed. As a contribution towards galvanising further research, the hallmarks of this paper include (i) a literature survey explicitly anchored on privacy preservation, it is underpinned by untangling privacy goals from security goals, to avoid mixing privacy and security concerns, as is often the case in other papers (ii) a critical survey of privacy preservation services for wireless sensor networks in healthcare, including threat analysis and assessment methodologies it also offers classification trees for the multifaceted challenge of privacy protection in healthcare, and for privacy threats, attacks and countermeasures (iii) a discussion of technical advances complemented by reflection over the implications of regulatory frameworks (iv) a discussion of open research challenges, leading onto offers of directions for future research towards unlocking the door onto privacy protection which is appropriate for healthcare in the twenty first century.


Handling Syntactic Divergence in Low resource Machine Translation. Despite impressive empirical successes of neural machine translation (NMT) on standard benchmarks, limited parallel data impedes the application of NMT models to many language pairs. Data augmentation methods such as back translation make it possible to use monolingual data to help alleviate these issues, but back translation itself fails in extreme low resource scenarios, especially for syntactically divergent languages. In this paper, we propose a simple yet effective solution, whereby target language sentences are re ordered to match the order of the source and used as an additional source of training time supervision. Experiments with simulated low resource Japanese to English, and real low resource Uyghur to English scenarios find significant improvements over other semi supervised alternatives.


The Canonical Grothendieck Topology and a Homotopical Analog. We explore the canonical Grothendieck topology and a new homotopical analog. First we discuss some background information, including defining a new 2 category called the Index Functor Category and a sieve generalization. Then we discuss a specific description of the covers in the canonical topology and a homotopical analog. Lastly, we explore the covers in the homotopical analog by obtaining some examples.


Discrete Laplace Operator Estimation for Dynamic 3D Reconstruction. We present a general paradigm for dynamic 3D reconstruction from multiple independent and uncontrolled image sources having arbitrary temporal sampling density and distribution. Our graph theoretic formulation models the Spatio temporal relationships among our observations in terms of the joint estimation of their 3D geometry and its discrete Laplace operator. Towards this end, we define a tri convex optimization framework that leverages the geometric properties and dependencies found among a Euclideanshape space and the discrete Laplace operator describing its local and global topology. We present a reconstructability analysis, experiments on motion capture data and multi view image datasets, as well as explore applications to geometry based event segmentation and data association.


TransPose Keypoint Localization via Transformer. While CNN based models have made remarkable progress on human pose estimation, what spatial dependencies they capture to localize keypoints remains unclear. In this work, we propose a model called textbf TransPose , which introduces Transformer for human pose estimation. The attention layers built in Transformer enable our model to capture long range relationships efficiently and also can reveal what dependencies the predicted keypoints rely on. To predict keypoint heatmaps, the last attention layer acts as an aggregator, which collects contributions from image clues and forms maximum positions of keypoints. Such a heatmap based localization approach via Transformer conforms to the principle of Activation Maximization cite erhan2009visualizing . And the revealed dependencies are image specific and fine grained, which also can provide evidence of how the model handles special cases, e.g., occlusion. The experiments show that TransPose achieves 75.8 AP and 75.0 AP on COCO validation and test dev sets, while being more lightweight and faster than mainstream CNN architectures. The TransPose model also transfers very well on MPII benchmark, achieving superior performance on the test set when fine tuned with small training costs. Code and pre trained models are publicly available footnote url https github.com yangsenius TransPose .