Sparsity through evolutionary pruning prevents neuronal networks from overfitting. Modern Machine learning techniques take advantage of the exponentially rising calculation power in new generation processor units. Thus, the number of parameters which are trained to resolve complex tasks was highly increased over the last decades. However, still the networks fail in contrast to our brain to develop general intelligence in the sense of being able to solve several complex tasks with only one network architecture. This could be the case because the brain is not a randomly initialized neural network, which has to be trained by simply investing a lot of calculation power, but has from birth some fixed hierarchical structure. To make progress in decoding the structural basis of biological neural networks we here chose a bottom up approach, where we evolutionarily trained small neural networks in performing a maze task. This simple maze task requires dynamical decision making with delayed rewards. We were able to show that during the evolutionary optimization random severance of connections lead to better generalization performance of the networks compared to fully connected networks. We conclude that sparsity is a central property of neural networks and should be considered for modern Machine learning approaches.


Naturalness as a reasonable scientific principle in fundamental physics. I aim to clarify the physical content and significance of naturalness. Physicists' earliest understanding of naturalness, as an autonomy of scales (AoS) requirement provides the most cogent definition of naturalness and I will assert that i) this provides a uniform notion which undergirds a myriad prominent naturalness conditions, ii) this is a reasonable criterion to impose on EFTs and iii) the successes and violations of naturalness are best understood when adhering to this notion of naturalness. I argue that this principle is neither an aesthetic nor a sociologically influenced principle. I contend that naturalness may only be plausibly argued to be an aesthetic sociological principle when formal measures of naturalness and their use in physics communities are conflated with the central dogma of naturalness the former may indeed be argued to be sociologically influenced and somewhat arbitrary but these formal measures of naturalness are in fact less successful than AoS naturalness. I put forward arguments as to why AoS naturalness is well defined and why it was reasonable for physicists to endorse this naturalness principle on both theoretical and empirical grounds. Up to date, no compelling reasons have appeared as to why the laws of nature should generically decoupling into quasi autonomous physical domains. A decoupling of scales in the quantum realm is often claimed to be entailed by the Decoupling Theorem (Cao and Schweber (1993)), yet I will show that this theorem is too weak to underwrite quasi autonomous physical domains in quantum field theories because one should additionally impose that parameters be natural. Violations of naturalness would then have ontological import unnatural parameters would not be accurately described by EFTs but rather by field theories exhibiting some kind of UV IR interplay.


The maximum modulus set of a polynomial. We study the maximum modulus set, mathcal M (p) , of a polynomial p . We are interested in constructing p so that mathcal M (p) has certain exceptional features. Jassim and London gave a cubic polynomial p such that mathcal M (p) has one discontinuity, and Tyler found a quintic polynomial tilde p such that mathcal M ( tilde p ) has one singleton component. These are the only results of this type, and we strengthen them considerably. In particular, given a finite sequence a 1, a 2, ldots, a n of distinct positive real numbers, we construct polynomials p and tilde p such that mathcal M (p) has discontinuities of modulus a 1, a 2, ldots, a n , and mathcal M ( tilde p ) has singleton components at the points a 1, a 2, ldots, a n . Finally we show that these results are strong, in the sense that it is not possible for a polynomial to have infinitely many discontinuities in its maximum modulus set.


A Paired Sparse Representation Model for Robust Face Recognition from a Single Sample. Sparse representation based classification (SRC) has been shown to achieve a high level of accuracy in face recognition (FR). However, matching faces captured in unconstrained video against a gallery with a single reference facial still per individual typically yields low accuracy. For improved robustness to intra class variations, SRC techniques for FR have recently been extended to incorporate variational information from an external generic set into an auxiliary dictionary. Despite their success in handling linear variations, non linear variations (e.g., pose and expressions) between probe and reference facial images cannot be accurately reconstructed with a linear combination of images in the gallery and auxiliary dictionaries because they do not share the same type of variations. In order to account for non linear variations due to pose, a paired sparse representation model is introduced allowing for joint use of variational information and synthetic face images. The proposed model, called synthetic plus variational model, reconstructs a probe image by jointly using (1) a variational dictionary and (2) a gallery dictionary augmented with a set of synthetic images generated over a wide diversity of pose angles. The augmented gallery dictionary is then encouraged to pair the same sparsity pattern with the variational dictionary for similar pose angles by solving a newly formulated simultaneous sparsity based optimization problem. Experimental results obtained on Chokepoint and COX S2V datasets, using different face representations, indicate that the proposed approach can outperform state of the art SRC based methods for still to video FR with a single sample per person.


Symmetric Promise Constraint Satisfaction Problems Beyond the Boolean Case. The Promise Constraint Satisfaction Problem (PCSP) is a recently introduced vast generalization of the Constraint Satisfaction Problem (CSP). We investigate the computational complexity of a class of PCSPs beyond the most studied cases approximation variants of satisfiability and graph coloring problems. We give an almost complete classification for the class of PCSPs of the form given a 3 uniform hypergraph that has an admissible 2 coloring, find an admissible 3 coloring, where admissibility is given by a ternary symmetric relation. The only PCSP of this sort whose complexity is left open in this work is a natural hypergraph coloring problem, where admissibility is given by the relation "if two colors are equal, then the remaining one is higher."


Crepant resolutions of double covers On the Cynk Hulek criterion for crepant resolutions of double cover. A collection S D 1, ldots, D n of divisors in a smooth variety X is an em arrangement if intersections of all subsets of S are smooth. We show that a double cover of X ramified on an arrangement has a crepant resolution under additional hypotheses. Namely, we assume that all intersection components that change the canonical divisor when blown up satisfy are em splayed , a property of the tangent spaces of the components first studied by Faber. This strengthens a result of Cynk and Hulek, which requires a stronger hypothesis on the intersection components. Further, we study the singular subscheme of the union of the divisors in S and prove that it has a primary decomposition where the primary components are supported on exactly the subvarieties which are blown up in the course of constructing the crepant resolution of the double cover.


Asymptotically Optimal Load Balancing in Large scale Heterogeneous Systems with Multiple Dispatchers. We consider the load balancing problem in large scale heterogeneous systems with multiple dispatchers. We introduce a general framework called Local Estimation Driven (LED). Under this framework, each dispatcher keeps local (possibly outdated) estimates of queue lengths for all the servers, and the dispatching decision is made purely based on these local estimates. The local estimates are updated via infrequent communications between dispatchers and servers. We derive sufficient conditions for LED policies to achieve throughput optimality and delay optimality in heavy traffic, respectively. These conditions directly imply delay optimality for many previous local memory based policies in heavy traffic. Moreover, the results enable us to design new delay optimal policies for heterogeneous systems with multiple dispatchers. Finally, the heavy traffic delay optimality of the LED framework directly resolves a recent open problem on how to design optimal load balancing schemes using delayed information.


On The Plurality of Graphs. We conduct a series of experiments designed to empirically demonstrate the effects of varying the structural features of a multi agent emergent communication game framework. Specifically, we model the interactions (edges) between individual agents (nodes)as the structure of a graph generated according to a series of known random graph generating algorithms. Confirming the hypothesis proposed in 10 , we show that the two factors of variation induced in this work, namely 1) the graph generating process and 2) the centrality measure according to which edges are sampled, in fact play a significant role in determining the dynamics of language emergence within the population at hand.


Verification Artifacts in Cooperative Verification Survey and Unifying Component Framework. The goal of cooperative verification is to combine verification approaches in such a way that they work together to verify a system model. In particular, cooperative verifiers provide exchangeable information (verification artifacts) to other verifiers or consume such information from other verifiers with the goal of increasing the overall effectiveness and efficiency of the verification process. This paper first gives an overview over approaches for leveraging strengths of different techniques, algorithms, and tools in order to increase the power and abilities of the state of the art in software verification. Second, we specifically outline cooperative verification approaches and discuss their employed verification artifacts. We formalize all artifacts in a uniform way, thereby fixing their semantics and providing verifiers with a precise meaning of the exchanged information.


Towards Mass Adoption of Contact Tracing Apps Learning from Users' Preferences to Improve App Design. Contact tracing apps have become one of the main approaches to control and slow down the spread of COVID 19 and ease up lockdown measures. While these apps can be very effective in stopping the transmission chain and saving lives, their adoption remains under the expected critical mass. The public debate about contact tracing apps emphasizes general privacy reservations and is conducted at an expert level, but lacks the user perspective related to actual designs. To address this gap, we explore user preferences for contact tracing apps using market research techniques, and specifically conjoint analysis. Our main contributions are empirical insights into individual and group preferences, as well as insights for prescriptive design. While our results confirm the privacy preserving design of most European contact tracing apps, they also provide a more nuanced understanding of acceptable features. Based on market simulation and variation analysis, we conclude that adding goal congruent features will play an important role in fostering mass adoption.


Substra a framework for privacy preserving, traceable and collaborative Machine Learning. Machine learning is promising, but it often needs to process vast amounts of sensitive data which raises concerns about privacy. In this white paper, we introduce Substra, a distributed framework for privacy preserving, traceable and collaborative Machine Learning. Substra gathers data providers and algorithm designers into a network of nodes that can train models on demand but under advanced permission regimes. To guarantee data privacy, Substra implements distributed learning the data never leave their nodes only algorithms, predictive models and non sensitive metadata are exchanged on the network. The computations are orchestrated by a Distributed Ledger Technology which guarantees traceability and authenticity of information without needing to trust a third party. Although originally developed for Healthcare applications, Substra is not data, algorithm or programming language specific. It supports many types of computation plans including parallel computation plan commonly used in Federated Learning. With appropriate guidelines, it can be deployed for numerous Machine Learning use cases with data or algorithm providers where trust is limited.


Investigating the refractive index sensitivity of U bent fiber optic sensors using ray optics. Geometrically modified fiber optic sensors (FOS), particularly U bent FOS, have gained significant attention due to their remarkably high refractive index (RI) and evanescent wave absorbance (EWA) sensitivity, as well as their ergonomic design and ease in handling. In this study, we present a theoretical model for the U bent FOS probes, to predict the sensor behavior by numerically simulating the light propagation in an equivalent 2D semi circular ring using ray tracing approach. In addition to the effects due to the modification of geometry, this study presents a thorough investigation of the influence of the bend induced material deformation on the nature of light propagation and refractive losses. We introduce bend ratio (ratio of bend radius to fiber core radius), to explain the influence of geometry modification and the bend induced inhomogeneity in RI (BIRI) of the fiber core on RI sensitivity. The bend ratio of bent plastic optical fiber sensors falls under one of the four bending regimes namely, gentle, geometric, saturation and plastic, for which the bend ratios are less than 35, 25, 17 and 7 respectively. The results also show that for bend ratios less than 7, BIRI inhomogeneity is responsible for the high RI sensitivity observed with U bent probes as opposed to the simple geometric modification. This study also indicates the existence of an optimum bend ratio (for a given value of RI of the surrounding medium) where RI sensitivity is maximum. These findings were validated with previously reported experimental results.


Curves in the disc, the type B braid group, and the type B zigzag algebra. We construct a finite dimensional quiver algebra from the non simply laced type B Dynkin diagram, which we call the type B zigzag algebra. This leads to a faithful categorical action of the type B braid group mathcal A (B) , acting on the homotopy category of its projective modules. This categorical action is also closely related to the topological action of mathcal A (B) , viewed as mapping class group of the punctured disc hence our exposition can be seen as a type B analogue of Khovanov Seidel's work in arXiv math 0006056v2. Moreover, we show that certain category of bimodules over our type B zigzag algebra is a quotient category of Soergel bimodules, resulting in an alternative proof to Rouquier's conjecture on the faithfulness of the 2 braid groups for type B .


Hidden but real new relativistic "paradox" exposing the ubiquity of hidden momentum. The tight connection between mass and energy unveiled by Special Relativity, summarized by the iconic formula E mc 2 , has revolutionized our understanding of nature and even shaped our political world over the past century through its military application. It is certainly one of the most exhaustively tested and well known equations of modern science. Although we have become used to its most obvious implication mass energy equivalence , it is surprising that one of its subtle yet, inevitable consequences is still a matter of confusion the so called hidden momentum. Often considered as a peculiar feature of specific systems or as an artifact to avoid paradoxal situations, here we present a new relativistic "paradox" which exposes the true nature and ubiquity of hidden momentum. We also show that hidden momentum can be forced to reveal itself through observable effects, hopefully putting an end to decades of controversy about its reality.


Distilled Semantics for Comprehensive Scene Understanding from Videos. Whole understanding of the surroundings is paramount to autonomous systems. Recent works have shown that deep neural networks can learn geometry (depth) and motion (optical flow) from a monocular video without any explicit supervision from ground truth annotations, particularly hard to source for these two tasks. In this paper, we take an additional step toward holistic scene understanding with monocular cameras by learning depth and motion alongside with semantics, with supervision for the latter provided by a pre trained network distilling proxy ground truth images. We address the three tasks jointly by a) a novel training protocol based on knowledge distillation and self supervision and b) a compact network architecture which enables efficient scene understanding on both power hungry GPUs and low power embedded platforms. We thoroughly assess the performance of our framework and show that it yields state of the art results for monocular depth estimation, optical flow and motion segmentation.


Well posedness for boundary value problems for coagulation fragmentation equations. We investigate a coagulation fragmentation equation with boundary data, establishing the well posedness of the initial value problem when the coagulation kernels are bounded at zero and showing existence of solutions for the singular kernels relevant in the applications. We determine the large time asymptotic behavior of solutions, proving that solutions converge exponentially fast to zero in the absence of fragmentation and stabilize toward an equilibrium if the boundary value satisfies a detailed balance condition. Incidentally, we obtain an improvement in the regularity of solutions by showing the finiteness of negative moments for positive time.


SMYRF Efficient Attention using Asymmetric Clustering. We propose a novel type of balanced clustering algorithm to approximate attention. Attention complexity is reduced from O(N 2) to O(N log N) , where N is the sequence length. Our algorithm, SMYRF, uses Locality Sensitive Hashing (LSH) in a novel way by defining new Asymmetric transformations and an adaptive scheme that produces balanced clusters. The biggest advantage of SMYRF is that it can be used as a drop in replacement for dense attention layers without any retraining. On the contrary, prior fast attention methods impose constraints (e.g. queries and keys share the same vector representations) and require re training from scratch. We apply our method to pre trained state of the art Natural Language Processing and Computer Vision models and we report significant memory and speed benefits. Notably, SMYRF BERT outperforms (slightly) BERT on GLUE, while using 50 less memory. We also show that SMYRF can be used interchangeably with dense attention before and after training. Finally, we use SMYRF to train GANs with attention in high resolutions. Using a single TPU, we were able to scale attention to 128x128 16k and 256x256 65k tokens on BigGAN on CelebA HQ.


Ramsey numbers of partial order graphs (comparability graphs) and implications in ring theory. For a partially ordered set (A, le) , let G A be the simple, undirected graph with vertex set A such that two vertices a neq b in A are adjacent if either a le b or b le a . We call G A the emph partial order graph or emph comparability graph of A . Further, we say that a graph G is a partial order graph if there exists a partially ordered set A such that G G A . For a class mathcal C of simple, undirected graphs and n , m ge 1 , we define the Ramsey number mathcal R mathcal C (m,n) with respect to mathcal C to be the minimal number of vertices r such that every induced subgraph of an arbitrary partial order graph consisting of r vertices contains either a complete n clique K n or an independent set consisting of m vertices. In this paper, we determine the Ramsey number with respect to some classes of partial order graphs. Furthermore, some implications of Ramsey numbers in ring theory are discussed.


RPT Learning Point Set Representation for Siamese Visual Tracking. While remarkable progress has been made in robust visual tracking, accurate target state estimation still remains a highly challenging problem. In this paper, we argue that this issue is closely related to the prevalent bounding box representation, which provides only a coarse spatial extent of object. Thus an effcient visual tracking framework is proposed to accurately estimate the target state with a finer representation as a set of representative points. The point set is trained to indicate the semantically and geometrically significant positions of target region, enabling more fine grained localization and modeling of object appearance. We further propose a multi level aggregation strategy to obtain detailed structure information by fusing hierarchical convolution layers. Extensive experiments on several challenging benchmarks including OTB2015, VOT2018, VOT2019 and GOT 10k demonstrate that our method achieves new state of the art performance while running at over 20 FPS.


A probabilistic proof of the spherical excess formula. This note offers a probabilistic proof of Girard's angle excess formula for the area of a spherical triangle, based on the observation that an unbounded 3 dimensional convex cone, with single vertex at the origin, has only three kinds of 2 dimensional orthogonal projections a 2 dimensional convex cone with one vertex, a 2 dimensional half plane (this is an outcome of probability zero), and a 2 dimensional plane.


Round Robin is Provably Near Optimal for Minimizing Age with HARQ over Heterogeneous Unreliable Multiaccess Channels. In a heterogeneous unreliable multiaccess network, wherein terminals share a common wireless channel with distinctive error probabilities, existing works have showed that a persistent round robin (RR P) scheduling policy (i.e., greedy policy) can be arbitrarily worse than the optimum in terms of Age of Information (AoI) under standard Automatic Repeat reQuest (ARQ), and one must resort to Whittle's index approach for optimal AoI. In this paper, practical Hybrid ARQ (HARQ) schemes which are widely used in today's wireless networks are considered. We show that RR P is very close to optimum with asymptotically many terminals in this case, by explicitly deriving tight, closed form AoI gaps between optimum and achievable AoI by RR P. In particular, it is rigorously proved that for RR P, under HARQ models concerning fading channels (resp. finite blocklength regime), the relative AoI gap compared with the optimum is within a constant of ( sqrt e 1) 2 4 sqrt e cong 6.4 (resp. 6.2 with error exponential decay rate of 0.5 ). In addition, RR P enjoys the distinct advantage of implementation simplicity with channel unaware and easy to decentralize operations, making it favorable in practice.


New Instances of Quadratic APN Functions. In a recent work, Beierle, Brinkmann and Leander presented a recursive tree search for finding APN permutations with linear self equivalences in small dimensions. In this paper, we describe how this search can be adapted to find many new instances of quadratic APN functions. In particular, we found 12,921 new quadratic APN functions in dimension eight, 35 new quadratic APN functions in dimension nine and five new quadratic APN functions in dimension ten up to CCZ equivalence. Remarkably, two of the 35 new APN functions in dimension nine are APN permutations. Among the 8 bit APN functions, there are three extended Walsh spectra that do not correspond to any of the previously known quadratic 8 bit APN functions and, surprisingly, there exist at least four CCZ inequivalent 8 bit APN functions with linearity 2 7 , i.e., the highest possible non trivial linearity for quadratic functions in dimension eight.


Representing Ordinal Numbers with Arithmetically Interesting Sets of Real Numbers. For a real number x and set of natural numbers A , define x ast A x a bmod 1 a in A subseteq 0,1). We consider relationships between x , A , and the order type of x ast A . For example, for every irrational x and order type alpha , there is an A with x ast A simeq alpha , but if alpha is a well order, then A must be a thin set. If, however, A is restricted to be a subset of the powers of 2, then not every order type is possible, although arbitrarily large countable well orders arise.


A Topological Perspective on Distributed Network Algorithms. More than two decades ago, combinatorial topology was shown to be useful for analyzing distributed fault tolerant algorithms in shared memory systems and in message passing systems. In this work, we show that combinatorial topology can also be useful for analyzing distributed algorithms in failure free networks of arbitrary structure. To illustrate this, we analyze consensus, set agreement, and approximate agreement in networks, and derive lower bounds for these problems under classical computational settings, such as the LOCAL model and dynamic networks.


The 4th Industrial Revolution Effect on the Enterprise Cyber Strategy. The Fourth (4th) Industrial Revolution represents the profound advancement of technology that will likely transform the boundaries between the digital and physical worlds in modern society. The impact of advance technology will disrupt almost every aspect of business and government communities alike. In the past few years, the advancement of information technologies has opened the door to artificial intelligence (AI), block chain technologies, robotics, virtual reality and the possibility of quantum computing being released in the commercial sector. The use of these innovative technologies will likely impact society by leveraging modern technological platforms such as cloud computing and AI. This also includes the release of 5G network technologies by Internet Service Providers (ISP) beginning in 2019. Networks that rely upon 5G technologies in combination with cloud computing platforms will open the door allow greater innovations and change the nature of how work is performed in the 4th Industrial Revolution.


Average of complete joint weight enumerators and self dual codes. In this paper, we give a representation of the average of complete joint weight enumerators of two linear codes of length n over mathbb F q and mathbb Z k in terms of the compositions of n and their distributions in the codes. We also obtain a generalization of the representation for the average of g fold complete joint weight enumerators of codes over mathbb F q and mathbb Z k . Finally, the average of intersection numbers of a pair of Type III (resp. Type IV) codes, and its second moment are found.


Bongard LOGO A New Benchmark for Human Level Concept Learning and Reasoning. Humans have an inherent ability to learn novel concepts from only a few samples and generalize these concepts to different situations. Even though today's machine learning models excel with a plethora of training data on standard recognition tasks, a considerable gap exists between machine level pattern recognition and human level concept learning. To narrow this gap, the Bongard problems (BPs) were introduced as an inspirational challenge for visual cognition in intelligent systems. Despite new advances in representation learning and learning to learn, BPs remain a daunting challenge for modern AI. Inspired by the original one hundred BPs, we propose a new benchmark Bongard LOGO for human level concept learning and reasoning. We develop a program guided generation technique to produce a large set of human interpretable visual cognition problems in action oriented LOGO language. Our benchmark captures three core properties of human cognition 1) context dependent perception, in which the same object may have disparate interpretations given different contexts 2) analogy making perception, in which some meaningful concepts are traded off for other meaningful concepts and 3) perception with a few samples but infinite vocabulary. In experiments, we show that the state of the art deep learning methods perform substantially worse than human subjects, implying that they fail to capture core human cognition properties. Finally, we discuss research directions towards a general architecture for visual reasoning to tackle this benchmark.


ArTIST Autoregressive Trajectory Inpainting and Scoring for Tracking. One of the core components in online multiple object tracking (MOT) frameworks is associating new detections with existing tracklets, typically done via a scoring function. Despite the great advances in MOT, designing a reliable scoring function remains a challenge. In this paper, we introduce a probabilistic autoregressive generative model to score tracklet proposals by directly measuring the likelihood that a tracklet represents natural motion. One key property of our model is its ability to generate multiple likely futures of a tracklet given partial observations. This allows us to not only score tracklets but also effectively maintain existing tracklets when the detector fails to detect some objects even for a long time, e.g., due to occlusion, by sampling trajectories so as to inpaint the gaps caused by misdetection. Our experiments demonstrate the effectiveness of our approach to scoring and inpainting tracklets on several MOT benchmark datasets. We additionally show the generality of our generative model by using it to produce future representations in the challenging task of human motion prediction.


Computing Hecke Operators for Arithmetic Subgroups of General Linear Groups. We present an algorithm to compute the Hecke operators on the equivariant cohomology of an arithmetic subgroup Gamma of the general linear group mathrm GL n . This includes mathrm GL n over a number field or a finite dimensional division algebra. As coefficients, we may use any finite dimensional local coefficient system. Unlike earlier methods, the algorithm works for the cohomology H i in all degrees i . It starts from the well rounded retract tilde W , a Gamma invariant cell complex which computes the cohomology. It extends tilde W to a new well tempered complex tilde W of one higher real dimension, using a real parameter called the temperament. The algorithm has been coded up for mathrm SL n( mathbb Z ) for n 2,3,4 we present some results for congruence subgroups of mathrm SL 3( mathbb Z ) .


Hilbert evolution algebras and its connection with discrete time Markov chains. Evolution algebras are non associative algebras. In this work we provide an extension of this class of algebras, in the context of Hilbert spaces, capable to deal with infinite dimensional spaces. We illustrate the applicability of our approach by discussing a connection with discrete time Markov chains with countable state space.


Distributed Robust Nash Equilibrium Searching for Mixed order Games by a Neural Network based Approach. Noticing that agents with different dynamics may work together, this paper considers Nash equilibrium computation for a class of games in which first order integrator type players and second order integrator type players interact in a distributed network. To deal with this situation, we firstly exploit a centralized method for full information games. In the considered scenario, the players can employ its own gradient information, though it may rely on all players' actions. Based on the proposed centralized algorithm, we further develop a distributed counterpart. Different from the centralized one, the players are assumed to have limited access into the other players' actions. In addition, noticing that unmodeled dynamics and disturbances are inevitable for practical engineering systems, the paper further considers games in which the players' dynamics are suffering from unmodeled dynamics and time varying disturbances. In this situation, an adaptive neural network is utilized to approximate the unmodeled dynamics and disturbances, based on which a centralized Nash equilibrium seeking algorithm and a distributed Nash equilibrium seeking algorithm are established successively. Appropriate Lyapunov functions are constructed to investigate the effectiveness of the proposed methods analytically. It is shown that if the considered mixed order game is free of unmodeled dynamics and disturbances, the proposed method would drive the players' actions to the Nash equilibrium exponentially. Moreover, if unmodeled dynamics and disturbances are considered, the players' actions would converge to arbitrarily small neighborhood of the Nash equilibrium. Lastly, the theoretical results are numerically verified by simulation examples.


Unsupervised Representation Learning for Gaze Estimation. Although automatic gaze estimation is very important to a large variety of application areas, it is difficult to train accurate and robust gaze models, in great part due to the difficulty in collecting large and diverse data (annotating 3D gaze is expensive and existing datasets use different setups). To address this issue, our main contribution in this paper is to propose an effective approach to learn a low dimensional gaze representation without gaze annotations, which to the best of our best knowledge, is the first work to do so. The main idea is to rely on a gaze redirection network and use the gaze representation difference of the input and target images (of the redirection network) as the redirection variable. A redirection loss in image domain allows the joint training of both the redirection network and the gaze representation network. In addition, we propose a warping field regularization which not only provides an explicit physical meaning to the gaze representations but also avoids redirection distortions. Promising results on few shot gaze estimation (competitive results can be achieved with as few as 100 calibration samples), cross dataset gaze estimation, gaze network pretraining, and another task (head pose estimation) demonstrate the validity of our framework.


Deep Multi View Spatiotemporal Virtual Graph Neural Network for Significant Citywide Ride hailing Demand Prediction. Urban ride hailing demand prediction is a crucial but challenging task for intelligent transportation system construction. Predictable ride hailing demand can facilitate more reasonable vehicle scheduling and online car hailing platform dispatch. Conventional deep learning methods with no external structured data can be accomplished via hybrid models of CNNs and RNNs by meshing plentiful pixel level labeled data, but spatial data sparsity and limited learning capabilities on temporal long term dependencies are still two striking bottlenecks. To address these limitations, we propose a new virtual graph modeling method to focus on significant demand regions and a novel Deep Multi View Spatiotemporal Virtual Graph Neural Network (DMVST VGNN) to strengthen learning capabilities of spatial dynamics and temporal long term dependencies. Specifically, DMVST VGNN integrates the structures of 1D Convolutional Neural Network, Multi Graph Attention Neural Network and Transformer layer, which correspond to short term temporal dynamics view, spatial dynamics view and long term temporal dynamics view respectively. In this paper, experiments are conducted on two large scale New York City datasets in fine grained prediction scenes. And the experimental results demonstrate effectiveness and superiority of DMVST VGNN framework in significant citywide ride hailing demand prediction.


Proof Complexity of Substructural Logics. In this paper, we investigate the proof complexity of a wide range of substructural systems. For any proof system mathbf P at least as strong as Full Lambek calculus, mathbf FL , and polynomially simulated by the extended Frege system for some infinite branching super intuitionistic logic, we present an exponential lower bound on the proof lengths. More precisely, we will provide a sequence of mathbf P provable formulas A n n 1 infty such that the length of the shortest mathbf P proof for A n is exponential in the length of A n . The lower bound also extends to the number of proof lines (proof lengths) in any Frege system (extended Frege system) for a logic between mathsf FL and any infinite branching super intuitionistic logic. We will also prove a similar result for the proof systems and logics extending Visser's basic propositional calculus mathbf BPC and its logic mathsf BPC , respectively. Finally, in the classical substructural setting, we will establish an exponential lower bound on the number of proof lines in any proof system polynomially simulated by the cut free version of mathbf CFL ew .


SurfCon Synonym Discovery on Privacy Aware Clinical Data. Unstructured clinical texts contain rich health related information. To better utilize the knowledge buried in clinical texts, discovering synonyms for a medical query term has become an important task. Recent automatic synonym discovery methods leveraging raw text information have been developed. However, to preserve patient privacy and security, it is usually quite difficult to get access to large scale raw clinical texts. In this paper, we study a new setting named synonym discovery on privacy aware clinical data (i.e., medical terms extracted from the clinical texts and their aggregated co occurrence counts, without raw clinical texts). To solve the problem, we propose a new framework SurfCon that leverages two important types of information in the privacy aware clinical data, i.e., the surface form information, and the global context information for synonym discovery. In particular, the surface form module enables us to detect synonyms that look similar while the global context module plays a complementary role to discover synonyms that are semantically similar but in different surface forms, and both allow us to deal with the OOV query issue (i.e., when the query is not found in the given data). We conduct extensive experiments and case studies on publicly available privacy aware clinical data, and show that SurfCon can outperform strong baseline methods by large margins under various settings.


Global regularity for Einstein Klein Gordon system with U(1) times mathbb R isometry group, II. This paper is devoted to the study of the global existence of smooth solutions for the 3 1 dimensional Einstein Klein Gordon systems with a U(1) times mathbb R isometry group for a class of regular Cauchy data. In our first paper cite chen , we reduce the Einstein equations to a 2 1 dimensional Einstein wave Klein Gordon system. And we show that the first possible singularity can only occur at the axis. In this paper, we give a proof for the global regularity for the 2 1 dimensional system. Firstly, we show the non concentration of the energy near the first possible singularity. Then, we prove that the global regularity holds for initial data with small energy.


Strong and weak principles of neural dimension reduction. If spikes are the medium, what is the message? Answering that question is driving the development of large scale, single neuron resolution recordings from behaving animals, on the scale of thousands of neurons. But these data are inherently high dimensional, with as many dimensions as neurons so how do we make sense of them? For many the answer is to reduce the number of dimensions. Here I argue we can distinguish weak and strong principles of neural dimension reduction. The weak principle is that dimension reduction is a convenient tool for making sense of complex neural data. The strong principle is that dimension reduction shows us how neural circuits actually operate and compute. Elucidating these principles is crucial, for which we subscribe to provides radically different interpretations of the same neural activity data. I show how we could make either the weak or strong principles appear to be true based on innocuous looking decisions about how we use dimension reduction on our data. To counteract these confounds, I outline the experimental evidence for the strong principle that do not come from dimension reduction but also show there are a number of neural phenomena that the strong principle fails to address. To reconcile these conflicting data, I suggest that the brain has both principles at play.


On complex explicit formulae connected with the M "obius function of an elliptic curve. We study analytic properties function m(z, E) , which is defined on the upper half plane as an integral from the shifted L function of an elliptic curve. We show that m(z, E) analytically continues to a meromorphic function on the whole complex plane and satisfies certain functional equation. Moreover, we give explicit formula for m(z, E) in the strip Im z 2 pi .


A Koll ' a r type vanishing theorem. Let f X rightarrow Y be a smooth fibration between two complex manifolds X and Y , and let L be a pseudo effective line bundle on X . We obtain a sufficient condition for R q f ast (K X Y otimes L) to be reflexive and hence derive a Koll ' a r type vanishing theorem.


A nonlinear version of Bourgain's projection theorem. We prove a version of Bourgain's projection theorem for parametrized families of C 2 maps, that refines the original statement even in the linear case. As one application, we show that if A is a Borel set of Hausdorff dimension close to 1 in mathbb R 2 or close to 3 2 in mathbb R 3 , then for y in A outside of a very sparse set, the pinned distance set x y x in A has Hausdorff dimension at least 1 2 c , where c is universal. Furthermore, the same holds if the distances are taken with respect to a C 2 norm of positive Gaussian curvature. As further applications, we obtain new bounds on the dimensions of spherical projections, and an improvement over the trivial estimate for incidences between delta balls and delta neighborhoods of curves in the plane, under fairly general assumptions. The proofs depend on a new multiscale decomposition of measures into Frostman pieces'' that may be of independent interest.


Period Relations for Quaternionic Elliptic Functions. We study elliptic functions in quaternionic analysis, and prove some analogues of classical theorems from the complex case. The main result is a relation between the periods of closed differential 1 forms and 3 forms on H L where L is a lattice in H. By applying to forms that are regular in the sense of quaternionic analysis, we obtain quaternionic analogues of Riemann's period relations for an abelian surface. We also obtain a quaternionic analogue of Legendre's relation, as an equality between 2 pi 2 and a linear combination of the four quasi periods of the quaternionic Weierstrass zeta function, where the coefficients are rational functions of a basis for L. When L is a left ideal for a maximal order in a definite quaternion algebra over Q, we obtain three further relations among the quasi periods.


Leveraging the Invariant Side of Generative Zero Shot Learning. Conventional zero shot learning (ZSL) methods generally learn an embedding, e.g., visual semantic mapping, to handle the unseen visual samples via an indirect manner. In this paper, we take the advantage of generative adversarial networks (GANs) and propose a novel method, named leveraging invariant side GAN (LisGAN), which can directly generate the unseen features from random noises which are conditioned by the semantic descriptions. Specifically, we train a conditional Wasserstein GANs in which the generator synthesizes fake unseen features from noises and the discriminator distinguishes the fake from real via a minimax game. Considering that one semantic description can correspond to various synthesized visual samples, and the semantic description, figuratively, is the soul of the generated features, we introduce soul samples as the invariant side of generative zero shot learning in this paper. A soul sample is the meta representation of one class. It visualizes the most semantically meaningful aspects of each sample in the same category. We regularize that each generated sample (the varying side of generative ZSL) should be close to at least one soul sample (the invariant side) which has the same class label with it. At the zero shot recognition stage, we propose to use two classifiers, which are deployed in a cascade way, to achieve a coarse to fine result. Experiments on five popular benchmarks verify that our proposed approach can outperform state of the art methods with significant improvements.


A generalized Fermat Torricelli tree that has acquired a subconscious on a surface. We study a generalized Fermat Torricelli (S.FT) problem for infinitesimal geodesic triangles on a C 2 complete surface M with variable Gaussian curvature a K b, for a, b in R, such that the intersection point (generalized Fermat Torricelli point) of the three geodesics acquires a positive real number (subconscious). The solution of the S.FT problem is a generalized Fermat Torricelli tree with one node that has acquired a subconscious. This solution is based on a new variational method of the length of a geodesic arc with respect to arc length, which coincides with the first variational formula for geodesics on a surface with K 0, or 0 K c. The 'plasticity' solution of the inverse S.FT problem gives a connection of the absolute value of the Gaussian curvature K(F) at the generalized Fermat Torricelli point F with the absolute value of the Aleksandrov curvature of the geodesic triangle by acquiring both of them the subconscious of the g.FT point.


Visuallly Grounded Generation of Entailments from Premises. Natural Language Inference (NLI) is the task of determining the semantic relationship between a premise and a hypothesis. In this paper, we focus on the em generation of hypotheses from premises in a multimodal setting, to generate a sentence (hypothesis) given an image and or its description (premise) as the input. The main goals of this paper are (a) to investigate whether it is reasonable to frame NLI as a generation task and (b) to consider the degree to which grounding textual premises in visual information is beneficial to generation. We compare different neural architectures, showing through automatic and human evaluation that entailments can indeed be generated successfully. We also show that multimodal models outperform unimodal models in this task, albeit marginally.


Parametric upconversion of Ince Gaussian modes. Ince Gaussian (IG) mode, a recently discovered type of structured Gaussian beam, corresponds to eigenfunctions of the paraxial wave equation in elliptical coordinates. This propagation invariant mode is of significance in various domains, and in particular, its nonlinear transformation however, there have been few relevant studies to date. In this work, we report the parametric upconversion of IG modes and associated full field selection rule for the first time. We demonstrate that IG signals can be perfectly upconverted by a flattop beam pump in contrast, significant mode distortion occurred when using the most common Gaussian pump. Particular attention was given to the origin of the distortion, i.e., radial mode degeneration induced by the sum frequency generation excited by Gaussian pump. This proof of principle demonstration has great significance in relevant areas, such as high dimension quantum frequency interfacing and upconversion imaging.


Brieskorn module and Center conditions pull back of differential equations in projective space. The moduli space of algebraic foliations on P2 of a fixed degree and with a center singularity has many irreducible components. We find a basis of the Brieskorn module defined for a rational function and prove that set of pull back foliations forms an irreducible component of the moduli space. The main tools are the Picard Lefschetz theory of a rational function in two variables, period integrals, and the Brieskorn module.


Fairness across Network Positions in Cyberbullying Detection Algorithms. Cyberbullying, which often has a deeply negative impact on the victim, has grown as a serious issue in Online Social Networks. Recently, researchers have created automated machine learning algorithms to detect Cyberbullying using social and textual features. However, the very algorithms that are intended to fight off one threat (cyberbullying) may inadvertently be falling prey to another important threat (bias of the automatic detection algorithms). This is exacerbated by the fact that while the current literature on algorithmic fairness has multiple empirical results, metrics, and algorithms for countering bias across immediately observable demographic characteristics (e.g. age, race, gender), there have been no efforts at empirically quantifying the variation in algorithmic performance based on the network role or position of individuals. We audit an existing cyberbullying algorithm using Twitter data for disparity in detection performance based on the network centrality of the potential victim and then demonstrate how this disparity can be countered using an Equalized Odds post processing technique. The results pave way for more accurate and fair cyberbullying detection algorithms.


Online Search with Maximum Clearance. We study the setting in which a mobile agent must locate a hidden target in a bounded or unbounded environment, with no information about the hider's position. In particular, we consider online search, in which the performance of the search strategy is evaluated by its worst case competitive ratio. We introduce a multi criteria search problem in which the searcher has a budget on its allotted search time, and the objective is to design strategies that are competitively efficient, respect the budget, and maximize the total searched ground. We give analytically optimal strategies for the line and the star environments, and efficient heuristics for general networks.


CVA and vulnerable options in stochastic volatility models. In this work we want to provide a general principle to evaluate the CVA (Credit Value Adjustment) for a vulnerable option, that is an option subject to some default event, concerning the solvability of the issuer. CVA is needed to evaluate correctly the contract and it is particularly important in presence of WWR (Wrong Way Risk), when a credit deterioration determines an increase of the claim's price. In particular, we are interested in evaluating the CVA in stochastic volatility models for the underlying's price (which often fit quite well the market's prices) when admitting correlation with the default event. By cunningly using Ito's calculus, we provide a general representation formula applicable to some popular models such as SABR, Hull White and Heston, which explicitly shows the correction in CVA due to the processes correlation. Later, we specialize this formula and construct its approximation for the three selected models. Lastly, we run a numerical study to test the formula's accuracy, comparing our results with Monte Carlo simulations.


Lorentz groups of cyclotomic extensions. In this (mostly historical) note we show how a unified Kummer Artin Schreier sequence from W , SOS may be recovered from the relativistic velocity addition law.


Smart Home, security concerns of IoT. The IoT (Internet of Things) has become widely popular in the domestic environments. People are renewing their homes into smart homes however, the privacy concerns of owning many Internet connected devices with always on environmental sensors remain insufficiently addressed. Default and weak passwords, cheap materials and hardware, and unencrypted communication are identified as the principal threats and vulnerabilities of IoT devices. Solutions and countermeasures are also provided choosing a strong password, strong authentication mechanisms, check online databases of exposed or default credentials to mitigate the first threat a selection of smart home devices from reputable companies and the implementation of the SDN for the Dos DDoS threat and finally IDS, HTTPS protocol and VPN for eavesdropping. The paper concludes dealing with a further challenge, "the lack of technical support", by which an auto configuration approach should be analysed this could both ease the installation maintenance and enhance the security in the self configuration step of Smart Home devices.


Toward Structured Proofs for Dynamic Logics. We present Kaisar, a structured interactive proof language for differential dynamic logic (dL), for safety critical cyber physical systems (CPS). The defining feature of Kaisar is nominal terms , which simplify CPS proofs by making the frequently needed historical references to past program states first class. To support nominals, we extend the notion of structured proof with a first class notion of structured symbolic execution of CPS models. We implement Kaisar in the theorem prover KeYmaera X and reproduce an example on the safe operation of a parachute and a case study on ground robot control. We show how nominals simplify common CPS reasoning tasks when combined with other features of structured proof. We develop an extensive metatheory for Kaisar. In addition to soundness and completeness, we show a formal specification for Kaisar's nominals and relate Kaisar to a nominal variant of dL.


Trignometry Without Geometry. The development of the trigonometric functions in introductory texts usually follows geometric constructions using right triangles or the unit circle. While these methods are satisfactory at the elementary level, advanced mathematics demands a more rigorous approach. Our purpose here is to revisit elementary trigonometry from an entirely analytic perspective. We will give a comprehensive treatment of the sine and cosine functions and will show how to derive the familiar theorems of trigonometry without reference to geometric definitions or constructions.


Effective bounds for monochromatic connectivity measures in two dimensions. We establish numerical lower bounds for the monochromatic connectivity measure in two dimensions introduced by Sarnak and Wigman. This measure dictates among the nodal domains of a random plane wave what proportion have any given number of holes, and how they are nested. Our bounds provide the first effective estimate for the number of simply connected domains and for those that contain a single hole. The deterministic aspect of the proof is to find a single function with a prescribed zero set and, using a quantitative form of the implicit function theorem, to argue that the same configuration occurs in the zero set of any sufficiently close approximation to this function. The probabilistic aspect is to quantify the likelihood of a random wave being close enough to this function.


EMLight Lighting Estimation via Spherical Distribution Approximation. Illumination estimation from a single image is critical in 3D rendering and it has been investigated extensively in the computer vision and computer graphic research community. On the other hand, existing works estimate illumination by either regressing light parameters or generating illumination maps that are often hard to optimize or tend to produce inaccurate predictions. We propose Earth Mover Light (EMLight), an illumination estimation framework that leverages a regression network and a neural projector for accurate illumination estimation. We decompose the illumination map into spherical light distribution, light intensity and the ambient term, and define the illumination estimation as a parameter regression task for the three illumination components. Motivated by the Earth Mover distance, we design a novel spherical mover's loss that guides to regress light distribution parameters accurately by taking advantage of the subtleties of spherical distribution. Under the guidance of the predicted spherical distribution, light intensity and ambient term, the neural projector synthesizes panoramic illumination maps with realistic light frequency. Extensive experiments show that EMLight achieves accurate illumination estimation and the generated relighting in 3D object embedding exhibits superior plausibility and fidelity as compared with state of the art methods.


Sheaf quantization in Weinstein symplectic manifolds. Using the microlocal theory of sheaves, we associate a category to each Weinstein manifold. By constructing a microlocal specialization functor, we show that exact Lagrangians give objects in our category, and that the category is invariant under Weinstein homotopy.


Exploiting Unsupervised Data for Emotion Recognition in Conversations. Emotion Recognition in Conversations (ERC) aims to predict the emotional state of speakers in conversations, which is essentially a text classification task. Unlike the sentence level text classification problem, the available supervised data for the ERC task is limited, which potentially prevents the models from playing their maximum effect. In this paper, we propose a novel approach to leverage unsupervised conversation data, which is more accessible. Specifically, we propose the Conversation Completion (ConvCom) task, which attempts to select the correct answer from candidate answers to fill a masked utterance in a conversation. Then, we Pre train a basic COntext Dependent Encoder (Pre CODE) on the ConvCom task. Finally, we fine tune the Pre CODE on the datasets of ERC. Experimental results demonstrate that pre training on unsupervised data achieves significant improvement of performance on the ERC datasets, particularly on the minority emotion classes.


Flexibility of Planar Graphs Sharpening the Tools to Get Lists of Size Four. A graph where each vertex v has a list L(v) of available colors is L colorable if there is a proper coloring such that the color of v is in L(v) for each v . A graph is k choosable if every assignment L of at least k colors to each vertex guarantees an L coloring. Given a list assignment L , an L request for a vertex v is a color c in L(v) . In this paper, we look at a variant of the widely studied class of precoloring extension problems from Z. Dvo v r 'ak, S. Norin, and L. Postle List coloring with requests. J. Graph Theory 2019 , wherein one must satisfy "enough", as opposed to all, of the requested set of precolors. A graph G is varepsilon flexible for list size k if for any k list assignment L , and any set S of L requests, there is an L coloring of G satisfying an varepsilon fraction of the requests in S . It is conjectured that planar graphs are varepsilon flexible for list size 5 , yet it is proved only for list size 6 and for certain subclasses of planar graphs. We give a stronger version of the main tool used in the proofs of the aforementioned results. By doing so, we improve upon a result by Masa v r 'ik and show that planar graphs without K 4 are varepsilon flexible for list size 5 . We also prove that planar graphs without 4 cycles and 3 cycle distance at least 2 are varepsilon flexible for list size 4 . Finally, we introduce a new (slightly weaker) form of varepsilon flexibility where each vertex has exactly one request. In that setting, we provide a stronger tool and we demonstrate its usefulness to further extend the class of graphs that are varepsilon flexible for list size 5 .


Large homogeneous subgraphs in bipartite graphs with forbidden induced subgraphs. For a bipartite graph G, let h(G) be the largest t such that either G or the bipartite complement of G contain K t,t . For a class F of graphs, let h(F) min h(G) G in F . We say that a bipartite graph H is strongly acyclic if neither H nor its bipartite complement contain a cycle. By Forb(n, H) we denote a set of bipartite graphs with parts of sizes n each, that do not contain H as an induced bipartite subgraph respecting the sides. One can easily show that h(Forb(n,H)) O(n 1 s ) for a positive s if H is not strongly acyclic. Here, we prove that h(Forb(n, H)) is linear in n for all strongly acyclic graphs except for four graphs.


On the Okounkov Olshanski formula for standard tableaux of skew shapes. The classical hook length formula counts the number of standard tableaux of straight shapes. In 1996, Okounkov and Olshanski found a positive formula for the number of standard Young tableaux of a skew shape. We prove various properties of this formula, including three determinantal formulas for the number of nonzero terms, an equivalence between the Okounkov Olshanski formula and another skew tableaux formula involving Knutson Tao puzzles, and two q analogues for reverse plane partitions, which complements work by Stanley and Chen for semistandard tableaux. We also give several reformulations of the formula, including two in terms of the excited diagrams appearing in a more recent skew tableaux formula by Naruse. Lastly, for thick zigzag shapes we show that the number of nonzero terms is given by a determinant of the Genocchi numbers and improve on known upper bounds by Morales Pak Panova on the number of standard tableaux of these shapes.


Lengths of Local Cohomology of Thickenings. Let R be a standard graded polynomial ring that is finitely generated over a field of characteristic 0 , let mathfrak m be the homogeneous maximal ideal of R , and let I be a homogeneous prime ideal of R . Dao and Monta n o defined an invariant that, in the case that operatorname Proj (R I) is lci and for cohomological index less than dim(R I) , measures the asymptotic growth of lengths of local cohomology modules of thickenings. They showed its existence and rationality for certain classes of monomial ideals I . The following affirms that the invariant exists and is rational for rings R mathbb C X where X is a 2 times m matrix and I is the ideal generated by size two minors and is to our knowledge, the first non monomial calculation of this invariant.


Modeling of User Portrait Through Social Media. Nowadays, massive useful data of user information and social behavior have been accumulated on the Internet, providing a possibility of profiling user's personality traits online. In this paper, we propose a psychological modeling method based on computational linguistic features to profile Big Five personality traits of users on Sina Weibo (a Twitter like microblogging service in China) and their correlations with user's social behaviors. To the best of our knowledge, this is the first research on investigating the potential relationship between profile information, social network behaviors and personality traits of users on Sina Weibo. Our results demonstrate an effective modeling approach to understanding demographic and psychological portraits of users on social media without customer disruption, which is useful for commercial incorporations to provide better personalized products and services.


A Comprehensive Review on Recent Methods and Challenges of Video Description. Video description involves the generation of the natural language description of actions, events, and objects in the video. There are various applications of video description by filling the gap between languages and vision for visually impaired people, generating automatic title suggestion based on content, browsing of the video based on the content and video guided machine translation 86 etc.In the past decade, several works had been done in this field in terms of approaches methods for video description, evaluation metrics,and datasets. For analyzing the progress in the video description task, a comprehensive survey is needed that covers all the phases of video description approaches with a special focus on recent deep learning approaches. In this work, we report a comprehensive survey on the phases of video description approaches, the dataset for video description, evaluation metrics, open competitions for motivating the research on the video description, open challenges in this field, and future research directions. In this survey, we cover the state of the art approaches proposed for each and every dataset with their pros and cons. For the growth of this research domain,the availability of numerous benchmark dataset is a basic need. Further, we categorize all the dataset into two classes open domain dataset and domain specific dataset. From our survey, we observe that the work in this field is in fast paced development since the task of video description falls in the intersection of computer vision and natural language processing. But still, the work in the video description is far from saturation stage due to various challenges like the redundancy due to similar frames which affect the quality of visual features, the availability of dataset containing more diverse content and availability of an effective evaluation metric.


A Silver Standard Corpus of Human Phenotype Gene Relations. Human phenotype gene relations are fundamental to fully understand the origin of some phenotypic abnormalities and their associated diseases. Biomedical literature is the most comprehensive source of these relations, however, we need Relation Extraction tools to automatically recognize them. Most of these tools require an annotated corpus and to the best of our knowledge, there is no corpus available annotated with human phenotype gene relations. This paper presents the Phenotype Gene Relations (PGR) corpus, a silver standard corpus of human phenotype and gene annotations and their relations. The corpus consists of 1712 abstracts, 5676 human phenotype annotations, 13835 gene annotations, and 4283 relations. We generated this corpus using Named Entity Recognition tools, whose results were partially evaluated by eight curators, obtaining a precision of 87.01 . By using the corpus we were able to obtain promising results with two state of the art deep learning tools, namely 78.05 of precision. The PGR corpus was made publicly available to the research community.


Tactile Mapping and Localization from High Resolution Tactile Imprints. This work studies the problem of shape reconstruction and object localization using a vision based tactile sensor, GelSlim. The main contributions are the recovery of local shapes from contact, an approach to reconstruct the tactile shape of objects from tactile imprints, and an accurate method for object localization of previously reconstructed objects. The algorithms can be applied to a large variety of 3D objects and provide accurate tactile feedback for in hand manipulation. Results show that by exploiting the dense tactile information we can reconstruct the shape of objects with high accuracy and do on line object identification and localization, opening the door to reactive manipulation guided by tactile sensing. We provide videos and supplemental information in the project's website http web.mit.edu mcube research tactile localization.html.


Remote Joint Strong Coordination and Reliable Communication. We consider a three node network, in which two agents wish to communicate over a noisy channel, while controlling the distribution observed by a third external agent. We use strong coordination to constrain the distribution, and we provide a complete characterization of the "remote strong coordination and reliable communication" region.


Model Based Reinforcement Learning for Type 1Diabetes Blood Glucose Control. In this paper we investigate the use of model based reinforcement learning to assist people with Type 1 Diabetes with insulin dose decisions. The proposed architecture consists of multiple Echo State Networks to predict blood glucose levels combined with Model Predictive Controller for planning. Echo State Network is a version of recurrent neural networks which allows us to learn long term dependencies in the input of time series data in an online manner. Additionally, we address the quantification of uncertainty for a more robust control. Here, we used ensembles of Echo State Networks to capture model (epistemic) uncertainty. We evaluated the approach with the FDA approved UVa Padova Type 1 Diabetes simulator and compared the results against baseline algorithms such as Basal Bolus controller and Deep Q learning. The results suggest that the model based reinforcement learning algorithm can perform equally or better than the baseline algorithms for the majority of virtual Type 1 Diabetes person profiles tested.


Uncertainty Principles for Quaternion Windowed Offset Linear Canonical Transform of Two Dimensional Signals. The offset linear canonical transform encompassing the numerous integral transforms, is a promising tool for analyzing non stationary signals with more degrees of freedom. In this paper, we generalize the windowed offset linear canonical transform for quaternion valued signals, by introducing a novel time frequency transform namely the quaternion windowed offset linear canonical transform of 2D quaternion valued signals. We initiate our investigation by studying some fundamental properties of the proposed transform including inner product relation, energy conservation, and reproducing formula by employing the machinery of quaternion offset linear canonical transforms. Some uncertainty principles such as Heisenberg Weyl, logarithmic and local uncertainty principle are also derived for quaternion windowed offset linear canonical transform. Finally, we gave an example of quaternion windowed offset linear canonical transform.


One Model to Recognize Them All Marginal Distillation from NER Models with Different Tag Sets. Named entity recognition (NER) is a fundamental component in the modern language understanding pipeline. Public NER resources such as annotated data and model services are available in many domains. However, given a particular downstream application, there is often no single NER resource that supports all the desired entity types, so users must leverage multiple resources with different tag sets. This paper presents a marginal distillation (MARDI) approach for training a unified NER model from resources with disjoint or heterogeneous tag sets. In contrast to recent works, MARDI merely requires access to pre trained models rather than the original training datasets. This flexibility makes it easier to work with sensitive domains like healthcare and finance. Furthermore, our approach is general enough to integrate with different NER architectures, including local models (e.g., BiLSTM) and global models (e.g., CRF). Experiments on two benchmark datasets show that MARDI performs on par with a strong marginal CRF baseline, while being more flexible in the form of required NER resources. MARDI also sets a new state of the art on the progressive NER task. MARDI significantly outperforms the start of the art model on the task of progressive NER.


Grundy Coloring friends, Half Graphs, Bicliques. The first fit coloring is a heuristic that assigns to each vertex, arriving in a specified order sigma , the smallest available color. The problem Grundy Coloring asks how many colors are needed for the most adversarial vertex ordering sigma , i.e., the maximum number of colors that the first fit coloring requires over all possible vertex orderings. Since its inception by Grundy in 1939, Grundy Coloring has been examined for its structural and algorithmic aspects. A brute force f(k)n 2 k 1 time algorithm for Grundy Coloring on general graphs is not difficult to obtain, where k is the number of colors required by the most adversarial vertex ordering. It was asked several times whether the dependency on k in the exponent of n can be avoided or reduced, and its answer seemed elusive until now. We prove that Grundy Coloring is W 1 hard and the brute force algorithm is essentially optimal under the Exponential Time Hypothesis, thus settling this question by the negative. The key ingredient in our W 1 hardness proof is to use so called half graphs as a building block to transmit a color from one vertex to another. Leveraging the half graphs, we also prove that b Chromatic Core is W 1 hard, whose parameterized complexity was posed as an open question by Panolan et al. JCSS '17 . A natural follow up question is, how the parameterized complexity changes in the absence of (large) half graphs. We establish fixed parameter tractability on K t,t free graphs for b Chromatic Core and Partial Grundy Coloring, making a step toward answering this question. The key combinatorial lemma underlying the tractability result might be of independent interest.


Bodies at Rest 3D Human Pose and Shape Estimation from a Pressure Image using Synthetic Data. People spend a substantial part of their lives at rest in bed. 3D human pose and shape estimation for this activity would have numerous beneficial applications, yet line of sight perception is complicated by occlusion from bedding. Pressure sensing mats are a promising alternative, but training data is challenging to collect at scale. We describe a physics based method that simulates human bodies at rest in a bed with a pressure sensing mat, and present PressurePose, a synthetic dataset with 206K pressure images with 3D human poses and shapes. We also present PressureNet, a deep learning model that estimates human pose and shape given a pressure image and gender. PressureNet incorporates a pressure map reconstruction (PMR) network that models pressure image generation to promote consistency between estimated 3D body models and pressure image input. In our evaluations, PressureNet performed well with real data from participants in diverse poses, even though it had only been trained with synthetic data. When we ablated the PMR network, performance dropped substantially.


Influence Flowers of Academic Entities. We present the Influence Flower, a new visual metaphor for the influence profile of academic entities, including people, projects, institutions, conferences, and journals. While many tools quantify influence, we aim to expose the flow of influence between entities. The Influence Flower is an ego centric graph, with a query entity placed in the centre. The petals are styled to reflect the strength of influence to and from other entities of the same or different type. For example, one can break down the incoming and outgoing influences of a research lab by research topics. The Influence Flower uses a recent snapshot of Microsoft Academic Graph, consisting of 212million authors, their 176 million publications, and 1.2 billion citations. An interactive web app, Influence Map, is constructed around this central metaphor for searching and curating visualisations. We also propose a visual comparison method that highlights change in influence patterns over time. We demonstrate through several case studies that the Influence Flower supports data driven inquiries about the following researchers' careers over time paper(s) and projects, including those with delayed recognition the interdisciplinary profile of a research institution and the shifting topical trends in conferences. We also use this tool on influence data beyond academic citations, by contrasting the academic and Twitter activities of a researcher.


Howl A Deployed, Open Source Wake Word Detection System. We describe Howl, an open source wake word detection toolkit with native support for open speech datasets, like Mozilla Common Voice and Google Speech Commands. We report benchmark results on Speech Commands and our own freely available wake word detection dataset, built from MCV. We operationalize our system for Firefox Voice, a plugin enabling speech interactivity for the Firefox web browser. Howl represents, to the best of our knowledge, the first fully productionized yet open source wake word detection toolkit with a web browser deployment target. Our codebase is at https github.com castorini howl.


Stretchable Cells Help DARTS Search Better. Differentiable neural architecture search (DARTS) has gained much success in discovering flexible and diverse cell types. To reduce the evaluation gap, the supernet is expected to have identical layers with the target network. However, even for this consistent search, the searched cells often suffer from poor performance, especially for the supernet with fewer layers, as current DARTS methods are prone to wide and shallow cells, and this topology collapse induces sub optimal searched cells. In this paper, we alleviate this issue by endowing the cells with explicit stretchability, so the search can be directly implemented on our stretchable cells for both operation type and topology simultaneously. Concretely, we introduce a set of topological variables and a combinatorial probabilistic distribution to explicitly model the target topology. With more diverse and complex topologies, our method adapts well for various layer numbers. Extensive experiments on CIFAR 10 and ImageNet show that our stretchable cells obtain better performance with fewer layers and parameters. For example, our method can improve DARTS by 0.28 accuracy on CIFAR 10 dataset with 45 parameters reduced or 2.9 with similar FLOPs on ImageNet dataset.


Interpretable End to end Urban Autonomous Driving with Latent Deep Reinforcement Learning. Unlike popular modularized framework, end to end autonomous driving seeks to solve the perception, decision and control problems in an integrated way, which can be more adapting to new scenarios and easier to generalize at scale. However, existing end to end approaches are often lack of interpretability, and can only deal with simple driving tasks like lane keeping. In this paper, we propose an interpretable deep reinforcement learning method for end to end autonomous driving, which is able to handle complex urban scenarios. A sequential latent environment model is introduced and learned jointly with the reinforcement learning process. With this latent model, a semantic birdeye mask can be generated, which is enforced to connect with a certain intermediate property in today's modularized framework for the purpose of explaining the behaviors of learned policy. The latent space also significantly reduces the sample complexity of reinforcement learning. Comparison tests with a simulated autonomous car in CARLA show that the performance of our method in urban scenarios with crowded surrounding vehicles dominates many baselines including DQN, DDPG, TD3 and SAC. Moreover, through masked outputs, the learned policy is able to provide a better explanation of how the car reasons about the driving environment. The codes and videos of this work are available at our github repo and project website.


A note on commutators on weighted Morrey spaces on spaces of homogeneous type. In this paper we study the boundedness and compactness characterizations of the commutator of Calder ' o n Zygmund operators T on spaces of homogeneous type (X,d, mu) in the sense of Coifman and Weiss. More precisely, We show that the commutator b, T is bounded on weighted Morrey space L omega p, kappa (X) ( kappa in(0,1), omega in A p (X), 1 p infty ) if and only if b is in the BMO space. Moreover, the commutator b, T is compact on weighted Morrey space L omega p, kappa (X) ( kappa in(0,1), omega in A p (X), 1 p infty ) if and only if b is in the VMO space.


SummPip Unsupervised Multi Document Summarization with Sentence Graph Compression. Obtaining training data for multi document summarization (MDS) is time consuming and resource intensive, so recent neural models can only be trained for limited domains. In this paper, we propose SummPip an unsupervised method for multi document summarization, in which we convert the original documents to a sentence graph, taking both linguistic and deep representation into account, then apply spectral clustering to obtain multiple clusters of sentences, and finally compress each cluster to generate the final summary. Experiments on Multi News and DUC 2004 datasets show that our method is competitive to previous unsupervised methods and is even comparable to the neural supervised approaches. In addition, human evaluation shows our system produces consistent and complete summaries compared to human written ones.


Next Paradigm Programming Languages What Will They Look Like and What Changes Will They Bring?. The dream of programming language design is to bring about orders of magnitude productivity improvements in software development tasks. Designers can endlessly debate on how this dream can be realized and on how close we are to its realization. Instead, I would like to focus on a question with an answer that can be, surprisingly, clearer what will be the common principles behind next paradigm, high productivity programming languages, and how will they change everyday program development? Based on my decade plus experience of heavy duty development in declarative languages, I speculate that certain tenets of high productivity languages are inevitable. These include, for instance, enormous variations in performance (including automatic transformations that change the asymptotic complexity of algorithms) a radical change in a programmer's workflow, elevating testing from a near menial task to an act of deep understanding a change in the need for formal proofs and more.


Soft Interference Cancellation for Random Coding in Massive Gaussian Multiple Access. In 2017, Polyanskiy 1 showed that the trade off between power and bandwidth efficiency for massive Gaussian random access is governed by two fundamentally different regimes low power and high power. For both regimes, tight performance bounds were found by Zadik et al. 2 , in 2019. This work utilizes recent results on the exact block error probability of Gaussian random codes in additive white Gaussian noise to propose practical methods based on iterative soft decoding to closely approach the bounds in 2 . In the low power regime, this work finds that orthogonal random codes can be applied directly. In the high power regime, a more sophisticated effort is needed. This work shows that power profile optimization by means of linear programming as pioneered by Caire et al. 3 , in 2001, is a promising strategy to apply. The proposed combination of orthogonal random coding and iterative soft decoding even outperforms the existence bounds of Zadik et al. 2 in the low power regime and is very close to the non existence bounds for message lengths around 100 and above. Finally, the approach of power optimization by linear programming proposed for the high power regime is found to benefit from power imbalances due to fading which makes is even more attractive for typical mobile radio channels.


When Pull Turns to Shove A Continuous Time Model for Opinion Dynamics. Accurate modeling of opinion dynamics has the potential to help us understand polarization and what makes effective political discourse possible or impossible. Here, we use physics based methods to model the evolution of political opinions within a continuously distributed population. We utilize a network free system of determining political influence and a local attraction, distal repulsion dynamic for reaction to perceived content. Our approach allows for the incorporation of intergroup bias such that messages from trusted in group sources enjoy greater leeway than out group ones. We are able to extrapolate these nonlinear microscopic dynamics to macroscopic population distributions by using probabilistic functions representing biased environments. The framework we put forward can reproduce real world political distributions and experimentally observed dynamics, and is amenable to further refinement as more data becomes available.


Mellin Barnes presentations for Whittaker wave functions. We obtain certain Mellin Barnes integrals which present Whittaker wave functions related to classical real split forms of simple complex Lie groups.


Lossless Size Reduction for Integer Least Squares with Application to Sphere Decoding. Minimum achievable complexity (MAC) for a maximum likelihood (ML) performance achieving detection algorithm is derived. Using the derived MAC, we prove that the conventional sphere decoding (SD) algorithms suffer from an inherent weakness at low SNRs. To find a solution for the low SNR deficiency, we analyze the effect of zero forcing (ZF) and minimum mean square error (MMSE) detected symbols on the MAC and demonstrate that although they both improve the SD algorithm in terms of the computational complexity, the MMSE point has a vital difference at low SNRs. By exploiting the information provided by the MMSE method, we prove the existence of a lossless size reduction which can be interpreted as the feasibility of a detection method which is capable of detecting the ML symbol without visiting any nodes at low and high SNRs. We also propose a lossless size reduction aided detection method which achieves the promised complexity bounds marginally and reduces the overall computational complexity significantly, while obtaining the ML performance. The theoretical analysis is corroborated with numerical simulations.


A simulation tool for MRPC telescopes of the EEE project. The Extreme Energy Events (EEE) Project is mainly devoted to the study of the secondary cosmic ray radiation by using muon tracker telescopes made of three Multigap Resistive Plate Chambers (MRPC) each. The experiment consists of a telescope network mainly distributed across Italy, hosted in different building structures pertaining to high schools, universities and research centers. Therefore, the possibility to take into account the effects of these structures on collected data is important for the large physics programme of the project. A simulation tool, based on GEANT4 and using GEMC framework, has been implemented to take into account the muon interaction with EEE telescopes and to estimate the effects on data of the structures surrounding the experimental apparata.A dedicated event generator producing realistic muon distributions, detailed geometry and microscopic behavior of MRPCs have been included to produce experimental like data. The comparison between simulated and experimental data, and the estimation of detector resolutions is here presented and discussed.


Rubik A Hierarchical Architecture for Efficient Graph Learning. Graph convolutional network (GCN) emerges as a promising direction to learn the inductive representation in graph data commonly used in widespread applications, such as E commerce, social networks, and knowledge graphs. However, learning from graphs is non trivial because of its mixed computation model involving both graph analytics and neural network computing. To this end, we decompose the GCN learning into two hierarchical paradigms graph level and node level computing. Such a hierarchical paradigm facilitates the software and hardware accelerations for GCN learning. We propose a lightweight graph reordering methodology, incorporated with a GCN accelerator architecture that equips a customized cache design to fully utilize the graph level data reuse. We also propose a mapping methodology aware of data reuse and task level parallelism to handle various graphs inputs effectively. Results show that Rubik accelerator design improves energy efficiency by 26.3x to 1375.2x than GPU platforms across different datasets and GCN models.


Finitely Presentable Algebras For Finitary Monads. For finitary regular monads T on locally finitely presentable categories we characterize the finitely presentable objects in the category of T algebras in the style known from general algebra they are precisely the algebras presentable by finitely many generators and finitely many relations.


Playing Unique Games on Certified Small Set Expanders. We give an algorithm for solving unique games (UG) instances whenever low degree sum of squares proofs certify good bounds on the small set expansion of the underlying constraint graph via a hypercontractive inequality. Our algorithm is in fact more versatile, and succeeds even when the constraint graph is not a small set expander as long as the structure of non expanding small sets is (informally speaking) "characterized" by a low degree sum of squares proof. Our results are obtained by rounding emph low entropy solutions measured via a new global potential function to sum of squares (SoS) semidefinite programs. This technique adds to the (currently short) list of general tools for analyzing SoS relaxations for emph worst case optimization problems. As corollaries, we obtain the first polynomial time algorithms for solving any UG instance where the constraint graph is either the emph noisy hypercube , the emph short code or the emph Johnson graph. The prior best algorithm for such instances was the eigenvalue enumeration algorithm of Arora, Barak, and Steurer (2010) which requires quasi polynomial time for the noisy hypercube and nearly exponential time for the short code and Johnson graphs. All of our results achieve an approximation of 1 epsilon vs delta for UG instances, where epsilon 0 and delta 0 depend on the expansion parameters of the graph but are independent of the alphabet size.


Reposing Humans by Warping 3D Features. We address the problem of reposing an image of a human into any desired novel pose. This conditional image generation task requires reasoning about the 3D structure of the human, including self occluded body parts. Most prior works are either based on 2D representations or require fitting and manipulating an explicit 3D body mesh. Based on the recent success in deep learning based volumetric representations, we propose to implicitly learn a dense feature volume from human images, which lends itself to simple and intuitive manipulation through explicit geometric warping. Once the latent feature volume is warped according to the desired pose change, the volume is mapped back to RGB space by a convolutional decoder. Our state of the art results on the DeepFashion and the iPER benchmarks indicate that dense volumetric human representations are worth investigating in more detail.


The leverage effect and other stylized facts displayed by Bitcoin returns. In this paper, we explore some stylized facts of the Bitcoin market using the BTC USD exchange rate time series of historical intraday data from 2013 to 2020. Bitcoin presents some very peculiar idiosyncrasies, like the absence of macroeconomic fundamentals or connections with underlying assets or benchmarks, an asymmetry between demand and supply and the presence of inefficiency in the form of strong arbitrage opportunity. Nevertheless, all these elements seem to be marginal in the definition of the structural statistical properties of this virtual financial asset, which result to be analogous to general individual stocks or indices. In contrast, we find some clear differences, compared to fiat money exchange rates time series, in the values of the linear autocorrelation and, more surprisingly, in the presence of the leverage effect. We also explore the dynamics of correlations, monitoring the shifts in the evolution of the Bitcoin market. This analysis is able to distinguish between two different regimes a stochastic process with weaker memory signatures and closer to Gaussianity between the Mt. Gox incident and the late 2015, and a dynamics with relevant correlations and strong deviations from Gaussianity before and after this interval.


FFCI A Framework for Interpretable Automatic Evaluation of Summarization. In this paper, we propose FFCI, a framework for fine grained summarization evaluation that comprises four elements faithfulness (degree of factual consistency with the source), focus (precision of summary content relative to the reference), coverage (recall of summary content relative to the reference), and inter sentential coherence (document fluency between adjacent sentences). We construct a novel dataset for focus, coverage, and inter sentential coherence, and develop automatic methods for evaluating each of the four dimensions of FFCI based on cross comparison of evaluation metrics and model based evaluation methods, including question answering (QA) approaches, semantic textual similarity (STS), next sentence prediction (NSP), and scores derived from 19 pre trained language models. We then apply the developed metrics in evaluating a broad range of summarization models across two datasets, with some surprising findings.


Deformation classes in generalized K "ahler geometry. We introduce natural deformation classes of generalized K "ahler structures using the Courant symmetry group. We show that these yield natural extensions of the notions of K "ahler class and K "ahler cone to generalized K "ahler geometry. Lastly we show that the generalized K "ahler Ricci flow preserves this generalized K "ahler cone, and the underlying real Poisson tensor.


On the fractional operators with respect to another function. This paper is in concern with Cauchy problems involving the fractional derivatives with respect to another function. Results of existence, uniqueness, and Taylor series among others are established in appropriate functional spaces. We prove that these results are valid at once for several standard fractional operators such as the Riemann Liouville and Caputo operators, the Hadamard operators, the Erd 'elyi Kober operators, etc., depending on the choice of the scaling function. We also show that our technique can be useful to solve a wide range of Volterra integral equations. The numerical approximation of solutions of systems involving the fractional derivatives with respect to another function is also investigated and the optimal convergence rate of the schemes is reached in graded meshes, even in the case of singular solutions. Various examples and numerical tests, with an application to the Erd 'elyi Kober operators, are performed at the end to illustrate the efficiency of the proposed approach.


A formula for systems of Boolean polynomial equations and applications to computational complexity. It is known a method for converting a system of Boolean polynomial equations to a single Boolean polynomial equation with less variables. In this paper, we show a formula for systems of Boolean polynomial equations which is based on the method. The formula has a structure of binary tree, and conforms to De Morgan's duality. Using the formula, we prove a computational complexity result with a parameter for solving systems. The parameter is the bandwidth in matrix and graph theories to be precise, the definition follows convention in matrix and the value depends on the order of variables. We also apply the result to the NP complete problems, SAT and graph list coloring, to show that these problems are fixed parameter tractable by bandwidth.


Watermarking Graph Neural Networks by Random Graphs. Many learning tasks require us to deal with graph data which contains rich relational information among elements, leading increasing graph neural network (GNN) models to be deployed in industrial products for improving the quality of service. However, they also raise challenges to model authentication. It is necessary to protect the ownership of the GNN models, which motivates us to present a watermarking method to GNN models in this paper. In the proposed method, an Erdos Renyi (ER) random graph with random node feature vectors and labels is randomly generated as a trigger to train the GNN to be protected together with the normal samples. During model training, the secret watermark is embedded into the label predictions of the ER graph nodes. During model verification, by activating a marked GNN with the trigger ER graph, the watermark can be reconstructed from the output to verify the ownership. Since the ER graph was randomly generated, by feeding it to a non marked GNN, the label predictions of the graph nodes are random, resulting in a low false alarm rate (of the proposed work). Experimental results have also shown that, the performance of a marked GNN on its original task will not be impaired. Moreover, it is robust against model compression and fine tuning, which has shown the superiority and applicability.


An invitation to the study of a uniqueness problem. In this very short paper, we provide a strong motivation for the study of the following problem given a real normed space E , a closed, convex, unbounded set X subseteq E and a function f X to X , find suitable conditions under which, for each y in X , the function x to x f(x) y f(x) has at most one global minimum in X .


Pattern Avoiding (0,1) Matrices. We investigate pattern avoiding (0,1) matrices as generalizations of pattern avoiding permutations. Our emphasis is on 123 avoiding and 321 avoiding patterns for which we obtain exact results as to the maximum number of 1's such matrices can have. We also give algorithms when carried out in all possible ways, construct all of the pattern avoiding matrices of these two types.


Inline Vector Compression for Computational Physics. A novel inline data compression method is presented for single precision vectors in three dimensions. The primary application of the method is for accelerating computational physics calculations where the throughput is bound by memory bandwidth. The scheme employs spherical polar coordinates, angle quantisation, and a bespoke floating point representation of the magnitude to achieve a fixed compression ratio of 1.5. The anisotropy of this method is considered, along with companding and fractional splitting techniques to improve the efficiency of the representation. We evaluate the scheme numerically within the context of high order computational fluid dynamics. For both the isentropic convecting vortex and the Taylor Green vortex test cases, the results are found to be comparable to those without compression. Performance is evaluated for a vector addition kernel on an NVIDIA Titan V GPU it is demonstrated that a speedup of 1.5 can be achieved.