Natural oscillations of a sessile drop on flat surfaces with mobile contact lines. Oscillation of sessile drops is important to many applications. In the present study, the natural oscillation of a sessile drop on flat surfaces with free contact lines (FCL) is investigated through numerical and theoretical analysis. The FCL condition represents a limit of contact line mobility, i.e. the contact angle remains constant when the contact line moves. In the numerical simulation, the interfaces are captured by the volume of fluid method and the contact angle at the boundary is specified using the height function method. The oscillation frequencies for sessile drops with FCL are mainly controlled by the contact angle and the Bond number and a parametric study is carried out to characterize their effects on the frequencies for the first and high order modes. Particular attention is paid to the frequency of the first mode, since it is usually the dominant mode. An inviscid theoretical model for the first mode is developed. The model yields an explicit expression for the first mode frequency as a function of the contact angle and the Bond number, with all parameters involved fully determined by the equilibrium drop theory and the simulation. The predicted frequencies for a wide range of contact angles agree very well with the simulation results for small Bond numbers. The frequencies for both the first and high order modes decrease with the contact angle and increase with the Bond number. For the high order modes, the frequencies for different modes generally scale with the Rayleigh frequencies. The scaling relation performs better for small Bond numbers and large contact angles. A simple model is proposed to predict the frequencies of high order modes for large contact angles and a good agreement with the simulation results is observed.


Receding Horizon Task and Motion Planning in Changing Environments. Complex manipulation tasks require careful integration of symbolic reasoning and motion planning. This problem, commonly referred to as Task and Motion Planning (TAMP), is even more challenging if the workspace is non static, e.g. due to human interventions and perceived with noisy non ideal sensors. This work proposes an online approximated TAMP method that combines a geometric reasoning module and a motion planner with a standard task planner in a receding horizon fashion. Our approach iteratively solves a reduced planning problem over a receding window of a limited number of future actions during the implementation of the actions. Thus, only the first action of the horizon is actually scheduled at each iteration, then the window is moved forward, and the problem is solved again. This procedure allows to naturally take into account potential changes in the scene while ensuring good runtime performance. We validate our approach within extensive experiments in a simulated environment. We showed that our approach is able to deal with unexpected changes in the environment while ensuring comparable performance with respect to other recent TAMP approaches in solving traditional static benchmarks. We release with this paper the open source implementation of our method.


Understanding Spatial Relations through Multiple Modalities. Recognizing spatial relations and reasoning about them is essential in multiple applications including navigation, direction giving and human computer interaction in general. Spatial relations between objects can either be explicit expressed as spatial prepositions, or implicit expressed by spatial verbs such as moving, walking, shifting, etc. Both these, but implicit relations in particular, require significant common sense understanding. In this paper, we introduce the task of inferring implicit and explicit spatial relations between two entities in an image. We design a model that uses both textual and visual information to predict the spatial relations, making use of both positional and size information of objects and image embeddings. We contrast our spatial model with powerful language models and show how our modeling complements the power of these, improving prediction accuracy and coverage and facilitates dealing with unseen subjects, objects and relations.


Effective equidistribution of horospherical flows in infinite volume rank one homogeneous spaces. We prove effective equidistribution of horospherical flows in operatorname SO (n,1) circ Gamma when Gamma is geometrically finite and the frame flow is exponentially mixing for the Bowen Margulis Sullivan measure. We also discuss settings in which such an exponential mixing result is known to hold. As part of the proof, we show that the Patterson Sullivan measure satisfies some friendly like properties when Gamma is geometrically finite.


A Frustratingly Easy Approach for Entity and Relation Extraction. End to end relation extraction aims to identify named entities and extract relations between them. Most recent work models these two subtasks jointly, either by casting them in one structured prediction framework, or performing multi task learning through shared representations. In this work, we present a simple pipelined approach for entity and relation extraction, and establish the new state of the art on standard benchmarks (ACE04, ACE05 and SciERC), obtaining a 1.7 2.8 absolute improvement in relation F1 over previous joint models with the same pre trained encoders. Our approach essentially builds on two independent encoders and merely uses the entity model to construct the input for the relation model. Through a series of careful examinations, we validate the importance of learning distinct contextual representations for entities and relations, fusing entity information early in the relation model, and incorporating global context. Finally, we also present an efficient approximation to our approach which requires only one pass of both entity and relation encoders at inference time, achieving an 8 16 times speedup with a slight reduction in accuracy.


Factorial supersymmetric skew Schur functions and ninth variation determinantal identities. The determinantal identities of Hamel and Goulden have recently been shown to apply to a tableau based ninth variation of skew Schur functions. Here we extend this approach and its results to the analogous tableau based ninth variation of supersymmetric skew Schur functions. These tableaux are built on entries taken from an alphabet of unprimed and primed numbers and that may be ordered in a myriad of different ways, each leading to a determinantal identity. At the level of the ninth variation the corresponding determinantal identities are all distinct but the original notion of supersymmetry is lost. It is shown that this can be remedied at the level of the sixth variation involving a doubly infinite sequence of factorial parameters. Moreover it is shown that the resulting factorial supersymmetric skew Schur functions are independent of the ordering of the unprimed and primed entries in the alphabet.


Resolvent conditions and growth of powers of operators on L p spaces. Let T be a bounded linear operator on L p . We study the rate of growth of the norms of the powers of T under resolvent conditions or Ces aro boundedness assumptions. Actually the relevant properties of L p spaces in our study are their type and cotype, and for 1 p infty , the fact that they are UMD. Some of the proofs make use of Fourier multipliers on Banach spaces, which explains why UMD spaces come into play.


A Psychology of Visualization or (External) Representation?. What is a visualization? There is limited utility in trifling with definitions, except insofar as one serves as a tool for communicating and conceptualizing our subject matter a statement of identity for a community. To establish Visualization Psychology as a viable inter disciplinary research programme, we must first define the object(s) of our collective inquiry. I propose that while we might refer to the study of "visualization" for the term's colloquial accessibility and pragmatic alignment with other fields, we should consider for exploration a class of artifacts and corresponding processes more expansive and profound external representations. What follows is an argument for the study of external representation as the foundation for a new interdisciplinary endeavor, and approach to mapping the corresponding problem space.


A connection between bacterial chemotactic network and optimal filtering. The chemotactic network of Escherichia coli has been studied extensively both biophysically and information theoretically. Nevertheless, the connection between these two aspects is still elusive. In this work, we report such a connection by showing that a standard biochemical model of the chemotactic network is mathematically equivalent to an information theoretically optimal filtering dynamics. Moreover, we demonstrate that an experimentally observed nonlinear response relation can be reproduced from the optimal dynamics. These results suggest that the biochemical network of E. coli chemotaxis is designed to optimally extract gradient information in a noisy condition.


Feynman categories and Representation Theory. We give a presentation of Feynman categories from a representation theoretical viewpoint. Feynman categories are a special type of monoidal categories and their representations are monoidal functors. They can be viewed as a far reaching generalization of groups, algebras and modules. Taking a new algebraic approach, we provide more examples and more details for several key constructions. This leads to new applications and results. The text is intended to be a self contained basis for a crossover of more elevated constructions and results in the fields of representation theory and Feynman categories, whose applications so far include number theory, geometry, topology and physics.


Generating large scale free networks with the Chung Lu random graph model. Random graph models are a recurring tool of the trade for studying network structural properties and benchmarking community detection and other network algorithms. Moreover, they serve as test bed generators for studying diffusion and routing processes on networks. In this paper, we illustrate how to generate large random graphs having a power law degree distribution using the Chung Lu model. In particular, we are concerned with the fulfilment of a fundamental hypothesis that must be placed on the model parameters, without which the generated graphs lose all the theoretical properties of the model, notably, the controllability of the expected node degrees and the absence of correlations between the degrees of two nodes joined by an edge. We provide explicit formulas for the model parameters to generate random graphs that have several desirable properties, including a power law degree distribution with any exponent larger than 2 , a prescribed asymptotic behaviour of the largest and average expected degrees, and the presence of a giant component.


On normalizers of maximal tori in classical Lie groups. The normalizer N G(H G) of a maximal torus H G in a semisimple complex Lie group G does not in general allow a presentation as a semidirect product of H G and the corresponding Weyl group W G . Meanwhile, splitting holds for classical groups corresponding to the root systems A ell , B ell , D ell . For the remaining classical groups corresponding to the root systems C ell there still exists an embedding of the Tits extension of W G into normalizer N G(H G) . We provide explicit unified construction of the lifts of the Weyl groups into normalizers of maximal tori for classical Lie groups corresponding to the root systems A ell , B ell , D ell using embeddings into general linear Lie groups. For symplectic series of classical Lie groups we provide an explanation of impossibility of embedding of the Weyl group into the symplectic group. The explicit formula for adjoint action of the lifts of the Weyl groups on mathfrak g rm Lie (G) are given. Finally some examples of the groups closely associated with classical Lie groups are considered.


Mapping class group actions from Hopf monoids and ribbon graphs. We show that any pivotal Hopf monoid H in a symmetric monoidal category mathcal C gives rise to actions of mapping class groups of oriented surfaces of genus g geq 1 with n geq 1 boundary components. These mapping class group actions are given by group homomorphisms into the group of automorphisms of certain Yetter Drinfeld modules over H . They are associated with edge slides in embedded ribbon graphs that generalise chord slides in chord diagrams. We give a concrete description of these mapping class group actions in terms of generating Dehn twists and defining relations. For the case where mathcal C is finitely complete and cocomplete, we also obtain actions of mapping class groups of closed surfaces by imposing invariance and coinvariance under the Yetter Drinfeld module structure.


Towards an Open Platform for Legal Information. Recent advances in the area of legal information systems have led to a variety of applications that promise support in processing and accessing legal documents. Unfortunately, these applications have various limitations, e.g., regarding scope or extensibility. Furthermore, we do not observe a trend towards open access in digital libraries in the legal domain as we observe in other domains, e.g., economics of computer science. To improve open access in the legal domain, we present our approach for an open source platform to transparently process and access Legal Open Data. This enables the sustainable development of legal applications by offering a single technology stack. Moreover, the approach facilitates the development and deployment of new technologies. As proof of concept, we implemented six technologies and generated metadata for more than 250,000 German laws and court decisions. Thus, we can provide users of our platform not only access to legal documents, but also the contained information.


Universal transfer and stacking technique of van der Waals heterostructures for spintronics. The key to achieving high quality van der Waals heterostructure devices made from various two dimensional (2D) materials lies in the control over clean and flexible interfaces. However, existing transfer methods based on different mediators possess insufficiencies including the presence of residues, the unavailability of flexible interface engineering, and the selectivity towards materials and substrates since their adhesions differ considerably with the various preparation conditions, from chemical vapor deposition (CVD) growth to mechanical exfoliation. In this paper, we introduce a more universal method using a prefabricated polyvinyl alcohol (PVA) film to transfer and stack 2D materials, whether they are prepared by CVD or exfoliation. This peel off and drop off technique promises an ideal interface of the materials without introducing contamination. In addition, the method exhibits a micron scale spatial transfer accuracy and meets special experimental conditions such as the preparation of twisted graphene and the 2D metal heterostructure construction. We illustrate the superiority of this method with a WSe2 vertical spin valve device, whose performance verifies the applicability and advantages of such a method for spintronics. Our PVA assisted transfer process will promote the development of high performance 2D material based devices.


A Variational Auto Encoder Model for Stochastic Point Processes. We propose a novel probabilistic generative model for action sequences. The model is termed the Action Point Process VAE (APP VAE), a variational auto encoder that can capture the distribution over the times and categories of action sequences. Modeling the variety of possible action sequences is a challenge, which we show can be addressed via the APP VAE's use of latent representations and non linear functions to parameterize distributions over which event is likely to occur next in a sequence and at what time. We empirically validate the efficacy of APP VAE for modeling action sequences on the MultiTHUMOS and Breakfast datasets.


Notes on Backward Stochastic Differential Equations for Computing XVA. The X valuation adjustment (XVA) problem, which is a recent topic in mathematical finance, is considered and analyzed. First, the basic properties of backward stochastic differential equations (BSDEs) with a random horizon in a progressively enlarged filtration are reviewed. Next, the pricing hedging problem for defaultable over the counter (OTC) derivative securities is described using such BSDEs. An explicit sufficient condition is given to ensure the non existence of an arbitrage opportunity for both the seller and buyer of the derivative securities. Furthermore, an explicit pricing formula is presented in which XVA is interpreted as approximated correction terms of the theoretical fair price.


Lower Bounds Against Sparse Symmetric Functions of ACC Circuits Expanding the Reach of SAT Algorithms. We continue the program of proving circuit lower bounds via circuit satisfiability algorithms. So far, this program has yielded several concrete results, proving that functions in text Quasi NP text NTIME n ( log n) O(1) and text NEXP do not have small circuits from various circuit classes cal C , by showing that cal C admits non trivial satisfiability and or SAT algorithms which beat exhaustive search by a minor amount. In this paper, we present a new strong lower bound consequence of non trivial SAT algorithm for a circuit class mathcal C . Say a symmetric Boolean function f(x 1, ldots,x n) is sparse if it outputs 1 on O(1) values of sum i x i . We show that for every sparse f , and for all "typical" cal C , faster SAT algorithms for cal C circuits actually imply lower bounds against the circuit class f circ cal C , which may be stronger than cal C itself. In particular SAT algorithms for n k size cal C circuits running in 2 n n k time (for all k ) imply text NEXP does not have f circ cal C circuits of polynomial size. SAT algorithms for 2 n epsilon size cal C circuits running in 2 n n epsilon time (for some epsilon 0 ) imply text Quasi NP does not have f circ cal C circuits of polynomial size. Applying SAT algorithms from the literature, one immediate corollary of our results is that text Quasi NP does not have text EMAJ circ text ACC 0 circ text THR circuits of polynomial size, where text EMAJ is the "exact majority" function, improving previous lower bounds against text ACC 0 Williams JACM'14 and text ACC 0 circ text THR Williams STOC'14 , Murray Williams STOC'18 . This is the first nontrivial lower bound against such a circuit class.


Retracing some paths in categorical semantics From process propositions as types to categorified reals and computers. The logical parallelism of propositional connectives and type constructors extends beyond the static realm of predicates, to the dynamic realm of processes. Understanding the logical parallelism of process propositions and dynamic types was one of the central problems of the semantics of computation, albeit not always clear or explicit. It sprung into clarity through the early work of Samson Abramsky, where the central ideas of denotational semantics and process calculus were brought together and analyzed by categorical tools, e.g. in the structure of interaction categories. While some logical structures borne of dynamics of computation immediately started to emerge, others had to wait, be it because the underlying logical principles (mainly those arising from coinduction) were not yet sufficiently well understood, or simply because the research community was more interested in other semantical tasks. Looking back, it seems that the process logic uncovered by those early semantical efforts might still be starting to emerge and that the vast field of results that have been obtained in the meantime might be a valley on a tip of an iceberg. In the present paper, I try to provide a logical overview of the gamut of interaction categories and to distinguish those that model computation from those that capture processes in general. The main coinductive constructions turn out to be of this latter kind, as illustrated towards the end of the paper by a compact category of all real numbers as processes, computable and uncomputable, with polarized bisimulations as morphisms. The addition of the reals arises as the biproduct, real vector spaces are the enriched bicompletions, and linear algebra arises from the enriched kan extensions. At the final step, I sketch a structure that characterizes the computable fragment of categorical semantics.


Hit Detector Hierarchical Trinity Architecture Search for Object Detection. Neural Architecture Search (NAS) has achieved great success in image classification task. Some recent works have managed to explore the automatic design of efficient backbone or feature fusion layer for object detection. However, these methods focus on searching only one certain component of object detector while leaving others manually designed. We identify the inconsistency between searched component and manually designed ones would withhold the detector of stronger performance. To this end, we propose a hierarchical trinity search framework to simultaneously discover efficient architectures for all components (i.e. backbone, neck, and head) of object detector in an end to end manner. In addition, we empirically reveal that different parts of the detector prefer different operators. Motivated by this, we employ a novel scheme to automatically screen different sub search spaces for different components so as to perform the end to end search for each component on the corresponding sub search space efficiently. Without bells and whistles, our searched architecture, namely Hit Detector, achieves 41.4 mAP on COCO minival set with 27M parameters. Our implementation is available at https github.com ggjy HitDet.pytorch.


Geometric filling curve on punctured surfaces. This paper is about a type of quantitative density of closed geodesics and orthogeodesics on complete finite area hyperbolic surfaces. The main results are upper bounds on the length of the shortest closed geodesic and the shortest doubly truncated orthogeodesic that are varepsilon dense on a given compact set on the surface.


The spectrum of derived Mackey functors. We compute the spectrum of the category of derived Mackey functors (in the sense of Kaledin) for all finite groups. We find that this space captures precisely the top and bottom layers (i.e. the height infinity and height zero parts) of the spectrum of the equivariant stable homotopy category. Due to this truncation of the chromatic information, we are able to obtain a complete description of the spectrum for all finite groups, despite our incomplete knowledge of the topology of the spectrum of the equivariant stable homotopy category. From a different point of view, we show that the spectrum of derived Mackey functors can be understood as the space obtained from the spectrum of the Burnside ring by "ungluing" closed points. In order to compute the spectrum, we provide a new description of Kaledin's category, as the derived category of an equivariant ring spectrum, which may be of independent interest. In fact, we clarify the relationship between several different categories, establishing symmetric monoidal equivalences and comparisons between the constructions of Kaledin, the spectral Mackey functors of Barwick, the ordinary derived category of Mackey functors, and categories of modules over certain equivariant ring spectra. We also illustrate an interesting feature of the ordinary derived category of Mackey functors that distinguishes it from other equivariant categories relating to the behavior of its geometric fixed points.


The graph minor theorem in topological combinatorics. We study a variety of natural constructions from topological combinatorics, including matching complexes as well as other graph complexes, from the perspective of the graph minor category of the authors previous work with Proudfoot. We prove that these complexes must have universally bounded torsion in their homology across all graphs. One may think of these results as arising from an algebraic version of the graph minor theorem of Robertson and Seymour.


FiD Ex Improving Sequence to Sequence Models for Extractive Rationale Generation. Natural language (NL) explanations of model predictions are gaining popularity as a means to understand and verify decisions made by large black box pre trained models, for NLP tasks such as Question Answering (QA) and Fact Verification. Recently, pre trained sequence to sequence (seq2seq) models have proven to be very effective in jointly making predictions, as well as generating NL explanations. However, these models have many shortcomings they can fabricate explanations even for incorrect predictions, they are difficult to adapt to long input documents, and their training requires a large amount of labeled data. In this paper, we develop FiD Ex, which addresses these shortcomings for seq2seq models by 1) introducing sentence markers to eliminate explanation fabrication by encouraging extractive generation, 2) using the fusion in decoder architecture to handle long input contexts, and 3) intermediate fine tuning on re structured open domain QA datasets to improve few shot performance. FiD Ex significantly improves over prior work in terms of explanation metrics and task accuracy, on multiple tasks from the ERASER explainability benchmark, both in the fully supervised and in the few shot settings.


Human Action Recognition with Deep Temporal Pyramids. Deep convolutional neural networks (CNNs) are nowadays achieving significant leaps in different pattern recognition tasks including action recognition. Current CNNs are increasingly deeper, data hungrier and this makes their success tributary of the abundance of labeled training data. CNNs also rely on max average pooling which reduces dimensionality of output layers and hence attenuates their sensitivity to the availability of labeled data. However, this process may dilute the information of upstream convolutional layers and thereby affect the discrimination power of the trained representations, especially when the learned categories are fine grained. In this paper, we introduce a novel hierarchical aggregation design, for final pooling, that controls granularity of the learned representations w.r.t the actual granularity of action categories. Our solution is based on a tree structured temporal pyramid that aggregates outputs of CNNs at different levels. Top levels of this hierarchy are dedicated to coarse categories while deep levels are more suitable to fine grained ones. The design of our temporal pyramid is based on solving a constrained minimization problem whose solution corresponds to the distribution of weights of different representations in the temporal pyramid. Experiments conducted using the challenging UCF101 database show the relevance of our hierarchical design w.r.t other related methods.


Asymptotic Pairs for Interval Exchange Transformations. We provide a simple description of asymptotic pairs in the subshift associated with an interval exchange transformation and show that, under reasonably general conditions, doubly asymptotic pairs do not occur.


Emerging Disentanglement in Auto Encoder Based Unsupervised Image Content Transfer. We study the problem of learning to map, in an unsupervised way, between domains A and B, such that the samples b in B contain all the information that exists in samples a in A and some additional information. For example, ignoring occlusions, B can be people with glasses, A people without, and the glasses, would be the added information. When mapping a sample a from the first domain to the other domain, the missing information is replicated from an independent reference sample b in B. Thus, in the above example, we can create, for every person without glasses a version with the glasses observed in any face image. Our solution employs a single two pathway encoder and a single decoder for both domains. The common part of the two domains and the separate part are encoded as two vectors, and the separate part is fixed at zero for domain A. The loss terms are minimal and involve reconstruction losses for the two domains and a domain confusion term. Our analysis shows that under mild assumptions, this architecture, which is much simpler than the literature guided translation methods, is enough to ensure disentanglement between the two domains. We present convincing results in a few visual domains, such as no glasses to glasses, adding facial hair based on a reference image, etc.


Beam tracing domain decomposition method for urban acoustic pollution. This paper covers the fast solution of large acoustic problems on low resources parallel platforms. A domain decomposition method is coupled with a dynamic load balancing scheme to efficiently accelerate a geometrical acoustic method. The geometrical method studied implements a beam tracing method where intersections are handled as in a ray tracing method. Beyond the distribution of the global processing upon multiple sub domains, a second parallelization level is operated by means of multi threading and shared memory mechanisms. Numerical experiments show that this method allows to handle large scale open domains for parallel computing purposes on few machines. Urban acoustic pollution arrising from car traffic was simulated on a large model of the Shinjuku district of Tokyo, Japan. The good speed up results illustrate the performance of this new domain decomposition method.


Construction of Poincar 'e type series by generating kernels. Let Gamma subset textrm PSL 2( mathbb R ) be a Fuchsian group of the first kind having a fundamental domain with a finite hyperbolic area, and let widetilde Gamma be its cover in textrm SL 2( mathbb R ) . Consider the space of twice continuously differentiable, square integrable functions on the hyperbolic upper half plane, which transform in a suitable way with respect to a multiplier system of weight k in mathbb R under the action of widetilde Gamma . The space of such functions admits the action of the hyperbolic Laplacian Delta k of weight k . Following an approach of Jorgenson, von Pippich and Smajlovi 'c (where k 0 ), we use the spectral expansion associated to Delta k to construct a wave distribution and then identify the conditions on its test functions under which it represents automorphic kernels and further gives rise to Poincar 'e type series. An advantage of this method is that the resulting series may be naturally meromorphically continued to the whole complex plane. Additionally, we derive sup norm bounds for the eigenfunctions in the discrete spectrum of Delta k .


Learning on a Grassmann Manifold CSI Quantization for Massive MIMO Systems. This paper focuses on the design of beamforming codebooks that maximize the average normalized beamforming gain for any underlying channel distribution. While the existing techniques use statistical channel models, we utilize a model free data driven approach with foundations in machine learning to generate beamforming codebooks that adapt to the surrounding propagation conditions. The key technical contribution lies in reducing the codebook design problem to an unsupervised clustering problem on a Grassmann manifold where the cluster centroids form the finite sized beamforming codebook for the channel state information (CSI), which can be efficiently solved using K means clustering. This approach is extended to develop a remarkably efficient procedure for designing product codebooks for full dimension (FD) multiple input multiple output (MIMO) systems with uniform planar array (UPA) antennas. Simulation results demonstrate the capability of the proposed design criterion in learning the codebooks, reducing the codebook size and producing noticeably higher beamforming gains compared to the existing state of the art CSI quantization techniques.


MCMH Learning Multi Chain Multi Hop Rules for Knowledge Graph Reasoning. Multi hop reasoning approaches over knowledge graphs infer a missing relationship between entities with a multi hop rule, which corresponds to a chain of relationships. We extend existing works to consider a generalized form of multi hop rules, where each rule is a set of relation chains. To learn such generalized rules efficiently, we propose a two step approach that first selects a small set of relation chains as a rule and then evaluates the confidence of the target relationship by jointly scoring the selected chains. A game theoretical framework is proposed to this end to simultaneously optimize the rule selection and prediction steps. Empirical results show that our multi chain multi hop (MCMH) rules result in superior results compared to the standard single chain approaches, justifying both our formulation of generalized rules and the effectiveness of the proposed learning framework.


On parabolic convergence of positive solutions of the heat equation. In this article, we study certain type of boundary behaviour of positive solutions of the heat equation on the upper half space of R n 1 . We prove that the existence of the parabolic limit of a positive solution of the heat equation at a point in the boundary is equivalent to the existence of the strong derivative of the boundary measure of the solution at that point. Moreover, the parabolic limit and the strong derivative are equal.


A chance constrained dial a ride problem with utility maximizing demand and multiple pricing structures. The classic Dial A Ride Problem (DARP) aims at designing the minimum cost routing that accommodates a set of user requests under constraints at an operations planning level, where users' preferences and revenue management are often overlooked. In this paper, we present a mechanism for accepting rejecting user requests in a Demand Responsive Transportation (DRT) context based on the representative utilities of alternative transportation modes. We consider utility maximizing users and propose a mixed integer programming formulation for a Chance Constrained DARP (CC DARP), that captures users' preferences in the long run via a Logit model. We further introduce class based user groups and consider various pricing structures for DRT services. A customised local search based heuristic is developed to solve the proposed CC DARP. We report numerical results for both DARP benchmarking instances and a realistic case study based on New York City yellow taxi trip data. Computational experiments performed on 105 benchmarking instances with up to 96 nodes yield an average optimality gap of 2.69 using the proposed local search heuristic. The results obtained on the realistic case study reveal that a zonal fare structure is the best strategy in terms of optimising revenue and ridership. The proposed CC DARP formulation provides a new decision support tool to inform on revenue and fleet management for DRT systems at a strategic planning level.


Learning to Make Chemical Predictions the Interplay of Feature Representation, Data, and Machine Learning Algorithms. Recently supervised machine learning has been ascending in providing new predictive approaches for chemical, biological and materials sciences applications. In this Perspective we focus on the interplay of machine learning algorithm with the chemically motivated descriptors and the size and type of data sets needed for molecular property prediction. Using Nuclear Magnetic Resonance chemical shift prediction as an example, we demonstrate that success is predicated on the choice of feature extracted or real space representations of chemical structures, whether the molecular property data is abundant and or experimentally or computationally derived, and how these together will influence the correct choice of popular machine learning algorithms drawn from deep learning, random forests, or kernel methods.


Nonhedgeable risk and Credit Risk Pricing. We introduce a new model for pricing corporate bonds, which is a modification of the classical model of Merton. In this new model, we drop the liquidity assumption of the firm's asset value process, and assume that there is a liquidly traded asset in the market whose value is correlated with the firm's asset value, and all portfolios can be constructed using solely this asset and the money market account. We formulate the market price of the corporate bond as the product of the price of an optimal replicating portfolio and exp( kappa x replication error), where kappa is a positive constant. The interpretation is that the representative investor accepts the price of the optimal replicating portfolio as a benchmark, however, requests compensation for the non hedgeable risk. We show that if the replication error is measured relative to the firm's value, the resulting formula is arbitrage free with mild restrictions on the parameters.


Investigating and Simplifying Masking based Saliency Methods for Model Interpretability. Saliency maps that identify the most informative regions of an image for a classifier are valuable for model interpretability. A common approach to creating saliency maps involves generating input masks that mask out portions of an image to maximally deteriorate classification performance, or mask in an image to preserve classification performance. Many variants of this approach have been proposed in the literature, such as counterfactual generation and optimizing over a Gumbel Softmax distribution. Using a general formulation of masking based saliency methods, we conduct an extensive evaluation study of a number of recently proposed variants to understand which elements of these methods meaningfully improve performance. Surprisingly, we find that a well tuned, relatively simple formulation of a masking based saliency model outperforms many more complex approaches. We find that the most important ingredients for high quality saliency map generation are (1) using both masked in and masked out objectives and (2) training the classifier alongside the masking model. Strikingly, we show that a masking model can be trained with as few as 10 examples per class and still generate saliency maps with only a 0.7 point increase in localization error.


Corrigendum and Supplement to "Improve Language Modelling for Code Completion through Learning General Token Repetition of Source Code (with Optimized Memory)". This paper is written because I receive several inquiry emails saying it is hard to achieve good results when applying token repetition learning techniques. If REP (proposed by me) or Pointer Mixture (proposed by Jian Li) is directly applied to source code to decide all token repetitions, the model performance will decrease sharply. As we use pre order traversal to traverse the Abstract Syntax Tree (AST) to generate token sequence, tokens corresponding to AST grammar are ignored when learning token repetition. For non grammar tokens, there are many kinds strings, chars, numbers and identifiers. For each kind of tokens, we try to learn its repetition pattern and find that only identifiers have the property of token repetition. For identifiers, there are also many kinds such as variables, package names, method names, simple types, qualified types or qualified names. Actually, some kinds of identifiers such as package names, method names, qualified names or qualified types are unlikely to be repeated. Thus, we ignore these kinds of identifiers that are unlikely to be repeated when learning token repetition. This step is crucial and this important implementation trick is not clearly presented in the paper because we think it is trivial and too many details may bother readers. We offer the GitHub address of our model in our conference paper and readers can check the description and implementation in that repository. Thus, in this paper, we supplement the important implementation optimization details for the already published papers.


Interpretable Multi Step Reasoning with Knowledge Extraction on Complex Healthcare Question Answering. Healthcare question answering assistance aims to provide customer healthcare information, which widely appears in both Web and mobile Internet. The questions usually require the assistance to have proficient healthcare background knowledge as well as the reasoning ability on the knowledge. Recently a challenge involving complex healthcare reasoning, HeadQA dataset, has been proposed, which contains multiple choice questions authorized for the public healthcare specialization exam. Unlike most other QA tasks that focus on linguistic understanding, HeadQA requires deeper reasoning involving not only knowledge extraction, but also complex reasoning with healthcare knowledge. These questions are the most challenging for current QA systems, and the current performance of the state of the art method is slightly better than a random guess. In order to solve this challenging task, we present a Multi step reasoning with Knowledge extraction framework (MurKe). The proposed framework first extracts the healthcare knowledge as supporting documents from the large corpus. In order to find the reasoning chain and choose the correct answer, MurKe iterates between selecting the supporting documents, reformulating the query representation using the supporting documents and getting entailment score for each choice using the entailment model. The reformulation module leverages selected documents for missing evidence, which maintains interpretability. Moreover, we are striving to make full use of off the shelf pre trained models. With less trainable weight, the pre trained model can easily adapt to healthcare tasks with limited training samples. From the experimental results and ablation study, our system is able to outperform several strong baselines on the HeadQA dataset.


p Adic hypergeometric functions in the connections with certain twisted Kloosterman sheaf sum and modular forms. In this paper we establish certain identities connecting p adic hypergeometric functions with 4 th twisted Kloosterman sheaf sum. To prove these identities we express certain character sum over finite field in terms of special values of p adic hypergeometric functions. One conjecture of Evans behaves as a bridge to connect p adic hypergeometric functions with Kloosterman sheaf sum. We also connect p adic hypergeometric functions with Fourier coefficients of certain modular forms.


A homomorphism between Bott Samelson bimodules. In the previous paper, we defined a new category which categorifies the Hecke algebra. This is a generalization of the theory of Soergel bimodules. To prove theorems, the existences of certain homomorphisms between Bott Samelson bimodules are assumed. In this paper, we prove this assumption. We only assume the vanishing of certain two colored quantum binomial coefficients.


A Comparison of Distance Bounds for Quasi Twisted Codes. Spectral bounds on the minimum distance of quasi twisted codes over finite fields are proposed, based on eigenvalues of polynomial matrices and the corresponding eigenspaces. They generalize the Semenov Trifonov and Zeh Ling bounds in a way similar to how the Roos and shift bounds extend the BCH and HT bounds for cyclic codes. The eigencodes of a quasi twisted code in the spectral theory and the outer codes in its concatenated structure are related. A comparison based on this relation verifies that the Jensen bound always outperforms the spectral bound under special conditions, which yields a similar relation between the Lally and the spectral bounds. The performances of the Lally, Jensen and spectral bounds are presented in comparison with each other.


Learning to Correct 3D Reconstructions from Multiple Views. This paper is about reducing the cost of building good large scale 3D reconstructions post hoc. We render 2D views of an existing reconstruction and train a convolutional neural network (CNN) that refines inverse depth to match a higher quality reconstruction. Since the views that we correct are rendered from the same reconstruction, they share the same geometry, so overlapping views complement each other. We take advantage of that in two ways. Firstly, we impose a loss during training which guides predictions on neighbouring views to have the same geometry and has been shown to improve performance. Secondly, in contrast to previous work, which corrects each view independently, we also make predictions on sets of neighbouring views jointly. This is achieved by warping feature maps between views and thus bypassing memory intensive 3D computation. We make the observation that features in the feature maps are viewpoint dependent, and propose a method for transforming features with dynamic filters generated by a multi layer perceptron from the relative poses between views. In our experiments we show that this last step is necessary for successfully fusing feature maps between views.


Combining Deep Learning with Geometric Features for Image based Localization in the Gastrointestinal Tract. Tracking monocular colonoscope in the Gastrointestinal tract (GI) is a challenging problem as the images suffer from deformation, blurred textures, significant changes in appearance. They greatly restrict the tracking ability of conventional geometry based methods. Even though Deep Learning (DL) can overcome these issues, limited labeling data is a roadblock to state of art DL method. Considering these, we propose a novel approach to combine DL method with traditional feature based approach to achieve better localization with small training data. Our method fully exploits the best of both worlds by introducing a Siamese network structure to perform few shot classification to the closest zone in the segmented training image set. The classified label is further adopted to initialize the pose of scope. To fully use the training dataset, a pre generated triangulated map points within the zone in the training set are registered with observation and contribute to estimating the optimal pose of the test image. The proposed hybrid method is extensively tested and compared with existing methods, and the result shows significant improvement over traditional geometric based or DL based localization. The accuracy is improved by 28.94 (Position) and 10.97 (Orientation) with respect to state of art method.


Non solvable graphs of groups. Let G be a group and Sol(G) x in G langle x,y rangle text is solvable for all y in G . We associate a graph mathcal NS G (called the non solvable graph of G ) with G whose vertex set is G setminus Sol(G) and two distinct vertices are adjacent if they generate a non solvable subgroup. In this paper we study many properties of mathcal NS G . In particular, we obtain results on vertex degree, cardinality of vertex degree set, graph realization, domination number, vertex connectivity, independence number and clique number of mathcal NS G . We also consider two groups G and H having isomorphic non solvable graphs and derive some properties of G and H . Finally, we conclude this paper by showing that mathcal NS G is neither planar, toroidal, double toroidal, triple toroidal nor projective.


Non radial solutions to a bi harmonic equation with negative exponent. We prove the existence of non radial entire solution to Delta 2 u u q 0 quad text in mathbb R 3, quad u 0, for q 1 . This answers an open question raised by P. J. McKenna and W. Reichel (E. J. D. E. textbf 37 (2003) 1 13).


Genetic Algorithms for the Optimization of Diffusion Parameters in Content Based Image Retrieval. Several computer vision and artificial intelligence projects are nowadays exploiting the manifold data distribution using, e.g., the diffusion process. This approach has produced dramatic improvements on the final performance thanks to the application of such algorithms to the kNN graph. Unfortunately, this recent technique needs a manual configuration of several parameters, thus it is not straightforward to find the best configuration for each dataset. Moreover, the brute force approach is computationally very demanding when used to optimally set the parameters of the diffusion approach. We propose to use genetic algorithms to find the optimal setting of all the diffusion parameters with respect to retrieval performance for each different dataset. Our approach is faster than others used as references (brute force, random search and PSO). A comparison with these methods has been made on three public image datasets Oxford5k, Paris6k and Oxford105k.


On contact type hypersurfaces in 4 space. We consider constraints on the topology of closed 3 manifolds that can arise as hypersurfaces of contact type in standard symplectic R 4 . Using an obstruction derived from Heegaard Floer homology we prove that no Brieskorn homology sphere admits a contact type embedding in R 4 , a result that has bearing on conjectures of Gompf and Koll 'ar. This implies in particular that no rationally convex domain in C 2 has boundary diffeomorphic to a Brieskorn sphere. We also give infinitely many examples of contact 3 manifolds that bound Stein domains but not symplectically convex ones in particular we find Stein domains in C 2 that cannot be made Weinstein with respect to the ambient symplectic structure while preserving the contact structure on their boundaries.


Smooth solutions to the Gauss image problem. In this paper we study the the Gauss image problem, which is a generalization of the Aleksandrov problem in convex geometry. By considering a geometric flow involving Gauss curvature and functions of normal vectors and radial vectors, we obtain the existence of smooth solutions to this problem.


Learning from Implicit Information in Natural Language Instructions for Robotic Manipulations. Human robot interaction often occurs in the form of instructions given from a human to a robot. For a robot to successfully follow instructions, a common representation of the world and objects in it should be shared between humans and the robot so that the instructions can be grounded. Achieving this representation can be done via learning, where both the world representation and the language grounding are learned simultaneously. However, in robotics this can be a difficult task due to the cost and scarcity of data. In this paper, we tackle the problem by separately learning the world representation of the robot and the language grounding. While this approach can address the challenges in getting sufficient data, it may give rise to inconsistencies between both learned components. Therefore, we further propose Bayesian learning to resolve such inconsistencies between the natural language grounding and a robot's world representation by exploiting spatio relational information that is implicitly present in instructions given by a human. Moreover, we demonstrate the feasibility of our approach on a scenario involving a robotic arm in the physical world.


Periodic multi pulses and spectral stability in Hamiltonian PDEs with symmetry. We consider the existence and spectral stability of periodic multi pulse solutions in Hamiltonian systems which are translation invariant and reversible, for which the fifth order Korteweg de Vries equation is a prototypical example. We use Lin's method to construct multi pulses on a periodic domain, and in particular demonstrate a pitchfork bifurcation structure for periodic double pulses. We also use Lin's method to reduce the spectral problem for periodic multi pulses to computing the determinant of a block matrix, which encodes both eigenvalues resulting from interactions between neighboring pulses and eigenvalues associated with the essential spectrum. We then use this matrix to compute the spectrum associated with periodic single and double pulses. Most notably, we prove that brief instability bubbles form when eigenvalues collide on the imaginary axis as the periodic domain size is altered. These analytical results are all in good agreement with numerical computations.


Fair and consistent prize allocation in competitions. Given the final ranking of a competition, how should the total prize endowment be allocated among the competitors? We study consistent prize allocation rules satisfying elementary solidarity and fairness principles. In particular, we axiomatically characterize several families of rules satisfying anonymity, order preservation, and endowment monotonicity, which all fall between the Equal Division rule and the Winner Takes All rule. Specific characterizations of rules and subfamilies are directly obtained. To our knowledge, this paper is the first that develops and motivates prize allocation rules for rank order competitions directly from axioms.


Real structures on symmetric spaces. We obtain a necessary and sufficient condition for the existence of equivariant real structures on complex symmetric spaces for semisimple groups and discuss how to determine the number of equivalence classes for such structures.


A whole year simulation study on nonlinear mixed integer model predictive control for a thermal energy supply system with multi use components. This work presents a whole year simulation study on nonlinear mixed integer Model Predictive Control (MPC) for a complex thermal energy supply system which consists of a heat pump, stratified water storages, free cooling facilities, and a large underground thermal storage. For solution of the arising Mixed Integer Non Linear Programs (MINLPs) we apply an existing general and optimal control suitable decomposition approach. To compensate deviation of forecast inputs from measured disturbances, we introduce a moving horizon estimation step within the MPC strategy. The MPC performance for this study, which consists of more than 50,000 real time suitable MINLP solutions, is compared to an elaborate conventional control strategy for the system. It is shown that MPC can significantly reduce the yearly energy consumption while providing a similar degree of constraint satisfaction, and autonomously identify previously unknown, beneficial operation modes.


C 0 stability of boundary actions and inequivalent Anosov flows. We give a topological stability result for the action of the fundamental group of a compact manifold of negative curvature on its boundary at infinity any nearby action of this group by homeomorphisms of the sphere is semi conjugate to the standard boundary action. Using similar techniques we prove a global rigidity result for the "slithering actions" of 3 manifold groups that come from skew Anosov flows. As applications, we construct hyperbolic 3 manifolds that admit arbitrarily many topologically inequivalent Anosov flows, answering a question from Kirby's problem list, and also give a more conceptual proof of a theorem of the second author on em global C 0 rigidity of geometric surface group actions on the circle.


Structural aspects of truncated archimedean vector lattices simple elements, good sequences. The truncation operation facilitates the articulation and analysis of several aspects of the structure of archimedean vector lattices we investigate two such aspects in this article. We refer to archimedean vector lattices equipped with a truncation as emph truncs . In the first part of the article we review the basic definitions, state the (pointed) Yosida Representation Theorem for truncs, and then prove a representation theorem which subsumes and extends the (pointfree) Madden Representation Theorem. The proof has the virtue of being much shorter than the one in the literature, but the real novelty of the theorem lies in the fact that the topological data dual to a given trunc G is a (localic) compactification, i.e., a dense pointed frame surjection q colon M to L out of a compact regular pointed frame M . The representation is an amalgam of the Yosida and Madden representations the compact frame M is sufficient to describe the behavior of the bounded part G of G in the sense that widetilde G separates the points of the compact Hausdorff pointed space X dual to M , while the frame L is just sufficient to capture the behavior of the unbounded part of G in mathcal R 0 L . The truncation operation lends itself to identifying those elements of a trunc which behave like characteristic functions, and in the second part of the article we characterize in several ways those truncs composed of linear combinations of such elements. Along the way, we show that the category of such truncs is equivalent to the category of pointed Boolean spaces, and to the category of generalized Boolean algebras. The short third part contains a characterization of the kernels of truncation homomorphisms in terms of pointwise closure. In it we correct an error in the literature.


Explainable Automated Fact Checking A Survey. A number of exciting advances have been made in automated fact checking thanks to increasingly larger datasets and more powerful systems, leading to improvements in the complexity of claims which can be accurately fact checked. However, despite these advances, there are still desirable functionalities missing from the fact checking pipeline. In this survey, we focus on the explanation functionality that is fact checking systems providing reasons for their predictions. We summarize existing methods for explaining the predictions of fact checking systems and we explore trends in this topic. Further, we consider what makes for good explanations in this specific domain through a comparative analysis of existing fact checking explanations against some desirable properties. Finally, we propose further research directions for generating fact checking explanations, and describe how these may lead to improvements in the research area.


Analysis of Global Fixed Priority Scheduling for Generalized Sporadic DAG Tasks. We consider global fixed priority (G FP) scheduling of parallel tasks, in which each task is represented as a directed acyclic graph (DAG). We summarize and highlight limitations of the state of the art analyses for G FP and propose a novel technique for bounding interfering workload, which can be applied directly to generalized DAG tasks. Our technique works by constructing optimization problems for which the optimal solution values serve as safe and tight upper bounds for interfering workloads. Using the proposed workload bounding technique, we derive a response time analysis and show that it improves upon state of the art analysis techniques for G FP scheduling.


Complexity of fall coloring for restricted graph classes. We strengthen a result by Laskar and Lyle (Discrete Appl. Math. (2009), 330 338) by proving that it is NP complete to decide whether a bipartite planar graph can be partitioned into three independent dominating sets. In contrast, we show that this is always possible for every maximal outerplanar graph with at least three vertices. Moreover, we extend their previous result by proving that deciding whether a bipartite graph can be partitioned into k independent dominating sets is NP complete for every k geq 3 . We also strengthen a result by Henning et al. (Discrete Math. (2009), 6451 6458) by showing that it is NP complete to determine if a graph has two disjoint independent dominating sets, even when the problem is restricted to triangle free planar graphs. Finally, for every k geq 3 , we show that there is some constant t depending only on k such that deciding whether a k regular graph can be partitioned into t independent dominating sets is NP complete. We conclude by deriving moderately exponential time algorithms for the problem.


Transcription Enriched Joint Embeddings for Spoken Descriptions of Images and Videos. In this work, we propose an effective approach for training unique embedding representations by combining three simultaneous modalities image and spoken and textual narratives. The proposed methodology departs from a baseline system that spawns a embedding space trained with only spoken narratives and image cues. Our experiments on the EPIC Kitchen and Places Audio Caption datasets show that introducing the human generated textual transcriptions of the spoken narratives helps to the training procedure yielding to get better embedding representations. The triad speech, image and words allows for a better estimate of the point embedding and show an improving of the performance within tasks like image and speech retrieval, even when text third modality, text, is not present in the task.


Multi task Learning for Chinese Word Usage Errors Detection. Chinese word usage errors often occur in non native Chinese learners' writing. It is very helpful for non native Chinese learners to detect them automatically when learning writing. In this paper, we propose a novel approach, which takes advantages of different auxiliary tasks, such as POS tagging prediction and word log frequency prediction, to help the task of Chinese word usage error detection. With the help of these auxiliary tasks, we achieve the state of the art results on the performances on the HSK corpus data, without any other extra data.


Biphasic Learning of GANs for High Resolution Image to Image Translation. Despite that the performance of image to image translation has been significantly improved by recent progress in generative models, current methods still suffer from severe degradation in training stability and sample quality when applied to the high resolution situation. In this work, we present a novel training framework for GANs, namely biphasic learning, to achieve image to image translation in multiple visual domains at 1024 2 resolution. Our core idea is to design an adjustable objective function that varies across training phases. Within the biphasic learning framework, we propose a novel inherited adversarial loss to achieve the enhancement of model capacity and stabilize the training phase transition. Furthermore, we introduce a perceptual level consistency loss through mutual information estimation and maximization. To verify the superiority of the proposed method, we apply it to a wide range of face related synthesis tasks and conduct experiments on multiple large scale datasets. Through comprehensive quantitative analyses, we demonstrate that our method significantly outperforms existing methods.


The average size of matchings in graphs. In this paper, we consider the average size of independent edge sets, also called matchings, in a graph. We characterize the extremal graphs for the average size of matchings in general graphs and trees. In addition, we obtain inequalities between the average size of matchings and the number of matchings as well as the matching energy, which is defined as the sum of the absolute values of the zeros of the matching polynomial.


Task Aware Monocular Depth Estimation for 3D Object Detection. Monocular depth estimation enables 3D perception from a single 2D image, thus attracting much research attention for years. Almost all methods treat foreground and background regions ("things and stuff") in an image equally. However, not all pixels are equal. Depth of foreground objects plays a crucial role in 3D object recognition and localization. To date how to boost the depth prediction accuracy of foreground objects is rarely discussed. In this paper, we first analyse the data distributions and interaction of foreground and background, then propose the foreground background separated monocular depth estimation (ForeSeE) method, to estimate the foreground depth and background depth using separate optimization objectives and depth decoders. Our method significantly improves the depth estimation performance on foreground objects. Applying ForeSeE to 3D object detection, we achieve 7.5 AP gains and set new state of the art results among other monocular methods. Code will be available at https github.com WXinlong ForeSeE.


Some toy models of self organized criticality in percolation. We consider the Bernoulli percolation model in a finite box and we introduce an automatic control of the percolation probability, which is a function of the percolation configuration. For a suitable choice of this automatic control, the model is self critical, i.e., the percolation probability converges to the critical point p c when the size of the box tends to infinity. We study here three simple examples of such models, involving the size of the largest cluster, the number of vertices connected to the boundary of the box, or the distribution of the cluster sizes.


Physical limit to concentration sensing in a changing environment. Cells adapt to changing environments by sensing ligand concentrations using specific receptors. The accuracy of sensing is ultimately limited by the finite number of ligand molecules bound by receptors. Previously derived physical limits to sensing accuracy have assumed that the concentration was constant and ignored its temporal fluctuations. We formulate the problem of concentration sensing in a strongly fluctuating environment as a non linear field theoretic problem, for which we find an excellent approximate Gaussian solution. We derive a new physical bound on the relative error in concentration c which scales as delta c c sim (Dac tau) 1 4 with ligand diffusivity D , receptor cross section a , and characteristic fluctuation time scale tau , in stark contrast with the usual Berg and Purcell bound delta c c sim (DacT) 1 2 for a perfect receptor sensing concentration during time T . We show how the bound can be achieved by a simple biochemical network downstream the receptor that adapts the kinetics of signaling as a function of the square root of the sensed concentration.


A note on 2 times 2 block diagonal preconditioning. For 2x2 block matrices, it is well known that block triangular or block LDU preconditioners with an exact Schur complement (inverse) converge in at most two iterations for fixed point or minimal residual methods. Similarly, for saddle point matrices with a zero (2,2) block, block diagonal preconditioners converge in at most three iterations for minimal residual methods, although they may diverge for fixed point iterations. But, what happens for non saddle point matrices and block diagonal preconditioners with an exact Schur complement? This note proves that minimal residual methods applied to general 2x2 block matrices, preconditioned with a block diagonal preconditioner, including an exact Schur complement, do not (necessarily) converge in a fixed number of iterations. Furthermore, examples are constructed where (i) block diagonal preconditioning with an exact Schur complement converges no faster than block diagonal preconditioning using diagonal blocks of the matrix, and (ii) block diagonal preconditioning with an approximate Schur complement converges as fast as the corresponding block triangular preconditioning. The paper concludes by discussing some practical applications in neutral particle transport, introducing one algorithm where block triangular or block LDU preconditioning are superior to block diagonal, and a second algorithm where block diagonal preconditioning is superior both in speed and simplicity.


Through a Jet Speed Darkly The Emergence of Robust Euro Atlantic Regimes in the Absence of Jet Speed Variability. Euro Atlantic regimes are typically identified using either the latitude of the eddy driven jet, or clustering algorithms in the phase space of 500hPa geopotential height (Z500). However, while robust trimodality is visibly apparent in jet latitude indices, Z500 clusters require highly sensitive significance tests to distinguish them from autocorrelated noise. As a result, even small shifts in the time period considered can notably alter the diagnosed regimes. Fixing the optimal regime number is also hard to justify. We argue that the jet speed, a near Gaussian distribution projecting strongly onto the Z500 field, is the source of this lack of robustness. Once its influence is removed, the Z500 phase space becomes visibly non Gaussian, and clustering algorithms easily recover three extremely stable regimes, corresponding to the jet latitude regimes. Further analysis supports the existence of two additional regimes, corresponding to a tilted and split jet. This framework therefore naturally unifies the two regime perspectives.


Fast Adaptive Non Monotone Submodular Maximization Subject to a Knapsack Constraint. Constrained submodular maximization problems encompass a wide variety of applications, including personalized recommendation, team formation, and revenue maximization via viral marketing. The massive instances occurring in modern day applications can render existing algorithms prohibitively slow, while frequently, those instances are also inherently stochastic. Focusing on these challenges, we revisit the classic problem of maximizing a (possibly non monotone) submodular function subject to a knapsack constraint. We present a simple randomized greedy algorithm that achieves a 5.83 approximation and runs in O(n log n) time, i.e., at least a factor n faster than other state of the art algorithms. The robustness of our approach allows us to further transfer it to a stochastic version of the problem. There, we obtain a 9 approximation to the best adaptive policy, which is the first constant approximation for non monotone objectives. Experimental evaluation of our algorithms showcases their improved performance on real and synthetic data.


A Computational Analysis of Natural Languages to Build a Sentence Structure Aware Artificial Neural Network. Natural languages are complexly structured entities. They exhibit characterising regularities that can be exploited to link them one another. In this work, I compare two morphological aspects of languages Written Patterns and Sentence Structure. I show how languages spontaneously group by similarity in both analyses and derive an average language distance. Finally, exploiting Sentence Structure I developed an Artificial Neural Network capable of distinguishing languages suggesting that not only word roots but also grammatical sentence structure is a characterising trait which alone suffice to identify them.


L p eigenfunction bounds for fractional Schr "odinger operators on manifolds. This paper is dedicated to L p bounds on eigenfunctions of a Sch "odinger type operator ( Delta g) alpha 2 V on closed Riemannian manifolds for critically singular potentials V . The operator ( Delta g) alpha 2 is defined spectrally in terms of the eigenfunctions of Delta g . We obtain also quasimodes and spectral clusters estimates. As an application, we derive Strichartz estimates for the fractional wave equation ( partial t 2 ( Delta g) alpha 2 V)u 0 . The wave kernel techniques recently developed by Bourgain Shao Sogge Yao and Shao Yao play a key role in this paper. We construct a new reproducing operator with several local operators and some good error terms. Moreover, we shall prove that these local operators satisfy certain variable coefficient versions of the "uniform Sobolev estimates" by Kenig Ruiz Sogge. These enable us to handle the critically singular potentials V and prove the quasimode estimates.


QuaRL Quantization for Sustainable Reinforcement Learning. Deep reinforcement learning has achieved significant milestones, however, the computational demands of reinforcement learning training and inference remain substantial. Quantization is an effective method to reduce the computational overheads of neural networks, though in the context of reinforcement learning, it is unknown whether quantization's computational benefits outweigh the accuracy costs introduced by the corresponding quantization error. To quantify this tradeoff we perform a broad study applying quantization to reinforcement learning. We apply standard quantization techniques such as post training quantization (PTQ) and quantization aware training (QAT) to a comprehensive set of reinforcement learning tasks (Atari, Gym), algorithms (A2C, DDPG, DQN, D4PG, PPO), and models (MLPs, CNNs) and show that policies may be quantized to 8 bits without degrading reward, enabling significant inference speedups on resource constrained edge devices. Motivated by the effectiveness of standard quantization techniques on reinforcement learning policies, we introduce a novel quantization algorithm, textit ActorQ , for quantized actor learner distributed reinforcement learning training. By leveraging full precision optimization on the learner and quantized execution on the actors, textit ActorQ enables 8 bit inference while maintaining convergence. We develop a system for quantized reinforcement learning training around textit ActorQ and demonstrate end to end speedups of 1.5 times 2.5 times over full precision training on a range of tasks (Deepmind Control Suite). Finally, we break down the various runtime costs of distributed reinforcement learning training (such as communication time, inference time, model load time, etc) and evaluate the effects of quantization on these system attributes.


Machine Teaching by Domain Experts Towards More Humane,Inclusive, and Intelligent Machine Learning Systems. This paper argues that a possible way to escape from the limitations of current machine learning (ML) systems is to allow their development directly by domain experts without the mediation of ML experts. This could be accomplished by making ML systems interactively teachable using concepts, definitions, and similar high level knowledge constructs. Pointing to the recent advances in machine teaching technology, we list key technical challenges specific for such expert centric ML systems, and suggest that they are more humane and possibly more intelligent than traditional ML systems in many domains. We then argue that ML systems could also benefit greatly from being built by a community of experts as much as open source software did, creating more inclusive systems, in terms of enabling different points of view about the same corpus of knowledge. Advantages of the community approach over current ways to build ML systems, as well as specific challenges this approach raises, are also discussed in the paper.


A micropolar peridynamics model with non unified horizon for damage of solids with different non local effects. Most peridynamics models adopt regular point distribution and unified horizon, limiting their flexibility and engineering applications. In this work, a micropolar peridynamics approach with non unified horizon (NHPD) is proposed. This approach is implemented in a conventional finite element framework, using element based discretization. By modifying the dual horizon approach into the pre processing part, point dependent horizon and non unified beam like bonds are built. By implementing a domain correction strategy, the equivalence of strain energy density is assured. Then, a novel energy density based failure criterion is presented which directly bridges the critical stretch to the mechanical strength. The numerical results indicate the weak mesh dependency of NHPD and the effectiveness of the new failure criterion. Moreover, it is proven that damage of solid with different non local effects can lead to similar results by only adjusting the mechanical strength.


Towards Formally Verified Compilation of Tag Based Policy Enforcement. Hardware assisted reference monitoring is receiving increasing attention as a way to improve the security of existing software. One example is the PIPE architecture extension, which attaches metadata tags to register and memory values and executes tag based rules at each machine instruction to enforce a software defined security policy. To use PIPE effectively, engineers should be able to write security policies in terms of source level concepts like functions, local variables, and structured control operators, which are not visible at machine level. It is the job of the compiler to generate PIPE aware machine code that enforces these source level policies. The compiler thus becomes part of the monitored system's trusted computing base and hence a prime candidate for verification. To formalize compiler correctness in this setting, we extend the source language semantics with its own form of user specified tag based monitoring, and show that the compiler preserves that monitoring behavior. The challenges of compilation include mapping source level monitoring policies to instruction level tag rules, preserving fail stop behaviors, and satisfying the surprisingly complex preconditions for conventional optimizations. In this paper, we describe the design and verification of Tagine, a small prototype compiler that translates a simple tagged WHILE language to a tagged register transfer language and performs simple optimizations. Tagine is based on the RTLgen and Deadcode phases of the CompCert compiler, and hence is written and verified in Coq. This work is a first step toward verification of a full scale compiler for a realistic tagged source language.


Postulate based proof of the P ! NP hypothesis. The paper contains a proof for the P ! NP hypothesis with the help of the two "natural" postulates. The postulates restrict capacity of the Turing machines and state that each independent and necessary condition of the problem should be considered by a solver (Turing machine) individually, not in groups. That is, a solver should spend at least one step to deal with the condition and, therefore, if the amount of independent conditions is exponentially growing with polynomially growing problem sizes then exponential time is needed to find a solution. With the postulates, it is enough to build a natural (not pure mathematical) proof that P ! NP.


Federated Learning with Differential Privacy Algorithms and Performance Analysis. In this paper, to effectively prevent information leakage, we propose a novel framework based on the concept of differential privacy (DP), in which artificial noises are added to the parameters at the clients side before aggregating, namely, noising before model aggregation FL (NbAFL). First, we prove that the NbAFL can satisfy DP under distinct protection levels by properly adapting different variances of artificial noises. Then we develop a theoretical convergence bound of the loss function of the trained FL model in the NbAFL. Specifically, the theoretical bound reveals the following three key properties 1) There is a tradeoff between the convergence performance and privacy protection levels, i.e., a better convergence performance leads to a lower protection level 2) Given a fixed privacy protection level, increasing the number N of overall clients participating in FL can improve the convergence performance 3) There is an optimal number of maximum aggregation times (communication rounds) in terms of convergence performance for a given protection level. Furthermore, we propose a K random scheduling strategy, where K ( 1 K N ) clients are randomly selected from the N overall clients to participate in each aggregation. We also develop the corresponding convergence bound of the loss function in this case and the K random scheduling strategy can also retain the above three properties. Moreover, we find that there is an optimal K that achieves the best convergence performance at a fixed privacy level. Evaluations demonstrate that our theoretical results are consistent with simulations, thereby facilitating the designs on various privacy preserving FL algorithms with different tradeoff requirements on convergence performance and privacy levels.


On the compactness threshold in the critical Kirchhoff equation. We study a class of critical Kirchhoff problems with a general nonlocal term. The main difficulty here is the absence of a closed form formula for the compactness threshold. First we obtain a variational characterization of this threshold level. Then we prove a series of existence and multiplicity results based on this variational characterization.


Spatial Heterogeneity Can Lead to Substantial Local Variations in COVID 19 Timing and Severity. Standard epidemiological models for COVID 19 employ variants of compartment (SIR) models at local scales, implicitly assuming spatially uniform local mixing. Here, we examine the effect of employing more geographically detailed diffusion models based on known spatial features of interpersonal networks, most particularly the presence of a long tailed but monotone decline in the probability of interaction with distance, on disease diffusion. Based on simulations of unrestricted COVID 19 diffusion in 19 U.S cities, we conclude that heterogeneity in population distribution can have large impacts on local pandemic timing and severity, even when aggregate behavior at larger scales mirrors a classic SIR like pattern. Impacts observed include severe local outbreaks with long lag time relative to the aggregate infection curve, and the presence of numerous areas whose disease trajectories correlate poorly with those of neighboring areas. A simple catchment model for hospital demand illustrates potential implications for health care utilization, with substantial disparities in the timing and extremity of impacts even without distancing interventions. Likewise, analysis of social exposure to others who are morbid or deceased shows considerable variation in how the epidemic can appear to individuals on the ground, potentially affecting risk assessment and compliance with mitigation measures. These results demonstrate the potential for spatial network structure to generate highly non uniform diffusion behavior even at the scale of cities, and suggest the importance of incorporating such structure when designing models to inform healthcare planning, predict community outcomes, or identify potential disparities.


Extreme Non Reciprocal Near Field Thermal Radiation via Floquet Photonics. By utilizing Floquet driving protocols and interlacing them with a judicious reservoir emission engineering we achieve extreme non reciprocal thermal radiation. We show that the latter is rooted in an interplay between a direct radiation process occurring due to temperature bias between two thermal baths and the modulation process which is responsible for pumped radiation heat. Our theoretical results are confirmed via time domain simulations with RF circuits.


Combinatorially equivalent hyperplane arrangements. We study the combinatorics of hyperplane arrangements over arbitrary fields. Specifically, we determine in which situation an arrangement and its reduction modulo a prime number have isomorphic lattices via the use of minimal strong sigma Gr "obner bases. Moreover, we prove that the Terao's conjecture over finite fields implies the conjecture over the rationals.


Energy Efficiency Path Planning for Quadrotor UAV Under Wind Conditions. Quadrotor unmanned aerial vehicles have a limited quantity of embedded energy. To preserve and guaranty the success of the UAV mission, we should manage energy consumption during the mission. In this study we introduce an optimization algorithm to minimize the consumed energy in quadrotor mission under windy conditions. The mechanical energy consumed by rotors of the flying vehicle is formulated with an efficiency function. Then, we formulate the energy minimization problem as an optimal control problem. The last problem is solved in order to calculate minimum energy for quadrotor simple mission under windy conditions. In simulation experiment, we compare the proposed method with an adaptive control approach.


Motioning connected subgraphs into a graph. Imagine that a swarm of robots is given, these robots must communicate with each other, and they can do so if certain conditions are met. We say that the swarm is connected if there is at least one way to send a message between each pair of robots. A robot can move from a work station to another only if the connectivity of the swarm is preserved in order to perform some tasks. We model the problem via graph theory, we study connected subgraphs and how to motion them inside a connected graph preserving the connectivity. We determine completely the group of movements.


Self supervised reinforcement learning for speaker localisation with the iCub humanoid robot. In the future robots will interact more and more with humans and will have to communicate naturally and efficiently. Automatic speech recognition systems (ASR) will play an important role in creating natural interactions and making robots better companions. Humans excel in speech recognition in noisy environments and are able to filter out noise. Looking at a person's face is one of the mechanisms that humans rely on when it comes to filtering speech in such noisy environments. Having a robot that can look toward a speaker could benefit ASR performance in challenging environments. To this aims, we propose a self supervised reinforcement learning based framework inspired by the early development of humans to allow the robot to autonomously create a dataset that is later used to learn to localize speakers with a deep learning network.


On the complexity of fault tolerant consensus. The paper studies the problem of reaching agreement in a distributed message passing system prone to crash failures. Crashes are generated by constrained adversaries a wadapt adversary, who has to fix in advance the set of f crash prone processes, or a chainadapt adversary, who orders all the processes into k disjoint chains and has to follow this pattern when crashing them. Apart from these constraints, both of them may crash processes in an adaptive way at any time. While commonly used sadapt adversaries model attacks and noadapt ones pre defined faults, the constrained adversaries model more realistic scenarios when there are fault prone dependent processes, e.g., in hierarchical or dependable software hardware systems. We propose time efficient consensus algorithms against such adversaries and also show how to improve the message complexity of proposed solutions. Finally, we show how to reach consensus against a kthick adversary, limited by an arbitrary partial order dk with a maximal anti chain of length k . We complement our algorithmic results with (almost) tight lower bounds, and extend the one for wadapt adversaries to hold also for (syntactically) weaker noadapt adversaries. Together with the consensus algorithm against wadapt adversaries (which automatically translates to noadapt adversaries), these results extend the state of the art of the popular class of noadapt adversaries, in particular the result of Chor, Meritt and Shmoys cite CMS , and prove general separation between sadapt and the constrained adversaries (including noadapt) analyzed by Bar Joseph and Ben Or cite BB and others.


Can the Optimizer Cost be Used to Predict Query Execution Times?. Predicting the execution time of queries is an important problem with applications in scheduling, service level agreements and error detection. During query planning, a cost is associated with the chosen execution plan and used to rank competing plans. It would be convenient to use that cost to predict execution time, but it has been claimed in the literature that this is not possible. In this paper, we thoroughly investigate this claim considering both linear and non linear models. We find that the accuracy using more complex models with only the optimizer cost is comparable to the reported accuracy in the literature. The most accurate method in the literature is nearest neighbour regression which does not produce a model. The published results used a large feature set to identify nearest neighbours. We show that it is possible to achieve the same level of accuracy using only the cost to identify nearest neighbours. Using a smaller feature set brings the advantages of reduced overhead in terms of both storage space for the training data and the time to produce a prediction.


Generalization on the Enhancement of Layerwise Relevance Interpretability of Deep Neural Network. The practical application of deep neural networks are still limited by their lack of transparency. One of the efforts to provide explanation for decisions made by artificial intelligence (AI) is the use of saliency or heat maps highlighting relevant regions that contribute significantly to its prediction. A layer wise amplitude filtering method was previously introduced to improve the quality of heatmaps, performing error corrections by noise spike suppression. In this study, we generalize the layerwise error correction by considering any identifiable error and assuming there exists a groundtruth interpretable information. The forms of errors propagated through layerwise relevance methods are studied and we propose a filtering technique for interpretability signal rectification taylored to the trend of signal amplitude of the particular neural network used. Finally, we put forth arguments for the use of groundtruth interpretable information.


Fuzzy Rule Interpolation Toolbox for the GNU Open Source OCTAVE. In most fuzzy control applications (applying classical fuzzy reasoning), the reasoning method requires a complete fuzzy rule base, i.e all the possible observations must be covered by the antecedents of the fuzzy rules, which is not always available. Fuzzy control systems based on the Fuzzy Rule Interpolation (FRI) concept play a major role in different platforms, in case if only a sparse fuzzy rule base is available. This cases the fuzzy model contains only the most relevant rules, without covering all the antecedent universes. The first FRI toolbox being able to handle different FRI methods was developed by Johanyak et. al. in 2006 for the MATLAB environment. The goal of this paper is to introduce some details of the adaptation of the FRI toolbox to support the GNU OCTAVE programming language. The OCTAVE Fuzzy Rule Interpolation (OCTFRI) Toolbox is an open source toolbox for OCTAVE programming language, providing a large functionally compatible subset of the MATLAB FRI toolbox as well as many extensions. The OCTFRI Toolbox includes functions that enable the user to evaluate Fuzzy Inference Systems (FISs) from the command line and from OCTAVE scripts, read write FISs and OBS to from files, and produce a graphical visualisation of both the membership functions and the FIS outputs. Future work will focus on implementing advanced fuzzy inference techniques and GUI tools.


Evaluation for Weakly Supervised Object Localization Protocol, Metrics, and Datasets. Weakly supervised object localization (WSOL) has gained popularity over the last years for its promise to train localization models with only image level labels. Since the seminal WSOL work of class activation mapping (CAM), the field has focused on how to expand the attention regions to cover objects more broadly and localize them better. However, these strategies rely on full localization supervision for validating hyperparameters and model selection, which is in principle prohibited under the WSOL setup. In this paper, we argue that WSOL task is ill posed with only image level labels, and propose a new evaluation protocol where full supervision is limited to only a small held out set not overlapping with the test set. We observe that, under our protocol, the five most recent WSOL methods have not made a major improvement over the CAM baseline. Moreover, we report that existing WSOL methods have not reached the few shot learning baseline, where the full supervision at validation time is used for model training instead. Based on our findings, we discuss some future directions for WSOL.


From Open Source Intelligence to Decision Making a Hybrid Approach. We provide an overview of tools enabling users to utilize data from open sources for decision making support in weakly structured subject domains. Presently, it is impossible to replace expert data with data from open sources in the process of decision making. Although organization of expert sessions requires much time and costs a lot, due to insufficient level of natural language processing technology development, we still have to engage experts and knowledge engineers in decision making process. Information, obtained from experts and open sources, is processed, aggregated, and used as basis of recommendations, provided to decision maker. As an example of a weakly structured domain, we consider information conflicts and operations. For this domain we propose a hybrid decision support methodology, using data provided by both experts and open sources. The methodology is based on hierarchic decomposition of the main goal of an information operation. Using the data obtained from experts and open sources, we build the knowledge base of subject domain in the form of a weighted graph. It represents a hierarchy of factors influencing the main goal. Besides intensity, the impact of each factor is characterized by delay and duration. With these parameters taken into account, main goal achievement degree is calculated, and changes of target parameters of information operation object are monitored. In order to illustrate the suggested hybrid approach, we consider a real life example, where we detect, monitor, and analyze actions intended to discredit the National academy of sciences of Ukraine. For this purpose, we use specialized decision making support and content monitoring software.


On the probability that a binomial variable is at most its expectation. Consider the probability that a binomial random variable Bi (n,m n) with integer expectation m is at most its expectation. Chv 'atal conjectured that for any given n , this probability is smallest when m is the integer closest to 2n 3 . We show that this holds when n is large.


Playing to distraction towards a robust training of CNN classifiers through visual explanation techniques. The field of deep learning is evolving in different directions, with still the need for more efficient training strategies. In this work, we present a novel and robust training scheme that integrates visual explanation techniques in the learning process. Unlike the attention mechanisms that focus on the relevant parts of images, we aim to improve the robustness of the model by making it pay attention to other regions as well. Broadly speaking, the idea is to distract the classifier in the learning process to force it to focus not only on relevant regions but also on those that, a priori, are not so informative for the discrimination of the class. We tested the proposed approach by embedding it into the learning process of a convolutional neural network for the analysis and classification of two well known datasets, namely Stanford cars and FGVC Aircraft. Furthermore, we evaluated our model on a real case scenario for the classification of egocentric images, allowing us to obtain relevant information about peoples' lifestyles. In particular, we work on the challenging EgoFoodPlaces dataset, achieving state of the art results with a lower level of complexity. The obtained results indicate the suitability of our proposed training scheme for image classification, improving the robustness of the final model.


I Bet You Are Wrong Gambling Adversarial Networks for Structured Semantic Segmentation. Adversarial training has been recently employed for realizing structured semantic segmentation, in which the aim is to preserve higher level scene structural consistencies in dense predictions. However, as we show, value based discrimination between the predictions from the segmentation network and ground truth annotations can hinder the training process from learning to improve structural qualities as well as disabling the network from properly expressing uncertainties. In this paper, we rethink adversarial training for semantic segmentation and propose to formulate the fake real discrimination framework with a correct incorrect training objective. More specifically, we replace the discriminator with a "gambler" network that learns to spot and distribute its budget in areas where the predictions are clearly wrong, while the segmenter network tries to leave no clear clues for the gambler where to bet. Empirical evaluation on two road scene semantic segmentation tasks shows that not only does the proposed method re enable expressing uncertainties, it also improves pixel wise and structure based metrics.


PrivacyGuard Enforcing Private Data Usage Control with Blockchain and Attested Off chain Contract Execution. The abundance and rich varieties of data are enabling many transformative applications of big data analytics that have profound societal impacts. However, there are also increasing concerns regarding the improper use of individual data owner's private data. In this paper, we propose PrivacyGuard, a system that leverages blockchain smart contract and trusted execution environment (TEE) to enable individual's control over the access and usage of their private data. Smart contracts are used to specify data usage policy, i.e., who can use what data under which conditions and what analytics to perform, while the distributed blockchain ledger is used to keep an irreversible and non repudiable data usage record. To address the efficiency problem of on chain contract execution and to prevent exposing private data on the publicly viewable blockchain, PrivacyGuard incorporates a novel TEE based off chain contract execution engine along with a protocol to securely commit the execution result onto blockchain. We have built and deployed a prototype of PrivacyGuard with Ethereum and Intel SGX. Our experiment result demonstrates that PrivacyGuard fulfills the promised privacy goal and supports analytics on data from a considerable number of data owners.