Reducing Path TSP to TSP. We present a black box reduction from the path version of the Traveling Salesman Problem (Path TSP) to the classical tour version (TSP). More precisely, we show that given an alpha approximation algorithm for TSP, then, for any epsilon 0 , there is an ( alpha epsilon) approximation algorithm for the more general Path TSP. This reduction implies that the approximability of Path TSP is the same as for TSP, up to an arbitrarily small error. This avoids future discrepancies between the best known approximation factors achievable for these two problems, as they have existed until very recently. A well studied special case of TSP, Graph TSP, asks for tours in unit weight graphs. Our reduction shows that any alpha approximation algorithm for Graph TSP implies an ( alpha epsilon) approximation algorithm for its path version. By applying our reduction to the 1.4 approximation algorithm for Graph TSP by Seb H o and Vygen, we obtain a polynomial time (1.4 epsilon) approximation algorithm for Graph Path TSP, improving on a recent 1.497 approximation algorithm of Traub and Vygen. We obtain our results through a variety of new techniques, including a novel way to set up a recursive dynamic program to guess significant parts of an optimal solution. At the core of our dynamic program we deal with instances of a new generalization of (Path) TSP which combines parity constraints with certain connectivity requirements. This problem, which we call Phi TSP, has a constant factor approximation algorithm and can be reduced to TSP in certain cases when the dynamic program would not make sufficient progress.


Dynamic cut aggregation in L shaped algorithms. We present a novel framework for dynamic cut aggregation in L shaped algorithms. The aim is to improve the parallel performance of distributed L shaped algorithms through reduced communication latency and load imbalance. We show how optimality cuts can be aggregated into arbitrary partitions without affecting convergence of the L shaped algorithm. Furthermore, we give a worst case bound for L shaped algorithms with static cut aggregation and then extend this result for dynamic aggregation. We propose a variety of aggregation schemes that fit into our framework, and evaluate them on a collection of large scale stochastic programming problems. All methods are implemented in our open source framework for stochastic programming, StochasticPrograms.jl, written in the Julia programming language. In addition, we propose a granulated strategy that combines the strengths of dynamic and static cut aggregation. Major performance improvements are possible with our approach in distributed settings. Our experimental results suggest that the granulated strategy can consistently yield high performance on a range of test problems. The experimental results are supported by our worst case bounds.


Green's Functions with Oblique Neumann Boundary Conditions in the Quadrant. We study semi martingale obliquely reflected Brownian motion with drift in the first quadrant of the plane in the transient case. Our main result determines a general explicit integral expression for the moment generating function of Green's functions of this process. To that purpose we establish a new kernel functional equation connecting moment generating functions of Green's functions inside the quadrant and on its edges. This is reminiscent of the recurrent case where a functional equation derives from the basic adjoint relationship which characterizes the stationary distribution. This equation leads us to a non homogeneous Carleman boundary value problem. Its resolution provides a formula for the moment generating function in terms of contour integrals and a conformal mapping.


An entropic proof of cutoff on Ramanujan graphs. It is recently proved by Lubetzky and Peres that the simple random walk on a Ramanujan graph exhibits a cutoff phenomenon, that is to say, the total variation distance of the random walk distribution from the uniform distribution drops abruptly from near 1 to near 0 . There are already a few alternative proofs of this fact. In this note, we give yet another proof based on functional analysis and entropic consideration.


Taming denumerable Markov decision processes with decisiveness. Decisiveness has proven to be an elegant concept for denumerable Markov chains it is general enough to encompass several natural classes of denumerable Markov chains, and is a sufficient condition for simple qualitative and approximate quantitative model checking algorithms to exist. In this paper, we explore how to extend the notion of decisiveness to Markov decision processes. Compared to Markov chains, the extra non determinism can be resolved in an adversarial or cooperative way, yielding two natural notions of decisiveness. We then explore whether these notions yield model checking procedures concerning the infimum and supremum probabilities of reachability properties.


A variant of Ostrowski numeration. In this article, we propose a variant of the usual Ostrowski alpha numeration (where alpha is a real in 0, 1 ) that codes integers (positive as well as negative) and reals of 0, 1 (instead of alpha , 1 alpha ), so that for every integer n, n and n alpha have the same coding sequence. These coding sequences respect natural lexicographic orders and will be used to prove well known results on order properties of Kronecker sequences ( n alpha beta ) n .


Quantifying the Complexity of Standard Benchmarking Datasets for Long Term Human Trajectory Prediction. Methods to quantify the complexity of trajectory datasets are still a missing piece in benchmarking human trajectory prediction models. In order to gain a better understanding of the complexity of trajectory prediction tasks and following the intuition, that more complex datasets contain more information, an approach for quantifying the amount of information contained in a dataset from a prototype based dataset representation is proposed. The dataset representation is obtained by first employing a non trivial spatial sequence alignment, which enables a subsequent learning vector quantization (LVQ) stage. A large scale complexity analysis is conducted on several human trajectory prediction benchmarking datasets, followed by a brief discussion on indications for human trajectory prediction and benchmarking.


PizzaBox Studying Internet Connected Physical Object Manipulation based Food Ordering. This paper presents the designing and testing of PizzaBox, a 3D printed, interactive food ordering system that aims to differ from conventional food ordering systems and provide an entertaining and unique experience when ordering a pizza by incorporating underlying technologies that support ubiquitous computing. The PizzaBox has gone through both low and medium fidelity testing while working collaboratively with participants to co design and refine a product that is approachable to all age groups while maintaining a simple process for ordering food from start to finish. Final testing was conducted at an independent pizzeria where interviews with participants lead us to develop four discussion themes 1) usability and end user engagement, 2) towards connected real time products and services, 3) healthy eating, 4) evolution of food ordering systems. Our interviews show that in general, PizzaBox would have a greater appeal to a younger audience by providing a fantasy of helping in the creation and baking of the pizza but also has a novelty value that all ages would enjoy. We investigate the effect that the PizzaBox has in encouraging new healthy habits or promoting a healthier lifestyle as well as how we can improve PizzaBox to better encourage these lifestyle changes.


Non Sequential Theory of Distributed Systems. These lecture notes cover basic automata theoretic concepts and logical formalisms for the modeling and verification of concurrent and distributed systems. Many of these concepts naturally extend the classical automata and logics over words, which provide a framework for modeling sequential systems. A distributed system, on the other hand, combines several (finite or recursive) processes, and will therefore be modeled as a collection of (finite or pushdown, respectively) automata. A crucial parameter of a distributed system is the kind of interaction that is allowed between processes. In this lecture, we focus on the message passing paradigm. In general, communication in a distributed system creates complex dependencies between events, which are hidden when using a sequential, operational semantics. The approach taken here is based on a faithful preservation of the dependencies of concurrent events. That is, an execution of a system is modeled as a partial order, or graph, rather than a sequence of events.


Improving Relation Extraction by Leveraging Knowledge Graph Link Prediction. Relation extraction (RE) aims to predict a relation between a subject and an object in a sentence, while knowledge graph link prediction (KGLP) aims to predict a set of objects, O, given a subject and a relation from a knowledge graph. These two problems are closely related as their respective objectives are intertwined given a sentence containing a subject and an object o, a RE model predicts a relation that can then be used by a KGLP model together with the subject, to predict a set of objects O. Thus, we expect object o to be in set O. In this paper, we leverage this insight by proposing a multi task learning approach that improves the performance of RE models by jointly training on RE and KGLP tasks. We illustrate the generality of our approach by applying it on several existing RE models and empirically demonstrate how it helps them achieve consistent performance gains.


AccSS3D Accelerator for Spatially Sparse 3D DNNs. Semantic understanding and completion of real world scenes is a foundational primitive of 3D Visual perception widely used in high level applications such as robotics, medical imaging, autonomous driving and navigation. Due to the curse of dimensionality, compute and memory requirements for 3D scene understanding grow in cubic complexity with voxel resolution, posing a huge impediment to realizing real time energy efficient deployments. The inherent spatial sparsity present in the 3D world due to free space is fundamentally different from the channel wise sparsity that has been extensively studied. We present ACCELERATOR FOR SPATIALLY SPARSE 3D DNNs (AccSS3D), the first end to end solution for accelerating 3D scene understanding by exploiting the ample spatial sparsity. As an algorithm dataflow architecture co designed system specialized for spatially sparse 3D scene understanding, AccSS3D includes novel spatial locality aware metadata structures, a near zero latency and spatial sparsity aware dataflow optimizer, a surface orientation aware pointcloud reordering algorithm and a codesigned hardware accelerator for spatial sparsity that exploits data reuse through systolic and multicast interconnects. The SSpNNA accelerator core together with the 64 KB of L1 memory requires 0.92 mm2 of area in 16nm process at 1 GHz. Overall, AccSS3D achieves 16.8x speedup and a 2232x energy efficiency improvement for 3D sparse convolution compared to an Intel i7 8700K 4 core CPU, which translates to a 11.8x end to end 3D semantic segmentation speedup and a 24.8x energy efficiency improvement (iso technology node)


Unification based Reconstruction of Multi hop Explanations for Science Questions. This paper presents a novel framework for reconstructing multi hop explanations in science Question Answering (QA). While existing approaches for multi hop reasoning build explanations considering each question in isolation, we propose a method to leverage explanatory patterns emerging in a corpus of scientific explanations. Specifically, the framework ranks a set of atomic facts by integrating lexical relevance with the notion of unification power, estimated analysing explanations for similar questions in the corpus. An extensive evaluation is performed on the Worldtree corpus, integrating k NN clustering and Information Retrieval (IR) techniques. We present the following conclusions (1) The proposed method achieves results competitive with Transformers, yet being orders of magnitude faster, a feature that makes it scalable to large explanatory corpora (2) The unification based mechanism has a key role in reducing semantic drift, contributing to the reconstruction of many hops explanations (6 or more facts) and the ranking of complex inference facts ( 12.0 Mean Average Precision) (3) Crucially, the constructed explanations can support downstream QA models, improving the accuracy of BERT by up to 10 overall.


Face Quality Estimation and Its Correlation to Demographic and Non Demographic Bias in Face Recognition. Face quality assessment aims at estimating the utility of a face image for the purpose of recognition. It is a key factor to achieve high face recognition performances. Currently, the high performance of these face recognition systems come with the cost of a strong bias against demographic and non demographic sub groups. Recent work has shown that face quality assessment algorithms should adapt to the deployed face recognition system, in order to achieve highly accurate and robust quality estimations. However, this could lead to a bias transfer towards the face quality assessment leading to discriminatory effects e.g. during enrolment. In this work, we present an in depth analysis of the correlation between bias in face recognition and face quality assessment. Experiments were conducted on two publicly available datasets captured under controlled and uncontrolled circumstances with two popular face embeddings. We evaluated four state of the art solutions for face quality assessment towards biases to pose, ethnicity, and age. The experiments showed that the face quality assessment solutions assign significantly lower quality values towards subgroups affected by the recognition bias demonstrating that these approaches are biased as well. This raises ethical questions towards fairness and discrimination which future works have to address.


Partially hyperbolic dynamics and 3 manifold topology. This is an expository note intended to illustrate current research in topological study of partially hyperbolic diffeomorphisms in dimension 3 with a beautiful result due to Margulis and Plante Thurston on topological obstructions for a manifold to admit an Anosov flow.


Proportional 2 Choosability with a Bounded Palette. Proportional choosability is a list coloring analogue of equitable coloring. Specifically, a k assignment L for a graph G specifies a list L(v) of k available colors to each v in V(G) . An L coloring assigns a color to each vertex v from its list L(v) . A proportional L coloring of G is a proper L coloring in which each color c in bigcup v in V(G) L(v) is used lfloor eta(c) k rfloor or lceil eta(c) k rceil times where eta(c) left lvert v in V(G) c in L(v) right rvert . A graph G is proportionally k choosable if a proportional L coloring of G exists whenever L is a k assignment for G . Motivated by earlier work, we initiate the study of proportional choosability with a bounded palette by studying proportional 2 choosability with a bounded palette. In particular, when ell geq 2 , a graph G is said to be proportionally (2, ell) choosable if a proportional L coloring of G exists whenever L is a 2 assignment for G satisfying bigcup v in V(G) L(v) leq ell . We observe that a graph is proportionally (2,2) choosable if and only if it is equitably 2 colorable. As ell gets larger, the set of proportionally (2, ell) choosable graphs gets smaller. We show that whenever ell geq 5 a graph is proportionally (2, ell) choosable if and only if it is proportionally 2 choosable. We also completely characterize the connected proportionally (2, ell) choosable graphs when ell 3,4 .


Meta Distribution of Downlink tt SIR in a Poisson Cluster Process based HetNet Model. The performance analysis of heterogeneous cellular networks (HetNets), that relied mostly on the homogeneous Poisson point process (PPP) for the spatial distribution of the users and base stations (BSs), has seen a major transition with the emergence of the Poisson cluster process (PCP) based models. With the combination of PPP and PCP, it is possible to construct a general HetNet model which can capture formation of hotspots and spatial coupling between the users and the BSs. While the downlink coverage analysis of this model in terms of the distribution of the received downlink signal to interference ratio ( tt SIR ) is well understood by now, more fine grained analysis in terms of the meta distribution of tt SIR is an open problem. In this letter, we solve this problem by deriving the meta distribution of the downlink tt SIR assuming that the typical user connects to the BS providing the maximum received power.


ThreshKnot Thresholded ProbKnot for Improved RNA Secondary Structure Prediction. RNA structure prediction is a challenging problem, especially with pseudoknots. Recently, there has been a shift from the classical minimum free energy based methods (MFE) to partition function based ones that assemble structures using base pairing probabilities. Two examples of the latter group are the popular maximum expected accuracy (MEA) method and the ProbKnot method. ProbKnot is a fast heuristic that pairs nucleotides that are reciprocally most probable pairing partners, and unlike MEA, can also predict structures with pseudoknots. However, ProbKnot's full potential has been largely overlooked. In particular, when introduced, it did not have an MEA like hyperparameter that can balance between positive predictive value (PPV) and sensitivity. We show that a simple thresholded version of ProbKnot, which we call ThreshKnot, leads to more accurate overall predictions by filtering out unlikely pairs whose probabilities fall under a given threshold. We also show that on three widely used folding engines (RNAstructure, Vienna RNAfold, and CONTRAfold), ThreshKnot always outperforms the much more involved MEA algorithm in (1) its higher structure prediction accuracy, (2) its capability to predict pseudoknots, and (3) its faster runtime and easier implementation. This suggests that ThreshKnot should replace MEA as the default partition function based structure prediction algorithm. ThreshKnot is already available in the widely used RNAstructure software package version 6.2 (released November 27, 2019) https rna.urmc.rochester.edu RNAstructure.html


Euler and Laplace integral representations of GKZ hypergeometric functions. We introduce an interpolation between Euler integral and Laplace integral Euler Laplace integral. We establish a combinatorial method of constructing a basis of the rapid decay homology group associated to Euler Laplace integral with a nice intersection property. This construction yields a remarkable expansion formula of cohomology intersection numbers in terms of GKZ hypergeometric series. As an application, we obtain closed formulas of the quadratic relations of Aomoto Gelfand hypergeometric functions and their confluent analogue in terms of bipartite graphs.


Energy Based Molecular Orbital Localization in a Specific Spatial Region. We present a novel energy based localization procedure able to localize molecular orbitals into specific spatial regions. The method is applied to several cases including both conjugated and non conjugated systems. The obtained localized molecular orbitals are used in a multiscale framework based on the multilevel Hartree Fock approach. An almost perfect agreement with reference values is achieved for both ground state properties, such as dipole moments, and local excitation energies calculated at the coupled cluster level. The proposed approach is useful to extend the application range of high level electron correlation methods. In fact, the reduced number of molecular orbitals can lead to a large reduction in the computational cost of correlated calculations.


Embedding Culture and Grit in the Technology Acceptance Model (TAM) for Higher Education. The implementors of learning technologies within education environments often follow strategies that assume the educational environment within which they are being introduced is culturally neutral. A comprehensive literature review including 150 papers on educational technology challenges was undertaken. The purpose of this review is explore different contextual challenges to the adoption of educational technology in the higher education sector. The cultural factors that define the key stakeholders (e.g., teachers, lectures, students and support staff) are often ignored when the implementation processes are undertaken. Furthermore, it is often assumed that the personnel responsible for the implementation are also culturally neutral and do not possess any attributes unique to their culture. It has been shown that cultural factors may significantly influence the implementation of learning technologies and to design strategies that fail to consider factors may limit their efficiency and effectiveness. The challenges are interrelated and based on the findings, this review proposes a conceptual framework by integrating culture and grit into the Technology Acceptance Model(TAM) for implementing educational technology in higher education. The framework will be useful to guide both practice and research.


ICurry. FlatCurry is a well established intermediate representation of Curry programs used in compilers that translate Curry code into Prolog and Haskell code. Some FlatCurry constructs have no direct translation into imperative code. These constructs must be each handled differently when translating Curry code into C, C and Python code. We introduce a new representation of Curry programs, called ICurry, and derive a translation from all FlatCurry constructs into ICurry. We present the syntax of ICurry and the translation from FlatCurry to ICurry. We present a model of functional logic computations as graph rewriting, show how this model can be implemented in a low level imperative language, and describe the translation from ICurry to this model.


The SmartSHARK Ecosystem for Software Repository Mining. Software repository mining is the foundation for many empirical software engineering studies. The collection and analysis of detailed data can be challenging, especially if data shall be shared to enable replicable research and open science practices. SmartSHARK is an ecosystem that supports replicable and reproducible research based on software repository mining.


GKM Theory for Torus Actions on Cyclic Quiver Grassmannians. We define and investigate algebraic torus actions on quiver Grassmannians for nilpotent representations of the equioriented cycle. Examples of such varieties are type tt A flag varieties, their linear degenerations, finite dimensional approximations of the GL n affine flag variety and affine Grassmannian. We show that these quiver Grassmannians, equipped with our torus action, are GKM varieties and that their moment graph admits a combinatorial description in terms of coefficients quiver of the underlying quiver representations. By adapting to our setting results by Gonzales, we are able to prove that moment graph techniques can be applied to construct module bases for the equivariant cohomology of the above quiver Grassmannians.


Closing the AI Accountability Gap Defining an End to End Framework for Internal Algorithmic Auditing. Rising concern for the societal implications of artificial intelligence systems has inspired a wave of academic and journalistic literature in which deployed systems are audited for harm by investigators from outside the organizations deploying the algorithms. However, it remains challenging for practitioners to identify the harmful repercussions of their own systems prior to deployment, and, once deployed, emergent issues can become difficult or impossible to trace back to their source. In this paper, we introduce a framework for algorithmic auditing that supports artificial intelligence system development end to end, to be applied throughout the internal organization development lifecycle. Each stage of the audit yields a set of documents that together form an overall audit report, drawing on an organization's values or principles to assess the fit of decisions made throughout the process. The proposed auditing framework is intended to contribute to closing the accountability gap in the development and deployment of large scale artificial intelligence systems by embedding a robust process to ensure audit integrity.


Implementation of Strong Numerical Methods of Orders 0.5, 1.0, 1.5, 2.0, 2.5, and 3.0 for Ito SDEs with Non Commutative Noise Based on the Unified Taylor Ito and Taylor Stratonovich Expansions and Multiple Fourier Legendre Series. The article is devoted to the implementation of strong numerical methods with convergence orders 0.5, 1.0, 1.5, 2.0, 2.5, and 3.0 for Ito stochastic differential equations with multidimensional non commutative noise based on the unified Taylor Ito and Taylor Stratonovich expansions and multiple Fourier Legendre series. Algorithms for the implementation of these methods are constructed and a package of programs in the Python programming language is presented. An important part of this software package, concerning the mean square approximation of iterated Ito and Stratonovich stochastic integrals of multiplicities 1 to 6 with respect to components of the multidimensional Wiener process is based on the method of generalized multiple Fourier series. More precisely, we used the multiple Fourier Legendre series converging in the sense of norm in Hilbert space L 2( t, T k) (k 1, ldots,6) for the mean square approximation of iterated Ito and Stratonovich stochastic integrals.


Pareto Deterministic Policy Gradients and Its Application in 5G Massive MIMO Networks. In this paper, we consider jointly optimizing cell load balance and network throughput via a reinforcement learning (RL) approach, where inter cell handover (i.e., user association assignment) and massive MIMO antenna tilting are configured as the RL policy to learn. Our rationale behind using RL is to circumvent the challenges of analytically modeling user mobility and network dynamics. To accomplish this joint optimization, we integrate vector rewards into the RL value network and conduct RL action via a separate policy network. We name this method as Pareto deterministic policy gradients (PDPG). It is an actor critic, model free and deterministic policy algorithm which can handle the coupling objectives with the following two merits 1) It solves the optimization via leveraging the degree of freedom of vector reward as opposed to choosing handcrafted scalar reward 2) Cross validation over multiple policies can be significantly reduced. Accordingly, the RL enabled network behaves in a self organized way It learns out the underlying user mobility through measurement history to proactively operate handover and antenna tilt without environment assumptions. Our numerical evaluation demonstrates that the introduced RL method outperforms scalar reward based approaches. Meanwhile, to be self contained, an ideal static optimization based brute force search solver is included as a benchmark. The comparison shows that the RL approach performs as well as this ideal strategy, though the former one is constrained with limited environment observations and lower action frequency, whereas the latter ones have full access to the user mobility. The convergence of our introduced approach is also tested under different user mobility environment based on our measurement data from a real scenario.


Wiener Index and Remoteness in Triangulations and Quadrangulations. Let G be a a connected graph. The Wiener index of a connected graph is the sum of the distances between all unordered pairs of vertices. We provide asymptotic formulae for the maximum Wiener index of simple triangulations and quadrangulations with given connectivity, as the order increases, and make conjectures for the extremal triangulations and quadrangulations based on computational evidence. If overline sigma (v) denotes the arithmetic mean of the distances from v to all other vertices of G , then the remoteness of G is defined as the largest value of overline sigma (v) over all vertices v of G . We give sharp upper bounds on the remoteness of simple triangulations and quadrangulations of given order and connectivity.


Semantic Product Search for Matching Structured Product Catalogs in E Commerce. Retrieving all semantically relevant products from the product catalog is an important problem in E commerce. Compared to web documents, product catalogs are more structured and sparse due to multi instance fields that encode heterogeneous aspects of products (e.g. brand name and product dimensions). In this paper, we propose a new semantic product search algorithm that learns to represent and aggregate multi instance fields into a document representation using state of the art transformers as encoders. Our experiments investigate two aspects of the proposed approach (1) effectiveness of field representations and structured matching (2) effectiveness of adding lexical features to semantic search. After training our models using user click logs from a well known E commerce platform, we show that our results provide useful insights for improving product search. Lastly, we present a detailed error analysis to show which types of queries benefited the most by fielded representations and structured matching.


A Survey on Deep Learning Based Point Of Interest (POI) Recommendations. Location based Social Networks (LBSNs) enable users to socialize with friends and acquaintances by sharing their check ins, opinions, photos, and reviews. Huge volume of data generated from LBSNs opens up a new avenue of research that gives birth to a new sub field of recommendation systems, known as Point of Interest (POI) recommendation. A POI recommendation technique essentially exploits users' historical check ins and other multi modal information such as POI attributes and friendship network, to recommend the next set of POIs suitable for a user. A plethora of earlier works focused on traditional machine learning techniques by using hand crafted features from the dataset. With the recent surge of deep learning research, we have witnessed a large variety of POI recommendation works utilizing different deep learning paradigms. These techniques largely vary in problem formulations, proposed techniques, used datasets, and features, etc. To the best of our knowledge, this work is the first comprehensive survey of all major deep learning based POI recommendation works. Our work categorizes and critically analyzes the recent POI recommendation works based on different deep learning paradigms and other relevant features. This review can be considered a cookbook for researchers or practitioners working in the area of POI recommendation.


Gait Graph Optimization Generate Variable Gaits from One Base Gait for Lower limb Rehabilitation Exoskeleton Robots. The most concentrated application of lower limb rehabilitation exoskeleton (LLE) robot is that it can help paraplegics "re walk". However, "walking" in daily life is more than just walking on flat ground with fixed gait. This paper focuses on variable gaits generation for LLE robot to adapt complex walking environment. Different from traditional gaits generator for biped robot, the generated gaits for LLEs should be comfortable to patients. Inspired by the pose graph optimization algorithm in SLAM, we propose a graph based gait generation algorithm called gait graph optimization (GGO) to generate variable, functional and comfortable gaits from one base gait collected from healthy individuals to adapt the walking environment. Variants of walking problem, e.g., stride adjustment, obstacle avoidance, and stair ascent and descent, help verify the proposed approach in simulation and experimentation. We open source our implementation.


MKD a Multi Task Knowledge Distillation Approach for Pretrained Language Models. Pretrained language models have led to significant performance gains in many NLP tasks. However, the intensive computing resources to train such models remain an issue. Knowledge distillation alleviates this problem by learning a light weight student model. So far the distillation approaches are all task specific. In this paper, we explore knowledge distillation under the multi task learning setting. The student is jointly distilled across different tasks. It acquires more general representation capacity through multi tasking distillation and can be further fine tuned to improve the model in the target domain. Unlike other BERT distillation methods which specifically designed for Transformer based architectures, we provide a general learning framework. Our approach is model agnostic and can be easily applied on different future teacher model architectures. We evaluate our approach on a Transformer based and LSTM based student model. Compared to a strong, similarly LSTM based approach, we achieve better quality under the same computational constraints. Compared to the present state of the art, we reach comparable results with much faster inference speed.


Dynamic Graph Learning Instance aware Connectivity for Neural Networks. One practice of employing deep neural networks is to apply the same architecture to all the input instances. However, a fixed architecture may not be representative enough for data with high diversity. To promote the model capacity, existing approaches usually employ larger convolutional kernels or deeper network structure, which may increase the computational cost. In this paper, we address this issue by raising the Dynamic Graph Network (DG Net). The network learns the instance aware connectivity, which creates different forward paths for different instances. Specifically, the network is initialized as a complete directed acyclic graph, where the nodes represent convolutional blocks and the edges represent the connection paths. We generate edge weights by a learnable module textit router and select the edges whose weights are larger than a threshold, to adjust the connectivity of the neural network structure. Instead of using the same path of the network, DG Net aggregates features dynamically in each node, which allows the network to have more representation ability. To facilitate the training, we represent the network connectivity of each sample in an adjacency matrix. The matrix is updated to aggregate features in the forward pass, cached in the memory, and used for gradient computing in the backward pass. We verify the effectiveness of our method with several static architectures, including MobileNetV2, ResNet, ResNeXt, and RegNet. Extensive experiments are performed on ImageNet classification and COCO object detection, which shows the effectiveness and generalization ability of our approach.


Differentially Private Language Models Benefit from Public Pre training. Language modeling is a keystone task in natural language processing. When training a language model on sensitive information, differential privacy (DP) allows us to quantify the degree to which our private data is protected. However, training algorithms which enforce differential privacy often lead to degradation in model quality. We study the feasibility of learning a language model which is simultaneously high quality and privacy preserving by tuning a public base model on a private corpus. We find that DP fine tuning boosts the performance of language models in the private domain, making the training of such models possible.


Promotion Sorting. Sch " u tzenberger's promotion operator is an extensively studied bijection that permutes the linear extensions of a finite poset. We introduce a natural extension partial of this operator that acts on all labelings of a poset. We prove several properties of partial in particular, we show that for every labeling L of an n element poset P , the labeling partial n 1 (L) is a linear extension of P . Thus, we can view the dynamical system defined by partial as a sorting procedure that sorts labelings into linear extensions. For all 0 leq k leq n 1 , we characterize the n element posets P that admit labelings that require at least n k 1 iterations of partial in order to become linear extensions. The case in which k 0 concerns labelings that require the maximum possible number of iterations in order to be sorted we call these labelings tangled. We explicitly enumerate tangled labelings for a large class of posets that we call inflated rooted forest posets. For an arbitrary finite poset, we show how to enumerate the sortable labelings, which are the labelings L such that partial(L) is a linear extension.


Causal Knowledge Extraction from Scholarly Papers in Social Sciences. The scale and scope of scholarly articles today are overwhelming human researchers who seek to timely digest and synthesize knowledge. In this paper, we seek to develop natural language processing (NLP) models to accelerate the speed of extraction of relationships from scholarly papers in social sciences, identify hypotheses from these papers, and extract the cause and effect entities. Specifically, we develop models to 1) classify sentences in scholarly documents in business and management as hypotheses (hypothesis classification), 2) classify these hypotheses as causal relationships or not (causality classification), and, if they are causal, 3) extract the cause and effect entities from these hypotheses (entity extraction). We have achieved high performance for all the three tasks using different modeling techniques. Our approach may be generalizable to scholarly documents in a wide range of social sciences, as well as other types of textual materials.


Steering Flexural Waves by Amplitude Shift Elastic Metasurfaces. As 2D materials with subwavelength structures, elastic metasurfaces show remarkable abilities to manipulate elastic waves at will through artificial boundary conditions. However, the application prospects of current metasurfaces may be restricted by their phase only modulating boundaries. Herein, we present the next generation of elastic metasurfaces by additionally incorporating amplitude shift modulation. A general theory for target wave fields steered by metasurfaces is proposed by modifying the Huygens Fresnel principle. As examples, two amplitude shift metasurfaces concerning flexural waves in thin plates are carried out one is to transform a cylindrical wave into a Gaussian beam by elaborating both amplitude and phase shifts, and the other one is to focus the incidence by amplitude modulations only. These examples coincide well over theoretical calculations, numerical simulations and experimental tests. This work may underlie the design of metasurfaces with complete control over guided elastic waves, and may extend to more sophisticated applications, such as analog signal processing and holographic imaging.


Double Affine Bruhat Order. We classify cocovers and covers of a given element of the double affine Weyl semigroup W with respect to the Bruhat order, specifically when W is associated to a finite root system that is irreducible and simply laced. We show two approaches one extending the work of Lam and Shimozono, and its strengthening by Milicevic, where cocovers are characterized in the affine case using the quantum Bruhat graph of the finite Weyl group, and another, which takes a more geometrical approach by using the length difference set defined by Muthiah and Orr.


Functional L "owner Ellipsoids. We extend the notion of the smallest volume ellipsoid containing a convex body in mathbb R d to the setting of logarithmically concave functions. We consider a vast class of logarithmically concave functions whose superlevel sets are concentric ellipsoids. For a fixed function from this class, we consider the set of all its "affine" positions. For any log concave function f on mathbb R d , we consider functions belonging to this set of "affine" positions, and find the one with the smallest integral under the condition that it is pointwise greater than or equal to f. We study the properties of existence and uniqueness of the solution to this problem. For any s in 0, infty), we consider the construction dual to the recently defined John s function cite ivanov2020functional . We prove that such a construction determines a unique function and call it the emph L "owner s function of f. We study the L "owner s functions as s tends to zero and to infinity. Finally, extending the notion of the outer volume ratio, we define the outer integral ratio of a log concave function and give an asymptotically tight bound on it. end abstract


TCNN Triple Convolutional Neural Network Models for Retrieval based Question Answering System in E commerce. Automatic question answering (QA) systems have boomed during last few years, and commonly used techniques can be roughly categorized into Information Retrieval (IR) based and generation based. A key solution to the IR based models is to retrieve the most similar knowledge entries of a given query from a QA knowledge base, and then rerank those knowledge entries with semantic matching models. In this paper, we aim to improve an IR based e commerce QA system AliMe with proposed text matching models, including a basic Triple Convolutional Neural Network (TCNN) model and two Attention based TCNN (ATCNN) models. Experimental results show their effect.


Volumetric bounds for intersections of congruent balls. We investigate the intersections of balls of radius r , called r ball bodies, in Euclidean d space. An r lense (resp., r spindle) is the intersection of two balls of radius r (resp., balls of radius r containing a given pair of points). We prove that among r ball bodies of given volume, the r lense (resp., r spindle) has the smallest inradius (resp., largest circumradius). In general, we upper (resp., lower) bound the intrinsic volumes of r ball bodies of given inradius (resp., circumradius). This complements and extends some earlier results on volumetric estimates for r ball bodies.


On distinct consecutive differences. We show that if A a 1 a 2 ldots a k is a set of real numbers such that the differences of the consecutive elements are distinct, then for and finite B subset mathbb R , A B gg A 1 2 B . The bound is tight up to the constant.


Motion Planner Augmented Reinforcement Learning for Robot Manipulation in Obstructed Environments. Deep reinforcement learning (RL) agents are able to learn contact rich manipulation tasks by maximizing a reward signal, but require large amounts of experience, especially in environments with many obstacles that complicate exploration. In contrast, motion planners use explicit models of the agent and environment to plan collision free paths to faraway goals, but suffer from inaccurate models in tasks that require contacts with the environment. To combine the benefits of both approaches, we propose motion planner augmented RL (MoPA RL) which augments the action space of an RL agent with the long horizon planning capabilities of motion planners. Based on the magnitude of the action, our approach smoothly transitions between directly executing the action and invoking a motion planner. We evaluate our approach on various simulated manipulation tasks and compare it to alternative action spaces in terms of learning efficiency and safety. The experiments demonstrate that MoPA RL increases learning efficiency, leads to a faster exploration, and results in safer policies that avoid collisions with the environment. Videos and code are available at https clvrai.com mopa rl .


Teaching and learning special relativity theory in secondary and lower undergraduate education A literature review. This review presents an overview and analysis of the body of research on special relativity theory (SRT) education at the secondary and lower undergraduate level. There is currently a growing international interest in implementing SRT in pre university education as an introduction to modern physics. For this reason, insights into learning opportunities and challenges in SRT education are needed. The field of research in SRT education is still at an early stage, especially at the level of secondary education, and there is a shortage of empirical evaluation of learning outcomes. In order to guide future research directions, there is a need for an overview and synthesis of the results reported so far. We have selected 40 articles and categorized them according to reported learning difficulties, teaching approaches, and research tools. Analysis shows that students at all educational levels experience learning difficulties with the use of frames of reference, the postulates of SRT, and relativistic effects. In the reported teaching sequences, instructional materials, and learning activities, these difficulties are approached from different angles. Some teaching approaches focus on thought experiments to express conceptual features of SRT, while others use virtual environments to provide realistic visualization of relativistic effects. From the reported teaching approaches, three learning objectives can be identified to foster conceptual understanding, to foster understanding of the history and philosophy of science, and to gain motivation and confidence toward SRT and physics in general. In order to quantitatively compare learning outcomes of different teaching strategies, a more thorough evaluation of assessment tools is required.


Description of generalized isomonodromic deformations of rank two linear differential equations using apparent singularities. In this paper, we consider the generalized isomonodromic deformations of rank two irregular connections on the Riemann sphere. We introduce Darboux coordinates on the parameter space of a family of rank two irregular connections by apparent singularities. By the Darboux coordinates, we describe the generalized isomonodromic deformations as Hamiltonian systems.


Enjoy the Untrusted Cloud A Secure, Scalable and Efficient SQL like Query Framework for Outsourcing Data. While the security of the cloud remains a concern, a common practice is to encrypt data before outsourcing them for utilization. One key challenging issue is how to efficiently perform queries over the ciphertext. Conventional crypto based solutions, e.g. partially fully homomorphic encryption and searchable encryption, suffer from low performance, poor expressiveness and weak compatibility. An alternative method that utilizes hardware assisted trusted execution environment, i.e., Intel SGX, has emerged recently. On one hand, such work lacks of supporting scalable access control over multiple data users. On the other hand, existing solutions are subjected to the key revocation problem and knowledge extractor vulnerability. In this work, we leverage the newly hardware assisted methodology and propose a secure, scalable and efficient SQL like query framework named QShield. Building upon Intel SGX, QShield can guarantee the confidentiality and integrity of sensitive data when being processed on an untrusted cloud platform. Moreover, we present a novel lightweight secret sharing method to enable multi user access control in QShield, while tackling the key revocation problem. Furthermore, with an additional trust proof mechanism, QShield guarantees the correctness of queries and significantly alleviates the possibility to build a knowledge extractor. We implemented a prototype for QShield and show that QShield incurs minimum performance cost.


Counting Labeled Threshold Graphs with Eulerian Numbers. A threshold graph is any graph which can be constructed from the empty graph by repeatedly adding a new vertex that is either adjacent to every vertex or to no vertices. The Eulerian number genfrac langle rangle 0pt n k counts the number of permutations of size n with exactly k ascents. Implicitly Beissinger and Peled proved that the number of labeled threshold graphs on n ge 2 vertices is sum k 1 n 1 (n k) genfrac langle rangle 0pt n 1 k 1 2 k. Their proof used generating functions. We give a direct combinatorial proof of this result.


Generating Synthetic Data for Task Oriented Semantic Parsing with Hierarchical Representations. Modern conversational AI systems support natural language understanding for a wide variety of capabilities. While a majority of these tasks can be accomplished using a simple and flat representation of intents and slots, more sophisticated capabilities require complex hierarchical representations supported by semantic parsing. State of the art semantic parsers are trained using supervised learning with data labeled according to a hierarchical schema which might be costly to obtain or not readily available for a new domain. In this work, we explore the possibility of generating synthetic data for neural semantic parsing using a pretrained denoising sequence to sequence model (i.e., BART). Specifically, we first extract masked templates from the existing labeled utterances, and then fine tune BART to generate synthetic utterances conditioning on the extracted templates. Finally, we use an auxiliary parser (AP) to filter the generated utterances. The AP guarantees the quality of the generated data. We show the potential of our approach when evaluating on the Facebook TOP dataset for navigation domain.


Learning to Sample the Most Useful Training Patches from Images. Some image restoration tasks like demosaicing require difficult training samples to learn effective models. Existing methods attempt to address this data training problem by manually collecting a new training dataset that contains adequate hard samples, however, there are still hard and simple areas even within one single image. In this paper, we present a data driven approach called PatchNet that learns to select the most useful patches from an image to construct a new training set instead of manual or random selection. We show that our simple idea automatically selects informative samples out from a large scale dataset, leading to a surprising 2.35dB generalisation gain in terms of PSNR. In addition to its remarkable effectiveness, PatchNet is also resource friendly as it is applied only during training and therefore does not require any additional computational cost during inference.


Spectral gap of scl in graphs of groups and 3 manifolds. The stable commutator length scl G(g) of an element g in a group G is an invariant for group elements sensitive to the geometry and dynamics of G. For any group G acting on a tree, we prove a sharp bound scl G(g) 1 2 for any g acting without fixed points, provided that the stabilizer of each edge is relatively torsion free in its vertex stabilizers. The sharp gap becomes 1 2 1 n if the edge stabilizers are n relatively torsion free in vertex stabilizers. We also compute scl G for elements acting with a fixed point. This implies many such groups have a spectral gap, that is, there is a constant C 0 such that either scl G(g) C or scl G(g) 0. New examples include the fundamental group of any 3 manifold using the JSJ decomposition, though the gap must depend on the manifold. We also compute the exact gap of graph products. We prove these statements by characterizing maps of surfaces to a suitable K(G,1). In many cases, we also find families of quasimorphisms that realize these gaps. In particular, we construct quasimorphisms realizing the 1 2 gap for free groups explicitly induced by actions on the circle.


Adversarial Network with Multiple Classifiers for Open Set Domain Adaptation. Domain adaptation aims to transfer knowledge from a domain with adequate labeled samples to a domain with scarce labeled samples. Prior research has introduced various open set domain adaptation settings in the literature to extend the applications of domain adaptation methods in real world scenarios. This paper focuses on the type of open set domain adaptation setting where the target domain has both private ('unknown classes') label space and the shared ('known classes') label space. However, the source domain only has the 'known classes' label space. Prevalent distribution matching domain adaptation methods are inadequate in such a setting that demands adaptation from a smaller source domain to a larger and diverse target domain with more classes. For addressing this specific open set domain adaptation setting, prior research introduces a domain adversarial model that uses a fixed threshold for distinguishing known from unknown target samples and lacks at handling negative transfers. We extend their adversarial model and propose a novel adversarial domain adaptation model with multiple auxiliary classifiers. The proposed multi classifier structure introduces a weighting module that evaluates distinctive domain characteristics for assigning the target samples with weights which are more representative to whether they are likely to belong to the known and unknown classes to encourage positive transfers during adversarial training and simultaneously reduces the domain gap between the shared classes of the source and target domains. A thorough experimental investigation shows that our proposed method outperforms existing domain adaptation methods on a number of domain adaptation datasets.


Hilbert spaces and C ast algebras are not finitely concrete. We show that no faithful functor from the category of Hilbert spaces with linear isometries into the category of sets preserves directed colimits. Thus Hilbert spaces cannot form an abstract elementary class, even up to change of language. We deduce an analogous result for the category of commutative unital C ast algebras with ast homomorphisms. This implies, in particular, that this category is not axiomatizable by a first order theory, a strengthening of a conjecture of Bankston.


An encounter in the realm of Structural Stability between a qualitative theory for geometric shapes and one for the integral foliations of differential equations. This evocative essay focuses on some landmarks that led the author to the study of principal curvature configurations on surfaces in mathbb R 3 , their structural stability and generic properties. The starting point was an encounter with the book of D. Struik and the reading of the references to the works of Euler, Monge and Darboux found there. The concatenation of these references with the work of Peixoto, 1962, on differential equations on surfaces, was a crucial second step. The circumstances of the convergence toward the theorems of Guti 'errez and Sotomayor, 1982 1983, are recounted here. The above 1982 1983 theorems are pointed out as the first encounter between the line of thought disclosed from the works of Monge, 1796, Dupin, 1815, and Darboux, 1896, with that transpiring from the achievements of Poincar 'e, 1881, Andronov Pontrjagin, 1937, and Peixoto, 1962. Some mathematical developments sprouting from the 1982 1983 works are mentioned on the final section of this essay.


Estimate on the dimension of the singular set of the supercritical surface quasigeostrophic equation. We consider the SQG equation with dissipation given by a fractional Laplacian of order alpha frac 1 2 . We introduce a notion of suitable weak solution, which exists for every L 2 initial datum, and we prove that for such solution the singular set is contained in a compact set in spacetime of Hausdorff dimension at most frac 1 2 alpha left( frac 1 alpha alpha (1 2 alpha) 2 right) .


A characterisation of ordered abstract probabilities. In computer science, especially when dealing with quantum computing or other non standard models of computation, basic notions in probability theory like "a predicate" vary wildly. There seems to be one constant the only useful example of an algebra of probabilities is the real unit interval. In this paper we try to explain this phenomenon. We will show that the structure of the real unit interval naturally arises from a few reasonable assumptions. We do this by studying effect monoids, an abstraction of the algebraic structure of the real unit interval it has an addition x y which is only defined when x y leq 1 and an involution x mapsto 1 x which make it an effect algebra, in combination with an associative (possibly non commutative) multiplication. Examples include the unit intervals of ordered rings and Boolean algebras. We present a structure theory for effect monoids that are omega complete, i.e. where every increasing sequence has a supremum. We show that any omega complete effect monoid embeds into the direct sum of a Boolean algebra and the unit interval of a commutative unital C algebra. This gives us from first principles a dichotomy between sharp logic, represented by the Boolean algebra part of the effect monoid, and probabilistic logic, represented by the commutative C algebra. Some consequences of this characterisation are that the multiplication must always be commutative, and that the unique omega complete effect monoid without zero divisors and more than 2 elements must be the real unit interval. Our results give an algebraic characterisation and motivation for why any physical or logical theory would represent probabilities by real numbers.


Understanding the Nature of System Related Issues in Machine Learning Frameworks An Exploratory Study. Modern systems are built using development frameworks. These frameworks have a major impact on how the resulting system executes, how configurations are managed, how it is tested, and how and where it is deployed. Machine learning (ML) frameworks and the systems developed using them differ greatly from traditional frameworks. Naturally, the issues that manifest in such frameworks may differ as well as may the behavior of developers addressing those issues. We are interested in characterizing the system related issues issues impacting performance, memory and resource usage, and other quality attributes that emerge in ML frameworks, and how they differ from those in traditional frameworks. We have conducted a moderate scale exploratory study analyzing real world system related issues from 10 popular machine learning frameworks. Our findings offer implications for the development of machine learning systems, including differences in the frequency of occurrence of certain issue types, observations regarding the impact of debate and time on issue correction, and differences in the specialization of developers. We hope that this exploratory study will enable developers to improve their expectations, plan for risk, and allocate resources accordingly when making use of the tools provided by these frameworks to develop ML based systems.


Security in biometric systems. The objective of biometric systems is to provide an identification mechanism. This identification mechanism can be used to fulfil several objectives. The most common, related to providing security to a resource, is usually authentication or detection of authorized personnel and detection of unauthorized personnel. From the technical point of view, these two objectives can be included in a single point since most functionalities are achieved by making searches of people previously identified in the database of the system in question. In the first case access is given to people entered in the database and in the second case access is given to people who are not entered in the database. Although these are the two most common attacks there are also others that we will discuss in this chapter. The structure of the chapter is as follows. The first part of the chapter gives an overview of the basic types of attacks and describes the usual protection measures (Sections 1, 2 and 3). The second part of the chapter describes several attacks that can be made on systems based on fingerprinting, face recognition, and iris recognition (Sections 4 and 5). Once the attack methodologies have been described, some specific protection measures are also discussed (Sections 4 and 5). Finally, side channel attacks and their usefulness in combination with other possible attacks are described (Section 6).


A formalisation of the SPARC TSO memory model for multi core machine code. SPARC processors have many applications in mission critical industries such as aviation and space engineering. Hence, it is important to provide formal frameworks that facilitate the verification of hardware and software that run on or interface with these processors. This paper presents the first mechanised SPARC Total Store Ordering (TSO) memory model which operates on top of an abstract model of the SPARC Instruction Set Architecture (ISA) for multi core processors. Both models are specified in the theorem prover Isabelle HOL. We formalise two TSO memory models one is an adaptation of the axiomatic SPARC TSO model, the other is a novel operational TSO model which is suitable for verifying execution results. We prove that the operational model is sound and complete with respect to the axiomatic model. Finally, we give verification examples with two case studies drawn from the SPARCv9 manual.


Actions of Cremona groups on CAT(0) cube complexes. For each d we construct CAT(0) cube complexes on which Cremona groups rank d act by isometries. From these actions we deduce new and old group theoretical and dynamical results about Cremona groups. In particular, we study the dynamical behaviour of the irreducible components of exceptional loci, we prove regularization theorems, we find new constraints on the degree growth for non regularizable birational transformations, and we show that the centralizer of certain birational transformations is small.


Breaking the logarithmic barrier in Roth's theorem on arithmetic progressions. We show that if A subset 1, ldots,N contains no non trivial three term arithmetic progressions then lvert A rvert ll N ( log N) 1 c for some absolute constant c 0 . In particular, this proves the first non trivial case of a conjecture of Erd H o s on arithmetic progressions.


Automatic Model Parallelism for Deep Neural Networks with Compiler and Hardware Support. The deep neural networks (DNNs) have been enormously successful in tasks that were hitherto in the human only realm such as image recognition, and language translation. Owing to their success the DNNs are being explored for use in ever more sophisticated tasks. One of the ways that the DNNs are made to scale for the complex undertakings is by increasing their size deeper and wider networks can model well the additional complexity. Such large models are trained using model parallelism on multiple compute devices such as multi GPUs and multi node systems. In this paper, we develop a compiler driven approach to achieve model parallelism. We model the computation and communication costs of a dataflow graph that embodies the neural network training process and then, partition the graph using heuristics in such a manner that the communication between compute devices is minimal and we have a good load balance. The hardware scheduling assistants are proposed to assist the compiler in fine tuning the distribution of work at runtime.


An observer for partially obstructed wood particles in industrial drying processes. In order for biomass drying processes to be efficient, it is crucial to achieve the target residual water content within a close margin, since more conservative drying would result in a waste of energy. A method for a reliable estimation of the water content is therefore of obvious importance. Ideally, such a method does not require any expensive sensors. We show reduced order models and extended Kalman filters can be combined to reliably determine the water content and temperature of wood particles based on only surface temperature measurements. The proposed observer works reliably if measurements are only available for parts of a particle face. It can therefore still be applied if particle surfaces are partially obstructed, which is a prerequisite for use in industrial processes and units, such as rotary dryers. The extended Kalman filter uses a reduced order model that is obtained by applying proper orthogonal decomposition and Galerkin projection to coupled PDEs that model heat conduction and water diffusion in anisotropic particles. In contrast to the original PDE simulation model, the reduced model and the filter based on it are suitable for real time computations and monitoring.


Automorphismes du groupe des automorphismes d'un groupe de Coxeter universel. Using the Guirardel Levitt outer space of a free product, we prove that the outer automorphism group of the outer automorphism group of the universal Coxeter group of rank n geq 5 is trivial, and that it is a cyclic group of order 2 if n 4 . In addition we prove that the outer automorphism group of the automorphism group of the universal Coxeter group of rank n geq 4 is trivial.


Tensor structured sketching for constrained least squares. Constrained least squares problems arise in many applications. Their memory and computation costs are expensive in practice involving high dimensional input data. We employ the so called "sketching" strategy to project the least squares problem onto a space of a much lower "sketching dimension" via a random sketching matrix. The key idea of sketching is to reduce the dimension of the problem as much as possible while maintaining the approximation accuracy. Tensor structure is often present in the data matrices of least squares, including linearized inverse problems and tensor decompositions. In this work, we utilize a general class of row wise tensorized sub Gaussian matrices as sketching matrices in constrained optimizations for the sketching design's compatibility with tensor structures. We provide theoretical guarantees on the sketching dimension in terms of error criterion and probability failure rate. In the context of unconstrained linear regressions, we obtain an optimal estimate for the sketching dimension. For optimization problems with general constraint sets, we show that the sketching dimension depends on a statistical complexity that characterizes the geometry of the underlying problems. Our theories are demonstrated in a few concrete examples, including unconstrained linear regression and sparse recovery problems.


On the Spectral Behavior and Normalization of a Resonance Free and High Frequency Stable Integral Equation. The CFIE used for solving scattering and radiation problems, although a resonance free formulation, suffers from an ill conditioning that strongly depends on the frequency and discretization density, both in the low and high frequency regime, resulting in slow convergence rates for iterative solvers. This work presents a new preconditioning scheme for the CFIE that cures the low and the high frequency as well as the dense discretization breakdown. The new preconditioner for the CFIE is based on a spherical harmonics analysis and the proper regularization with Helmholtz type operators. Numerical results have been obtained to prove the effectiveness of this new formulation in real scenarios.


Isotope effects on molecular structures and electronic properties of liquid water via deep potential molecular dynamics based on SCAN functional. Feynman path integral deep potential molecular dynamics (PI DPMD) calculations have been employed to study both light (H 2 O) and heavy water (D 2 O) within the isothermal isobaric ensemble. In particular, the deep neural network is trained based on ab initio data obtained from the strongly constrained and appropriately normed (SCAN) exchange correlation functional. Because of the lighter mass of hydrogen than deuteron, the properties of light water is more influenced by nuclear quantum effect than those of heavy water. Clear isotope effects are observed and analyzed in terms of hydrogen bond structure and electronic properties of water that are closely associated with experimental observables. The molecular structures of both liquid H 2 O and D 2 O agree well with the data extracted from scattering experiments. The delicate isotope effects on radial distribution functions and angular distribution functions are well reproduced as well. Our approach demonstrates that deep neural network combined with SCAN functional based ab initio molecular dynamics provides an accurate theoretical tool for modeling water and its isotope effects.


Cross Domain Latent Modulation for Variational Transfer Learning. We propose a cross domain latent modulation mechanism within a variational autoencoders (VAE) framework to enable improved transfer learning. Our key idea is to procure deep representations from one data domain and use it as perturbation to the reparameterization of the latent variable in another domain. Specifically, deep representations of the source and target domains are first extracted by a unified inference model and aligned by employing gradient reversal. Second, the learned deep representations are cross modulated to the latent encoding of the alternate domain. The consistency between the reconstruction from the modulated latent encoding and the generation using deep representation samples is then enforced in order to produce inter class alignment in the latent space. We apply the proposed model to a number of transfer learning tasks including unsupervised domain adaptation and image toimage translation. Experimental results show that our model gives competitive performance.


Maximizing Drift is Not Optimal for Solving OneMax. It may seem very intuitive that for the maximization of the OneMax problem OM(x) sum i 1 n x i the best that an elitist unary unbiased search algorithm can do is to store a best so far solution, and to modify it with the operator that yields the best possible expected progress in function value. This assumption has been implicitly used in several empirical works. In Doerr, Doerr, Yang Optimal parameter choices via precise black box analysis, TCS, 2020 it was formally proven that this approach is indeed almost optimal. In this work we prove that drift maximization is not optimal. More precisely, we show that for most fitness levels between n 2 and 2n 3 the optimal mutation strengths are larger than the drift maximizing ones. This implies that the optimal RLS is more risk affine than the variant maximizing the step wise expected progress. We show similar results for the mutation rates of the classic (1 1) Evolutionary Algorithm (EA) and its resampling variant, the (1 1) EA 0 . As a result of independent interest we show that the optimal mutation strengths, unlike the drift maximizing ones, can be even.


Robust Hierarchical Graph Classification with Subgraph Attention. Graph neural networks get significant attention for graph representation and classification in machine learning community. Attention mechanism applied on the neighborhood of a node improves the performance of graph neural networks. Typically, it helps to identify a neighbor node which plays more important role to determine the label of the node under consideration. But in real world scenarios, a particular subset of nodes together, but not the individual pairs in the subset, may be important to determine the label of the graph. To address this problem, we introduce the concept of subgraph attention for graphs. On the other hand, hierarchical graph pooling has been shown to be promising in recent literature. But due to noisy hierarchical structure of real world graphs, not all the hierarchies of a graph play equal role for graph classification. Towards this end, we propose a graph classification algorithm called SubGattPool which jointly learns the subgraph attention and employs two different types of hierarchical attention mechanisms to find the important nodes in a hierarchy and the importance of individual hierarchies in a graph. Experimental evaluation with different types of graph classification algorithms shows that SubGattPool is able to improve the state of the art or remains competitive on multiple publicly available graph classification datasets. We conduct further experiments on both synthetic and real world graph datasets to justify the usefulness of different components of SubGattPool and to show its consistent performance on other downstream tasks.


Laser Cooled Polyatomic Molecules for Improved Electron Electric Dipole Moment Searches. Doppler and Sisyphus cooling of 174 YbOH are achieved and studied. This polyatomic molecule has high sensitivity to physics beyond the Standard Model and represents a new class of species for future high precision probes of new T violating physics. The transverse temperature of the YbOH beam is reduced by nearly two orders of magnitude to 600 , mu K and the phase space density is increased by a factor of 6 via Sisyphus cooling. We develop a full numerical model of the laser cooling of YbOH and find excellent agreement with the data. We project that laser cooling and magneto optical trapping of long lived samples of YbOH molecules are within reach and these will allow a high sensitivity probe of the electric dipole moment (EDM) of the electron. The approach demonstrated here is easily generalized to other isotopologues of YbOH that have enhanced sensitivity to other symmetry violating electromagnetic moments.


Deep learning inter atomic potential model for accurate irradiation damage simulations. We propose a hybrid scheme that interpolates smoothly the Ziegler Biersack Littmark (ZBL) screened nuclear repulsion potential with a newly developed deep learning potential energy model. The resulting DP ZBL model can not only provide overall good performance on the predictions of near equilibrium material properties but also capture the right physics when atoms are extremely close to each other, an event that frequently happens in computational simulations of irradiation damage events. We applied this scheme to the simulation of the irradiation damage processes in the face centered cubic aluminium system, and found better descriptions in terms of the defect formation energy, evolution of collision cascades, displacement threshold energy, and residual point defects, than the widely adopted ZBL modified embedded atom method potentials and its variants. Our work provides a reliable and feasible scheme to accurately simulate the irradiation damage processes and opens up new opportunities to solve the predicament of lacking accurate potentials for enormous newly discovered materials in the irradiation effect field.


Anonymity Network Tor and Performance Analysis of ARANEA an IOT Based Privacy Preserving Router. There was a time when the word security was only confined to the physical protection of things that were valuable which must be guarded against all the odds. Today, in a world where people can do things virtually have emerged the necessity to protect the virtual world. Every single facet of our life is being controlled by the internet one way or another. There is no privacy in the cyberspace as the data which we are browsing on the internet is being monitored on the other side by someone. Each work we are doing on the internet is getting tracked or the data are getting leaked without consent. To browse the internet securely we developed a router named Aranea which relates to the browser Tor. Tor gives traffic anonymity and security. The Tor browser can be used in both positive and negative purpose. Tor encrypts data, it hides the location and identity of the user, it hides the IP address of the device, it hides the network traffic and many more. By using Tor browser each user can browse the internet safely in the cyber world. Our goal is to create an additional security bridge through the router Aranea for every user so that each user can simply browse the internet anonymously.


ApplicaAI at SemEval 2020 Task 11 On RoBERTa CRF, Span CLS and Whether Self Training Helps Them. This paper presents the winning system for the propaganda Technique Classification (TC) task and the second placed system for the propaganda Span Identification (SI) task. The purpose of TC task was to identify an applied propaganda technique given propaganda text fragment. The goal of SI task was to find specific text fragments which contain at least one propaganda technique. Both of the developed solutions used semi supervised learning technique of self training. Interestingly, although CRF is barely used with transformer based language models, the SI task was approached with RoBERTa CRF architecture. An ensemble of RoBERTa based models was proposed for the TC task, with one of them making use of Span CLS layers we introduce in the present paper. In addition to describing the submitted systems, an impact of architectural decisions and training schemes is investigated along with remarks regarding training models of the same or better quality with lower computational budget. Finally, the results of error analysis are presented.


Boundedness of log pluricanonical maps for surfaces of log general types in positive characteristic. In this article we prove the following boundedness result Fix a DCC set I subset 0, 1 . Let mathfrak D be the set of all log pairs (X, Delta) satisfying the following properties (i) X is a projective surface defined over an algebraically closed field, (ii) (X, Delta) is log canonical and the coefficients of Delta are in I , and (iii) K X Delta is big. Then there is a positive integer N N(I) depending only on the set I such that the linear system lceil m(K X Delta) rceil defines a birational map onto its image for all m geq N and (X, Delta) in mathfrak D


Radiative QED corrections to one photon transition rates in hydrogen atom at finite temperatures. Within the framework of QED theory at finite temperature the thermal radiative corrections to spontaneous one photon transition rates in hydrogen atom are investigated. The radiative one loop self energy corrections are described in the thermal case. Closed analytical expressions are derived and their numerical calculations for the spontaneous decay rate of the 2p state are carried out. Dominance of thermal radiative corrections to spontaneous Ly alpha decay rate over ordinary induced transition rate up to temperatures T 6000 K is demonstrated.


Detector Algorithms of Bounding Box and Segmentation Mask of a Mask R CNN Model. Detection performances on bounding box and segmentation mask outputs of Mask R CNN models are evaluated. There are significant differences in detection performances of bounding boxes and segmentation masks, where the former is constantly superior to the latter. Harmonic values of precisions and recalls of linear cracks, joints, fillings, and shadows are significantly lower in segmentation masks than bounding boxes. Other classes showed similar harmonic values. Discussions are made on different performances of detection metrics of bounding boxes and segmentation masks focusing on detection algorithms of both detectors.


Online Allocation and Pricing Constant Regret via Bellman Inequalities. We develop a framework for designing simple and efficient policies for a family of online allocation and pricing problems, that includes online packing, budget constrained probing, dynamic pricing, and online contextual bandits with knapsacks. In each case, we evaluate the performance of our policies in terms of their regret (i.e., additive gap) relative to an offline controller that is endowed with more information than the online controller. Our framework is based on Bellman Inequalities, which decompose the loss of an algorithm into two distinct sources of error (1) arising from computational tractability issues, and (2) arising from estimation prediction of random trajectories. Balancing these errors guides the choice of benchmarks, and leads to policies that are both tractable and have strong performance guarantees. In particular, in all our examples, we demonstrate constant regret policies that only require re solving an LP in each period, followed by a simple greedy action selection rule thus, our policies are practical as well as provably near optimal.


An Efficient Parametric Linear Programming Solver and Application to Polyhedral Projection. Polyhedral projection is a main operation of the polyhedron abstract domain.It can be computed via parametric linear programming (PLP), which is more efficient than the classic Fourier Motzkin elimination method.In prior work, PLP was done in arbitrary precision rational arithmetic.In this paper, we present an approach where most of the computation is performed in floating point arithmetic, then exact rational results are reconstructed.We also propose a workaround for a difficulty that plagued previous attempts at using PLP for computations on polyhedra in general the linear programming problems are degenerate, resulting in redundant computations and geometric descriptions.


Polynomial Invariant Theory and Shape Enumerator of Self Dual Codes in the NRT Metric. In this paper we consider self dual NRT codes, that is, self dual codes in the metric space endowed with the Niederreiter Rosenbloom Tsfasman (NRT metric). We use polynomial invariant theory to describe the shape enumerator of a binary self dual, doubly even self dual, and doubly doubly even self dual NRT code C subseteq M n,2 ( mathbb F 2 ) . Motivated by these results we describe the number of invariant polinomials that we must find to describe the shape enumerator of a self dual NRT code of M n,s ( mathbb F 2 ) . We define the ordered flip of a matrix A in M k,ns ( mathbb F q ) and present some constructions of self dual NRT codes over mathbb F q . We further give an application of ordered flip to the classification of bidimensional self dual NRT codes.


Compression with wildcards All exact, or all minimal hitting sets. Our main objective is the COMPRESSED enumeration (based on wildcards) of all minimal hitting sets of general hypergraphs. To the author's best knowledge the only previous attempt towards compression, due to Toda T , is based on BDD's and much different from our techniques. Numerical experiments show that traditional one by one enumeration schemes cannot compete against compressed enumeration when the degree of compression is high. Our method works particularly well in these two cases Either compressing all exact hitting sets, or all minimum cardinality hitting sets. It also supports parallelization and cut off (i.e. restriction to all minimal hitting sets of cardinality at most m).


Radius Adaptive Convolutional Neural Network. Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time consuming layer of the networks. Usually, the solution to address the computation cost is to decrease the number of trainable parameters. This solution usually comes with the cost of dropping the accuracy. Another problem with this technique is that usually the cost of memory access is not taken into account which results in insignificant speedup gain. The number of operations and memory access in a standard convolution layer is independent of the input content, which makes it limited for certain accelerations. We propose a simple modification to a standard convolution to bridge this gap. We propose an adaptive convolution that adopts different kernel sizes (or radii) based on the content. The network can learn and select the proper radius based on the input content in a soft decision manner. Our proposed radius adaptive convolutional neural network (RACNN) has a similar number of weights to a standard one, yet, results show it can reach higher speeds. The code has been made available at https github.com meisamrf racnn.


Shotgun Assembly of Erdos Renyi Random Graphs. Graph shotgun assembly refers to the problem of reconstructing a graph from a collection of local neighborhoods. In this paper, we consider shotgun assembly of ER random graphs G(n, p n) , where p n n alpha for 0 alpha 1 . We consider both reconstruction up to isomorphism as well as exact reconstruction (recovering the vertex labels as well as the structure). We show that given the collection of distance 1 neighborhoods, G is exactly reconstructable for 0 alpha frac 1 3 , but not reconstructable for frac 1 2 alpha 1 . Given the collection of distance 2 neighborhoods, G is exactly reconstructable for alpha in left(0, frac 1 2 right) cup left( frac 1 2 , frac 3 5 right) , but not reconstructable for frac 3 4 alpha 1 .


Bypassing the energy functional in density functional theory Direct calculation of electronic energies from conditional probability densities. Density functional calculations can fail for want of an accurate exchange correlation approximation. The energy can instead be extracted from a sequence of density functional calculations of conditional probabilities (CP DFT). Simple CP approximations yield usefully accurate results for two electron ions, the hydrogen dimer, and the uniform gas at all temperatures. CP DFT has no self interaction error for one electron, and correctly dissociates H2, both major challenges. For warm dense matter, classical CP DFT calculations can overcome the convergence problems of Kohn Sham DFT.


Higher order weighted Sobolev spaces on the real line for strongly degenerate weights. Application to variational problems in elasticity of beams. For one dimensional interval and integrable weight function w we define via completion a weighted Sobolev space H m,p mu w of arbitrary integer order m . The weights in consideration may suffer strong degeneration so that, in general, functions u from H m,p mu w do not have weak derivatives. This contribution is focussed on studying the continuity properties of functions u at a chosen internal point x 0 to which we attribute a notion of criticality of order k and with respect to the weight w . For non critical points x 0 we formulate a local embedding result that guarantees continuity of functions u or their derivatives. Conversely, we employ duality theory to show that criticality of x 0 furnishes a smooth approximation of functions in H m,p mu w admitting jump type discontinuities at x 0 . The work concludes with demonstration of established results in the context of variational problem in elasticity theory of beams with degenerate width distribution.


On the density of sumsets. Recently introduced by the authors in Proc. Edinb. Math. Soc. 60 (2020), 139 167 , quasi densities form a large family of real valued functions partially defined on the power set of the integers that serve as a unifying framework for the study of many known densities (including the asymptotic density, the Banach density, the logarithmic density, the analytic density, and the P 'olya density). We further contribute to this line of research by proving that (i) for each n in mathbf N and alpha in 0,1 , there is A subseteq mathbf N with kA in text dom ( mu) and mu(kA) alpha k n for every quasi density mu and every k 1, ldots, n , where kA A cdots A is the k fold sumset of A and text dom ( mu) denotes the domain of definition of mu (ii) for each alpha in 0,1 and every non empty finite B subseteq mathbf N , there is A subseteq mathbf N with A B in mathrm dom ( mu) and mu(A B) alpha for every quasi density mu (iii) for each alpha in 0,1 , there exists A subseteq mathbf N with 2A mathbf N such that A in text dom ( mu) and mu(A) alpha for every quasi density mu . Proofs rely on the properties of a little known density first considered by R.C. Buck and the "structure" of the set of all quasi densities in particular, they are rather different than previously known proofs of special cases of the same results.


Biembeddings of cycle systems using integer Heffter arrays. In this paper we will show the existence of a face 2 colourable biembedding of the complete graph onto an orientable surface where each face is a cycle of a fixed length k , for infinitely many values of k . In particular, under certain conditions, we show that there exists at least (n 2) (p 2)! 2 (e 2 kn) non isomorphic face 2 colourable biembeddings of K 2nk 1 in which all faces are cycles of length k 4p 3 . These conditions are n equiv 1 mod 4 , k equiv 3 mod 4 and either n is prime or n gg k and n equiv 0 mod 3 implies p equiv 1 mod 3 . To achieve this result we begin by verifying the existence of (n 2) (p 2)! e 2 non equivalent Heffter arrays, H(n k) , which satisfy the conditions (1) for each row and each column the sequential partial sums determined by the natural ordering must be distinct modulo 2nk 1 (2) the composition of the natural orderings of the rows and columns is equivalent to a single cycle permutation on the entries in the array. The existence of Heffter arrays H(n k) that satisfy condition (1) was established earlier in cite BCDY and in this current paper we vary this construction and show that there are at least (n 2) (p 2)! e 2 such non equivalent H(n k) that satisfy condition (1) and then show that each of these Heffter arrays also satisfy condition (2) under certain conditions.


Logic Synthesis Meets Machine Learning Trading Exactness for Generalization. Logic synthesis is a fundamental step in hardware design whose goal is to find structural representations of Boolean functions while minimizing delay and area. If the function is completely specified, the implementation accurately represents the function. If the function is incompletely specified, the implementation has to be true only on the care set. While most of the algorithms in logic synthesis rely on SAT and Boolean methods to exactly implement the care set, we investigate learning in logic synthesis, attempting to trade exactness for generalization. This work is directly related to machine learning where the care set is the training set and the implementation is expected to generalize on a validation set. We present learning incompletely specified functions based on the results of a competition conducted at IWLS 2020. The goal of the competition was to implement 100 functions given by a set of care minterms for training, while testing the implementation using a set of validation minterms sampled from the same function. We make this benchmark suite available and offer a detailed comparative analysis of the different approaches to learning


On Adaptation Cost and Tractability in Robust Adaptive Radiation Therapy Optimization. A framework for online robust adaptive radiation therapy (ART) is presented. This framework is designed to (i) handle interfractional geometric variations following a probability distribution different from the a priori hypothesis, (ii) address adaptation cost and (iii) address computational tractability. The novelty of this framework is the use of Bayesian inference and scenario reduction, which is evaluated in a series of treatment on a one dimensional phantom geometry. The initial robust plan is generated from a robust optimization problem based on either expected value or worst case optimization approach using the a priori hypothesis of the probability distribution governing the interfractional geometric variations. The actual interfractional variations are evaluated in terms of their likelihood with respect to the a priori hypothesis and violation of user specified tolerance limits. During an adaptation the a posteriori distribution is computed from the actual variations using Bayesian inference. The adapted plan is optimized to better suit the actual interfractional variations of the individual case, which is used until the next adaptation is. To address adaptation cost, the proposed framework provides an option for increased adaptation frequency. Computational tractability is addressed by scenario reduction algorithms to reduce the size of the optimization problem. According to the simulations, the proposed framework may improve target coverage compared to the corresponding non adaptive robust approach. Combining the worst case optimization approach with Bayesian inference may perform best in terms of improving CTV coverage and organ at risk (OAR) protection. Bayesian inference may have a greater impact on handling adaptation cost than increased adaptation frequency. The concept of scenario reduction may be useful to address computational tractability in ART and robust planning.


Algebraic reflexivity of diameter preserving linear bijections between C(X) spaces. We prove that if X and Y are first countable compact Hausdorff spaces, then the set of all diameter preserving linear bijections from C(X) to C(Y) is algebraically reflexive.


ICDAR2019 Robust Reading Challenge on Multi lingual Scene Text Detection and Recognition RRC MLT 2019. With the growing cosmopolitan culture of modern cities, the need of robust Multi Lingual scene Text (MLT) detection and recognition systems has never been more immense. With the goal to systematically benchmark and push the state of the art forward, the proposed competition builds on top of the RRC MLT 2017 with an additional end to end task, an additional language in the real images dataset, a large scale multi lingual synthetic dataset to assist the training, and a baseline End to End recognition method. The real dataset consists of 20,000 images containing text from 10 languages. The challenge has 4 tasks covering various aspects of multi lingual scene text (a) text detection, (b) cropped word script classification, (c) joint text detection and script classification and (d) end to end detection and recognition. In total, the competition received 60 submissions from the research and industrial communities. This paper presents the dataset, the tasks and the findings of the presented RRC MLT 2019 challenge.


On 1 absorbing primary ideal of a commutative ring (Correction to Theorem 17 is added). Let R be a commutative ring with identity. In this paper, we introduce the concept 1 absrbing primary ideal of R.


Towards usable automated detection of CPU architecture and endianness for arbitrary binary files and object code sequences. Static and dynamic binary analysis techniques are actively used to reverse engineer software's behavior and to detect its vulnerabilities, even when only the binary code is available for analysis. To avoid analysis errors due to misreading op codes for a wrong CPU architecture, these analysis tools must precisely identify the Instruction Set Architecture (ISA) of the object code under analysis. The variety of CPU architectures that modern security and reverse engineering tools must support is ever increasing due to massive proliferation of IoT devices and the diversity of firmware and malware targeting those devices. Recent studies concluded that falsely identifying the binary code's ISA caused alone about 10 of failures of IoT firmware analysis. The state of the art approaches to detect ISA for arbitrary object code look promising their results demonstrate effectiveness and high performance. However, they lack the support of publicly available datasets and toolsets, which makes the evaluation, comparison, and improvement of those techniques, datasets, and machine learning models quite challenging (if not impossible). This paper bridges multiple gaps in the field of automated and precise identification of architecture and endianness of binary files and object code. We develop from scratch the toolset and datasets that are lacking in this research space. As such, we contribute a comprehensive collection of open data, open source, and open API web services. We also attempt experiment reconstruction and cross validation of effectiveness, efficiency, and results of the state of the art methods. When training and testing classifiers using solely code sections from executable binary files, all our classifiers performed equally well achieving over 98 accuracy. The results are consistent and comparable with the current state of the art, hence supports the general validity of the algorithms


Plasmonic sensing with FIB milled 2D micro arrays of truncated gold nano pyramids. Plasmonic platforms are a promising solution for the next generation of low cost, integrated biomedical sensors. However, fabricating these nanostructures often requires lengthy and challenging fabrication processes. Here we exploit the peculiar features of Focused Ion Beam milling to obtain single step patterning of a plasmonic two dimensional (2D) array of truncated gold nano pyramids (TNP), with gaps as small as 17 nm. We describe the formation of plasmonic bandgaps in the arrangement of crossed tapered grooves that separate the nano pyramids, and we demonstrate refractive index sensing via dark field imaging in patterned areas of 30 mu m times 30 mu m.


AvgOut A Simple Output Probability Measure to Eliminate Dull Responses. Many sequence to sequence dialogue models tend to generate safe, uninformative responses. There have been various useful efforts on trying to eliminate them. However, these approaches either improve decoding algorithms during inference, rely on hand crafted features, or employ complex models. In our work, we build dialogue models that are dynamically aware of what utterances or tokens are dull without any feature engineering. Specifically, we start with a simple yet effective automatic metric, AvgOut, which calculates the average output probability distribution of all time steps on the decoder side during training. This metric directly estimates which tokens are more likely to be generated, thus making it a faithful evaluation of the model diversity (i.e., for diverse models, the token probabilities should be more evenly distributed rather than peaked at a few dull tokens). We then leverage this novel metric to propose three models that promote diversity without losing relevance. The first model, MinAvgOut, directly maximizes the diversity score through the output distributions of each batch the second model, Label Fine Tuning (LFT), prepends to the source sequence a label continuously scaled by the diversity score to control the diversity level the third model, RL, adopts Reinforcement Learning and treats the diversity score as a reward signal. Moreover, we experiment with a hybrid model by combining the loss terms of MinAvgOut and RL. All four models outperform their base LSTM RNN model on both diversity and relevance by a large margin, and are comparable to or better than competitive baselines (also verified via human evaluation). Moreover, our approaches are orthogonal to the base model, making them applicable as an add on to other emerging better dialogue models in the future.