Hello, It's GPT 2 How Can I Help You? Towards the Use of Pretrained Language Models for Task Oriented Dialogue Systems. Data scarcity is a long standing and crucial challenge that hinders quick development of task oriented dialogue systems across multiple domains task oriented dialogue models are expected to learn grammar, syntax, dialogue reasoning, decision making, and language generation from absurdly small amounts of task specific data. In this paper, we demonstrate that recent progress in language modeling pre training and transfer learning shows promise to overcome this problem. We propose a task oriented dialogue model that operates solely on text input it effectively bypasses explicit policy and language generation modules. Building on top of the TransferTransfo framework (Wolf et al., 2019) and generative model pre training (Radford et al., 2019), we validate the approach on complex multi domain task oriented dialogues from the MultiWOZ dataset. Our automatic and human evaluations show that the proposed model is on par with a strong task specific neural baseline. In the long run, our approach holds promise to mitigate the data scarcity problem, and to support the construction of more engaging and more eloquent task oriented conversational agents.


No infimum gap and normality in optimal impulsive control under state constraints. In this paper we consider an impulsive extension of an optimal control problem with unbounded controls, subject to endpoint and state constraints. We show that the existence of an extended sense minimizer that is a normal extremal for a constrained Maximum Principle ensures that there is no gap between the infima of the original problem and of its extension. Furthermore, we translate such relation into verifiable sufficient conditions for normality in the form of constraint and endpoint qualifications. Links between existence of an infimum gap and normality in impulsive control have previously been explored for problems without state constraints. This paper establishes such links in the presence of state constraints and of an additional ordinary control, for locally Lipschitz continuous data.


Positive arborealization of polarized Weinstein manifolds. Let X be a Weinstein manifold. We show that the existence of a global field of Lagrangian planes in TX is equivalent to the existence of a positive arboreal skeleton for the Weinstein homotopy class of X .


Semi abelian spectral data for singular fibres of the mathsf SL (2, mathbb C ) Hitchin system. We describe spectral data for singular fibres of the mathsf SL (2, mathbb C ) Hitchin fibration with irreducible and reduced spectral curve. Using Hecke transformations we give a stratification of these singular spaces by fibre bundles over Prym varieties. By analysing the parameter spaces of Hecke transformations this describes the singular Hitchin fibres as compactifications of abelian group bundles over abelian torsors. We prove that a large class of singular fibres are themselves fibre bundles over Prym varieties. As applications we study irreducible components of singular Hitchin fibres and give a description of mathsf SL (2, mathbb R ) Higgs bundles in terms of these semi abelian spectral data.


On k layered numbers and some labeling related to k layered numbers. In this paper, first, we define and investigate k layered numbers, which are a generalization of Zumkeller numbers. After that, we generalize the concept of Zumkeller labeling and Zumkeller cordial labeling to k layered labeling and k layered cordial labeling, respectively. Moreover, we prove that every simple graph admits Zumkeller labeling, Zumkeller cordial labeling, 3 layered labeling, 3 layered cordial labeling, 4 layered labeling and 4 layered cordial labeling.


Average preserving variation processes in view of optimization. In this paper, within the specific framework of an intrinsic calculus of variations on laws of semi martingales, which is based on information flows preserving perturbations, we investigate least action principles associated to average preserving variation processes. The associated Euler Lagrange conditions, which we obtain, exhibit a deterministic process aside the canonical martingale term. In particular, taking specific action functionals, we have that critical processes with respect to those variations encompass specific laws of continuous semi martingales whose drift characteristic is integrable with independent increments. Then, we relate critical processes of classical cost functions to a specific class of forward backward systems.


LAC Nav Collision Free Mutiagent Navigation Based on The Local Action Cells. Collision avoidance is one of the most primary requirement in the decentralized multiagent navigations while the agents are moving towards their own targets, attentions should be paid to avoid the collisions with the others. In this paper, we introduce the concept of local action cell, which provides for each agent a set of velocities that are safe to perform. Based on the realtime updated local action cells, we propose the LAC Nav approach to navigate the agent with the properly selected velocity and furthermore, we coupled the local action cell with an adaptive learning framework, in which the effect of selections are evaluated and used as the references for making decisions in the following updates. Through the experiments for three commonly considered scenarios, we demonstrated the efficiency of the proposed approaches, with the comparison to several widely studied strategies.


Robust Clustering Oracle and Local Reconstructor of Cluster Structure of Graphs. Due to the massive size of modern network data, local algorithms that run in sublinear time for analyzing the cluster structure of the graph are receiving growing interest. Two typical examples are local graph clustering algorithms that find a cluster from a seed node with running time proportional to the size of the output set, and clusterability testing algorithms that decide if a graph can be partitioned into a few clusters in the framework of property testing. In this work, we develop sublinear time algorithms for analyzing the cluster structure of graphs with noisy partial information. By using conductance based definitions for measuring the quality of clusters and the cluster structure, we formalize a definition of noisy clusterable graphs with bounded maximum degree. The algorithm is given query access to the adjacency list to such a graph. We then formalize the notion of robust clustering oracle for a noisy clusterable graph, and give an algorithm that builds such an oracle in sublinear time, which can be further used to support typical queries (e.g., IsOutlier( s ), SameCluster( s,t )) regarding the cluster structure of the graph in sublinear time. All the answers are consistent with a partition of G in which all but a small fraction of vertices belong to some good cluster. We also give a local reconstructor for a noisy clusterable graph that provides query access to a reconstructed graph that is guaranteed to be clusterable in sublinear time. All the query answers are consistent with a clusterable graph which is guaranteed to be close to the original graph.


Bounded Memory Criteria for Streams with Application Time. Bounded memory computability continues to be in the focus of those areas of AI and databases that deal with feasible computations over streams be it feasible arithmetical calculations on low level streams or feasible query answering for declaratively specified queries on relational data streams or even feasible query answering for high level queries on streams w.r.t. a set of constraints in an ontology such as in the paradigm of Ontology Based Data Access (OBDA). In classical OBDA, a high level query is answered by transforming it into a query on data source level. The transformation requires a rewriting step, where knowledge from an ontology is incorporated into the query, followed by an unfolding step with respect to a set of mappings. Given an OBDA setting it is very difficult to decide, whether and how a query can be answered efficiently. In particular it is difficult to decide whether a query can be answered in bounded memory, i.e., in constant space w.r.t. an infinitely growing prefix of a data stream. This work presents criteria for bounded memory computability of select project join (SPJ) queries over streams with application time. Deciding whether an SPJ query can be answered in constant space is easier than for high level queries, as neither an ontology nor a set of mappings are part of the input. Using the transformation process of classical OBDA, these criteria then can help deciding the efficiency of answering high level queries on streams.


Superiorization vs. Accelerated Convex Optimization The Superiorized Regularized Least Squares Case. We conduct a study and comparison of superiorization and optimization approaches for the reconstruction problem of superiorized regularized least squares solutions of underdetermined linear equations with nonnegativity variable bounds. Regarding superiorization, the state of the art is examined for this problem class, and a novel approach is proposed that employs proximal mappings and is structurally similar to the established forward backward optimization approach. Regarding convex optimization, accelerated forward backward splitting with inexact proximal maps is worked out and applied to both the natural splitting least squares term regularizer and to the reverse splitting regularizer least squares term. Our numerical findings suggest that superiorization can approach the solution of the optimization problem and leads to comparable results at significantly lower costs, after appropriate parameter tuning. On the other hand, applying accelerated forward backward optimization to the reverse splitting slightly outperforms superiorization, which suggests that convex optimization can approach superiorization too, using a suitable problem splitting.


Machine Common Sense. Machine common sense remains a broad, potentially unbounded problem in artificial intelligence (AI). There is a wide range of strategies that can be employed to make progress on this challenge. This article deals with the aspects of modeling commonsense reasoning focusing on such domain as interpersonal interactions. The basic idea is that there are several types of commonsense reasoning one is manifested at the logical level of physical actions, the other deals with the understanding of the essence of human human interactions. Existing approaches, based on formal logic and artificial neural networks, allow for modeling only the first type of common sense. To model the second type, it is vital to understand the motives and rules of human behavior. This model is based on real life heuristics, i.e., the rules of thumb, developed through knowledge and experience of different generations. Such knowledge base allows for development of an expert system with inference and explanatory mechanisms (commonsense reasoning algorithms and personal models). Algorithms provide tools for a situation analysis, while personal models make it possible to identify personality traits. The system so designed should perform the function of amplified intelligence for interactions, including human machine.


Conversational Browsing. How can we better understand the mechanisms behind multi turn information seeking dialogues? How can we use these insights to design a dialogue system that does not require explicit query formulation upfront as in question answering? To answer these questions, we collected observations of human participants performing a similar task to obtain inspiration for the system design. Then, we studied the structure of conversations that occurred in these settings and used the resulting insights to develop a grounded theory, design and evaluate a first system prototype. Evaluation results show that our approach is effective and can complement query based information retrieval approaches. We contribute new insights about information seeking behavior by analyzing and providing automated support for a type of information seeking strategy that is effective when the clarity of the information need and familiarity with the collection content are low.


Study of the usability of LinkedIn a social media platform meant to connect employers and employees. Social network platforms have increased and become very popular in the last decade they allow people to create an online account to then interact with others creating a complicated net of connections. LinkedIn is one of the most used social media platform, created and used for professional purposes. Here, indeed, the user can either apply for job positions or join professional communities to deepen his own knowledge and expertise and be always up to date in the interested field. The primary objectives of this paper are assessing LinkedIn's usability, by using both user and expert evaluation and giving recommendations for the developer to improve this social network. This has been achieved through different steps initially, feedbacks have been collected, via questionnaire, from direct users. Later, the usability issues, which have been underlined by users in the questionnaire, have been explored, by simulating user's problem solving process, through Walkthrough. Finally, the overall usability of LinkedIn application has been measured by using SUS (System Usability Scale).


Do recommender systems function in the health domain a system review. Recommender systems have fulfilled an important role in everyday life. Recommendations such as news by Google, videos by Netflix, goods by e commerce providers, etc. have heavily changed everyones lifestyle. Health domains contain similar decision making problems such as what to eat, how to exercise, and what is the proper medicine for a patient. Recently, studies focused on recommender systems to solve health problems have attracted attention. In this paper, we review aspects of health recommender systems including interests, methods, evaluation, future challenges and trend issues. We find that 1) health recommender systems have their own health concern limitations that cause them to focus on less risky recommendations such as diet recommendation 2) traditional recommender methods such as content based and collaborative filtering methods can hardly handle health constraints, but knowledge based methods function more than ever 3) evaluating a health recommendation is more complicated than evaluating a commercial one because multiple dimensions in addition to accuracy should be considered. Recommender systems can function well in the health domain after the solution of several key problems. Our work is a systematic review of health recommender system studies, we show current conditions and future directions. It is believed that this review will help domain researchers and promote health recommender systems to the next step.


Isogeometric continuity constraints for multi patch shells governed by fourth order deformation and phase field models. This work presents numerical techniques to enforce continuity constraints on multi patch surfaces for three distinct problem classes. The first involves structural analysis of thin shells that are described by general Kirchhoff Love kinematics. Their governing equation is a vector valued, fourth order, nonlinear, partial differential equation (PDE) that requires at least C 1 continuity within a displacement based finite element formulation. The second class are surface phase separations modeled by a phase field. Their governing equation is the Cahn Hilliard equation a scalar, fourth order, nonlinear PDE that can be coupled to the thin shell PDE. The third class are brittle fracture processes modeled by a phase field approach. In this work, these are described by a scalar, fourth order, nonlinear PDE that is similar to the Cahn Hilliard equation and is also coupled to the thin shell PDE. Using a direct finite element discretization, the two phase field equations also require at least a C 1 continuous formulation. Isogeometric surface discretizations often composed of multiple patches thus require constraints that enforce the C 1 continuity of displacement and phase field. For this, two numerical strategies are presented For this, two numerical strategies are presented A Lagrange multiplier formulation and a penalty method. The curvilinear shell model including the geometrical constraints is taken from Duong et al. (2017) and it is extended to model the coupled phase field problems on thin shells of Zimmermann et al. (2019) and Paul et al. (2020) on multi patches. Their accuracy and convergence are illustrated by several numerical examples considering deforming shells, phase separations on evolving surfaces, and dynamic brittle fracture of thin shells.


A note on the largest sum free sets of integers. Given A a set of N positive integers, an old question in additive combinatorics asks that whether A contains a sum free subset of size at least N 3 omega(N) for some increasing unbounded function omega . The question is generally attacked in the literature by considering another conjecture, which asserts that as N to infty , max x in mathbb R mathbb Z sum n in A ( bf 1 (1 3,2 3) 1 3)(nx) to infty . This conjecture, if true, would also imply that a similar phenomenon occurs for (2k,4k) sum free sets for every k geq1 . In this note, we prove the latter result directly. The new ingredient of our proof is a structural analysis on the host set A , which might be of independent interest.


Spontaneous wave formation in stochastic self driven particle systems. Waves and oscillations are commonly observed in the dynamics of self driven agents such as pedestrians or vehicles. Interestingly, many factors may perturb the stability of space homogeneous streaming, leading to the spontaneous formation of collective oscillations of the agents related to stop and go waves, jamiton, or phantom jam in the literature. In this article, we demonstrate that even a minimal additive stochastic noise in stable first order dynamics can initiate stop and go phenomena. The noise is not a classic white one, but a colored noise described by a Gaussian Ornstein Uhlenbeck process. It turns out that the joint dynamics of particles and noises forms again a (Gaussian) Ornstein Uhlenbeck process whose characteristics can be explicitly expressed in terms of parameters of the model. We analyze its stability and characterize the presence of waves through oscillation patterns in the correlation and autocorrelation of the distance spacing between the particles. We determine exact solutions for the correlation functions for the finite system with periodic boundaries and in the continuum limit when the system size is infinite. Finally, we compare experimental trajectories of single file pedestrian motions to simulation results.


Topological pressure of free semigroup actions for non compact sets and Bowen's equation, II. Inspired to the work of Ma and Wu cite Ma and Climenhaga cite Climenhaga , we introduce the new nation of topological pressure of a semigroup of maps by using the Carath ' e odory Pesin structure (C P structure) with respect to arbitrary subset in this paper. Moreover, by Bowen's equation, we characterize the Hausdorff dimension of an arbitrary subset, where the points of the subset have the positive lower Lyapunov exponents and satisfy a so called tempered contraction condition.


Detecting Hate Speech in Multi modal Memes. In the past few years, there has been a surge of interest in multi modal problems, from image captioning to visual question answering and beyond. In this paper, we focus on hate speech detection in multi modal memes wherein memes pose an interesting multi modal fusion problem. We aim to solve the Facebook Meme Challenge cite kiela2020hateful which aims to solve a binary classification problem of predicting whether a meme is hateful or not. A crucial characteristic of the challenge is that it includes "benign confounders" to counter the possibility of models exploiting unimodal priors. The challenge states that the state of the art models perform poorly compared to humans. During the analysis of the dataset, we realized that majority of the data points which are originally hateful are turned into benign just be describing the image of the meme. Also, majority of the multi modal baselines give more preference to the hate speech (language modality). To tackle these problems, we explore the visual modality using object detection and image captioning models to fetch the "actual caption" and then combine it with the multi modal representation to perform binary classification. This approach tackles the benign text confounders present in the dataset to improve the performance. Another approach we experiment with is to improve the prediction with sentiment analysis. Instead of only using multi modal representations obtained from pre trained neural networks, we also include the unimodal sentiment to enrich the features. We perform a detailed analysis of the above two approaches, providing compelling reasons in favor of the methodologies used.


Two Dimensions for Organizing Immersive Analytics Toward a Taxonomy for Facet and Position. As immersive analytics continues to grow as a discipline, so too should its underlying methodological support. Taxonomies play an important role for information visualization and human computer interaction. They provide an organization of the techniques used in a particular domain that better enable researchers to describe their work, discover existing methods, and identify gaps in the literature. Existing taxonomies in related fields do not capture or describe the unique paradigms employed in immersive analytics. We conceptualize a taxonomy that organizes immersive analytics according to two dimensions spatial and visual presentation. Each intersection of this taxonomy represents a unique design paradigm which, when thoroughly explored, can aid in the design and research of new immersive analytic applications.


Probing Biomedical Embeddings from Language Models. Contextualized word embeddings derived from pre trained language models (LMs) show significant improvements on downstream NLP tasks. Pre training on domain specific corpora, such as biomedical articles, further improves their performance. In this paper, we conduct probing experiments to determine what additional information is carried intrinsically by the in domain trained contextualized embeddings. For this we use the pre trained LMs as fixed feature extractors and restrict the downstream task models to not have additional sequence modeling layers. We compare BERT, ELMo, BioBERT and BioELMo, a biomedical version of ELMo trained on 10M PubMed abstracts. Surprisingly, while fine tuned BioBERT is better than BioELMo in biomedical NER and NLI tasks, as a fixed feature extractor BioELMo outperforms BioBERT in our probing tasks. We use visualization and nearest neighbor analysis to show that better encoding of entity type and relational information leads to this superiority.


Circular holographic ionization phase meter. We propose an attosecond XUV pump IR probe photoionization protocol that employs pairs of counter rotating consecutive harmonics and angularly resolved photoelectron detection, thereby providing direct measurement of ionization phases. The present method, which we call circular holographic ionization phase meter (CHIP), gives also access to the phase of photoemission amplitudes of even parity continuum states from a single time delay measurement, since the relative phase of one and two photon ionization pathways is imprinted in the photoemission anisotropy. The method is illustrated with emph ab initio simulations of photoionization via autoionizing resonances in helium. The rapid phase excursion in the transition amplitude to both the dipole allowed (2s2p) 1 P rm o and the dipole forbidden (2p 2) 1 D rm e states are faithfully reproduced.


On the Pricing of Currency Options under Variance Gamma Process. The pricing of currency options is largely dependent on the dynamic relationship between a pair of currencies. Typically, the pricing of options with payoffs dependent on multi assets becomes tricky for reasons such as the non Gaussian distribution of financial variable and non linear macroeconomic relations between these markets. We study the options based on the currency pair US dollar and Indian rupee (USD INR) and test several pricing formulas to evaluate the performance under different volatility regimes. We show the performance of the variance gamma and the symmetric variance gamma models during different volatility periods as well as for different moneyness, in comparison to the modified Black Scholes model. In all cases, variance gamma model outperforms Black Scholes. This can be attributed to the control of kurtosis and skewness of the distribution that is possible using the variance gamma model. Our findings support the superiority of variance gamma process of currency option pricing in better risk management strategies.


High performance superconducting nanowire single photon detectors operating at temperature from 4 to 7 K. We experimentally investigate the performance of NbTiN superconducting nanowire single photon detectors above the base temperature of a conventional Gifford McMahon cryocooler (2.5 K). By tailoring design and thickness (8 13 nm) of the detectors, high performance, high operating temperature, single photon detection from the visible to telecom wavelengths are demonstrated. At 4.3 K, a detection efficiency of 82 at 785 nm wavelength and a timing jitter of 30 pm 0.3 ps are achieved. In addition, for 1550 nm and similar operating temperature we measured a detection efficiency as high as 64 . Finally, we show that at temperatures up to 7 K, unity internal efficiency is maintained for the visible spectrum. Our work is particularly important to allow for the large scale implementation of superconducting single photon detectors in combination with heat sources such as free space optical windows, cryogenic electronics, microwave sources and active optical components for complex quantum optical experiments and bio imaging.


Phenomenological Mesoscopic Models for Seizure Activity. In this chapter we review phenomenological models of seizure like activity. We discuss dynamical mechanisms for seizure onset and offset, preictal spikes, spike and wave complexes and status epilepticus, highlighting the role played by the bifurcation structure of the model, the presence of noise and the emergence of multiple interacting time scales. These models can be used to build large scale patient specific brain network models serving as in silico platforms to test clinical hypothesis and perform virtual surgeries. They suggest innovative treatment strategies, such as minimally invasive ablations or stimulations that fully exploit the network and dynamical properties of the system, or even modulation of variables and parameters to force the system in safer regions of the bifurcation diagram. We discuss insights from phenomenological models that can help to foster our understanding of the mechanisms underlying epileptic seizures.


Beyond Statistical Relations Integrating Knowledge Relations into Style Correlations for Multi Label Music Style Classification. Automatically labeling multiple styles for every song is a comprehensive application in all kinds of music websites. Recently, some researches explore review driven multi label music style classification and exploit style correlations for this task. However, their methods focus on mining the statistical relations between different music styles and only consider shallow style relations. Moreover, these statistical relations suffer from the underfitting problem because some music styles have little training data. To tackle these problems, we propose a novel knowledge relations integrated framework (KRF) to capture the complete style correlations, which jointly exploits the inherent relations between music styles according to external knowledge and their statistical relations. Based on the two types of relations, we use a graph convolutional network to learn the deep correlations between styles automatically. Experimental results show that our framework significantly outperforms state of the art methods. Further studies demonstrate that our framework can effectively alleviate the underfitting problem and learn meaningful style correlations. The source code can be available at https github.com Makwen1995 MusicGenre.


Vizing Goldberg type bounds for the equitable chromatic number of block graphs. An equitable coloring of a graph G is a proper vertex coloring of G such that the sizes of any two color classes differ by at most one. In the paper, we pose a conjecture that offers a gap one bound for the smallest number of colors needed to equitably color every block graph. In other words, the difference between the upper and the lower bounds of our conjecture is at most one. Thus, in some sense, the situation is similar to that of chromatic index, where we have the classical theorem of Vizing and the Goldberg conjecture for multigraphs. The results obtained in the paper support our conjecture. More precisely, we verify it in the class of well covered block graphs, which are block graphs in which each vertex belongs to a maximum independent set. We also show that the conjecture is true for block graphs, which contain a vertex that does not lie in an independent set of size larger than two. Finally, we verify the conjecture for some symmetric like block graphs. In order to derive our results we obtain structural characterizations of block graphs from these classes.


Exceptional scatteredness in prime degree. Let q be an odd prime power and n be a positive integer. Let ell in mathbb F q n x be a q linearised t scattered polynomial of linearized degree r . Let d max t,r be an odd prime number. In this paper we show that under these assumptions it follows that ell x . Our technique involves a Galois theoretical characterization of t scattered polynomials combined with the classification of transitive subgroups of the general linear group over the finite field mathbb F q .


The Effect of Singularization on the Euler Characteristic. In this work, singular surfaces are obtained from smooth orientable closed surfaces by applying three basic simple loop operations, collapsing operation, zipping operation and double loop identification, each of which produces different singular surfaces. A formula that provides the Euler characteristic of the singularized surface is proved. Also, we introduce a new definition of genus for singularized surfaces which generalizes the classical definition of genus in the smooth case. A theorem relating the Euler characteristic to the genus of the singularized surface is proved.


Fredholm conditions and index for restrictions of invariant pseudodifferential operators to isotypical components. Let Gamma be a compact group acting on a smooth, compact manifold M , let P in psi m(M E 0, E 1) be a Gamma invariant, classical pseudodifferential operator acting between sections of two equivariant vector bundles E i to M , i 0,1 , and let alpha be an irreducible representation of the group Gamma . Then P induces a map pi alpha(P) H s(M E 0) alpha to H s m (M E 1) alpha between the alpha isotypical components of the corresponding Sobolev spaces of sections. When Gamma is finite, we explicitly characterize the operators P for which the map pi alpha(P) is Fredholm in terms of the principal symbol of P and the action of Gamma on the vector bundles E i . When Gamma 1 , that is, when there is no group, our result extends the classical characterization of Fredholm (pseudo)differential operators on compact manifolds. The proof is based on a careful study of the symbol C algebra and of the topology of its primitive ideal spectrum. We also obtain several results on the structure of the norm closure of the algebra of invariant pseudodifferential operators and their relation to induced representations. Whenever our results also hold for non discrete groups, we prove them in this greater generality. As an illustration of the generality of our results, we provide some applications to Hodge theory and to index theory of singular quotient spaces.


On the smallest trees with the same restricted U polynomial and the rooted U polynomial. In this article, we construct explicit examples of pairs of non isomorphic trees with the same restricted U polynomial for every k by this we mean that the polynomials agree on terms with degree at most k 1 . The main tool for this construction is a generalization of the U polynomial to rooted graphs, which we introduce and study in this article. Most notably we show that rooted trees can be reconstructed from its rooted U polynomial.


On maximal green sequences in abelian length categories. In this article, we study the relationship among maximal green sequences, complete forward hom orthogonal sequences and stability functions in abelian length categories. Mainly, we firstly give a one to one correspondence between maximal green sequences and complete forward hom orthogonal sequences via mutual constructions, and then prove that a maximal green sequence can be induced by a central charge if and only if it satisfies crossing inequalities. As applications, we show that crossing inequalities can be computed by c vectors for finite dimensional algebras finally, we give the Rotation Lemma for finite dimensional Jacobian algebras.


Improving accuracy in the Leray model for incompressible non isothermal flows via adaptive deconvolution based nonlinear filtering. This paper considers a Leray regularization model of incompressible, non isothermal fluid flows which uses nonlinear filtering based on indicator functions, and introduces an efficient numerical method for solving it. The proposed method uses a multi step, second order temporal discretization with a finite element (FE) spatial discretization in such a way that the resulting algorithm is linear at each time level, and decouples the evolution equations from the velocity filter step. Since the indicator function chosen in this model is mathematically based on approximation theory, the proposed numerical algorithm can be analyzed robustly, i.e the stability and convergence of the method is provable. A series of numerical tests are carried out to verify the theoretical convergence rates, and to compare the algorithm with direct numerical simulation and the usual Leray alpha model of the flow problem.


A polynomial time approximation schema for maximum k vertex cover in bipartite graphs. The paper presents a polynomial time approximation schema for the edge weighted version of maximum k vertex cover problem in bipartite graphs.


Outage Analysis in SWIPT Enabled Cooperative AF DF Relay Assisted Two Way Spectrum Sharing Communication. This paper reports relative performance of decode and forward (DF) and amplify and forward (AF) relaying in a multi antenna cooperative cognitive radio network (CCRN) that supports device to device (D2D) communications using spectrum sharing technique in cellular network. In this work, cellular system is considered as primary and internet of things devices (IoDs), engaged in D2D communications, are considered to be secondary system. The devices access the licensed spectrum by means of the cooperation in two way primary communications. Furthermore, IoDs are energized by harvesting the energy from radio frequency (RF) signals, using simultaneous wireless information and power transfer (SWIPT) protocol. Closed form expressions of outage probability for both cellular and D2D communications are derived and the impact of various design parameters for both AF and DF relaying techniques are studied. Based on the simulation results, it is found that the proposed spectrum sharing protocol, for both DF relaying and AF relaying schemes, outperform another similar network architecture in terms of spectrum efficiency. It is also observed that the performance of the proposed system using DF relaying is better than AF relaying scheme in terms of energy efficiency at same transmit power.


Temporal Reasoning on Implicit Events from Distant Supervision. We propose TRACIE, a novel temporal reasoning dataset that evaluates the degree to which systems understand implicit events events that are not mentioned explicitly in natural language text but can be inferred from it. This introduces a new challenge in temporal reasoning research, where prior work has focused on explicitly mentioned events. Human readers can infer implicit events via commonsense reasoning, resulting in a more comprehensive understanding of the situation and, consequently, better reasoning about time. We find, however, that state of the art models struggle when predicting temporal relationships between implicit and explicit events. To address this, we propose a neuro symbolic temporal reasoning model, SYMTIME, which exploits distant supervision signals from large scale text and uses temporal rules to combine start times and durations to infer end times. SYMTIME outperforms strong baseline systems on TRACIE by 5 , and by 11 in a zero prior knowledge training setting. Our approach also generalizes to other temporal reasoning tasks, as evidenced by a gain of 1 9 on MATRES, an explicit event benchmark.


LiteX an open source SoC builder and library based on Migen Python DSL. LiteX is a GitHub hosted SoC builder IP library and utilities that can be used to create SoCs and full FPGA designs. Besides being open source and BSD licensed, its originality lies in the fact that its IP components are entirely described using Migen Python internal DSL, which simplifies its design in depth. LiteX already supports various softcores CPUs and essential peripherals, with no dependencies on proprietary IP blocks or generators. This paper provides an overview of LiteX two real SoC designs on FPGA are presented. They both leverage the LiteX approach in terms of design entry, libraries and integration capabilities. The first one is based on RISC V core, while the second is based on a LM32 core. In the second use case, we further demonstrate the use of a fully open source toolchain coupled with LiteX.


An O(log log m) Prophet Inequality for Subadditive Combinatorial Auctions. Prophet inequalities compare the expected performance of an online algorithm for a stochastic optimization problem to the expected optimal solution in hindsight. They are a major alternative to classic worst case competitive analysis, of particular importance in the design and analysis of simple (posted price) incentive compatible mechanisms with provable approximation guarantees. A central open problem in this area concerns subadditive combinatorial auctions. Here n agents with subadditive valuation functions compete for the assignment of m items. The goal is to find an allocation of the items that maximizes the total value of the assignment. The question is whether there exists a prophet inequality for this problem that significantly beats the best known approximation factor of O( log m) . We make major progress on this question by providing an O( log log m) prophet inequality. Our proof goes through a novel primal dual approach. It is also constructive, resulting in an online policy that takes the form of static and anonymous item prices that can be computed in polynomial time given appropriate query access to the valuations. As an application of our approach, we construct a simple and incentive compatible mechanism based on posted prices that achieves an O( log log m) approximation to the optimal revenue for subadditive valuations under an item independence assumption.


Rapid Light Field Depth Estimation with Semi Global Matching. Running time of the light field depth estimation algorithms is typically high. This assessment is based on the computational complexity of existing methods and the large amounts of data involved. The aim of our work is to develop a simple and fast algorithm for accurate depth computation. In this context, we propose an approach, which involves Semi Global Matching for the processing of light field images. It forms on comparison of pixels' correspondences with different metrics in the substantially bounded light field space. We show that our method is suitable for the fast production of a proper result in a variety of light field configurations


iCapsNets Towards Interpretable Capsule Networks for Text Classification. Many text classification applications require models with satisfying performance as well as good interpretability. Traditional machine learning methods are easy to interpret but have low accuracies. The development of deep learning models boosts the performance significantly. However, deep learning models are typically hard to interpret. In this work, we propose interpretable capsule networks (iCapsNets) to bridge this gap. iCapsNets use capsules to model semantic meanings and explore novel methods to increase interpretability. The design of iCapsNets is consistent with human intuition and enables it to produce human understandable interpretation results. Notably, iCapsNets can be interpreted both locally and globally. In terms of local interpretability, iCapsNets offer a simple yet effective method to explain the predictions for each data sample. On the other hand, iCapsNets explore a novel way to explain the model's general behavior, achieving global interpretability. Experimental studies show that our iCapsNets yield meaningful local and global interpretation results, without suffering from significant performance loss compared to non interpretable methods.


Anonymous Collocation Discovery Harnessing Privacy to Tame the Coronavirus. Successful containment of the Coronavirus pandemic rests on the ability to quickly and reliably identify those who have been in close proximity to a contagious individual. Existing tools for doing so rely on the collection of exact location information of individuals over lengthy time periods, and combining this information with other personal information. This unprecedented encroachment on individual privacy at national scales has created an outcry and risks rejection of these tools. We propose an alternative an extremely simple scheme for providing fine grained and timely alerts to users who have been in the close vicinity of an infected individual. Crucially, this is done while preserving the anonymity of all individuals, and without collecting or storing any personal information or location history. Our approach is based on using short range communication mechanisms, like Bluetooth, that are available in all modern cell phones. It can be deployed with very little infrastructure, and incurs a relatively low false positive rate compared to other collocation methods. We also describe a number of extensions and tradeoffs. We believe that the privacy guarantees provided by the scheme will encourage quick and broad voluntary adoption. When combined with sufficient testing capacity and existing best practices from healthcare professionals, we hope that this may significantly reduce the infection rate.


Counterexamples to Siegel's Conjecture. We prove that the intersection of a Hirsch polytope and a cube may be a non Hirsch polytope.


Dilogarithm identities after Bridgeman. Following Bridgeman, we demonstrate several families of infinite dilogarithm identities associated with Fibonacci numbers, Lucas numbers, convergents of continued fractions of even periods, and terms arising from various recurrence relations.


Metamath Zero The Cartesian Theorem Prover. As the usage of theorem prover technology expands, so too does the reliance on correctness of the tools. Metamath Zero is a verification system that aims for simplicity of logic and implementation, without compromising on efficiency of verification. It is formally specified in its own language, and supports a number of translations to and from other proof languages. This paper describes the abstract logic of Metamath Zero, essentially a multi sorted first order logic, as well as the binary proof format and the way in which it can ensure essentially linear time verification while still being concise and efficient at scale. Metamath Zero currently holds the record for fastest verification of the mathtt set .mm Metamath library of proofs in ZFC (including 71 of Wiedijk's 100 formalization targets), at less than 200 ms. Ultimately, we intend to use it to verify the correctness of the implementation of the verifier down to binary executable, so it can be used as a root of trust for more complex proof systems.


Pattern Avoidance Over a Hypergraph. We consider the problem of bounding the number of permutations sigma in S n that avoid a fixed permutation pi in S k in specific indices given by a k uniform hypergraph Lambda . We obtain relatively sharp bounds in the case where Lambda is a random hypergraph, and find bounds in the case where Lambda contains many large cliques. Along the way, we prove a supersaturation version of F "uredi Hajnal, which may be of independent interest.


1D and 2D Flow Routing on a Terrain. An important problem in terrain analysis is modeling how water flows across a terrain creating floods by forming channels and filling depressions. In this paper we study a number of emph flow query related problems Given a terrain Sigma , represented as a triangulated xy monotone surface with n vertices, a rain distribution R which may vary over time, determine how much water is flowing over a given edge as a function of time. We develop internal memory as well as I O efficient algorithms for flow queries. This paper contains four main results (i) We present an internal memory algorithm that preprocesses Sigma into a linear size data structure that for a (possibly time varying) rain distribution R can return the flow rate functions of all edges of Sigma in O( rho k phi log n) time, where rho is the number of sinks in Sigma , k is the number of times the rain distribution changes, and phi is the total complexity of the flow rate functions that have non zero values (ii) We also present an I O efficient algorithm for preprocessing Sigma into a linear size data structure so that for a rain distribution R , it can compute the flow rate function of all edges using O( text Sort ( phi )) I Os and O( phi log phi ) internal computation time. (iii) Sigma can be preprocessed into a linear size data structure so that for a given rain distribution R , the flow rate function of an edge (q,r) in Sigma under the single flow direction (SFD) model can be computed more efficiently. (iv) We present an algorithm for computing the two dimensional channel along which water flows using Manning's equation a widely used empirical equation that relates the flow rate of water in an open channel to the geometry of the channel along with the height of water in the channel.


Hankel Bilinear forms on generalized Fock Sobolev spaces on mathbb C n . We characterize the boundedness of Hankel bilinear forms on a product of generalized Fock Sobolev spaces on mathbb C n with respect to the weight (1 z ) rho e frac alpha 2 z 2 ell , for ell ge 1 , alpha 0 and rho in mathbb R . We obtain a weak decomposition of the Bergman kernel with estimates and a Littlewood Paley formula, which are key ingredients in the proof of our main results. As an application, we characterize the boundedness, compactness and the membership in the Schatten class of small Hankel operators on these spaces.


Equilibrium for multiphase solids with Eulerian interfaces. We describe a general phase field model for hyperelastic multiphase materials. The model features an elastic energy functional that depends on the phase field variable and a surface energy term that depends in turn on the elastic deformation, as it measures interfaces in the deformed configuration. We prove the existence of energy minimizing equilibrium states and Gamma convergence of diffuse interface approximations to the sharp interface limit.


Stochastic optimization methods for the simultaneous control of parameter dependent systems. We address the application of stochastic optimization methods for the simultaneous control of parameter dependent systems. In particular, we focus on the classical Stochastic Gradient Descent (SGD) approach of Robbins and Monro, and on the recently developed Continuous Stochastic Gradient (CSG) algorithm. We consider the problem of computing simultaneous controls through the minimization of a cost functional defined as the superposition of individual costs for each realization of the system. We compare the performances of these stochastic approaches, in terms of their computational complexity, with those of the more classical Gradient Descent (GD) and Conjugate Gradient (CG) algorithms, and we discuss the advantages and disadvantages of each methodology. In agreement with well established results in the machine learning context, we show how the SGD and CSG algorithms can significantly reduce the computational burden when treating control problems depending on a large amount of parameters. This is corroborated by numerical experiments.


General Optimal Stopping with Linear Costs. This article treats both discrete time and continuous time stopping problems for general Markov processes on the real line with general linear costs. Using an auxiliary function of maximum representation type, conditions are given to guarantee the optimal stopping time to be of threshold type. The optimal threshold is then characterized as the root of that function. For random walks our results condense in the fact that all combinations of concave increasing pay off functions and convex cost functions lead to a one sided solution. For L 'evy processes an explicit way to obtain the auxiliary function and the threshold is given by use of the ladder height processes. Lastly, the connection from discrete and continuous problem and possible approximation of the latter one via the former one is discussed.


Whither Semantics?. We discuss how mathematical semantics has evolved, and suggest some new directions for future work. As an example, we discuss some recent work on encapsulating model comparison games as comonads, in the context of finite model theory.


New Failure Rate Model for Iterative Software Development Life Cycle Process. Software reliability models are one of the most generally used mathematical tool for estimation of reliability, failure rate and number of remaining faults in the software. Existing software reliability models are designed to follow waterfall software development life cycle process. These existing models do not take advantage of iterative software development process. In this paper, a new failure rate model centered on iterative software development life cycle process has been developed. It aims to integrate a new modulation factor for incorporating varying needs in each phase of iterative software development process. It comprises imperfect debugging with the possibility of fault introduction and removal of multiple faults in an interval as iterative development of the software proceeds. The proposed model has been validated on twelve iterations of Eclipse software failure dataset and nine iterations of Java Development toolkit (JDT) software failure dataset. Parameter estimation for the proposed model has been done by hybrid Particle Swarm Optimization and Gravitational Search Algorithm. Experimental results in terms of goodness of fit shows that proposed model has outperformed Jelinski Moranda, Shick Wolverton, Goel Okummotto Imperfect debugging, GS Mahapatra, Modified Shick Wolverton in 83.33 of iterations for eclipse dataset and 77.77 of iterations for JDT dataset.


Label guided Learning for Text Classification. Text classification is one of the most important and fundamental tasks in natural language processing. Performance of this task mainly dependents on text representation learning. Currently, most existing learning frameworks mainly focus on encoding local contextual information between words. These methods always neglect to exploit global clues, such as label information, for encoding text information. In this study, we propose a label guided learning framework LguidedLearn for text representation and classification. Our method is novel but simple that we only insert a label guided encoding layer into the commonly used text representation learning schemas. That label guided layer performs label based attentive encoding to map the universal text embedding (encoded by a contextual information learner) into different label spaces, resulting in label wise embeddings. In our proposed framework, the label guided layer can be easily and directly applied with a contextual encoding method to perform jointly learning. Text information is encoded based on both the local contextual information and the global label clues. Therefore, the obtained text embeddings are more robust and discriminative for text classification. Extensive experiments are conducted on benchmark datasets to illustrate the effectiveness of our proposed method.


Monocular 3D Object Detection with Sequential Feature Association and Depth Hint Augmentation. Monocular 3D object detection, with the aim of predicting the geometric properties of on road objects, is a promising research topic for the intelligent perception systems of autonomous driving. Most state of the art methods follow a keypoint based paradigm, where the keypoints of objects are predicted and employed as the basis for regressing the other geometric properties. In this work, a unified network named as FADNet is presented to address the task of monocular 3D object detection. In contrast to previous keypoint based methods, we propose to divide the output modalities into different groups according to the estimation difficulty of object properties. Different groups are treated differently and sequentially associated by a convolutional Gated Recurrent Unit. Another contribution of this work is the strategy of depth hint augmentation. To provide characterized depth patterns as hints for depth estimation, a dedicated depth hint module is designed to generate row wise features named as depth hints, which are explicitly supervised in a bin wise manner. The contributions of this work are validated by conducting experiments and ablation study on the KITTI benchmark. Without utilizing depth priors, post optimization, or other refinement modules, our network performs competitively against state of the art methods while maintaining a decent running speed.


Token Curated Registry with Citation Graph. In this study, we aim to incorporate the expertise of anonymous curators into a token curated registry (TCR), a decentralized recommender system for collecting a list of high quality content. This registry is important, because previous studies on TCRs have not specifically focused on technical content, such as academic papers and patents, whose effective curation requires expertise in relevant fields. To measure expertise, curation in our model focuses on both the content and its citation relationships, for which curator assignment uses the Personalized PageRank (PPR) algorithm while reward computation uses a multi task peer prediction mechanism. Our proposed CitedTCR bridges the literature on network based and token based recommender systems and contributes to the autonomous development of an evolving citation graph for high quality content. Moreover, we experimentally confirm the incentive for registration and curation in CitedTCR using the simplification of a one to one correspondence between users and content (nodes).


Neural Multi Task Learning for Teacher Question Detection in Online Classrooms. Asking questions is one of the most crucial pedagogical techniques used by teachers in class. It not only offers open ended discussions between teachers and students to exchange ideas but also provokes deeper student thought and critical analysis. Providing teachers with such pedagogical feedback will remarkably help teachers improve their overall teaching quality over time in classrooms. Therefore, in this work, we build an end to end neural framework that automatically detects questions from teachers' audio recordings. Compared with traditional methods, our approach not only avoids cumbersome feature engineering, but also adapts to the task of multi class question detection in real education scenarios. By incorporating multi task learning techniques, we are able to strengthen the understanding of semantic relations among different types of questions. We conducted extensive experiments on the question detection tasks in a real world online classroom dataset and the results demonstrate the superiority of our model in terms of various evaluation metrics.


Overpartitions and Bressoud's conjecture, II. The main objective of this paper is to prove Bressoud's conjecture for j 0 . The case for j 1 has been recently proved by Kim. We first obtain an overpartition analogue of Bressoud's conjecture for j 1 by using a bijective method. We then show that Bressoud's conjecture for j 0 can be derived from the overpartition analogue of Bressoud's conjecture for j 1 with the aid of the relation between the partition function B 0 in Bressoud's conjecture and the partition function bar B 1 established in our previous paper.


SoccerNet v2 A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videos. Understanding broadcast videos is a challenging task in computer vision, as it requires generic reasoning capabilities to appreciate the content offered by the video editing. In this work, we propose SoccerNet v2, a novel large scale corpus of manual annotations for the SoccerNet video dataset, along with open challenges to encourage more research in soccer understanding and broadcast production. Specifically, we release around 300k annotations within SoccerNet's 500 untrimmed broadcast soccer videos. We extend current tasks in the realm of soccer to include action spotting, camera shot segmentation with boundary detection, and we define a novel replay grounding task. For each task, we provide and discuss benchmark results, reproducible with our open source adapted implementations of the most relevant works in the field. SoccerNet v2 is presented to the broader research community to help push computer vision closer to automatic solutions for more general video understanding and production purposes.


Bayesian dynamical estimation of the parameters of an SE(A)IR COVID 19 spread model. In this article, we consider a dynamic epidemiology model for the spread of the COVID 19 infection. Starting from the classical SEIR model, the model is modified so as to better describe characteristic features of the underlying pathogen and its infectious modes. In line with the large number of secondary infections not related to contact with documented infectious individuals, the model includes a cohort of asymptomatic or oligosymptomatic infectious individuals, not accounted for in the data of new daily counts of infections. A Bayesian particle filtering algorithm is used to update dynamically the relevant cohort and simultaneously estimate the transmission rate as the new data on the number of new infections and disease related death become available. The underlying assumption of the model is that the infectivity rate is dynamically changing during the epidemics, either because of a mutation of the pathogen or in response to mitigation and containment measures. The sequential Bayesian framework naturally provides a quantification of the uncertainty in the estimate of the model parameters, including the reproduction number, and of the size of the different cohorts. Moreover, we introduce a dimensionless quantity, which is the equilibrium ratio between asymptomatic and symptomatic cohort sizes, and propose a simple formula to estimate the quantity. This ratio leads naturally to another dimensionless quantity that plays the role of the basic reproduction number R 0 of the model. When we apply the model and particle filter algorithm to COVID 19 infection data from several counties in Northeastern Ohio and Southeastern Michigan we found the proposed reproduction number R 0 to have a consistent dynamic behavior within both states, thus proving to be a reliable summary of the success of the mitigation measures.


Energy transfer in turbulent channel flows and implications for resolvent modelling. We analyse the inter scale transfer of energy for two types of plane Poiseuille flow the P4U exact coherent state of Park and Graham (2015) and turbulent flow in a minimal channel. For both flows, the dominant energy producing modes are streamwise constant streaks with a spanwise spacing of approximately 100 wall units. Since the viscous dissipation for these scales is not sufficient to balance production, the nonlinear terms redistribute the excess energy to other scales. Spanwise constant scales (that is, Tollmien Schlichting like modes with zero spanwise wavenumber), in particular, account for a significant amount of net energy gain from the nonlinear terms. We compare the energy balance to predictions from resolvent analysis and we show that it does not model energy transfer well. Nevertheless, we find that the energy transferred from the streamwise constant streaks can be predicted reasonably well by a Cess eddy viscosity profile. As such, eddy viscosity is an effective model for the nonlinear terms in resolvent analysis and explains good predictions for the most energetic streamwise constant streaks. It also improves resolvent modes as a basis for structures whose streamwise lengths are greater than their spanwise widths by counteracting non normality of the resolvent operator. Eddy viscosity does not respect the conservative nature of the nonlinear energy transfer which must sum to zero over all scales. It is less effective, consequently, for scales which receive energy from the nonlinear terms.


Concavifiability and convergence necessary and sufficient conditions for gradient descent analysis. Convergence of the gradient descent algorithm has been attracting renewed interest due to its utility in deep learning applications. Even as multiple variants of gradient descent were proposed, the assumption that the gradient of the objective is Lipschitz continuous remained an integral part of the analysis until recently. In this work, we look at convergence analysis by focusing on a property that we term as concavifiability, instead of Lipschitz continuity of gradients. We show that concavifiability is a necessary and sufficient condition to satisfy the upper quadratic approximation which is key in proving that the objective function decreases after every gradient descent update. We also show that any gradient Lipschitz function satisfies concavifiability. A constant known as the concavifier analogous to the gradient Lipschitz constant is derived which is indicative of the optimal step size. As an application, we demonstrate the utility of finding the concavifier the in convergence of gradient descent through an example inspired by neural networks. We derive bounds on the concavifier to obtain a fixed step size for a single hidden layer ReLU network.


Evaluation of a Flow Based Hypergraph Bipartitioning Algorithm. In this paper, we propose HyperFlowCutter, an algorithm for balanced hypergraph bipartitioning. It is based on minimum S T hyperedge cuts and maximum flows. It computes a sequence of bipartitions that optimize cut size and balance in the Pareto sense, being able to trade one for the other. HyperFlowCutter builds on the FlowCutter algorithm for partitioning graphs. We propose additional features, such as handling disconnected hypergraphs, novel methods for obtaining starting S,T pairs as well as an approach to refine a given partition with HyperFlowCutter. Our main contribution is ReBaHFC, a new algorithm which obtains an initial partition with the fast multilevel hypergraph partitioner PaToH and then improves it using HyperFlowCutter as a refinement algorithm. ReBaHFC is able to significantly improve the solution quality of PaToH at little additional running time. The solution quality is only marginally worse than that of the best performing hypergraph partitioners KaHyPar and hMETIS, while being one order of magnitude faster. Thus ReBaHFC offers a new time quality trade off in the current spectrum of hypergraph partitioners. For the special case of perfectly balanced bipartitioning, only the much slower plain HyperFlowCutter yields slightly better solutions than ReBaHFC, while only PaToH is faster than ReBaHFC.


Is a Single Vector Enough? Exploring Node Polysemy for Network Embedding. Networks have been widely used as the data structure for abstracting real world systems as well as organizing the relations among entities. Network embedding models are powerful tools in mapping nodes in a network into continuous vector space representations in order to facilitate subsequent tasks such as classification and link prediction. Existing network embedding models comprehensively integrate all information of each node, such as links and attributes, towards a single embedding vector to represent the node's general role in the network. However, a real world entity could be multifaceted, where it connects to different neighborhoods due to different motives or self characteristics that are not necessarily correlated. For example, in a movie recommender system, a user may love comedies or horror movies simultaneously, but it is not likely that these two types of movies are mutually close in the embedding space, nor the user embedding vector could be sufficiently close to them at the same time. In this paper, we propose a polysemous embedding approach for modeling multiple facets of nodes, as motivated by the phenomenon of word polysemy in language modeling. Each facet of a node is mapped as an embedding vector, while we also maintain association degree between each pair of node and facet. The proposed method is adaptive to various existing embedding models, without significantly complicating the optimization process. We also discuss how to engage embedding vectors of different facets for inference tasks including classification and link prediction. Experiments on real world datasets help comprehensively evaluate the performance of the proposed method.


Momentum Exchange Current Drive by Electrostatic Waves in an Unmagnetized Collisionless Plasma. For an electrostatic wave interacting with a single species in a collisionless plasma, momentum conservation implies current conservation. However, when multiple species interact with the wave, they can exchange momentum, leading to current drive. A simple, general formula for this driven current is derived. As examples, we show how currents can be driven for Langmuir waves in electron positron ion plasmas, and for ion acoustic waves in electron ion plasmas.


SAIA Split Artificial Intelligence Architecture for Mobile Healthcare System. As the advancement of deep learning (DL), the Internet of Things and cloud computing techniques for biomedical and healthcare problems, mobile healthcare systems have received unprecedented attention. Since DL techniques usually require enormous amount of computation, most of them cannot be directly deployed on the resource constrained mobile and IoT devices. Hence, most of the mobile healthcare systems leverage the cloud computing infrastructure, where the data collected by the mobile and IoT devices would be transmitted to the cloud computing platforms for analysis. However, in the contested environments, relying on the cloud might not be practical at all times. For instance, the satellite communication might be denied or disrupted. We propose SAIA, a Split Artificial Intelligence Architecture for mobile healthcare systems. Unlike traditional approaches for artificial intelligence (AI) which solely exploits the computational power of the cloud server, SAIA could not only relies on the cloud computing infrastructure while the wireless communication is available, but also utilizes the lightweight AI solutions that work locally on the client side, hence, it can work even when the communication is impeded. In SAIA, we propose a meta information based decision unit, that could tune whether a sample captured by the client should be operated by the embedded AI (i.e., keeping on the client) or the networked AI (i.e., sending to the server), under different conditions. In our experimental evaluation, extensive experiments have been conducted on two popular healthcare datasets. Our results show that SAIA consistently outperforms its baselines in terms of both effectiveness and efficiency.


Learning from demonstration with model based Gaussian process. In learning from demonstrations, it is often desirable to adapt the behavior of the robot as a function of the variability retrieved from human demonstrations and the (un)certainty encoded in different parts of the task. In this paper, we propose a novel multi output Gaussian process (MOGP) based on Gaussian mixture regression (GMR). The proposed approach encapsulates the variability retrieved from the demonstrations in the covariance of the MOGP. Leveraging the generative nature of GP models, our approach can efficiently modulate trajectories towards new start , via or end points defined by the task. Our framework allows the robot to precisely track via points while being compliant in regions of high variability. We illustrate the proposed approach in simulated examples and validate it in a real robot experiment.


Graphs with large girth and free groups. We use Margulis' construction together with lattice counting arguments to build Cayley graphs on mathrm SL 2 left( mathbb F p right), p to infty which are d regular graphs with girth geq frac 2 3 frac ln left(n right) ln left(d 1 right) ln left(C right) for some absolute constant C.


Invariant subvarieties with small dynamical degree. Let f X to X be a dominant self morphism of an algebraic variety over an algebraically closed field of characteristic zero. We consider the set Sigma f infty of f periodic (irreducible closed) subvarieties of small dynamical degree, the subset S f infty of maximal elements in Sigma f infty , and the subset S f of f invariant elements in S f infty . When X is projective, we prove the finiteness of the set P f of f invariant prime divisors with small dynamical degree, and give an optimal upper bound (of cardinality) sharp P f n le d 1(f) n(1 o(1)) as n to infty , where d 1(f) is the first dynamic degree of f . When X is an algebraic group (with f being a translation of an isogeny), or a (not necessarily complete) toric variety (with f stabilizing the big torus), we give an optimal upper bound sharp S f n le d 1(f) n cdot dim(X) (1 o(1)) as n to infty , which slightly generalizes a conjecture of S. W. Zhang for polarized f .


HydraMix Net A Deep Multi task Semi supervised Learning Approach for Cell Detection and Classification. Semi supervised techniques have removed the barriers of large scale labelled set by exploiting unlabelled data to improve the performance of a model. In this paper, we propose a semi supervised deep multi task classification and localization approach HydraMix Net in the field of medical imagining where labelling is time consuming and costly. Firstly, the pseudo labels are generated using the model's prediction on the augmented set of unlabelled image with averaging. The high entropy predictions are further sharpened to reduced the entropy and are then mixed with the labelled set for training. The model is trained in multi task learning manner with noise tolerant joint loss for classification localization and achieves better performance when given limited data in contrast to a simple deep model. On DLBCL data it achieves 80 accuracy in contrast to simple CNN achieving 70 accuracy when given only 100 labelled examples.


Efficient Latent Representations using Multiple Tasks for Autonomous Driving. Driving in the dynamic, multi agent, and complex urban environment is a difficult task requiring a complex decision policy. The learning of such a policy requires a state representation that can encode the entire environment. Mid level representations that encode a vehicle's environment as images have become a popular choice, but they are quite high dimensional, which limits their use in data scarce cases such as reinforcement learning. In this article, we propose to learn a low dimensional and rich feature representation of the environment by training an encoder decoder deep neural network to predict multiple application relevant factors such as trajectories of other agents. We demonstrate that the use of the multi head encoder decoder neural network results in a more informative representation compared to a single head encoder decoder model. In particular, the proposed representation learning approach helps the policy network to learn faster, with increased performance and with less data, compared to existing approaches using a single head network.


Modeling Disease Progression in Mild Cognitive Impairment and Alzheimer's Disease with Digital Twins. Alzheimer's Disease (AD) is a neurodegenerative disease that affects subjects in a broad range of severity and is assessed in clinical trials with multiple cognitive and functional instruments. As clinical trials in AD increasingly focus on earlier stages of the disease, especially Mild Cognitive Impairment (MCI), the ability to model subject outcomes across the disease spectrum is extremely important. We use unsupervised machine learning models called Conditional Restricted Boltzmann Machines (CRBMs) to create Digital Twins of AD subjects. Digital Twins are simulated clinical records that share baseline data with actual subjects and comprehensively model their outcomes under standard of care. The CRBMs are trained on a large set of records from subjects in observational studies and the placebo arms of clinical trials across the AD spectrum. These data exhibit a challenging, but common, patchwork of measured and missing observations across subjects in the dataset, and we present a novel model architecture designed to learn effectively from it. We evaluate performance against a held out test dataset and show how Digital Twins simultaneously capture the progression of a number of key endpoints in clinical trials across a broad spectrum of disease severity, including MCI and mild to moderate AD.


Exploring Zero Shot Emergent Communication in Embodied Multi Agent Populations. Effective communication is an important skill for enabling information exchange and cooperation in multi agent settings. Indeed, emergent communication is now a vibrant field of research, with common settings involving discrete cheap talk channels. One limitation of this setting is that it does not allow for the emergent protocols to generalize beyond the training partners. Furthermore, so far emergent communication has primarily focused on the use of symbolic channels. In this work, we extend this line of work to a new modality, by studying agents that learn to communicate via actuating their joints in a 3D environment. We show that under realistic assumptions, a non uniform distribution of intents and a common knowledge energy cost, these agents can find protocols that generalize to novel partners. We also explore and analyze specific difficulties associated with finding these solutions in practice. Finally, we propose and evaluate initial training improvements to address these challenges, involving both specific training curricula and providing the latent feature that can be coordinated on during training.


HASeparator Hyperplane Assisted Softmax. Efficient feature learning with Convolutional Neural Networks (CNNs) constitutes an increasingly imperative property since several challenging tasks of computer vision tend to require cascade schemes and modalities fusion. Feature learning aims at CNN models capable of extracting embeddings, exhibiting high discrimination among the different classes, as well as intra class compactness. In this paper, a novel approach is introduced that has separator, which focuses on an effective hyperplane based segregation of the classes instead of the common class centers separation scheme. Accordingly, an innovatory separator, namely the Hyperplane Assisted Softmax separator (HASeparator), is proposed that demonstrates superior discrimination capabilities, as evaluated on popular image classification benchmarks.


Environment Probing Interaction Policies. A key challenge in reinforcement learning (RL) is environment generalization a policy trained to solve a task in one environment often fails to solve the same task in a slightly different test environment. A common approach to improve inter environment transfer is to learn policies that are invariant to the distribution of testing environments. However, we argue that instead of being invariant, the policy should identify the specific nuances of an environment and exploit them to achieve better performance. In this work, we propose the 'Environment Probing' Interaction (EPI) policy, a policy that probes a new environment to extract an implicit understanding of that environment's behavior. Once this environment specific information is obtained, it is used as an additional input to a task specific policy that can now perform environment conditioned actions to solve a task. To learn these EPI policies, we present a reward function based on transition predictability. Specifically, a higher reward is given if the trajectory generated by the EPI policy can be used to better predict transitions. We experimentally show that EPI conditioned task specific policies significantly outperform commonly used policy generalization methods on novel testing environments.


Restricted Rules of Inference and Paraconsistency. In this paper, we study two companions to a logic, viz., the left variable inclusion companion and the restricted rules companion, their nature and interrelations, especially in connection with paraconsistency. A sufficient condition for the two companions to coincide has also been proved. Two new logical systems Intuitionistic Paraconsistent Weak Kleene logic (IPWK) and Paraconsistent Pre Rough logic (PPRL) are presented here as examples of logics of left variable inclusion. IPWK is the left variable inclusion companion of Intuitionistic Propositional logic (IPC) and is also the restricted rules companion of it. PPRL, on the other hand, is the left variable inclusion companion of Pre Rough logic (PRL) but differs from the restricted rules companion of it. We have discussed algebraic semantics for these logics in terms of P l onka sums. This amounts to introducing a contaminating truth value, intended to denote a state of indeterminacy.


Asymptotic behavior of a nonautonomous evolution equation governed by a quasi nonexpansive operator. We study the asymptotic behavior of the trajectory of a nonautonomous evolution equation governed by a quasi nonexpansive operator in Hilbert spaces. We prove the weak convergence of the trajectory to a fixed point of the operator by relying on Lyapunov analysis. Under a metric subregularity condition, we further derive a flexible global exponential type rate for the distance of the trajectory to the set of fixed points. The results obtained are applied to analyze the asymptotic behavior of the trajectory of an adaptive Douglas Rachford dynamical system, which is applied for finding a zero of the sum of two operators, one of which is strongly monotone while the other one is weakly monotone.


Dynamic Compression Ratio Selection for Edge Inference Systems with Hard Deadlines. Implementing machine learning algorithms on Internet of things (IoT) devices has become essential for emerging applications, such as autonomous driving, environment monitoring. But the limitations of computation capability and energy consumption make it difficult to run complex machine learning algorithms on IoT devices, especially when latency deadline exists. One solution is to offload the computation intensive tasks to the edge server. However, the wireless uploading of the raw data is time consuming and may lead to deadline violation. To reduce the communication cost, lossy data compression can be exploited for inference tasks, but may bring more erroneous inference results. In this paper, we propose a dynamic compression ratio selection scheme for edge inference system with hard deadlines. The key idea is to balance the tradeoff between communication cost and inference accuracy. By dynamically selecting the optimal compression ratio with the remaining deadline budgets for queued tasks, more tasks can be timely completed with correct inference under limited communication resources. Furthermore, information augmentation that retransmits less compressed data of task with erroneous inference, is proposed to enhance the accuracy performance. While it is often hard to know the correctness of inference, we use uncertainty to estimate the confidence of the inference, and based on that, jointly optimize the information augmentation and compression ratio selection. Lastly, considering the wireless transmission errors, we further design a retransmission scheme to reduce performance degradation due to packet losses. Simulation results show the performance of the proposed schemes under different deadlines and task arrival rates.


Optimality conditions based on the Fr 'echet second order subdifferential. This paper focuses on second order necessary optimality conditions for constrained optimization problems on Banach spaces. For problems in the classical setting, where the objective function is C 2 smooth, we show that strengthened second order necessary optimality conditions are valid if the constraint set is generalized polyhedral convex. For problems in a new setting, where the objective function is just assumed to be C 1 smooth and the constraint set is generalized polyhedral convex, we establish sharp second order necessary optimality conditions based on the Fr 'echet second order subdifferential of the objective function and the second order tangent set to the constraint set. Three examples are given to show that the used hypotheses are essential for the new theorems. Our second order necessary optimality conditions refine and extend several existing results.


Thermal Annealing Effect on Electrical and Structural Properties of Tungsten Carbide Schottky Contacts on AlGaN GaN heterostructures. Tungsten carbide (WC) contacts have been investigated as a novel gold free Schottky metallization for AlGaN GaN heterostructures. The evolution of the electrical and structural compositional properties of the WC AlGaN contact has been monitored as a function of the annealing temperature in the range from 400 to 800 deg C. The Schottky barrier height ( Phi B) at WC AlGaN interface, extracted from the forward current voltage characteristics of the diode, decreased from 0.8 eV in the as deposited and 400 deg C annealed sample, to 0.56 eV after annealing at 800 deg C. This large reduction of Phi B was accompanied by a corresponding increase of the reverse bias leakage current. Transmission electron microscopy coupled to electron energy loss spectroscopy analyses revealed the presence of oxygen (O) uniformly distributed in the WC layer, both in the as deposited and 400 deg C annealed sample. Conversely, oxygen accumulation in a 2 3 nm thin W O C layer at the interface with AlGaN was observed after the annealing at 800 deg C, as well as the formation of W2C grains within the film (confirmed by X ray diffraction analyses). The formation of this interfacial W O C layer is plausibly the main origin of the decreased Phi B and the increased leakage current in the 800 deg C annealed Schottky diode, whereas the decreased O content inside the WC film can explain the reduced resistivity of the metal layer. The results provide an assessment of the processing conditions for the application of WC as Schottky contact for AlGaN GaN heterostructures.


A note on semitotal domination in graphs. A set S of vertices in G is a semitotal dominating set of G if it is a dominating set of G and every vertex in S is within distance 2 of another vertex of S . The emph semitotal domination number , gamma t2 (G) , is the minimum cardinality of a semitotal dominating set of G . The emph semitotal domination multisubdivision number of a graph G , msd gamma t2 (G) , is the minimum positive integer k such that there exists an edge which must be subdivided k times to increase the semitotal domination number of G . In this paper, we show that msd gamma t2 (G) leq 3 for any graph G of order at least 3 , we also determine the semitotal domination multisubdivision number for some classes of graphs and characterize trees T with msd gamma t2 (T) 3 . On the other hand, we know that gamma t2 (G) is a parameter that is squeezed between domination number, gamma(G) and total domination number, gamma t(G) , so for any tree T , we investigate the ratios frac gamma t2 (T) gamma(T) and frac gamma t(T) gamma t2 (T) , and present the constructive characterizations of the families of trees achieving the upper bounds.


On Non standard Models of Arithmetic with Uncountable Standard Systems. In 1960s, Dana Scott gave a recursion theoretic characterization of standard systems of countable non standard models of arithmetic, i.e., collections of sets of standard natural numbers coded in non standard models. Later, Knight and Nadel proved that Scott's characterization also applies to non standard models of arithmetic with cardinality aleph 1 . But the question, whether the limit on cardinality can be removed from the above characterization, remains a long standing question, known as the Scott Set Problem. This article presents two constructions of non standard models of arithmetic with non trivial uncountable standard systems. The first one leads to a new proof of the above theorem of Knight and Nadel, and the second proves the existence of models with non trivial standard systems of cardinality the continuum. A partial answer to the Scott Set Problem under certain set theoretic hypothesis also follows from the second construction.


Probability free models in option pricing statistically indistinguishable dynamics and historical vs implied volatility. We investigate whether it is possible to formulate option pricing and hedging models without using probability. We present a model that is consistent with two notions of volatility a historical volatility consistent with statistical analysis, and an implied volatility consistent with options priced with the model. The latter will be also the quadratic variation of the model, a pathwise property. This first result, originally presented in Brigo and Mercurio (1998, 2000), is then connected with the recent work of Armstrong et al (2018, 2021), where using rough paths theory it is shown that implied volatility is associated with a purely pathwise lift of the stock dynamics involving no probability and no semimartingale theory in particular, leading to option models without probability. Finally, an intermediate result by Bender et al. (2008) is recalled. Using semimartingale theory, Bender et al. showed that one could obtain option prices based only on the semimartingale quadratic variation of the model, a pathwise property, and highlighted the difference between historical and implied volatility. All three works confirm the idea that while historical volatility is a statistical quantity, implied volatility is a pathwise one. This leads to a 20 years mini anniversary of pathwise pricing through 1998, 2008 and 2018, which is rather fitting for a talk presented at the conference for the 45 years of the Black, Scholes and Merton option pricing paradigm.


Model Based Meta Reinforcement Learning for Flight with Suspended Payloads. Transporting suspended payloads is challenging for autonomous aerial vehicles because the payload can cause significant and unpredictable changes to the robot's dynamics. These changes can lead to suboptimal flight performance or even catastrophic failure. Although adaptive control and learning based methods can in principle adapt to changes in these hybrid robot payload systems, rapid mid flight adaptation to payloads that have a priori unknown physical properties remains an open problem. We propose a meta learning approach that "learns how to learn" models of altered dynamics within seconds of post connection flight data. Our experiments demonstrate that our online adaptation approach outperforms non adaptive methods on a series of challenging suspended payload transportation tasks. Videos and other supplemental material are available on our website https sites.google.com view meta rl for flight


About Fibonacci trees. I. In this first paper, we look at the following question are the properties of the Fibonacci tree still true if we consider a finitely generated tree by the same rules but rooted at a black node? The direct answer is no, but new properties arise, a bit more complex than in the case of a tree rooted at a white node, but still of interest.


If beam search is the answer, what was the question?. Quite surprisingly, exact maximum a posteriori (MAP) decoding of neural language generators frequently leads to low quality results. Rather, most state of the art results on language generation tasks are attained using beam search despite its overwhelmingly high search error rate. This implies that the MAP objective alone does not express the properties we desire in text, which merits the question if beam search is the answer, what was the question? We frame beam search as the exact solution to a different decoding objective in order to gain insights into why high probability under a model alone may not indicate adequacy. We find that beam search enforces uniform information density in text, a property motivated by cognitive science. We suggest a set of decoding objectives that explicitly enforce this property and find that exact decoding with these objectives alleviates the problems encountered when decoding poorly calibrated language generation models. Additionally, we analyze the text produced using various decoding strategies and see that, in our neural machine translation experiments, the extent to which this property is adhered to strongly correlates with BLEU.


A simple self interaction correction to RPA like correlation energies. The random phase approximation (RPA) is exact for the exchange energy of a many electron ground state, but RPA makes the correlation energy too negative by about 0.5 eV electron. That large short range error, which tends to cancel out of iso electronic energy differences, is largely corrected by an exchange correlation kernel, or (as in RPA ) by an additive local or semilocal correction. RPA is by construction exact for the homogeneous electron gas, and it is also accurate for the jellium surface. RPA often gives realistic total energies for atoms or solids in which spin polarization corrections are absent or small. RPA and RPA also yield realistic singlet binding energy curves for H2 and N2, and thus RPA yields correct total energies even for spin unpolarized atoms with fractional spins and strong correlation, as in stretched H2 or N2. However, RPA and RPA can be very wrong for spin polarized one electron systems (especially for stretched H2 ), and also for the spin polarization energies of atoms. The spin polarization energy is often a small part of the total energy of an atom, but important for ionization energies, electron affinities, and the atomization energies of molecules. Here we propose a computationally efficient generalized RPA (gRPA ) that changes RPA only for spin polarized systems by making gRPA exact for all one electron densities, in the same simple semilocal way that the correlation energy densities of many meta generalized gradent approximations are made self correlation free. By construction, gRPA does not degrade the exact RPA description of jellium. gRPA is found to greatly improve upon RPA and RPA for the ionization energies and electron affinities of light atoms. Many versions of RPA with an approximate exchange correlation kernel fail to be exact for all one electron densities, and they can also be self interaction corrected in this way.


A First Look at the Deprecation of RESTful APIs An Empirical Study. REpresentational State Transfer (REST) is considered as one standard software architectural style to build web APIs that can integrate software systems over the internet. However, while connecting systems, RESTful APIs might also break the dependent applications that rely on their services when they introduce breaking changes, e.g., an older version of the API is no longer supported. To warn developers promptly and thus prevent critical impact on downstream applications, a deprecated removed model should be followed, and deprecation related information such as alternative approaches should also be listed. While API deprecation analysis as a theme is not new, most existing work focuses on non web APIs, such as the ones provided by Java and Android. To investigate RESTful API deprecation, we propose a framework called RADA (RESTful API Deprecation Analyzer). RADA is capable of automatically identifying deprecated API elements and analyzing impacted operations from an OpenAPI specification, a machine readable profile for describing RESTful web service. We apply RADA on 2,224 OpenAPI specifications of 1,368 RESTful APIs collected from APIs.guru, the largest directory of OpenAPI specifications. Based on the data mined by RADA, we perform an empirical study to investigate how the deprecated removed protocol is followed in RESTful APIs and characterize practices in RESTful API deprecation. The results of our study reveal several severe deprecation related problems in existing RESTful APIs. Our implementation of RADA and detailed empirical results are publicly available for future intelligent tools that could automatically identify and migrate usage of deprecated RESTful API operations in client code.


3D Object Instance Recognition and Pose Estimation Using Triplet Loss with Dynamic Margin. In this paper, we address the problem of 3D object instance recognition and pose estimation of localized objects in cluttered environments using convolutional neural networks. Inspired by the descriptor learning approach of Wohlhart et al., we propose a method that introduces the dynamic margin in the manifold learning triplet loss function. Such a loss function is designed to map images of different objects under different poses to a lower dimensional, similarity preserving descriptor space on which efficient nearest neighbor search algorithms can be applied. Introducing the dynamic margin allows for faster training times and better accuracy of the resulting low dimensional manifolds. Furthermore, we contribute the following adding in plane rotations (ignored by the baseline method) to the training, proposing new background noise types that help to better mimic realistic scenarios and improve accuracy with respect to clutter, adding surface normals as another powerful image modality representing an object surface leading to better performance than merely depth, and finally implementing an efficient online batch generation that allows for better variability during the training phase. We perform an exhaustive evaluation to demonstrate the effects of our contributions. Additionally, we assess the performance of the algorithm on the large BigBIRD dataset to demonstrate good scalability properties of the pipeline with respect to the number of models.


Residues of manifolds. For a manifold X a meromorphic function can be obtained by analytic continuation from the Riesz energy which is the integration of the distance between two points to the power z over the product space X times X , where z is a complex variable. We call this function the meromorphic energy function of the manifold X . It has only simple poles at some negative integers. We call them the residues of the manifold, which are the main subject of the paper. Some geometrically important quantities such as the volume, the mean and scalar curvatures, and the Euler characteristic of compact bodies of dimension less than 4 can be obtained as (local) residues. Suppose X is a closed submanifold or a compact body in a Euclidean space. If the meromorphic energy function of X has a pole at z 2 dim X then the residue at that point is M invariant and if not the value of the function at that point is M invariant. Thus we obtain M invariant residues for even dimensional closed submanifolds. They can be considered as higher dimensional analogues of the Willmore energy of closed surfaces. Residues appear to be similar to quantities obtained by asymptotic expansion such as intrinsic volumes (Lipschitz Killing curvatures), spectra of Laplacian, and the Graham Witten energy. We show that residues are independent from them. Finally we introduce a M invariant principal curvature energy for 4 dimensional hypersurfaces in RR 5 , and express the Graham Witten energy in terms of the residues, Weyl tensor, and this M invariant principal curvature energy.


Improving 3D Object Detection for Pedestrians with Virtual Multi View Synthesis Orientation Estimation. Accurately estimating the orientation of pedestrians is an important and challenging task for autonomous driving because this information is essential for tracking and predicting pedestrian behavior. This paper presents a flexible Virtual Multi View Synthesis module that can be adopted into 3D object detection methods to improve orientation estimation. The module uses a multi step process to acquire the fine grained semantic information required for accurate orientation estimation. First, the scene's point cloud is densified using a structure preserving depth completion algorithm and each point is colorized using its corresponding RGB pixel. Next, virtual cameras are placed around each object in the densified point cloud to generate novel viewpoints, which preserve the object's appearance. We show that this module greatly improves the orientation estimation on the challenging pedestrian class on the KITTI benchmark. When used with the open source 3D detector AVOD FPN, we outperform all other published methods on the pedestrian Orientation, 3D, and Bird's Eye View benchmarks.