Biomedical Concept Relatedness A large EHR based benchmark. A promising application of AI to healthcare is the retrieval of information from electronic health records (EHRs), e.g. to aid clinicians in finding relevant information for a consultation or to recruit suitable patients for a study. This requires search capabilities far beyond simple string matching, including the retrieval of concepts (diagnoses, symptoms, medications, etc.) related to the one in question. The suitability of AI methods for such applications is tested by predicting the relatedness of concepts with known relatedness scores. However, all existing biomedical concept relatedness datasets are notoriously small and consist of hand picked concept pairs. We open source a novel concept relatedness benchmark overcoming these issues it is six times larger than existing datasets and concept pairs are chosen based on co occurrence in EHRs, ensuring their relevance for the application of interest. We present an in depth analysis of our new dataset and compare it to existing ones, highlighting that it is not only larger but also complements existing datasets in terms of the types of concepts included. Initial experiments with state of the art embedding methods show that our dataset is a challenging new benchmark for testing concept relatedness models.


Stance Prediction for Contemporary Issues Data and Experiments. We investigate whether pre trained bidirectional transformers with sentiment and emotion information improve stance detection in long discussions of contemporary issues. As a part of this work, we create a novel stance detection dataset covering 419 different controversial issues and their related pros and cons collected by procon.org in nonpartisan format. Experimental results show that a shallow recurrent neural network with sentiment or emotion information can reach competitive results compared to fine tuned BERT with 20x fewer parameters. We also use a simple approach that explains which input phrases contribute to stance detection.


Reconstructing veriT Proofs in Isabelle HOL. Automated theorem provers are now commonly used within interactive theorem provers to discharge an increasingly large number of proof obligations. To maintain the trustworthiness of a proof, the automatically found proof must be verified inside the proof assistant. We present here a reconstruction procedure in the proof assistant Isabelle HOL for proofs generated by the satisfiability modulo theories solver veriT which is part of the smt tactic. We describe in detail the architecture of our improved reconstruction method and the challenges we faced in designing it. Our experiments show that the veriT powered smt tactic is regularly suggested by Sledgehammer as the fastest method to automatically solve proof goals.


Online Continual Learning on Sequences. Online continual learning (OCL) refers to the ability of a system to learn over time from a continuous stream of data without having to revisit previously encountered training samples. Learning continually in a single data pass is crucial for agents and robots operating in changing environments and required to acquire, fine tune, and transfer increasingly complex representations from non i.i.d. input distributions. Machine learning models that address OCL must alleviate textit catastrophic forgetting in which hidden representations are disrupted or completely overwritten when learning from streams of novel input. In this chapter, we summarize and discuss recent deep learning models that address OCL on sequential input through the use (and combination) of synaptic regularization, structural plasticity, and experience replay. Different implementations of replay have been proposed that alleviate catastrophic forgetting in connectionists architectures via the re occurrence of (latent representations of) input sequences and that functionally resemble mechanisms of hippocampal replay in the mammalian brain. Empirical evidence shows that architectures endowed with experience replay typically outperform architectures without in (online) incremental learning tasks.


A Deep Learning Framework for Predicting Digital Asset Price Movement from Trade by trade Data. This paper presents a deep learning framework based on Long Short term Memory Network(LSTM) that predicts price movement of cryptocurrencies from trade by trade data. The main focus of this study is on predicting short term price changes in a fixed time horizon from a looking back period. By carefully designing features and detailed searching for best hyper parameters, the model is trained to achieve high performance on nearly a year of trade by trade data. The optimal model delivers stable high performance(over 60 accuracy) on out of sample test periods. In a realistic trading simulation setting, the prediction made by the model could be easily monetized. Moreover, this study shows that the LSTM model could extract universal features from trade by trade data, as the learned parameters well maintain their high performance on other cryptocurrency instruments that were not included in training data. This study exceeds existing researches in term of the scale and precision of data used, as well as the high prediction accuracy achieved.


A Beurling Theorem for almost invariant subspaces of the shift operator. A complete characterization of nearly invariant subspaces of finite defect for the backward shift operator acting on the Hardy space is provided in the spirit of Hitt and Sarason's theorem. As a corollary we describe the almost invariant subspaces for the shift and its adjoint.


Subharmonic Solutions In Reversible Non Autonomous Differential Equations. We study the existence of subharmonic solutions in the system ddot u (t) f(t,u(t)) , where u(t) in mathbb R k and f is an even and p periodic function in time. Under some additional symmetry conditions on the function f , the problem of finding mp periodic solutions can be reformulated in a functional space as a Gamma times mathbb Z 2 times D m equivariant equation, where the group Gamma times mathbb Z 2 acts on the space mathbb R k and D m acts on u(t) by time shifts and reflection. We apply Brouwer equivariant degree to prove the existence of an infinite number of subharmonic solutions for the function f that satisfies additional hypothesis on linear behavior near zero and the Nagumo condition at infinity. We also discuss the bifurcation of subharmonic solutions when the system depends on an extra parameter.


Cyclic cycle systems of the complete multipartite graph. In this paper, we study the existence problem for cyclic ell cycle decompositions of the graph K m n , the complete multipartite graph with m parts of size n , and give necessary and sufficient conditions for their existence in the case that 2 ell mid (m 1)n .


Graphical Conditions for Rate Independence in Chemical Reaction Networks. Chemical Reaction Networks (CRNs) provide a useful abstraction of molecular interaction networks in which molecular structures as well as mass conservation principles are abstracted away to focus on the main dynamical properties of the network structure. In their interpretation by ordinary differential equations, we say that a CRN with distinguished input and output species computes a positive real function f R rightarrow R , if for any initial concentration x of the input species, the concentration of the output molecular species stabilizes at concentration f (x). The Turing completeness of that notion of chemical analog computation has been established by proving that any computable real function can be computed by a CRN over a finite set of molecular species. Rate independent CRNs form a restricted class of CRNs of high practical value since they enjoy a form of absolute robustness in the sense that the result is completely independent of the reaction rates and depends solely on the input concentrations. The functions computed by rate independent CRNs have been characterized mathematically as the set of piecewise linear functions from input species. However, this does not provide a mean to decide whether a given CRN is rate independent. In this paper, we provide graphical conditions on the Petri Net structure of a CRN which entail the rate independence property either for all species or for some output species. We show that in the curated part of the Biomodels repository, among the 590 reaction models tested, 2 reaction graphs were found to satisfy our rate independence conditions for all species, 94 for some output species, among which 29 for some non trivial output species. Our graphical conditions are based on a non standard use of the Petri net notions of place invariants and siphons which are computed by constraint programming techniques for efficiency reasons.


From the Black Karasinski to the Verhulst model to accommodate the unconventional Fed's policy. In this paper, we argue that some of the most popular short term interest models have to be revisited and modified to reflect current market conditions better. In particular, we propose a modification of the popular Black Karasinski model, which is widely used by practitioners for modeling interest rates, credit, and commodities. Our adjustment gives rise to the stochastic Verhulst model, which is well known in the population dynamics and epidemiology as a logistic model. We demonstrate that the Verhulst model's dynamics are well suited to the current economic environment and the Fed's actions. Besides, we derive new integral equations for the zero coupon bond prices for both the BK and Verhulst models. For the BK model for small maturities up to 2 years, we solve the corresponding integral equation by using the reduced differential transform method. For the Verhulst integral equation, under some mild assumptions, we find the closed form solution. Numerical examples show that computationally our approach is significantly more efficient than the standard finite difference method.


Rigidity results for automorphisms of Hardy Toeplitz C algebras. We prove a number of results on the automorphisms of and isomorphisms between Hardy Toeplitz algebras mathcal T (D) associated to bounded symmetric domains D that the stable isomorphism class of mathcal T (D) determines D (even when it is reducible), that for reducible domains D D 1 times cdots times D s the automorphisms of the Shilov boundary check S (D) induced by those of mathcal T (D) permute the Shilov boundaries check S (D i) , and that by contrast to arbitrary solvable algebras, automorphisms of mathcal T (D) that are trivial on their character spaces check S (D) are trivial on the entire spectrum widehat mathcal T (D) .


Simultaneous approximation terms and functional accuracy for diffusion problems discretized with multidimensional summation by parts operators. Several types of simultaneous approximation term (SAT) for diffusion problems discretized with diagonal norm multidimensional summation by parts (SBP) operators are analyzed based on a common framework. Conditions under which the SBP SAT discretizations are consistent, conservative, adjoint consistent, and energy stable are presented. For SATs leading to primal and adjoint consistent discretizations, the error in output functionals is shown to be of order h 2p when a degree p multidimensional SBP operator is used to discretize the spatial derivatives. SAT penalty coefficients corresponding to various discontinuous Galerkin fluxes developed for elliptic partial differential equations are identified. We demonstrate that the original method of Bassi and Rebay, the modified method of Bassi and Rebay, and the symmetric interior penalty method are equivalent when implemented with SBP diagonal E operators that have diagonal norm matrix, e.g., the Legendre Gauss Lobatto SBP operator in one space dimension. Similarly, the local discontinuous Galerkin and the compact discontinuous Galerkin schemes are equivalent for this family of operators. The analysis remains valid on curvilinear grids if a degree le p 1 bijective polynomial mapping from the reference to physical elements is used. Numerical experiments with the two dimensional Poisson problem support the theoretical results.


Nonrelativistic limit of solitary waves for nonlinear Maxwell Klein Gordon equations. We study the nonrelativistic limit of solitary waves from Nonlinear Maxwell Klein Gordon equations (NMKG) to Nonlinear Schrodinger Poisson equations (NSP). It is known that the existence or multiplicity of positive solutions depends on the choices of parameters the equations contain. In this paper, we prove that for a given positive solitary wave of NSP, which is found in Ruiz's work cite R , there corresponds a family of positive solitary waves of NMKG under the nonrelativistic limit. Notably, our results contain a new result of existence of positive solutions to (NMKG) with lower order nonlinearity.


A dynamical approach towards Collatz conjecture. The present work focuses on the study of the renowned Collatz conjecture, also known as the 3x 1 problem. The distinguished analysis approach lies on the dynamics of an iterative map in binary form. A new estimation of the enlargement of iterated numbers is given. Within the associated iterative map, characteristic periods for periodic orbits are identified.


Strong solutions to a beta Wishart particle system. The purpose of this paper is to study the existence and uniqueness of solutions to a Stochastic Differential Equation (SDE) coming from the eigenvalues of Wishart processes. The coordinates are non negative, evolve as Cox Ingersoll Ross (CIR) processes and repulse each other according to a Coulombian like interaction force. We show the existence of strong and pathwise unique solutions to the system until the first multiple collision, and give a necessary and sufficient condition on the parameters of the SDE for this multiple collision not to occur in finite time.


Optimization Bounds from the Branching Dual. We present a general method for obtaining strong bounds for discrete optimization problems that is based on a concept of branching duality. It can be applied when no useful integer programming model is available, and we illustrate this with the minimum bandwidth problem. The method strengthens a known bound for a given problem by formulating a dual problem whose feasible solutions are partial branching trees. It solves the dual problem with a "worst bound" local search heuristic that explores neighboring partial trees. After proving some optimality properties of the heuristic, we show that it substantially improves known combinatorial bounds for the minimum bandwidth problem with a modest amount of computation. It also obtains significantly tighter bounds than depth first and breadth first branching, demonstrating that the dual perspective can lead to better branching strategies when the object is to find valid bounds.


Triplet Track Trigger for Future High Rate Experiments. The hadron hadron based Future Circular Collider (FCC hh) is a project with the goal to collide proton proton beams at a center of mass energy of sqrt(s) 100 TeV with a bunch crossing rate of 25 ns. Some of the major challenges that the FCC experiments have to tackle are the very large number of pile up events of around 1000 and the data processing, namely the reduction of the huge data rate of 1 2 PBytes s whilst keeping the signal efficiencies of interesting processes high. Therefore, smart triggering concepts are needed that not only allow for a significant reduction of pile up and rate but also provide high signal acceptance and purity. In this proceeding, one such concept of a triplet track trigger based on Monolithic ActivePixel Sensors (MAPS) is presented for a generic detector geometry. It is demonstrated that the triplet pixel layer design allows for a very simple and fast track reconstruction already at the first trigger level, providing excellent track reconstruction efficiencies and very high purity at the same time. Based on a full Geant4 simulation tracking performance studies are presented for a full scale triplet pixel detector, i.e. three closely spaced pixel layers at a sufficiently large radius, in an FCC like detector environment. Results obtained for different triplet layer design parameters are compared.


Hyperbolic geometry. This textbook is an introductory course on hyperbolic geometry, intended for students at the advanced undergraduate (Bachelor) or early graduate (Master) level.


Convergence Rates for Boundedly Regular Systems. In this work, we consider a continuous dynamical system associated with the fixed point set of a nonexpansive operator which was originally studied by Bo c t Csetnek (2015). Our main results establish convergence rates for the system's trajectories when the nonexpansive operator satisfies an additional regularity property. This setting is the natural continuous time analogue to discrete time results obtained in Bauschke, Noll Phan (2015) and Borwein, Li Tam (2017) by using the same regularity properties.


Automorphisms of modular lattices. The methods to classify extremal unimodular lattices with given automorphisms are extended to the situation of modular lattices. A slightly more general notion than the type from the PhD thesis of Michael Juergens is the det type. The det type of an automorphism on L determines the one of all partial dual lattices of L . This easy observation allows to exclude quite a few det types of automorphisms left open in the above mentioned thesis. Passing to suitable p maximal lattices, extremal l modular lattices of composite level 14 and 15 of dimension 12 and the ones of level 6 and dimension 16 are classified.


Virus Transmission Risk in Urban Rail Systems A Microscopic Simulation based Analysis of Spatio temporal Characteristics. Transmission risk of air borne diseases in public transportation systems is a concern. The paper proposes a modified Wells Riley model for risk analysis in public transportation systems to capture the passenger flow characteristics, including spatial and temporal patterns in terms of number of boarding, alighting passengers, and number of infectors. The model is utilized to assess overall risk as a function of OD flows, actual operations, and factors such as mask wearing, and ventilation. The model is integrated with a microscopic simulation model of subway operations (SimMETRO). Using actual data from a subway system, a case study explores the impact of different factors on transmission risk, including mask wearing, ventilation rates, infectiousness levels of disease and carrier rates. In general, mask wearing and ventilation are effective under various demand levels, infectiousness levels, and carrier rates. Mask wearing is more effective in mitigating risks. Impacts from operations and service frequency are also evaluated, emphasizing the importance of maintaining reliable, frequent operations in lowering transmission risks. Risk spatial patterns are also explored, highlighting locations of higher risk.


Uniform Convolution and Fourier Restriction estimates for complex polynomial curves in mathbb C 3 . We establish optimal (p,q) ranges for two types of estimates associated to three dimensional complex polynomial curves. These are the estimates for the weighted restriction of the Fourier Transform to a complex polynomial curve, and the weighted Convolution Operator associated to a complex polynomial curve. Establishing these estimates comes down to establishing a lower bound for the Jacobian of a mapping associated to the complex curve in question.


Joint Optimization of Transfer Location and Capacity in a Multimodal Transport Network Bilevel Modeling and Paradoxes. With the growing attention towards developing the multimodal transport system to enhance urban mobility, there is an increasing need to construct new, rebuild or expand existing infrastructure to facilitate existing and accommodate newly generated travel demand. Therefore, this paper develops a bilevel model to simultaneously determine the location and capacity of the transfer infrastructure to be built considering elastic demand in a multimodal transport network. The upper level problem is formulated as a mixed integer linear programming problem, while the lower level problem is the capacitated combined trip distribution assignment model that depicts both destination and route choices of travelers via the multinomial logit formula. To solve the model, the paper develops a matheuristics algorithm that integrates a Genetic Algorithm and a successive linear programming solution approach. Numerical studies are conducted to demonstrate the existence and examine two Braess like paradox phenomena in a multimodal transport network. The first one states that under fixed demand constructing parking spaces to stimulate the usage of Park and Ride service could deteriorate the system performance, measured by the total passengers travel time, while the second one reveals that under variable demand increasing the parking capacity for the Park and Ride services to promote the usages may fail, represented by the decline in its modal share. Meanwhile, the last experiment suggests that constructing transfer infrastructures at distributed stations outperforms building a large transfer center in terms of attracting travelers using sustainable transit modes.


Calibrating Self supervised Monocular Depth Estimation. In the recent years, many methods demonstrated the ability of neural networks to learn depth and pose changes in a sequence of images, using only self supervision as the training signal. Whilst the networks achieve good performance, the often over looked detail is that due to the inherent ambiguity of monocular vision they predict depth up to an unknown scaling factor. The scaling factor is then typically obtained from the LiDAR ground truth at test time, which severely limits practical applications of these methods. In this paper, we show that incorporating prior information about the camera configuration and the environment, we can remove the scale ambiguity and predict depth directly, still using the self supervised formulation and not relying on any additional sensors.


Zero Reference Deep Curve Estimation for Low Light Image Enhancement. The paper presents a novel method, Zero Reference Deep Curve Estimation (Zero DCE), which formulates light enhancement as a task of image specific curve estimation with a deep network. Our method trains a lightweight deep network, DCE Net, to estimate pixel wise and high order curves for dynamic range adjustment of a given image. The curve estimation is specially designed, considering pixel value range, monotonicity, and differentiability. Zero DCE is appealing in its relaxed assumption on reference images, i.e., it does not require any paired or unpaired data during training. This is achieved through a set of carefully formulated non reference loss functions, which implicitly measure the enhancement quality and drive the learning of the network. Our method is efficient as image enhancement can be achieved by an intuitive and simple nonlinear curve mapping. Despite its simplicity, we show that it generalizes well to diverse lighting conditions. Extensive experiments on various benchmarks demonstrate the advantages of our method over state of the art methods qualitatively and quantitatively. Furthermore, the potential benefits of our Zero DCE to face detection in the dark are discussed. Code and model will be available at https github.com Li Chongyi Zero DCE.


On the Widom factors for L p extremal polynomials. We continue our study of the Widom factors for L p( mu) extremal polynomials initiated in 4 . In this work we characterize sets for which the lower bounds obtained in 4 are saturated, establish continuity of the Widom factors with respect to the measure mu , and show that despite the lower bound W 2,n ( mu K) 2 geq 2S( mu K) for the equilibrium measure mu K on a compact set K subset mathbb R the general lower bound W p,n ( mu) p geq S( mu) is optimal even for measures d mu wd mu K with polynomial weights w on K subset mathbb R . We also study pull back measures under polynomial pre images introduced in 16, 23 and obtain invariance of the Widom factors for such measures. Lastly, we study in detail the Widom factors for orthogonal polynomials with respect to the equilibrium measure on a circular arc and, in particular, find their limit, infimum, and supremum and show that they are strictly monotone increasing with the degree and strictly monotone decreasing with the length of the arc.


Sampling from Rough Energy Landscapes. We examine challenges to sampling from Boltzmann distributions associated with multiscale energy landscapes. The multiscale features, or "roughness," corresponds to highly oscillatory, but bounded, perturbations of a smooth landscape. Through a combination of numerical experiments and analysis we demonstrate that the performance of Metropolis Adjusted Langevin Algorithm can be severely attenuated as the roughness increases. In contrast, we prove that Random Walk Metropolis is insensitive to such roughness. We also formulate two alternative sampling strategies that incorporate large scale features of the energy landscape, while resisting the impact of fine scale roughness these also outperform Random Walk Metropolis. Numerical experiments on these landscapes are presented that confirm our predictions. Open questions and numerical challenges are also highlighted.


Fine Grained Emotion Classification of Chinese Microblogs Based on Graph Convolution Networks. Microblogs are widely used to express people's opinions and feelings in daily life. Sentiment analysis (SA) can timely detect personal sentiment polarities through analyzing text. Deep learning approaches have been broadly used in SA but still have not fully exploited syntax information. In this paper, we propose a syntax based graph convolution network (GCN) model to enhance the understanding of diverse grammatical structures of Chinese microblogs. In addition, a pooling method based on percentile is proposed to improve the accuracy of the model. In experiments, for Chinese microblogs emotion classification categories including happiness, sadness, like, anger, disgust, fear, and surprise, the F measure of our model reaches 82.32 and exceeds the state of the art algorithm by 5.90 . The experimental results show that our model can effectively utilize the information of dependency parsing to improve the performance of emotion detection. What is more, we annotate a new dataset for Chinese emotion classification, which is open to other researchers.


A crystal on decreasing factorizations in the 0 Hecke monoid. We introduce a type A crystal structure on decreasing factorizations of fully commutative elements in the 0 Hecke monoid which we call star crystal. This crystal is a K theoretic generalization of the crystal on decreasing factorizations in the symmetric group of the first and last author. We prove that under the residue map the star crystal intertwines with the crystal on set valued tableaux recently introduced by Monical, Pechenik and Scrimshaw. We also define a new insertion from decreasing factorization to pairs of semistandard Young tableaux and prove several properties, such as its relation to the Hecke insertion and the uncrowding algorithm. The new insertion also intertwines with the crystal operators.


High order numerical method for two dimensional Riesz space fractional advection dispersion equation. In this paper, by combining of fractional centered difference approach with alternating direction implicit method, we introduce a mixed difference method for solving two dimensional Riesz space fractional advection dispersion equation. The proposed method is a fourth order centered difference operator in spatial directions and second order Crank Nicolson method in temporal direction. By reviewing the consistency and stability of the method, the convergence of the proposed method is achieved. Several numerical examples are considered aiming to demonstrate the validity and applicability of the proposed technique.


Investigation of the luminescence of mathrm UO 2X 4 2 (X Cl, Br) complexes in organic phase using time resolved laser induced fluorescence spectroscopy and quantum chemical simulations. The luminescence properties of the mathrm UO 2Cl 4 2 complex in an organic phase, especially the influence of large organic counter cations, have been studied by time resolved laser induced fluorescence spectroscopy (TRLFS) and ab initio modeling. The experimental spectrum was assigned by vibronic Franck Condon calculations on quantum chemical models based on relativistic density functional approaches. The shape of the luminescence spectrum of the uranyl tetrachloride complex is determined by symmetrical vibrations and geometrical change upon emission. The possible change of the luminescence properties depending on the first and second uranyl coordination sphere was predicted theoretically for mathrm UO 2Br 4 2 and mathrm R 4N 2 UO 2Cl 4 ( mathrm R 4N mathrm Bu 4N , mathrm A336 ) systems. The computations reveal that for U(VI), the second coordination sphere has little influence on the spectrum shape, making speciation of uranyl complexes with identical first coordination sphere ligands tedious to discriminate. The computed structural changes agreed well with experimental trends theoretical spectra and peaks attribution are in a good accordance with TRLFS and magnetic circular dichroism (MCD) data respectively.


Question Answering over Knowledge Base using Language Model Embeddings. Knowledge Base, represents facts about the world, often in some form of subsumption ontology, rather than implicitly, embedded in procedural code, the way a conventional computer program does. While there is a rapid growth in knowledge bases, it poses a challenge of retrieving information from them. Knowledge Base Question Answering is one of the promising approaches for extracting substantial knowledge from Knowledge Bases. Unlike web search, Question Answering over a knowledge base gives accurate and concise results, provided that natural language questions can be understood and mapped precisely to an answer in the knowledge base. However, some of the existing embedding based methods for knowledge base question answering systems ignore the subtle correlation between the question and the Knowledge Base (e.g., entity types, relation paths, and context) and suffer from the Out Of Vocabulary problem. In this paper, we focused on using a pre trained language model for the Knowledge Base Question Answering task. Firstly, we used Bert base uncased for the initial experiments. We further fine tuned these embeddings with a two way attention mechanism from the knowledge base to the asked question and from the asked question to the knowledge base answer aspects. Our method is based on a simple Convolutional Neural Network architecture with a Multi Head Attention mechanism to represent the asked question dynamically in multiple aspects. Our experimental results show the effectiveness and the superiority of the Bert pre trained language model embeddings for question answering systems on knowledge bases over other well known embedding methods.


Knowledge Authoring and Question Answering with KALM. Knowledge representation and reasoning (KRR) is one of the key areas in artificial intelligence (AI) field. It is intended to represent the world knowledge in formal languages (e.g., Prolog, SPARQL) and then enhance the expert systems to perform querying and inference tasks. Currently, constructing large scale knowledge bases (KBs) with high quality is prohibited by the fact that the construction process requires many qualified knowledge engineers who not only understand the domain specific knowledge but also have sufficient skills in knowledge representation. Unfortunately, qualified knowledge engineers are in short supply. Therefore, it would be very useful to build a tool that allows the user to construct and query the KB simply via text. Although there is a number of systems developed for knowledge extraction and question answering, they mainly fail in that these system don't achieve high enough accuracy whereas KRR is highly sensitive to erroneous data. In this thesis proposal, I will present Knowledge Authoring Logic Machine (KALM), a rule based system which allows the user to author knowledge and query the KB in text. The experimental results show that KALM achieved superior accuracy in knowledge authoring and question answering as compared to the state of the art systems.


Actionable Attribution Maps for Scientific Machine Learning. The scientific community has been increasingly interested in harnessing the power of deep learning to solve various domain challenges. However, despite the effectiveness in building predictive models, fundamental challenges exist in extracting actionable knowledge from the deep neural network due to their opaque nature. In this work, we propose techniques for exploring the behavior of deep learning models by injecting domain specific actionable concepts as tunable knobs'' in the analysis pipeline. By incorporating the domain knowledge with generative modeling, we are not only able to better understand the behavior of these black box models, but also provide scientists with actionable insights that can potentially lead to fundamental discoveries.


Noncommutative weak (1,1) type estimate for a square function from ergodic theory. In this paper, we investigate the boundedness of a square function from ergodic theory on noncommutative L p spaces. The main result is a weak (1,1) type estimate of this square function. We also show the (L infty , mathrm BMO ) estimate, and thus strong (L p ,L p ) estimate by interpolation. The main novel difficulty lies in the fact that the kernel of this square function does not enjoy any regularity, which is crucial in showing such endpoint estimates for standard noncommutative Calder 'on Zygmund singular integral operators.


Slices of Parameter Space for Meromorphic Maps with Two Asymptotic Values. This paper is part of a program to understand the parameter spaces of dynamical systems generated by meromorphic functions with finitely many singular values. We give a full description of the parameter space for a specific family based on the exponential function that has precisely two finite asymptotic values and one attracting fixed point. It represents a step beyond the previous work in GK on degree 2 rational functions with analogous constraints two critical values and an attracting fixed point. What is interesting and promising for pushing the general program even further, is that, despite the presence of the essential singularity, our new functions exhibit a dynamic structure as similar as one could hope to the rational case, and that the philosophy of the techniques used in the rational case could be adapted.


Beurling Ahlfors extension by heat kernel, rm A infty weights for VMO, and vanishing Carleson measures. We investigate a variant of the Beurling Ahlfors extension of quasisymmetric homeomorphisms of the real line that is given by the convolution of the heat kernel, and prove that the complex dilatation of such a quasiconformal extension of a strongly symmetric homeomorphism (i.e. its derivative is an rm A infty weight whose logarithm is in VMO) induces a vanishing Carleson measure on the upper half plane.


Maker Breaker domination number for P 2 square P n . We study the Maker Breaker domination game played by Dominator and Staller on the vertex set of a given graph. Dominator wins when the vertices he has claimed form a dominating set of the graph. Staller wins if she makes it impossible for Dominator to win, or equivalently, she is able to claim some vertex and all its neighbours. Maker Breaker domination number gamma MB (G) ( gamma ' MB (G) ) of a graph G is defined to be the minimum number of moves for Dominator to guarantee his winning when he plays first (second). We investigate these two invariants for the Cartesian product of any two graphs. We obtain upper bounds for the Maker Breaker domination number of the Cartesian product of two arbitrary graphs. Also, we give upper bounds for the Maker Breaker domination number of the Cartesian product of the complete graph with two vertices and an arbitrary graph. Most importantly, we prove that gamma MB (P 2 square P n) n 2 for n geq 13 and gamma' MB (P 2 square P n) n for n geq 1 . Also, for the unions of P 2 square P n s, we show that gamma MB '( dot cup i 1 k(P 2 square P n) i) k cdot n ( n geq 1 ), and that k cdot n geq gamma MB ( dot cup i 1 k(P 2 square P n) i) geq k cdot n 2 ( n geq 13 ).


Automatic Lesion Detection System (ALDS) for Skin Cancer Classification Using SVM and Neural Classifiers. Technology aided platforms provide reliable tools in almost every field these days. These tools being supported by computational power are significant for applications that need sensitive and precise data analysis. One such important application in the medical field is Automatic Lesion Detection System (ALDS) for skin cancer classification. Computer aided diagnosis helps physicians and dermatologists to obtain a second opinion for proper analysis and treatment of skin cancer. Precise segmentation of the cancerous mole along with surrounding area is essential for proper analysis and diagnosis. This paper is focused towards the development of improved ALDS framework based on probabilistic approach that initially utilizes active contours and watershed merged mask for segmenting out the mole and later SVM and Neural Classifier are applied for the classification of the segmented mole. After lesion segmentation, the selected features are classified to ascertain that whether the case under consideration is melanoma or non melanoma. The approach is tested for varying datasets and comparative analysis is performed that reflects the effectiveness of the proposed system.


Influence of density and release properties of UCx targets on the fission product yields at ALTO. To study the influence of the structural properties of UCx targets on their release properties, several types of targets using different precursors (carbon and uranium) were synthesized, characterized, irradiated and heated leading to the determination of the released fractions of eight elements. In this article, the production rates of these targets are estimated under the use conditions at ALTO, i.e. with targets bombarded by an electron beam (10 mu A, 50 MeV). We have simulated the fission number produced using the FLUKA code. Then, we have determined the release efficiency as a function of the half life of the isotopes using average diffusion coefficients deduced for the elements studied previously. Finally, we compare the production rates obtained from the various targets and conclude that the target must be adapted to the element studied. It is crucial to find in each case the best compromise between the target density and the release efficiency.


On quasi reversibility solutions to the Cauchy problem for the Laplace equation regularity and error estimates. We are interested in the classical ill posed Cauchy problem for the Laplace equation. One method to approximate the solution associated with compatible data consists in considering a family of regularized well posed problems depending on a small parameter varepsilon 0 . In this context, in order to prove convergence of finite elements methods, it is necessary to get regularity results of the solutions to these regularized problems which hold uniformly in varepsilon . In the present work, we obtain these results in smooth domains and in 2D polygonal geometries. In presence of corners, due the particular structure of the regularized problems, classical techniques a la Grisvard do not work and instead, we apply the Kondratiev approach. We describe the procedure in detail to keep track of the dependence in varepsilon in all the estimates. The main originality of this study lies in the fact that the limit problem is ill posed in any framework.


Axonal Computations. Axons functionally link the somato dendritic compartment to synaptic terminals. Structurally and functionally diverse, they accomplish a central role in determining the delays and reliability with which neuronal ensembles communicate. By combining their active and passive biophysical properties, they ensure a plethora of physiological computations. In this review, we revisit the biophysics of generation and propagation of electrical signals in the axon, their complex interplay, and their rich dynamics. We further place the computational abilities of axons in the context of intracellular and intercellular coupling. We discuss how, by means of sophisticated biophysical mechanisms, axons expand the repertoire of axonal computation, and thereby, of neural computation.


Proceedings Third Joint Workshop on Developments in Implicit Computational complExity and Foundational Practical Aspects of Resource Analysis. These proceedings present the accepted regular papers and some selected extended abstracts from the 3rd joint DICE FOPARA workshop, which was held in Prague, Czech Republic on April 6 7, 2019, as a part of ETAPS. The joint workshop provides synergies by combining two complementary communities The 10th DICE workshop explores the area of Implicit Computational Complexity (ICC), which grew out from several proposals to use logic and formal methods to provide languages for complexity bounded computation (e.g. Ptime, Logspace computation). It aims at studying the computational complexity of programs without referring to external measuring conditions or a particular machine model, but only by considering language restrictions or logical computational principles entailing complexity properties. Several approaches have been explored for that purpose, such as restrictions on primitive recursion and ramification, rewriting systems, linear logic, types and lambda calculus, interpretations of functional and imperative programs. The 6th FOPARA workshop serves as a forum for presenting original research results that are relevant to the analysis of resource (e.g. time, space, energy) consumption by computer programs. The workshop aims to bring together the researchers that work on foundational issues with the researchers that focus more on practical results. Therefore, both theoretical and practical contributions are encouraged. We also encourage papers that combine theory and practice. This third joint DICE FOPARA workshop at ETAPS 2019 follows the successful experiences of co location of DICE FOPARA at ETAPS 2015 in London and ETAPS 2017 in Uppsala.


Sublinearly Morse Boundary II Proper geodesic spaces. We build an analogue of the Gromov boundary for any proper geodesic metric space, hence for any finitely generated group. More precisely, for any proper geodesic metric space X and any sublinear function kappa , we construct a boundary for X , denoted mathcal partial kappa X , that is quasi isometrically invariant and metrizable. As an application, we show that when G is the mapping class group of a finite type surface, or a relatively hyperbolic group, then with minimal assumptions the Poisson boundary of G can be realized on the kappa Morse boundary of G equipped the word metric associated to any finite generating set.


Course of the first month of the COVID 19 outbreak in the New York State counties. We illustrate and study the evolution of reported infections over the month from March 1st to April 1st in the New York State as a whole, as well as in each individual county. We search for exponential trends, and try to understand whether there is any correlation of the timing and dynamics of these trends with state mandated measures on social distancing and testing. We conclude that the reports on April 1st may be dramatically under representing the actual number of state wide infections, and we propose reassessment of the data over the coming weeks, to monitor for effects of the PAUSE directive, and for the increasing number of casualties as a validating measure.


Learning to Retrieve Entity Aware Knowledge and Generate Responses with Copy Mechanism for Task Oriented Dialogue Systems. Task oriented conversational modeling with unstructured knowledge access, as track 1 of the 9th Dialogue System Technology Challenges (DSTC 9), requests to build a system to generate response given dialogue history and knowledge access. This challenge can be separated into three subtasks, (1) knowledge seeking turn detection, (2) knowledge selection, and (3) knowledge grounded response generation. We use pre trained language models, ELECTRA and RoBERTa, as our base encoder for different subtasks. For subtask 1 and 2, the coarse grained information like domain and entity are used to enhance knowledge usage. For subtask 3, we use a latent variable to encode dialog history and selected knowledge better and generate responses combined with copy mechanism. Meanwhile, some useful post processing strategies are performed on the model's final output to make further knowledge usage in the generation task. As shown in released evaluation results, our proposed system ranks second under objective metrics and ranks fourth under human metrics.


Solving Sparse Linear Systems Faster than Matrix Multiplication. Can linear systems be solved faster than matrix multiplication? While there has been remarkable progress for the special cases of graph structured linear systems, in the general setting, the bit complexity of solving an n times n linear system Ax b is tilde O (n omega) , where omega 2.372864 is the matrix multiplication exponent. Improving on this has been an open problem even for sparse linear systems with poly (n) condition number. In this paper, we present an algorithm that solves linear systems in sparse matrices asymptotically faster than matrix multiplication for any omega 2 . This speedup holds for any input matrix A with o(n omega 1 log( kappa(A))) non zeros, where kappa(A) is the condition number of A . For poly (n) conditioned matrices with tilde O (n) nonzeros, and the current value of omega , the bit complexity of our algorithm to solve to within any 1 text poly (n) error is O(n 2.331645 ) . Our algorithm can be viewed as an efficient, randomized implementation of the block Krylov method via recursive low displacement rank factorizations. It is inspired by the algorithm of Eberly et al. ISSAC 06 07 for inverting matrices over finite fields. In our analysis of numerical stability, we develop matrix anti concentration techniques to bound the smallest eigenvalue and the smallest gap in eigenvalues of semi random matrices.


Pose based Body Language Recognition for Emotion and Psychiatric Symptom Interpretation. Inspired by the human ability to infer emotions from body language, we propose an automated framework for body language based emotion recognition starting from regular RGB videos. In collaboration with psychologists, we further extend the framework for psychiatric symptom prediction. Because a specific application domain of the proposed framework may only supply a limited amount of data, the framework is designed to work on a small training set and possess a good transferability. The proposed system in the first stage generates sequences of body language predictions based on human poses estimated from input videos. In the second stage, the predicted sequences are fed into a temporal network for emotion interpretation and psychiatric symptom prediction. We first validate the accuracy and transferability of the proposed body language recognition method on several public action recognition datasets. We then evaluate the framework on a proposed URMC dataset, which consists of conversations between a standardized patient and a behavioral health professional, along with expert annotations of body language, emotions, and potential psychiatric symptoms. The proposed framework outperforms other methods on the URMC dataset.


Sumsets of Wythoff Sequences, Fibonacci Representation, and Beyond. Let alpha (1 sqrt 5 ) 2 and define the lower and upper Wythoff sequences by a i lfloor i alpha rfloor , b i lfloor i alpha 2 rfloor for i geq 1 . In a recent interesting paper, Kawsumarng et al. proved a number of results about numbers representable as sums of the form a i a j , b i b j , a i b j , and so forth. In this paper I show how to derive all of their results, using one simple idea and existing free software called Walnut. The key idea is that for each of their sumsets, there is a relatively small automaton accepting the Fibonacci representation of the numbers represented. I also show how the automaton approach can easily prove other results.


Efficient Integer Arithmetic Only Convolutional Neural Networks. Integer arithmetic only networks have been demonstrated effective to reduce computational cost and to ensure cross platform consistency. However, previous works usually report a decline in the inference accuracy when converting well trained floating point number (FPN) networks into integer networks. We analyze this phonomenon and find that the decline is due to activation quantization. Specifically, when we replace conventional ReLU with Bounded ReLU, how to set the bound for each neuron is a key problem. Considering the tradeoff between activation quantization error and network learning ability, we set an empirical rule to tune the bound of each Bounded ReLU. We also design a mechanism to handle the cases of feature map addition and feature map concatenation. Based on the proposed method, our trained 8 bit integer ResNet outperforms the 8 bit networks of Google's TensorFlow and NVIDIA's TensorRT for image recognition. We also experiment on VDSR for image super resolution and on VRCNN for compression artifact reduction, both of which serve for regression tasks that natively require high inference accuracy. Our integer networks achieve equivalent performance as the corresponding FPN networks, but have only 1 4 memory cost and run 2x faster on modern GPUs. Our code and models can be found at github.com HengRuiZ brelu.


Concept study and preliminary design of a cold atom interferometer for space gravity gradiometry. We study a space based gravity gradiometer based on cold atom interferometry and its potential for the Earth's gravitational field mapping. The instrument architecture has been proposed in Carraz et al., Microgravity Science and Technology 26, 139 (2014) and enables high sensitivity measurements of gravity gradients by using atom interferometers in a differential accelerometer configuration. We present the design of the instrument including its subsystems and analyze the mission scenario, for which we derive the expected instrument performances, the requirements on the sensor and its key subsystems, and the expected impact on the recovery of the Earth gravity field.


Developmental trajectory of Caenorhabditis elegans nervous system governs its structural organization. A central problem of neuroscience involves uncovering the principles governing the organization of nervous systems which ensure robustness in brain development. The nematode Caenorhabditis elegans provides us with a model organism for studying this question. In this paper, we focus on the invariant connection structure and spatial arrangement of the neurons comprising the somatic neuronal network of this organism to understand the key developmental constraints underlying its design. We observe that neurons with certain shared characteristics such as, neural process lengths, birth time cohort, lineage and bilateral symmetry exhibit a preference for connecting to each other. Recognizing the existence of such homophily helps in connecting the physical location and morphology of neurons with the topological organization of the network. Further, the functional identities of neurons appear to dictate the temporal hierarchy of their appearance during the course of development. Providing crucial insights into principles that may be common across many organisms, our study shows how the trajectory in the developmental landscape constrains the eventual spatial and network topological organization of a nervous system.


On the possible origin and evolution of genetic coding. To synthesize peptides alongside the RNAs making the so called RNA world, some genetic coding involving RNA had to develop. Herein, it is proposed that the first real coding setup was a direct one, made up of continuous poly tRNA like molecules, with each tRNA like moiety carrying, beyond and near its 5 prime or 3 prime end, a trinucleotide site for specific amino acid binding the sequence and continuity of the tRNA moieties of a particular poly tRNA would ensure the sequence and continuity of the amino acids of the corresponding peptide or small protein. In parallel with these particular entities, and enhancing their peptide forming function, a proto ribosome and primitive amino acid activation system would develop. At some stage, one critical innovation would be the appearance of RNA fragments that could tighten several adjacent tRNA moieties together on a particular poly tRNA molecule, by pairing with the second trinucleotide sequence (identical to the first one carrying the specific amino acid binding site) situated at, or close to, the middle of each tRNA moiety (i.e., the present anticodon site). These RNA fragments, acting as authentic co ribozymes in the peptide synthesizing apparatus, would constitute the ancestors of the present mRNAs. Later, on these mRNA like guiding fragments, free tRNA forms would be additionally used, first keeping their amino acid binding sites, then losing them in favor of a specific amino acid attachment at a CCA arm at their 3 prime end. Finally, these latter mechanisms would progressively prevail, leading to the modern and universal indirect genetic coding system. Experimental and theoretical arguments are presented and discussed in favor of such a scenario for the origin and evolution of genetic coding.


Learning epidemic threshold in complex networks by Convolutional Neural Network. Deep learning has taken part in the competition since not long ago to learn and identify phase transitions in physical systems such as many body quantum systems, whose underlying lattice structures are generally regular as they're in euclidean space. Real networks have complex structural features which play a significant role in dynamics in them, and thus the structural and dynamical information of complex networks can not be directly learned by existing neural network models. Here we propose a novel and effective framework to learn the epidemic threshold in complex networks by combining the structural and dynamical information into the learning procedure. Considering the strong performance of learning in Euclidean space, Convolutional Neural Network (CNN) is used and, with the help of confusion scheme, we can identify precisely the outbreak threshold of epidemic dynamics. To represent the high dimensional network data set in Euclidean space for CNN, we reduce the dimensionality of a network by using graph representation learning algorithms and discretize the embedded space to convert it into an image like structure. We then creatively merge the nodal dynamical states with the structural embedding by multi channel images. In this manner, the proposed model can draw the conclusion from both structural and dynamical information. A large number of simulations show a great performance in both synthetic and empirical network data set. Our end to end machine learning framework is robust and universally applicable to complex networks with arbitrary size and topology.


Improving Federated Relational Data Modeling via Basis Alignment and Weight Penalty. Federated learning (FL) has attracted increasing attention in recent years. As a privacy preserving collaborative learning paradigm, it enables a broader range of applications, especially for computer vision and natural language processing tasks. However, to date, there is limited research of federated learning on relational data, namely Knowledge Graph (KG). In this work, we present a modified version of the graph neural network algorithm that performs federated modeling over KGs across different participants. Specifically, to tackle the inherent data heterogeneity issue and inefficiency in algorithm convergence, we propose a novel optimization algorithm, named FedAlign, with 1) optimal transportation (OT) for on client personalization and 2) weight constraint to speed up the convergence. Extensive experiments have been conducted on several widely used datasets. Empirical results show that our proposed method outperforms the state of the art FL methods, such as FedAVG and FedProx, with better convergence.


Relationship between polytropic index and temperature anisotropy in space plasmas. The paper develops a theoretical relationship between the polytropic index and the temperature anisotropy that may characterize space plasmas. The derivation is based on the correlation among the kinetic energies of particles with velocities described by anisotropic kappa distributions. The correlation coefficient depends on the effective dimensionality of the velocity distribution function, having its shape determined by the temperature anisotropies caused by the ambient magnetic field on the other hand, the effective dimensionality is directly dependent on the polytropic index. This analysis leads to the connection between the correlation coefficient, effective dimensionality of velocity space, and the polytropic index, with the ratio of temperature anisotropy. Moreover, a data and statistical analysis is performed to test the application of the theoretically developed model, in the solar wind proton plasma near 1 AU. The derived theoretical relationship is in good agreement with observations, showing that the lowest and classical value of the adiabatic polytropic index occurs in the isotropic case, while higher indices characterize anisotropic plasmas. Finally, possible extensions of the theory considering (i) non adiabatic polytropic behavior, and (ii) more general distributions, are further discussed.


Non uniformly receding contact line breaks axisymmetric flow patterns. We investigate the internal flow pattern of an evaporating droplet using tomographic particle image velocimetry (PIV) when the contact line non uniformly recedes. We observe a three dimensional azimuthal vortex pair while the contact line non uniformly recedes and the symmetry breaking flow field is maintained during the evaporation. Based on the experimental results, we show that the vorticity magnitude of the internal flow is related to the relative contact line motion. Furthermore, to explain how the azimuthal vortex pair flow is created, we develop a theoretical model by taking into account the relation between the contact line motion and evaporating flux. Finally, we show that the theoretical model has a good agreement with experimental results.


No Arbitrage Commodity Option Pricing with Market Manipulation. We design three continuous time models in finite horizon of a commodity price, whose dynamics can be affected by the actions of a representative risk neutral producer and a representative risk neutral trader. Depending on the model, the producer can control the drift and or the volatility of the price whereas the trader can at most affect the volatility. The producer can affect the volatility in two ways either by randomizing her production rate or, as the trader, using other means such as spreading false information. Moreover, the producer contracts at time zero a fixed position in a European convex derivative with the trader. The trader can be price taker, as in the first two models, or she can also affect the volatility of the commodity price, as in the third model. We solve all three models semi explicitly and give closed form expressions of the derivative price over a small time horizon, preventing arbitrage opportunities to arise. We find that when the trader is price taker, the producer can always compensate the loss in expected production profit generated by an increase of volatility by a gain in the derivative position by driving the price at maturity to a suitable level. Finally, in case the trader is active, the model takes the form of a nonzero sum linear quadratic stochastic differential game and we find that when the production rate is already at its optimal stationary level, there is an amount of derivative position that makes both players better off when entering the game.


Towards Generalizable Surgical Activity Recognition Using Spatial Temporal Graph Convolutional Networks. Modeling and recognition of surgical activities poses an interesting research problem. Although a number of recent works studied automatic recognition of surgical activities, generalizability of these works across different tasks and different datasets remains a challenge. We introduce a modality that is robust to scene variation, and that is able to infer part information such as orientational and relative spatial relationships. The proposed modality is based on spatial temporal graph representations of surgical tools in videos, for surgical activity recognition. To explore its effectiveness, we model and recognize surgical gestures with the proposed modality. We construct spatial graphs connecting the joint pose estimations of surgical tools. Then, we connect each joint to the corresponding joint in the consecutive frames forming inter frame edges representing the trajectory of the joint over time. We then learn hierarchical spatial temporal graph representations using Spatial Temporal Graph Convolutional Networks (ST GCN). Our experiments show that learned spatial temporal graph representations perform well in surgical gesture recognition even when used individually. We experiment with the Suturing task of the JIGSAWS dataset where the chance baseline for gesture recognition is 10 . Our results demonstrate 68 average accuracy which suggests a significant improvement. Learned hierarchical spatial temporal graph representations can be used either individually, in cascades or as a complementary modality in surgical activity recognition, therefore provide a benchmark for future studies. To our knowledge, our paper is the first to use spatial temporal graph representations of surgical tools, and pose based skeleton representations in general, for surgical activity recognition.


Frontoparietal Connectivity Neurofeedback Training for Promotion of Working Memory An fNIRS Study in Healthy Male Participants. Neurofeedback cognitive training is a promising tool used to promote cognitive functions effectively and efficiently. In this study, we investigated a novel functional near infrared spectroscopy (fNIRS) based frontoparietal functional connectivity (FC) neurofeedback training paradigm related to working memory, involving healthy adults. Compared with conventional cognitive training studies, we chose the frontoparietal network, a key brain region for cognitive function modulation, as neurofeedback, yielding a strong targeting effect. In the experiment, 10 participants (test group) received three cognitive training sessions of 15 min using fNIRS based frontoparietal FC as neurofeedback, and another 10 participants served as the control group. Frontoparietal FC was significantly increased in the test group (p D 0.03), and the cognitive functions (memory and attention) were significantly promoted compared with the control group (accuracy of 3 back test p D 0.0005, reaction time of 3 back test p D 0.0009). After additional validations on long term training effect and on different patient populations, the proposed method exhibited considerable potential to be developed as a fast, effective, and widespread training approach for cognitive function enhancement.


Efficient Three party Computation An Information theoretic Approach from Cut and Choose. As far as we know, the literature on secure computation from cut and choose has focused on achieving computational security against malicious adversaries. It is unclear whether the idea of cut and choose can be adapted to secure computation with information theoretic security. In this work we explore the possibility of using cut and choose in information theoretic setting for secure three party computation (3PC). Previous work on 3PC has mainly focus on the semi honest case, and is motivated by the observation that real word deployments of multi party computation (MPC) seem to involve few parties. We propose a new protocol for information theoretically secure 3PC tolerating one malicious party with cheating probability 2 s using s runs of circuit computation in the cut and choose paradigm. The computational cost of our protocol is essentially only a small constant worse than that of state of the art 3PC protocols against a semi honest corruption, while its communication round is greatly reduced compared to other maliciously secure 3PC protocols in information theoretic setting.


Training Compact Models for Low Resource Entity Tagging using Pre trained Language Models. Training models on low resource named entity recognition tasks has been shown to be a challenge, especially in industrial applications where deploying updated models is a continuous effort and crucial for business operations. In such cases there is often an abundance of unlabeled data, while labeled data is scarce or unavailable. Pre trained language models trained to extract contextual features from text were shown to improve many natural language processing (NLP) tasks, including scarcely labeled tasks, by leveraging transfer learning. However, such models impose a heavy memory and computational burden, making it a challenge to train and deploy such models for inference use. In this work in progress we combined the effectiveness of transfer learning provided by pre trained masked language models with a semi supervised approach to train a fast and compact model using labeled and unlabeled examples. Preliminary evaluations show that the compact models can achieve competitive accuracy with 36x compression rate when compared with a state of the art pre trained language model, and run significantly faster in inference, allowing deployment of such models in production environments or on edge devices.


A Human Centered Data Driven Planner Actor Critic Architecture via Logic Programming. Recent successes of Reinforcement Learning (RL) allow an agent to learn policies that surpass human experts but suffers from being time hungry and data hungry. By contrast, human learning is significantly faster because prior and general knowledge and multiple information resources are utilized. In this paper, we propose a Planner Actor Critic architecture for huMAN centered planning and learning (PACMAN), where an agent uses its prior, high level, deterministic symbolic knowledge to plan for goal directed actions, and also integrates the Actor Critic algorithm of RL to fine tune its behavior towards both environmental rewards and human feedback. This work is the first unified framework where knowledge based planning, RL, and human teaching jointly contribute to the policy learning of an agent. Our experiments demonstrate that PACMAN leads to a significant jump start at the early stage of learning, converges rapidly and with small variance, and is robust to inconsistent, infrequent, and misleading feedback.


Ask to Learn A Study on Curiosity driven Question Generation. We propose a novel text generation task, namely Curiosity driven Question Generation. We start from the observation that the Question Generation task has traditionally been considered as the dual problem of Question Answering, hence tackling the problem of generating a question given the text that contains its answer. Such questions can be used to evaluate machine reading comprehension. However, in real life, and especially in conversational settings, humans tend to ask questions with the goal of enriching their knowledge and or clarifying aspects of previously gathered information. We refer to these inquisitive questions as Curiosity driven these questions are generated with the goal of obtaining new information (the answer) which is not present in the input text. In this work, we experiment on this new task using a conversational Question Answering (QA) dataset further, since the majority of QA dataset are not built in a conversational manner, we describe a methodology to derive data for this novel task from non conversational QA data. We investigate several automated metrics to measure the different properties of Curious Questions, and experiment different approaches on the Curiosity driven Question Generation task, including model pre training and reinforcement learning. Finally, we report a qualitative evaluation of the generated outputs.


Binding of Endpoints to Identifiers by On Chain Proofs. In many applications, identity management (IdM) is used to associate a subject public key with an endpoint at which the subject can be contacted (telephone number, email, etc.). In decentralized applications based on distributed ledger technologies (DLTes), it is desirable for the IdM to be decentralized as well. Currently, endpoints are either verified by who needs it, which is impractical in DLT based applications, or by a centralized authority, which contrasts with the spirit of DLTes. In this paper, we show two DLT based protocols to prove the association between a subject and an endpoint in a decentralized manner, contributing in filling the gap of the current IdM approaches with respect to decentralization. Our protocols are compatible with a wide variety of endpoints. We analyze the security of our protocols and evaluate their performance and cost against the common approaches.


Equivariant discretizations of diffusions and harmonic functions of bounded growth. For covering spaces and properly discontinuous actions with compatible diffusion operators, we discuss Lyons Sullivan discretizations of the associated diffusions and harmonic functions of bounded growth.


Towards a Passive BCI to Induce Lucid Dream. Lucid dreaming (LD) is a phenomenon during which the person is aware that he she dreaming and is able to control the dream content. Studies have shown that only 20 of people can experience lucid dreams on a regular basis. However, LD frequency can be increased through induction techniques. External stimulation technique relies on the ability to integrate external information into the dream content. The aim is to remind the sleeper that she he is dreaming. If this type of protocol is not fully efficient, it demonstrates how sensorial stimuli can be easily incorporated into people's dreams. The objective of our project was to replicate this induction technique using material less expensive and more portable. This material could simplify experimental procedures. Participants could bring the material home, then have a more ecological setting. First, we used the OpenBCI Cyton, a low cost EEG signal acquisition board in order to record and manually live score sleep. Then, we designed a mask containing two LEDs, connected to a microcontroller to flash visual stimulation during sleep. We asked two volunteers to sleep for 2 hours in a dedicated room. One of the participants declared having a dream during which the blue lights diffused by the mask were embedded into the dream environment. The other participant woke up during the visual stimulation. These results are congruent with previous studies. This work marked the first step of a larger project. Our ongoing research includes the use of an online sleep stage scoring tool and the possibility to automatically send stimuli according to the sleep stage. We will also investigate other types of stimulus induction in the future such as vibro tactile stimulation that showed great potentials.


C algebras of self similar actions of groupoids on higher rank graphs and their equilibrium states. We introduce the notion of a self similar action of a groupoid G on a finite higher rank graph. To these actions we associate a compactly aligned product system of Hilbert bimodules, and we show that the corresponding Nica Toeplitz and Cuntz Pimsner algebras are universal for generators and relations. We consider natural actions of the real numbers on both algebras and study the KMS states of the associated dynamics. For large inverse temperatures, we describe the simplex of KMS states on the Nica Toeplitz algebra in terms of traces on the full C algebra of G. To study the KMS structure of the Cuntz Pimsner algebra, we restrict to strongly connected finite higher rank graphs and a preferred dynamics. We generalise the G periodicity group of Li and Yang, which is built to encode the periodicity of the underlying graph in the presence of the action of G. We prove that the KMS states of the Cuntz Pimsner algebra are parametrised by states on the C algebra of the G periodicity group, and we show that if the graph is G aperiodic and the action satisfies a finite state condition, then there is at most one KMS state on the Cuntz Pimsner algebra. We illustrate our results by introducing the notion of a coloured graph automaton, which we use to construct examples of self similar actions. We compute the unique KMS states of the Cuntz Pimsner algebra for some concrete examples.


Sequential Graph Convolutional Network for Active Learning. We propose a novel pool based Active Learning framework constructed on a sequential Graph Convolution Network (GCN). Each image's feature from a pool of data represents a node in the graph and the edges encode their similarities. With a small number of randomly sampled images as seed labelled examples, we learn the parameters of the graph to distinguish labelled vs unlabelled nodes by minimising the binary cross entropy loss. GCN performs message passing operations between the nodes, and hence, induces similar representations of the strongly associated nodes. We exploit these characteristics of GCN to select the unlabelled examples which are sufficiently different from labelled ones. To this end, we utilise the graph node embeddings and their confidence scores and adapt sampling techniques such as CoreSet and uncertainty based methods to query the nodes. We flip the label of newly queried nodes from unlabelled to labelled, re train the learner to optimise the downstream task and the graph to minimise its modified objective. We continue this process within a fixed budget. We evaluate our method on 6 different benchmarks 4 real image classification, 1 depth based hand pose estimation and 1 synthetic RGB image classification datasets. Our method outperforms several competitive baselines such as VAAL, Learning Loss, CoreSet and attains the new state of the art performance on multiple applications The implementations can be found here https github.com razvancaramalau Sequential GCN for Active Learning


Non reversible Metastable Diffusions with Gibbs Invariant Measure II Markov Chain Convergence. This article considers a class of metastable non reversible diffusion processes whose invariant measure is a Gibbs measure associated with a Morse potential. In a companion paper 30 , we proved the Eyring Kramers formula for the corresponding class of metastable diffusion processes. In this article, we further develop this result by proving that a suitably time rescaled metastable diffusion process converges to a Markov chain on the deepest metastable valleys. This article is also an extension of 43 , which considered the same problem for metastable reversible diffusion processes. Our proof is based on the recently developed partial differential equation (PDE) approach to metastability. To the best of our knowledge, this study is the first to propose a robust methodology for applying the PDE approach to non reversible models.


Goal Conditioned Variational Autoencoder Trajectory Primitives with Continuous and Discrete Latent Codes. Imitation learning is an intuitive approach for teaching motion to robotic systems. Although previous studies have proposed various methods to model demonstrated movement primitives, one of the limitations of existing methods is that the shape of the trajectories are encoded in high dimensional space. The high dimensionality of the trajectory representation can be a bottleneck in the subsequent process such as planning a sequence of primitive motions. We address this problem by learning the latent space of the robot trajectory. If the latent variable of the trajectories can be learned, it can be used to tune the trajectory in an intuitive manner even when the user is not an expert. We propose a framework for modeling demonstrated trajectories with a neural network that learns the low dimensional latent space. Our neural network structure is built on the variational autoencoder (VAE) with discrete and continuous latent variables. We extend the structure of the existing VAE to obtain the decoder that is conditioned on the goal position of the trajectory for generalization to different goal positions. Although the inference performed by VAE is not accurate, the positioning error at the generalized goal position can be reduced to less than 1 mm by incorporating the projection onto the solution space. To cope with requirement of the massive training data, we use a trajectory augmentation technique inspired by the data augmentation commonly used in the computer vision community. In the proposed framework, the latent variables that encodes the multiple types of trajectories are learned in an unsupervised manner, although existing methods usually require label information to model diverse behaviors. The learned decoder can be used as a motion planner in which the user can specify the goal position and the trajectory types by setting the latent variables.


MOFA Modular Factorial Design for Hyperparameter Optimization. This paper presents a novel and lightweight hyperparameter optimization (HPO) method, MOdular FActorial Design (MOFA). MOFA pursues several rounds of HPO, where each round alternates between exploration of hyperparameter space by factorial design and exploitation of evaluation results by factorial analysis. Each round first explores the configuration space by constructing a low discrepancy set of hyperparameters that cover this space well while de correlating hyperparameters, and then exploits evaluation results through factorial analysis that determines which hyperparameters should be further explored and which should become fixed in the next round. We prove that the inference of MOFA achieves higher confidence than other sampling schemes. Each individual round is highly parallelizable and hence offers major improvements of efficiency compared to model based methods. Empirical results show that MOFA achieves better effectiveness and efficiency compared with state of the art methods.


Classifying Suspicious Content in Tor Darknet. One of the tasks of law enforcement agencies is to find evidence of criminal activity in the Darknet. However, visiting thousands of domains to locate visual information containing illegal acts manually requires a considerable amount of time and resources. Furthermore, the background of the images can pose a challenge when performing classification. To solve this problem, in this paper, we explore the automatic classification Tor Darknet images using Semantic Attention Keypoint Filtering, a strategy that filters non significant features at a pixel level that do not belong to the object of interest, by combining saliency maps with Bag of Visual Words (BoVW). We evaluated SAKF on a custom Tor image dataset against CNN features MobileNet v1 and Resnet50, and BoVW using dense SIFT descriptors, achieving a result of 87.98 accuracy and outperforming all other approaches.


Realization, Internal Stability, and Controller Synthesis. We have witnessed the emergence of several controller parameterizations and the corresponding synthesis methods, including Youla, system level, input output, and many other new proposals. Meanwhile, under the same synthesis method, there are multiple realizations to adopt. Different synthesis methods realizations target different plants scenarios. Except for some case by case studies, we don't currently have a unified framework to understand their relationships. To address the issue, we show that existing controller synthesis methods and realization proposals are all special cases of a simple lemma, the realization stability lemma. The lemma leads to easier equivalence proofs among existing methods and enables the formulation of a general controller synthesis problem, which provides a unified foundation for controller synthesis and realization derivation.


Private Queries on Public Certificate Transparency Data. Despite increasing advancements in today's information exchange infrastructure, the preservation of user data and privacy still remains a problem. Both insecure baselines and secure solutions leak user data. For example, Certificate Transparency (CT) promises significant security improvements to existing Public Key Infrastructure solutions that up to now have solely relied on the Certificate Authority hierarchy. CT provides a robust auditing layer and transparency solution to quickly detect such compromises, but introduces the requirement that client browsers interact with third party servers when validating a site certificate. In the existing CT system, these requests leak information about each user's browsing habits to the hosting server. It is not a stretch to think that this valuable data could be collected and exploited, as corporations and governments have plenty of financial and political incentive to do so. In this project, we seek to address this problem by using an oblivious file sharing system with strong anonymity properties, to provide a more scalable, performant solution to privacy preserving queries.


ATHENA a pre university study programme at the university of Geneva. Athena (named after the ancient Greek goddess of wisdom) is a pre university study programme for mathematics and physics organised by the Faculty of Science at the University of Geneva. It targets pupils enrolled in the final or penultimate year of Secondary II (high school), giving them an opportunity to explore and discover university level studies in mathematics and physics. The programme aims to enhance pupils interest for the physical and mathematical sciences by introducing them to new topics, all while giving them a taste for student life. It also seeks to promote scientific careers to young pupils, especially to young women, as well as improving the transition between Secondary II and university


Image amplification in a self imaging degenerate optical cavity. Image amplifying optical cavities offer an intriguing platform for nonlinear optical processing of two dimensional signals, with potential applications in optical information processing and optically implemented artificial neural networks. Here, we analyze the performance of a self imaging degenerate cavity via numerical simulations and show the existence of a cavity size dependent minimum spread in the transverse mode resonances. This non degeneracy, in turn, leads to an inherent trade off between the amplification and the fidelity of the intracavity image as the cavity finesse changes. Our results point to a promising path to nonlinear image processing in a low power, small form factor optical cavity.


Linking Machine Learning with Multiscale Numerics Data Driven Discovery of Homogenized Equations. The data driven discovery of partial differential equations (PDEs) consistent with spatiotemporal data is experiencing a rebirth in machine learning research. Training deep neural networks to learn such data driven partial differential operators requires extensive spatiotemporal data. For learning coarse scale PDEs from computational fine scale simulation data, the training data collection process can be prohibitively expensive. We propose to transformatively facilitate this training data collection process by linking machine learning (here, neural networks) with modern multiscale scientific computation (here, equation free numerics). These equation free techniques operate over sparse collections of small, appropriately coupled, space time subdomains ("patches"), parsimoniously producing the required macro scale training data. Our illustrative example involves the discovery of effective homogenized equations in one and two dimensions, for problems with fine scale material property variations. The approach holds promise towards making the discovery of accurate, macro scale effective materials PDE models possible by efficiently summarizing the physics embodied in "the best" fine scale simulation models available.


Learning to Adapt for Stereo. Real world applications of stereo depth estimation require models that are robust to dynamic variations in the environment. Even though deep learning based stereo methods are successful, they often fail to generalize to unseen variations in the environment, making them less suitable for practical applications such as autonomous driving. In this work, we introduce a "learning to adapt" framework that enables deep stereo methods to continuously adapt to new target domains in an unsupervised manner. Specifically, our approach incorporates the adaptation procedure into the learning objective to obtain a base set of parameters that are better suited for unsupervised online adaptation. To further improve the quality of the adaptation, we learn a confidence measure that effectively masks the errors introduced during the unsupervised adaptation. We evaluate our method on synthetic and real world stereo datasets and our experiments evidence that learning to adapt is, indeed beneficial for online adaptation on vastly different domains.


AgingMapGAN (AMGAN) High Resolution Controllable Face Aging with Spatially Aware Conditional GANs. Existing approaches and datasets for face aging produce results skewed towards the mean, with individual variations and expression wrinkles often invisible or overlooked in favor of global patterns such as the fattening of the face. Moreover, they offer little to no control over the way the faces are aged and can difficultly be scaled to large images, thus preventing their usage in many real world applications. To address these limitations, we present an approach to change the appearance of a high resolution image using ethnicity specific aging information and weak spatial supervision to guide the aging process. We demonstrate the advantage of our proposed method in terms of quality, control, and how it can be used on high definition images while limiting the computational overhead.


Persistent Homotopy Groups of Metric Spaces. We study notions of persistent homotopy groups of compact metric spaces together with their stability properties in the Gromov Hausdorff sense. We pay particular attention to the case of fundamental groups for which we obtain a more precise description.


Demand Adaptive Route Planning and Scheduling for Urban Hub based High Capacity Mobility on Demand Services. In this study, we propose a three stage framework for the planning and scheduling of high capacity mobility on demand services (e.g., micro transit and flexible transit) at urban activity hubs. The proposed framework consists of (1) the route generation step to and from the activity hub with connectivity to existing transit systems, and (2) the robust route scheduling step which determines the vehicle assignment and route headway under demand uncertainty. Efficient exact and heuristic algorithms are developed for identifying the minimum number of routes that maximize passenger coverage, and a matching scheme is proposed to combine routes to and from the hub into roundtrips optimally. With the generated routes, the robust route scheduling problem is formulated as a two stage robust optimization problem. Model reformulations are introduced to solve the robust optimization problem into the global optimum. In this regard, the proposed framework presents both algorithmic and analytic solutions for developing the hub based transit services in response to the varying passenger demand over a short time period. To validate the effectiveness of the proposed framework, comprehensive numerical experiments are conducted for planning the HHMoD services at the JFK airport in New York City (NYC). The results show the superior performance of the proposed route generation algorithm to maximize the citywide coverage more efficiently. The results also demonstrate the cost effectiveness of the robust route schedules under normal demand conditions and against worst case oriented realizations of passenger demand.


Using a small number of devices to experimentally estimate the packet delivery ratio on a lorawan network with a large number of end devices. In this paper, the proposed methodology for conducting experiments on a small number of devices for evaluating systems with a large number of devices. A software package for assessing the performance of LPWAN (Long Range Wide Area Networks, LoRaWAN) networks is presented. An example of the operation of this software system as applied to the LoRaWAN network for estimating the probability of message delivery from a number of devices to a base station when implementing this technique is shown. This technique can be used to evaluate the performance of other LPWAN networks.


Ramsey theory for layered semigroups. We further develop the theory of layered semigroups, as introduced by Farah, Hindman and McLeod, providing a general framework to prove Ramsey statements about such a semigroup S . By nonstandard and topological arguments, we show Ramsey statements on S are implied by the existence of "coherent" sequences in S . This framework allows us to formalise and prove many results in Ramsey theory, including Gowers' mathrm FIN k theorem, the Graham Rothschild theorem, and Hindman's finite sums theorem. Other highlights include a simple nonstandard proof of the Graham Rothschild theorem for strong variable words a nonstandard proof of Bergelson Blass Hindman's partition theorem for located variable words, using a result of Carlson, Hindman and Strauss and a common generalisation of the latter result and Gowers' theorem, which can be proven in our framework.


A simple metamaterial absorber associated with Fano like resonance. A simple metamaterial absorber suitable for fabrication over large areas associated with a Fano like resonance is proposed. The proposed designed of the metamaterial absorber consists of photoresist disk arrays on a silicon substrate followed by the deposition of a tri layer of Au, ZnS and Au on the top of the structure. Due to the tri layer, there is a formation of a cavity between the substrate and gold layer on the top of photoresist disk and a waveguide in the ZnS layer in between the gold layers on the substrate and the ZnS layer itself. The Fano like resonance arises due to the interference of the cavity mode and the guided mode resonance as well as the Woods anomaly. The cavity mode resonance works as continuum mode whereas the guided mode resonance and Woods anomaly work as discrete modes. The spectral position of the resonance can be tuned by just controlling the thickness of the tri layer instead of the structural size and shape modification of the micro and nano structures as usually done in conventional metamaterial absorbers. This design can be easily scaled for fabrication over large areas as it separates the structuring and deposition processes and makes them sequential thereby avoiding expensive and complex lift off or etching processes which are usually required for conventional metamaterial processing.


Rational 2 functions are abelian. We show that the coefficients of rational 2 functions are contained in an abelian number field. More precisely, we show that the poles of such functions are poles of order one and given by roots of unity and rational residue.


Specification Driven Predictive Business Process Monitoring. Predictive analysis in business process monitoring aims at forecasting the future information of a running business process. The prediction is typically made based on the model extracted from historical process execution logs (event logs). In practice, different business domains might require different kinds of predictions. Hence, it is important to have a means for properly specifying the desired prediction tasks, and a mechanism to deal with these various prediction tasks. Although there have been many studies in this area, they mostly focus on a specific prediction task. This work introduces a language for specifying the desired prediction tasks, and this language allows us to express various kinds of prediction tasks. This work also presents a mechanism for automatically creating the corresponding prediction model based on the given specification. Differently from previous studies, instead of focusing on a particular prediction task, we present an approach to deal with various prediction tasks based on the given specification of the desired prediction tasks. We also provide an implementation of the approach which is used to conduct experiments using real life event logs.


How are Project Specific Forums Utilized? A Study of Participation, Content, and Sentiment in the Eclipse Ecosystem. Although many software development projects have moved their developer discussion forums to generic platforms such as Stack Overflow, Eclipse has been steadfast in hosting their self supported community forums. While recent studies show forums share similarities to generic communication channels, it is unknown how project specific forums are utilized. In this paper, we analyze 832,058 forum threads and their linkages to four systems with 2,170 connected contributors to understand the participation, content and sentiment. Results show that Seniors are the most active participants to respond bug and non bug related threads in the forums (i.e., 66.1 and 45.5 ), and sentiment among developers are inconsistent while knowledge sharing within Eclipse. We recommend the users to identify appropriate topics and ask in a positive procedural way when joining forums. For developers, preparing project specific forums could be an option to bridge the communication between members. Irrespective of the popularity of Stack Overflow, we argue the benefits of using project specific forum initiatives, such as GitHub Discussions, are needed to cultivate a community and its ecosystem.


Hidden State Guidance Improving Image Captioning using An Image Conditioned Autoencoder. Most RNN based image captioning models receive supervision on the output words to mimic human captions. Therefore, the hidden states can only receive noisy gradient signals via layers of back propagation through time, leading to less accurate generated captions. Consequently, we propose a novel framework, Hidden State Guidance (HSG), that matches the hidden states in the caption decoder to those in a teacher decoder trained on an easier task of autoencoding the captions conditioned on the image. During training with the REINFORCE algorithm, the conventional rewards are sentence based evaluation metrics equally distributed to each generated word, no matter their relevance. HSG provides a word level reward that helps the model learn better hidden representations. Experimental results demonstrate that HSG clearly outperforms various state of the art caption decoders using either raw images or detected objects as inputs.


iCub Learning Emotion Expressions using Human Reward. The purpose of the present study is to learn emotion expression representations for artificial agents using reward shaping mechanisms. The approach takes inspiration from the TAMER framework for training a Multilayer Perceptron (MLP) to learn to express different emotions on the iCub robot in a human robot interaction scenario. The robot uses a combination of a Convolutional Neural Network (CNN) and a Self Organising Map (SOM) to recognise an emotion and then learns to express the same using the MLP. The objective is to teach a robot to respond adequately to the user's perception of emotions and learn how to express different emotions.


Discrimination through optimization How Facebook's ad delivery can lead to skewed outcomes. The enormous financial success of online advertising platforms is partially due to the precise targeting features they offer. Although researchers and journalists have found many ways that advertisers can target or exclude particular groups of users seeing their ads, comparatively little attention has been paid to the implications of the platform's ad delivery process, comprised of the platform's choices about which users see which ads. It has been hypothesized that this process can "skew" ad delivery in ways that the advertisers do not intend, making some users less likely than others to see particular ads based on their demographic characteristics. In this paper, we demonstrate that such skewed delivery occurs on Facebook, due to market and financial optimization effects as well as the platform's own predictions about the "relevance" of ads to different groups of users. We find that both the advertiser's budget and the content of the ad each significantly contribute to the skew of Facebook's ad delivery. Critically, we observe significant skew in delivery along gender and racial lines for "real" ads for employment and housing opportunities despite neutral targeting parameters. Our results demonstrate previously unknown mechanisms that can lead to potentially discriminatory ad delivery, even when advertisers set their targeting parameters to be highly inclusive. This underscores the need for policymakers and platforms to carefully consider the role of the ad delivery optimization run by ad platforms themselves and not just the targeting choices of advertisers in preventing discrimination in digital advertising.


Tail risk protection Machine Learning meets modern Econometrics. Tail risk protection is in the focus of the financial industry and requires solid mathematical and statistical tools, especially when a trading strategy is derived. Recent hype driven by machine learning (ML) mechanisms has raised the necessity to display and understand the functionality of ML tools. In this paper, we present a dynamic tail risk protection strategy that targets a maximum predefined level of risk measured by Value At Risk while controlling for participation in bull market regimes. We propose different weak classifiers, parametric and non parametric, that estimate the exceedance probability of the risk level from which we derive trading signals in order to hedge tail events. We then compare the different approaches both with statistical and trading strategy performance, finally we propose an ensemble classifier that produces a meta tail risk protection strategy improving both generalization and trading performance.