Semantic Source Code Models Using Identifier Embeddings. The emergence of online open source repositories in the recent years has led to an explosion in the volume of openly available source code, coupled with metadata that relate to a variety of software development activities. As an effect, in line with recent advances in machine learning research, software maintenance activities are switching from symbolic formal methods to data driven methods. In this context, the rich semantics hidden in source code identifiers provide opportunities for building semantic representations of code which can assist tasks of code search and reuse. To this end, we deliver in the form of pretrained vector space models, distributed code representations for six popular programming languages, namely, Java, Python, PHP, C, C , and C . The models are produced using fastText, a state of the art library for learning word representations. Each model is trained on data from a single programming language the code mined for producing all models amounts to over 13.000 repositories. We indicate dissimilarities between natural language and source code, as well as variations in coding conventions in between the different programming languages we processed. We describe how these heterogeneities guided the data preprocessing decisions we took and the selection of the training parameters in the released models. Finally, we propose potential applications of the models and discuss limitations of the models.


Faster Least Squares Optimization. We investigate iterative methods with randomized preconditioners for solving overdetermined least squares problems, where the preconditioners are based on a random embedding of the data matrix. We consider two distinct approaches the sketch is either computed once (fixed preconditioner), or, the random projection is refreshed at each iteration, i.e., sampled independently of previous ones (varying preconditioners). Although fixed sketching based preconditioners have received considerable attention in the recent literature, little is known about the performance of refreshed sketches. For a fixed sketch, we characterize the optimal iterative method, that is, the preconditioned conjugate gradient as well as its rate of convergence in terms of the subspace embedding properties of the random embedding. For refreshed sketches, we provide a closed form formula for the expected error of the iterative Hessian sketch (IHS), a.k.a. preconditioned steepest descent. In contrast to the guarantees and analysis for fixed preconditioners based on subspace embedding properties, our formula is exact and it involves the expected inverse moments of the random projection. Our main technical contribution is to show that this convergence rate is, surprisingly, unimprovable with heavy ball momentum. Additionally, we construct the locally optimal first order method whose convergence rate is bounded by that of the IHS. Based on these theoretical and numerical investigations, we do not observe that the additional randomness of refreshed sketches provides a clear advantage over a fixed preconditioner. Therefore, we prescribe PCG as the method of choice along with an optimized sketch size according to our analysis. Our prescribed sketch size yields state of the art computational complexity for solving highly overdetermined linear systems. Lastly, we illustrate the numerical benefits of our algorithms.


AKHCRNet Bengali Handwritten Character Recognition Using Deep Learning. I propose a state of the art deep neural architectural solution for handwritten character recognition for Bengali alphabets, compound characters as well as numerical digits that achieves state of the art accuracy 96.8 in just 11 epochs. Similar work has been done before by Chatterjee, Swagato, et al. but they achieved 96.12 accuracy in about 47 epochs. The deep neural architecture used in that paper was fairly large considering the inclusion of the weights of the ResNet 50 model which is a 50 layer Residual Network. This proposed model achieves higher accuracy as compared to any previous work in a little number of epochs. ResNet50 is a good model trained on the ImageNet dataset, but I propose an HCR network that is trained from the scratch on Bengali characters without the "Ensemble Learning" that can outperform previous architectures.


Stabilizers, Measures and IP sets. The purpose of this simple note is to provide elementary model theoretic proofs to some existing results on sumset phenomena and IP sets, motivated by Hrushovski's work on the stabilizer theorem.


Mitigating Network Noise on Dragonfly Networks through Application Aware Routing. System noise can negatively impact the performance of HPC systems, and the interconnection network is one of the main factors contributing to this problem. To mitigate this effect, adaptive routing sends packets on non minimal paths if they are less congested. However, while this may mitigate interference caused by congestion, it also generates more traffic since packets traverse additional hops, causing in turn congestion on other applications and on the application itself. In this paper, we first describe how to estimate network noise. By following these guidelines, we show how noise can be reduced by using routing algorithms which select minimal paths with a higher probability. We exploit this knowledge to design an algorithm which changes the probability of selecting minimal paths according to the application characteristics. We validate our solution on microbenchmarks and real world applications on two systems relying on a Dragonfly interconnection network, showing noise reduction and performance improvement.


Map Z Exposing the Zcash Network in Times of Transition. Zcash is a privacy preserving cryptocurrency that provides anonymous monetary transactions. While Zcash's anonymity is part of a rigorous scientific discussion, information on the underlying peer to peer network are missing. In this paper, we provide the first long term measurement study of the Zcash network to capture key metrics such as the network size and node distribution as well as deeper insights on the centralization of the network. Furthermore, we present an inference method based on a timing analysis of block arrivals that we use to determine interconnections of nodes. We evaluate and verify our method through simulations and real world experiments, yielding a precision of 50 with a recall of 82 in the real world scenario. By adjusting the parameters, the topology inference model is adaptable to the conditions found in other cryptocurrencies and therefore also contributes to the broader discussion of topology hiding in general.


Few Shot Knowledge Graph Completion. Knowledge graphs (KGs) serve as useful resources for various natural language processing applications. Previous KG completion approaches require a large number of training instances (i.e., head tail entity pairs) for every relation. The real case is that for most of the relations, very few entity pairs are available. Existing work of one shot learning limits method generalizability for few shot scenarios and does not fully use the supervisory information however, few shot KG completion has not been well studied yet. In this work, we propose a novel few shot relation learning model (FSRL) that aims at discovering facts of new relations with few shot references. FSRL can effectively capture knowledge from heterogeneous graph structure, aggregate representations of few shot references, and match similar entity pairs of reference set for every relation. Extensive experiments on two public datasets demonstrate that FSRL outperforms the state of the art.


Noncommutative Frames Revisited. In this note, we correct an error in arXiv 1702.04949 by adding an additional assumption of join completeness. We demonstrate with examples why this assumption is necessary, and discuss how join completeness relates to other properties of a skew lattice.


Macroscopic descriptions of follower leader systems. The fundamental derivation of macroscopic model equations to describe swarms based on microscopic movement laws and mathematical analyses into their self organisation capabilities remains a challenge from the perspective of both modelling and analysis. In this paper we clarify relevant continuous macroscopic model equations that describe follower leader interactions for a swarm where these two populations are fixed. We study the behaviour of the swarm over long and short time scales to shed light on the number of leaders needed to initiate swarm movement, according to the homogeneous or inhomogeneous nature of the interaction (alignment) kernel. The results indicate the crucial role played by the interaction kernel to model transient behaviour.


NAS DIP Learning Deep Image Prior with Neural Architecture Search. Recent work has shown that the structure of deep convolutional neural networks can be used as a structured image prior for solving various inverse image restoration tasks. Instead of using hand designed architectures, we propose to search for neural architectures that capture stronger image priors. Building upon a generic U Net architecture, our core contribution lies in designing new search spaces for (1) an upsampling cell and (2) a pattern of cross scale residual connections. We search for an improved network by leveraging an existing neural architecture search algorithm (using reinforcement learning with a recurrent neural network controller). We validate the effectiveness of our method via a wide variety of applications, including image restoration, dehazing, image to image translation, and matrix factorization. Extensive experimental results show that our algorithm performs favorably against state of the art learning free approaches and reaches competitive performance with existing learning based methods in some cases.


LiDARTag A Real Time Fiducial Tag System for Point Clouds. Image based fiducial markers are useful in problems such as object tracking in cluttered or textureless environments, camera (and multi sensor) calibration tasks, and vision based simultaneous localization and mapping (SLAM). The state of the art fiducial marker detection algorithms rely on the consistency of the ambient lighting. This paper introduces LiDARTag, a novel fiducial tag design and detection algorithm suitable for light detection and ranging (LiDAR) point clouds. The proposed method runs in real time and can process data at 100 Hz, which is faster than the currently available LiDAR sensor frequencies. Because of the LiDAR sensors' nature, rapidly changing ambient lighting will not affect the detection of a LiDARTag hence, the proposed fiducial marker can operate in a completely dark environment. In addition, the LiDARTag nicely complements and is compatible with existing visual fiducial markers, such as AprilTags, allowing for efficient multi sensor fusion and calibration tasks. We further propose a concept of minimizing a fitting error between a point cloud and the marker's template to estimate the marker's pose. The proposed method achieves millimeter error in translation and a few degrees in rotation. Due to LiDAR returns' sparsity, the point cloud is lifted to a continuous function in a reproducing kernel Hilbert space where the inner product can be used to determine a marker's ID. The experimental results, verified by a motion capture system, confirm that the proposed method can reliably provide a tag's pose and unique ID code. The rejection of false positives is validated on the Google Cartographer indoor dataset and the Honda H3D outdoor dataset. All implementations are coded in C and are available at https github.com UMich BipedLab LiDARTag.


On residual connectedness in chiral geometries. We show that a chiral coset geometry constructed from a C group necessarily satisfies residual connectedness and is therefore a hypertope.


The kappa Strongly Proper Forcing Axiom. We study methods with which we can obtain the consistency of forcing axioms, and particularly higher forcing axioms. We first prove that the consistency of a supercompact cardinal theta kappa implies the consistency of a forcing axiom for kappa strongly proper forcing notions which are also kappa lattice, and then eliminate the need for the supercompact cardinal. The proof goes through a natural reflection property for kappa strongly proper forcings and through the fact that every kappa sequence of ordinals added by a kappa lattice and kappa strongly proper forcing is in a kappa Cohen extension.


Robust Multi Agent Task Assignment in Failure Prone and Adversarial Environments. The problem of assigning agents to tasks is a central computational challenge in many multi agent autonomous systems. However, in the real world, agents are not always perfect and may fail due to a number of reasons. A motivating application is where the agents are robots that operate in the physical world and are susceptible to failures. This paper studies the problem of Robust Multi Agent Task Assignment, which seeks to find an assignment that maximizes overall system performance while accounting for potential failures of the agents. We investigate both, stochastic and adversarial failures under this framework. For both cases, we present efficient algorithms that yield optimal or near optimal results.


On the Language Neutrality of Pre trained Multilingual Representations. Multilingual contextual embeddings, such as multilingual BERT and XLM RoBERTa, have proved useful for many multi lingual tasks. Previous work probed the cross linguality of the representations indirectly using zero shot transfer learning on morphological and syntactic tasks. We instead investigate the language neutrality of multilingual contextual embeddings directly and with respect to lexical semantics. Our results show that contextual embeddings are more language neutral and, in general, more informative than aligned static word type embeddings, which are explicitly trained for language neutrality. Contextual embeddings are still only moderately language neutral by default, so we propose two simple methods for achieving stronger language neutrality first, by unsupervised centering of the representation for each language and second, by fitting an explicit projection on small parallel data. Besides, we show how to reach state of the art accuracy on language identification and match the performance of statistical methods for word alignment of parallel sentences without using parallel data.


Faster Unsupervised Semantic Inpainting A GAN Based Approach. In this paper, we propose to improve the inference speed and visual quality of contemporary baseline of Generative Adversarial Networks (GAN) based unsupervised semantic inpainting. This is made possible with better initialization of the core iterative optimization involved in the framework. To our best knowledge, this is also the first attempt of GAN based video inpainting with consideration to temporal cues. On single image inpainting, we achieve about 4.5 5 times speedup and 80 times on videos compared to baseline. Simultaneously, our method has better spatial and temporal reconstruction qualities as found on three image and one video dataset.


Enhancing self supervised monocular depth estimation with traditional visual odometry. Estimating depth from a single image represents an attractive alternative to more traditional approaches leveraging multiple cameras. In this field, deep learning yielded outstanding results at the cost of needing large amounts of data labeled with precise depth measurements for training. An issue softened by self supervised approaches leveraging monocular sequences or stereo pairs in place of expensive ground truth depth annotations. This paper enables to further improve monocular depth estimation by integrating into existing self supervised networks a geometrical prior. Specifically, we propose a sparsity invariant autoencoder able to process the output of conventional visual odometry algorithms working in synergy with depth from mono networks. Experimental results on the KITTI dataset show that by exploiting the geometrical prior, our proposal i) outperforms existing approaches in the literature and ii) couples well with both compact and complex depth from mono architectures, allowing for its deployment on high end GPUs as well as on embedded devices (e.g., NVIDIA Jetson TX2).


A Systematic Review of Natural Language Processing for Knowledge Management in Healthcare. Driven by the visions of Data Science, recent years have seen a paradigm shift in Natural Language Processing (NLP). NLP has set the milestone in text processing and proved to be the preferred choice for researchers in the healthcare domain. The objective of this paper is to identify the potential of NLP, especially, how NLP is used to support the knowledge management process in the healthcare domain, making data a critical and trusted component in improving the health outcomes. This paper provides a comprehensive survey of the state of the art NLP research with a particular focus on how knowledge is created, captured, shared, and applied in the healthcare domain. Our findings suggest, first, the techniques of NLP those supporting knowledge management extraction and knowledge capture processes in healthcare. Second, we propose a conceptual model for the knowledge extraction process through NLP. Finally, we discuss a set of issues, challenges, and proposed future research areas.


Telerobotic Operation of Intensive Care Unit Ventilators. Since the first reports of a novel coronavirus (SARS CoV 2) in December 2019, over 33 million people have been infected worldwide and approximately 1 million people worldwide have died from the disease caused by this virus, COVID 19. In the US alone, there have been approximately 7 million cases and over 200,000 deaths. This outbreak has placed an enormous strain on healthcare systems and workers. Severe cases require hospital care, and 8.5 of patients require mechanical ventilation in an intensive care unit (ICU). One major challenge is the necessity for clinical care personnel to don and doff cumbersome personal protective equipment (PPE) in order to enter an ICU unit to make simple adjustments to ventilator settings. Although future ventilators and other ICU equipment may be controllable remotely through computer networks, the enormous installed base of existing ventilators do not have this capability. This paper reports the development of a simple, low cost telerobotic system that permits adjustment of ventilator settings from outside the ICU. The system consists of a small Cartesian robot capable of operating a ventilator touch screen with camera vision control via a wirelessly connected tablet master device located outside the room. Engineering system tests demonstrated that the open loop mechanical repeatability of the device was 7.5 ,mm, and that the average positioning error of the robotic finger under visual servoing control was 5.94 ,mm. Successful usability tests in a simulated ICU environment were carried out and are reported. In addition to enabling a significant reduction in PPE consumption, the prototype system has been shown in a preliminary evaluation to significantly reduce the total time required for a respiratory therapist to perform typical setting adjustments on a commercial ventilator, including donning and doffing PPE, from 271 seconds to 109 seconds.


Higher signs for Coxeter groups. We define and study cocycles on a Coxeter group in each degree generalizing the sign function. When the Coxeter group is a Weyl group, we explain how the degree three cocycle arises naturally from geometry representation theory.


Succinct Population Protocols for Presburger Arithmetic. Angluin et al. proved that population protocols compute exactly the predicates definable in Presburger arithmetic (PA), the first order theory of addition. As part of this result, they presented a procedure that translates any formula varphi of quantifier free PA with remainder predicates (which has the same expressive power as full PA) into a population protocol with 2 O( text poly ( varphi )) states that computes varphi . More precisely, the number of states of the protocol is exponential in both the bit length of the largest coefficient in the formula, and the number of nodes of its syntax tree. In this paper, we prove that every formula varphi of quantifier free PA with remainder predicates is computable by a leaderless population protocol with O( text poly ( varphi )) states. Our proof is based on several new constructions, which may be of independent interest. Given a formula varphi of quantifier free PA with remainder predicates, a first construction produces a succinct protocol (with O( varphi 3) leaders) that computes varphi this completes the work initiated in STACS'18 , where we constructed such protocols for a fragment of PA. For large enough inputs, we can get rid of these leaders. If the input is not large enough, then it is small, and we design another construction producing a succinct protocol with one leader that computes varphi . Our last construction gets rid of this leader for small inputs.


Random generation with cycle type restrictions. We study random generation in the symmetric group when cycle type restrictions are imposed. Given pi, pi' in S n , we prove that pi and a random conjugate of pi' are likely to generate at least A n provided only that pi and pi' have not too many fixed points and not too many 2 cycles. As an application, we investigate the following question For which positive integers m should we expect two random elements of order m to generate A n ? Among other things, we give a positive answer for any m having any divisor d in the range 3 leq d leq o(n 1 2 ) .


On Graph Continued Fractions and the Heilmann Lieb Theorem. Inspired by Viennot's observation that matching polynomials are numerators of branched continued fractions we present a proof of the Heilmann Lieb Theorem.


A note on the bilinear fractional integral operator acting on Morrey spaces. The boundedness of the bilinear fractional integral operator is investigated. This bilinear fractional integral operator goes back to Kenig and Stein. This paper is oriented to the boundedness of this operator on products of Morrey spaces. Compared to the earlier work by He and Yan, the local integrability condition of the domain is expanded. The local integrability condition can be relaxed with the help of the averaging technique.


Kato's inequalities up to the boundary for a quasilinear elliptic operator. In a bounded smooth domain of Rn, we shall establish Kato's inequalities involving measures for p Laplace operator up to the boundary under suitable assumptions. Keywords Kato's inequality, p Laplace operator


PropTech for Proactive Pricing of Houses in Classified Advertisements in the Indian Real Estate Market. Property Technology (PropTech) is the next big thing that is going to disrupt the real estate market. Nowadays, we see applications of Machine Learning (ML) and Artificial Intelligence (AI) in almost all the domains but for a long time the real estate industry was quite slow in adopting data science and machine learning for problem solving and improving their processes. However, things are changing quite fast as we see a lot of adoption of AI and ML in the US and European real estate markets. But the Indian real estate market has to catch up a lot. This paper proposes a machine learning approach for solving the house price prediction problem in the classified advertisements. This study focuses on the Indian real estate market. We apply advanced machine learning algorithms such as Random forest, Gradient boosting and Artificial neural networks on a real world dataset and compare the performance of these methods. We find that the Random forest method is the best performer in terms of prediction accuracy.


Energy Efficient Resource Allocation in a Multi UAV Aided NOMA Network. This paper is concerned with the resource allocation in a multi unmanned aerial vehicle (UAV) aided network for providing enhanced mobile broadband (eMBB) services for user equipments. Different from most of the existing network resource allocation approaches, we investigate a joint non orthogonal user association, subchannel allocation and power control problem. The objective of the problem is to maximize the network energy efficiency under the constraints on user equipments' quality of service, UAVs' network capacity and power consumption. We formulate the energy efficiency maximization problem as a challenging mixed integer non convex programming problem. To alleviate this problem, we first decompose the original problem into two subproblems, namely, an integer non linear user association and subchannel allocation subproblem and a non convex power control subproblem. We then design a two stage approximation strategy to handle the non linearity of the user association and subchannel allocation subproblem and exploit a successive convex approximation approach to tackle the non convexity of the power control subproblem. Based on the derived results, we develop an iterative algorithm with provable convergence to mitigate the original problem. Simulation results show that our proposed framework can improve energy efficiency compared with several benchmark algorithms.


Local interpolation for minimal surfaces. Let a I to mathbb R 3 be a real analytic curve satisfying some conditions. In this article, we show that for any real analytic curve l I to mathbb R 3 close to a (in a sense which is precisely defined in the paper) there exists a translation of l , and a minimal surface which contains both a and the translated l .


Federated Bayesian Optimization via Thompson Sampling. Bayesian optimization (BO) is a prominent approach to optimizing expensive to evaluate black box functions. The massive computational capability of edge devices such as mobile phones, coupled with privacy concerns, has led to a surging interest in federated learning (FL) which focuses on collaborative training of deep neural networks (DNNs) via first order optimization techniques. However, some common machine learning tasks such as hyperparameter tuning of DNNs lack access to gradients and thus require zeroth order black box optimization. This hints at the possibility of extending BO to the FL setting (FBO) for agents to collaborate in these black box optimization tasks. This paper presents federated Thompson sampling (FTS) which overcomes a number of key challenges of FBO and FL in a principled way We (a) use random Fourier features to approximate the Gaussian process surrogate model used in BO, which naturally produces the parameters to be exchanged between agents, (b) design FTS based on Thompson sampling, which significantly reduces the number of parameters to be exchanged, and (c) provide a theoretical convergence guarantee that is robust against heterogeneous agents, which is a major challenge in FL and FBO. We empirically demonstrate the effectiveness of FTS in terms of communication efficiency, computational efficiency, and practical performance.


FrameNet Learning Local Canonical Frames of 3D Surfaces from a Single RGB Image. In this work, we introduce the novel problem of identifying dense canonical 3D coordinate frames from a single RGB image. We observe that each pixel in an image corresponds to a surface in the underlying 3D geometry, where a canonical frame can be identified as represented by three orthogonal axes, one along its normal direction and two in its tangent plane. We propose an algorithm to predict these axes from RGB. Our first insight is that canonical frames computed automatically with recently introduced direction field synthesis methods can provide training data for the task. Our second insight is that networks designed for surface normal prediction provide better results when trained jointly to predict canonical frames, and even better when trained to also predict 2D projections of canonical frames. We conjecture this is because projections of canonical tangent directions often align with local gradients in images, and because those directions are tightly linked to 3D canonical frames through projective geometry and orthogonality constraints. In our experiments, we find that our method predicts 3D canonical frames that can be used in applications ranging from surface normal estimation, feature matching, and augmented reality.


Joint Uplink Downlink Resource Allocation for OFDMA URLLC MEC Systems. In this paper, we study resource allocation algorithm design for multiuser orthogonal frequency division multiple access (OFDMA) ultra reliable low latency communication (URLLC) in mobile edge computing (MEC) systems. To achieve the stringent end to end delay and reliability requirements of URLLC MEC systems, we propose joint uplink downlink resource allocation and finite blocklength transmission. Furthermore, we propose a partial time overlap between the uplink and downlink frames to minimize the end to end delay, which introduces new time causality constraints. Then, the proposed resource allocation algorithm is formulated as an optimization problem for minimization of the total weighted transmit power of the network under constraints on the minimum quality of service regarding the number of computed URLLC user bits within the maximum allowable computing time, i.e., the end to end delay of a computation task. Due to the non convexity of the optimization problem, finding the globally optimal solution entails a high computational complexity which is not tolerable for real time applications. Therefore, a low complexity algorithm based on successive convex approximation is proposed to find a high quality sub optimal solution. Our simulation results show that the proposed resource allocation algorithm design facilitates the application of URLLC in MEC systems, and yields significant power savings compared to a benchmark scheme.


Who Are the Phishers? Phishing Scam Detection on Ethereum via Network Embedding. Recently, blockchain technology has become a topic in the spotlight but also a hotbed of various cybercrimes. Among them, phishing scams on blockchain have been found making a notable amount of money, thus emerging as a serious threat to the trading security of the blockchain ecosystem. In order to create a favorable environment for investment, an effective method for detecting phishing scams is urgently needed in the blockchain ecosystem. To this end, this paper proposes an approach to detect phishing scams on Ethereum by mining its transaction records. Specifically, we first crawl the labeled phishing addresses from two authorized websites and reconstruct the transaction network according to the collected transaction records. Then, by taking the transaction amount and timestamp into consideration, we propose a novel network embedding algorithm called trans2vec to extract the features of the addresses for subsequent phishing identification. Finally, we adopt the oneclass support vector machine (SVM) to classify the nodes into normal and phishing ones. Experimental results demonstrate that the phishing detection method works effectively on Ethereum, and indicate the efficacy of trans2vec over existing state of the art algorithms on feature extraction for transaction networks. This work is the first investigation on phishing detection on Ethereum via network embedding and provides insights into how features of large scale transaction networks can be embedded.


Efficient Planar Two Center Algorithms. We consider the planar Euclidean two center problem in which given n points in the plane we are to find two congruent disks of the smallest radius covering the points. We present a deterministic O(n log n) time algorithm for the case that the centers of the two optimal disks are close to each other, that is, the overlap of the two optimal disks is a constant fraction of the disk area. We also present a deterministic O(n log n) time algorithm for the case that the input points are in convex position. Both results improve the previous best O(n log n log log n) bound on the problems.


Simple and Fast Distributed Computation of Betweenness Centrality. Betweenness centrality is a graph parameter that has been successfully applied to network analysis. In the context of computer networks, it was considered for various objectives, ranging from routing to service placement. However, as observed by Maccari et al. INFOCOM 2018 , research on betweenness centrality for improving protocols was hampered by the lack of a usable, fully distributed algorithm for computing this parameter. We resolve this issue by designing an efficient algorithm for computing betweenness centrality, which can be implemented by minimal modifications to any distance vector routing protocol based on Bellman Ford. The convergence time of our implementation is shown to be proportional to the diameter of the network


Static vs accumulating priorities in healthcare queues under heavy loads. Amid unprecedented times caused by COVID 19, healthcare systems all over the world are strained to the limits of, or even beyond, capacity. A similar event is experienced by some healthcare systems regularly, due to for instance seasonal spikes in the number of patients. We model this as a queueing system in heavy traffic (where the arrival rate is approaching the service rate from below) or in overload (where the arrival rate exceeds the service rate). In both cases we assume that customers (patients) may have different priorities and we consider two popular service disciplines static priorities and accumulating priorities. It has been shown that the latter allows for patients of all classes to be seen in a timely manner as long as the system is stable. We demonstrate however that if accumulating priorities are used in the heavy traffic or overload regime, then all patients, including those with the highest priority, will experience very long waiting times. If on the other hand static priorities are applied, then one can ensure that the highest priority patients will be seen in a timely manner even in overloaded systems.


The Hitchhiker's Guide to LDA. Latent Dirichlet Allocation (LDA) model is a famous model in the topic model field, it has been studied for years due to its extensive application value in industry and academia. However, the mathematical derivation of LDA model is challenging and difficult, which makes it difficult for the beginners to learn. To help the beginners in learning LDA, this book analyzes the mathematical derivation of LDA in detail, and it also introduces all the knowledge background to make it easy for beginners to understand. Thus, this book contains the author's unique insights. It should be noted that this book is written in Chinese.


When does MAML Work the Best? An Empirical Study on Model Agnostic Meta Learning in NLP Applications. Model Agnostic Meta Learning (MAML), a model agnostic meta learning method, is successfully employed in NLP applications including few shot text classification and multi domain low resource language generation. Many impacting factors, including data quantity, similarity among tasks, and the balance between general language model and task specific adaptation, can affect the performance of MAML in NLP, but few works have thoroughly studied them. In this paper, we conduct an empirical study to investigate these impacting factors and conclude when MAML works the best based on the experimental results.


Minkowski dimension for measures. We introduce a Minkowski dimension for measures and show that it can be used to characterise the Minkowski dimension of a compact metric space. We also study its relationship with other concepts in dimension theory.


Fully piecewise linear vector optimization problem. We distinguish two kinds of piecewise linear functions and provide an interesting representation for a piecewise linear function between two normed spaces. Based on such a representation, we study a fully piecewise linear vector optimization (PLP) with the objective and constraint functions being piecewise linear. We divide (PLP) into some linear subproblems and structure a finite dimensional reduction method to solve (PLP). Under some mild assumptions, we prove that the Pareto (resp. weak Pareto) solution set of (PLP) is the union of finitely many generalized polyhedra (resp. polyhedra), each of which is contained in a Pareto (resp. weak Pareto) face of some linear subproblem. Our main results are even new in the linear case and further generalize Arrow, Barankin and Blackwell's classical results on linear vector optimization problems in the framework of finite dimensional spaces.


Cdh Descent for Homotopy Hermitian K Theory of Rings with Involution. We provide a geometric model for the classifying space of automorphism groups of Hermitian vector bundles over a ring with involution R such that frac 1 2 in R this generalizes a result of Schlichting Tripathi cite SchTri . We then prove a periodicity theorem for Hermitian K theory and use it to construct an E infty motivic ring spectrum mathbf KR mathrm alg representing homotopy Hermitian K theory. From these results, we show that mathbf KR mathrm alg is stable under base change, and cdh descent for homotopy Hermitian K theory of rings with involution is a formal consequence.


Recent progress on the Dirichlet problem for the minimal surface system and minimal cones. This is a very brief report on recent developments on the Dirichlet problem for the minimal surface system and minimal cones in Euclidean spaces. We shall mainly focus on two directions (1) Further systematic developments after Lawson Osserman's paper cite l o on the Dirichlet problem for minimal graphs of high codimensions. Aspects including non existence, non uniqueness and irregularity properties of solutions have been explored from different points of view. (2) Complexities and varieties of area minimizing cones in high codimensions. We shall mention interesting history and exhibit some recent results which successfully furnished new families of minimizing cones of different types.


A Retrospective Recount of Computer Architecture Research with a Data Driven Study of Over Four Decades of ISCA Publications. This study began with a research project, called DISCvR, conducted at the IBM ILLINOIS Center for Cognitive Computing Systems Reseach. The goal of DISCvR was to build a practical NLP based AI pipeline for document understanding which will help us better understand the computation patterns and requirements of modern computing systems. While building such a prototype, an early use case came to us thanks to the 2017 IEEE ACM International Symposium on Microarchitecture (MICRO 50) Program Co chairs, Drs. Hillery Hunter and Jaime Moreno. They asked us if we can perform some data driven analysis of the past 50 years of MICRO papers and show some interesting historical perspectives on MICRO's 50 years of publication. We learned two important lessons from that experience (1) building an AI solution to truly understand unstructured data is hard in spite of the many claimed successes in natural language understanding and (2) providing a data driven perspective on computer architecture research is a very interesting and fun project. Recently we decided to conduct a more thorough study based on all past papers of International Symposium on Computer Architecture (ISCA) from 1973 to 2018, which resulted this article. We recognize that we have just scratched the surface of natural language understanding of unstructured data, and there are many more aspects that we can improve. But even with our current study, we felt there were enough interesting findings that may be worthwhile to share with the community. Hence we decided to write this article to summarize our findings so far based only on ISCA publications. Our hope is to generate further interests from the community in this topic, and we welcome collaboration from the community to deepen our understanding both of the computer architecture research and of the challenges of NLP based AI solutions.


Interpretable Poverty Mapping using Social Media Data, Satellite Images, and Geospatial Information. Access to accurate, granular, and up to date poverty data is essential for humanitarian organizations to identify vulnerable areas for poverty alleviation efforts. Recent works have shown success in combining computer vision and satellite imagery for poverty estimation however, the cost of acquiring high resolution images coupled with black box models can be a barrier to adoption for many development organizations. In this study, we present a interpretable and cost efficient approach to poverty estimation using machine learning and readily accessible data sources including social media data, low resolution satellite images, and volunteered geographic information. Using our method, we achieve an R 2 of 0.66 for wealth estimation in the Philippines, compared to 0.63 using satellite imagery. Finally, we use feature importance analysis to identify the highest contributing features both globally and locally to help decision makers gain deeper insights into poverty.


Insight into Potential Well Based Nanoscale FDSOI MOSFET Using Doped Silicon Tubs A Simulation and Device Physics Based Study Part I Theory and Methodology. A novel planar device having doped silicon regions (tubs) under the source and drain of an FDSOI MOSFET is reported at 20 nm gate length. The doped silicon regions result in formation of potential wells (PW) in the source and drain regions of FDSOI MOSFET and thus, the device being called as Potential Well Based FDSOI MOSFET (PWFDSOI MOSFET). Simulation and device physics study on PWFDSOI MOSFET showed reduction in the OFF current of the device by orders of magnitude. A low IOF F of 22 pA um, high ION IOF F ratio of 1.5 x 107 and subthreshold swing of 76 mV decade were achieved in 20 nm gate length PWFDSOI MOSFET. The study was performed on devices with unstrained silicon channel.


Estimating predictive uncertainty for rumour verification models. The inability to correctly resolve rumours circulating online can have harmful real world consequences. We present a method for incorporating model and data uncertainty estimates into natural language processing models for automatic rumour verification. We show that these estimates can be used to filter out model predictions likely to be erroneous, so that these difficult instances can be prioritised by a human fact checker. We propose two methods for uncertainty based instance rejection, supervised and unsupervised. We also show how uncertainty estimates can be used to interpret model performance as a rumour unfolds.


Conformance Constraint Discovery Measuring Trust in Data Driven Systems. The reliability and proper function of data driven applications hinge on the data's continued conformance to the applications' initial design. When data deviates from this initial profile, system behavior becomes unpredictable. Data profiling techniques such as functional dependencies and denial constraints encode patterns in the data that can be used to detect deviations. But traditional methods typically focus on exact constraints and categorical attributes, and are ill suited for tasks such as determining whether the prediction of a machine learning system can be trusted or for quantifying data drift. In this paper, we introduce data invariants, a new data profiling primitive that models arithmetic relationships involving multiple numerical attributes within a (noisy) dataset and which complements the existing data profiling techniques. We propose a quantitative semantics to measure the degree of violation of a data invariant, and establish that strong data invariants can be constructed from observations with low variance on the given dataset. A concrete instance of this principle gives the surprising result that low variance components of a principal component analysis (PCA), which are usually discarded, generate better invariants than the high variance components. We demonstrate the value of data invariants on two applications trusted machine learning and data drift. We empirically show that data invariants can (1) reliably detect tuples on which the prediction of a machine learned model should not be trusted, and (2) quantify data drift more accurately than the state of the art methods. Additionally, we show four case studies where an intervention centric explanation tool uses data invariants to explain causes for tuple non conformance.


Enhancement of Short Text Clustering by Iterative Classification. Short text clustering is a challenging task due to the lack of signal contained in such short texts. In this work, we propose iterative classification as a method to b o ost the clustering quality (e.g., accuracy) of short texts. Given a clustering of short texts obtained using an arbitrary clustering algorithm, iterative classification applies outlier removal to obtain outlier free clusters. Then it trains a classification algorithm using the non outliers based on their cluster distributions. Using the trained classification model, iterative classification reclassifies the outliers to obtain a new set of clusters. By repeating this several times, we obtain a much improved clustering of texts. Our experimental results show that the proposed clustering enhancement method not only improves the clustering quality of different clustering methods (e.g., k means, k means , and hierarchical clustering) but also outperforms the state of the art short text clustering methods on several short text datasets by a statistically significant margin.


Lyapunov exponents for random perturbations of coupled standard maps. In this paper, we give a quantitative estimate for the sum of the first N Lyapunov exponents for random perturbations of a natural class 2N dimensional volume preserving systems exhibiting strong hyperbolicity on a large but noninvariant subset of phase space. Concrete models covered by our setting include systems of coupled standard maps, in both weak' and strong' coupling regimes.


Parabolic equations with dynamic boundary conditions and drift terms. The aim of this paper is to study the wellposedness and L 2 regularity, firstly for a linear heat equation with dynamic boundary conditions by using the approach of sesquilinear forms, and secondly for its backward adjoint equation using the Galerkin approximation and the extension semigroup to a negative Sobolev space.


Systematic literature review protocol. Learning outcomes and teaching learning process a Bloom's taxonomy perspective. Context The importance of defining learning outcomes and the planning stage for a systematic literature review. Objective A protocol for carrying out a systematic literature review about the evidence for the tool support for the learning outcomes and the teaching learning process using Bloom's taxonomy to address it. Method The definition of a protocol to conduct a systematic literature review according to the guidelines of B. Kitchenham. Results A validated protocol to conduct a systematic literature review. Conclusions A proposal for the protocol definition of a systematic literature review about the tool support for the learning outcomes, the teaching learning process using Bloom's taxonomy was built. Initials results show that a more detailed review of the learning outcomes and their alignment with the levels of curricular progress, training cycles, and Bloom's Taxonomy should be carried out.


Whole brain models to explore altered states of consciousness from the bottom up. The scope of human consciousness includes states departing from what most of us experience as ordinary wakefulness. These altered states of consciousness constitute a prime opportunity to study how global changes in brain activity relate to different varieties of subjective experience. We consider the problem of explaining how global signatures of altered consciousness arise from the interplay between large scale connectivity and local dynamical rules that can be traced to known properties of neural tissue. For this purpose, we advocate a research program aimed at bridging the gap between bottom up generative models of whole brain activity and the top down signatures proposed by theories of consciousness. Throughout this paper, we define altered states of consciousness, discuss relevant signatures of consciousness observed in brain activity, and introduce whole brain models to explore the mechanisms of altered consciousness from the bottom up. We discuss the potential of our proposal in view of the current state of the art, give specific examples of how this research agenda might play out, and emphasise how a systematic investigation of altered states of consciousness via bottom up modelling may help us better understand the biophysical, informational, and dynamical underpinnings of consciousness.


Vertex algebroids and Conformal vertex algebras associated with simple Leibniz algebras. We first investigate the algebraic structure of vertex algebroids B when B are simple Leibniz algebras. Next, we use these vertex algebroids B to construct indecomposable non simple C 2 cofinite mathbb N graded vertex algebras overline V B . In addition, we classify mathbb N graded irreducible overline V B modules and examine conformal vectors of these mathbb N graded vertex algebras overline V B .


Une nouvelle minoration pour la trace des entiers alg 'ebriques totalement positifs. We explain how a slight variant in the use of our recursive algorithm leads to improve the known lower bounds for the absolute trace of a totally positive algebraic integer. We also link the absolute trace of a totally positive algebraic integer and the absolute trace of a totally positive reciprocal integer.


Adelic superrigidity and profinitely solitary lattices. By arithmeticity and superrigidity, a commensurability class of lattices in a higher rank Lie group is defined by a unique algebraic group over a unique number subfield of mathbb R or mathbb C . We prove an adelic version of superrigidity which implies that two such commensurability classes define the same profinite commensurability class if and only if the algebraic groups are adelically isomorphic. We discuss noteworthy consequences on profinite rigidity questions.


Towards Coherent and Engaging Spoken Dialog Response Generation Using Automatic Conversation Evaluators. Encoder decoder based neural architectures serve as the basis of state of the art approaches in end to end open domain dialog systems. Since most of such systems are trained with a maximum likelihood (MLE) objective they suffer from issues such as lack of generalizability and the generic response problem, i.e., a system response that can be an answer to a large number of user utterances, e.g., "Maybe, I don't know." Having explicit feedback on the relevance and interestingness of a system response at each turn can be a useful signal for mitigating such issues and improving system quality by selecting responses from different approaches. Towards this goal, we present a system that evaluates chatbot responses at each dialog turn for coherence and engagement. Our system provides explicit turn level dialog quality feedback, which we show to be highly correlated with human evaluation. To show that incorporating this feedback in the neural response generation models improves dialog quality, we present two different and complementary mechanisms to incorporate explicit feedback into a neural response generation model reranking and direct modification of the loss function during training. Our studies show that a response generation model that incorporates these combined feedback mechanisms produce more engaging and coherent responses in an open domain spoken dialog setting, significantly improving the response quality using both automatic and human evaluation.


Data structures to represent a set of k long DNA sequences. The analysis of biological sequencing data has been one of the biggest applications of string algorithms. The approaches used in many such applications are based on the analysis of k mers, which are short fixed length strings present in a dataset. While these approaches are rather diverse, storing and querying a k mer set has emerged as a shared underlying component. A set of k mers has unique features and applications that, over the last ten years, have resulted in many specialized approaches for its representation. In this survey, we give a unified presentation and comparison of the data structures that have been proposed to store and query a k mer set. We hope this survey will serve as a resource for researchers in the field as well as make the area more accessible to researchers outside the field.


MIDV 2019 Challenges of the modern mobile based document OCR. Recognition of identity documents using mobile devices has become a topic of a wide range of computer vision research. The portfolio of methods and algorithms for solving such tasks as face detection, document detection and rectification, text field recognition, and other, is growing, and the scarcity of datasets has become an important issue. One of the openly accessible datasets for evaluating such methods is MIDV 500, containing video clips of 50 identity document types in various conditions. However, the variability of capturing conditions in MIDV 500 did not address some of the key issues, mainly significant projective distortions and different lighting conditions. In this paper we present a MIDV 2019 dataset, containing video clips shot with modern high resolution mobile cameras, with strong projective distortions and with low lighting conditions. The description of the added data is presented, and experimental baselines for text field recognition in different conditions. The dataset is available for download at ftp smartengines.com midv 500 extra midv 2019 .


Learning to Identify Security Related Issues Using Convolutional Neural Networks. Software security is becoming a high priority for both large companies and start ups alike due to the increasing potential for harm that vulnerabilities and breaches carry with them. However, attaining robust security assurance while delivering features requires a precarious balancing act in the context of agile development practices. One path forward to help aid development teams in securing their software products is through the design and development of security focused automation. Ergo, we present a novel approach, called SecureReqNet, for automatically identifying whether issues in software issue tracking systems describe security related content. Our approach consists of a two phase neural net architecture that operates purely on the natural language descriptions of issues. The first phase of our approach learns high dimensional word embeddings from hundreds of thousands of vulnerability descriptions listed in the CVE database and issue descriptions extracted from open source projects. The second phase then utilizes the semantic ontology represented by these embeddings to train a convolutional neural network capable of predicting whether a given issue is security related. We evaluated SecureReqNet by applying it to identify security related issues from a dataset of thousands of issues mined from popular projects on GitLab and GitHub. In addition, we also applied our approach to identify security related requirements from a commercial software project developed by a major telecommunication company. Our preliminary results are encouraging, with SecureReqNet achieving an accuracy of 96 on open source issues and 71.6 on industrial requirements.


Turbulence in a network of rigid fibers. The effect of a network of fixed rigid fibers on fluid flow is investigated by means of three dimensional direct numerical simulations using an immersed boundary method for the fluid structure coupling. Different flows are considered (i.e., cellular, parallel and homogeneous isotropic turbulent flow) in order to identify the modification of the classic energy budget occurring within canopies or fibrous media, as well as particle laden flows. First, we investigate the stabilizing effect of the network on the Arnold Beltrami Childress (ABC) cellular flow, showing that, the steady configuration obtained for a sufficiently large fiber concentration mimics the single phase stable solution at a lower Reynolds number. Focusing on the large scale dynamics, the effect of the drag exerted by the network on the flow can be effectively modelled by means of a Darcy's friction term. For the latter, we propose a phenomenological expression that is corroborated when extending our analysis to the Kolmogorov parallel flow and homogeneous isotropic turbulence. Furthermore, we examine the overall energy distribution across the various scales of motion, highlighting the presence of small scale activity with a peak in the energy spectra occurring at the wavenumber corresponding to the network spacing.


JUCBNMT at WMT2018 News Translation Task Character Based Neural Machine Translation of Finnish to English. In the current work, we present a description of the system submitted to WMT 2018 News Translation Shared task. The system was created to translate news text from Finnish to English. The system used a Character Based Neural Machine Translation model to accomplish the given task. The current paper documents the preprocessing steps, the description of the submitted system and the results produced using the same. Our system garnered a BLEU score of 12.9.


The Brou 'e invariant of a p permutation equivalence. A perfect isometry I (introduced by Brou 'e) between two blocks B and C is a frequent phenomenon in the block theory of finite groups. It maps an irreducible character psi of C to pm an irreducible character of B . Brou 'e proved that the ratio of the codegrees of psi and I( psi) is a rational number with p value zero and that its class in mathbb F p is independent of psi . We call this element the Brou 'e invariant of I . The goal of this paper is to show that if I comes from a p permutation equivalence or a splendid Rickard equivalence between B and C then, up to a sign, the Brou 'e invariant of I is determined by local data of B and C and is independent of the p permutation equivalence or splendid Rickard equivalence. Apart from results on p permutation equivalences, our proof requires new results on extended tensor products and bisets that are also proved in this paper.


Multimodal Systems Taxonomy, Methods, and Challenges. Naturally, humans use multiple modalities to convey information. The modalities are processed both sequentially and in parallel for communication in the human brain, this changes when humans interact with computers. Empowering computers with the capability to process input multimodally is a major domain of investigation in Human Computer Interaction (HCI). The advancement in technology (powerful mobile devices, advanced sensors, new ways of output, etc.) has opened up new gateways for researchers to design systems that allow multimodal interaction. It is a matter of time when the multimodal inputs will overtake the traditional ways of interactions. The paper provides an introduction to the domain of multimodal systems, explains a brief history, describes advantages of multimodal systems over unimodal systems, and discusses various modalities. The input modeling, fusion, and data collection were discussed. Finally, the challenges in the multimodal systems research were listed. The analysis of the literature showed that multimodal interface systems improve the task completion rate and reduce the errors compared to unimodal systems. The commonly used inputs for multimodal interaction are speech and gestures. In the case of multimodal inputs, late integration of input modalities is preferred by researchers because it allows easy update of modalities and corresponding vocabularies.


Exponential Sums of Witt Towers over Affinoids. In this paper we construct a Dwork theory for general exponential sums over affinoids in Witt towers. Using this, we compute the degree of the L function, its Hodge polygon and examine when the Hodge and Newton polygons coincide.


Ornstein Uhlenbeck processes of bounded variation. Ornstein Uhlenbeck process of bounded variation is introduced as a solution of an analogue of the Langevin equation with an integrated telegraph process replacing a Brownian motion. There is an interval I such that the process starting from the internal point of I always remains within I . Starting outside, this process a. s. reaches this interval in a finite time. The distribution of the time for which the process falls into this interval is obtained explicitly. The certain formulae for the mean and the variance of this process are obtained on the basis of the joint distribution of the telegraph process and its integrated copy. Under Kac's rescaling, the limit process is identified as the classical Ornstein Uhlenbeck process.


A semiclassical approach to geometric X ray transforms in the presence of convexity. In this short paper we introduce a variant of the approach to inverting the X ray transform that originated in the author's work with Uhlmann. The new method is based on semiclassical analysis and eliminates the need for using sufficiently small domains and layer stripping for obtaining the injectivity and stability results, assuming natural geometric conditions are satisfied.


Purification and recovery of 100MoO3 in crystal production for AMoRE experiment. The AMoRE collaboration searches for the neutrinoless double beta decay of 100Mo with ultra radiopure molybdate crystals operated as low temperature scintillating bolometers. For such a rare event search experiment, the techniques for investigating and reducing radioactive background contaminants in detector materials are extremely crucial. This paper discusses techniques for deep purification of enriched molybdenum for growing the crystals and the recovery of 100MoO3 from the residual melt left after growing lithium molybdate crystals. The purities of enriched molybdenum trioxide powders before and after the purification and that of the recovered powder were tested with ICP MS results of these tests are presented.


From Solar Eclipse of 1919 to the Spectacle of Gravitational Lensing. A century after observing the deflection of light emitted by distant stars during the solar eclipse of 1919, it is interesting to know the concepts emerged from the experiment and the theoretical and observational consequences for modern cosmology and astrophysics. In addition to confirming Einstein's gravitational theory, its greatest legacy was the construction of a new research area to cosmos science dubbed gravitational lensing. The formation and magnification of multiple images (mirages) by the gravitational field of a compact or extended lens are among the most striking phenomena of nature. This article presents a pedagogical view of the first genuine gravitational lens effect, the double quasar QSO 0957 561. We also describe the formation of rings, giant arcs, arclets and multiple Supernova images. It is also surprising that the Hubble constant and the amount of dark matter in the Universe can be measured by the same technique. Finally, the lensing of gravitational waves, a possible but still not yet detected effect, is also briefly discussed.


5 Parallel Prism A topology for pipelined implementations of convolutional neural networks using computational memory. In memory computing is an emerging computing paradigm that could enable deeplearning inference at significantly higher energy efficiency and reduced latency. The essential idea is to map the synaptic weights corresponding to each layer to one or more computational memory (CM) cores. During inference, these cores perform the associated matrix vector multiply operations in place with O(1) time complexity, thus obviating the need to move the synaptic weights to an additional processing unit. Moreover, this architecture could enable the execution of these networks in a highly pipelined fashion. However, a key challenge is to design an efficient communication fabric for the CM cores. Here, we present one such communication fabric based on a graph topology that is well suited for the widely successful convolutional neural networks (CNNs). We show that this communication fabric facilitates the pipelined execution of all state of the art CNNs by proving the existence of a homomorphism between one graph representation of these networks and the proposed graph topology. We then present a quantitative comparison with established communication topologies and show that our proposed topology achieves the lowest bandwidth requirements per communication channel. Finally, we present a concrete example of mapping ResNet 32 onto an array of CM cores.


Derivation of Heard Of Predicates From Elementary Behavioral Patterns. There are many models of distributed computing, and no unifying mathematical framework for considering them all. One way to sidestep this issue is to start with simple communication and fault models, and use them as building blocks to derive the complex models studied in the field. We thus define operations like union, succession or repetition, which makes it easier to build complex models from simple ones while retaining expressivity. To formalize this approach, we abstract away the complex models and operations in the Heard Of model. This model relies on (possibly asynchronous) rounds sequence of digraphs, one for each round, capture which messages sent at a given round are received before the receiver goes to the next round. A set of sequences, called a heard of predicate,defines the legal communication behaviors that is to say, a model of communication. Because the proposed operations behave well with this transformation of operational models into heard of predicates, we can derive bounds, characterizations, and implementations of the heard of predicates for the constructions.


On sets of n points in general position that determine lines that can be pierced by n points. Let P be a set of n points in general position in the plane. Let R be a set of n points disjoint from P such that for every x,y in P the line through x and y contains a point in R outside of the segment delimited by x and y . We show that P cup R must be contained in a cubic curve.


Dynamic Averaging Load Balancing on Cycles. We consider the following dynamic load balancing process given an underlying graph G with n nodes, in each step t geq 0 , one unit of load is created, and placed at a randomly chosen graph node. In the same step, the chosen node picks a random neighbor, and the two nodes balance their loads by averaging them. We are interested in the expected gap between the minimum and maximum loads at nodes as the process progresses, and its dependence on n and on the graph structure. Similar variants of the above graphical balanced allocation process have been studied by Peres, Talwar, and Wieder, and by Sauerwald and Sun for regular graphs. These authors left as open the question of characterizing the gap in the case of emph cycle graphs in the emph dynamic case, where weights are created during the algorithm's execution. For this case, the only known upper bound is of mathcal O ( n log n ) , following from a majorization argument due to Peres, Talwar, and Wieder, which analyzes a related graphical allocation process. In this paper, we provide an upper bound of mathcal O ( sqrt n log n ) on the expected gap of the above process for cycles of length n . We introduce a new potential analysis technique, which enables us to bound the difference in load between k hop neighbors on the cycle, for any k leq n 2 . We complement this with a "gap covering" argument, which bounds the maximum value of the gap by bounding its value across all possible subsets of a certain structure, and recursively bounding the gaps within each subset. We provide analytical and experimental evidence that our upper bound on the gap is tight up to a logarithmic factor.


Hamiltonian cycles and 1 factors in 5 regular graphs. It is proven that for any integer g ge 0 and k in 0, ldots, 10 , there exist infinitely many 5 regular graphs of genus g containing a 1 factorisation with exactly k pairs of 1 factors that are perfect, i.e. form a hamiltonian cycle. For g 0 , this settles a problem of Kotzig from 1964. Motivated by Kotzig and Labelle's "marriage" operation, we discuss two gluing techniques aimed at producing graphs of high cyclic edge connectivity. We prove that there exist infinitely many planar 5 connected 5 regular graphs in which every 1 factorisation has zero perfect pairs. On the other hand, by the Four Colour Theorem and a result of Brinkmann and the first author, every planar 4 connected 5 regular graph satisfying a condition on its hamiltonian cycles has a linear number of 1 factorisations each containing at least one perfect pair. We also prove that every planar 5 connected 5 regular graph satisfying a stronger condition contains a 1 factorisation with at most nine perfect pairs, whence, every such graph admitting a 1 factorisation with ten perfect pairs has at least two edge Kempe equivalence classes. The paper concludes with further results on edge Kempe equivalence classes in planar 5 regular graphs.


Totally null sets and capacity in Dirichlet type spaces. In the context of Dirichlet type spaces on the unit ball of mathbb C d , also known as Hardy Sobolev or Besov Sobolev spaces, we compare two notions of smallness for compact subsets of the unit sphere. We show that the functional analytic notion of being totally null agrees with the potential theoretic notion of having capacity zero. In particular, this applies to the classical Dirichlet space on the unit disc and logarithmic capacity. In combination with a peak interpolation result of Davidson and the second named author, we obtain strengthenings of boundary interpolation theorems of Peller and Khrushch " e v and of Cohn and Verbitsky.


Reconstruction of turbulent flow fields from lidar measurements based on large eddy simulation. We investigate the reconstruction of a turbulent flow field in the atmospheric boundary layer from a time series of lidar measurements, using Large Eddy Simulations (LES) and a 4D Var data assimilation algorithm. This leads to an optimisation problem in which the error between measurements and simulations is minimised over an observation time horizon. To exploit the spatial coherence of the turbulence, we use a quadratic regularisation in the objective function, that is based on the two point covariance matrix. Moreover, to improve conditioning, and remove continuity constraints, the problem is transformed into a Karhunen Lo eve basis. For the optimisation, we use a quasi Newton limited memory BFGS algorithm combined with an adjoint approach for the gradient. We also consider reconstruction based on a Taylor's frozen turbulence (TFT) model as point of comparison. To evaluate the approach, we construct a series of virtual lidar measurements from a fine grid LES of a pressure driven boundary layer. The reconstruction uses LES on a coarser mesh and smaller domain, and results are compared to the fine grid reference. Two lidar scanning modes are considered a classical plan position indicator mode, which swipes the lidar beam in a horizontal plane, and a 3D pattern that is based on a Lissajous curve. We find that normalised errors lie between 15 and 25 (error variance normalised by background variance) in the scanning region, and increase to 100 over a distance that is comparable to the correlation length scale outside this scanning region. Moreover, LES outperforms TFT by 30 to 70 depending on scanning mode and location.


physics.comp-ph physics.atom-ph physics.ins-det physics.med-ph

PenRed An extensible and parallel Monte Carlo framework for radiation transport based on PENELOPE. Monte Carlo methods provide detailed and accurate results for radiation transport simulations. Unfortunately, the high computational cost of these methods limits its usage in real time applications. Moreover, existing computer codes do not provide a methodology for adapting these kind of simulations to specific problems without advanced knowledge of the corresponding code system, and this restricts their applicability. To help solve these current limitations, we present PenRed, a general purpose, stand alone, extensible and modular framework code based on PENELOPE for parallel Monte Carlo simulations of electron photon transport through matter. It has been implemented in C programming language and takes advantage of modern object oriented technologies. In addition, PenRed offers the capability to read and process DICOM images as well as to construct and simulate image based voxelized geometries, so as to facilitate its usage in medical applications. Our framework has been successfully verified against the original PENELOPE Fortran code. Furthermore, the implemented parallelism has been tested showing a significant improvement in the simulation time without any loss in precision of results.


Hypercontractivity on the symmetric group. The hypercontractive inequality is a fundamental result in analysis, with many applications throughout discrete mathematics, theoretical computer science, combinatorics and more. So far, variants of this inequality have been proved mainly for product spaces, which raises the question of whether analogous results hold over non product domains. We consider the symmetric group, S n , one of the most basic non product domains, and establish hypercontractive inequalities on it. Our inequalities are most effective for the class of emph global functions on S n , which are functions whose 2 norm remains small when restricting O(1) coordinates of the input, and assert that low degree, global functions have small q norms, for q 2 . As applications, we show 1. An analog of the level d inequality on the hypercube, asserting that the mass of a global function on low degrees is very small. We also show how to use this inequality to bound the size of global, product free sets in the alternating group A n . 2. Isoperimetric inequalities on the transposition Cayley graph of S n for global functions, that are analogous to the KKL theorem and to the small set expansion property in the Boolean hypercube. 3. Hypercontractive inequalities on the multi slice, and stability versions of the Kruskal Katona Theorem in some regimes of parameters.


Component Mismatches Are a Critical Bottleneck to Fielding AI Enabled Systems in the Public Sector. The use of machine learning or artificial intelligence (ML AI) holds substantial potential toward improving many functions and needs of the public sector. In practice however, integrating ML AI components into public sector applications is severely limited not only by the fragility of these components and their algorithms, but also because of mismatches between components of ML enabled systems. For example, if an ML model is trained on data that is different from data in the operational environment, field performance of the ML component will be dramatically reduced. Separate from software engineering considerations, the expertise needed to field an ML AI component within a system frequently comes from outside software engineering. As a result, assumptions and even descriptive language used by practitioners from these different disciplines can exacerbate other challenges to integrating ML AI components into larger systems. We are investigating classes of mismatches in ML AI systems integration, to identify the implicit assumptions made by practitioners in different fields (data scientists, software engineers, operations staff) and find ways to communicate the appropriate information explicitly. We will discuss a few categories of mismatch, and provide examples from each class. To enable ML AI components to be fielded in a meaningful way, we will need to understand the mismatches that exist and develop practices to mitigate the impacts of these mismatches.


Norm violation in online communities A study of Stack Overflow comments. Norms are behavioral expectations in communities. Online communities are also expected to abide by the rules and regulations that are expressed in the code of conduct of a system. Even though community authorities continuously prompt their users to follow the regulations, it is observed that hate speech and abusive language usage are on the rise. In this paper, we quantify and analyze the patterns of violations of normative behaviour among the users of Stack Overflow (SO) a well known technical question answer site for professionals and enthusiast programmers, while posting a comment. Even though the site has been dedicated to technical problem solving and debugging, hate speech as well as posting offensive comments make the community "toxic". By identifying and minimising various patterns of norm violations in different SO communities, the community would become less toxic and thereby the community can engage more effectively in its goal of knowledge sharing. Moreover, through automatic detection of such comments, the authors can be warned by the moderators, so that it is less likely to be repeated, thereby the reputation of the site and community can be improved. Based on the comments extracted from two different data sources on SO, this work first presents a taxonomy of norms that are violated. Second, it demonstrates the sanctions for certain norm violations. Third, it proposes a recommendation system that can be used to warn users that they are about to violate a norm. This can help achieve norm adherence in online communities.


Quasi projective dimension. In this paper, we introduce a new homological invariant called quasi projective dimension, which is a generalization of projective dimension. We discuss various properties of quasi projective dimension. Among other things, we prove the following. (1) Over a quotient of a regular local ring by a regular sequence, every finitely generated module has finite quasi projective dimension. (2) The Auslander Buchsbaum formula and the depth formula for modules of finite projective dimension remain valid for modules of finite quasi projective dimension. (3) Several results on vanishing of Tor and Ext hold for modules of finite quasi projective dimension.


UniVSE Robust Visual Semantic Embeddings via Structured Semantic Representations. We propose Unified Visual Semantic Embeddings (UniVSE) for learning a joint space of visual and textual concepts. The space unifies the concepts at different levels, including objects, attributes, relations, and full scenes. A contrastive learning approach is proposed for the fine grained alignment from only image caption pairs. Moreover, we present an effective approach for enforcing the coverage of semantic components that appear in the sentence. We demonstrate the robustness of Unified VSE in defending text domain adversarial attacks on cross modal retrieval tasks. Such robustness also empowers the use of visual cues to resolve word dependencies in novel sentences.


Motif Enhanced Recommendation over Heterogeneous Information Network. Heterogeneous Information Networks (HIN) has been widely used in recommender systems (RSs). In previous HIN based RSs, meta path is used to compute the similarity between users and items. However, existing meta path based methods only consider first order relations, ignoring higher order relations among the nodes of textit same type, captured by textit motifs . In this paper, we propose to use motifs to capture higher order relations among nodes of same type in a HIN and develop the motif enhanced meta path (MEMP) to combine motif based higher order relations with edge based first order relations. With MEMP based similarities between users and items, we design a recommending model MoHINRec, and experimental results on two real world datasets, Epinions and CiaoDVD, demonstrate its superiority over existing HIN based RS methods.


A new approach to mod 2 decompositions of BSU(2) and BSO(3). Dwyer, Miller and Wilkerson proved that at the prime 2, the classifying spaces of SU(2) and SO(3) can be obtained as a homotopy pushout of the classifying spaces of certain subgroups. In this paper we show explicitly how these decompositions arise from the fusion systems of SU(2) and SO(3) over maximal discrete 2 toral subgroups.


Anchor Locating Android Framework specific Crashing Faults. Android framework specific app crashes are hard to debug. Indeed, the callback based event driven mechanism of Android challenges crash localization techniques that are developed for traditional Java programs. The key challenge stems from the fact that the buggy code location may not even be listed within the stack trace. For example, our empirical study on 500 framework specific crashes from an open benchmark has revealed that 37 percent of the crash types are related to bugs that are outside the stack traces. Moreover, Android programs are a mixture of code and extra code artifacts such as the Manifest file. The fact that any artifact can lead to failures in the app execution creates the need to position the localization target beyond the code realm. In this paper, we propose Anchor, a two phase suspicious bug location suggestion tool. Anchor specializes in finding crash inducing bugs outside the stack trace. Anchor is lightweight and source code independent since it only requires the crash message and the apk file to locate the fault. Experimental results, collected via cross validation and in the wild dataset evaluation, show that Anchor is effective in locating Android framework specific crashing faults.


Autism spectrum disorder a neuro immunometabolic hypothesis of the developmental origins. Fetal neuroinflammation and prenatal stress (PS) may contribute to lifelong neurological disabilities. Astrocytes and microglia, among the brain's non neuronal glia cell populations, play a pivotal role in neurodevelopment, predisposition to and initiation of disease throughout lifespan. One of the most common neurodevelopmental disorders manifesting between 1 4 years of age is autism spectrum disorder (ASD). A pathological glial neuronal interplay is thought to increase the risk for clinical manifestation of ASD in at risk children, but the mechanisms remain poorly understood and integrative, multi scale models are needed. We propose a model that integrates the data across the scales of physiological organization, from genome to phenotype, and provides a foundation to explain the disparate findings on the genomic level. We hypothesize that via gene environment interactions, fetal neuroinflammation and PS may reprogram glial immunometabolic phenotypes that impact neurodevelopment and neurobehavior. Drawing on genomic data from the recently published series of ovine and rodent glial transcriptome analyses with fetuses exposed to neuroinflammation or PS, we conduct an analysis on the Simons Foundation Autism Research Initiative (SFARI) Gene database. We confirm 21 gene hits. Using unsupervised statistical network analysis, we then identify six clusters of probable protein protein interactions mapping onto the immunometabolic and stress response networks and epigenetic memory. These findings support our hypothesis. We discuss the implications for ASD etiology, early detection, and novel therapeutic approaches. We conclude with delineation of the next steps to verify our model on the individual gene level in an assumption free manner.


Modeling Helping Behavior in Emergency Evacuations Using Volunteer's Dilemma Game. People often help others who are in trouble, especially in emergency evacuation situations. For instance, during the 2005 London bombings, it was reported that evacuees helped injured persons to escape the place of danger. In terms of game theory, it can be understood that such helping behavior provides a collective good while it is a costly behavior because the volunteers spend extra time to assist the injured persons in case of emergency evacuations. In order to study the collective effects of helping behavior in emergency evacuations, we have performed numerical simulations of helping behavior among evacuees in a room evacuation scenario. Our simulation model is based on the volunteer's dilemma game reflecting volunteering cost. The game theoretic model is coupled with a social force model to understand the relationship between the spatial and social dynamics of evacuation scenarios. By systematically changing the cost parameter of helping behavior, we observed different patterns of collective helping behaviors and these collective patterns are summarized with a phase diagram.


Stochastic Dynamic Pricing for Same Day Delivery Routing. Same day delivery for e commerce has become a popular service. Companies usually offer several time delivery options with the earliest one being next hour delivery. Due to tight delivery deadlines and thin margins, companies often find it challenging to provide efficient same day delivery services. In this work, we propose a holistic scheme that combines the optimization of routing and pricing for same day delivery. The proposed approach is able to take into account uncertainty in travel times, a crucial factor for delivery applications in urban environments. We model this problem as a Markov decision process. We apply a value function approximation technique to compute opportunity costs. Based on these opportunity costs, as well as the customer choice model and travel time distribution, we optimize the prices for various delivery deadlines. We perform extensive computational experiments to compare the proposed model with baseline policies. We also investigate how the (potentially wrong) choice of travel time distributions affect the performance of the proposed optimization scheme. Through numerical simulations of realistic scenarios, we observe that compared to the deterministic model, the proposed approach can reduce the number of missed deliveries up to 40 at the same time, it can increase revenue by more than 5 compared to the baseline policies. We explore new issues that arise due to the stochastic nature of the problem such as the effect of penalties for missed deliveries on pricing structure and overall revenue.


Numerically Stable Polynomially Coded Computing. We study the numerical stability of polynomial based encoding methods, which has emerged to be a powerful class of techniques for providing straggler and fault tolerance in the area of coded computing. Our contributions are as follows 1) We construct new codes for matrix multiplication that achieve the same fault straggler tolerance as the previously constructed MatDot Codes and Polynomial Codes. Unlike previous codes that use polynomials expanded in a monomial basis, our codes uses a basis of orthogonal polynomials. 2) We show that the condition number of every m times m sub matrix of an m times n, n geq m Chebyshev Vandermonde matrix, evaluated on the n point Chebyshev grid, grows as O(n 2(n m) ) for n m . An implication of this result is that, when Chebyshev Vandermonde matrices are used for coded computing, for a fixed number of redundant nodes s n m, the condition number grows at most polynomially in the number of nodes n . 3) By specializing our orthogonal polynomial based constructions to Chebyshev polynomials, and using our condition number bound for Chebyshev Vandermonde matrices, we construct new numerically stable techniques for coded matrix multiplication. We empirically demonstrate that our constructions have significantly lower numerical errors compared to previous approaches which involve inversion of Vandermonde matrices. We generalize our constructions to explore the trade off between computation communication and fault tolerance. 4) We propose a numerically stable specialization of Lagrange coded computing. Motivated by our condition number bound, our approach involves the choice of evaluation points and a suitable decoding procedure that involves inversion of an appropriate Chebyshev Vandermonde matrix. Our approach is demonstrated empirically to have lower numerical errors as compared to standard methods.


The support of dually epi translation invariant valuations on convex functions. We study dually epi translation invariant valuations on cones of convex functions containing the space of finite valued convex functions. The existence of a homogeneous decomposition is used to associate a distribution to every valuation of this type similar to the Goodey Weil embedding for translation invariant valuations on convex bodies. The relation between the valuation and its associated distribution is used to establish a notion of support for valuations. As an application, we show that there are no mathrm SL (n) or translation invariant valuations except constant valuations in this class and we discuss which valuations on finite valued convex functions can be extended to larger cones. In addition, we examine some topological properties of spaces of valuations with compact support.


Pose Estimation for Vehicle mounted Cameras via Horizontal and Vertical Planes. We propose two novel solvers for estimating the egomotion of a calibrated camera mounted to a moving vehicle from a single affine correspondence via recovering special homographies. For the first class of solvers, the sought plane is expected to be perpendicular to one of the camera axes. For the second class, the plane is orthogonal to the ground with unknown normal, e.g., it is a building facade. Both methods are solved via a linear system with a small coefficient matrix, thus, being extremely efficient. Both the minimal and over determined cases can be solved by the proposed methods. They are tested on synthetic data and on publicly available real world datasets. The novel methods are more accurate or comparable to the traditional algorithms and are faster when included in state of the art robust estimators.


Model Interpretability through the Lens of Computational Complexity. In spite of several claims stating that some models are more interpretable than others e.g., "linear models are more interpretable than deep neural networks" we still lack a principled notion of interpretability to formally compare among different classes of models. We make a step towards such a notion by studying whether folklore interpretability claims have a correlate in terms of computational complexity theory. We focus on local post hoc explainability queries that, intuitively, attempt to answer why individual inputs are classified in a certain way by a given model. In a nutshell, we say that a class mathcal C 1 of models is more interpretable than another class mathcal C 2 , if the computational complexity of answering post hoc queries for models in mathcal C 2 is higher than for those in mathcal C 1 . We prove that this notion provides a good theoretical counterpart to current beliefs on the interpretability of models in particular, we show that under our definition and assuming standard complexity theoretical assumptions (such as P neq NP), both linear and tree based models are strictly more interpretable than neural networks. Our complexity analysis, however, does not provide a clear cut difference between linear and tree based models, as we obtain different results depending on the particular post hoc explanations considered. Finally, by applying a finer complexity analysis based on parameterized complexity, we are able to prove a theoretical result suggesting that shallow neural networks are more interpretable than deeper ones.


Interpreting OWL Complex Classes in AutomationML based on Bidirectional Translation. The World Wide Web Consortium (W3C) has published several recommendations for building and storing ontologies, including the most recent OWL 2 Web Ontology Language (OWL). These initiatives have been followed by practical implementations that popularize OWL in various domains. For example, OWL has been used for conceptual modeling in industrial engineering, and its reasoning facilities are used to provide a wealth of services, e.g. model diagnosis, automated code generation, and semantic integration. More specifically, recent studies have shown that OWL is well suited for harmonizing information of engineering tools stored as AutomationML (AML) files. However, OWL and its tools can be cumbersome for direct use by engineers such that an ontology expert is often required in practice. Although much attention has been paid in the literature to overcome this issue by transforming OWL ontologies from to AML models automatically, dealing with OWL complex classes remains an open research question. In this paper, we introduce the AML concept models for representing OWL complex classes in AutomationML, and present algorithms for the bidirectional translation between OWL complex classes and their corresponding AML concept models. We show that this approach provides an efficient and intuitive interface for nonexperts to visualize, modify, and create OWL complex classes.


Characteristics of Dataset Retrieval Sessions Experiences from a Real life Digital Library. Secondary analysis or the reuse of existing survey data is a common practice among social scientists. Searching for relevant datasets in Digital Libraries is a somehow unfamiliar behaviour for this community. Dataset retrieval, especially in the social sciences, incorporates additional material such as codebooks, questionnaires, raw data files and more. Our assumption is that due to the diverse nature of datasets, document retrieval models often do not work as efficiently for retrieving datasets. One way of enhancing these types of searches is to incorporate the users' interaction context in order to personalise dataset retrieval sessions. As a first step towards this long term goal, we study characteristics of dataset retrieval sessions from a real life Digital Library for the social sciences that incorporates both research data and publications. Previous studies reported a way of discerning queries between document search and dataset search by query length. In this paper, we argue the claim and report our findings of an indistinguishability of queries, whether aiming for a dataset or a document. Amongst others, we report our findings of dataset retrieval sessions with respect to query characteristics, interaction sequences and topical drift within 65,000 unique sessions.


Super Selfish Self Supervised Learning on Images with PyTorch. Super Selfish is an easy to use PyTorch framework for image based self supervised learning. Features can be learned with 13 algorithms that span from simple classification to more complex state of theart contrastive pretext tasks. The framework is easy to use and allows for pretraining any PyTorch neural network with only two lines of code. Simultaneously, full flexibility is maintained through modular design choices. The code can be found at https github.com MECLabTUDA Super Selfish and installed using pip install super selfish.


Limit theorems for topological invariants of the dynamic multi parameter simplicial complex. Topological study of existing random simplicial complexes is non trivial and has led to several seminal works. However, the applicability of such studies is limited since the randomness there is usually governed by a single parameter. With this in mind, we focus here on the topology of the recently proposed multi parameter random simplicial complex and, more importantly, of its dynamic analogue that we introduce here. In this dynamic setup, the temporal evolution of simplices is determined by stationary and possibly non Markovian processes with a renewal structure. The dynamic versions of the clique complex and the Linial Meshulum complex are special cases of our setup. Our key result concerns the regime where face counts of a particular dimension dominate. We show that the Betti numbers corresponding to this dimension and the Euler characteristic satisfy functional strong law of large numbers and functional central limit theorems. Surprisingly, in the latter result, the limiting Gaussian process depends only upon the dynamics in the smallest non trivial dimension.


Method and Dataset Entity Mining in Scientific Literature A CNN Bi LSTM Model with Self attention. Literature analysis facilitates researchers to acquire a good understanding of the development of science and technology. The traditional literature analysis focuses largely on the literature metadata such as topics, authors, abstracts, keywords, references, etc., and little attention was paid to the main content of papers. In many scientific domains such as science, computing, engineering, etc., the methods and datasets involved in the scientific papers published in those domains carry important information and are quite useful for domain analysis as well as algorithm and dataset recommendation. In this paper, we propose a novel entity recognition model, called MDER, which is able to effectively extract the method and dataset entities from the main textual content of scientific papers. The model utilizes rule embedding and adopts a parallel structure of CNN and Bi LSTM with the self attention mechanism. We evaluate the proposed model on datasets which are constructed from the published papers of four research areas in computer science, i.e., NLP, CV, Data Mining and AI. The experimental results demonstrate that our model performs well in all the four areas and it features a good learning capacity for cross area learning and recognition. We also conduct experiments to evaluate the effectiveness of different building modules within our model which indicate that the importance of different building modules in collectively contributing to the good entity recognition performance as a whole. The data augmentation experiments on our model demonstrated that data augmentation positively contributes to model training, making our model much more robust in dealing with the scenarios where only small number of training samples are available. We finally apply our model on PAKDD papers published from 2009 2019 to mine insightful results from scientific papers published in a longer time span.


A local input to state stability result w.r.t. attractors of nonlinear reaction diffusion equations. We establish the local input to state stability of a large class of disturbed nonlinear reaction diffusion equations w.r.t. the global attractor of the respective undisturbed system.


Algebraic Manipulation Detection Codes via Highly Nonlinear Functions. In this paper, we study the relationship between algebraic manipulation detection (AMD) codes and highly nonlinear functions. As applications, on one hand, a generic construction for systematic AMD codes is introduced based on highly nonlinear functions. Systematic AMD codes with new parameters can be generated from known highly nonlinear functions. Especially, several infinite classes of optimal systematic AMD codes, some with asymptotically optimal tag size, can be constructed. On the other hand, systematic AMD codes are used to construct highly nonlinear functions. The known construction by Cramer et al. 10 for systematic AMD codes turns out to be based on a special kind of functions with high nonlinearity.