Learning Off Policy with Online Planning. Reinforcement learning (RL) in low data and risk sensitive domains requires performant and flexible deployment policies that can readily incorporate constraints during deployment. One such class of policies are the semi parametric H step lookahead policies, which select actions using trajectory optimization over a dynamics model for a fixed horizon with a terminal value function. In this work, we investigate a novel instantiation of H step lookahead with a learned model and a terminal value function learned by a model free off policy algorithm, named Learning Off Policy with Online Planning (LOOP). We provide a theoretical analysis of this method, suggesting a tradeoff between model errors and value function errors and empirically demonstrate this tradeoff to be beneficial in deep reinforcement learning. Furthermore, we identify the "Actor Divergence" issue in this framework and propose Actor Regularized Control (ARC), a modified trajectory optimization procedure. We evaluate our method on a set of robotic tasks for Offline and Online RL and demonstrate improved performance. We also show the flexibility of LOOP to incorporate safety constraints during deployment with a set of navigation environments. We demonstrate that LOOP is a desirable framework for robotics applications based on its strong performance in various important RL settings. Project video and details can be found at https hari sikchi.github.io loop .


Intercultural Science Art Project 'Magritte Meet Science'. In this manuscript a joint project between young researchers from all around the world, the Intercultural Science Art Project, is presented, in which all participants interpreted their own research with art. Art is meant in the most inclusive way possible, including drawings and digital works, but also songs and confectionary art. This project has two main goals. On the one hand it creates tools for young scientists to communicate their research to society by artistic means. On the other hand it tries to bring together different cultures and to strengthen ties between them.


Conics associated with totally degenerate curves. Let k be a field. Let X k be a stable curve whose geometric irreducible components are smooth rational curves. Taking Stein factorization of its normalization, we get a conic. We show the conic is non split in certain cases. As an application, we show for g geq3 , the period and index of the universal genus g curve both equal to 2g 2 .


Explicit zero density estimate for the Riemann zeta function near the critical line. In 1946, A. Selberg proved N( sigma,T) ll T 1 frac 1 4 left( sigma frac 1 2 right) log T where N( sigma,T) is the number of nontrivial zeros rho of the Riemann zeta function with Re rho sigma and 0 Im rho leq T . We provide an explicit version of this estimate, together with an explicit approximate functional equation and an explicit upper bound for the second power moment of the zeta function on the critical line.


Existence results for doubly nonlinear parabolic equations with two lower order terms and L 1 data. We investigate the existence of a renormalized solution for a class of nonlinear parabolic equations with two lower order terms and L 1 data.


Transfer Learning based Road Damage Detection for Multiple Countries. Many municipalities and road authorities seek to implement automated evaluation of road damage. However, they often lack technology, know how, and funds to afford state of the art equipment for data collection and analysis of road damages. Although some countries, like Japan, have developed less expensive and readily available Smartphone based methods for automatic road condition monitoring, other countries still struggle to find efficient solutions. This work makes the following contributions in this context. Firstly, it assesses the usability of the Japanese model for other countries. Secondly, it proposes a large scale heterogeneous road damage dataset comprising 26620 images collected from multiple countries using smartphones. Thirdly, we propose generalized models capable of detecting and classifying road damages in more than one country. Lastly, we provide recommendations for readers, local agencies, and municipalities of other countries when one other country publishes its data and model for automatic road damage detection and classification. Our dataset is available at (https github.com sekilab RoadDamageDetector ).


Small cap decouplings. We develop a toolbox for proving decouplings into boxes with diameter smaller than the canonical scale. As an application of this new technique, we solve three problems for which earlier methods have failed. We start by verifying the small cap decoupling for the parabola. Then we find sharp estimates for exponential sums with small frequency separation on the moment curve in mathbb R 3 . This part of the work relies on recent improved Kakeya type estimates for planar tubes, as well as on new multilinear incidence bounds for plates and planks. We also combine our method with the recent advance on the reverse square function estimate, in order to prove small cap decoupling into square like caps for the two dimensional cone. The Appendix by Roger Heath Brown contains an application of the new exponential sum estimates for the moment curve, to the Riemann zeta function.


Integrating Privacy Enhancing Techniques into Blockchains Using Sidechains. Blockchains are turning into decentralized computing platforms and are getting worldwide recognition for their unique advantages. There is an emerging trend beyond payments that blockchains could enable a new breed of decentralized applications, and serve as the foundation for Internet's security infrastructure. The immutable nature of the blockchain makes it a winner on security and transparency it is nearly inconceivable for ledgers to be altered in a way not instantly clear to every single user involved. However, most blockchains fall short in privacy aspects, particularly in data protection. Garlic Routing and Onion Routing are two of major Privacy Enhancing Techniques (PETs) which are popular for anonymization and security. Garlic Routing is a methodology using by I2P Anonymous Network to hide the identity of sender and receiver of data packets by bundling multiple messages into a layered encryption structure. The Onion Routing attempts to provide lowlatency Internet based connections that resist traffic analysis, deanonymization attack, eavesdropping, and other attacks both by outsiders (e.g. Internet routers) and insiders (Onion Routing servers themselves). As there are a few controversies over the rate of resistance of these two techniques to privacy attacks, we propose a PET Enabled Sidechain (PETES) as a new privacy enhancing technique by integrating Garlic Routing and Onion Routing into a Garlic Onion Routing (GOR) framework suitable to the structure of blockchains. The preliminary proposed GOR aims to improve the privacy of transactions in blockchains via PETES structure.


Low degree points on curves. In this paper we investigate an arithmetic analogue of the gonality of a smooth projective curve C over a number field k the minimal e such there are infinitely many points P in C( bar k ) with k(P) k leq e . Developing techniques that make use of an auxiliary smooth surface containing the curve, we show that this invariant can take any value subject to constraints imposed by the gonality. Building on work of Debarre Klassen, we show that this invariant is equal to the gonality for all sufficiently ample curves on a surface S with trivial irregularity.


Document Level Relation Extraction with Adaptive Thresholding and Localized Context Pooling. Document level relation extraction (RE) poses new challenges compared to its sentence level counterpart. One document commonly contains multiple entity pairs, and one entity pair occurs multiple times in the document associated with multiple possible relations. In this paper, we propose two novel techniques, adaptive thresholding and localized context pooling, to solve the multi label and multi entity problems. The adaptive thresholding replaces the global threshold for multi label classification in the prior work with a learnable entities dependent threshold. The localized context pooling directly transfers attention from pre trained language models to locate relevant context that is useful to decide the relation. We experiment on three document level RE benchmark datasets DocRED, a recently released large scale RE dataset, and two datasets CDRand GDA in the biomedical domain. Our ATLOP (Adaptive Thresholding and Localized cOntext Pooling) model achieves an F1 score of 63.4, and also significantly outperforms existing models on both CDR and GDA.


LiftFormer 3D Human Pose Estimation using attention models. Estimating the 3D position of human joints has become a widely researched topic in the last years. Special emphasis has gone into defining novel methods that extrapolate 2 dimensional data (keypoints) into 3D, namely predicting the root relative coordinates of joints associated to human skeletons. The latest research trends have proven that the Transformer Encoder blocks aggregate temporal information significantly better than previous approaches. Thus, we propose the usage of these models to obtain more accurate 3D predictions by leveraging temporal information using attention mechanisms on ordered sequences human poses in videos. Our method consistently outperforms the previous best results from the literature when using both 2D keypoint predictors by 0.3 mm (44.8 MPJPE, 0.7 improvement) and ground truth inputs by 2mm (MPJPE 31.9, 8.4 improvement) on Human3.6M. It also achieves state of the art performance on the HumanEva I dataset with 10.5 P MPJPE (22.2 reduction). The number of parameters in our model is easily tunable and is smaller (9.5M) than current methodologies (16.95M and 11.25M) whilst still having better performance. Thus, our 3D lifting model's accuracy exceeds that of other end to end or SMPL approaches and is comparable to many multi view methods.


Comparison Between, and Validation Against an Experiment of, a Slowly Varying Envelope Approximation Code and a Particle in Cell Simulation Code for Free Electron Lasers. Free electron lasers (FELs) operate at wavelengths down to hard x rays, and are either seeded or start from noise. There is increasing interest in x ray FELs that rely on Self Amplified Spontaneous Emission (SASE), and this involves increasing simulation activity in the design, optimization, and characterization of these x ray FELs. Most of the simulation codes in use rely on the Slowly Varying Envelope Approximation (SVEA) in which Maxwell's equations are averaged over the fast time scale resulting in relatively small computational requirements. While the SVEA codes are generally successful, the predictions of these codes sometimes differ in various aspects of the FEL interaction. In contrast, Particle in Cell (PiC) simulation codes do not average Maxwell's equations and are considered to be a more complete model of the underlying physics.Unfortunately, they require much longer run times than SVEA codes and have not been validated by comparison with experiment as often as the SVEA codes. In order to remedy this, and to resolve issues that arise due to different predictions between the SVEA codes, we present a comparison between one SVEA code (MINERVA) and a PiC simulation code (PUFFIN) with the experimental measurements obtained at the SPARC SASE FEL experiment at ENEA Frascati. The results show good agreement between the two codes and between the codes and the experiment. Since the formulations of the two codes share no common elements, this validates both formulations and demonstrates the capability to model the FEL interaction from the start of teh undulator through the undulator and into deep saturation.


Towards Deterministic Decomposable Circuits for Safe Queries. There exist two approaches for exact probabilistic inference of UCQs on tuple independent databases. In the extensional approach, query evaluation is performed within a DBMS by exploiting the structure of the query. In the intensional approach, one first builds a representation of the lineage of the query on the database, then computes the probability of the lineage. In this paper we propose a new technique to construct lineage representations as deterministic decomposable circuits in PTIME. The technique can apply to a class of UCQs that has been conjectured to separate the complexity of the two approaches. We test our technique experimentally, and show that it succeeds on all the queries of this class up to a certain size parameter, i.e., over 20 million queries.


Multiple Word Embeddings for Increased Diversity of Representation. Most state of the art models in natural language processing (NLP) are neural models built on top of large, pre trained, contextual language models that generate representations of words in context and are fine tuned for the task at hand. The improvements afforded by these "contextual embeddings" come with a high computational cost. In this work, we explore a simple technique that substantially and consistently improves performance over a strong baseline with negligible increase in run time. We concatenate multiple pre trained embeddings to strengthen our representation of words. We show that this concatenation technique works across many tasks, datasets, and model types. We analyze aspects of pre trained embedding similarity and vocabulary coverage and find that the representational diversity between different pre trained embeddings is the driving force of why this technique works. We provide open source implementations of our models in both TensorFlow and PyTorch.


TextBrewer An Open Source Knowledge Distillation Toolkit for Natural Language Processing. In this paper, we introduce TextBrewer, an open source knowledge distillation toolkit designed for natural language processing. It works with different neural network models and supports various kinds of supervised learning tasks, such as text classification, reading comprehension, sequence labeling. TextBrewer provides a simple and uniform workflow that enables quick setting up of distillation experiments with highly flexible configurations. It offers a set of predefined distillation methods and can be extended with custom code. As a case study, we use TextBrewer to distill BERT on several typical NLP tasks. With simple configurations, we achieve results that are comparable with or even higher than the public distilled BERT models with similar numbers of parameters. Our toolkit is available through http textbrewer.hfl rc.com


Strong complete minors in digraphs. Kostochka and Thomason independently showed that any graph with average degree Omega(r sqrt log r ) contains a K r minor. In particular, any graph with chromatic number Omega(r sqrt log r ) contains a K r minor, a partial result towards Hadwiger's famous conjecture. In this paper, we investigate analogues of these results in the directed setting. There are several ways to define a minor in a digraph. One natural way is as follows. A strong overrightarrow K r minor is a digraph whose vertex set is partitioned into r parts such that each part induces a strongly connected subdigraph, and there is at least one edge in each direction between any two distinct parts. We investigate bounds on the dichromatic number and minimum out degree of a digraph that force the existence of strong overrightarrow K r minors as subdigraphs. In particular, we show that any tournament with dichromatic number at least 2r contains a strong overrightarrow K r minor, and any tournament with minimum out degree Omega(r sqrt log r ) also contains a strong overrightarrow K r minor. The latter result is tight up to the implied constant, and may be viewed as a strong minor analogue to the classical result of Kostochka and Thomason. Lastly, we show that there is no function f mathbb N rightarrow mathbb N such that any digraph with minimum out degree at least f(r) contains a strong overrightarrow K r minor, but such a function exists when considering dichromatic number.


Virtual Reality for Robots. This paper applies the principles of Virtual Reality (VR) to robots, rather than living organisms. A simulator, of either physical states or information states, renders outputs to custom displays that fool the robot's sensors. This enables a robot to experience a combination of real and virtual sensor inputs, combining the efficiency of simulation and the benefits of real world sensor inputs. Thus, the robot can be taken through targeted experiences that are more realistic than pure simulation, yet more feasible and controllable than pure real world experiences. We define two distinctive methods for applying VR to robots, namely black box and white box based on these methods we identify potential applications, such as testing and verification procedures that are better than simulation, the study of spoofing attacks and anti spoofing techniques, and sample generation for machine learning. A general mathematical framework is presented, along with a simple experiment, detailed examples, and discussion of the implications.


CQ VAE Coordinate Quantized VAE for Uncertainty Estimation with Application to Disk Shape Analysis from Lumbar Spine MRI Images. Ambiguity is inevitable in medical images, which often results in different image interpretations (e.g. object boundaries or segmentation maps) from different human experts. Thus, a model that learns the ambiguity and outputs a probability distribution of the target, would be valuable for medical applications to assess the uncertainty of diagnosis. In this paper, we propose a powerful generative model to learn a representation of ambiguity and to generate probabilistic outputs. Our model, named Coordinate Quantization Variational Autoencoder (CQ VAE) employs a discrete latent space with an internal discrete probability distribution by quantizing the coordinates of a continuous latent space. As a result, the output distribution from CQ VAE is discrete. During training, Gumbel Softmax sampling is used to enable backpropagation through the discrete latent space. A matching algorithm is used to establish the correspondence between model generated samples and "ground truth" samples, which makes a trade off between the ability to generate new samples and the ability to represent training samples. Besides these probabilistic components to generate possible outputs, our model has a deterministic path to output the best estimation. We demonstrated our method on a lumbar disk image dataset, and the results show that our CQ VAE can learn lumbar disk shape variation and uncertainty.


Throughput Scaling of Covert Communication over Wireless Adhoc Networks. We consider the problem of covert communication over wireless adhoc networks in which (roughly) n legitimate nodes (LNs) and n kappa for 0 kappa 1 non communicating warden nodes (WNs) are randomly distributed in a square of unit area. Each legitimate source wants to communicate with its intended destination node while ensuring that every WN is unable to detect the presence of the communication. In this scenario, we study the throughput scaling law. Due the covert communication constraint, the transmit powers are necessarily limited. Under this condition, we introduce a preservation region around each WN. This region serves to prevent transmission from the LNs and to increase the transmit power of the LNs outside the preservation regions. For the achievability results, multi hop (MH), hierarchical cooperation (HC), and hybrid HC MH schemes are utilized with some appropriate modifications. In the proposed MH and hybrid schemes, because the preservation regions may impede communication along direct data paths, the data paths are suitably modified by taking a detour around each preservation region. To avoid the concentration of detours resulting extra relaying burdens, we distribute the detours evenly over a wide region. In the proposed HC scheme, we control the symbol power and the scheduling of distributed multiple input multiple output transmission. We also present matching upper bounds on the throughput scaling under the assumption that every active LN consumes the same average transmit power over the time period in which the WNs observe the channel outputs.


Differential Viewpoints for Ground Terrain Material Recognition. Computational surface modeling that underlies material recognition has transitioned from reflectance modeling using in lab controlled radiometric measurements to image based representations based on internet mined single view images captured in the scene. We take a middle ground approach for material recognition that takes advantage of both rich radiometric cues and flexible image capture. A key concept is differential angular imaging, where small angular variations in image capture enables angular gradient features for an enhanced appearance representation that improves recognition. We build a large scale material database, Ground Terrain in Outdoor Scenes (GTOS) database, to support ground terrain recognition for applications such as autonomous driving and robot navigation. The database consists of over 30,000 images covering 40 classes of outdoor ground terrain under varying weather and lighting conditions. We develop a novel approach for material recognition called texture encoded angular network (TEAN) that combines deep encoding pooling of RGB information and differential angular images for angular gradient features to fully leverage this large dataset. With this novel network architecture, we extract characteristics of materials encoded in the angular and spatial gradients of their appearance. Our results show that TEAN achieves recognition performance that surpasses single view performance and standard (non differential large angle sampling) multiview performance.


Lebesgue type inequalities in greedy approximation. We present new results regarding Lebesgue type inequalities for the Weak Chebyshev Greedy Algorithm (WCGA) in uniformly smooth Banach spaces. We improve earlier bounds in Temlyakov (Forum Math Sigma 2014), for dictionaries satisfying a new property introduced here. We apply these results to derive optimal bounds in two natural examples of sequence spaces. In particular, optimality is obtained in the case of the multivariate Haar system in Lp with 1 p 2, under the Littlewood Paley norm.


Linearity of some low complexity mapping class groups. By analyzing known presentations of the pure mapping groups of orientable surfaces of genus g with b boundary components and n punctures, we show that these groups are isomorphic to some groups related to the braid groups and the Artin group of type D 4 in the cases when g 0 with b and n arbitrary, and when g 1 and b n is at most 3 . As a corollary, we conclude that the pure mapping class groups are linear in these cases.


Sampled Limited Memory Methods for Massive Linear Inverse Problems. In many modern imaging applications the desire to reconstruct high resolution images, coupled with the abundance of data from acquisition using ultra fast detectors, have led to new challenges in image reconstruction. A main challenge is that the resulting linear inverse problems are massive. The size of the forward model matrix exceeds the storage capabilities of computer memory, or the observational dataset is enormous and not available all at once. Row action methods that iterate over samples of rows can be used to approximate the solution while avoiding memory and data availability constraints. However, their overall convergence can be slow. In this paper, we introduce a sampled limited memory row action method for linear least squares problems, where an approximation of the global curvature of the underlying least squares problem is used to speed up the initial convergence and to improve the accuracy of iterates. We show that this limited memory method is a generalization of the damped block Kaczmarz method, and we prove linear convergence of the expectation of the iterates and of the error norm up to a convergence horizon. Numerical experiments demonstrate the benefits of these sampled limited memory row action methods for massive 2D and 3D inverse problems in tomography applications.


Towards Forward Secure Internet Traffic. Forward Secrecy (FS) is a security property in key exchange algorithms which guarantees that a compromise in the secrecy of a long term private key does not compromise the secrecy of past session keys. With a growing awareness of long term mass surveillance programs by governments and others, FS has become widely regarded as a highly desirable property. This is particularly true in the TLS protocol, which is used to secure Internet communication. In this paper, we investigate FS in pre TLS 1.3 protocols, which do not mandate FS, but still widely used today. We conduct an empirical analysis of over 10 million TLS servers from three different datasets using a novel heuristic approach. Using a modern TLS client handshake algorithms, our results show 5.37 of top domains, 7.51 of random domains, and 26.16 of random IPs do not select FS key exchange algorithms. Surprisingly, 39.20 of the top domains, 24.40 of the random domains, and 14.46 of the random IPs that do not select FS, do support FS. In light of this analysis, we discuss possible paths toward forward secure Internet traffic. As an improvement of the current state, we propose a new client side mechanism that we call "Best Effort Forward Secrecy" (BEFS), and an extension of it that we call "Best Effort Forward Secrecy and Authenticated Encryption" (BESAFE), which aims to guide (force) misconfigured servers to FS using a best effort approach. Finally, within our analysis, we introduce a novel adversarial model that we call "discriminatory" adversary, which is applicable to the TLS protocol.


Hodge ideals and minimal exponents of ideals. We define and study Hodge ideals associated to a coherent ideal sheaf J on a smooth complex variety, via algebraic constructions based on the already existing concept of Hodge ideals associated to Q divisors. We also define the generic minimal exponent of J, extending the standard invariant for hypersurfaces. We relate it to Hodge ideals, and show that it is a root of the Bernstein Sato polynomial of J.


On the Efficient Design of LSM Stores. In the last decade, key value data storage systems have gained significantly more interest from academia and industry. These systems face numerous challenges concerning storage space and read optimization. There exists a large potential for improving current solutions by introducing new management techniques and algorithms. In this paper we give an overview of the basic concept of key value data storage systems and provide an explanation for bottlenecks. Further we introduce two new memory management algorithms and a improved index structure. Finally, these solutions are compared to each other and discussed.


Unsupervised Text Summarization via Mixed Model Back Translation. Back translation based approaches have recently lead to significant progress in unsupervised sequence to sequence tasks such as machine translation or style transfer. In this work, we extend the paradigm to the problem of learning a sentence summarization system from unaligned data. We present several initial models which rely on the asymmetrical nature of the task to perform the first back translation step, and demonstrate the value of combining the data created by these diverse initialization methods. Our system outperforms the current state of the art for unsupervised sentence summarization from fully unaligned data by over 2 ROUGE, and matches the performance of recent semi supervised approaches.


Boundedness in families with applications to arithmetic hyperbolicity. Motivated by conjectures of Demailly, Green Griffiths, Lang, and Vojta, we show that several notions related to hyperbolicity behave similarly in families. We apply our results to show the persistence of arithmetic hyperbolicity along field extensions for projective surfaces with nonzero irregularity. These results rely on the mild boundedness of semi abelian varieties. We also introduce and study the notion of pseudo algebraic hyperbolicity which extends Demailly's notion of algebraic hyperbolicity for projective schemes.


Inequivalent complexity criteria for free boundary minimal surfaces. We obtain a series of results in the global theory of free boundary minimal surfaces, which in particular provide a rather complete picture for the way different complexity criteria, such as area, topology and Morse index compare, beyond the regime where effective estimates are at disposal.


Amplitude and phase resolved nano imaging and nano spectroscopy of polaritons in liquid environment. Localized and propagating polaritons allow for highly sensitive analysis of (bio)chemical substances and processes. Nanoimaging of the polaritons evanescent fields allows for critically important experimental mode identification and for studying field confinement. Here we describe two setups for polariton nanoimaging and spectroscopy in liquid, which is an indispensable environment for (bio)chemical samples. We first demonstrate antenna mapping with a transflection infrared scattering type scanning near field optical microscope (s SNOM), where the tip acts as a near field scattering probe. We then demonstrate a total internal reflection (TIR) based setup, where the tip is both launching and probing ultra confined polaritons in van der Waals materials, here phonon polaritons in hexagonal boron nitride (h BN) flakes. This work lays the foundation for s SNOM based polariton interferometry in liquid, which has wide application potential for in situ studies of chemical reactions at the bare or functionalized surface of polaritonic materials, including (bio)chemical recognition analogous to the classical surface plasmon resonance spectroscopy.


Multi hop Byzantine Reliable Broadcast with Honest Dealer Made Practical. We revisit Byzantine tolerant reliable broadcast with honest dealer algorithms in multi hop networks. To tolerate Byzantine faulty nodes arbitrarily spread over the network, previous solutions require a factorial number of messages to be sent over the network if the messages are not authenticated (e.g. digital signatures are not available). We propose modifications that preserve the safety and liveness properties of the original unauthenticated protocols, while highly decreasing their observed message complexity when simulated on several classes of graph topologies, potentially opening to their employment.


Towards Spatial Variability Aware Deep Neural Networks (SVANN) A Summary of Results. Spatial variability has been observed in many geo phenomena including climatic zones, USDA plant hardiness zones, and terrestrial habitat types (e.g., forest, grasslands, wetlands, and deserts). However, current deep learning methods follow a spatial one size fits all(OSFA) approach to train single deep neural network models that do not account for spatial variability. In this work, we propose and investigate a spatial variability aware deep neural network(SVANN) approach, where distinct deep neural network models are built for each geographic area. We evaluate this approach using aerial imagery from two geographic areas for the task of mapping urban gardens. The experimental results show that SVANN provides better performance than OSFA in terms of precision, recall,and F1 score to identify urban gardens.


Nonnegativity of the CR Paneitz operator for embeddable CR manifolds. The nonnegativity of the CR Paneitz operator plays a crucial role in three dimensional CR geometry. In this paper, we prove this nonnegativity for embeddable CR manifolds. This result and previous works give an affirmative solution of the CR Yamabe problem for embeddable CR manifolds. We also show the existence of a contact form with zero CR Q curvature, and generalize the total Q prime curvature to embeddable CR manifolds with no pseudo Einstein contact forms. Furthermore, we discuss the logarithmic singularity of the Szeg H o kernel.


Planar Rectilinear Drawings of Outerplanar Graphs in Linear Time. We show how to test in linear time whether an outerplanar graph admits a planar rectilinear drawing, both if the graph has a prescribed plane embedding that the drawing has to respect and if it does not. Our algorithm returns a planar rectilinear drawing if the graph admits one.


Algorithmic properties of inverse monoids with hyperbolic and tree like Sch "utzenberger graphs. We prove that the class of finitely presented inverse monoids whose Sch "utzenberger graphs are quasi isometric to trees has a uniformly solvable word problem, furthermore, the languages of their Sch "utzenberger automata are context free. On the other hand, we show that there is a finitely presented inverse monoid with hyperbolic Sch "utzenberger graphs and an unsolvable word problem.


DeepTEGINN Deep Learning Based Tools to Extract Graphs from Images of Neural Networks. In the brain, the structure of a network of neurons defines how these neurons implement the computations that underlie the mind and the behavior of animals and humans. Provided that we can describe the network of neurons as a graph, we can employ methods from graph theory to investigate its structure or use cellular automata to mathematically assess its function. Although, software for the analysis of graphs and cellular automata are widely available. Graph extraction from the image of networks of brain cells remains difficult. Nervous tissue is heterogeneous, and differences in anatomy may reflect relevant differences in function. Here we introduce a deep learning based toolbox to extracts graphs from images of brain tissue. This toolbox provides an easy to use framework allowing system neuroscientists to generate graphs based on images of brain tissue by combining methods from image processing, deep learning, and graph theory. The goals are to simplify the training and usage of deep learning methods for computer vision and facilitate its integration into graph extraction pipelines. In this way, the toolbox provides an alternative to the required laborious manual process of tracing, sorting and classifying. We expect to democratize the machine learning methods to a wider community of users beyond the computer vision experts and improve the time efficiency of graph extraction from large brain image datasets, which may lead to further understanding of the human mind.


Direct Measurement of Folding Angle and Strain Vector in Atomically thin WS 2 using Second Harmonic Generation. Structural engineering techniques such as local strain engineering and folding provide functional control over critical optoelectronic properties of 2D materials. Accurate monitoring of local strain vector (both strain amplitude and direction) and folding angle in 2D materials is important to optimize the device performance. Conventionally, the accurate measurement of both strain amplitude and direction requires the combined usage of multiple tools, such as atomic force microscopy (AFM), electron microscopy, Raman spectroscopy, etc. Here, we demonstrated the usage of a single tool, polarization dependent second harmonic generation (SHG) imaging, to determine the folding angle and strain vector accurately in atomically thin tungsten disulfide (WS2). We find that trilayer WS2 folds with folding angle of 600 show 9 times SHG enhancement due to vector superposition of SH wave vectors coming from the individual folding layers. Strain dependent SHG quenching and enhancement is found parallel and perpendicular respectively to the direction of the compressive strain vector. However, despite a variation in strain angle, the total SHG remains constant which allows us to determine the local strain vector accurately using photoelastic approach. We also demonstrate that band nesting induced transition (C peak) can highly enhance SHG, which can be significantly modulated by strain. Our results would pave the way to enable novel applications of the TMDs in nonlinear optical device.


Exploration Based Language Learning for Text Based Games. This work presents an exploration and imitation learning based agent capable of state of the art performance in playing text based computer games. Text based computer games describe their world to the player through natural language and expect the player to interact with the game using text. These games are of interest as they can be seen as a testbed for language understanding, problem solving, and language generation by artificial agents. Moreover, they provide a learning environment in which these skills can be acquired through interactions with an environment rather than using fixed corpora. One aspect that makes these games particularly challenging for learning agents is the combinatorially large action space. Existing methods for solving text based games are limited to games that are either very simple or have an action space restricted to a predetermined set of admissible actions. In this work, we propose to use the exploration approach of Go Explore for solving text based games. More specifically, in an initial exploration phase, we first extract trajectories with high rewards, after which we train a policy to solve the game by imitating these trajectories. Our experiments show that this approach outperforms existing solutions in solving text based games, and it is more sample efficient in terms of the number of interactions with the environment. Moreover, we show that the learned policy can generalize better than existing solutions to unseen games without using any restriction on the action space.


Constructing Clustering Transformations. Clustering is one of the fundamental tasks in data analytics and machine learning. In many situations, different clusterings of the same data set become relevant. For example, different algorithms for the same clustering task may return dramatically different solutions. We are interested in applications in which one clustering has to be transformed into another e.g., when a gradual transition from an old solution to a new one is required. In this paper, we devise methods for constructing such a transition based on linear programming and network theory. We use a so called clustering difference graph to model the desired transformation and provide methods for decomposing the graph into a sequence of elementary moves that accomplishes the transformation. These moves are equivalent to the edge directions, or circuits, of the underlying partition polytopes. Therefore, in addition to a conceptually new metric for measuring the distance between clusterings, we provide new bounds on the circuit diameter of these partition polytopes.


Automorphisms and Periods of Cubic Fourfolds. We classify the symplectic automorphism groups for cubic fourfolds. The main inputs are the global Torelli theorem for cubic fourfolds and the classification of the fixed point sublattices of the Leech lattice. Among the highlights of our results, we note that there are 34 possible groups of symplectic automorphisms, with 6 maximal cases. The six maximal cases correspond to 8 non isomorphic, and isolated in moduli, cubic fourfolds six of them previously identified by other authors. Finally, the Fermat cubic fourfold has the largest possible order (174,960) for the automorphism group (non necessarily symplectic) among all smooth cubic fourfolds.


Ultrahigh Responsivity Photodetectors of Two dimensional Covalent Organic Frameworks Integrated on Graphene. Two dimensional (2D) materials exhibit superior properties in electronic and optoelectronic fields. The wide demand for high performance optoelectronic devices promotes the exploration of diversified 2D materials. Recently, 2D covalent organic frameworks (COFs) have emerged as next generation layered materials with predesigned pi electronic skeletons and highly ordered topological structures, which are promising for tailoring their optoelectronic properties. However, COFs are usually produced as solid powders due to anisotropic growth, making them unreliable to integrate into devices. Here, by selecting tetraphenylethylene (TPE) monomers with photoelectric activity, we designed and synthesized photosensitive 2D COFs with highly ordered topologies and grew 2D COFs in situ on graphene to form well ordered COF graphene heterostructures. Ultrasensitive photodetectors were successfully fabricated with the COFETBC TAPT graphene heterostructure and exhibited an excellent overall performance. Moreover, due to the high surface area and the polarity selectivity of COFs, the photosensing properties of the photodetectors can be reversibly regulated by specific target molecules. Our research provides new strategies for building advanced functional devices with programmable material structures and diversified regulation methods, paving the way for a generation of high performance applications in optoelectronics and many other fields.


Strategic API Analysis and Planning APIS Technical Report. Traditionally, software APIs (application programming interfaces) have been viewed from a technical perspective, as a means to separate implementation from functional calls, and as a way to define a contract of software functionality. The technical benefits of APIs have been reported in numerous studies. Several reports from industry offer useful practical design considerations for APIs, including advice on collecting usage data, monetization strategies, and at what point to open an API to external parties. Although this advice can be useful, the focus is still often on the API, only without considering the role the API plays in the wider organization or how it fits into an organizational strategy. Our industrial experiences show that more information is needed about the challenges and best practices of API design and management in an organizational context. Furthermore, it has become apparent that APIs are able to play a key role as part of a strategic business plan for software intensive companies. In this report, we present the results of our work with companies to build a framework that synthesizes and summarizes API strategies from several perspectives, including strategic API lifecycle, lifecycle stage characteristics, lifecycle use cases and transition points, API layered architecture, BAPO, value modeling, ecosystem mapping with goal models, API metrics, goal models with metrics, and API governance guidance. Our research was carried out with an industry academic collaboration. The framework was developed iteratively through workshops and discussions with company partners. We show how conceptual frameworks can be used to drive API strategy development, drawing on our research with several companies in practice.


Conversational agents for learning foreign languages a survey. Conversational practice, while crucial for all language learners, can be challenging to get enough of and very expensive. Chatbots are computer programs developed to engage in conversations with humans. They are designed as software avatars with limited, but growing conversational capability. The most natural and potentially powerful application of chatbots is in line with their fundamental nature language practice. However, their role and outcomes within (in)formal language learning are currently tangential at best. Existing research in the area has generally focused on chatbots' comprehensibility and the motivation they inspire in their users. In this paper, we provide an overview of the chatbots for learning languages, critically analyze existing approaches, and discuss the major challenges for future work.


Learning Humanoid Robot Running Skills through Proximal Policy Optimization. In the current level of evolution of Soccer 3D, motion control is a key factor in team's performance. Recent works takes advantages of model free approaches based on Machine Learning to exploit robot dynamics in order to obtain faster locomotion skills, achieving running policies and, therefore, opening a new research direction in the Soccer 3D environment. In this work, we present a methodology based on Deep Reinforcement Learning that learns running skills without any prior knowledge, using a neural network whose inputs are related to robot's dynamics. Our results outperformed the previous state of the art sprint velocity reported in Soccer 3D literature by a significant margin. It also demonstrated improvement in sample efficiency, being able to learn how to run in just few hours. We reported our results analyzing the training procedure and also evaluating the policies in terms of speed, reliability and human similarity. Finally, we presented key factors that lead us to improve previous results and shared some ideas for future work.


PharML.Bind Pharmacologic Machine Learning for Protein Ligand Interactions. Is it feasible to create an analysis paradigm that can analyze and then accurately and quickly predict known drugs from experimental data? PharML.Bind is a machine learning toolkit which is able to accomplish this feat. Utilizing deep neural networks and big data, PharML.Bind correlates experimentally derived drug affinities and protein ligand X ray structures to create novel predictions. The utility of PharML.Bind is in its application as a rapid, accurate, and robust prediction platform for discovery and personalized medicine. This paper demonstrates that graph neural networks (GNNs) can be trained to screen hundreds of thousands of compounds against thousands of targets in minutes, a vastly shorter time than previous approaches. This manuscript presents results from training and testing using the entirety of BindingDB after cleaning this includes a test set with 19,708 X ray structures and 247,633 drugs, leading to 2,708,151 unique protein ligand pairings. PharML.Bind achieves a prodigious 98.3 accuracy on this test set in under 25 minutes. PharML.Bind is premised on the following key principles 1) speed and a high enrichment factor per unit compute time, provided by high quality training data combined with a novel GNN architecture and use of high performance computing resources, 2) the ability to generalize to proteins and drugs outside of the training set, including those with unknown active sites, through the use of an active site agnostic GNN mapping, and 3) the ability to be easily integrated as a component of increasingly complex prediction and analysis pipelines. PharML.Bind represents a timely and practical approach to leverage the power of machine learning to efficiently analyze and predict drug action on any practical scale and will provide utility in a variety of discovery and medical applications.


Theoretical Limitations of Self Attention in Neural Sequence Models. Transformers are emerging as the new workhorse of NLP, showing great success across tasks. Unlike LSTMs, transformers process input sequences entirely through self attention. Previous work has suggested that the computational capabilities of self attention to process hierarchical structures are limited. In this work, we mathematically investigate the computational power of self attention to model formal languages. Across both soft and hard attention, we show strong theoretical limitations of the computational abilities of self attention, finding that it cannot model periodic finite state languages, nor hierarchical structure, unless the number of layers or heads increases with input length. These limitations seem surprising given the practical success of self attention and the prominent role assigned to hierarchical structure in linguistics, suggesting that natural language can be approximated well with models that are too weak for the formal languages typically assumed in theoretical linguistics.


Training an Interactive Helper. Developing agents that can quickly adapt their behavior to new tasks remains a challenge. Meta learning has been applied to this problem, but previous methods require either specifying a reward function which can be tedious or providing demonstrations which can be inefficient. In this paper, we investigate if, and how, a "helper" agent can be trained to interactively adapt their behavior to maximize the reward of another agent, whom we call the "prime" agent, without observing their reward or receiving explicit demonstrations. To this end, we propose to meta learn a helper agent along with a prime agent, who, during training, observes the reward function and serves as a surrogate for a human prime. We introduce a distribution of multi agent cooperative foraging tasks, in which only the prime agent knows the objects that should be collected. We demonstrate that, from the emerged physical communication, the trained helper rapidly infers and collects the correct objects.


Higher order fluctuation fields and orthogonal duality polynomials. Inspired by the works in 1 and 8 we introduce what we call k th order fluctuation fields and study their scaling limits. This construction is done in the context of particle systems with the property of orthogonal self duality. This type of duality provides us with a setting in which we are able to interpret these fields as some type of discrete analogue of powers of the well known density fluctuation field. We show that the weak limit of the k th order field satisfies a recursive martingale problem that formally corresponds to the SPDE associated with the k th power of a generalized Ornstein Uhlenbeck process.


From type theory to setoids and back. A model of Martin L "of extensional type theory with universes is formalized in Agda, an interactive proof system based on Martin L "of intensional type theory. This may be understood, we claim, as a solution to the old problem of modelling the full extensional theory in the intensional theory. Types are interpreted as setoids, and the model is therefore a setoid model. We solve the problem of intepreting type universes by utilizing Aczel's type of iterative sets, and show how it can be made into a setoid of small setoids containing the necessary setoid constructions. In addition we interpret the bracket types of Awodey and Bauer. Further quotient types should be interpretable.


Interpolating between dimensions. Dimension theory lies at the heart of fractal geometry and concerns the rigorous quantification of how large a subset of a metric space is. There are many notions of dimension to consider, and part of the richness of the subject is in understanding how these different notions fit together, as well as how their subtle differences give rise to different behaviour. Here we survey a new approach in dimension theory, which seeks to unify the study of individual dimensions by viewing them as different facets of the same object. For example, given two notions of dimension, one may be able to define a continuously parameterised family of dimensions which interpolates between them. An understanding of this interpolation function' therefore contains more information about a given object than the two dimensions considered in isolation. We pay particular attention to two concrete examples of this, namely the emph Assouad spectrum , which interpolates between the box and (quasi )Assouad dimension, and the emph intermediate dimensions , which interpolate between the Hausdorff and box dimensions.


Blockchain based Lightweight Authentication Mechanism for Vehicular Fog Infrastructure. With the increasing development of advanced communication technologies, vehicles are becoming smarter and more connected. Due to the tremendous growth of various vehicular applications, a huge amount of data is generated through advanced on board devices and is deemed critical to improve driving safety and enhance vehicular services. However, cloud based models often fall short in applications where latency and mobility are critical. In order to fully realize the potential of vehicular networks, the challenges of efficient communication and computation need to be addressed. In this direction, vehicular fog computing (VFC) has emerged which extends the concept of fog computing to conventional vehicular networks. It is a geographically distributed paradigm that has the potential to conduct time critical and data intensive tasks by pushing intelligence (i.e. computing resources, storage, and application services) in the vicinity of end vehicles. However secure and reliable transmission are of significant importance in highly mobile vehicular networks in order to ensure the optimal Quality of Service (QoS). In this direction, several authentication mechanisms have been proposed in the literature but most of them are found unfit due to absence of decentralization, anonymity, and trust characteristics. Thus, an effective cross datacenter authentication and key exchange scheme based on blockchain and elliptic curve cryptography (ECC) is proposed in this paper. Here, the distributed ledger of blockchain is used for maintaining the network information while the highly secure ECC is employed for mutual authentication between vehicles and road side units (RSUs). Additionally, the proposed scheme is lightweight and scalable for the considered VFC setup. The performance evaluation results against the existing state of the art reveal that the proposed scheme accomplishes enhanced security features.


U Bubble Model for Mixed Unit Interval Graphs and its Applications The MaxCut Problem Revisited. Interval graphs, intersection graphs of segments on a real line (intervals), play a key role in the study of algorithms and special structural properties. Unit interval graphs, their proper subclass, where each interval has a unit length, has also been extensively studied. We study mixed unit interval graphs a generalization of unit interval graphs where each interval has still a unit length, but intervals of more than one type (open, closed, semi closed) are allowed. This small modification captures a much richer class of graphs. In particular, mixed unit interval graphs are not claw free, compared to unit interval graphs. Heggernes, Meister, and Papadopoulos defined a representation of unit interval graphs called the bubble model which turned out to be useful in algorithm design. We extend this model to the class of mixed unit interval graphs and demonstrate the advantages of this generalized model by providing a subexponential time algorithm for solving the MaxCut problem on mixed unit interval graphs. In addition, we derive a polynomial time algorithm for certain subclasses of mixed unit interval graphs. We point out a substantial mistake in the proof of the polynomiality of the MaxCut problem on unit interval graphs by Boyaci, Ekim, and Shalom (2017). Hence, the time complexity of this problem on unit interval graphs remains open. We further provide a better algorithmic upper bound on the clique width of mixed unit interval graphs. Clique width is one of the most general structural graph parameters, where a large group of natural problems is still solvable in the tractable time when an efficient representation is given. Unfortunately, the exact computation of the clique width representation is NP hard. Therefore, good upper bounds on clique width are highly appreciated, in particular, when such a bound is algorithmic.


Coexistence in discrete time Multi type competing Frog Models. We study coexistence in discrete time multi type frog models. We first show that for two types of particles on mathbb Z d , for d geq2 , for any jumping parameters p 1, p 2 in (0,1) , coexistence occurs with positive probability for sufficiently rich deterministic initial configuration. We extend this to the case of random distribution of initial particles. We study the question of coexistence for multiple types and show positive probability coexistence of 2 d types on mathbb Z d for rich enough initial configuration. We also show an instance of infinite coexistence on mathbb Z d for d geq 3 provided we have sufficiently rich initial configuration.


Predicting Engagement in Video Lectures. The explosion of Open Educational Resources (OERs) in the recent years creates the demand for scalable, automatic approaches to process and evaluate OERs, with the end goal of identifying and recommending the most suitable educational materials for learners. We focus on building models to find the characteristics and features involved in context agnostic engagement (i.e. population based), a seldom researched topic compared to other contextualised and personalised approaches that focus more on individual learner engagement. Learner engagement, is arguably a more reliable measure than popularity number of views, is more abundant than user ratings and has also been shown to be a crucial component in achieving learning outcomes. In this work, we explore the idea of building a predictive model for population based engagement in education. We introduce a novel, large dataset of video lectures for predicting context agnostic engagement and propose both cross modal and modality specific feature sets to achieve this task. We further test different strategies for quantifying learner engagement signals. We demonstrate the use of our approach in the case of data scarcity. Additionally, we perform a sensitivity analysis of the best performing model, which shows promising performance and can be easily integrated into an educational recommender system for OERs.


Nail Polish Try On Realtime Semantic Segmentation of Small Objects for Native and Browser Smartphone AR Applications. We provide a system for semantic segmentation of small objects that enables nail polish try on AR applications to run client side in realtime in native and web mobile applications. By adjusting input resolution and neural network depth, our model design enables a smooth trade off of performance and runtime, with the highest performance setting achieving num 94.5 mIoU at 29.8ms runtime in native applications on an iPad Pro. We also provide a postprocessing and rendering algorithm for nail polish try on, which integrates with our semantic segmentation and fingernail base tip direction predictions.


Sharp thresholds for nonlinear Hamiltonian cycles in hypergraphs. For positive integers r ell , an r uniform hypergraph is called an ell cycle if there exists a cyclic ordering of its vertices such that each of its edges consists of r consecutive vertices, and such that every pair of consecutive edges (in the natural ordering of the edges) intersect in precisely ell vertices. Such cycles are said to be linear when ell 1 , and nonlinear when ell 1 . We determine the sharp threshold for nonlinear Hamiltonian cycles and show that for all r ell 1 , the threshold p r, ell (n) for the appearance of a Hamiltonian ell cycle in the random r uniform hypergraph on n vertices is sharp and is p r, ell (n) lambda(r, ell) ( frac mathrm e n ) r ell for an explicitly specified function lambda . This resolves several questions raised by Dudek and Frieze in 2011.


Geometric Deviation From L 'evy's Occupation Time Arcsine Law. We prove a geometric extension of L 'evy's occupation time arcsine law near a hypersurface on a Riemannian manifold. The deviation from the classic arcsine law is of the order of the square root of the time horizon and is expressed explicitly in terms of the mean curvature of the hypersurface and the local time of the underlying standard Brownian motion.


On the Borel summability of WKB solutions of certain Schr "odinger type differential equations. A class of Schr "odinger type second order linear differential equations with a large parameter u is considered. Analytic solutions of this type of equations can be described via (divergent) formal series in descending powers of u . These formal series solutions are called the WKB solutions. We show that under mild conditions on the potential function of the equation, the WKB solutions are Borel summable with respect to the parameter u in large, unbounded domains of the independent variable. It is established that the formal series expansions are the asymptotic expansions, uniform with respect to the independent variable, of the Borel re summed solutions and we supply computable bounds on their error terms. In addition, it is proved that the WKB solutions can be expressed using factorial series in the parameter, and that these expansions converge in half planes, uniformly with respect to the independent variable. We illustrate our theory by application to a radial Schr "odinger equation associated with the problem of a rotating harmonic oscillator and to the Bessel equation.


The non linear sewing lemma III Stability and generic properties. Solutions of Rough Differential Equations (RDE) may be defined as paths whose increments are close to an approximation of the associated flow. They are constructed through a discrete scheme using a non linear sewing lemma. In this article, we show that such solutions also solve a fixed point problem by exhibiting a suitable functional. Convergence then follows from consistency and stability, two notions that are adapted to our framework. In addition, we show that uniqueness and convergence of discrete approximations is a generic property, meaning that it holds excepted for a set of vector fields and starting points which is of Baire first category. At last, we show that Brownian flows are almost surely unique solutions to RDE associated to Lipschitz flows. The later property yields almost sure convergence of Milstein schemes.


Probabilistic Forwarding of Coded Packets on Networks. We consider a scenario of broadcasting information over a network of nodes connected by noiseless communication links. A source node in the network has some data packets to broadcast. It encodes these data packets into n coded packets in such a way that any node in the network that receives any k out of the n coded packets will be able to retrieve all the original data packets. The source transmits the n coded packets to its one hop neighbours. Every other node in the network follows a probabilistic forwarding protocol, in which it forwards a previously unreceived packet to all its neighbours with a certain probability p . We say that the information from the source undergoes a near broadcast'' if the expected fraction of nodes that receive at least k of the n coded packets is close to 1 . The forwarding probability p is chosen so as to minimize the expected total number of transmissions needed for a near broadcast. We study how, for a given k , this minimum forwarding probability and the associated expected total number of packet transmissions varies with n . We specifically analyze the probabilistic forwarding of coded packets on two network topologies binary trees and square grids. For trees, our analysis shows that for fixed k , the expected total number of transmissions increases with n . On the other hand, on grids, a judicious choice of n significantly reduces the expected total number of transmissions needed for a near broadcast. Behaviour similar to that of the grid is also observed in other well connected network topologies such as random geometric graphs and random regular graphs


Audio Visual Self Supervised Terrain Type Discovery for Mobile Platforms. The ability to both recognize and discover terrain characteristics is an important function required for many autonomous ground robots such as social robots, assistive robots, autonomous vehicles, and ground exploration robots. Recognizing and discovering terrain characteristics is challenging because similar terrains may have very different appearances (e.g., carpet comes in many colors), while terrains with very similar appearance may have very different physical properties (e.g. mulch versus dirt). In order to address the inherent ambiguity in vision based terrain recognition and discovery, we propose a multi modal self supervised learning technique that switches between audio features extracted from a mic attached to the underside of a mobile platform and image features extracted by a camera on the platform to cluster terrain types. The terrain cluster labels are then used to train an image based convolutional neural network to predict changes in terrain types. Through experiments, we demonstrate that the proposed self supervised terrain type discovery method achieves over 80 accuracy, which greatly outperforms several baselines and suggests strong potential for assistive applications.


Human Evaluation of Spoken vs. Visual Explanations for Open Domain QA. While research on explaining predictions of open domain QA systems (ODQA) to users is gaining momentum, most works have failed to evaluate the extent to which explanations improve user trust. While few works evaluate explanations using user studies, they employ settings that may deviate from the end user's usage in the wild ODQA is most ubiquitous in voice assistants, yet current research only evaluates explanations using a visual display, and may erroneously extrapolate conclusions about the most performant explanations to other modalities. To alleviate these issues, we conduct user studies that measure whether explanations help users correctly decide when to accept or reject an ODQA system's answer. Unlike prior work, we control for explanation modality, e.g., whether they are communicated to users through a spoken or visual interface, and contrast effectiveness across modalities. Our results show that explanations derived from retrieved evidence passages can outperform strong baselines (calibrated confidence) across modalities but the best explanation strategy in fact changes with the modality. We show common failure cases of current explanations, emphasize end to end evaluation of explanations, and caution against evaluating them in proxy modalities that are different from deployment.


Incomplete SMT Techniques for Solving Non Linear Formulas over the Integers. We present new methods for solving the Satisfiability Modulo Theories problem over the theory of Quantifier Free Non linear Integer Arithmetic, SMT(QF NIA), which consists in deciding the satisfiability of ground formulas with integer polynomial constraints. Following previous work, we propose to solve SMT(QF NIA) instances by reducing them to linear arithmetic non linear monomials are linearized by abstracting them with fresh variables and by performing case splitting on integer variables with finite domain. For variables that do not have a finite domain, we can artificially introduce one by imposing a lower and an upper bound, and iteratively enlarge it until a solution is found (or the procedure times out). The key for the success of the approach is to determine, at each iteration, which domains have to be enlarged. Previously, unsatisfiable cores were used to identify the domains to be changed, but no clue was obtained as to how large the new domains should be. Here we explain two novel ways to guide this process by analyzing solutions to optimization problems (i) to minimize the number of violated artificial domain bounds, solved via a Max SMT solver, and (ii) to minimize the distance with respect to the artificial domains, solved via an Optimization Modulo Theories (OMT) solver. Using this SMT based optimization technology allows smoothly extending the method to also solve Max SMT problems over non linear integer arithmetic. Finally we leverage the resulting Max SMT(QF NIA) techniques to solve exists forall formulas in a fragment of quantified non linear arithmetic that appears commonly in verification and synthesis applications.


Mean field solution of structural balance dynamics in nonzero temperature. In signed networks with simultaneous friendly and hostile interactions, there is a general tendency to a global structural balance, based on the dynamical model of links status. Although the structural balance represents a state of the network with a lack of contentious situations, there are always tensions in real networks. To study such networks, we generalize the balance dynamics in nonzero temperatures. The presented model uses elements from Boltzmann Gibbs statistical physics to assign an energy to each type of triad, and it introduces the temperature as a measure of tension tolerance of the network. Based on the mean field solution of the model, we find out that the model undergoes a first order phase transition from an imbalanced random state to structural balance with a critical temperature T c , where in the case of T T c there is no chance to reach the balanced state. A main feature of the first order phase transition is the occurrence of a hysteresis loop crossing the balanced and imbalanced regimes.


Rate Distortion Memory Trade offs in Heterogeneous Caching Networks. Caching at the wireless edge can be used to keep up with the increasing demand for high definition wireless video streaming. By prefetching popular content into memory at wireless access points or end user devices, requests can be served locally, relieving strain on expensive backhaul. In addition, using network coding allows the simultaneous serving of distinct cache misses via common coded multicast transmissions, resulting in significantly larger load reductions compared to those achieved with traditional delivery schemes. Most prior works simply treat video content as fixed size files that users would like to fully download. This work is motivated by the fact that video can be coded in a scalable fashion and that the decoded video quality depends on the number of layers a user receives in sequence. Using a Gaussian source model, caching and coded delivery methods are designed to minimize the squared error distortion at end user devices in a rate limited caching network. The framework is very general and accounts for heterogeneous cache sizes, video popularities and user file play back qualities. As part of the solution, a new decentralized scheme for lossy cache aided delivery subject to preset user distortion targets is proposed, which further generalizes prior literature to a setting with file heterogeneity.


Optimal Investment in the Development of Oil and Gas Field. Let an oil and gas field consists of clusters in each of which an investor can launch at most one project. During the implementation of a particular project, all characteristics are known, including annual production volumes, necessary investment volumes, and profit. The total amount of investments that the investor spends on developing the field during the entire planning period we know. It is required to determine which projects to implement in each cluster so that, within the total amount of investments, the profit for the entire planning period is maximum. The problem under consideration is NP hard. However, it is solved by dynamic programming with pseudopolynomial time complexity. Nevertheless, in practice, there are additional constraints that do not allow solving the problem with acceptable accuracy at a reasonable time. Such restrictions, in particular, are annual production volumes. In this paper, we considered only the upper constraints that are dictated by the pipeline capacity. For the investment optimization problem with such additional restrictions, we obtain qualitative results, propose an approximate algorithm, and investigate its properties. Based on the results of a numerical experiment, we conclude that the developed algorithm builds a solution close (in terms of the objective function) to the optimal one.


Effects of Social Cues on Biosecurity Compliance in Livestock Facilities Evidence from Experimental Simulations. Disease outbreaks in U.S. animal livestock industries have economic impacts measured in hundreds of millions of dollars per year. Biosecurity, or procedures intended to protect animals against disease, is known to be effective at reducing infection risk at facilities. Yet to the detriment of animal health, humans do not always follow biosecurity protocols. Human behavioral factors have been shown to influence willingness to follow biosecurity protocols. Here we show how social cues may affect cooperation with a biosecurity practice. Participants were immersed in a simulated swine production facility through a graphical user interface and prompted to make a decision that addressed their willingness to comply with a biosecurity practice. We tested the effect of varying three experimental variables (1) the risk of acquiring an infection, (2) the delivery method of the infection risk information (numerical versus graphical), and (3) behavior of an automated coworker in the facility. We provide evidence that participants changed their behavior when they observed a simulated worker making a choice to follow or not follow a biosecurity protocol, even though the simulated worker had no economic effect on the participants' payouts. These results advance the understanding of human behavioral effects on biosecurity protocol decisions demonstrating that social cues need to be considered by livestock facility managers when developing policies to make agricultural systems more disease resilient.


A hybrid moment method for multi scale kinetic equations based on maximum entropy principle. We propose a hybrid moment method for the multi scale kinetic equations in the framework of the regularized moment method 7 . In this method, the fourth order moment system is chosen as the governing equations in the fluid region. When transiting from the fluid regime to the kinetic regime, the maximum entropy principle is adopted to reconstruct the kinetic distribution function, so that the information in the fluid region can be utilized thoroughly. Moreover, only one uniform set of numerical scheme is needed for both the fluid and kinetic regions. Numerical tests show the high efficiency of this new hybrid method.


The shuffle conjecture. Walks in the plane taking unit length steps north and east from (0,0) to (n,n) never dropping below y x and parking cars subject to preferences are two intriguing ingredients in a formula conjectured in 2005, now famously known as the shuffle conjecture. Here we describe the combinatorial tools needed to state the conjecture. We also give key parts and people in its history, including its eventual algebraic solution by Carlsson and Mellit, which was published in the Journal of the American Mathematical Society in 2018. Finally, we conclude with some remaining open problems.


Filter Pruning using Hierarchical Group Sparse Regularization for Deep Convolutional Neural Networks. Since the convolutional neural networks are often trained with redundant parameters, it is possible to reduce redundant kernels or filters to obtain a compact network without dropping the classification accuracy. In this paper, we propose a filter pruning method using the hierarchical group sparse regularization. It is shown in our previous work that the hierarchical group sparse regularization is effective in obtaining sparse networks in which filters connected to unnecessary channels are automatically close to zero. After training the convolutional neural network with the hierarchical group sparse regularization, the unnecessary filters are selected based on the increase of the classification loss of the randomly selected training samples to obtain a compact network. It is shown that the proposed method can reduce more than 50 parameters of ResNet for CIFAR 10 with only 0.3 decrease in the accuracy of test samples. Also, 34 parameters of ResNet are reduced for TinyImageNet 200 with higher accuracy than the baseline network.


Coarse Baum Connes conjecture and rigidity for Roe algebras. In this paper, we connect the rigidity problem and the coarse Baum Connes conjecture for Roe algebras. In particular, we show that if X and Y are two uniformly locally finite metric spaces such that their Roe algebras are isomorphic, then X and Y are coarsely equivalent provided either X or Y satisfies the coarse Baum Connes conjecture with coefficients. It is well known that coarse embeddability into a Hilbert space implies the coarse Baum Connes conjecture with coefficients. On the other hand, we provide a new example of a finitely generated group satisfying the coarse Baum Connes conjecture with coefficients but which does not coarsely embed into a Hilbert space.


DeepHammer Depleting the Intelligence of Deep Neural Networks through Targeted Chain of Bit Flips. Security of machine learning is increasingly becoming a major concern due to the ubiquitous deployment of deep learning in many security sensitive domains. Many prior studies have shown external attacks such as adversarial examples that tamper with the integrity of DNNs using maliciously crafted inputs. However, the security implication of internal threats (i.e., hardware vulnerability) to DNN models has not yet been well understood. In this paper, we demonstrate the first hardware based attack on quantized deep neural networks DeepHammer that deterministically induces bit flips in model weights to compromise DNN inference by exploiting the rowhammer vulnerability. DeepHammer performs aggressive bit search in the DNN model to identify the most vulnerable weight bits that are flippable under system constraints. To trigger deterministic bit flips across multiple pages within reasonable amount of time, we develop novel system level techniques that enable fast deployment of victim pages, memory efficient rowhammering and precise flipping of targeted bits. DeepHammer can deliberately degrade the inference accuracy of the victim DNN system to a level that is only as good as random guess, thus completely depleting the intelligence of targeted DNN systems. We systematically demonstrate our attacks on real systems against 12 DNN architectures with 4 different datasets and different application domains. Our evaluation shows that DeepHammer is able to successfully tamper DNN inference behavior at run time within a few minutes. We further discuss several mitigation techniques from both algorithm and system levels to protect DNNs against such attacks. Our work highlights the need to incorporate security mechanisms in future deep learning system to enhance the robustness of DNN against hardware based deterministic fault injections.


Aligning Biomedical Metadata with Ontologies Using Clustering and Embeddings. The metadata about scientific experiments published in online repositories have been shown to suffer from a high degree of representational heterogeneity there are often many ways to represent the same type of information, such as a geographical location via its latitude and longitude. To harness the potential that metadata have for discovering scientific data, it is crucial that they be represented in a uniform way that can be queried effectively. One step toward uniformly represented metadata is to normalize the multiple, distinct field names used in metadata (e.g., lat lon, lat and long) to describe the same type of value. To that end, we present a new method based on clustering and embeddings (i.e., vector representations of words) to align metadata field names with ontology terms. We apply our method to biomedical metadata by generating embeddings for terms in biomedical ontologies from the BioPortal repository. We carried out a comparative study between our method and the NCBO Annotator, which revealed that our method yields more and substantially better alignments between metadata and ontology terms.


Multi person Articulated Tracking with Spatial and Temporal Embeddings. We propose a unified framework for multi person pose estimation and tracking. Our framework consists of two main components, ie SpatialNet and TemporalNet. The SpatialNet accomplishes body part detection and part level data association in a single frame, while the TemporalNet groups human instances in consecutive frames into trajectories. Specifically, besides body part detection heatmaps, SpatialNet also predicts the Keypoint Embedding (KE) and Spatial Instance Embedding (SIE) for body part association. We model the grouping procedure into a differentiable Pose Guided Grouping (PGG) module to make the whole part detection and grouping pipeline fully end to end trainable. TemporalNet extends spatial grouping of keypoints to temporal grouping of human instances. Given human proposals from two consecutive frames, TemporalNet exploits both appearance features encoded in Human Embedding (HE) and temporally consistent geometric features embodied in Temporal Instance Embedding (TIE) for robust tracking. Extensive experiments demonstrate the effectiveness of our proposed model. Remarkably, we demonstrate substantial improvements over the state of the art pose tracking method from 65.4 to 71.8 Multi Object Tracking Accuracy (MOTA) on the ICCV'17 PoseTrack Dataset.


Optimal order finite difference approximation of generalized solutions to the biharmonic equation in a cube. We prove an optimal order error bound in the discrete H 2( Omega) norm for finite difference approximations of the first boundary value problem for the biharmonic equation in n space dimensions, with n in 2, dots,7 , whose generalized solution belongs to the Sobolev space H s( Omega) cap H 2 0( Omega) , for frac 1 2 max(5,n) s leq 4 , where Omega (0,1) n . The result extends the range of the Sobolev index s in the best convergence results currently available in the literature to the maximal range admitted by the Sobolev embedding of H s( Omega) into C( overline Omega) in n space dimensions.


Deep reinforcement learning for RAN optimization and control. Due to the high variability of the traffic in the radio access network (RAN), fixed network configurations are not flexible enough to achieve optimal performance. Our vendors provide several settings of the eNodeB to optimize the RAN performance, such as media access control scheduler, loading balance, etc. But the detailed mechanisms of the eNodeB configurations are usually very complicated and not disclosed, not to mention the large key performance indicators (KPIs) space needed to be considered. These make constructing a simulator, offline tuning, or rule based solutions difficult. We aim to build an intelligent controller without strong assumption or domain knowledge about the RAN and can run 24 7 without supervision. To achieve this goal, we first build a closed loop control testbed RAN in a lab environment with one eNodeB provided by one of the largest wireless vendors and four smartphones. Next, we build a double Q network agent trained with the live feedback of the key performance indicators from the RAN. Our work proved the effectiveness of applying deep reinforcement learning to improve network performance in a real RAN network environment.


On the eigenvalues of the Robin Laplacian with a complex parameter. We study the spectrum of the Robin Laplacian with a complex Robin parameter alpha on a bounded Lipschitz domain Omega . We start by establishing a number of properties of the corresponding operator, such as generation properties, local analytic dependence of the eigenvalues and eigenspaces on alpha in mathbb C , and basis properties of the eigenfunctions. Our focus, however, is on bounds and asymptotics for the eigenvalues as functions of alpha we start by providing estimates on the numerical range of the associated operator, which lead to new eigenvalue bounds even in the case alpha in mathbb R . For the asymptotics of the eigenvalues as alpha to infty in mathbb C , in place of the min max characterisation of the eigenvalues and Dirichlet Neumann bracketing techniques commonly used in the real case, we exploit the duality between the eigenvalues of the Robin Laplacian and the eigenvalues of the Dirichlet to Neumann map. We use this to show that every Robin eigenvalue either diverges to infty in mathbb C or converges to a point in the spectrum of the Dirichlet Laplacian, and also to give a comprehensive treatment of the special cases where Omega is an interval, a hyperrectangle or a ball. This leads to the conjecture that on a general smooth domain in dimension d geq 2 all eigenvalues converge to the Dirichlet spectrum if rm Re , alpha remains bounded from below as alpha to infty , while if rm Re , alpha to infty , then there is a family of divergent eigenvalue curves, each of which behaves asymptotically like alpha 2 .


Epimorphism surjectivity in varieties of Heyting algebras. It was shown recently that epimorphisms need not be surjective in a variety K of Heyting algebras, but only one counter example was exhibited in the literature until now. Here, a continuum of such examples is identified, viz. the variety generated by the Rieger Nishimura lattice, and all of its (locally finite) subvarieties that contain the original counter example K. It is known that, whenever a variety of Heyting algebras has finite depth, then it has surjective epimorphisms. In contrast, we show that for every integer n greater or equal than 2, the variety of all Heyting algebras of width at most n has a non surjective epimorphism. Within the so called Kuznetsov Gerciu variety (i.e., the variety generated by finite linear sums of one generated Heyting algebras), we describe exactly the subvarieties that have surjective epimorphisms. This yields new positive examples, and an alternative proof of epimorphism surjectivity for all varieties of Goedel algebras. The results settle natural questions about Beth style definability for a range of intermediate logics.


Eigenvalues and Eigenvectors of Tau Matrices with Applications to Markov Processes and Economics. In the context of matrix displacement decomposition, Bozzo and Di Fiore introduced the so called tau varepsilon, varphi algebra, a generalization of the more known tau algebra originally proposed by Bini and Capovani. We study the properties of eigenvalues and eigenvectors of the generator T n, varepsilon, varphi of the tau varepsilon, varphi algebra. In particular, we derive the asymptotics for the outliers of T n, varepsilon, varphi and the associated eigenvectors we obtain equations for the eigenvalues of T n, varepsilon, varphi , which provide also the eigenvectors of T n, varepsilon, varphi and we compute the full eigendecomposition of T n, varepsilon, varphi in the specific case varepsilon varphi 1 . We also present applications of our results in the context of queuing models, random walks, and diffusion processes, with a special attention to their implications in the study of wealth income inequality and portfolio dynamics.


On unimodular multilinear forms with small norms on sequence spaces. The Kahane Salem Zygmund inequality is a probabilistic result that guarantees the existence of special matrices with entries 1 and 1 generating unimodular m linear forms A m,n ell p 1 n times cdots times ell p m n longrightarrow mathbb R (or mathbb C ) with relatively small norms. The optimal asymptotic estimates for the smallest possible norms of A m,n when left p 1 ,...,p m right subset lbrack2, infty and when left p 1 ,...,p m right subset lbrack1,2) are well known and in this paper we obtain the optimal asymptotic estimates for the remaining case left p 1 ,...,p m right intercepts both 2, infty and 1,2) . In particular we prove that a conjecture posed by Albuquerque and Rezende is false and, using a special type of matrices that dates back to the works of Toeplitz, we also answer a problem posed by the same authors.


Clark measures on the complex sphere. Let B d denote the unit ball of mathbb C d , d ge 1 . Given a holomorphic function varphi B d to B 1 , we study the corresponding family sigma alpha varphi , alpha in partial B 1 , of Clark measures on the unit sphere partial B d . If varphi is an inner function, then we introduce and investigate related unitary operators U alpha mapping analogs of model spaces onto L 2( sigma alpha) , alpha in partial B 1 . In particular, we explicitly characterize the set of U alpha f such that f sigma alpha is a pluriharmonic measure. Also, for an arbitrary holomorphic varphi B d to B 1 , we use the family sigma alpha varphi to compute the essential norm of the composition operator C varphi H 2(B 1) to H 2(B d) .


EDEN Multimodal Synthetic Dataset of Enclosed GarDEN Scenes. Multimodal large scale datasets for outdoor scenes are mostly designed for urban driving problems. The scenes are highly structured and semantically different from scenarios seen in nature centered scenes such as gardens or parks. To promote machine learning methods for nature oriented applications, such as agriculture and gardening, we propose the multimodal synthetic dataset for Enclosed garDEN scenes (EDEN). The dataset features more than 300K images captured from more than 100 garden models. Each image is annotated with various low high level vision modalities, including semantic segmentation, depth, surface normals, intrinsic colors, and optical flow. Experimental results on the state of the art methods for semantic segmentation and monocular depth prediction, two important tasks in computer vision, show positive impact of pre training deep networks on our dataset for unstructured natural scenes. The dataset and related materials will be available at https lhoangan.github.io eden.


Ricci flat Calabi's metric is not projectively induced. We show that the Ricci flat Calabi's metrics on holomorphic line bundles over compact Kaehler Einstein manifolds are not projectively induced. As a byproduct we solve a conjecture addressed in arXiv 1705.03908v2 math.DG by proving that any multiple of the Eguchi Hanson metric on the blow up of C 2 at the origin is not projectively induced.


Let's Get Dirty GAN Based Data Augmentation for Camera Lens Soiling Detection in Autonomous Driving. Wide angle fisheye cameras are commonly used in automated driving for parking and low speed navigation tasks. Four of such cameras form a surround view system that provides a complete and detailed view of the vehicle. These cameras are directly exposed to harsh environmental settings and can get soiled very easily by mud, dust, water, frost. Soiling on the camera lens can severely degrade the visual perception algorithms, and a camera cleaning system triggered by a soiling detection algorithm is increasingly being deployed. While adverse weather conditions, such as rain, are getting attention recently, there is only limited work on general soiling. The main reason is the difficulty in collecting a diverse dataset as it is a relatively rare event. We propose a novel GAN based algorithm for generating unseen patterns of soiled images. Additionally, the proposed method automatically provides the corresponding soiling masks eliminating the manual annotation cost. Augmentation of the generated soiled images for training improves the accuracy of soiling detection tasks significantly by 18 demonstrating its usefulness. The manually annotated soiling dataset and the generated augmentation dataset will be made public. We demonstrate the generalization of our fisheye trained GAN model on the Cityscapes dataset. We provide an empirical evaluation of the degradation of the semantic segmentation algorithm with the soiled data.


The BIRAFFE2 Experiment. Study in Bio Reactions and Faces for Emotion based Personalization for AI Systems. The paper describes BIRAFFE2 data set, which is a result of an affective computing experiment conducted between 2019 and 2020, that aimed to develop computer models for classification and recognition of emotion. Such work is important to develop new methods of natural Human AI interaction. As we believe that models of emotion should be personalized by design, we present an unified paradigm allowing to capture emotional responses of different persons, taking individual personality differences into account. We combine classical psychological paradigms of emotional response collection with the newer approach, based on the observation of the computer game player. By capturing ones psycho physiological reactions (ECG, EDA signal recording), mimic expressions (facial emotion recognition), subjective valence arousal balance ratings (widget ratings) and gameplay progression (accelerometer and screencast recording), we provide a framework that can be easily used and developed for the purpose of the machine learning methods.


Averaged electron densities of the helium like atoms. Different kinds of averaging of the wavefunctions densities of the two electron atomic systems are investigated. Using the Pekeris like method, the ground state wave functions Psi of the helium like atoms with nucleus charge 1 leq Z leq5 are calculated in a few coordinate systems including the hyperspherical coordinates left R, alpha, theta right . The wave functions Psi av (R) of the hyperspherical radius R are calculated numerically by averaging Psi over the hyperspherical angles alpha and theta . The exact analytic representations for the relative derivatives Psi av '(0) Psi av (0) and Psi av ''(0) Psi av (0) are derived. Analytic approximations very close to the actual Psi av (R) are obtained. Using actual wave functions Psi , the one electron densities rho(r) are calculated as functions of the electron nucleus distance r . The relevant derivatives rho'(0) rho(0) and rho''(0) rho(0) characterizing the behavior of rho(r) near the nucleus are calculated numerically. Very accurate analytical approximations, representing the actual one electron density both near the nucleus and far away from it, are derived. All the analytical and numerical results are supplemented with tables and graphs.


Fano control of down conversion in a nonlinear crystal embedded with plasmonic quantum emitter hybrid structures. Control of nonlinear response of nanostructures via path interference effects, i.e., Fano resonances, has been studied extensively. In such studies, a frequency conversion process takes place near a hot spot. Here, we study the case where the frequency conversion process takes place textit along the body of a nonlinear crystal . Metal nanoparticle quantum emitter dimers control the down conversion process, taking place throughout the crystal body, via introducing interfering conversion paths. Dimers behave as interaction centers. We show that a 2 orders of magnitude enhancement is possible, on top of the enhancement due to localization effects. That is, this factor multiplies the enhancement taking place due to the field localization.


HADES IoT A Practical Host Based Anomaly Detection System for IoT Devices (Extended Version). Internet of Things (IoT) devices have become ubiquitous and are spread across many application domains including the industry, transportation, healthcare, and households. However, the proliferation of the IoT devices has raised the concerns about their security, especially when observing that many manufacturers focus only on the core functionality of their products due to short time to market and low cost pressures, while neglecting security aspects. Moreover, it does not exist any established or standardized method for measuring and ensuring the security of IoT devices. Consequently, vulnerabilities are left untreated, allowing attackers to exploit IoT devices for various purposes, such as compromising privacy, recruiting devices into a botnet, or misusing devices to perform cryptocurrency mining. In this paper, we present a practical Host based Anomaly DEtection System for IoT (HADES IoT) that represents the last line of defense. HADES IoT has proactive detection capabilities, provides tamper proof resistance, and it can be deployed on a wide range of Linux based IoT devices. The main advantage of HADES IoT is its low performance overhead, which makes it suitable for the IoT domain, where state of the art approaches cannot be applied due to their high performance demands. We deployed HADES IoT on seven IoT devices to evaluate its effectiveness and performance overhead. Our experiments show that HADES IoT achieved 100 effectiveness in the detection of current IoT malware such as VPNFilter and IoTReaper while on average, requiring only 5.5 of available memory and causing only a low CPU load.


SplitFlyer a Modular Quadcoptor that Disassembles into Two Flying Robots. We introduce SplitFlyer a novel quadcopter with an ability to disassemble into two self contained bicopters through human assistance. As a subunit, the bicopter is a severely underactuated aerial vehicle equipped with only two propellers. Still, each bicopter is capable of independent flight. To achieve this, we provide an analysis of the system dynamics by relaxing the control over the yaw rotation, allowing the bicopter to maintain its large spinning rate in flight. Taking into account the gyroscopic motion, the dynamics are described and a cascaded control strategy is developed. We constructed a transformable prototype to demonstrate consecutive flights in both configurations. The results verify the proposed control strategy and show the potential of the platform for future research in modular aerial swarm robotics.


The Einstein condition on nearly K "ahler six manifolds. We review basic facts on the structure of nearly K "ahler manifolds, focussing in particular on the six dimensional case. A self contained proof that nearly K "ahler six manifolds are Einstein is given by combining different known results. We finally rephrase the definition of nearly K "ahler six manifold in terms of a pair of partial differential equations.


Treatment of carcinomas using atmospheric pressure plasma jets from targets to in vivo models to investigate innocuity and therapeutic efficiency. Atmospheric pressure plasma jets (APPJ) are investigated as an efficient approach to induce antitumor effects of cancerous tissues without inducing any damage (e.g. dessication, burnings). For this, a two steps methodology has been developed where first APPJ are calibrated and characterized on targets mimicking electrical properties of living organisms (mice, human body) and second where they are applied on murine models to demonstrate their innocuity and therapeutic efficiency.


Arabic Offensive Language Detection Using Machine Learning and Ensemble Machine Learning Approaches. This study aims at investigating the effect of applying single learner machine learning approach and ensemble machine learning approach for offensive language detection on Arabic language. Classifying Arabic social media text is a very challenging task due to the ambiguity and informality of the written format of the text. Arabic language has multiple dialects with diverse vocabularies and structures, which increase the complexity of obtaining high classification performance. Our study shows significant impact for applying ensemble machine learning approach over the single learner machine learning approach. Among the trained ensemble machine learning classifiers, bagging performs the best in offensive language detection with F1 score of 88 , which exceeds the score obtained by the best single learner classifier by 6 . Our findings highlight the great opportunities of investing more efforts in promoting the ensemble machine learning approach solutions for offensive language detection models.