Blockchain and its Potential in Education. The proposed paper presents a literature review regarding the status of integrating the dynamic blockchain technology in the educational field. Blockchain is a relatively new technology and the same is its implementation in education. The emerging need in this area of research, which still is in its infancy, is justified by the possible use cases some of these cases are in piloting phase, while others have already been adopted by educational institutions. This paper focuses on extending knowledge about blockchain and on identifying the benefits, risks and the associated challenges regarding the successful implementation of blockchain based solutions in the field of education, fully in line with standards and guidelines for quality assurance.


Learning to map source code to software vulnerability using code as a graph. We explore the applicability of Graph Neural Networks in learning the nuances of source code from a security perspective. Specifically, whether signatures of vulnerabilities in source code can be learned from its graph representation, in terms of relationships between nodes and edges. We create a pipeline we call AI4VA, which first encodes a sample source code into a Code Property Graph. The extracted graph is then vectorized in a manner which preserves its semantic information. A Gated Graph Neural Network is then trained using several such graphs to automatically extract templates differentiating the graph of a vulnerable sample from a healthy one. Our model outperforms static analyzers, classic machine learning, as well as CNN and RNN based deep learning models on two of the three datasets we experiment with. We thus show that a code as graph encoding is more meaningful for vulnerability detection than existing code as photo and linear sequence encoding approaches. (Submitted Oct 2019, Paper 28, ICST)


Large deviations for interacting multiscale particle systems. We consider a collection of weakly interacting diffusion processes moving in a two scale locally periodic environment. We study the large deviations principle of the empirical distribution of the particles' positions in the combined limit as the number of particles grow to infinity and the time scale separation parameter goes to zero simultaneously. We make use of weak convergence methods providing a convenient representation for the large deviations rate function, which allow us to characterize the effective controlled mean field dynamics. In addition, we obtain equivalent representations for the large deviations rate function of the form of Dawson G "artner which hold even in the case where the diffusion matrix depends on the empirical measure and when the particles undergo averaging in addition to the propagation of chaos.


Development of POS tagger for English Bengali Code Mixed data. Code mixed texts are widespread nowadays due to the advent of social media. Since these texts combine two languages to formulate a sentence, it gives rise to various research problems related to Natural Language Processing. In this paper, we try to excavate one such problem, namely, Parts of Speech tagging of code mixed texts. We have built a system that can POS tag English Bengali code mixed data where the Bengali words were written in Roman script. Our approach initially involves the collection and cleaning of English Bengali code mixed tweets. These tweets were used as a development dataset for building our system. The proposed system is a modular approach that starts by tagging individual tokens with their respective languages and then passes them to different POS taggers, designed for different languages (English and Bengali, in our case). Tags given by the two systems are later joined together and the final result is then mapped to a universal POS tag set. Our system was checked using 100 manually POS tagged code mixed sentences and it returned an accuracy of 75.29


Exploring the potential of transfer learning for metamodels of heterogeneous material deformation. From the nano scale to the macro scale, biological tissue is spatially heterogeneous. Even when tissue behavior is well understood, the exact subject specific spatial distribution of material properties is often unknown. And, when developing computational models of biological tissue, it is usually prohibitively computationally expensive to simulate every plausible spatial distribution of material properties for each problem of interest. Therefore, one of the major challenges in developing accurate computational models of biological tissue is capturing the potential effects of this spatial heterogeneity. Recently, machine learning based metamodels have gained popularity as a computationally tractable way to overcome this problem because they can make predictions based on a limited number of direct simulation runs. These metamodels are promising, but they often still require a high number of direct simulations to achieve an acceptable performance. Here we show that transfer learning, a strategy where knowledge gained while solving one problem is transferred to solving a different but related problem, can help overcome this limitation. Critically, transfer learning can be used to leverage both low fidelity simulation data and simulation data that is the outcome of solving a different but related mechanical problem. In this paper, we extend Mechanical MNIST, our open source benchmark dataset of heterogeneous material undergoing large deformation, to include a selection of low fidelity simulation results that require 2 4 orders of magnitude less CPU time to run. Then, we show that transferring the knowledge stored in metamodels trained on these low fidelity simulation results can vastly improve the performance of metamodels used to predict the results of high fidelity simulations.


Principles for data analysis workflows. Traditional data science education often omits training on research workflows the process that moves a scientific investigation from raw data to coherent research question to insightful contribution. In this paper, we elaborate basic principles of a reproducible data analysis workflow by defining three phases the Exploratory, Refinement, and Polishing Phases. Each workflow phase is roughly centered around the audience to whom research decisions, methodologies, and results are being immediately communicated. Importantly, each phase can also give rise to a number of research products beyond traditional academic publications. Where relevant, we draw analogies between principles for data intensive research workflows and established practice in software development. The guidance provided here is not intended to be a strict rulebook rather, the suggestions for practices and tools to advance reproducible, sound data intensive analysis may furnish support for both students and current professionals.


Doubly Lambda commuting row isometries, universal models, and classification. The goal of the paper is to study the structure of the k tuples of doubly Lambda commuting row isometries and the C algebras they generate from the point of view of noncommutative multivariable operator theory. We obtain Wold decompositions, in this setting, and use them to classify the k tuples of doubly Lambda commuting row isometries up to a unitary equivalence. We introduce a universal model in this setting, describe its invariant subspaces, and develop a dilation theory on Lambda polyballs.


Relative L p cohomology and Heintze groups. We define the L p cohomology of a Gromov hyperbolic Riemannian manifold relative to a point on its boundary at infinity and prove that it is, as in the classical case, a quasi isometry invariant. We obtain an application to the problem of quasi isometry classification of Heintze groups. More precisely, we explicitly construct non zero relative L p cohomology classes on a Heintze group mathbb R n rtimes alpha mathbb R , which allows us to prove that the eigenvalues of alpha , up to a scalar multiple, are invariants under quasi isometries.


On a family of gradient type projection methods for nonlinear ill posed problems. We propose and analyze a family of successive projection methods whose step direction is the same as Landweber method for solving nonlinear ill posed problems that satisfy the Tangential Cone Condition (TCC). This family enconpasses Landweber method, the minimal error method, and the steepest descent method thush providing an unified framework for the analysis of these methods. Moreover, we define in this family new methods which are convergent for the constant of the TCC in a range twice as large as the one required for the Landweber and other gradient type methods. The TCC is widely used in the analysis of iterative methods for solving nonlinear ill posed problems. The key idea in this work is to use the TCC in order to construct special convex sets possessing a separation property, and to succesively project onto these sets. Numerical experiments are presented for a nonlinear 2D elliptic parameter identification problem, validating the efficiency of our method.


The DeepFake Detection Challenge (DFDC) Dataset. Deepfakes are a recent off the shelf manipulation technique that allows anyone to swap two identities in a single video. In addition to Deepfakes, a variety of GAN based face swapping methods have also been published with accompanying code. To counter this emerging threat, we have constructed an extremely large face swap video dataset to enable the training of detection models, and organized the accompanying DeepFake Detection Challenge (DFDC) Kaggle competition. Importantly, all recorded subjects agreed to participate in and have their likenesses modified during the construction of the face swapped dataset. The DFDC dataset is by far the largest currently and publicly available face swap video dataset, with over 100,000 total clips sourced from 3,426 paid actors, produced with several Deepfake, GAN based, and non learned methods. In addition to describing the methods used to construct the dataset, we provide a detailed analysis of the top submissions from the Kaggle contest. We show although Deepfake detection is extremely difficult and still an unsolved problem, a Deepfake detection model trained only on the DFDC can generalize to real "in the wild" Deepfake videos, and such a model can be a valuable analysis tool when analyzing potentially Deepfaked videos. Training, validation and testing corpuses can be downloaded from https ai.facebook.com datasets dfdc.


Quantitative Oppenheim conjecture for S arithmetic quadratic forms of rank 3 and 4 . The celebrated result of Eskin, Margulis and Mozes (1998) and Dani and Margulis (1993) on quantitative Oppenheim conjecture says that for irrational quadratic forms q of rank at least 5, the number of integral vectors mathbf v such that q( mathbf v) is in a given bounded interval is asymptotically equal to the volume of the set of real vectors mathbf v such that q( mathbf v) is in the same interval. In dimension 3 or 4 , there are exceptional quadratic forms which fail to satisfy the quantitative Oppenheim conjecture. Even in those cases, one can say that almost all quadratic forms hold that two asymptotic limits are the same ( Eskin Margulis Mozes'98, Theorem 2.4 ). In this paper, we extend this result to the S arithmetic version.


Identities in group rings, enveloping algebras and Poisson algebras. This is a short survey of works on identical relations in group rings, enveloping algebras, Poisson symmetric algebras and other related algebraic structures. First, the classical work of Passman specified group rings that satisfy nontrivial identical relations. This result was an origin and motivation of close research projects. Second, Latyshev and Bahturin determined Lie algebras such that their universal enveloping algebra satisfies a non trivial identical relation. Next, Passman and Petrogradsky solved a similar problem in case of restricted enveloping algebras. Third, Farkas started to study identical relations in Poisson algebras. On the other hand, Shestakov proved that the symmetric algebra S(L) of an arbitrary Lie algebra L satisfies the identity x, y,z equiv 0 if, and only if, L is abelian. We survey further results on existence of identical relations in (truncated) Poisson symmetric algebras of Lie algebras. In particular, we report on recent results on (strong) Lie nilpotency and (strong) solvability of (truncated) Poisson symmetric algebras and related nilpotency classes. Also, we discuss constructions and methods to achieve these results.


On quasilinear elliptic problems with finite or infinite potential wells. We consider quasilinear elliptic problems of the form operatorname div big( phi( nabla u ) nabla u big) V(x) phi ( u )u f(u) qquad u in W 1, Phi ( mathbb R N ), where phi and f satisfy suitable conditions. The positive potential V in C( mathbb R N ) exhibits a finite or infinite potential well in the sense that V(x) tends to its supremum V infty le infty as x to infty . Nontrivial solutions are obtained by variational methods. When V infty infty , a compact embedding from a suitable subspace of W 1, Phi ( mathbb R N ) into L Phi ( mathbb R N ) is established, which enables us to get infinitely many solutions for the case that f is odd. For the case that V(x) lambda a(x) 1 exhibits a steep potential well controlled by a positive parameter lambda , we get nontrivial solutions for large lambda .


Low perturbations for a class of nonuniformly elliptic problems. We introduce and study a new functional which was motivated by our paper on the Caffarelli Kohn Nirenberg inequality with variable exponent (Bahrouni, R u a dulescu and Repov v s , Nonlinearity 31 (2018), 1518 1534). We also study the eigenvalue problem for equations involving this new functional.


Non invasive characterisation of a laser driven positron beam. We report on an indirect and non invasive method to simultaneously characterise the energy dependent emittance and source size of ultra relativistic positron beams generated during the propagation of a laser wakefield accelerated electron beam through a high Z converter target. The strong correlation of the geometrical emittance of the positrons with that of the scattered electrons allows the former to be inferred, with high accuracy, from monitoring the latter. The technique has been tested in a proof of principle experiment where, for 100 MeV positrons, we infer geometrical emittances and source sizes of the order of epsilon e approx 3 mu m and D e approx 150 mu m, respectively. This is consistent with the numerically predicted possibility of achieving sub mu m geometrical emittances and micron scale source sizes at the GeV level.


A Column Generation Approach to the Discrete Barycenter Problem. The discrete Wasserstein barycenter problem is a minimum cost mass transport problem for a set of discrete probability measures. Although an exact barycenter is computable through linear programming, the underlying linear program can be extremely large. For worst case input, a best known linear programming formulation is exponential in the number of variables, but has a low number of constraints, making it an interesting candidate for column generation. In this paper, we devise and study two column generation strategies a natural one based on a simplified computation of reduced costs, and one through a Dantzig Wolfe decomposition. For the latter, we produce efficiently solvable subproblems, namely, a pricing problem in the form of a classical transportation problem. The two strategies begin with an efficient computation of an initial feasible solution. While the structure of the constraints leads to the computation of the reduced costs of all remaining variables for setup, both approaches may outperform a computation using the full program in speed, and dramatically so in memory requirement. In our computational experiments, we exhibit that, depending on the input, either strategy can become a best choice.


Distributed Voting in Beep Model. We consider the problem of distributed multi choice voting in a setting that each node can communicate with its neighbors merely by sending beep signals. Given its simplicity, the beep communication model is of practical importance in different applications such as system biology and wireless sensor networks. Yet, the distributed majority voting has not been resolved in this setting. In this paper, we propose two algorithms, named Distributed Voting with Beeps, to resolve this problem. In the first proposed algorithm, the adjacent nodes having the same value form a set called spot. Afterwards, the spots with majority value try to corrode the spots with non majority values. The second proposed algorithm is based on pairwise interactions between nodes. The proposed algorithms have a termination detection procedure to check whether voting is achieved. We establish theoretical guarantees for the convergence of these algorithms. In particular, we show that the success probability of the first algorithm tends to one as the percentage of the initial votes in majority increases. For the second algorithm, we show that it returns the correct output with high probability. Our experiments show that the algorithms are fairly invariant to the network topology, initial distribution of values, and network size.


DFVS Deep Flow Guided Scene Agnostic Image Based Visual Servoing. Existing deep learning based visual servoing approaches regress the relative camera pose between a pair of images. Therefore, they require a huge amount of training data and sometimes fine tuning for adaptation to a novel scene. Furthermore, current approaches do not consider underlying geometry of the scene and rely on direct estimation of camera pose. Thus, inaccuracies in prediction of the camera pose, especially for distant goals, lead to a degradation in the servoing performance. In this paper, we propose a two fold solution (i) We consider optical flow as our visual features, which are predicted using a deep neural network. (ii) These flow features are then systematically integrated with depth estimates provided by another neural network using interaction matrix. We further present an extensive benchmark in a photo realistic 3D simulation across diverse scenes to study the convergence and generalisation of visual servoing approaches. We show convergence for over 3m and 40 degrees while maintaining precise positioning of under 2cm and 1 degree on our challenging benchmark where the existing approaches that are unable to converge for majority of scenarios for over 1.5m and 20 degrees. Furthermore, we also evaluate our approach for a real scenario on an aerial robot. Our approach generalizes to novel scenarios producing precise and robust servoing performance for 6 degrees of freedom positioning tasks with even large camera transformations without any retraining or fine tuning.


Assessing Disaster Impacts on Highways Using Social Media Case Study of Hurricane Harvey. During and after disasters, highways provide vital routes for emergency services, relief efforts, and evacuation activities. Thus, a timely and reliable assessment of disaster impacts on highways is critical for decision makers to quickly and effectively perform relief and recovery efforts. Recently, social media has increasingly been used in disaster management for obtaining a rapid, public centric assessment of disaster impacts due to its near real time, social and informational characteristics. Although promising, the employment of social media for assessing disaster impacts on highways is still limited due to the inability of extracting accurate highway related data from social media. To overcome this limitation, a systematic approach is proposed to identify highway related data from social media for assessing disaster impacts on highways, and a case study of Hurricane Harvey in Houston, TX is employed for the demonstration. The approach is constructed through three steps (1) building data sources for social media and highways of interest in Houston, respectively (2) adapting the social media data to each highway through a developed mapping algorithm (3) assessing disaster impacts through analyzing social media activities in terms of their intensity, geographic, and topic distributions. Results show that the proposed approach is capable of capturing the temporal patterns of disaster impacts on highways. Official news and reports are employed to validate the assessed impacts.


Towards DNS of the Ultimate Regime of Rayleigh B 'enard Convection. In this contribution we have briefly introduced the problem of turbulent thermal convection with a particular look at its transition to the ultimate regime and the resolution requirements needed for the direct numerical simulation of this flow.


Uncertainty aware multi view co training for semi supervised medical image segmentation and domain adaptation. Although having achieved great success in medical image segmentation, deep learning based approaches usually require large amounts of well annotated data, which can be extremely expensive in the field of medical image analysis. Unlabeled data, on the other hand, is much easier to acquire. Semi supervised learning and unsupervised domain adaptation both take the advantage of unlabeled data, and they are closely related to each other. In this paper, we propose uncertainty aware multi view co training (UMCT), a unified framework that addresses these two tasks for volumetric medical image segmentation. Our framework is capable of efficiently utilizing unlabeled data for better performance. We firstly rotate and permute the 3D volumes into multiple views and train a 3D deep network on each view. We then apply co training by enforcing multi view consistency on unlabeled data, where an uncertainty estimation of each view is utilized to achieve accurate labeling. Experiments on the NIH pancreas segmentation dataset and a multi organ segmentation dataset show state of the art performance of the proposed framework on semi supervised medical image segmentation. Under unsupervised domain adaptation settings, we validate the effectiveness of this work by adapting our multi organ segmentation model to two pathological organs from the Medical Segmentation Decathlon Datasets. Additionally, we show that our UMCT DA model can even effectively handle the challenging situation where labeled source data is inaccessible, demonstrating strong potentials for real world applications.


The PBW basis of U q, bar q ( ddot mathfrak gl n) . We consider the PBW basis of the type A quantum toroidal algebra developed by the author, and prove commutation relations between its generators akin to the ones studied by Burban Schiffmann for n 1. This gives rise to a new presentation of the quantum toroidal algebra of type A.


Non linear iterations and higher splitting. We show that generalized eventually narrow sequences on a strongly inaccessible cardinal kappa are preserved under the Cummings Shaleh non linear iterations of the higher Hechler forcing on kappa . Moreover assuming GCH, kappa kappa kappa , we show that (1) if kappa is strongly unfoldable, kappa leq beta hbox cf ( beta) leq hbox cf ( delta) leq delta leq mu and hbox cf ( mu) kappa ,then there is a cardinal preserving generic extension in which mathfrak s ( kappa) kappa leq mathfrak b ( kappa) beta leq mathfrak d ( kappa) delta leq 2 kappa mu. (2) if kappa is strongly inaccessible, lambda kappa , then in the generic extension obtained as the kappa support iteration of kappa Hechler forcing of length lambda there are no kappa towers of length lambda .


Robustness and Overfitting Behavior of Implicit Background Models. In this paper, we examine the overfitting behavior of image classification models modified with Implicit Background Estimation (SCrIBE), which transforms them into weakly supervised segmentation models that provide spatial domain visualizations without affecting performance. Using the segmentation masks, we derive an overfit detection criterion that does not require testing labels. In addition, we assess the change in model performance, calibration, and segmentation masks after applying data augmentations as overfitting reduction measures and testing on various types of distorted images.


TensorFlow Lite Micro Embedded Machine Learning on TinyML Systems. Deep learning inference on embedded devices is a burgeoning field with myriad applications because tiny embedded devices are omnipresent. But we must overcome major challenges before we can benefit from this opportunity. Embedded processors are severely resource constrained. Their nearest mobile counterparts exhibit at least a 100 1,000x difference in compute capability, memory availability, and power consumption. As a result, the machine learning (ML) models and associated ML inference framework must not only execute efficiently but also operate in a few kilobytes of memory. Also, the embedded devices' ecosystem is heavily fragmented. To maximize efficiency, system vendors often omit many features that commonly appear in mainstream systems, including dynamic memory allocation and virtual memory, that allow for cross platform interoperability. The hardware comes in many flavors (e.g., instruction set architecture and FPU support, or lack thereof). We introduce TensorFlow Lite Micro (TF Micro), an open source ML inference framework for running deep learning models on embedded systems. TF Micro tackles the efficiency requirements imposed by embedded system resource constraints and the fragmentation challenges that make cross platform interoperability nearly impossible. The framework adopts a unique interpreter based approach that provides flexibility while overcoming these challenges. This paper explains the design decisions behind TF Micro and describes its implementation details. Also, we present an evaluation to demonstrate its low resource requirement and minimal run time performance overhead.


Enriched functor categories for functor calculus. In this paper we present background results in enriched category theory and enriched model category theory necessary for developing model categories of enriched functors suitable for doing functor calculus.


Software Engineering Practices for Scientific Software Development A Systematic Mapping Study. Background The development of scientific software applications is far from trivial, due to the constant increase in the necessary complexity of these applications, their increasing size, and their need for intensive maintenance and reuse. Aim To this end, developers of scientific software (who usually lack a formal computer science background) need to use appropriate software engineering (SE) practices. This paper describes the results of a systematic mapping study on the use of SE for scientific application development and their impact on software quality. Method To achieve this goal we have performed a systematic mapping study on 359 papers. We first describe a catalogue of SE practices used in scientific software development. Then, we discuss the quality attributes of interest that drive the application of these practices, as well as tentative side effects of applying the practices on qualities. Results The main findings indicate that scientific software developers are focusing on practices that improve implementation productivity, such as code reuse, use of third party libraries, and the application of "good" programming techniques. In addition, apart from the finding that performance is a key driver for many of these applications, scientific software developers also find maintainability and productivity to be important. Conclusions The results of the study are compared to existing literature, are interpreted under a software engineering prism, and various implications for researchers and practitioners are provided. One of the key findings of the study, which is considered as important for driving future research endeavors is the lack of evidence on the trade offs that need to be made when applying a software practice, i.e., negative (indirect) effects on other quality attributes.


Look, Listen, and Attend Co Attention Network for Self Supervised Audio Visual Representation Learning. When watching videos, the occurrence of a visual event is often accompanied by an audio event, e.g., the voice of lip motion, the music of playing instruments. There is an underlying correlation between audio and visual events, which can be utilized as free supervised information to train a neural network by solving the pretext task of audio visual synchronization. In this paper, we propose a novel self supervised framework with co attention mechanism to learn generic cross modal representations from unlabelled videos in the wild, and further benefit downstream tasks. Specifically, we explore three different co attention modules to focus on discriminative visual regions correlated to the sounds and introduce the interactions between them. Experiments show that our model achieves state of the art performance on the pretext task while having fewer parameters compared with existing methods. To further evaluate the generalizability and transferability of our approach, we apply the pre trained model on two downstream tasks, i.e., sound source localization and action recognition. Extensive experiments demonstrate that our model provides competitive results with other self supervised methods, and also indicate that our approach can tackle the challenging scenes which contain multiple sound sources.


Directed Graphs of Cayley Functions. In this paper we describe a condition under which a given function that commute with an idempotent function on an infinite set is a Cayley function using its functional digraph.


A Transfer Learning Method for Goal Recognition Exploiting Cross Domain Spatial Features. The ability to infer the intentions of others, predict their goals, and deduce their plans are critical features for intelligent agents. For a long time, several approaches investigated the use of symbolic representations and inferences with limited success, principally because it is difficult to capture the cognitive knowledge behind human decisions explicitly. The trend, nowadays, is increasingly focusing on learning to infer intentions directly from data, using deep learning in particular. We are now observing interesting applications of intent classification in natural language processing, visual activity recognition, and emerging approaches in other domains. This paper discusses a novel approach combining few shot and transfer learning with cross domain features, to learn to infer the intent of an agent navigating in physical environments, executing arbitrary long sequences of actions to achieve their goals. Experiments in synthetic environments demonstrate improved performance in terms of learning from few samples and generalizing to unseen configurations, compared to a deep learning baseline approach.


Oscillation of Functions in the H "older class. We study the size of the set of points where the alpha divided difference of a function in the H "older class Lambda alpha is bounded below by a fixed positive constant. Our results are obtained from their discrete analogues which can be stated in the language of dyadic martingales. Our main technical result in this setting is a sharp estimate of the Hausdorff measure of the set of points where a dyadic martingale with bounded increments has maximal growth.


Elements of Scheduling. In the winter of 1976, Alexander Rinnooy Kan and Jan Karel Lenstra defended their PhD theses at the University of Amsterdam. Gene Lawler was on their committees. It was a natural idea to turn the theses into a textbook on scheduling. They set out to compile a survey with Ron Graham (1979), but progress on the book was hampered by the many research opportunities offered by the field. After David Shmoys joined the team in the mid 1980's, several chapters were drafted, and the survey was rewritten (1993). Gene passed away in 1994. Colleagues were asked to contribute chapters or to complete existing drafts. However, by the turn of the century the project was losing its momentum, and finite convergence to completion fell beyond our reach. Over the years, several chapters have been used in the classroom. We continue to receive requests from colleagues who look for a text on the elements of scheduling at an advanced undergraduate or early graduate level. This document is a compilation of what currently exists. We have made a marginal effort in patching it up at some places but is essentially what was written long ago. We did make an attempt to include most of the citations in the bibliography.


Generating Fluent Adversarial Examples for Natural Languages. Efficiently building an adversarial attacker for natural language processing (NLP) tasks is a real challenge. Firstly, as the sentence space is discrete, it is difficult to make small perturbations along the direction of gradients. Secondly, the fluency of the generated examples cannot be guaranteed. In this paper, we propose MHA, which addresses both problems by performing Metropolis Hastings sampling, whose proposal is designed with the guidance of gradients. Experiments on IMDB and SNLI show that our proposed MHA outperforms the baseline model on attacking capability. Adversarial training with MAH also leads to better robustness and performance.


Data Dependent Randomized Smoothing. Randomized smoothing is a recent technique that achieves state of art performance in training certifiably robust deep neural networks. While the smoothing family of distributions is often connected to the choice of the norm used for certification, the parameters of these distributions are always set as global hyper parameters independent from the input data on which a network is certified. In this work, we revisit Gaussian randomized smoothing and show that the variance of the Gaussian distribution can be optimized at each input so as to maximize the certification radius for the construction of the smooth classifier. We also propose a simple memory based approach to certifying the resultant smooth classifier. This new approach is generic, parameter free, and easy to implement. In fact, we show that our data dependent framework can be seamlessly incorporated into 3 randomized smoothing approaches, leading to consistent improved certified accuracy. When this framework is used in the training routine of these approaches followed by a data dependent certification, we achieve 9 and 6 improvement over the certified accuracy of the strongest baseline for a radius of 0.5 on CIFAR10 and ImageNet.


A Note on Spectral Triples on the Quantum Disk. By modifying the ideas from our previous paper SIGMA 13 (2017), 075, 26 pages, arXiv 1705.04005 , we construct spectral triples from implementations of covariant derivations on the quantum disk.


An Almost Constant Lower Bound of the Isoperimetric Coefficient in the KLS Conjecture. We prove an almost constant lower bound of the isoperimetric coefficient in the KLS conjecture. The lower bound has the dimension dependency d o d(1) . When the dimension is large enough, our lower bound is tighter than the previous best bound which has the dimension dependency d 1 4 . Improving the current best lower bound of the isoperimetric coefficient in the KLS conjecture has many implications, including improvements of the current best bounds in Bourgain's slicing conjecture and in the thin shell conjecture, better concentration inequalities for Lipschitz functions of log concave measures and better mixing time bounds for MCMC sampling algorithms on log concave measures.


Fairness in Rating Prediction by Awareness of Verbal and Gesture Quality of Public Speeches. The role of verbal and non verbal cues towards great public speaking has been a topic of exploration for many decades. We identify a commonality across present theories, the element of "variety or heterogeneity" in channels or modes of communication (e.g. resorting to stories, scientific facts, emotional connections, facial expressions etc.) which is essential for effectively communicating information. We use this observation to formalize a novel HEterogeneity Metric, HEM, that quantifies the quality of a talk both in the verbal and non verbal domain (transcript and facial gestures). We use TED talks as an input repository of public speeches because it consists of speakers from a diverse community besides having a wide outreach. We show that there is an interesting relationship between HEM and the ratings of TED talks given to speakers by viewers. It emphasizes that HEM inherently and successfully represents the quality of a talk based on "variety or heterogeneity". Further, we also discover that HEM successfully captures the prevalent bias in ratings with respect to race and gender, that we call sensitive attributes (because prediction based on these might result in unfair outcome). We incorporate the HEM metric into the loss function of a neural network with the goal to reduce unfairness in rating predictions with respect to race and gender. Our results show that the modified loss function improves fairness in prediction without considerably affecting prediction accuracy of the neural network. Our work ties together a novel metric for public speeches in both verbal and non verbal domain with the computational power of a neural network to design a fair prediction system for speakers.


SCARL Side Channel Analysis with Reinforcement Learning on the Ascon Authenticated Cipher. Existing side channel analysis techniques require a leakage model, in the form of a prior knowledge or a set of training data, to establish a relationship between the secret data and the measurements. We introduce side channel analysis with reinforcement learning (SCARL) capable of extracting data dependent features of the measurements in an unsupervised learning approach without requiring a prior knowledge on the leakage model. SCARL consists of an auto encoder to encode the information of power measurements into an internal representation, and a reinforcement learning algorithm to extract information about the secret data. We employ a reinforcement learning algorithm with actor critic networks, to identify the proper leakage model that results in maximum inter cluster separation of the auto encoder representation. SCARL assumes that the lower order components of a generic non linear leakage model have larger contribution to the leakage of sensitive data. On a lightweight implementation of the Ascon authenticated cipher on the Artix 7 FPGA, SCARL is able to recover the secret key using 24K power traces during the key insertion, or Initialization Stage, of the cipher. We also demonstrate that classical techniques such as DPA and CPA fail to identify the correct key using traditional linear leakage models and more than 40K power traces.


Cream of the Crop Distilling Prioritized Paths For One Shot Neural Architecture Search. One shot weight sharing methods have recently drawn great attention in neural architecture search due to high efficiency and competitive performance. However, weight sharing across models has an inherent deficiency, i.e., insufficient training of subnetworks in hypernetworks. To alleviate this problem, we present a simple yet effective architecture distillation method. The central idea is that subnetworks can learn collaboratively and teach each other throughout the training process, aiming to boost the convergence of individual models. We introduce the concept of prioritized path, which refers to the architecture candidates exhibiting superior performance during training. Distilling knowledge from the prioritized paths is able to boost the training of subnetworks. Since the prioritized paths are changed on the fly depending on their performance and complexity, the final obtained paths are the cream of the crop. We directly select the most promising one from the prioritized paths as the final architecture, without using other complex search methods, such as reinforcement learning or evolution algorithms. The experiments on ImageNet verify such path distillation method can improve the convergence ratio and performance of the hypernetwork, as well as boosting the training of subnetworks. The discovered architectures achieve superior performance compared to the recent MobileNetV3 and EfficientNet families under aligned settings. Moreover, the experiments on object detection and more challenging search space show the generality and robustness of the proposed method. Code and models are available at https github.com microsoft cream.git.


Refactoring Neural Networks for Verification. Deep neural networks (DNN) are growing in capability and applicability. Their effectiveness has led to their use in safety critical and autonomous systems, yet there is a dearth of cost effective methods available for reasoning about the behavior of a DNN. In this paper, we seek to expand the applicability and scalability of existing DNN verification techniques through DNN refactoring. A DNN refactoring defines (a) the transformation of the DNN's architecture, i.e., the number and size of its layers, and (b) the distillation of the learned relationships between the input features and function outputs of the original to train the transformed network. Unlike with traditional code refactoring, DNN refactoring does not guarantee functional equivalence of the two networks, but rather it aims to preserve the accuracy of the original network while producing a simpler network that is amenable to more efficient property verification. We present an automated framework for DNN refactoring, and demonstrate its potential effectiveness through three case studies on networks used in autonomous systems.


RTTD ID Tracked Captions with Multiple Speakers for Deaf Students. Students who are deaf and hard of hearing cannot hear in class and do not have full access to spoken information. They can use accommodations such as captions that display speech as text. However, compared with their hearing peers, the caption accommodations do not provide equal access, because they are focused on reading captions on their tablet and cannot see who is talking. This viewing isolation contributes to student frustration and risk of doing poorly or withdrawing from introductory engineering courses with lab components. It also contributes to their lack of inclusion and sense of belonging. We report on the evaluation of a Real Time Text Display with Speaker Identification, which displays the location of a speaker in a group (RTTD ID). RTTD ID aims to reduce frustration in identifying and following an active speaker when there are multiple speakers, e.g., in a lab. It has three different display schemes to identify the location of the active speaker, which helps deaf students in viewing both the speaker's words and the speaker's expression and actions. We evaluated three RTTD speaker identification methods 1) traditional captions stay in one place and viewers search for the speaker, 2) pointer captions stay in one place, and a pointer to the speaker is displayed, and 3) pop up captions "pop up" next to the speaker. We gathered both quantitative and qualitative information through evaluations with deaf and hard of hearing users. The users preferred the pointer identification method over the traditional and pop up methods.


Probabilistic Linear Solvers for Machine Learning. Linear systems are the bedrock of virtually all numerical computation. Machine learning poses specific challenges for the solution of such systems due to their scale, characteristic structure, stochasticity and the central role of uncertainty in the field. Unifying earlier work we propose a class of probabilistic linear solvers which jointly infer the matrix, its inverse and the solution from matrix vector product observations. This class emerges from a fundamental set of desiderata which constrains the space of possible algorithms and recovers the method of conjugate gradients under certain conditions. We demonstrate how to incorporate prior spectral information in order to calibrate uncertainty and experimentally showcase the potential of such solvers for machine learning.


Asymptotic Bounds on the Rate of Locally Repairable Codes. New asymptotic upper bounds are presented on the rate of sequences of locally repairable codes (LRCs) with a prescribed relative minimum distance and locality over a finite field F . The bounds apply to LRCs in which the recovery functions are linear in particular, the bounds apply to linear LRCs over F . The new bounds are shown to improve on previously published results, especially when the repair groups are disjoint, namely, they form a partition of the set of coordinates.


Deception Strategies and Threats for Online Discussions. Communication plays a major role in social systems. Effective communications, which requires transmission of the messages between individuals without disruptions or noise, can be a powerful tool to deliver intended impact. Language and style of the content can be leveraged to deceive and manipulate recipients. These deception and persuasion strategies can be applied to exert power and amass capital in politics and business. In this work, we provide a modest review of how such deception and persuasion strategies were applied to different communication channels over the years. We provide examples of campaigns that has occurred in different periods over the last 100 years, together with their corresponding dissemination mediums. In the Internet age, we enjoy access to the vast amount of information and the ability to communicate without borders. However, malicious actors work toward abusing online systems to disseminate disinformation, disrupt communication, and manipulate people by the means of automated tools, such as social bots. It is important to study the old practices of persuasion to be able to investigate modern practices and tools. Here we provide a discussion of current threats against society while drawing parallels with the historical practices and the recent research efforts on systems of detection and prevention.


Pomeau Manneville maps are global local mixing. We prove that a large class of expanding maps of the unit interval with a C 2 regular indifferent point in 0 and full increasing branches are global local mixing. This class includes the standard Pomeau Manneville maps T(x) x x p 1 mod 1 ( p ge 1 ), the Liverani Saussol Vaienti maps (with index p ge 1 ) and many generalizations thereof.


On sampling discretization in L 2 . We prove a sampling discretization theorem for the square norm of functions from a finite dimensional subspace satisfying Nikol'skii's inequality with an upper bound on the number of sampling points of the order of the dimension of the subspace


The Great Divide Drivers of Polarization in the US Public. Many democratic societies have become more politically polarized, with the U.S. as the main example. The origins of this phenomenon are still not well understood and subject to debate. To better understand the mechanisms underlying political polarization, we develop a mathematical framework and employ information theoretic concepts to analyze empirical data on political polarization that has been collected by Pew Research Center from 1994 to 2017. Our framework can capture the evolution of polarization in the Democratic and Republican leaning segments of the U.S. public and allows us to identify its drivers. Our findings provide empirical and quantitative evidence that political polarization in the U.S. is mainly driven by strong and more left leaning policy cultural innovations in the Democratic party.


A Counterexample guided Approach to Finding Numerical Invariants. Numerical invariants, e.g., relationships among numerical variables in a program, represent a useful class of properties to analyze programs. General polynomial invariants represent more complex numerical relations, but they are often required in many scientific and engineering applications. We present NumInv, a tool that implements a counterexample guided invariant generation (CEGIR) technique to automatically discover numerical invariants, which are polynomial equality and inequality relations among numerical variables. This CEGIR technique infers candidate invariants from program traces and then checks them against the program source code using the KLEE test input generation tool. If the invariants are incorrect KLEE returns counterexample traces, which help the dynamic inference obtain better results. Existing CEGIR approaches often require sound invariants, however NumInv sacrifices soundness and produces results that KLEE cannot refute within certain time bounds. This design and the use of KLEE as a verifier allow NumInv to discover useful and important numerical invariants for many challenging programs. Preliminary results show that NumInv generates required invariants for understanding and verifying correctness of programs involving complex arithmetic. We also show that NumInv discovers polynomial invariants that capture precise complexity bounds of programs used to benchmark existing static complexity analysis techniques. Finally, we show that NumInv performs competitively comparing to state of the art numerical invariant analysis tools.


CUED speech at TREC 2020 Podcast Summarisation Track. In this paper, we describe our approach for the Podcast Summarisation challenge in TREC 2020. Given a podcast episode with its transcription, the goal is to generate a summary that captures the most important information in the content. Our approach consists of two steps (1) Filtering redundant or less informative sentences in the transcription using the attention of a hierarchical model (2) Applying a state of the art text summarisation system (BART) fine tuned on the Podcast data using a sequence level reward function. Furthermore, we perform ensembles of three and nine models for our submission runs. We also fine tune the BART model on the Podcast data as our baseline. The human evaluation by NIST shows that our best submission achieves 1.777 in the EGFB scale, while the score of creator provided description is 1.291. Our system won the Spotify Podcast Summarisation Challenge in the TREC2020 Podcast Track in both human and automatic evaluation.


Hybrid Data Driven and Analytical Model for Kinematic Control of a Surgical Robotic Tool. Accurate kinematic models are essential for effective control of surgical robots. For tendon driven robots, which is common for minimally invasive surgery, intrinsic nonlinearities are important to consider. Traditional analytical methods allow to build the kinematic model of the system by making certain assumptions and simplifications on the nonlinearities. Machine learning techniques, instead, allow to recover a more complex model based on the acquired data. However, analytical models are more generalisable, but can be over simplified data driven models, on the other hand, can cater for more complex models, but are less generalisable and the result is highly affected by the training dataset. In this paper, we present a novel approach to combining analytical and data driven approaches to model the kinematics of nonlinear tendon driven surgical robots. Gaussian Process Regression (GPR) is used for learning the data driven model and the proposed method is tested on both simulated data and real experimental data.


Isotropic Nematic Phase Transition and Liquid Crystal Droplets. Liquid crystal droplets are of great interest from physics and applications. Rigorous mathematical analysis is challenging as the problem involves harmonic maps (and in general the Oseen Frank model), free interfaces and topological defects which could be either inside the droplet or on its surface along with some intriguing boundary anchoring conditions for the orientation configurations. In this paper, through a study of the phase transition between the isotropic and nematic states of liquid crystal based on the Ericksen model, we can show, when the size of droplet is much larger in comparison with the ratio of the Frank constants to the surface tension, a Gamma convergence theorem for minimizers. This Gamma limit is in fact the sharp interface limit for the phase transition between the isotropic and nematic regions when the small parameter varepsilon , corresponding to the transition layer width, goes to zero. This limiting process not only provides a geometric description of the shape of the droplet as one would expect, and surprisingly it also gives the anchoring conditions for the orientations of liquid crystals on the surface of the droplet depending on material constants. In particular, homeotropic, tangential, and even free boundary conditions as assumed in earlier phenomenological modelings arise naturally provided that the surface tension, Frank and Ericksen constants are in suitable ranges.


De novo topology optimization of Total Ossicular Replacement Prostheses. Conductive hearing loss, due to middle ear pathologies or traumas, affects more than 5 of the population worldwide. Passive prostheses to replace the ossicular chain mainly rely on piston like titanium and or hydroxyapatite devices, which in the long term suffer from extrusion. Although the basic shape of such devices always consists of a base for contact with the eardrum and a stem to have mechanical connection with the residual bony structures, a plethora of topologies have been proposed, mainly to help surgical positioning. In this work, we optimize the topology of a total ossicular replacement prosthesis, by maximizing the global stiffness and under the smallest possible volume constraint that ensures material continuity. This investigation optimizes the prosthesis topology in response to static displacement loads with amplitudes that normally occur during sound stimulation in a frequency range between 100 Hz and 10 kHz. Following earlier studies, we discuss how the presence and arrangement of holes on the surface of the prosthesis plate in contact with the umbo affect the overall geometry. Finally, we validate the designs through a finite element model, in which we assess the prosthesis performance upon dynamic sound pressure loads by considering four different constitutive materials titanium, cortical bone, silk, and collagen hydroxyapatite. The results show that the selected prostheses present, almost independently of their constitutive material, a vibroacustic behavior close to that of the native ossicular chain, with a slight almost constant positive shift that reaches a maximum of 5 dB close to 1 kHz. This work represents a reference for the development of a new generation of middle ear prostheses with non conventional topologies for fabrication via additive manufacturing technologies or ultraprecision machining in order to create patient specific devices.


Mass Action Law Conjugate Representation for General Chemical Mechanisms. Power law rates constitute a common approximation to the general analysis of the stability properties of complex reaction networks. We point out in this paper that this form for the rates does not need to be assumed as an approximation for general rate laws. On the contrary, any functional form for a rate law can be represented exactly in terms of power laws. Moreover, we can uniquely associate to any set of kinetic equations an equivalent 'conjugate' representation in terms of the well known generalized Lotka Volterra equations, standing for what we call per capita rates, which amounts to a great simplification in terms of the structural form of the mathematical representation of a reaction network.


Meta learning the Learning Trends Shared Across Tasks. Meta learning stands for 'learning to learn' such that generalization to new tasks is achieved. Among these methods, Gradient based meta learning algorithms are a specific sub class that excel at quick adaptation to new tasks with limited data. This demonstrates their ability to acquire transferable knowledge, a capability that is central to human learning. However, the existing meta learning approaches only depend on the current task information during the adaptation, and do not share the meta knowledge of how a similar task has been adapted before. To address this gap, we propose a 'Path aware' model agnostic meta learning approach. Specifically, our approach not only learns a good initialization for adaptation, it also learns an optimal way to adapt these parameters to a set of task specific parameters, with learnable update directions, learning rates and, most importantly, the way updates evolve over different time steps. Compared to the existing meta learning methods, our approach offers (a) The ability to learn gradient preconditioning at different time steps of the inner loop, thereby modeling the dynamic learning behavior shared across tasks, and (b) The capability of aggregating the learning context through the provision of direct gradient skip connections from the old time steps, thus avoiding overfitting and improving generalization. In essence, our approach not only learns a transferable initialization, but also models the optimal update directions, learning rates, and task specific learning trends. Specifically, in terms of learning trends, our approach determines the way update directions shape up as the task specific learning progresses and how the previous update history helps in the current update. Our approach is simple to implement and demonstrates faster convergence. We report significant performance improvements on a number of FSL datasets.


A well posedness theory in Sobolev spaces for the stochastic magnetohydrodynamic equations in the whole space. We prove the existence of a mild solution to the three dimensional incompressible stochastic magnetohydrodynamic equations in the whole space with the initial data which belong to the Sobolev spaces.


A fully pipelined FPGA accelerator for scale invariant feature transform keypoint descriptor matching,. The scale invariant feature transform (SIFT) algorithm is considered a classical feature extraction algorithm within the field of computer vision. SIFT keypoint descriptor matching is a computationally intensive process due to the amount of data consumed. In this work, we designed a novel fully pipelined hardware accelerator architecture for SIFT keypoint descriptor matching. The accelerator core was implemented and tested on a field programmable gate array (FPGA). The proposed hardware architecture is able to properly handle the memory bandwidth necessary for a fully pipelined implementation and hits the roofline performance model, achieving the potential maximum throughput. The fully pipelined matching architecture was designed based on the consine angle distance method. Our architecture was optimized for 16 bit fixed point operations and implemented on hardware using a Xilinx Zynq based FPGA development board. Our proposed architecture shows a noticeable reduction of area resources compared with its counterparts in literature, while maintaining high throughput by alleviating memory bandwidth restrictions. The results show a reduction in consumed device resources of up to 91 percent in LUTs and 79 percent of BRAMs. Our hardware implementation is 15.7 times faster than the comparable software approach.


Exploit Prediction Scoring System (EPSS). Despite the massive investments in information security technologies and research over the past decades, the information security industry is still immature. In particular, the prioritization of remediation efforts within vulnerability management programs predominantly relies on a mixture of subjective expert opinion, severity scores, and incomplete data. Compounding the need for prioritization is the increase in the number of vulnerabilities the average enterprise has to remediate. This paper produces the first open, data driven framework for assessing vulnerability threat, that is, the probability that a vulnerability will be exploited in the wild within the first twelve months after public disclosure. This scoring system has been designed to be simple enough to be implemented by practitioners without specialized tools or software, yet provides accurate estimates of exploitation. Moreover, the implementation is flexible enough that it can be updated as more, and better, data becomes available. We call this system the Exploit Prediction Scoring System, EPSS.


Some new results related to Lorentz G gamma spaces and interpolation. We compute the K functional related to some couple of spaces as small or classical Lebesgue space or Lorentz Marcinkiewicz spaces completing the results of the previous works of the authors. This computation allows to determine the interpolation space in the sense of Peetre for such couple. It happens that the result is always a G gamma space, since this last space covers many spaces. The motivations of such study are various, among them we wish to obtain a regularity estimate for the so called very weak solution of linear equation in a domain Omega with data in the space of the integrable function with respect to the distance function to the boundary of Omega.


Minimal Quantile Functions Subject to Stochastic Dominance Constraints. We consider a problem of finding an SSD minimal quantile function subject to the mixture of multiple first order stochastic dominance (FSD) and second order stochastic dominance (SSD) constraints. The solution is explicitly worked out and has a closed relation to the Skorokhod problem. We then apply this result to solve an expenditure minimization problem with the mixture of an FSD constraint and an SSD constraint in financial economics.


Hartogs companions and holomorphic extensions in arbitrary dimension. We show that every holomorphic map f in mathcal H ( Omega setminus K) ( K subset Omega subset mathbb C n , with K compact, Omega open, and n ge2 ), has a unique " emph Hartogs companion " tilde f in mathcal H ( Omega) matching f on an open subset C K, Omega subset Omega setminus K . Furthermore, tilde f extends f , emph if and only if mathbb C n setminus K is a connected set this equivalence proves the converse implication from the Hartogs Kugelsatz. The existence of vector valued Hartogs companions in any dimension yields a Hartogs type extension theorem for G ateaux holomorphic maps f in mathcal H mathrm G ( Omega setminus K,Y) on finitely open sets in arbitrary complex vector spaces. The equivalence is very similar to that for K subset Omega subset mathbb C n and leads to a corresponding Hartogs Kugelsatz in arbitrary dimension and to extension theorems for five types of holomorphy (G ateaux, Mackey Silva, hypoanalytic, Fr 'echet, locally bounded). We also show that the range tilde f( Omega) of a vector valued Hartogs companion cannot leave a domain of holomorphy containing f( Omega setminus K) . We establish a boundary principle for maps f in mathcal H mathrm G ( Omega,Y) cap mathcal C ( bar Omega,Y) on finitely bounded open sets. For Y mathbb C , the principle states that f big( bar Omega big) f( partial Omega) (hence sup x in Omega f(x) sup x in partial Omega f(x) ). Several results require a new identity theorem, which yields a maximum norm principle and a "max min" seminorm principle.


A note on transitive union closed families. We show that the Union Closed Conjecture holds for the union closed family generated by the cyclic translates of any fixed set.


A Weighted Randomized Kaczmarz Method for Solving Linear Systems. The Kaczmarz method for solving a linear system Ax b interprets such a system as a collection of equations left langle a i, x right rangle b i , where a i is the i th row of A , then picks such an equation and corrects x k 1 x k lambda a i where lambda is chosen so that the i th equation is satisfied. Convergence rates are difficult to establish. Assuming the rows to be normalized, a i ell 2 1 , Strohmer Vershynin established that if the order of equations is chosen at random, mathbb E x k x ell 2 converges exponentially. We prove that if the i th row is selected with likelihood proportional to left left langle a i, x k right rangle b i right p , where 0 p infty , then mathbb E x k x ell 2 converges faster than the purely random method. As p rightarrow infty , the method de randomizes and explains, among other things, why the maximal correction method works well. We empirically observe that the method computes approximations of small singular vectors of A as a byproduct.


Polynomial and horizontally polynomial functions on Lie groups. We generalize both the notion of polynomial functions on Lie groups and the notion of horizontally affine maps on Carnot groups. We fix a subset S of the algebra mathfrak g of left invariant vector fields on a Lie group mathbb G and we assume that S Lie generates mathfrak g . We say that a function f mathbb G to mathbb R (or more generally a distribution on mathbb G ) is S polynomial if for all X in S there exists k in mathbb N such that the iterated derivative X k f is zero in the sense of distributions. First, we show that all S polynomial functions (as well as distributions) are represented by analytic functions and, if the exponent k in the previous definition is independent on X in S , they form a finite dimensional vector space. Second, if mathbb G is connected and nilpotent we show that S polynomial functions are polynomial functions in the sense of Leibman. The same result may not be true for non nilpotent groups. Finally, we show that in connected nilpotent Lie groups, being polynomial in the sense of Leibman, being a polynomial in exponential chart, and the vanishing of mixed derivatives of some fixed degree along directions of mathfrak g are equivalent notions.


Improved Residual Networks for Image and Video Recognition. Residual networks (ResNets) represent a powerful type of convolutional neural network (CNN) architecture, widely adopted and used in various tasks. In this work we propose an improved version of ResNets. Our proposed improvements address all three main components of a ResNet the flow of information through the network layers, the residual building block, and the projection shortcut. We are able to show consistent improvements in accuracy and learning convergence over the baseline. For instance, on ImageNet dataset, using the ResNet with 50 layers, for top 1 accuracy we can report a 1.19 improvement over the baseline in one setting and around 2 boost in another. Importantly, these improvements are obtained without increasing the model complexity. Our proposed approach allows us to train extremely deep networks, while the baseline shows severe optimization issues. We report results on three tasks over six datasets image classification (ImageNet, CIFAR 10 and CIFAR 100), object detection (COCO) and video action recognition (Kinetics 400 and Something Something v2). In the deep learning era, we establish a new milestone for the depth of a CNN. We successfully train a 404 layer deep CNN on the ImageNet dataset and a 3002 layer network on CIFAR 10 and CIFAR 100, while the baseline is not able to converge at such extreme depths. Code is available at https github.com iduta iresnet


Proposal of Automatic Offloading for Function Blocks of Applications. When using heterogeneous hardware other than CPUs, barriers of technical skills such as OpenCL are high. Based on that, I have proposed environment adaptive software that enables automatic conversion, configuration, and high performance operation of once written code, according to the hardware to be placed. Partly of the offloading to the GPU was automated previously. In this paper, I propose and evaluate an automatic extraction method of appropriate offload target loop statements of source code as the first step of offloading to FPGA. I evaluate the effectiveness of the proposed method in multiple applications.


CTRL A Conditional Transformer Language Model for Controllable Generation. Large scale language models show promising text generation capabilities, but users cannot easily control particular aspects of the generated text. We release CTRL, a 1.63 billion parameter conditional transformer language model, trained to condition on control codes that govern style, content, and task specific behavior. Control codes were derived from structure that naturally co occurs with raw text, preserving the advantages of unsupervised learning while providing more explicit control over text generation. These codes also allow CTRL to predict which parts of the training data are most likely given a sequence. This provides a potential method for analyzing large amounts of data via model based source attribution. We have released multiple full sized, pretrained versions of CTRL at https github.com salesforce ctrl.


An Off Chip Attack on Hardware Enclaves via the Memory Bus. This paper shows how an attacker can break the confidentiality of a hardware enclave with Membuster, an off chip attack based on snooping the memory bus. An attacker with physical access can observe an unencrypted address bus and extract fine grained memory access patterns of the victim. Membuster is qualitatively different from prior on chip attacks to enclaves and is more difficult to thwart. We highlight several challenges for Membuster. First, DRAM requests are only visible on the memory bus at last level cache misses. Second, the attack needs to incur minimal interference or overhead to the victim to prevent the detection of the attack. Lastly, the attacker needs to reverse engineer the translation between virtual, physical, and DRAM addresses to perform a robust attack. We introduce three techniques, critical page whitelisting, cache squeezing, and oracle based fuzzy matching algorithm to increase cache misses for memory accesses that are useful for the attack, with no detectable interference to the victim, and to convert memory accesses to sensitive data. We demonstrate Membuster on an Intel SGX CPU to leak confidential data from two applications Hunspell and Memcached. We show that a single uninterrupted run of the victim can leak most of the sensitive data with high accuracy.


Neural Architecture Search for Deep Image Prior. We present a neural architecture search (NAS) technique to enhance the performance of unsupervised image de noising, in painting and super resolution under the recently proposed Deep Image Prior (DIP). We show that evolutionary search can automatically optimize the encoder decoder (E D) structure and meta parameters of the DIP network, which serves as a content specific prior to regularize these single image restoration tasks. Our binary representation encodes the design space for an asymmetric E D network that typically converges to yield a content specific DIP within 10 20 generations using a population size of 500. The optimized architectures consistently improve upon the visual quality of classical DIP for a diverse range of photographic and artistic content.


Shedding Light on Blind Spots Developing a Reference Architecture to Leverage Video Data for Process Mining. Process mining is one of the most active research streams in business process management. In recent years, numerous methods have been proposed for analyzing structured process data. Yet, in many cases, it is only the digitized parts of processes that are directly captured from process aware information systems, and manual activities often result in blind spots. While the use of video cameras to observe these activities could help to fill this gap, a standardized approach to extracting event logs from unstructured video data remains lacking. Here, we propose a reference architecture to bridge the gap between computer vision and process mining. Various evaluation activities (i.e., competing artifact analysis, prototyping, and real world application) ensured that the proposed reference architecture allows flexible, use case driven, and context specific instantiations. Our results also show that an exemplary software prototype instantiation of the proposed reference architecture is capable of automatically extracting most of the process relevant events from unstructured video data.


HypperSteer Hypothetical Steering and Data Perturbation in Sequence Prediction with Deep Learning. Deep Recurrent Neural Networks (RNN) continues to find success in predictive decision making with temporal event sequences. Recent studies have shown the importance and practicality of visual analytics in interpreting deep learning models for real world applications. However, very limited work enables interactions with deep learning models and guides practitioners to form hypotheticals towards the desired prediction outcomes, especially for sequence prediction. Specifically, no existing work has addressed the what if analysis and value perturbation along different time steps for sequence outcome prediction. We present a model agnostic visual analytics tool, HypperSteer, that steers hypothetical testing and allows users to perturb data for sequence predictions interactively. We showcase how HypperSteer helps in steering patient data to achieve desired treatment outcomes and discuss how HypperSteer can serve as a comprehensive solution for other practical scenarios.


Maximal Haagerup subalgebras in L( mathbb Z 2 rtimes SL 2( mathbb Z )) . We prove that L(SL 2( textbf k )) is a maximal Haagerup von Neumann subalgebra in L( textbf k 2 rtimes SL 2( textbf k )) for textbf k mathbb Q . Then we show how to modify the proof to handle textbf k mathbb Z . The key step for the proof is a complete description of all intermediate von Neumann subalgebras between L(SL 2( textbf k )) and L infty (Y) rtimes SL 2( textbf k ) , where SL 2( textbf k ) curvearrowright Y denotes the quotient of the algebraic action SL 2( textbf k ) curvearrowright widehat textbf k 2 by modding out the relation phi sim phi' , where phi , phi' in widehat textbf k 2 and phi'(x, y) phi( x, y) for all (x, y) in textbf k 2 . As a by product, we show L(PSL 2( mathbb Q )) is a maximal von Neumann subalgebra in L infty (Y) rtimes PSL 2( mathbb Q ) in particular, PSL 2( mathbb Q ) curvearrowright Y is a prime action, i.e. it admits no non trivial quotient actions.


Silica Silicon Composites for Near Infrared Reflection A Comprehensive Computational and Experimental Study. Compact layers containing embedded semiconductor particles consolidated using pulsed electric current sintering exhibit intense, broadband near infrared reflectance. The composites consolidated from nano or micro silica powder have a different porous microstructure which causes scattering at the air matrix interface and larger reflectance primarily in the visible region. The 3 mm thick composite compacts reflect up to 72 of the incident radiation in the near infrared region with a semiconductor microinclusion volume fraction of 1 which closely matches predictions from multiscale Monte Carlo modeling and Kubelka Munk theory. Further, the calculated spectra predict an improvement of the reflectance by decreasing the average particle size or broadening the standard deviation. The high reflectance is achieved with minimal dissipative losses and facile manufacturing, and the composites described herein are well suited to control the radiative transfer of heat in devices at high temperature and under harsh conditions.


An Assessment of GANs for Identity related Applications. Generative Adversarial Networks (GANs) are now capable of producing synthetic face images of exceptionally high visual quality. In parallel to the development of GANs themselves, efforts have been made to develop metrics to objectively assess the characteristics of the synthetic images, mainly focusing on visual quality and the variety of images. Little work has been done, however, to assess overfitting of GANs and their ability to generate new identities. In this paper we apply a state of the art biometric network to various datasets of synthetic images and perform a thorough assessment of their identity related characteristics. We conclude that GANs can indeed be used to generate new, imagined identities meaning that applications such as anonymisation of image sets and augmentation of training datasets with distractor images are viable applications. We also assess the ability of GANs to disentangle identity from other image characteristics and propose a novel GAN triplet loss that we show to improve this disentanglement.


Challenges in Developing Secure Mobile Health Applications, A Systematic Review. Mobile health (mHealth) applications (apps) have gained significant popularity over the last few years due to its tremendous benefits, such as lowering healthcare cost and increasing patient awareness. However, the sensitivity of healthcare data makes the security of mHealth apps a serious concern. In this review, we aim to identify and analyse the reported challenges that the developers of mHealth apps face concerning security. Additionally, our study aimed to develop a conceptual framework with the challenges faced by mHealth apps development organization for developing secure apps. The knowledge of such challenges can help to reduce the risk of developing insecure mHealth apps. We followed the Systematic Literature Review method for this review. We selected studies that have been published between January 2008 and October 2020. We selected 32 primary studies using predefined criteria and used thematic analysis method for analysing the extracted data. We identified nine challenges that can affect the development of secure mHealth apps. Such as 1) lack of security guidelines and regulations for developing secure mHealth apps, 2) developers lack of knowledge and expertise for secure mHealth app development, 3) lack of stakeholders involvement during mHealth app development, etc . Based on our analysis, we have presented a conceptual framework which highlights the correlation between the identified challenges. We conclude that our findings can help them identify their weaknesses and improve their security practices. Similarly, mHealth apps developers can identify the challenges they face to develop mHealth apps that do not pose security risks for users. Our review is a step towards providing insights into the development of secure mHealth apps. Our proposed conceptual framework can act as a practice guideline for practitioners to enhance secure mHealth apps development.


Efficiency of Covid 19 Mobile Contact Tracing Containment by Measuring Time Dependent Doubling Time. The Covid 19 epidemic of the novel coronavirus (severe acute respiratory syndrome SARS CoV 2) has been spreading around the world. While different containment policies using non pharmaceutical interventions have been applied, their efficiency are not known quantitatively. We show that the doubling time Td(t) with the success s factor, the characteristic time of the exponential growth of Td(t) in the arrested regime, is a reliable tool for early predictions of epidemic spread time evolution and it provides a quantitative measure of the success of different containment measures. The efficiency of the containment policy Lockdown case Finding mobile Tracing (LFT) using mandatory mobile contact tracing is much higher than the Lockdown Stop and Go (LSG) policy proposed by the Imperial College team in London. A very low s factor was reached by LFT policy giving the shortest time width of the dome of positive case curve and the lowest number of fatalities. The LFT policy has been able to reduce by a factor 100 the number of fatalities in the first 100 days of the Covid 19 epidemic, to reduce the time width of the Covid 19 pandemic dome by a factor 2.5 and to rapidly stop new outbreaks avoiding the second wave


Near perfect matchings in uniform hypergraphs. In this paper, we study degree conditions for the existence of large matchings in uniform hypergraphs. We prove that for integers k,l,n with k ge 3 , k 2 l k , and n large, if H is a k uniform hypergraph on n vertices and delta l (H) n l choose k l (n l) ( lceil n k rceil 2) choose 2 , then H has a matching covering all but a constant number of vertices. When l k 2 and k ge 5 , such a matching is near perfect and our bound on delta l(H) is best possible. When k 3 , with the help of an absorbing lemma of H ' a n, Person, and Schacht, our proof also implies that H has a perfect matching, a result proved by K " uhn, Osthus, and Treglown and, independently, of Kahn.


AoI and Energy Consumption Oriented Dynamic Status Updating in Caching Enabled IoT Networks. Caching has been regarded as a promising technique to alleviate energy consumption of sensors in Internet of Things (IoT) networks by responding to users' requests with the data packets stored in the edge caching node (ECN). For real time applications in caching enabled IoT networks, it is essential to develop dynamic status update strategies to strike a balance between the information freshness experienced by users and energy consumed by the sensor, which, however, is not well addressed. In this paper, we first depict the evolution of information freshness, in terms of age of information (AoI), at each user. Then, we formulate a dynamic status update optimization problem to minimize the expectation of a long term accumulative cost, which jointly considers the users' AoI and sensor's energy consumption. To solve this problem, a Markov Decision Process (MDP) is formulated to cast the status updating procedure, and a model free reinforcement learning algorithm is proposed, with which the challenge brought by the unknown of the formulated MDP's dynamics can be addressed. Finally, simulations are conducted to validate the convergence of our proposed algorithm and its effectiveness compared with the zero wait baseline policy.


Structured climate financing valuation of CDOs on inhomogeneous asset pools. Recently, a number of structured funds have emerged as public private partnerships with the intent of promoting investment in renewable energy in emerging markets. These funds seek to attract institutional investors by tranching the asset pool and issuing senior notes with a high credit quality. Financing of renewable energy (RE) projects is achieved via two channels small RE projects are financed indirectly through local banks that draw loans from the fund's assets, whereas large RE projects are directly financed from the fund. In a bottom up Gaussian copula framework, we examine the diversification properties and RE exposure of the senior tranche. To this end, we introduce the LH model, which combines a homogeneous infinitely granular loan portfolio with a finite number of large loans. Using expected tranche percentage notional (which takes a similar role as the default probability of a loan), tranche prices and tranche sensitivities in RE loans, we analyse the risk profile of the senior tranche. We show how the mix of indirect and direct RE investments in the asset pool affects the sensitivity of the senior tranche to RE investments and how to balance a desired sensitivity with a target credit quality and target tranche size.


Universal Bounds and Monotonicity Properties of Ratios of Hermite and Parabolic Cylinder Functions. We obtain so far unproved properties of a ratio involving a class of Hermite and parabolic cylinder functions. Those ratios are shown to be strictly decreasing and bounded by universal constants. Differently to usual analytic approaches, we employ simple purely probabilistic arguments to derive our results. In particular, we exploit the relation between Hermite and parabolic cylinder functions and the eigenfunctions of the infinitesimal generator of the Ornstein Uhlenbeck process. As a byproduct, we obtain Tur 'an type inequalities.


Enhancing spatial and textual analysis with EUPEG an extensible and unified platform for evaluating geoparsers. A rich amount of geographic information exists in unstructured texts, such as Web pages, social media posts, housing advertisements, and historical archives. Geoparsers are useful tools that extract structured geographic information from unstructured texts, thereby enabling spatial analysis on textual data. While a number of geoparsers were developed, they were tested on different datasets using different metrics. Consequently, it is difficult to compare existing geoparsers or to compare a new geoparser with existing ones. In recent years, researchers created open and annotated corpora for testing geoparsers. While these corpora are extremely valuable, much effort is still needed for a researcher to prepare these datasets and deploy geoparsers for comparative experiments. This paper presents EUPEG an Extensible and Unified Platform for Evaluating Geoparsers. EUPEG is an open source and Web based benchmarking platform which hosts a majority of open corpora, geoparsers, and performance metrics reported in the literature. It enables direct comparison of the hosted geoparsers, and a new geoparser can be connected to EUPEG and compared with other geoparsers. The main objective of EUPEG is to reduce the time and effort that researchers have to spend in preparing datasets and baselines, thereby increasing the efficiency and effectiveness of comparative experiments.


Perspectives on urban theories. At the end of the five years of work in our GeoDiverCity program, we brought together a diversity of authors from different disciplines. Each person was invited to present an important question about the theories and models of urbanization. They are representative of a variety of currents in urban research. Rather than repeat here the contents of all chapters, we propose two ways to synthesize the scientific contributions of this book. In a first part we replace them in relation to a few principles that were experimented in our program, and in a second part we situate them with respect to a broader view of international literature on these topics.


Optimal Bound on the Combinatorial Complexity of Approximating Polytopes. This paper considers the question of how to succinctly approximate a multidimensional convex body by a polytope. Given a convex body K of unit diameter in Euclidean d dimensional space (where d is a constant) and an error parameter varepsilon 0 , the objective is to determine a convex polytope of low combinatorial complexity whose Hausdorff distance from K is at most varepsilon . By combinatorial complexity we mean the total number of faces of all dimensions. Classical constructions by Dudley and Bronshteyn Ivanov show that O(1 varepsilon (d 1) 2 ) facets or vertices are possible, respectively, but neither achieves both bounds simultaneously. In this paper, we show that it is possible to construct a polytope with O(1 varepsilon (d 1) 2 ) combinatorial complexity, which is optimal in the worst case. Our result is based on a new relationship between varepsilon width caps of a convex body and its polar body. Using this relationship, we are able to obtain a volume sensitive bound on the number of approximating caps that are "essentially different." We achieve our main result by combining this with a variant of the witness collector method and a novel variable thickness layered construction of the economical cap covering.


Message Passing Networks for Molecules with Tetrahedral Chirality. Molecules with identical graph connectivity can exhibit different physical and biological properties if they exhibit stereochemistry a spatial structural characteristic. However, modern neural architectures designed for learning structure property relationships from molecular structures treat molecules as graph structured data and therefore are invariant to stereochemistry. Here, we develop two custom aggregation functions for message passing neural networks to learn properties of molecules with tetrahedral chirality, one common form of stereochemistry. We evaluate performance on synthetic data as well as a newly proposed protein ligand docking dataset with relevance to drug discovery. Results show modest improvements over a baseline sum aggregator, highlighting opportunities for further architecture development.


Convergence of solutions of fractional differential equations to power type functions. In this article we study the asymptotic behavior of solutions of some fractional differential equations. We prove convergence to power type functions under some assumptions on the nonlinearities. Our results extend and generalize some existing well known results on solutions of ordinary differential equations. Appropriate estimations and lemmas such as a fractional version of L'Hopital's rule are used.


Learning World Transition Model for Socially Aware Robot Navigation. Moving in dynamic pedestrian environments is one of the important requirements for autonomous mobile robots. We present a model based reinforcement learning approach for robots to navigate through crowded environments. The navigation policy is trained with both real interaction data from multi agent simulation and virtual data from a deep transition model that predicts the evolution of surrounding dynamics of mobile robots. The model takes laser scan sequence and robot's own state as input and outputs steering control. The laser sequence is further transformed into stacked local obstacle maps disentangled from robot's ego motion to separate the static and dynamic obstacles, simplifying the model training. We observe that our method can be trained with significantly less real interaction data in simulator but achieve similar level of success rate in social navigation task compared with other methods. Experiments were conducted in multiple social scenarios both in simulation and on real robots, the learned policy can guide the robots to the final targets successfully while avoiding pedestrians in a socially compliant manner. Code is available at https github.com YuxiangCui model based social navigation


Tuning Word2vec for Large Scale Recommendation Systems. Word2vec is a powerful machine learning tool that emerged from Natural Lan guage Processing (NLP) and is now applied in multiple domains, including recom mender systems, forecasting, and network analysis. As Word2vec is often used offthe shelf, we address the question of whether the default hyperparameters are suit able for recommender systems. The answer is emphatically no. In this paper, wefirst elucidate the importance of hyperparameter optimization and show that un constrained optimization yields an average 221 improvement in hit rate over thedefault parameters. However, unconstrained optimization leads to hyperparametersettings that are very expensive and not feasible for large scale recommendationtasks. To this end, we demonstrate 138 average improvement in hit rate with aruntime budget constrained hyperparameter optimization. Furthermore, to makehyperparameter optimization applicable for large scale recommendation problemswhere the target dataset is too large to search over, we investigate generalizinghyperparameters settings from samples. We show that applying constrained hy perparameter optimization using only a 10 sample of the data still yields a 91 average improvement in hit rate over the default parameters when applied to thefull datasets. Finally, we apply hyperparameters learned using our method of con strained optimization on a sample to the Who To Follow recommendation serviceat Twitter and are able to increase follow rates by 15 .


Analytic linearization of conformal maps of the annulus. We consider holomorphic maps defined in an annulus around mathbb R mathbb Z in mathbb C mathbb Z . E. Risler proved that in a generic analytic family of such maps f zeta that contains a Brjuno rotation f 0(z) z alpha , all maps that are conjugate to this rotation form a codimension 1 analytic submanifold near f 0 . In this paper, we obtain the Risler's result as a corollary of the following construction. We introduce a renormalization operator on the space of univalent maps in a neighborhood of mathbb R mathbb Z . We prove that this operator is hyperbolic, with one unstable direction corresponding to translations. We further use a holomorphic motions argument and Yoccoz's theorem to show that its stable foliation consists of diffeomorphisms that are conjugate to rotations.


3D printing in the context of Science, Technology, Engineering, and Mathematics education at the college university level. An overview concerning 3D printing (a.k.a. additive manufacturing) within the context of Science, Technology, Engineering, and Mathematics (STEM) education at the college university level is provided. The vast majority of quoted papers report self made models for which faculty members and their students have created the necessary 3D print files themselves by various routes. The prediction by the Gartner consulting company that it will take more than ten years from July 2014 onwards for Classroom 3D Printing to reach its Plateau of Productivity in one of their hallmark Visibility versus Time (Hype Cycle) graphs is critically assessed. The bibliography of this book chapter sums up the state of the art in 3D printing for STEM (including nano science and nano engineering) education at the college level approximately four years after Gartner's prediction. Current methodologies and best practices of college level Classroom 3D printing are described in the main section of this review. Detailed information is given mainly for those papers in which the authors of this book chapter are authors and co authors. A straightforward route from crystallographic information framework files (CIFs) at a very large open access database to 3D print files for atomic level crystal and molecule structure models is described here in some detail. Because the development of methodologies and best practices are typical activities of the penultimate stage of a Hype Cycle, we conclude that (i) Gartner's prediction underestimates the creativity, resourcefulness, and commitment of college educators to their students and that (ii) Classroom 3D Printing will be a widespread reality significantly earlier than the middle of the next decade (at least in the USA as more than one half of the relevant quoted papers originated there). An appendix provides a brief technical review of contemporary 3D printing techniques.


Martingale Representation in the Enlargement of the Filtration Generated by a Point Process. Let X be a point process and let mathbb X denote the filtration generated by X . In this paper we study martingale representation theorems in the filtration mathbb G obtained as an initial and progressive enlargement of the filtration mathbb X . The progressive enlargement is done here by means of a whole point process H . We do not require further assumptions on the point process H nor on the dependence between X and H . In particular, we recover the special case of the progressive enlargement by a random time tau .


On population growth with catastrophes. In this paper we study a particular class of Piecewise deterministic Markov processes (PDMP's) which are semi stochastic catastrophe versions of deterministic population growth models. In between successive jumps the process follows a flow describing deterministic population growth. Moreover, at random jump times, governed by state dependent rates, the size of the population shrinks by a random amount of its current size, an event possibly leading to instantaneous local (or total) extinction. A special separable shrinkage transition kernel is investigated in more detail, including the case of total disasters. We discuss conditions under which such processes are recurrent (positive or null) or transient. To do so, we introduce a modified scale function which is used to compute, when relevant, the law of the height of excursions and to decide if the process is recurrent or not. The question of the finiteness of the time to extinction is investigated together with the evaluation of the mean time to extinction when the last one is finite. Some information on the embedded jump chain of the PDMP is also required when dealing with the classification of states 0 and infinity that we exhibit.


Free Fourier Multipliers associated with the firstSegment. We study Fourier multipliers on free group mathbb F infty associated with the first segment of the reduced words, and prove that they are completely bounded on the noncommutative L p spaces L p( hat mathbb F infty) iff their restriction on L p( hat mathbb F 1) L p( mathbb T ) are completely bounded. As a consequence, every classical Mikhlin multiplier extends to a L p Fourier multiplier on free groups for all 1 p infty .


Reed at SemEval 2020 Task 9 Fine Tuning and Bag of Words Approaches to Code Mixed Sentiment Analysis. We explore the task of sentiment analysis on Hinglish (code mixed Hindi English) tweets as participants of Task 9 of the SemEval 2020 competition, known as the SentiMix task. We had two main approaches 1) applying transfer learning by fine tuning pre trained BERT models and 2) training feedforward neural networks on bag of words representations. During the evaluation phase of the competition, we obtained an F score of 71.3 with our best model, which placed 4 th out of 62 entries in the official system rankings.


DropLeaf a precision farming smartphone application for measuring pesticide spraying methods. Pesticide application has been heavily used in the cultivation of major crops, contributing to the increase of crop production over the past decades. However, their appropriate use and calibration of machines rely upon evaluation methodologies that can precisely estimate how well the pesticides' spraying covered the crops. A few strategies have been proposed in former works, yet their elevated costs and low portability do not permit their wide adoption. This work introduces and experimentally assesses a novel tool that functions over a smartphone based mobile application, named DropLeaf Spraying Meter. Tests performed using DropLeaf demonstrated that, notwithstanding its versatility, it can estimate the pesticide spraying with high precision. Our methodology is based on image analysis, and the assessment of spraying deposition measures is performed successfully over real and synthetic water sensitive papers. The proposed tool can be extensively used by farmers and agronomists furnished with regular smartphones, improving the utilization of pesticides with well being, ecological, and monetary advantages. DropLeaf can be easily used for spray drift assessment of different methods, including emerging UAV (Unmanned Aerial Vehicle) sprayers.