Towards Repairing Neural Networks Correctly. Neural networks are increasingly applied to support decision making in safety critical applications (like autonomous cars, unmanned aerial vehicles and face recognition based authentication). While many impressive static verification techniques have been proposed to tackle the correctness problem of neural networks, it is possible that static verification may never be sufficiently scalable to handle real world neural networks. In this work, we propose a runtime verification method to ensure the correctness of neural networks. Given a neural network and a desirable safety property, we adopt state of the art static verification techniques to identify strategically locations to introduce additional gates which "correct" neural network behaviors at runtime. Experiment results show that our approach effectively generates neural networks which are guaranteed to satisfy the properties, whilst being consistent with the original neural network most of the time.


Towards Automatic Face to Face Translation. In light of the recent breakthroughs in automatic machine translation systems, we propose a novel approach that we term as "Face to Face Translation". As today's digital communication becomes increasingly visual, we argue that there is a need for systems that can automatically translate a video of a person speaking in language A into a target language B with realistic lip synchronization. In this work, we create an automatic pipeline for this problem and demonstrate its impact on multiple real world applications. First, we build a working speech to speech translation system by bringing together multiple existing modules from speech and language. We then move towards "Face to Face Translation" by incorporating a novel visual module, LipGAN for generating realistic talking faces from the translated audio. Quantitative evaluation of LipGAN on the standard LRW test set shows that it significantly outperforms existing approaches across all standard metrics. We also subject our Face to Face Translation pipeline, to multiple human evaluations and show that it can significantly improve the overall user experience for consuming and interacting with multimodal content across languages. Code, models and demo video are made publicly available. Demo video https www.youtube.com watch?v aHG6Oei8jF0 Code and models https github.com Rudrabha LipGAN


Random Sampling in reproducing kernel subspaces of L p( mathbb R n) . In this paper, we study random sampling on reproducing kernel space V , which is a range of an idempotent integral operator. Under certain decay condition on the integral kernel, we show that any element in V can be approximated by an element in a finite dimensional subspace of V . Moreover, we prove with overwhelming probability that random points uniformly distributed over a cube C is stable sample for the set of functions concentrated on C


Simulating cilia driven mixing and transport in complex geometries. Cilia and flagella are self actuated microtubule based structures that are present on many cell surfaces, ranging from the outer surface of single cell organisms to the internal epithelial surfaces in larger animals. A fast and robust numerical method that simulates the coupled hydrodynamics of cilia and the constituent particles in the fluid such as rigid particles, drops or cells would be useful to not only understand several disease and developmental pathologies due to ciliary dysfunction but also to design microfluidic chips with ciliated cultures for some targeted functionality e.g., maximizing fluid transport or particle mixing. In this paper, we develop a hybrid numerical method that employs a boundary integral method for handling the confining geometries and the constituent rigid particles and the method of regularized Stokeslets for handling the cilia. We provide several examples demonstrating the effects of confining geometries on cilia generated fluid mixing as well as the cilia particle hydrodynamics.


Photovoltaic module segmentation and thermal analysis tool from thermal images. The growing interest in the use of clean energy has led to the construction of increasingly large photovoltaic systems. Consequently, monitoring the proper functioning of these systems has become a highly relevant issue.In this paper, automatic detection, and analysis of photovoltaic modules are proposed. To perform the analysis, a module identification step, based on a digital image processing algorithm, is first carried out. This algorithm consists of image enhancement (contrast enhancement, noise reduction, etc.), followed by segmentation of the photovoltaic module. Subsequently, a statistical analysis based on the temperature values of the segmented module is performed.Besides, a graphical user interface has been designed as a potential tool that provides relevant information of the photovoltaic modules.


Brain network similarity Methods and applications. Graph theoretical approach has proved an effective tool to understand, characterize and quantify the complex brain network. However, much less attention has been paid to methods that quantitatively compare two graphs, a crucial issue in the context of brain networks. Comparing brain networks is indeed mandatory in several network neuroscience applications. Here, we discuss the current state of the art, challenges, and a collection of analysis tools that have been developed in recent years to compare brain networks. We first introduce the graph similarity problem in brain network application. We then describe the methodological background of the available metrics and algorithms of comparing graphs, their strengths and limitations. We also report results obtained in concrete applications from normal brain networks. More precisely, we show the potential use of brain network similarity to build a 'network of networks' that may give new insights into the object categorization in the human brain. Additionally, we discuss future directions in terms of network similarity methods and applications.


Forgery Detection in a Questioned Hyperspectral Document Image using K means Clustering. Hyperspectral imaging allows for analysis of images in several hundred of spectral bands depending on the spectral resolution of the imaging sensor. Hyperspectral document image is the one which has been captured by a hyperspectral camera so that the document can be observed in the different bands on the basis of their unique spectral signatures. To detect the forgery in a document various Ink mismatch detection techniques based on hyperspectral imaging have presented vast potential in differentiating visually similar inks. Inks of different materials exhibit different spectral signature even if they have the same color. Hyperspectral analysis of document images allows identification and discrimination of visually similar inks. Based on this analysis forensic experts can identify the authenticity of the document. In this paper an extensive ink mismatch detection technique is presented which uses KMean Clustering to identify different inks on the basis of their unique spectral response and separates them into different clusters.


Efficient Intrusion Detection on Low Performance Industrial IoT Edge Node Devices. Communication between sensors, actors and Programmable Logic Controllers (PLCs) in industrial systems moves from two wire field buses to IP based protocols such as Modbus TCP. This increases the attack surface because the IP based network is often reachable from everywhere within the company. Thus, centralized defenses, e.g. at the perimeter of the network do not offer sufficient protection. Rather, decentralized defenses, where each part of the network protects itself, are needed. Network Intrusion Detection Systems (IDSs) monitor the network and report suspicious activity. They usually run on a single host and are not able to capture all events in the network and they are associated with a great integration effort. To bridge this gap, we introduce a method for intrusion detection that combines distributed agents on Industrial Internet of Things (IIoT) edge devices with a centralized logging. In contrast to existing IDSs, the distributed approach is suitable for industrial low performance microcontrollers. We demonstrate a Proof of Concept (PoC) implementation on a MCU running FreeRTOS with LwIP and show the feasibility of our approach in an IIoT application.


Gram Regularization for Multi view 3D Shape Retrieval. How to obtain the desirable representation of a 3D shape is a key challenge in 3D shape retrieval task. Most existing 3D shape retrieval methods focus on capturing shape representation with different neural network architectures, while the learning ability of each layer in the network is neglected. A common and tough issue that limits the capacity of the network is overfitting. To tackle this, L2 regularization is applied widely in existing deep learning frameworks. However,the effect on the generalization ability with L2 regularization is limited as it only controls large value in parameters. To make up the gap, in this paper, we propose a novel regularization term called Gram regularization which reinforces the learning ability of the network by encouraging the weight kernels to extract different information on the corresponding feature map. By forcing the variance between weight kernels to be large, the regularizer can help to extract discriminative features. The proposed Gram regularization is data independent and can converge stably and quickly without bells and whistles. Moreover, it can be easily plugged into existing off the shelf architectures. Extensive experimental results on the popular 3D object retrieval benchmark ModelNet demonstrate the effectiveness of our method.


On the Efficiency of K Means Clustering Evaluation, Optimization, and Algorithm Selection. This paper presents a thorough evaluation of the existing methods that accelerate Lloyd's algorithm for fast k means clustering. To do so, we analyze the pruning mechanisms of existing methods, and summarize their common pipeline into a unified evaluation framework UniK. UniK embraces a class of well known methods and enables a fine grained performance breakdown. Within UniK, we thoroughly evaluate the pros and cons of existing methods using multiple performance metrics on a number of datasets. Furthermore, we derive an optimized algorithm over UniK, which effectively hybridizes multiple existing methods for more aggressive pruning. To take this further, we investigate whether the most efficient method for a given clustering task can be automatically selected by machine learning, to benefit practitioners and researchers.


VIGOR Cross View Image Geo localization beyond One to one Retrieval. Cross view image geo localization aims to determine the locations of street view query images by matching with GPS tagged reference images from aerial view. Recent works have achieved surprisingly high retrieval accuracy on city scale datasets. However, these results rely on the assumption that there exists a reference image exactly centered at the location of any query image, which is not applicable for practical scenarios. In this paper, we redefine this problem with a more realistic assumption that the query image can be arbitrary in the area of interest and the reference images are captured before the queries emerge. This assumption breaks the one to one retrieval setting of existing datasets as the queries and reference images are not perfectly aligned pairs, and there may be multiple reference images covering one query location. To bridge the gap between this realistic setting and existing datasets, we propose a new large scale benchmark VIGOR for cross View Image Geo localization beyond One to one Retrieval. We benchmark existing state of the art methods and propose a novel end to end framework to localize the query in a coarse to fine manner. Apart from the image level retrieval accuracy, we also evaluate the localization accuracy in terms of the actual distance (meters) using the raw GPS data. Extensive experiments are conducted under different application scenarios to validate the effectiveness of the proposed method. The results indicate that cross view geo localization in this realistic setting is still challenging, fostering new research in this direction. Our dataset and code will be released at url https github.com Jeff Zilence VIGOR


Identifying and Reducing Gender Bias in Word Level Language Models. Many text corpora exhibit socially problematic biases, which can be propagated or amplified in the models trained on such data. For example, doctor cooccurs more frequently with male pronouns than female pronouns. In this study we (i) propose a metric to measure gender bias (ii) measure bias in a text corpus and the text generated from a recurrent neural network language model trained on the text corpus (iii) propose a regularization loss term for the language model that minimizes the projection of encoder trained embeddings onto an embedding subspace that encodes gender (iv) finally, evaluate efficacy of our proposed method on reducing gender bias. We find this regularization method to be effective in reducing gender bias up to an optimal weight assigned to the loss term, beyond which the model becomes unstable as the perplexity increases. We replicate this study on three training corpora Penn Treebank, WikiText 2, and CNN Daily Mail resulting in similar conclusions.


Local and 2 local derivations of Locally simple Lie algebras. In the present paper we study local and 2 local derivations of locally finite split simple Lie algebras. Namely, we show that every local and 2 local derivation on such Lie algebra is a derivation.


Mapping Languages The Corpus of Global Language Use. This paper describes a web based corpus of global language use with a focus on how this corpus can be used for data driven language mapping. First, the corpus provides a representation of where national varieties of major languages are used (e.g., English, Arabic, Russian) together with consistently collected data for each variety. Second, the paper evaluates a language identification model that supports more local languages with smaller sample sizes than alternative off the shelf models. Improved language identification is essential for moving beyond majority languages. Given the focus on language mapping, the paper analyzes how well this digital language data represents actual populations by (i) systematically comparing the corpus with demographic ground truth data and (ii) triangulating the corpus with an alternate Twitter based dataset. In total, the corpus contains 423 billion words representing 148 languages (with over 1 million words from each language) and 158 countries (again with over 1 million words from each country), all distilled from Common Crawl web data. The main contribution of this paper, in addition to describing this publicly available corpus, is to provide a comprehensive analysis of the relationship between two sources of digital data (the web and Twitter) as well as their connection to underlying populations.


Yet it moves Learning from Generic Motions to Generate IMU data from YouTube videos. Human activity recognition (HAR) using wearable sensors has benefited much less from recent advances in Machine Learning than fields such as computer vision and natural language processing. This is to a large extent due to the lack of large scale repositories of labeled training data. In our research we aim to facilitate the use of online videos, which exists in ample quantity for most activities and are much easier to label than sensor data, to simulate labeled wearable motion sensor data. In previous work we already demonstrate some preliminary results in this direction focusing on very simple, activity specific simulation models and a single sensor modality (acceleration norm) cite 10.1145 3341162.3345590 . In this paper we show how we can train a regression model on generic motions for both accelerometer and gyro signals and then apply it to videos of the target activities to generate synthetic IMU data (acceleration and gyro norms) that can be used to train and or improve HAR models. We demonstrate that systems trained on simulated data generated by our regression model can come to within around 10 of the mean F1 score of a system trained on real sensor data. Furthermore we show that by either including a small amount of real sensor data for model calibration or simply leveraging the fact that (in general) we can easily generate much more simulated data from video than we can collect in terms of real sensor data the advantage of real sensor data can be eventually equalized.


Distilling Visual Priors from Self Supervised Learning. Convolutional Neural Networks (CNNs) are prone to overfit small training datasets. We present a novel two phase pipeline that leverages self supervised learning and knowledge distillation to improve the generalization ability of CNN models for image classification under the data deficient setting. The first phase is to learn a teacher model which possesses rich and generalizable visual representations via self supervised learning, and the second phase is to distill the representations into a student model in a self distillation manner, and meanwhile fine tune the student model for the image classification task. We also propose a novel margin loss for the self supervised contrastive learning proxy task to better learn the representation under the data deficient scenario. Together with other tricks, we achieve competitive performance in the VIPriors image classification challenge.


Non archimedean integrals as limits of complex integrals. We explain how non archimedean integrals considered by Chambert Loir and Ducros naturally arise in asymptotics of families of complex integrals. To perform this analysis we work over a non standard model of the field of complex numbers, which is endowed at the same time with an archimedean and a non archimedean norm. Our main result states the existence of a natural morphism between bicomplexes of archimedean and non archimedean forms which is compatible with integration.


Leaking Sensitive Financial Accounting Data in Plain Sight using Deep Autoencoder Neural Networks. Nowadays, organizations collect vast quantities of sensitive information in Enterprise Resource Planning' (ERP) systems, such as accounting relevant transactions, customer master data, or strategic sales price information. The leakage of such information poses a severe threat for companies as the number of incidents and the reputational damage to those experiencing them continue to increase. At the same time, discoveries in deep learning research revealed that machine learning models could be maliciously misused to create new attack vectors. Understanding the nature of such attacks becomes increasingly important for the (internal) audit and fraud examination practice. The creation of such an awareness holds in particular for the fraudulent data leakage using deep learning based steganographic techniques that might remain undetected by state of the art Computer Assisted Audit Techniques' (CAATs). In this work, we introduce a real world threat model' designed to leak sensitive accounting data. In addition, we show that a deep steganographic process, constituted by three neural networks, can be trained to hide such data in unobtrusive day to day' images. Finally, we provide qualitative and quantitative evaluations on two publicly available real world payment datasets.


Toward fast and accurate human pose estimation via soft gated skip connections. This paper is on highly accurate and highly efficient human pose estimation. Recent works based on Fully Convolutional Networks (FCNs) have demonstrated excellent results for this difficult problem. While residual connections within FCNs have proved to be quintessential for achieving high accuracy, we re analyze this design choice in the context of improving both the accuracy and the efficiency over the state of the art. In particular, we make the following contributions (a) We propose gated skip connections with per channel learnable parameters to control the data flow for each channel within the module within the macro module. (b) We introduce a hybrid network that combines the HourGlass and U Net architectures which minimizes the number of identity connections within the network and increases the performance for the same parameter budget. Our model achieves state of the art results on the MPII and LSP datasets. In addition, with a reduction of 3x in model size and complexity, we show no decrease in performance when compared to the original HourGlass network.


Deep Learning in Diabetic Foot Ulcers Detection A Comprehensive Evaluation. There has been a substantial amount of research involving computer methods and technology for the detection and recognition of diabetic foot ulcers (DFUs), but there is a lack of systematic comparisons of state of the art deep learning object detection frameworks applied to this problem. DFUC2020 provided participants with a comprehensive dataset consisting of 2,000 images for training and 2,000 images for testing. This paper summarises the results of DFUC2020 by comparing the deep learning based algorithms proposed by the winning teams Faster R CNN, three variants of Faster R CNN and an ensemble method YOLOv3 YOLOv5 EfficientDet and a new Cascade Attention Network. For each deep learning method, we provide a detailed description of model architecture, parameter settings for training and additional stages including pre processing, data augmentation and post processing. We provide a comprehensive evaluation for each method. All the methods required a data augmentation stage to increase the number of images available for training and a post processing stage to remove false positives. The best performance was obtained from Deformable Convolution, a variant of Faster R CNN, with a mean average precision (mAP) of 0.6940 and an F1 Score of 0.7434. Finally, we demonstrate that the ensemble method based on different deep learning methods can enhanced the F1 Score but not the mAP.


The implications of digitalization on business model change. Context Digitalization brings new opportunities and also challenges to software companies. Objective Software companies have mostly focused on the technical aspects of handing changes and mostly ignoring the business model changes and their implications on software organization and the architecture. In this paper, we synthesize implications of the digitalization based on an extensive literature survey and a longitudinal case study at Ericsson AB. Method Using thematic analysis, we present six propositions to be used to facilitate the cross disciplinary analysis of business model dynamics and the effectiveness and efficiency of the outcome of business modeling, by linking value, transaction, and organizational learning to business model change. Conclusions Business model alignment is highlighted as a new business model research area for understanding the relationships between the dynamic nature of business models, organization design, and the value creation in the business model activities.


Informed Sampling for Diversity in Concept to Text NLG. Deep learning models for language generation tasks tend to produce repetitive output. Various methods have been proposed to encourage lexical diversity during decoding, but this often comes at a cost to the perceived fluency and adequacy of the output. In this work, we propose to ameliorate this cost by using an Imitation Learning approach to explore the level of diversity that a language generation model can reliably produce. Specifically, we augment the decoding process with a meta classifier trained to distinguish which words at any given timestep will lead to high quality output. We focus our experiments on concept to text generation where models are sensitive to the inclusion of irrelevant words due to the strict relation between input and output. Our analysis shows that previous methods for diversity underperform in this setting, while human evaluation suggests that our proposed method achieves a high level of diversity with minimal effect to the output's fluency and adequacy.


Local and global applications of the Minimal Model Program for co rank one foliations on threefolds. We provide several applications of the minimal model program to the local and global study of co rank one foliations on threefolds. Locally, we prove a singular variant of Malgrange's theorem, a classification of terminal foliation singularities and the existence of separatrices for log canonical singularities. Globally, we prove termination of flips, a connectedness theorem on lc centres, a non vanshing theorem and some hyperbolicity properties of foliations.


Mass in Mass Lattices with Small Internal Resonators. We consider the mass in mass (MiM) lattice when the internal resonators are very small. When there are no internal resonators the lattice reduces to a standard Fermi Pasta Ulam Tsingou (FPUT) system. We show that the solution of the MiM system, with suitable initial data, shadows the FPUT system for long periods of time. Using some classical oscillatory integral estimates we can conclude that the error of the approximation is (in some settings) higher than one may expect.


Model order reduction for parametric high dimensional models in the analysis of financial risk. This paper presents a model order reduction (MOR) approach for high dimensional problems in the analysis of financial risk. To understand the financial risks and possible outcomes, we have to perform several thousand simulations of the underlying product. These simulations are expensive and create a need for efficient computational performance. Thus, to tackle this problem, we establish a MOR approach based on a proper orthogonal decomposition (POD) method. The study involves the computations of high dimensional parametric convection diffusion reaction partial differential equations (PDEs). POD requires to solve the high dimensional model at some parameter values to generate a reduced order basis. We propose an adaptive greedy sampling technique based on surrogate modeling for the selection of the sample parameter set that is analyzed, implemented, and tested on the industrial data. The results obtained for the numerical example of a floater with cap and floor under the Hull White model indicate that the MOR approach works well for short rate models.


Hopf monoids of ordered simplicial complexes. We study pure ordered simplicial complexes (i.e., simplicial complexes with a linear order on their ground sets) from the Hopf theoretic point of view. We define a textit Hopf class to be a family of pure ordered simplicial complexes that give rise to a Hopf monoid under join and deletion contraction. The prototypical Hopf class is the family of ordered matroids. The idea of a Hopf class allows us to give a systematic study of simplicial complexes related to matroids, including shifted complexes, broken circuit complexes, and textit unbounded matroids (which arise from unbounded generalized permutohedra with 0 1 coordinates). We compute the antipodes in two cases textit facet initial complexes (a much larger class than shifted complexes) and unbounded ordered matroids. In the latter case, we embed the Hopf monoid of ordered matroids into the Hopf monoid of ordered generalized permutohedra, enabling us to compute the antipode using the topological method of Aguiar and Ardila. The calculation is complicated by the appearance of certain auxiliary simplicial complexes that we call textit Scrope complexes , whose Euler characteristics control certain coefficients of the antipode. The resulting antipode formula is multiplicity free and cancellation free.


Learning Cross Domain Correspondence for Control with Dynamics Cycle Consistency. At the heart of many robotics problems is the challenge of learning correspondences across domains. For instance, imitation learning requires obtaining correspondence between humans and robots sim to real requires correspondence between physics simulators and the real world transfer learning requires correspondences between different robotics environments. This paper aims to learn correspondence across domains differing in representation (vision vs. internal state), physics parameters (mass and friction), and morphology (number of limbs). Importantly, correspondences are learned using unpaired and randomly collected data from the two domains. We propose textit dynamics cycles that align dynamic robot behavior across two domains using a cycle consistency constraint. Once this correspondence is found, we can directly transfer the policy trained on one domain to the other, without needing any additional fine tuning on the second domain. We perform experiments across a variety of problem domains, both in simulation and on real robot. Our framework is able to align uncalibrated monocular video of a real robot arm to dynamic state action trajectories of a simulated arm without paired data. Video demonstrations of our results are available at https sjtuzq.github.io cycle dynamics.html .


Online Payments by Merely Broadcasting Messages (Extended Version). We address the problem of online payments, where users can transfer funds among themselves. We introduce Astro, a system solving this problem efficiently in a decentralized, deterministic, and completely asynchronous manner. Astro builds on the insight that consensus is unnecessary to prevent double spending. Instead of consensus, Astro relies on a weaker primitive Byzantine reliable broadcast enabling a simpler and more efficient implementation than consensus based payment systems. In terms of efficiency, Astro executes a payment by merely broadcasting a message. The distinguishing feature of Astro is that it can maintain performance robustly, i.e., remain unaffected by a fraction of replicas being compromised or slowed down by an adversary. Our experiments on a public cloud network show that Astro can achieve near linear scalability in a sharded setup, going from 10K payments sec (2 shards) to 20K payments sec (4 shards). In a nutshell, Astro can match VISA level average payment throughput, and achieves a 5 times improvement over a state of the art consensus based solution, while exhibiting sub second 95 th percentile latency.


Simulations of Majorana spin flips in an antihydrogen trap. The properties of antihydrogen ( bar rm H ) have, thus far, been probed at magnetic fields of sim 1 T. It may be fruitful to perform some of these measurements at magnetic fields approaching 0 T. In this case, there could occur zeros in the magnitude of the B field. The number and properties of the magnetic field zeros are investigated. For typical magnetic field geometries in bar rm H traps, the zeros will occur as two groups of 5 closely spaced points instead of as a single point. Except in special cases, results from calculations show that these 10 zeros can be treated as independent sources of spin flip probability. Although the behavior of Majorana spin flip near higher order zeros should not be important in the bar rm H traps, the probability for spin flip is calculated for the case of a quadratic zero. Finally, results are presented for a simple model of how magnetic field zeros would affect the trapped population of bar rm H .


Weak fixed point property and the space of affine functions. First we prove that if a separable Banach space X contains an isometric copy of an infinite dimensional space A(S) of affine continuous functions on a Choquet simplex S , then its dual X lacks the weak fixed point property for nonexpansive mappings. Then, we show that the dual of a separable Lindenstrauss space X fails the weak fixed point property for nonexpansive mappings if and only if X has a quotient isometric to some space A(S) . Moreover, we provide an example showing that "quotient" cannot be replaced by "subspace". Finally, it is worth to be mentioned that in our characterization the space A(S) cannot be substituted by any space mathcal C (K) of continuous functions on a compact Hausdorff K .


An Analysis of Python's Topics, Trends, and Technologies Through Mining Stack Overflow Discussions. Python is a popular, widely used, and general purpose programming language. In spite of its ever growing community, researchers have not performed much analysis on Python's topics, trends, and technologies which provides insights for developers about Python community trends and main issues. In this article, we examine the main topics related to this language being discussed by developers on one of the most popular Q A websites, Stack Overflow, as well as temporal trends through mining 2461876 posts. To be more useful for the software engineers, we study what Python provides as the alternative to popular technologies offered by common programming languages like Java. Our results indicate that discussions about Python standard features, web programming, and scientific programming. Programming in areas such as mathematics, data science, statistics, machine learning, natural language processing (NLP), and so forth. are the most popular areas in the Python community. At the same time, areas related to scientific programming are steadily receiving more attention from the Python developers.


Error estimation and uncertainty quantification for first time to a threshold value. Classical a posteriori error analysis for differential equations quantifies the error in a Quantity of Interest (QoI) which is represented as a bounded linear functional of the solution. In this work we consider a posteriori error estimates of a quantity of interest that cannot be represented in this fashion, namely the time at which a threshold is crossed for the first time. We derive two representations for such errors and use an adjoint based a posteriori approach to estimate unknown terms that appear in our representation. The first representation is based on linearizations using Taylor's Theorem. The second representation is obtained by implementing standard root finding techniques. We provide several examples which demonstrate the accuracy of the methods. We then embed these error estimates within a framework to provide error bounds on a cumulative distribution function when parameters of the differential equations are uncertain.


Multi Temporal Analysis and Scaling Relations of 100,000,000,000 Network Packets. Our society has never been more dependent on computer networks. Effective utilization of networks requires a detailed understanding of the normal background behaviors of network traffic. Large scale measurements of networks are computationally challenging. Building on prior work in interactive supercomputing and GraphBLAS hypersparse hierarchical traffic matrices, we have developed an efficient method for computing a wide variety of streaming network quantities on diverse time scales. Applying these methods to 100,000,000,000 anonymized source destination pairs collected at a network gateway reveals many previously unobserved scaling relationships. These observations provide new insights into normal network background traffic that could be used for anomaly detection, AI feature engineering, and testing theoretical models of streaming networks.


A Verified Architecture for Proofs of Execution on Remote Devices under Full Software Compromise. Modern society is increasingly surrounded by, and accustomed to, a wide range of Cyber Physical Systems (CPS), Internet of Things (IoT), and smart devices. They often perform safety critical functions, e.g., personal medical devices, automotive CPS and industrial automation (smart factories). Some devices are small, cheap and specialized sensors and or actuators. They tend to run simple software and operate under control of a more sophisticated central control unit. The latter is responsible for the decision making and orchestrating the entire system. If devices are left unprotected, consequences of forged sensor readings or ignored actuation commands can be catastrophic, particularly, in safety critical settings. This prompts the following three questions (1) How to trust data produced by a simple remote embedded device? and (2) How to ascertain that this data was produced via execution of expected software? Furthermore, (3) Is it possible to attain (1) and (2) under the assumption that all software on the remote device could be modified or compromised? In this paper we answer these questions by designing, proving security of, and formally verifying, VAPE Verified Architecture for Proofs of Execution. To the best of our knowledge, this is the first of its kind result for low end embedded systems. Our work has a range of applications, especially, to authenticated sensing and trustworthy actuation, which are increasingly relevant in the context of safety critical systems. VAPE architecture is publicly available and our evaluation demonstrates that it incurs low overhead, affordable even for lowest end embedded devices, e.g., those based on MSP430 or ARV ATMega processors.


Surfaces have (asymptotic) dimension 2. The asymptotic dimension is an invariant of metric spaces introduced by Gromov in the context of geometric group theory. When restricted to graphs and their shortest paths metric, the asymptotic dimension can be seen as a large scale version of weak diameter colorings (also known as weak diameter network decompositions), i.e. colorings in which each monochromatic component has small weak diameter. In this paper, we prove that for any p , the class of graphs excluding K 3,p as a minor has asymptotic dimension at most 2. This implies that the class of all graphs embeddable on any fixed surface (and in particular the class of planar graphs) has asymptotic dimension 2, which gives a positive answer to a recent question of Fujiwara and Papasoglu. Our result extends from graphs to Riemannian surfaces. We also prove that graphs of bounded pathwidth have asymptotic dimension at most 1 and graphs of bounded layered pathwidth have asymptotic dimension at most 2. We give some applications of our techniques to graph classes defined in a topological or geometrical way, and to graph classes of polynomial growth. Finally we prove that the class of bounded degree graphs from any fixed proper minor closed class has asymptotic dimension at most 2. This can be seen as a large scale generalization of the result that bounded degree graphs from any fixed proper minor closed class are 3 colorable with monochromatic components of bounded size. This also implies that (infinite) Cayley graphs avoiding some minor have asymptotic dimension at most 2, which solves a problem raised by Ostrovskii and Rosenthal.


MorphStore Analytical Query Engine with a Holistic Compression Enabled Processing Model. In this paper, we present MorphStore, an open source in memory columnar analytical query engine with a novel holistic compression enabled processing model. Basically, compression using lightweight integer compression algorithms already plays an important role in existing in memory column store database systems, but mainly for base data. In particular, during query processing, these systems only keep the data compressed until an operator cannot process the compressed data directly, whereupon the data is decompressed, but not recompressed. Thus, the full potential of compression during query processing is not exploited. To overcome that, we developed a novel compression enabled processing model as presented in this paper. As we are going to show, the continuous usage of compression for all base data and all intermediates is very beneficial to reduce the overall memory footprint as well as to improve the query performance.


Proceedings 16th International Conference on Quantum Physics and Logic. This volume contains the proceedings of the 16th International Conference on Quantum Physics and Logic (QPL 2017), which was held June 10 14, 2019. Quantum Physics and Logic is an annual conference that brings together researchers working on mathematical foundations of quantum physics, quantum computing, and related areas, with a focus on structural perspectives and the use of logical tools, ordered algebraic and category theoretic structures, formal languages, semantical methods, and other computer science techniques applied to the study of physical behaviour in general. Work that applies structures and methods inspired by quantum theory to other fields (including computer science) is also welcome.


"Stay Nearby or Get Checked" A Covid 19 Lockdown Exit Strategy. This paper repurposes the classic insight from network theory that long distance connections drive disease propagation into a strategy for controlling a second wave of Covid 19. We simulate a scenario in which a lockdown is first imposed on a population and then partly lifted while long range transmission is kept at a minimum. Simulated spreading patterns resemble contemporary distributions of Covid 19 across nations, regions, and provinces, providing some model validation. Results suggest that the proposed strategy may significantly flatten a second wave. We also find that post lockdown flare ups remain local longer, aiding geographical containment. Public policy may target long ties by heavily focusing medical testing and mobility tracking efforts on traffic and transport. This policy can be communicated to the general public as a simple and reasonable principle Stay nearby or get checked.


Deep Learning for Portfolio Optimization. We adopt deep learning models to directly optimise the portfolio Sharpe ratio. The framework we present circumvents the requirements for forecasting expected returns and allows us to directly optimise portfolio weights by updating model parameters. Instead of selecting individual assets, we trade Exchange Traded Funds (ETFs) of market indices to form a portfolio. Indices of different asset classes show robust correlations and trading them substantially reduces the spectrum of available assets to choose from. We compare our method with a wide range of algorithms with results showing that our model obtains the best performance over the testing period, from 2011 to the end of April 2020, including the financial instabilities of the first quarter of 2020. A sensitivity analysis is included to understand the relevance of input features and we further study the performance of our approach under different cost rates and different risk levels via volatility scaling.


Graph based open ended survey on concerns related to COVID 19. The COVID 19 pandemic is an unprecedented public health crisis with broad social and economic consequences. We conducted four surveys between April and August 2020 using the graph based open ended survey (GOS) framework, and investigated the most pressing concerns and issues for the general public in Japan. The GOS framework is a hybrid of the two traditional survey frameworks that allows respondents to post their opinions in a free format style, which can subsequently serve as one of the choice items for other respondents, just as in a multiple choice survey. As a result, this framework generates an opinion graph that relates opinions and respondents. We can also construct annotated opinion graphs to achieve a higher resolution. By clustering the annotated opinion graphs, we revealed the characteristic evolution of the response patterns as well as the interconnectedness and multi faceted nature of opinions. Substantively, our notable finding is that "social pressure," not "infection risk," was one of the major concerns of our respondents. Social pressure refers to criticism and discrimination that they anticipate receiving from others should they contract COVID 19. It is possible that the collectivist nature of Japanese culture coupled with the government's policy of relying on personal responsibility to combat COVID 19 explains some of the above findings, as the latter has led to the emergence of vigilantes. The presence of mutual surveillance can contribute to growing skepticism toward others as well as fear of ostracism, which may have negative consequences at both the societal and individual levels.


Disentangled Non Local Neural Networks. The non local block is a popular module for strengthening the context modeling ability of a regular convolutional neural network. This paper first studies the non local block in depth, where we find that its attention computation can be split into two terms, a whitened pairwise term accounting for the relationship between two pixels and a unary term representing the saliency of every pixel. We also observe that the two terms trained alone tend to model different visual clues, e.g. the whitened pairwise term learns within region relationships while the unary term learns salient boundaries. However, the two terms are tightly coupled in the non local block, which hinders the learning of each. Based on these findings, we present the disentangled non local block, where the two terms are decoupled to facilitate learning for both terms. We demonstrate the effectiveness of the decoupled design on various tasks, such as semantic segmentation on Cityscapes, ADE20K and PASCAL Context, object detection on COCO, and action recognition on Kinetics.


Invariance of polymer partition functions under the geometric RSK correspondence. We prove that the values of discrete directed polymer partition functions involving multiple non intersecting paths remain invariant under replacing the background weights by their images under the geometric RSK correspondence. This result is inspired by a recent and remarkable identity proved by Dauvergne, Orthmann and Vir 'ag which is recovered as the zero temperature, semi discrete limit of our main result.


On improving deep learning generalization with adaptive sparse connectivity. Large neural networks are very successful in various tasks. However, with limited data, the generalization capabilities of deep neural networks are also very limited. In this paper, we empirically start showing that intrinsically sparse neural networks with adaptive sparse connectivity, which by design have a strict parameter budget during the training phase, have better generalization capabilities than their fully connected counterparts. Besides this, we propose a new technique to train these sparse models by combining the Sparse Evolutionary Training (SET) procedure with neurons pruning. Operated on MultiLayer Perceptron (MLP) and tested on 15 datasets, our proposed technique zeros out around 50 of the hidden neurons during training, while having a linear number of parameters to optimize with respect to the number of neurons. The results show a competitive classification and generalization performance.


Rate Splitting Multiple Access for Downlink Multi Antenna Communications Physical Layer Design and Link level Simulations. Rate Splitting Multiple Access (RSMA) is an emerging flexible, robust and powerful multiple access scheme for downlink multi antenna wireless networks. RSMA relies on multi antenna Rate Splitting (RS) strategies at the transmitter and Successive Interference Cancellation (SIC) at the receivers, and has the unique ability to partially decode interference and partially treat interference as noise so as to softly bridge the two extremes of fully decoding interference (as in Non Orthogonal Multiple Access, NOMA) and treating interference as noise (as in Space Division Multiple Access, SDMA or Multi User Multiple Input Multiple Output, MU MIMO). RSMA has been shown to provide significant room for spectral efficiency, energy efficiency, Quality of Service enhancements, robustness to Channel State Information (CSI) imperfections, as well as feedback overhead and complexity reduction, in a wide range of network loads (underloaded and overloaded regimes) and user deployments (with a diversity of channel directions, channel strengths and qualities). RSMA is also deeply rooted and motivated by recent advances in understanding the fundamental limits of multi antenna networks with imperfect CSI at the Transmitter (CSIT). In this work, we leverage recent results on the optimization of RSMA and design for the first time its physical layer, accounting for modulation, coding (using polar codes), message split, adaptive modulation and coding, and SIC receiver. Link level evaluations confirm the significant throughput benefits of RSMA over various baselines as SDMA and NOMA.


Geodesic orbit metrics on homogeneous spaces constructed by strongly isotropy irreducible spaces. In this paper, we focus on homogeneous spaces which are constructed from two strongly isotropy irreducible spaces, and prove that any geodesic orbit metric on these spaces is naturally reductive.


Favourite distances in 3 space. Let S be a set of n points in Euclidean 3 space. Assign to each x in S a distance r(x) 0 , and let e r(x,S) denote the number of points in S at distance r(x) from x . Avis, Erd H o s and Pach (1988) introduced the extremal quantity f 3(n) max sum x in S e r(x,S) , where the maximum is taken over all n point subsets S of 3 space and all assignments r colon S to(0, infty) of distances. We show that if the pair (S,r) maximises f 3(n) and n is sufficiently large, then, except for at most 2 points, S is contained in a circle mathcal C and the axis of symmetry mathcal L of mathcal C , and r(x) equals the distance from x to C for each x in S cap mathcal L . This, together with a new construction, implies that f 3(n) n 2 4 5n 2 O(1) .


Modified SIR Model Yielding a Logistic Solution. The SIR pandemic model suffers from an unrealistic assumption The rate of removal from the infectious class of individuals is assumed to be proportional to the number of infectious individuals. This means that a change in the rate of infection is simultaneous with an equal change in the rate of removal. A more realistic assumption is that an individual is removed at a certain time interval after having been infected. A simple modified SIR model is proposed which implements this delay, resulting in a single delay differential equation which comprises the model. A solution to this equation which is applicable to a pandemic is of the form A B L(t) where L(t) is a logistic function, and A and B are constants. While the classical SIR model is often an oversimplification of pandemic behavior, it is instructive in that many of the fundamental dynamics and descriptors of pandemics are clearly and simply defined. The logistic model is generally used descriptively, dealing as it does with only the susceptible and infected classes and the rate of transfer between them. The present model presents a full but modified SIR model with a simpler logistic solution which is more realistic and equally instructive.


Fast Diffusion Inhibits Disease Outbreaks. We show that the basic reproduction number of an SIS patch model with standard incidence is either strictly decreasing and strictly convex with respect to the diffusion coefficient of infected subpopulation if the patch reproduction numbers of at least two patches in isolation are distinct or constant otherwise. Biologically, it means that fast diffusion of the infected people reduces the risk of infection. This completely solves and generalizes a conjecture by Allen et al. ( it SIAM J Appl Math , 67 1283 1309, 2007). Furthermore, a substantially improved lower bound on the multipatch reproduction number, a generalized monotone result on the spectral bound the Jacobian matrix of the model system at the disease free equilibrium, and the limiting endemic equilibrium are obtained. The approach and results can be applied to a class of epidemic patch models where only one class of infected compartments migrate between patches and one transmission route is involved.


Geometric detection of hierarchical backbones in real networks. Hierarchies permeate the structure of real networks, whose nodes can be ranked according to different features. However, networks are far from tree like structures and the detection of hierarchical ordering remains a challenge, hindered by the small world property and the presence of a large number of cycles, in particular clustering. Here, we use geometric representations of undirected networks to achieve an enriched interpretation of hierarchy that integrates features defining popularity of nodes and similarity between them, such that the more similar a node is to a less popular neighbor the higher the hierarchical load of the relationship. The geometric approach allows us to measure the local contribution of nodes and links to the hierarchy within a unified framework. Additionally, we propose a link filtering method, the similarity filter, able to extract hierarchical backbones containing the links that represent statistically significant deviations with respect to the maximum entropy null model for geometric heterogeneous networks. We applied our geometric approach to the detection of similarity backbones of real networks in different domains and found that the backbones preserve local topological features at all scales. Interestingly, we also found that similarity backbones favor cooperation in evolutionary dynamics modelling social dilemmas.


Foreground aware Semantic Representations for Image Harmonization. Image harmonization is an important step in photo editing to achieve visual consistency in composite images by adjusting the appearances of foreground to make it compatible with background. Previous approaches to harmonize composites are based on training of encoder decoder networks from scratch, which makes it challenging for a neural network to learn a high level representation of objects. We propose a novel architecture to utilize the space of high level features learned by a pre trained classification network. We create our models as a combination of existing encoder decoder architectures and a pre trained foreground aware deep high resolution network. We extensively evaluate the proposed method on existing image harmonization benchmark and set up a new state of the art in terms of MSE and PSNR metrics. The code and trained models are available at url https github.com saic vul image harmonization .


Faster Lagrangian Based Methods in Convex Optimization. In this paper, we aim at unifying, simplifying and improving the convergence rate analysis of Lagrangian based methods for convex optimization problems. We first introduce the notion of nice primal algorithmic map, which plays a central role in the unification and in the simplification of the analysis of most Lagrangian based methods. Equipped with a nice primal algorithmic map, we then introduce a versatile generic scheme, which allows for the design and analysis of Faster LAGrangian (FLAG) methods with new provably sublinear rate of convergence expressed in terms of function values and feasibility violation of the original (non ergodic) generated sequence. To demonstrate the power and versatility of our approach and results, we show that most well known iconic Lagrangian based schemes admit a nice primal algorithmic map, and hence share the new faster rate of convergence results within their corresponding FLAG.


The dual approach to non negative super resolution perturbation analysis. We study the problem of super resolution, where we recover the locations and weights of non negative point sources from a few samples of their convolution with a Gaussian kernel. It has been shown that exact recovery is possible by minimising the total variation norm of the measure, and a practical way of achieve this is by solving the dual problem. In this paper, we study the stability of solutions with respect to the solutions dual problem, both in the case of exact measurements and in the case of measurements with additive noise. In particular, we establish a relationship between perturbations in the dual variable and perturbations in the primal variable around the optimiser and a similar relationship between perturbations in the dual variable around the optimiser and the magnitude of the additive noise in the measurements. Our analysis is based on a quantitative version of the implicit function theorem.


A novel countermeasure technique to protect WSN against denial of sleep attacks using firefly and Hopfield neural network (HNN) algorithms. Wireless sensor networks (WSNs) contain numerous nodes that their main goals are to monitor and control environments. Also, sensor nodes distribute based on network usage. One of the most significant issues in this type of network is the energy consumption of sensor nodes. In fixed sink networks, nodes which are near the sink act as an interface to transfer data of other nodes to sink. This causes the energy consumption of sensors reduces rapidly. Therefore, the lifetime of the network declines. Sensor nodes owing to their weaknesses are susceptible to several threats, one of which is denial of sleep attack (DoSA) threatening WSN. Hence, the DoSA refers to the energy loss in these nodes by maintaining the nodes from entering energy saving and sleep mode. In this paper, a hybrid approach is proposed based on mobile sink, firefly algorithm based on leach, and Hopfield neural network (WSN FAHN). Thus, mobile sink is applied to both improve energy consumption and increase network lifetime. Firefly algorithm is proposed to cluster nodes and authenticate in two levels to prevent from DoSA. In addition, Hopfield neural network detects the direction route of the sink movement to send data of CH. Furthermore, here WSN FAHN technique is assessed through wide simulations performed in the NS 2 environment. The WSN FAHN procedure superiority is demonstrated by simulation outcomes in comparison with contemporary schemes based on performance metrics like packet delivery ratio (PDR), average throughput, detection ratio, and network lifetime while decreasing the average residual energy.


The equation (x d) 5 x 5 (x d) 5 y n . In this paper, we solve the equation of the title under the assumption that gcd(x,d) 1 and n geq 2 . This generalizes earlier work of the first author, Patel and Siksek BPS16 . Our main tools include Frey Hellegouarch curves and associated modular forms, and an assortment of Chabauty type techniques for determining rational points on curves of small positive genus.


Multi domain Clinical Natural Language Processing with MedCAT the Medical Concept Annotation Toolkit. Electronic health records (EHR) contain large volumes of unstructured text, requiring the application of Information Extraction (IE) technologies to enable clinical analysis. We present the open source Medical Concept Annotation Toolkit (MedCAT) that provides a) a novel self supervised machine learning algorithm for extracting concepts using any concept vocabulary including UMLS SNOMED CT b) a feature rich annotation interface for customising and training IE models and c) integrations to the broader CogStack ecosystem for vendor agnostic health system deployment. We show improved performance in extracting UMLS concepts from open datasets (F1 0.448 0.738 vs 0.429 0.650). Further real world validation demonstrates SNOMED CT extraction at 3 large London hospitals with self supervised training over 8.8B words from 17M clinical records and further fine tuning with 6K clinician annotated examples. We show strong transferability (F1 0.94) between hospitals, datasets, and concept types indicating cross domain EHR agnostic utility for accelerated clinical and research use cases.


An energy, momentum and angular momentum conserving scheme for a regularization model of incompressible flow. We introduce a new regularization model for incompressible fluid flow, which is a regularization of the EMAC formulation of the Navier Stokes equations (NSE) that we call EMAC Reg. The EMAC (energy, momentum, and angular momentum conserving) formulation has proved to be a useful formulation because it conserves energy, momentum and angular momentum even when the divergence constraint is only weakly enforced. However it is still a NSE formulation and so cannot resolve higher Reynolds number flows without very fine meshes. By carefully introducing regularization into the EMAC formulation, we create a model more suitable for coarser mesh computations but that still conserves the same quantities as EMAC, i.e., energy, momentum, and angular momentum. We show that EMAC Reg, when semi discretized with a finite element spatial discretization is well posed and optimally accurate. Numerical results are provided that show EMAC Reg is a robust coarse mesh model.


Topological complexity of real Grassmannians. We use some detailed knowledge of the cohomology ring of real Grassmann manifolds G k( mathbb R n) to compute zero divisor cup length and estimate topological complexity of motion planning for k linear subspaces in mathbb R n . In addition, we obtain results about monotonicity of Lusternik Schnirelmann category and topological complexity of G k( mathbb R n) as a function of n .


On dense subsets of matrices with distinct eigenvalues and distinct singular values. It is well known that the set of all n times n matrices with distinct eigenvalues is a dense subset of the set of all real or complex n times n matrices. In Hartfiel, D. J. Dense sets of diagonalizable matrices. Proc. Amer. Math. Soc., 123(6) 1669 1672, 1995. , the author established a necessary and sufficient condition for a subspace of the set of all n times n matrices to have a dense subset of matrices with distinct eigenvalues. We are interested in finding a few necessary and sufficient conditions for a subset of the set of all n times n real or complex matrices to have a dense subset of matrices with distinct eigenvalues. Some of our results are generalizing the results of Hartfiel. Also, we study the existence of dense subsets of matrices with distinct singular values, distinct analytic eigenvalues, and distinct analytic singular values, respectively, in the subsets of the set of all real or complex matrices.


Geometry aware Instance reweighted Adversarial Training. In adversarial machine learning, there was a common belief that robustness and accuracy hurt each other. The belief was challenged by recent studies where we can maintain the robustness and improve the accuracy. However, the other direction, whether we can keep the accuracy while improving the robustness, is conceptually and practically more interesting, since robust accuracy should be lower than standard accuracy for any model. In this paper, we show this direction is also promising. Firstly, we find even over parameterized deep networks may still have insufficient model capacity, because adversarial training has an overwhelming smoothing effect. Secondly, given limited model capacity, we argue adversarial data should have unequal importance geometrically speaking, a natural data point closer to farther from the class boundary is less more robust, and the corresponding adversarial data point should be assigned with larger smaller weight. Finally, to implement the idea, we propose geometry aware instance reweighted adversarial training, where the weights are based on how difficult it is to attack a natural data point. Experiments show that our proposal boosts the robustness of standard adversarial training combining two directions, we improve both robustness and accuracy of standard adversarial training.


Single Step Shaping of the Orbital Angular Momentum Spectrum of Light. Control of orbital angular momentum (OAM) in optical fields has seen tremendous growth of late, with a myriad of tools existing for their creation and detection. What has been lacking is the ability to arbitrarily modify the OAM spectrum of a superposition in amplitude and phase, especially if a priori knowledge of the initial OAM spectrum is absent. Motivated by a quasi mapping that exists between the position and OAM of Laguerre Gaussian modes, we propose an approach for single step modulation of a field's OAM spectrum. We outline the concept and implement it through the use of binary ring apertures encoded on spatial light modulators. We show that complete control of the OAM spectrum is achievable in a single step, fostering applications in classical and quantum information processing that utilise the OAM basis.


Almost symmetric numerical semigroups with high type. We establish a one to one correspondence between numerical semigroups of genus g and almost symmetric numerical semigroups with Frobenius number F and type F 2g , provided that F is greater than 4g 1 .


Describing the movement of molecules in reduced dimension models. When addressing spatial biological questions using mathematical models, symmetries within the system are often exploited to simplify the problem by reducing its physical dimension. In a reduced dimension model molecular movement is restricted to the reduced dimension, changing the nature of molecular movement. This change in molecular movement can lead to quantitatively and even qualitatively different results in the full and reduced systems. Within this manuscript we discuss the condition under which restricted molecular movement in reduced dimension models accurately approximates molecular movement in the full system. For those systems which do not satisfy the condition, we present a general method for approximating unrestricted molecular movement in reduced dimension models. We will derive a mathematically robust, finite difference method for solving the 2D diffusion equation within a 1D reduced dimension model. The methods described here can be used to improve the accuracy of many reduced dimension models while retaining benefits of system simplification.


Unicorn paths and hyperfiniteness for the mapping class group. Let S be an orientable surface of finite type. Using Pho On's infinite unicorn paths, we prove the hyperfiniteness of orbit equivalence relations induced by the actions of the mapping class group of S on the Gromov boundaries of the arc graph and the curve graph of S. In the curve graph case, this strengthens the results of Hamenst "adt and Kida that this action is universally amenable and that the mapping class group of S is exact.


DIPPAS A Deep Image Prior PRNU Anonymization Scheme. Source device identification is an important topic in image forensics since it allows to trace back the origin of an image. Its forensics counter part is source device anonymization, that is, to mask any trace on the image that can be useful for identifying the source device. A typical trace exploited for source device identification is the Photo Response Non Uniformity (PRNU), a noise pattern left by the device on the acquired images. In this paper, we devise a methodology for suppressing such a trace from natural images without significant impact on image quality. Specifically, we turn PRNU anonymization into an optimization problem in a Deep Image Prior (DIP) framework. In a nutshell, a Convolutional Neural Network (CNN) acts as generator and returns an image that is anonymized with respect to the source PRNU, still maintaining high visual quality. With respect to widely adopted deep learning paradigms, our proposed CNN is not trained on a set of input target pairs of images. Instead, it is optimized to reconstruct the PRNU free image from the original image under analysis itself. This makes the approach particularly suitable in scenarios where large heterogeneous databases are analyzed and prevents any problem due to lack of generalization. Through numerical examples on publicly available datasets, we prove our methodology to be effective compared to state of the art techniques.


The 1995 2018 Global Evolution of the Network of Amicable and Hostile Relations Among Nation States. We draw on the data collected by the Integrated Crisis Early Warning System on millions of international and regional public news stories, and this system's indicators of the orientation toward a specific nation state. We construct the networks of international amicable and hostile relations among nation states that occur in specific time periods in order to study the global evolution of the network of such international appraisals. Our analysis presents evidence of an evolution of the structure of this network and a model of the probabilistic micro dynamics of the alterations of international appraisals during the 1995 2018 span of the available data. Our research provides empirical findings on long standing debates in the interdisciplinary field of work on Structural Balance Theory. Also remarkably, we find that the trajectory of the Frobenius norm of sequential transition probabilities, which govern the evolution of international appraisals among nations, dramatically stabilizes.


Multivariate Rational Approximation. We present two approaches for computing rational approximations to multivariate functions, motivated by their effectiveness as surrogate models for high energy physics (HEP) applications. Our first approach builds on the Stieltjes process to efficiently and robustly compute the coefficients of the rational approximation. Our second approach is based on an optimization formulation that allows us to include structural constraints on the rational approximation, resulting in a semi infinite optimization problem that we solve using an outer approximation approach. We present results for synthetic and real life HEP data, and we compare the approximation quality of our approaches with that of traditional polynomial approximations.


Trace of canonical modules, annihilator of Ext, and classes of rings close to being Gorenstein. In this note we study trace ideals of canonical modules. Characterizations of the trace ideals in terms of annihilators of certain Ext modules are given. We apply our results to study many classes of rings close to being Gorenstein that appear in recent literature. We discuss the behavior of nearly Gorensteinness, introduced by Herzog Hibi Stamate, under reductions by regular sequences. A nearly Gorenstein version of the Tachikawa conjecture is posed, and an affirmative answer given for type 2 rings. We also introduce the class of weakly almost Gorenstein rings using the canonical module, and show that they are almost Gorenstein rings in dimension one, and are closely related to Teter rings in the artinian case. We explain their basic properties and give some examples.


Fingerprint Presentation Attack Detection Based on Local Features Encoding for Unknown Attacks. Fingerprint based biometric systems have experienced a large development in the last years. Despite their many advantages, they are still vulnerable to presentation attacks (PAs). Therefore, the task of determining whether a sample stems from a live subject (i.e., bona fide) or from an artificial replica is a mandatory issue which has received a lot of attention recently. Nowadays, when the materials for the fabrication of the Presentation Attack Instruments (PAIs) have been used to train the PA Detection (PAD) methods, the PAIs can be successfully identified. However, current PAD methods still face difficulties detecting PAIs built from unknown materials or captured using other sensors. Based on that fact, we propose a new PAD technique based on three image representation approaches combining local and global information of the fingerprint. By transforming these representations into a common feature space, we can correctly discriminate bona fide from attack presentations in the aforementioned scenarios. The experimental evaluation of our proposal over the LivDet 2011 to 2015 databases, yielded error rates outperforming the top state of the art results by up to 50 in the most challenging scenarios. In addition, the best configuration achieved the best results in the LivDet 2019 competition (overall accuracy of 96.17 ).


On modules M such that M and M are semi Gorenstein projective. Let A be an artin algebra. An A module M is semi Gorenstein projective provided that Ext i(M,A) 0 for all i 0. If M is Gorenstein projective, then both M and its A dual M are semi Gorenstein projective. As we have shown recently, the converse is not true, thus answering a question raised by Avramov and Martsinkovsky. The aim of the present note is to analyse in detail the modules M such that both M and M are semi Gorenstein projective.


Plotting Markson's 'Mistress'. The post modern novel 'Wittgenstein's Mistress' by David Markson (1988) presents the reader with a very challenging non linear narrative, that itself appears to one of the novel's themes. We present a distant reading of this work designed to complement a close reading of it by David Foster Wallace (1990). Using a combination of text analysis, entity recognition and networks, we plot repetitive structures in the novel's narrative relating them to its critical analysis.


DGAs with polynomial homology. In this work, we study the classification of differential graded algebras over mathbb Z (DGAs) whose homology is mathbb F p x , i.e. the polynomial algebra over mathbb F p on a single generator. This classification problem was left open in work of Dwyer, Greenlees and Iyengar. For lvert y 2p 2 rvert 2p 2 , we show that there is a unique non formal DGA with homology mathbb F p y 2p 2 and a non formal 2p 2 Postnikov section. Among a classification result, this provides the first example of a non formal DGA with homology mathbb F p x . By duality, this also shows that there is a non formal DGA whose homology is an exterior algebra over mathbb F p with a generator in degree (2p 1) . Considering the classification of the ring spectra corresponding to these DGAs, we show that every E 2 DGA with homology mathbb F p x (with no restrictions on lvert x rvert ) is topologically equivalent to the formal DGA with homology mathbb F p x , i.e. they are topologically formal. This follows by a theorem of Hopkins and Mahowald.


Assessing Impact of Data Partitioning for Approximate Memory in C C Code. Approximate memory is a technique to mitigate the performance gap between memory subsystems and CPUs with its reduced access latency at a cost of data integrity. To gain benefit from approximate memory for realistic applications, it is crucial to partition applications' data to approximate data and critical data and apply different error rates. However, error rates cannot be controlled in a fine grained manner (e.g., per byte) due to fundamental limitations of how approximate memory can be realized. Due to this, if approximate data and critical data are interleaved in a data structure (e.g., a C struct that has a pointer and an approximatable number as its members), data partitioning may degrade the application's performance because the data structure must be split to separate memory regions that have different error rates. This paper is the first to conduct an analysis of realistic C C code to assess the impact of this problem. First, we find the type of data (e.g., "int", "struct point") that is assessed by the instruction that incurs the largest number of cache misses in a benchmark, which we refer to as the target data type. Second, we qualitatively estimate if the target data type of an application has approximate data and critical data interleaved. To this end, we set up three criteria to analyze it because definitively distinguishing a piece of data as approximate data or critical data is infeasible since it depends on each use case. We analyze 11 memory intensive benchmarks from SPEC CPU 2006 and 2 graph analytics frameworks, and show that the target data types of 9 benchmarks are either a C struct or a C class (criterion 1). Among them, two have a pointer and a non pointer member together (criterion 2) and three have a floating point number and other members together (criterion 3).


Natural pigments from microalgae grown in industrial wastewater. The aim of this study was to investigate the cultivation of Nostoc sp., Arthrospira platensis and Porphyridium purpureum in industrial wastewater to produce phycobiliproteins. Initially, light intensity and growth medium composition were optimized, indicating that light conditions influenced the phycobiliproteins production more than the medium composition. Conditions were then selected, according to biomass growth, nutrients removal and phycobiliproteins production, to cultivate these microalgae in food industry wastewater. The three species could efficiently remove up to 98 , 94 and 100 of COD, inorganic nitrogen and PO43 P, respectively. Phycocyanin, allophycocyanin and phycoerythrin were successfully extracted from the biomass reaching concentrations up to 103, 57 and 30 mg g dry weight, respectively. Results highlight the potential use of microalgae for industrial wastewater treatment and related high value phycobiliproteins recovery.


A Partial Information Decomposition Based on Causal Tensors. We propose a partial information decomposition based on the newly introduced framework of causal tensors, i.e., multilinear stochastic maps that transform source data into destination data. This framework enables us to express an indirect association in terms of the constituting, direct associations. This is not possible when using average measures like mutual information or transfer entropy. From this, an intuitive definition of redundant and unique information arises. The proposed redundancy satisfies the three axioms stated by introduced by Williams and Beer. The symmetry and self redundancy properties follow directly from our definition. The Data Processing Inequality ensures that the monotonicity axiom is satisfied. Additional, two other proposed axioms are satisfied the identity property, and the left monotonicity axiom. Because causal tensors can describe both mutual information as transfer entropy, the proposed partial information decomposition applies to both measures. Results show that the decomposition closely resembles the decomposition of another approach that expresses associations in terms of mutual information a posteriori. It is furthermore demonstrated that negative contributions can arise when our assumptions about completeness of the data set, or what should be included as a source, are incorrect.


Exploring Feature Representation and Training strategies in Temporal Action Localization. Temporal action localization has recently attracted significant interest in the Computer Vision community. However, despite the great progress, it is hard to identify which aspects of the proposed methods contribute most to the increase in localization performance. To address this issue, we conduct ablative experiments on feature extraction methods, fixed size feature representation methods and training strategies, and report how each influences the overall performance. Based on our findings, we propose a two stage detector that outperforms the state of the art in THUMOS14, achieving a mAP tIoU 0.5 equal to 44.2 .


A Simple Model for Portable and Fast Prediction of Execution Time and Power Consumption of GPU Kernels. Characterizing compute kernel execution behavior on GPUs for efficient task scheduling is a non trivial task. We address this with a simple model enabling portable and fast predictions among different GPUs using only hardware independent features. This model is built based on random forests using 189 individual compute kernels from benchmarks such as Parboil, Rodinia, Polybench GPU and SHOC. Evaluation of the model performance using cross validation yields a median Mean Average Percentage Error (MAPE) of 8.86 52.00 and 1.84 2.94 , for time respectively power prediction across five different GPUs, while latency for a single prediction varies between 15 and 108 milliseconds.


Walrasian Equilibria in Markets with Small Demands. We study the complexity of finding a Walrasian equilibrium in markets where the agents have k demand valuations. These valuations are an extension of unit demand valuations where a bundle's value is the maximum of its k subsets' values. For unit demand agents, where the existence of a Walrasian equilibrium is guaranteed, we show that the problem is in quasi NC. For k 2 , we show that it is NP hard to decide if a Walrasian equilibrium exists even if the valuations are fractionally subadditive (XOS), while for k 3 the hardness carries over to budget additive valuations. In addition, we give a polynomial time algorithm for markets with 2 demand single minded valuations, or unit demand valuations.


Some Worst Case Datasets of Deterministic First Order Methods for Solving Binary Logistic Regression. We present in this paper some worst case datasets of deterministic first order methods for solving large scale binary logistic regression problems. Under the assumption that the number of algorithm iterations is much smaller than the problem dimension, with our worst case datasets it requires at least mathcal O (1 sqrt varepsilon ) first order oracle inquiries to compute an varepsilon approximate solution. From traditional iteration complexity analysis point of view, the binary logistic regression loss functions with our worst case datasets are new worst case function instances among the class of smooth convex optimization problems.


GraphACT Accelerating GCN Training on CPU FPGA Heterogeneous Platforms. Graph Convolutional Networks (GCNs) have emerged as the state of the art deep learning model for representation learning on graphs. It is challenging to accelerate training of GCNs, due to (1) substantial and irregular data communication to propagate information within the graph, and (2) intensive computation to propagate information along the neural network layers. To address these challenges, we design a novel accelerator for training GCNs on CPU FPGA heterogeneous systems, by incorporating multiple algorithm architecture co optimizations. We first analyze the computation and communication characteristics of various GCN training algorithms, and select a subgraph based algorithm that is well suited for hardware execution. To optimize the feature propagation within subgraphs, we propose a lightweight pre processing step based on a graph theoretic approach. Such pre processing performed on the CPU significantly reduces the memory access requirements and the computation to be performed on the FPGA. To accelerate the weight update in GCN layers, we propose a systolic array based design for efficient parallelization. We integrate the above optimizations into a complete hardware pipeline, and analyze its load balance and resource utilization by accurate performance modeling. We evaluate our design on a Xilinx Alveo U200 board hosted by a 40 core Xeon server. On three large graphs, we achieve an order of magnitude training speedup with negligible accuracy loss, compared with state of the art implementation on a multi core platform.


Computational evidence on repurposing the anti influenza drugs baloxavir acid and baloxavir marboxil against COVID 19. The main reasons for the ongoing COVID 19 (coronavirus disease 2019) pandemic are the unavailability of recommended efficacious drugs or vaccines along with the human to human transmission nature of SARS CoV 2 virus. So, there is urgent need to search appropriate therapeutic approach by repurposing approved drugs. In this communication, molecular docking analyses of two influenza antiviral drugs baloxavir acid (BXA) and baloxavir marboxil (BXM) were performed with the three therapeutic target proteins of severe acute respiratory syndrome coronavirus 2 (SARS CoV 2), i.e., main protease (Mpro), papain like protease (PLpro) and RNA dependent RNA polymerase (RdRp). The molecular docking results of both the drugs BXA and BXM were analysed and compared. The investigational drug BXA binds at the active site of Mpro and RdRp, whereas the approved drug BXM binds only at the active site of RdRp. Also, comparison of dock score revealed that BXA is binding more effectively at the active site of RdRp than BXM. The computational molecular docking revealed that the drug BXA may be more effective against COVID 19 as compared to BXM.


Learning Consistency Pursued Correlation Filters for Real Time UAV Tracking. Correlation filter (CF) based methods have demonstrated exceptional performance in visual object tracking for unmanned aerial vehicle (UAV) applications, but suffer from the undesirable boundary effect. To solve this issue, spatially regularized correlation filters (SRDCF) proposes the spatial regularization to penalize filter coefficients, thereby significantly improving the tracking performance. However, the temporal information hidden in the response maps is not considered in SRDCF, which limits the discriminative power and the robustness for accurate tracking. This work proposes a novel approach with dynamic consistency pursued correlation filters, i.e., the CPCF tracker. Specifically, through a correlation operation between adjacent response maps, a practical consistency map is generated to represent the consistency level across frames. By minimizing the difference between the practical and the scheduled ideal consistency map, the consistency level is constrained to maintain temporal smoothness, and rich temporal information contained in response maps is introduced. Besides, a dynamic constraint strategy is proposed to further improve the adaptability of the proposed tracker in complex situations. Comprehensive experiments are conducted on three challenging UAV benchmarks, i.e., UAV123 10FPS, UAVDT, and DTB70. Based on the experimental results, the proposed tracker favorably surpasses the other 25 state of the art trackers with real time running speed ( sim 43FPS) on a single CPU.


Balancing Reinforcement Learning Training Experiences in Interactive Information Retrieval. Interactive Information Retrieval (IIR) and Reinforcement Learning (RL) share many commonalities, including an agent who learns while interacts, a long term and complex goal, and an algorithm that explores and adapts. To successfully apply RL methods to IIR, one challenge is to obtain sufficient relevance labels to train the RL agents, which are infamously known as sample inefficient. However, in a text corpus annotated for a given query, it is not the relevant documents but the irrelevant documents that predominate. This would cause very unbalanced training experiences for the agent and prevent it from learning any policy that is effective. Our paper addresses this issue by using domain randomization to synthesize more relevant documents for the training. Our experimental results on the Text REtrieval Conference (TREC) Dynamic Domain (DD) 2017 Track show that the proposed method is able to boost an RL agent's learning effectiveness by 22 in dealing with unseen situations.


Distribution of neighborhood size in cities. We study the distribution of neighborhoods across a set of 12 global cities and find that the distribution of neighborhood sizes follows exponential decay across all cities under consideration. We are able to analytically show that this exponential distribution of neighbourhood sizes is consistent with the observed Zipf's Law for city sizes. We attempt to explain the emergence of exponential decay in neighbourhood size using a model of neighborhood dynamics where migration into and movement within the city are mediated by wealth. We find that, as observed empirically, the model generates exponential decay in neighborhood size distributions for a range of parameter specifications. The use of a comparative wealth based metric to assess the relative attractiveness of a neighborhood combined with a stringent affordability threshold in mediating movement within the city are found to be necessary conditions for the the emergence of the exponential distribution. While an analytical treatment is difficult due to the globally coupled dynamics, we use a simple two neighbourhood system to illustrate the precise dynamics yielding equilibrium non equal neighborhood size distributions.


Localised codegree conditions for tight Hamilton cycles in 3 uniform hypergraphs. We study sufficient conditions for the existence of Hamilton cycles in uniformly dense 3 uniform hypergraphs. Problems of this type were first considered by Lenz, Mubayi, and Mycroft for loose Hamilton cycles and Aigner Horev and Levy considered it for tight Hamilton cycles for a fairly strong notion of uniformly dense hypergraphs. We focus on tight cycles and obtain optimal results for a weaker notion of uniformly dense hypergraphs. We show that if an n vertex 3 uniform hypergraph H (V,E) has the property that for any set of vertices X and for any collection P of pairs of vertices, the number of hyperedges composed by a pair belonging to P and one vertex from X is at least (1 4 o(1)) X P o( V 3) and H has minimum vertex degree at least Omega( V 2) , then H contains a tight Hamilton cycle. A probabilistic construction shows that the constant 1 4 is optimal in this context.


The NMF problem and lattice subspaces. Suppose that A is a nonnegative n times m real matrix. The NMF problem is the determination of two nonnegative real matrices F , V so that A FV with intermediate dimension p smaller than min n,m . In this article we present a general mathematical method for the determination of two nonnegative real factors F,V of A . During the first steps of this process the intermediate dimension p of F,V is determined, therefore we have an easy criterion for p . This study is based on the theory of lattice subspaces and positive bases. Also we give the matlab program for the computation of F,V but the mathematical part is the main part of this article.


Infinite Time Solutions of Numerical Schemes for Advection Problems. This paper addresses the question whether there are numerical schemes for constant coefficient advection problems that can yield convergent solutions for an infinite time horizon. The motivation is that such methods may serve as building blocks for long time accurate solutions in more complex advection dominated problems. After establishing a new notion of convergence in an infinite time limit of numerical methods, we first show that linear methods cannot meet this convergence criterion. Then we present a new numerical methodology, based on a nonlinear jet scheme framework. We show that these methods do satisfy the new convergence criterion, thus establishing that numerical methods exist that converge on an infinite time horizon, and demonstrate the long time accuracy gains incurred by this property.


Kernel Two Dimensional Ridge Regression for Subspace Clustering. Subspace clustering methods have been widely studied recently. When the inputs are 2 dimensional (2D) data, existing subspace clustering methods usually convert them into vectors, which severely damages inherent structures and relationships from original data. In this paper, we propose a novel subspace clustering method for 2D data. It directly uses 2D data as inputs such that the learning of representations benefits from inherent structures and relationships of the data. It simultaneously seeks image projection and representation coefficients such that they mutually enhance each other and lead to powerful data representations. An efficient algorithm is developed to solve the proposed objective function with provable decreasing and convergence property. Extensive experimental results verify the effectiveness of the new method.


Physics and science the art of taking a stance about undecidable questions. In the past century many fundamental results on unpredictability, undecidability and uncertainty have compelled scientists to grapple with the idea that some questions may never be resolved within our current theories. While this existential crisis may appear to be new, we develop the view that it has a long history and that, in fact, providing closure to undecidable questions is a defining feature of scientific practice and development. We support our claim with historical and contemporary examples and suggest that the crux of many instances of undecidability in science is a form of invalid induction. Finally, we use our thesis to discuss the place of mathematics in the sciences, and to assess whether or not certain perspectives in the philosophy of mind might provide us with closure.


Separable algebras and coflasque resolutions. Over a non closed field, it is a common strategy to use separable algebras as invariants to distinguish algebraic and geometric objects. The most famous example is the deep connection between Severi Brauer varieties and central simple algebras. For more general varieties, one might use endomorphism algebras of line bundles, of indecomposable vector bundles, or of exceptional objects in their derived categories. Using Galois cohomology, we describe a new invariant of reductive algebraic groups that captures precisely when this strategy will fail. Our main result characterizes this invariant in terms of coflasque resolutions of linear algebraic groups introduced by Colliot Th 'el ene. We determine whether or not this invariant is trivial for many fields. For number fields, we show it agrees with the Tate Shafarevich group of the linear algebraic group, up to behavior at real places.


Sums of singular series and primes in short intervals in algebraic number fields. Gross and Smith have put forward generalizations of Hardy Littlewood twin prime conjectures for algebraic number fields. We estimate the behavior of sums of a singular series that arises in these conjectures, up to lower order terms. More exactly, we find asymptotic formulas for smoothed sums of the singular series minus one. Based upon Gross and Smith's conjectures, we use our result to suggest that for large enough 'short intervals' in an algebraic number field K, the variance of counts of prime elements in a random short interval deviates from a Cramer model prediction by a universal factor, independent of K. The conjecture over number fields generalizes a classical conjecture of Goldston and Montgomery over the integers. Numerical data is provided supporting the conjecture.


The structured Gerstenhaber problem (III). Let b be a symmetric bilinear form on a finite dimensional vector space over a field with characteristic 2 . Here, we determine the greatest possible dimension of a linear subspace of nilpotent b symmetric or b alternating endomorphisms of V , expressing it as a function of the dimension, the rank, the Witt index of b , and an additional invariant in a very special case.


Feedback Network for Image Super Resolution. Recent advances in image super resolution (SR) explored the power of deep learning to achieve a better reconstruction performance. However, the feedback mechanism, which commonly exists in human visual system, has not been fully exploited in existing deep learning based image SR methods. In this paper, we propose an image super resolution feedback network (SRFBN) to refine low level representations with high level information. Specifically, we use hidden states in an RNN with constraints to achieve such feedback manner. A feedback block is designed to handle the feedback connections and to generate powerful high level representations. The proposed SRFBN comes with a strong early reconstruction ability and can create the final high resolution image step by step. In addition, we introduce a curriculum learning strategy to make the network well suitable for more complicated tasks, where the low resolution images are corrupted by multiple types of degradation. Extensive experimental results demonstrate the superiority of the proposed SRFBN in comparison with the state of the art methods. Code is avaliable at https github.com Paper99 SRFBN CVPR19.


Weierstrass semigroups on the Skabelund maximal curve. In 2017, D. Skabelund constructed a maximal curve over mathbb F q 4 as a cyclic cover of the Suzuki curve. In this paper we explicitly determine the structure of the Weierstrass semigroup at any point P of the Skabelund curve. We show that its Weierstrass points are precisely the mathbb F q 4 rational points. Also we show that among the Weierstrass points, two types of Weierstrass semigroup occur one for the mathbb F q rational points, one for the remaining mathbb F q 4 rational points. For each of these two types its Ap 'ery set is computed as well as a set of generators.


Interaction and Aggregation Network for Person Re identification. Person re identification (reID) benefits greatly from deep convolutional neural networks (CNNs) which learn robust feature embeddings. However, CNNs are inherently limited in modeling the large variations in person pose and scale due to their fixed geometric structures. In this paper, we propose a novel network structure, Interaction and Aggregation (IA), to enhance the feature representation capability of CNNs. Firstly, Spatial IA (SIA) module is introduced. It models the interdependencies between spatial features and then aggregates the correlated features corresponding to the same body parts. Unlike CNNs which extract features from fixed rectangle regions, SIA can adaptively determine the receptive fields according to the input person pose and scale. Secondly, we introduce Channel IA (CIA) module which selectively aggregates channel features to enhance the feature representation, especially for smallscale visual cues. Further, IA network can be constructed by inserting IA blocks into CNNs at any depth. We validate the effectiveness of our model for person reID by demonstrating its superiority over state of the art methods on three benchmark datasets.


Temporal Attribute Appearance Learning Network for Video based Person Re Identification. Video based person re identification aims to match a specific pedestrian in surveillance videos across different time and locations. Human attributes and appearance are complementary to each other, both of them contribute to pedestrian matching. In this work, we propose a novel Temporal Attribute Appearance Learning Network (TALNet) for video based person re identification. TALNet simultaneously exploits human attributes and appearance to learn comprehensive and effective pedestrian representations from videos. It explores hard visual attention and temporal semantic context for attributes, and spatial temporal dependencies among body parts for appearance, to boost the learning of them. Specifically, an attribute branch network is proposed with a spatial attention block and a temporal semantic context block for learning robust attribute representation. The spatial attention block focuses the network on corresponding regions within video frames related to each attribute, the temporal semantic context block learns both the temporal context for each attribute across video frames and the semantic context among attributes in each video frame. The appearance branch network is designed to learn effective appearance representation from both whole body and body parts with spatial temporal dependencies among them. TALNet leverages the complementation between attribute and appearance representations, and jointly optimizes them by multi task learning fashion. Moreover, we annotate ID level attributes for each pedestrian in the two commonly used video datasets. Extensive experiments on these datasets, have verified the superiority of TALNet over state of the art methods.