Transformation based Adversarial Video Prediction on Large Scale Data. Recent breakthroughs in adversarial generative modeling have led to models capable of producing video samples of high quality, even on large and complex datasets of real world video. In this work, we focus on the task of video prediction, where given a sequence of frames extracted from a video, the goal is to generate a plausible future sequence. We first improve the state of the art by performing a systematic empirical study of discriminator decompositions and proposing an architecture that yields faster convergence and higher performance than previous approaches. We then analyze recurrent units in the generator, and propose a novel recurrent unit which transforms its past hidden state according to predicted motion like features, and refines it to handle dis occlusions, scene changes and other complex behavior. We show that this recurrent unit consistently outperforms previous designs. Our final model leads to a leap in the state of the art performance, obtaining a test set Frechet Video Distance of 25.7, down from 69.2, on the large scale Kinetics 600 dataset.


Diffusion wave phenomena and L p decay estimates of solutions of compressible viscoelastic system. We consider the system of equations describing motion of compressible viscoelastic fluids in a whole space. We investigate the large time behavior of solutions around a motionless state, and obtain the L p decay estimates of solutions for 1 p leq infty , provided that the initial data is sufficiently close to the motionless state. In addition, we clarify the diffusion wave phenomena caused by the sound wave and the elastic shear wave.


Throughput Prediction of Asynchronous SGD in TensorFlow. Modern machine learning frameworks can train neural networks using multiple nodes in parallel, each computing parameter updates with stochastic gradient descent (SGD) and sharing them asynchronously through a central parameter server. Due to communication overhead and bottlenecks, the total throughput of SGD updates in a cluster scales sublinearly, saturating as the number of nodes increases. In this paper, we present a solution to predicting training throughput from profiling traces collected from a single node configuration. Our approach is able to model the interaction of multiple nodes and the scheduling of concurrent transmissions between the parameter server and each node. By accounting for the dependencies between received parts and pending computations, we predict overlaps between computation and communication and generate synthetic execution traces for configurations with multiple nodes. We validate our approach on TensorFlow training jobs for popular image classification neural networks, on AWS and on our in house cluster, using nodes equipped with GPUs or only with CPUs. We also investigate the effects of data transmission policies used in TensorFlow and the accuracy of our approach when combined with optimizations of the transmission schedule.


Computation Against a Neighbour. Recent works in contexts like the Internet of Things (IoT) and large scale Cyber Physical Systems (CPS) propose the idea of programming distributed systems by focussing on their global behaviour across space and time. In this view, a potentially vast and heterogeneous set of devices is considered as an "aggregate" to be programmed as a whole, while abstracting away the details of individual behaviour and exchange of messages, which are expressed declaratively. One such a paradigm, known as aggregate programming, builds on computational models inspired by field based coordination. Existing models such as the field calculus capture interaction with neighbours by a so called "neighbouring field" (a map from neighbours to values). This requires ad hoc mechanisms to smoothly compose with standard values, thus complicating programming and introducing clutter in aggregate programs, libraries and domain specific languages (DSLs). To address this key issue we introduce the novel notion of "computation against a neighbour", whereby the evaluation of certain subexpressions of the aggregate program are affected by recent corresponding evaluations in neighbours. We capture this notion in the neighbours calculus (NC), a new field calculus variant which is shown to smoothly support declarative specification of interaction with neighbours, and correspondingly facilitate the embedding of field computations as internal DSLs in common general purpose programming languages as exemplified by a Scala implementation, called ScaFi. This paper formalises NC, thoroughly compares it with respect to the classic field calculus, and shows its expressiveness by means of a case study in edge computing, developed in ScaFi.


Augmented Understanding and Automated Adaptation of Curation Rules. Over the past years, there has been many efforts to curate and increase the added value of the raw data. Data curation has been defined as activities and processes an analyst undertakes to transform the raw data into contextualized data and knowledge. Data curation enables decision makers and data analyst to extract value and derive insight from the raw data. However, to curate the raw data, an analyst needs to carry out various curation tasks including, extraction linking, classification, and indexing, which are error prone, tedious and challenging. Besides, deriving insight require analysts to spend a long period of time to scan and analyze the curation environments. This problem is exacerbated when the curation environment is large, and the analyst needs to curate a varied and comprehensive list of data. To address these challenges, in this dissertation, we present techniques, algorithms and systems for augmenting analysts in curation tasks. We propose (1) a feature based and automated technique for curating the raw data. (2) We propose an autonomic approach for adapting data curation rules. (3) We provide a solution to augment users in formulating their preferences while curating data in large scale information spaces. (4) We implement a set of APIs for automating the basic curation tasks, including Named Entity extraction, POS tags, classification, and etc.


Evolving Boolean Functions with Conjunctions and Disjunctions via Genetic Programming. Recently it has been proved that simple GP systems can efficiently evolve the conjunction of n variables if they are equipped with the minimal required components. In this paper, we make a considerable step forward by analysing the behaviour and performance of the GP system for evolving a Boolean function with unknown components, i.e., the function may consist of both conjunctions and disjunctions. We rigorously prove that if the target function is the conjunction of n variables, then the RLS GP using the complete truth table to evaluate program quality evolves the exact target function in O( ell n log 2 n) iterations in expectation, where ell geq n is a limit on the size of any accepted tree. When, as in realistic applications, only a polynomial sample of possible inputs is used to evaluate solution quality, we show how RLS GP can evolve a conjunction with any polynomially small generalisation error with probability 1 O( log 2(n) n) . To produce our results we introduce a super multiplicative drift theorem that gives significantly stronger runtime bounds when the expected progress is only slightly super linear in the distance from the optimum.


Human Activity Recognition based on Dynamic Spatio Temporal Relations. Human activity, which usually consists of several actions, generally covers interactions among persons and or objects. In particular, human actions involve certain spatial and temporal relationships, are the components of more complicated activity, and evolve dynamically over time. Therefore, the description of a single human action and the modeling of the evolution of successive human actions are two major issues in human activity recognition. In this paper, we develop a method for human activity recognition that tackles these two issues. In the proposed method, an activity is divided into several successive actions represented by spatio temporal patterns, and the evolution of these actions are captured by a sequential model. A refined comprehensive spatio temporal graph is utilized to represent a single action, which is a qualitative representation of a human action incorporating both the spatial and temporal relations of the participant objects. Next, a discrete hidden Markov model is applied to model the evolution of action sequences. Moreover, a fully automatic partition method is proposed to divide a long term human activity video into several human actions based on variational objects and qualitative spatial relations. Finally, a hierarchical decomposition of the human body is introduced to obtain a discriminative representation for a single action. Experimental results on the Cornell Activity Dataset demonstrate the efficiency and effectiveness of the proposed approach, which will enable long videos of human activity to be better recognized.


Few Shot Event Detection with Prototypical Amortized Conditional Random Field. Event detection tends to struggle when it needs to recognize novel event types with a few samples. The previous work attempts to solve this problem in the identify then classify manner but ignores the trigger discrepancy between event types, thus suffering from the error propagation. In this paper, we present a novel unified model which converts the task to a few shot tagging problem with a double part tagging scheme. To this end, we first propose the Prototypical Amortized Conditional Random Field (PA CRF) to model the label dependency in the few shot scenario, which approximates the transition scores between labels based on the label prototypes. Then Gaussian distribution is introduced for modeling of the transition scores to alleviate the uncertain estimation resulting from insufficient data. Experimental results show that the unified models work better than existing identify then classify models and our PA CRF further achieves the best results on the benchmark dataset FewEvent. Our code and data are available at http github.com congxin95 PA CRF.


Photo Realistic Facial Details Synthesis from Single Image. We present a single image 3D face synthesis technique that can handle challenging facial expressions while recovering fine geometric details. Our technique employs expression analysis for proxy face geometry generation and combines supervised and unsupervised learning for facial detail synthesis. On proxy generation, we conduct emotion prediction to determine a new expression informed proxy. On detail synthesis, we present a Deep Facial Detail Net (DFDN) based on Conditional Generative Adversarial Net (CGAN) that employs both geometry and appearance loss functions. For geometry, we capture 366 high quality 3D scans from 122 different subjects under 3 facial expressions. For appearance, we use additional 20K in the wild face images and apply image based rendering to accommodate lighting variations. Comprehensive experiments demonstrate that our framework can produce high quality 3D faces with realistic details under challenging facial expressions.


MPro Combining Static and Symbolic Analysis for Scalable Testing of Smart Contract. Smart contracts are executable programs that enable the building of a programmable trust mechanism between multiple entities without the need of a trusted third party. Researchers have developed several security scanners in the past couple of years. However, many of these analyzers either do not scale well, or if they do, produce many false positives. This issue is exacerbated when bugs are triggered only after a series of interactions with the functions of the contract under test. A depth n vulnerability, refers to a vulnerability that requires invoking a specific sequence of n functions to trigger. Depth n vulnerabilities are time consuming to detect by existing automated analyzers, because of the combinatorial explosion of sequences of functions that could be executed on smart contracts. In this paper, we present a technique to analyze depth n vulnerabilities in an efficient and scalable way by combining symbolic execution and data dependency analysis. A significant advantage of combining symbolic with static analysis is that it scales much better than symbolic alone and does not have the problem of false positive that static analysis tools typically have. We have implemented our technique in a tool called MPro, a scalable and automated smart contract analyzer based on the existing symbolic analysis tool Mythril Classic and the static analysis tool Slither. We analyzed 100 randomly chosen smart contracts on MPro and our evaluation shows that MPro is about n times faster than Mythril Classic for detecting depth n vulnerabilities, while preserving all the detection capabilities of Mythril Classic.


Simulating an Object Oriented Financial System in a Functional Language. This paper summarises a successful application of functional programming within a commercial environment. We report on experience at Accenture's Financial Services Solution Centre in London with simulating an object oriented financial system in order to assist analysis and design. The work was part of a large IT project for an international investment bank and provides a pragmatic case study.


Whole Body Geometric Retargeting for Humanoid Robots. Humanoid robot teleoperation allows humans to integrate their cognitive capabilities with the apparatus to perform tasks that need high strength, manoeuvrability and dexterity. This paper presents a framework for teleoperation of humanoid robots using a novel approach for motion retargeting through inverse kinematics over the robot model. The proposed method enhances scalability for retargeting, i.e., it allows teleoperating different robots by different human users with minimal changes to the proposed system. Our framework enables an intuitive and natural interaction between the human operator and the humanoid robot at the configuration space level. We validate our approach by demonstrating whole body retargeting with multiple robot models. Furthermore, we present experimental validation through teleoperation experiments using two state of the art whole body controllers for humanoid robots.


Dynamical Combinatorics and Torsion Classes. For finite semidistributive lattices the map kappa gives a bijection between the sets of completely join irreducible elements and completely meet irreducible elements. Here we study the kappa map in the context of torsion classes. It is well known that the lattice of torsion classes for an artin algebra is semidistributive, but in general it is far from finite. We show the kappa map is well defined on the set of completely join irreducible elements, even when the lattice of torsion classes is infinite. We then extend kappa to a map on torsion classes which have canonical join representations given by the special torsion classes associated to the minimal extending modules introduced by the first and third authors and A. Carroll. For hereditary algebras, we show that the extended kappa map on torsion classes is essentially the same as Ringel's epsilon map on wide subcategories. Also in hereditary case, we relate the square of kappa to the Auslander Reiten translation.


Development of a coupling between a system thermal hydraulic code and a reduced order CFD model. The nuclear community has coupled several three dimensional Computational Fluid Dynamics (CFD) solvers with one dimensional system thermal hydraulic (STH) codes. This work proposes to replace the CFD solver by a reduced order model (ROM) to reduce the computational cost. The system code RELAP5 MOD3.3 and a ROM of the finite volume CFD solver OpenFOAM are coupled by a partitioned domain decomposition coupling algorithm using an implicit coupling scheme. The velocity transported over a coupling boundary interface is imposed in the ROM using a penalty method. The coupled models are evaluated on open and closed pipe flow configurations. The results of the coupled simulations with the ROM are close to those with the CFD solver. Also for new parameter sets, the coupled RELAP5 ROM models are capable of predicting the coupled RELAP5 CFD results with good accuracy. Finally, coupling with the ROM is 3 5 times faster than coupling with the CFD solver.


Towards the Next Generation of Retinal Neuroprosthesis Visual Computation with Spikes. Neuroprosthesis, as one type of precision medicine device, is aiming for manipulating neuronal signals of the brain in a closed loop fashion, together with receiving stimulus from the environment and controlling some part of our brain body. In terms of vision, incoming information can be processed by the brain in millisecond interval. The retina computes visual scenes and then sends its output as neuronal spikes to the cortex for further computation. Therefore, the neuronal signal of interest for retinal neuroprosthesis is spike. Closed loop computation in neuroprosthesis includes two stages encoding stimulus to neuronal signal, and decoding it into stimulus. Here we review some of the recent progress about visual computation models that use spikes for analyzing natural scenes, including static images and dynamic movies. We hypothesize that for a better understanding of computational principles in the retina, one needs a hypercircuit view of the retina, in which different functional network motifs revealed in the cortex neuronal network should be taken into consideration for the retina. Different building blocks of the retina, including a diversity of cell types and synaptic connections, either chemical synapses or electrical synapses (gap junctions), make the retina an ideal neuronal network to adapt the computational techniques developed in artificial intelligence for modeling of encoding decoding visual scenes. Altogether, one needs a systems approach of visual computation with spikes to advance the next generation of retinal neuroprosthesis as an artificial visual system.


The size Ramsey number of short subdivisions. The r size Ramsey number hat R r(H) of a graph H is the smallest number of edges a graph G can have, such that for every edge coloring of G with r colors there exists a monochromatic copy of H in G . For a graph H , we denote by H q the graph obtained from H by subdividing its edges with q 1 vertices each. In a recent paper of Kohayakawa, Retter and R "o dl, it is shown that for all constant integers q,r geq 2 and every graph H on n vertices and of bounded maximum degree, the r size Ramsey number of H q is at most ( log n) 20(q 1) n 1 1 q , for n large enough. We improve upon this result using a significantly shorter argument by showing that hat R r(H q) leq O(n 1 1 q ) for any such graph H .


An Asymptotic Analysis on Generalized Secretary Problem. As a famous result, the 37 Law'' for Secretary Problem has widely influenced peoples' perception on online decision strategies about choice. However, using this strategy, too many attractive candidates may be rejected in the first 37 , and in practice people also tend to stop earlier cite Bearden early . In this paper, we argued that in most cases, the best only optimization does not obtain an optimal outcome, while the optimal cutoff should be O( sqrt n ) . And we also showed that in some strict objective that only cares several best candidates, Theta(n) skips are still needed.


Ponderomotive Instability of RF Cavities with Vector Sum Control, and Cure By Difference Control. The radiation pressure inside an RF cavity resonator, resulting from the Lorentz force, couples the fundamental electromagnetic mode to the mechanical modes and may lead to static and dynamic ponderomotive instability. The analysis for generator driven (GD) cavity and for self excited (SEL) cavity was given by Schulze in 1971 and by Delayen in 1978, respectively. Since that time, little or no new analytical work until now. Here are presented results from the analysis for multiple (N) cavities (GD or SE) powered from a single source and regulated in vector sum. The system behaves as N virtual cavities, one with all loops present and N 1 with no loops except the tuner. After reviewing stability threshold criteria for these systems, difference control in the tuning loops is proposed as means for extending the stability range. Counter tuning of alternating cavities is also discussed.


Sensitivity analysis for the stationary distribution of reflected Brownian motion in a convex polyhedral cone. Reflected Brownian motion (RBM) in a convex polyhedral cone arises in a variety of applications ranging from the theory of stochastic networks to math finance, and under general stability conditions, it has a unique stationary distribution. In such applications, to implement a stochastic optimization algorithm or quantify robustness of a model, it is useful to characterize the dependence of stationary performance measures on model parameters. In this work we characterize parametric sensitivities of the stationary distribution of an RBM in a simple convex polyhedral cone that is, sensitivities to perturbations of the parameters that define the RBM namely, the covariance matrix, drift vector and directions of reflection along the boundary of the polyhedral cone. In order to characterize these sensitivities we study the long time behavior of the joint process consisting of an RBM along with its so called derivative process, which characterizes pathwise derivatives of RBMs on finite time intervals. We show that the joint process is positive recurrent, has a unique stationary distribution, and parametric sensitivities of the stationary distribution of an RBM can be expressed in terms of the stationary distribution of the joint process. This can be thought of as establishing an interchange of the differential operator and the limit in time. The analysis of ergodicity of the joint process is significantly more complicated than that of the RBM due to its degeneracy and the fact that the derivative process exhibits jumps that are modulated by the RBM. The proofs of our results rely on path properties of coupled RBMs and contraction properties related to the geometry of the polyhedral cone and directions of reflection along the boundary. Our results are potentially useful for developing efficient numerical algorithms for computing sensitivities of functionals of stationary RBMs.


Surface area measures of log concave functions. This paper's origins are in two papers One by Colesanti and Fragal a studying the surface area measure of a log concave function, and one by Cordero Erausquin and Klartag regarding the moment measure of a convex function. These notions are the same, and in this paper we continue studying the same construction as well as its generalization. In the first half the paper we prove a first variation formula for the integral of log concave functions under minimal and optimal conditions. We also explain why this result is a common generalization of two known theorems from the above papers. In the second half we extend the definition of the functional surface area measure to the L p setting, generalizing a classic definition of Lutwak. In this generalized setting we prove a functional Minkowski existence theorem for even measures. This is a partial extension of a theorem of Cordero Erausquin and Klartag that handled the case p 1 for not necessarily even measures.


A Hybrid Volume Surface Wire Integral Equation for the Anisotropic Forward Problem in Electroencephalography. Solving the electroencephalography (EEG) forward problem is a fundamental step in a wide range of applications including biomedical imaging techniques based on inverse source localization. State of the art electromagnetic solvers resort to a computationally expensive volumetric discretization of the full head to account for its complex and heterogeneous electric profile. The more efficient, popular in biomedical imaging circles, but unfortunately oversimplifying Boundary Element Method (BEM) relies instead on a piecewise uniform approximation that severely curbs its application in high resolution EEGs. This contribution lifts the standard BEM contraints by treating the local anisotropies with adequate wire and thin volume integral equations that are tailored to specific structures of the fibrous white matter and the inhomogeneous skull. The proposed hybrid integral equation formulation thereby avoids the full volumetric discretization of the head medium and allows for a realistic and efficient BEM like solution of the anisotropic EEG forward problem. The accuracy and flexibility of the proposed formulation is demonstrated through numerical experiments involving both canonical and realistic MRI based head models.


Inverse source in two parameter anomalous diffusion, numerical algorithms and simulations over graded time meshes. We consider an inverse source two parameter sub diffusion model subject to a nonlocal initial condition. The problem models several physical processes, among them are the microwave heating and light propagation in photoelectric cells. A bi orthogonal pair of bases is employed to construct a series representation of the solution and a Volterra integral equation for the source term. We develop a numerical algorithm for approximating the unknown time dependent source term. Due to the singularity of the solution near t 0 , a graded mesh is used to improve the convergence rate. Numerical experiments are provided to illustrate the expected analytical order of convergence.


Ray Effect Mitigation for the Discrete Ordinates Method Using Artificial Scattering. Solving the radiative transfer equation with the discrete ordinates (S N ) method leads to a non physical imprint of the chosen quadrature set on the solution. To mitigate these so called ray effects, we propose a modification of the S N method, which we call artificial scattering S N (as S N ). The method adds an artificial forward peaked scattering operator which generates angular diffusion to the solution and thereby mitigates ray effects. Similar to artificial viscosity for spatial discretizations, the additional term vanishes as the number of ordinates approaches infinity. Our method allows an efficient implementation of explicit and implicit time integration according to standard S N solver technology. For two test cases, we demonstrate a significant reduction of the error for the as S N method when compared to the standard S N method, both for explicit and implicit computations. Furthermore, we show that a prescribed numerical precision can be reached with less memory due to the reduction in the number of ordinates.


McKay quivers and Lusztig algebras of some finite groups. We are interested in the McKay quiver Gamma(G) and skew group rings A G , where G is a finite subgroup of mathrm GL (V) , where V is a finite dimensional vector space over a field K , and A is a K G algebra. These skew group rings appear in Auslander's version of the McKay correspondence. In the first part of this paper we consider complex reflection groups G subseteq mathrm GL (V) and find a combinatorial method, making use of Young diagrams, to construct the McKay quivers for the groups G(r,p,n) . We first look at the case G(1,1,n) , which is isomorphic to the symmetric group S n , followed by G(r,1,n) for r 1 . Then, using Clifford theory, we can determine the McKay quiver for any G(r,p,n) and thus for all finite irreducible complex reflection groups up to finitely many exceptions. In the second part of the paper we consider a more conceptual approach to McKay quivers of arbitrary finite groups we define the Lusztig algebra widetilde A(G) of a finite group G subseteq mathrm GL (V) , which is Morita equivalent to the skew group ring A G . This description gives us an embedding of the basic algebra Morita equivalent to A G into a matrix algebra over A .


Electromagnetic Energy Balance Equations and Poynting Theorem. Poynting theorem plays a very important role in analyzing electromagnetic phenomena. The electromagnetic power flux density is usually expressed with the Poynting vector. However, since Poynting theorem basically focuses on the power balance in a system, it is not so efficient in some situations to use it for evaluating the electromagnetic energies. The energy balance issue for time varying fields is revisited in this paper. Energy balance equations are introduced and a modified method for evaluating power flux is proposed.


HEDGE Efficient Traffic Classification of Encrypted and Compressed Packets. As the size and source of network traffic increase, so does the challenge of monitoring and analysing network traffic. Therefore, sampling algorithms are often used to alleviate these scalability issues. However, the use of high entropy data streams, through the use of either encryption or compression, further compounds the challenge as current state of the art algorithms cannot accurately and efficiently differentiate between encrypted and compressed packets. In this work, we propose a novel traffic classification method named HEDGE (High Entropy DistinGuishEr) to distinguish between compressed and encrypted traffic. HEDGE is based on the evaluation of the randomness of the data streams and can be applied to individual packets without the need to have access to the entire stream. Findings from the evaluation show that our approach outperforms current state of the art. We also make available our statistically sound dataset, based on known benchmarks, to the wider research community.


Actions of 'etale covered groupoids. By restricting to a class of localic open groupoids G which, similarly to Lie groupoids, possess appropriate covers widehat G to G by 'etale groupoids, we extend results about groupoid actions and quantales that were previously proved for 'etale groupoids but do not seem to work for arbitrary open groupoids. In particular we obtain a characterization of the category of G actions as a category of quantale modules on mathcal O( widehat G) that satisfy a condition related to the quantale mathcal O(G) . This leads to a simple description of G sheaves and the classifying topos of G in terms of Hilbert mathcal O( widehat G) modules. The bicategory whose 1 cells are the groupoid bi actions is bi equivalent to a corresponding bicategory of quantales and bimodules.


Fully Parallel Mesh I O using PETSc DMPlex with an Application to Waveform Modeling. Large scale PDE simulations using high order finite element methods on unstructured meshes are an indispensable tool in science and engineering. The widely used open source PETSc library offers an efficient representation of generic unstructured meshes within its DMPlex module. This paper details our recent implementation of parallel mesh reading and topological interpolation (computation of edges and faces from a cell vertex mesh) into DMPlex. We apply these developments to seismic wave propagation scenarios on Mars as an example application. The principal motivation is to overcome single node memory limits and reach mesh sizes which were impossible before. Moreover, we demonstrate that scalability of I O and topological interpolation goes beyond 12'000 cores, and memory imposed limits on mesh size vanish.


Action Recognition from Single Timestamp Supervision in Untrimmed Videos. Recognising actions in videos relies on labelled supervision during training, typically the start and end times of each action instance. This supervision is not only subjective, but also expensive to acquire. Weak video level supervision has been successfully exploited for recognition in untrimmed videos, however it is challenged when the number of different actions in training videos increases. We propose a method that is supervised by single timestamps located around each action instance, in untrimmed videos. We replace expensive action bounds with sampling distributions initialised from these timestamps. We then use the classifier's response to iteratively update the sampling distributions. We demonstrate that these distributions converge to the location and extent of discriminative action segments. We evaluate our method on three datasets for fine grained recognition, with increasing number of different actions per video, and show that single timestamps offer a reasonable compromise between recognition performance and labelling effort, performing comparably to full temporal supervision. Our update method improves top 1 test accuracy by up to 5.4 . across the evaluated datasets.


Towards Deep Machine Reasoning a Prototype based Deep Neural Network with Decision Tree Inference. In this paper we introduce the DMR a prototype based method and network architecture for deep learning which is using a decision tree (DT) based inference and synthetic data to balance the classes. It builds upon the recently introduced xDNN method addressing more complex multi class problems, specifically when classes are highly imbalanced. DMR moves away from a direct decision based on all classes towards a layered DT of pair wise class comparisons. In addition, it forces the prototypes to be balanced between classes regardless of possible class imbalances of the training data. It has two novel mechanisms, namely i) using a DT to determine the winning class label, and ii) balancing the classes by synthesizing data around the prototypes determined from the available training data. As a result, we improved significantly the performance of the resulting fully explainable DNN as evidenced by the best reported result on the well know benchmark problem Caltech 101 surpassing our own recently published "world record". Furthermore, we also achieved another "world record" for another very hard benchmark problem, namely Caltech 256 as well as surpassed the results of other approaches on Faces 1999 problem. In summary, we propose a new approach specifically advantageous for imbalanced multi class problems that achieved two world records on well known hard benchmark problems and the best result on another problem in terms of accuracy. Moreover, DMR offers full explainability, does not require GPUs and can continue to learn from new data by adding new prototypes preserving the previous ones but not requiring full retraining.


Equivalence of the categories of group triples and of hypergroups over the group. The main result of this paper is that the categories of (right) hypergroups over the group and of triples, consisting of a group, its subgroup and a (right) transversal to this subgroup, are equivalent.


Unique Factorization in Polynomial Rings with Zero Divisors. Given a certain factorization property of a ring R , we can ask if this property extends to the polynomial ring over R or vice versa. For example, it is well known that R is a unique factorization domain if and only if R X is a unique factorization domain. If R is not a domain, this is no longer true. In this paper we survey unique factorization in commutative rings with zero divisors, and characterize when a polynomial ring over an arbitrary commutative ring has unique factorization.


Efficient nuclear norm approximation via the randomized UTV algorithm. The recently introduced algorithm randUTV provides a highly efficient technique for computing accurate approximations to all the singular values of a given matrix A . The original version of randUTV was designed to compute a full factorization of the matrix in the form A UTV where U and V are orthogonal matrices, and T is upper triangular. The estimates to the singular values of A appear along the diagonal of T . This manuscript describes how the randUTV algorithm can be modified when the only quantity of interest being sought is the vector of approximate singular values. The resulting method is particularly effective for computing the nuclear norm of A , or more generally, other Schatten p norms. The report also describes how to compute an estimate of the errors incurred, at essentially negligible cost.


Recent Advances in Scalable Network Generation. Random graph models are frequently used as a controllable and versatile data source for experimental campaigns in various research fields. Generating such data sets at scale is a non trivial task as it requires design decisions typically spanning multiple areas of expertise. Challenges begin with the identification of relevant domain specific network features, continue with the question of how to compile such features into a tractable model, and culminate in algorithmic details arising while implementing the pertaining model. In the present survey, we explore crucial aspects of random graph models with known scalable generators. We begin by briefly introducing network features considered by such models, and then discuss random graphs alongside with generation algorithms. Our focus lies on modelling techniques and algorithmic primitives that have proven successful in obtaining massive graphs. We consider concepts and graph models for various domains (such as social network, infrastructure, ecology, and numerical simulations), and discuss generators for different models of computation (including shared memory parallelism, massive parallel GPUs, and distributed systems).


Recovering Gardner Restacking with Purely Diffusive Operations. The maximum particle kinetic energy that can be extracted from an initial six dimensional phase space distribution motivates the concept of free or available energy. The free energy depends on the allowed operations that can be performed. A key concept underlying the theoretical treatment of plasmas is the Gardner free energy, where the exchange of the contents of equal phase volumes is allowed. A second free energy concept is the diffusive free energy, in which the contents of volumes are instead averaged. For any finite discretization of phase space, the diffusive free energy is known to be less than the Gardner free energy. However, despite the apparent fundamental differences between these free energies, it is demonstrated here that the Gardner free energy may be recovered from the continuous limit of the diffusive free energy, leading to the surprise that macroscopic phase space conservation can be achieved by ostensibly entropy producing microscopic operations.


Explaining Local, Global, And Higher Order Interactions In Deep Learning. We present a simple yet highly generalizable method for explaining interacting parts within a neural network's reasoning process. First, we design an algorithm based on cross derivatives for computing statistical interaction effects between individual features, which is generalized to both 2 way and higher order (3 way or more) interactions. We present results side by side with a weight based attribution technique, corroborating that cross derivatives are a superior metric for both 2 way and higher order interaction detection. Moreover, we extend the use of cross derivatives as an explanatory device in neural networks to the computer vision setting by expanding Grad CAM, a popular gradient based explanatory tool for CNNs, to the higher order. While Grad CAM can only explain the importance of individual objects in images, our method, which we call Taylor CAM, can explain a neural network's relational reasoning across multiple objects. We show the success of our explanations both qualitatively and quantitatively, including with a user study. We will release all code as a tool package to facilitate explainable deep learning.


Identifying Distributional Perspective Differences from Colingual Groups. Perspective differences exist among different cultures or languages. A lack of mutual understanding among different groups about their perspectives on specific values or events may lead to uninformed decisions or biased opinions. Automatically understanding the group perspectives can provide essential background for many downstream applications of natural language processing techniques. In this paper, we study colingual groups and use language corpora as a proxy to identify their distributional perspectives. We present a novel computational approach to learn shared understandings, and benchmark our method by building culturally aware models for the English, Chinese, and Japanese languages. On a held out set of diverse topics including marriage, corruption, democracy, our model achieves high correlation with human judgements regarding intra group values and inter group differences.


Image Captioning with Attention for Smart Local Tourism using EfficientNet. Smart systems have been massively developed to help humans in various tasks. Deep Learning technologies push even further in creating accurate assistant systems due to the explosion of data lakes. One of the smart system tasks is to disseminate users needed information. This is crucial in the tourism sector to promote local tourism destinations. In this research, we design a model of local tourism specific image captioning, which later will support the development of AI powered systems that assist various users. The model is developed using a visual Attention mechanism and uses the state of the art feature extractor architecture EfficientNet. A local tourism dataset is collected and is used in the research, along with two different kinds of captions. Captions that describe the image literally and captions that represent human logical responses when seeing the image. This is done to make the captioning model more humane when implemented in the assistance system. We compared the performance of two different models using EfficientNet architectures (B0 and B4) with other well known VGG16 and InceptionV3. The best BLEU scores we get are 73.39 and 24.51 for the training set and the validation set respectively, using EfficientNetB0. The captioning result using the developed model shows that the model can produce logical caption for local tourism related images


Nonregularity via Ordinal Extensions. We present a simple new method for proving that languages are not regular. We prove the correctness of the method, illustrate the ease of using the method on well known examples of nonregular languages, and prove two additional theorems on the power and limitations of the method.


Social Distancing and the Internet What Can Network Performance Measurements Tell Us?. The COVID 19 pandemic and related restrictions forced many to work, learn, and socialize from home over the internet. There appears to be consensus that internet infrastructure in the developed world handled the resulting traffic surge well. In this paper, we study network measurement data collected by the Federal Communications Commission's Measuring Broadband America program before and during the pandemic in the United States (US). We analyze the data to understand the impact of lockdown orders on the performance of fixed broadband internet infrastructure across the US, and also attempt to correlate internet usage patterns with the changing behavior of users during lockdown. We found the key metrics such as change in data usage to be generally consistent with the literature. Through additional analysis, we found differences between metro and rural areas, changes in weekday, weekend, and hourly internet usage patterns, and indications of network congestion for some users.


On flips in planar matchings. In this paper we investigate the structure of flip graphs on non crossing perfect matchings in the plane. Specifically, consider all non crossing straight line perfect matchings on a set of 2n points that are placed equidistantly on the unit circle. A flip operation on such a matching replaces two matching edges that span an empty quadrilateral with the other two edges of the quadrilateral, and the flip is called centered if the quadrilateral contains the center of the unit circle. The graph mathcal G n has those matchings as vertices, and an edge between any two matchings that differ in a flip, and it is known to have many interesting properties. In this paper we focus on the spanning subgraph mathcal H n of mathcal G n obtained by taking all edges that correspond to centered flips, omitting edges that correspond to non centered flips. We show that the graph mathcal H n is connected for odd n , but has exponentially many small connected components for even n , which we characterize and count via Catalan and generalized Narayana numbers. For odd n , we also prove that the diameter of mathcal H n is linear in n . Furthermore, we determine the minimum and maximum degree of mathcal H n for all n , and characterize and count the corresponding vertices. Our results imply the non existence of certain rainbow cycles in mathcal G n , and they resolve several open questions and conjectures raised in a recent paper by Felsner, Kleist, M "utze, and Sering.


A Time Leap Challenge for SAT Solving. We compare the impact of hardware advancement and algorithm advancement for SAT solving over the last two decades. In particular, we compare 20 year old SAT solvers on new computer hardware with modern SAT solvers on 20 year old hardware. Our findings show that the progress on the algorithmic side has at least as much impact as the progress on the hardware side.


Enhanced POET Open Ended Reinforcement Learning through Unbounded Invention of Learning Challenges and their Solutions. Creating open ended algorithms, which generate their own never ending stream of novel and appropriately challenging learning opportunities, could help to automate and accelerate progress in machine learning. A recent step in this direction is the Paired Open Ended Trailblazer (POET), an algorithm that generates and solves its own challenges, and allows solutions to goal switch between challenges to avoid local optima. However, the original POET was unable to demonstrate its full creative potential because of limitations of the algorithm itself and because of external issues including a limited problem space and lack of a universal progress measure. Importantly, both limitations pose impediments not only for POET, but for the pursuit of open endedness in general. Here we introduce and empirically validate two new innovations to the original algorithm, as well as two external innovations designed to help elucidate its full potential. Together, these four advances enable the most open ended algorithmic demonstration to date. The algorithmic innovations are (1) a domain general measure of how meaningfully novel new challenges are, enabling the system to potentially create and solve interesting challenges endlessly, and (2) an efficient heuristic for determining when agents should goal switch from one problem to another (helping open ended search better scale). Outside the algorithm itself, to enable a more definitive demonstration of open endedness, we introduce (3) a novel, more flexible way to encode environmental challenges, and (4) a generic measure of the extent to which a system continues to exhibit open ended innovation. Enhanced POET produces a diverse range of sophisticated behaviors that solve a wide range of environmental challenges, many of which cannot be solved through other means.


Impact of independence on polarization of opinions. Polarization of societies is getting more and more attention from researchers working at the intersection of many fields, because it seems to be a defining feature of many public domains. In this paper, we are going to investigate how the unwillingness to yield to the group pressure, also known as independence, influences this phenomenon. In particular, we would like to answer the question whether independent choices of people could alter the dynamics of a system that otherwise would become polarized. A modified version of the q voter model will be used for that purpose. From our findings it follows that the impact of independence is at least two fold. At low independence levels the consensus polarization transition between two antagonistic groups sets in quicker than in the absence of independence. Higher levels induce additional transition in the system, from a polarized state to a disordered one.


LR CNN Local aware Region CNN for Vehicle Detection in Aerial Imagery. State of the art object detection approaches such as Fast Faster R CNN, SSD, or YOLO have difficulties detecting dense, small targets with arbitrary orientation in large aerial images. The main reason is that using interpolation to align RoI features can result in a lack of accuracy or even loss of location information. We present the Local aware Region Convolutional Neural Network (LR CNN), a novel two stage approach for vehicle detection in aerial imagery. We enhance translation invariance to detect dense vehicles and address the boundary quantization issue amongst dense vehicles by aggregating the high precision RoIs' features. Moreover, we resample high level semantic pooled features, making them regain location information from the features of a shallower convolutional block. This strengthens the local feature invariance for the resampled features and enables detecting vehicles in an arbitrary orientation. The local feature invariance enhances the learning ability of the focal loss function, and the focal loss further helps to focus on the hard examples. Taken together, our method better addresses the challenges of aerial imagery. We evaluate our approach on several challenging datasets (VEDAI, DOTA), demonstrating a significant improvement over state of the art methods. We demonstrate the good generalization ability of our approach on the DLR 3K dataset.


Algebraic Montgomery Yang problem and cascade conjecture. The conjecture called algebraic Montgomery Yang problem is still open for rational mathbb Q homology projective planes with cyclic quotient singularities having ample canonical divisor. All known such surfaces have a special birational behavior called a cascade. In this note, we establish algebraic Montgomery Yang problem assuming the cascade conjecture, which claims that every rational mathbb Q homology projective planes with quotient singularities having ample canonical divisor admits a cascade.


Functional MRI applications for psychiatric disease subtyping a review. Psychiatric disorders have historically been classified using symptom information alone. With the advent of new technologies that allowed researchers to investigate brain mechanisms more directly, interest in the mechanistic rationale behind defined pathologies and aetiology redefinition has greatly increased. This is particularly appealing for the field of personalised medicine, which searches for data driven approaches to improve individual diagnosis, prognosis and treatment selection. Here we intend to systematically analyse the usage of functional MRI on both the elucidation of psychiatric disease biotypes and the interpretation of subtypes obtained via unsupervised learning applied to symptom or biomarker data. We searched the existing literature for functional MRI applications to the obtention or interpretation of psychiatric disease subtypes. The PRISMA guidelines were applied to filter the retrieved studies, and the active learning framework ASReviews was applied for article prioritization. From the 20 studies that met the inclusion criteria, 5 used functional MRI data to interpret symptom derived disease clusters, 4 used it for the interpretation of clusters derived from biomarker data other than fMRI itself, and 11 applied clustering to fMRI directly. Major depression disorder and schizophrenia were the two most studied pathologies, followed by ADHD, psychosis, autism disorder, and early violence. No trans diagnostic studies were retrieved. While interest in personalised medicine and data driven disease subtyping is on the rise and psychiatry is not the exception, unsupervised analyses of functional MRI data are inconsistent to date, and much remains to be done in terms of gathering and centralising data, standardising pipelines and model validation, and method refinement. The usage of fMRI in the field of trans diagnostic psychiatry remains vastly unexplored.


On the tractability of the maximum clique problem. The maximum clique problem is a classical NP complete problem in graph theory and has important applications in many domains. In this paper we show, in a partially non constructive way, the existence of an exact polynomial time algorithm for this problem. We outline the algorithm in pseudo code style. Then we prove its exactness and efficiency by analysis.


The rates of growth in a hyperbolic group. We study the countable set of rates of growth of a hyperbolic group with respect to all its finite generating sets. We prove that the set is well ordered, and that every real number can be the rate of growth of at most finitely many generating sets up to automorphism of the group. We prove that the ordinal of the set of rates of growth is at least omega omega , and in case the group is a limit group (e.g., free and surface groups), it is omega omega . We further study the rates of growth of all the finitely generated subgroups of a hyperbolic group with respect to all their finite generating sets. This set is proved to be well ordered as well, and every real number can be the rate of growth of at most finitely many isomorphism classes of finite generating sets of subgroups of a given hyperbolic group. Finally, we strengthen our results to include rates of growth of all the finite generating sets of all the subsemigroups of a hyperbolic group.


Keep Your AI es on the Road Tackling Distracted Driver Detection with Convolutional Neural Networks and Targeted Data Augmentation. According to the World Health Organization, distracted driving is one of the leading cause of motor accidents and deaths in the world. In our study, we tackle the problem of distracted driving by aiming to build a robust multi class classifier to detect and identify different forms of driver inattention using the State Farm Distracted Driving Dataset. We utilize combinations of pretrained image classification models, classical data augmentation, OpenCV based image preprocessing and skin segmentation augmentation approaches. Our best performing model combines several augmentation techniques, including skin segmentation, facial blurring, and classical augmentation techniques. This model achieves an approximately 15 increase in F1 score over the baseline, thus showing the promise in these techniques in enhancing the power of neural networks for the task of distracted driver detection.


Bilirubin lowering effect and safety of a prototype low cost blue light emitting diode (LED) phototherapy device in the treatment of indirect hyperbilirubinemia among healthy term infants in a tertiary government hospital a pilot study. Objective This pilot study was done to evaluate the capability of a prototype low cost blue light emitting diode (LED) phototherapy device in lowering bilirubin levels among healthy term infants diagnosed with indirect hyperbilirubinemia. Methods Experimental study on term infants diagnosed with indirect hyperbilirubinemia in Ospital ng Makati from May 2016 to November 2016 who underwent phototherapy using the low cost blue LED phototherapy prototype. Results After 24 hours of phototherapy under the prototype LED phototherapy unit, 16 of the total patients completed treatment as they were already classified in the low risk zone, and another 36 of patients completed treatment after 48 hours. The total bilirubin significantly decreased from baseline bilirubin levels after 24 hours by 16.5 (p 0.0001). The mean percentage of change of bilirubin reduced after 48 hours of 29.9 was also significant. The proportion of subjects in the high risk zone during baseline to 24th hour went down significantly from 80 to 28 (p 0.0003), while comparing baseline to 48th hour, the percentage of high risk zone went down from 80 to 9.5 (p 0.0001). No subjects were reported to have rebound hyperbilirubinemia after discontinuation of phototherapy treatment under the LED prototype. No patient experienced any complication while on phototherapy treatment. Conclusion The prototype low cost blue light emitting diode (LED) phototherapy was able to lower total serum bilirubin among healthy term infants with indirect hyperbilirubinemia and was safe to use.


Atomic Layer Deposition Niobium Nitride Films for High Q Resonators. Niobium nitride (NbN) is a useful material for fabricating detectors because of its high critical temperature and relatively high kinetic inductance. In particular, NbN can be used to fabricate nanowire detectors and mm wave transmission lines. When deposited, NbN is usually sputtered, leaving room for concern about uniformity at small thicknesses. We present atomic layer deposition niobium nitride (ALD NbN) as an alternative technique that allows for precision control of deposition parameters such as film thickness, stage temperature, and nitrogen flow. Atomic scale control over film thickness admits wafer scale uniformity for films 4 30 nm thick control over deposition temperature gives rise to growth rate changes, which can be used to optimize film thickness and critical temperature. In order to characterize ALD NbN in the radio frequency regime, we construct single layer microwave resonators and test their performance as a function of stage temperature and input power. ALD processes can admit high resonator quality factors, which in turn increase detector multiplexing capabilities. We present measurements of the critical temperature and internal quality factor of ALD NbN resonators under the variation of ALD parameters.


ParsiNLU A Suite of Language Understanding Challenges for Persian. Despite the progress made in recent years in addressing natural language understanding (NLU) challenges, the majority of this progress remains to be concentrated on resource rich languages like English. This work focuses on Persian language, one of the widely spoken languages in the world, and yet there are few NLU datasets available for this rich language. The availability of high quality evaluation datasets is a necessity for reliable assessment of the progress on different NLU tasks and domains. We introduce ParsiNLU, the first benchmark in Persian language that includes a range of high level tasks Reading Comprehension, Textual Entailment, etc. These datasets are collected in a multitude of ways, often involving manual annotations by native speakers. This results in over 14.5 k new instances across 6 distinct NLU tasks. Besides, we present the first results on state of the art monolingual and multi lingual pre trained language models on this benchmark and compare them with human performance, which provides valuable insights into our ability to tackle natural language understanding challenges in Persian. We hope ParsiNLU fosters further research and advances in Persian language understanding.


Conditions of exact null controllability and the problem of complete stabilizability for time delay systems. For a class of linear time delay control systems satisfying the property of completability of the generalized eigenvectors we prove that the problems of complete stabilizability and exact null controllability are equivalent.


SAFFIRE System for Autonomous Feature Filtering and Intelligent ROI Estimation. This work introduces a new framework, named SAFFIRE, to automatically extract a dominant recurrent image pattern from a set of image samples. Such a pattern shall be used to eliminate pose variations between samples, which is a common requirement in many computer vision and machine learning tasks. The framework is specialized here in the context of a machine vision system for automated product inspection. Here, it is customary to ask the user for the identification of an anchor pattern, to be used by the automated system to normalize data before further processing. Yet, this is a very sensitive operation which is intrinsically subjective and requires high expertise. Hereto, SAFFIRE provides a unique and disruptive framework for unsupervised identification of an optimal anchor pattern in a way which is fully transparent to the user. SAFFIRE is thoroughly validated on several realistic case studies for a machine vision inspection pipeline.


Rain O'er Me Synthesizing real rain to derain with data distillation. We present a supervised technique for learning to remove rain from images without using synthetic rain software. The method is based on a two stage data distillation approach 1) A rainy image is first paired with a coarsely derained version using on a simple filtering technique ("rain to clean"). 2) Then a clean image is randomly matched with the rainy soft labeled pair. Through a shared deep neural network, the rain that is removed from the first image is then added to the clean image to generate a second pair ("clean to rain"). The neural network simultaneously learns to map both images such that high resolution structure in the clean images can inform the deraining of the rainy images. Demonstrations show that this approach can address those visual characteristics of rain not easily synthesized by software in the usual way.


Bidirectional One Shot Unsupervised Domain Mapping. We study the problem of mapping between a domain A , in which there is a single training sample and a domain B , for which we have a richer training set. The method we present is able to perform this mapping in both directions. For example, we can transfer all MNIST images to the visual domain captured by a single SVHN image and transform the SVHN image to the domain of the MNIST images. Our method is based on employing one encoder and one decoder for each domain, without utilizing weight sharing. The autoencoder of the single sample domain is trained to match both this sample and the latent space of domain B . Our results demonstrate convincing mapping between domains, where either the source or the target domain are defined by a single sample, far surpassing existing solutions. Our code is made publicly available at https github.com tomercohen11 BiOST


Opers of higher types, Quot schemes and Frobenius instability loci. In this paper we continue our study of the Frobenius instability locus in the coarse moduli space of semi stable vector bundles of rank r and degree 0 over a smooth projective curve defined over an algebraically closed field of characteristic p 0 . In a previous paper we identified the "maximal" Frobenius instability strata with opers (more precisely as opers of type 1 in the terminology of the present paper) and related them to certain Quot schemes of Frobenius direct images of line bundles. The main aim of this paper is to describe for any integer q geq 1 a conjectural generalization of this correspondence between opers of type q (which we introduce here) and Quot schemes of Frobenius direct images of vector bundles of rank q . We also give a conjectural formula for the dimension of the Frobenius instability locus.


Efficient Deep Learning Techniques for Multiphase Flow Simulation in Heterogeneous Porous Media. We present efficient deep learning techniques for approximating flow and transport equations for both single phase and two phase flow problems. The proposed methods take advantages of the sparsity structures in the underlying discrete systems and can be served as efficient alternatives to the system solvers at the full order. In particular, for the flow problem, we design a network with convolutional and locally connected layers to perform model reductions. Moreover, we employ a custom loss function to impose local mass conservation constraints. This helps to preserve the physical property of velocity solution which we are interested in learning. For the saturation problem, we propose a residual type of network to approximate the dynamics. Our main contribution here is the design of custom sparsely connected layers which take into account the inherent sparse interaction between the input and output. After training, the approximated feed forward map can be applied iteratively to predict solutions in the long range. Our trained networks, especially in two phase flow where the maps are nonlinear, show their great potential in accurately approximating the underlying physical system and improvement in computational efficiency. Some numerical experiments are performed and discussed to demonstrate the performance of our proposed techniques.


Special Topic Markov Models of Molecular Kinetics. The Journal of Chemical Physics (JCP) article collection on Markov Models of Molecular Kinetics (MMMK) features recent advances developing and using Markov State Models (MSMs) in atomistic molecular simulations and related applications. This editorial provides a brief overview of the state of the art in the field and relates it to the articles in this JCP collection.


On Approximating Partial Set Cover and Generalizations. Partial Set Cover (PSC) is a generalization of the well studied Set Cover problem (SC). In PSC the input consists of an integer k and a set system (U,S) where U is a finite set, and S subseteq 2 U is a collection of subsets of U . The goal is to find a subcollection S' subseteq S of smallest cardinality such that sets in S' cover at least k elements of U that is cup A in S' A ge k . SC is a special case of PSC when k U . In the weighted version each set X in S has a non negative weight w(X) and the goal is to find a minimum weight subcollection to cover k elements. Approximation algorithms for SC have been adapted to obtain comparable algorithms for PSC in various interesting cases. In recent work Inamdar and Varadarajan, motivated by geometric set systems, obtained a simple and elegant approach to reduce PSC to SC via the natural LP relaxation. They showed that if a deletion closed family of SC admits a beta approximation via the natural LP relaxation, then one can obtain a 2( beta 1) approximation for PSC on the same family. In a subsequent paper, they also considered a generalization of PSC that has multiple partial covering constraints which is partly inspired by and generalizes previous work of Bera et al on the Vertex Cover problem. Our main goal in this paper is to demonstrate some useful connections between the results in previous work and submodularity. This allows us to simplify, and in some cases improve their results. We improve the approximation for PSC to (1 1 e)( beta 1) . We extend the previous work to the sparse setting.


Using Diffuse Scattering to Observe X Ray Driven Nonthermal Melting. We present results from the SPring 8 Angstrom Compact free electron LAser (SACLA) XFEL facility, using a high intensity ( sim !10 20 , W cm 2 ) X ray pump X ray probe scheme to observe changes in the ionic structure of silicon induced by X ray heating of the electrons. By avoiding Laue spots in the scattering signal from a single crystalline sample, we observe a rapid rise in diffuse scattering, which we attribute to a loss of lattice order and a transition to a liquid state within 100 fs of irradiation, a timescale which agrees well with first principles simulations, but is faster than that predicted by purely inertial behavior. This method is capable of observing liquid scattering without masking or filtering of signal from the ambient solid, allowing the liquid structure to be measured throughout and beyond the phase change.


Revisiting CycleGAN for semi supervised segmentation. In this work, we study the problem of training deep networks for semantic image segmentation using only a fraction of annotated images, which may significantly reduce human annotation efforts. Particularly, we propose a strategy that exploits the unpaired image style transfer capabilities of CycleGAN in semi supervised segmentation. Unlike recent works using adversarial learning for semi supervised segmentation, we enforce cycle consistency to learn a bidirectional mapping between unpaired images and segmentation masks. This adds an unsupervised regularization effect that boosts the segmentation performance when annotated data is limited. Experiments on three different public segmentation benchmarks (PASCAL VOC 2012, Cityscapes and ACDC) demonstrate the effectiveness of the proposed method. The proposed model achieves 2 4 of improvement with respect to the baseline and outperforms recent approaches for this task, particularly in low labeled data regime.


Forma mentis networks reconstruct how Italian high schoolers and international STEM experts perceive teachers, students, scientists, and school. This study investigates how students and researchers shape their knowledge and perception of educational topics. The mindset or forma mentis of 159 Italian high school students and of 59 international researchers in STEM are reconstructed through forma mentis networks, i.e., cognitive networks of concepts connected by free associations and enriched with sentiment labels. The layout of conceptual associations between positively negatively neutrally perceived concepts is informative on how people build their own mental constructs or beliefs about specific topics. Researchers displayed mixed positive neutral mental representations of teacher'', student'' and, scientist''. Students' conceptual associations of scientist'' were highly positive and largely non stereotypical, although links about the mad scientist'' stereotype persisted. Students perceived teacher'' as a complex figure, associated with positive aspects like mentoring knowledge transmission but also to negative sides revolving around testing and grading. School'' elicited stronger differences between the two groups. In the students' mindset, school'' was surrounded by a negative emotional aura or set of associations, indicating an anxious perception of the school setting, mixing scholastic concepts, anxiety eliciting words, STEM disciplines like maths and physics, and exam related notions. Researchers' positive stance of school'' included concepts of fun, friendship, and personal growth instead. Along the perspective of Education Research, the above results are discussed as quantitative evidence for test and STEM anxiety co occurring in the way Italian students perceive education places and their actors. Detecting these patterns in student populations through forma mentis networks offers new, simple to gather yet detailed knowledge for future data informed intervention policies and action research.


On numerical semigroups with at most 12 left elements. For a numerical semigroup S subseteq N with embedding dimension e, conductor c and left part L S cap 0, c 1 , set W (S) e L c. In 1978 Wilf asked, in equivalent terms, whether W (S) ge 0 always holds, a question known since as Wilf's conjecture. Using a closely related lower bound W 0 (S) le W (S), we show that if L le 12 then W 0 (S) ge 0, thereby settling Wilf's conjecture in this case. This is best possible, since cases are known where L 13 and W 0 (S) 1. Wilf's conjecture remains open for L ge 13.


Weighted Reservoir Sampling from Distributed Streams. We consider message efficient continuous random sampling from a distributed stream, where the probability of inclusion of an item in the sample is proportional to a weight associated with the item. The unweighted version, where all weights are equal, is well studied, and admits tight upper and lower bounds on message complexity. For weighted sampling with replacement, there is a simple reduction to unweighted sampling with replacement. However, in many applications the stream has only a few heavy items which may dominate a random sample when chosen with replacement. Weighted sampling textit without replacement (weighted SWOR) eludes this issue, since such heavy items can be sampled at most once. In this work, we present the first message optimal algorithm for weighted SWOR from a distributed stream. Our algorithm also has optimal space and time complexity. As an application of our algorithm for weighted SWOR, we derive the first distributed streaming algorithms for tracking textit heavy hitters with residual error . Here the goal is to identify stream items that contribute significantly to the residual stream, once the heaviest items are removed. Residual heavy hitters generalize the notion of ell 1 heavy hitters and are important in streams that have a skewed distribution of weights. In addition to the upper bound, we also provide a lower bound on the message complexity that is nearly tight up to a log(1 epsilon) factor. Finally, we use our weighted sampling algorithm to improve the message complexity of distributed L 1 tracking, also known as count tracking, which is a widely studied problem in distributed streaming. We also derive a tight message lower bound, which closes the message complexity of this fundamental problem.


Comprehensive forecasting based analysis using stacked stateless and stateful Gated Recurrent Unit models. Photovoltaic power is a renewable source of energy which is highly used in industries. In economically struggling countries it can be a potential source of electric energy as other non renewable resources are already exhausting. Now if installation of a photovoltaic cell in a region is done prior to research, it may not provide the desired energy output required for running that region. Hence forecasting is required which can elicit the output from a particular region considering its geometrical coordinates, solar parameter like GHI and weather parameters like temperature and wind speed etc. Our paper explores forecasting of solar irradiance on four such regions, out of which three is in West Bengal and one outside to depict with using stacked Gated Recurrent Unit (GRU) models. We have checked that stateful stacked gated recurrent unit model improves the prediction accuracy significantly.


A discrete weighted Markov Bernstein inequality for polynomials and sequences. For parameters ,c in(0,1) , and , beta 0 , let , ell 2 (c, beta) , be the Hilbert space of real functions defined on , mathbb N , (i.e., real sequences), for which f c, beta 2 sum k 0 infty frac ( beta) k k! ,c k , f(k) 2 infty ,. We study the best (i.e., the smallest possible) constant , gamma n(c, beta) , in the discrete Markov Bernstein inequality Delta P c, beta leq gamma n(c, beta) , P c, beta ,, quad P in mathcal P n ,, where , mathcal P n , is the set of real algebraic polynomials of degree at most ,n , and , Delta f(x) f(x 1) f(x) , . We prove that (i) displaystyle gamma n(c,1) leq 1 frac 1 sqrt c , for every ,n in mathbb N , and displaystyle lim n to infty gamma n(c,1) 1 frac 1 sqrt c , . (ii) For every fixed ,c in (0,1) , , , gamma n(c, beta) , is a monotonically decreasing function of , beta , in ,(0, infty) , . (iii) For every fixed ,c in (0,1) , and , beta 0 , , the best Markov Bernstein constants , gamma n(c, beta) , are bounded uniformly with respect to ,n . A similar Markov Bernstein unequality is proved for sequences in , ell 2 (c, beta) , . We also establish a relation between the best Markov Bernstein constants , gamma n(c, beta) , and the smallest eigenvalues of certain explicitly given Jacobi matrices.


On non coercive mixed problems for parameter dependent elliptic operators. We consider a (generally, non coercive) mixed boundary value problem in a bounded domain D of mathbb R n for a second order parameter dependent elliptic differential operator A (x, partial, lambda) with complex valued essentially bounded measured coefficients and complex parameter lambda . The differential operator is assumed to be of divergent form in D , the boundary operator B (x, partial) is of Robin type with possible pseudo differential components on partial D . The boundary of D is assumed to be a Lipschitz surface. Under these assumptions the pair (A (x, partial, lambda),B) induces a holomorphic family of Fredholm operators L( lambda) H (D) to H (D) in suitable Hilbert spaces H (D) , H (D) of Sobolev type. If the argument of the complex valued multiplier of the parame ter in A (x, partial, lambda) is continuous and the coefficients related to second order derivatives of the operator are smooth then we prove that the operators L( lambda) are conti nu ously invertible for all lambda with sufficiently large modulus lambda on each ray on the complex plane mathbb C where the differential operator A (x, partial, lambda) is parameter dependent elliptic. We also describe reasonable conditions for the system of root functions related to the family L ( lambda) to be (doubly) complete in the spaces H (D) , H (D) and the Lebesgue space L 2 (D) .


A Comparative Study of magneto thermo elastic wave propagation in a finitely conducting medium under thermoelasticity of type I, II, III. The present work is concerned with the propagation of electro magneto thermoelastic plane waves of assigned frequency in a homogeneous isotropic and finitely conducting elastic medium permeated by a primary uniform external magnetic field. We formulate our problem under the theory of Green and Naghdi of type III (GN III) to account for the interactions between the elastic, thermal as well as magnetic fields. A general dispersion relation for coupled waves is deduced to ascertain the nature of waves propagating through the medium. Perturbation technique has been employed to obtain the solution of dispersion relation for small thermo elastic coupling parameter and identify three different types of waves. We specially analyze the nature of important wave components like, phase velocity, specific loss and penetration depth of all three modes of waves. We attempt to compute these wave components numerically to observe their variations with frequency. The effect of presence of magnetic field is analyzed. Comparative results under theories of type GN I, II and III have been presented numerically in which we have found that the coupled thermoelastic waves are un attenuated and nondispersive in case of Green Naghdi II model which is completely in contrast with the theories of type I and type III. Furthermore, the thermal mode wave is observed to propagate with finite phase velocity in case of GN II model, whereas the phase velocity of thermal mode wave is found to be an increasing function of frequency in other two cases. We achieve significant variations among the results predicted by all three theories.


Acceleration of nonlinear solvers for natural convection problems. This paper develops an efficient and robust solution technique for the steady Boussinesq model of non isothermal flow using Anderson acceleration applied to a Picard iteration. After analyzing the fixed point operator associated with the nonlinear iteration to prove that certain stability and regularity properties hold, we apply the authors' recently constructed theory for Anderson acceleration, which yields a convergence result for the Anderson accelerated Picard iteration for the Boussinesq system. The result shows that the leading term in the residual is improved by the gain in the optimization problem, but at the cost of additional higher order terms that can be significant when the residual is large. We perform numerical tests that illustrate the theory, and show that a 2 stage choice of Anderson depth can be advantageous. We also consider Anderson acceleration applied to the Newton iteration for the Boussinesq equations, and observe that the acceleration allows the Newton iteration to converge for significantly higher Rayleigh numbers that it could without acceleration, even with a standard line search.


Shared Cross Modal Trajectory Prediction for Autonomous Driving. Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self driving vehicles are equipped with various types of sensors (e.g., LiDAR scanner, RGB camera, radar, etc.), we propose a Cross Modal Embedding framework that aims to benefit from the use of multiple input modalities. At training time, our model learns to embed a set of complementary features in a shared latent space by jointly optimizing the objective functions across different types of input data. At test time, a single input modality (e.g., LiDAR data) is required to generate predictions from the input perspective (i.e., in the LiDAR space), while taking advantages from the model trained with multiple sensor modalities. An extensive evaluation is conducted to show the efficacy of the proposed framework using two benchmark driving datasets.


Local Differential Privacy a tutorial. In the past decade analysis of big data has proven to be extremely valuable in many contexts. Local Differential Privacy (LDP) is a state of the art approach which allows statistical computations while protecting each individual user's privacy. Unlike Differential Privacy no trust in a central authority is necessary as noise is added to user inputs locally. In this paper we give an overview over different LDP algorithms for problems such as locally private heavy hitter identification and spatial data collection. Finally, we will give an outlook on open problems in LDP.


iCassava 2019 Fine Grained Visual Categorization Challenge. Viral diseases are major sources of poor yields for cassava, the 2nd largest provider of carbohydrates in Africa.At least 80 of small holder farmer households in Sub Saharan Africa grow cassava. Since many of these farmers have smart phones, they can easily obtain photos of dis eased and healthy cassava leaves in their farms, allowing the opportunity to use computer vision techniques to monitor the disease type and severity and increase yields. How ever, annotating these images is extremely difficult as ex perts who are able to distinguish between highly similar dis eases need to be employed. We provide a dataset of labeled and unlabeled cassava leaves and formulate a Kaggle challenge to encourage participants to improve the performance of their algorithms using semi supervised approaches. This paper describes our dataset and challenge which is part of the Fine Grained Visual Categorization workshop at CVPR2019.


Woodpecker DL Accelerating Deep Neural Networks via Hardware Aware Multifaceted Optimizations. Accelerating deep model training and inference is crucial in practice. Existing deep learning frameworks usually concentrate on optimizing training speed and pay fewer attentions to inference specific optimizations. Actually, model inference differs from training in terms of computation, e.g. parameters are refreshed each gradient update step during training, but kept invariant during inference. These special characteristics of model inference open new opportunities for its optimization. In this paper, we propose a hardware aware optimization framework, namely Woodpecker DL (WPK), to accelerate inference by taking advantage of multiple joint optimizations from the perspectives of graph optimization, automated searches, domain specific language (DSL) compiler techniques and system level exploration. In WPK, we investigated two new automated search approaches based on genetic algorithm and reinforcement learning, respectively, to hunt the best operator code configurations targeting specific hardware. A customized DSL compiler is further attached to these search algorithms to generate efficient codes. To create an optimized inference plan, WPK systematically explores high speed operator implementations from third party libraries besides our automatically generated codes and singles out the best implementation per operator for use. Extensive experiments demonstrated that on a Tesla P100 GPU, we can achieve the maximum speedup of 5.40 over cuDNN and 1.63 over TVM on individual convolution operators, and run up to 1.18 times faster than TensorRT for end to end model inference.


Scattering for the non radial inhomogeneous NLS. We extend the result of Farah and Guzm 'an on scattering for the 3d cubic inhomogeneous NLS to the non radial setting. The key new ingredient is a construction of scattering solutions corresponding to initial data living far from the origin.


Equidistribution and inequalities for partitions into powers. If p k(a,m,n) denotes the number of partitions of n into k th powers with a number of parts that is congruent to a modulo m, then p 2(0,2,n) sim p 2(1,2,n) and the sign of the difference p 2(0,2,n) p k(1,2,n) alternates with the parity of n, as proven by recent work of the author (2020). In this paper, we place the problem in a broader framework. By analytic arguments using the circle method and Gauss sums estimates, we show that the same results hold for any k ge2. By combinatorial arguments, we show that the sign of the difference p k(0,2,n) p k(1,2,n) depends on the parity of n for a larger class of partitions.


Minimizing Perceived Image Quality Loss Through Adversarial Attack Scoping. Neural networks are now actively being used for computer vision tasks in security critical areas such as robotics, face recognition, autonomous vehicles yet their safety is under question after the discovery of adversarial attacks. In this paper we develop simplified adversarial attack algorithms based on a scoping idea, which enables execution of fast adversarial attacks that minimize structural image quality (SSIM) loss, allows performing efficient transfer attacks with low target inference network call count and opens a possibility of an attack using pen only drawings on a paper for the MNIST handwritten digit dataset. The presented adversarial attack analysis and the idea of attack scoping can be easily expanded to different datasets, thus making the paper's results applicable to a wide range of practical tasks.


Distributionally Robust Learning for Uncertainty Calibration under Domain Shift. We propose a framework for learning calibrated uncertainties under domain shifts. We consider the case where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts through the use of a binary domain classifier and integrate it with the task network and train them jointly end to end. The binary domain classifier yields a density ratio that reflects the closeness of a target (test) sample to the source (training) distribution. We employ it to adjust the uncertainty of prediction in the task network. This idea of using the density ratio is based on the distributionally robust learning (DRL) framework, which accounts for the domain shift through adversarial risk minimization. We demonstrate that our method generates calibrated uncertainties that benefit many downstream tasks, such as unsupervised domain adaptation (UDA) and semi supervised learning (SSL). In these tasks, methods like self training and FixMatch use uncertainties to select confident pseudo labels for re training. Our experiments show that the introduction of DRL leads to significant improvements in cross domain performance. We also demonstrate that the estimated density ratios show agreement with the human selection frequencies, suggesting a positive correlation with a proxy of human perceived uncertainties.


A discrete variational scheme for isentropic processes in polyconvex thermoelasticity. We propose a variational scheme for the construction of isentropic processes of the equations of adiabatic thermoelasticity with polyconvex internal energy. The scheme hinges on the embedding of the equations of adiabatic polyconvex thermoelasticity into a symmetrizable hyperbolic system. We establish existence of minimizers for an associated minimization theorem and construct measure valued solutions that dissipate the total energy. We prove that the scheme converges when the limiting solution is smooth.


A challenge to the Delta G 0 interpretation of hydrogen evolution. Platinum is a nearly perfect catalyst for the hydrogen evolution reaction, and its high activity has conventionally been explained by its close to thermoneutral hydrogen binding energy (G 0). However, many candidate non precious metal catalysts bind hydrogen with similar strengths, but exhibit orders of magnitude lower activity for this reaction. In this study, we employ electronic structure methods that allow fully potential dependent reaction barriers to be calculated, in order to develop a complete working picture of hydrogen evolution on platinum. Through the resulting ab initio microkinetic models, we assess the mechanistic origins of Pt's high activity. Surprisingly, we find that the G 0 hydrogen atoms are kinetically inert, and that the kinetically active hydrogen atoms have G's much weaker, similar to that of gold. These on top hydrogens have particularly low barriers, which we compare to those of gold, explaining the high reaction rates, and the exponential variations in coverages can uniquely explain Pt's strong kinetic response to the applied potential. This explains the unique reactivity of Pt that is missed by conventional Sabatier analyses, and suggests true design criteria for non precious alternatives.


Design and Implementation of Fair Congestion Control for Data Centers Networks. In data centers, the nature of the composite bursty traffic along with the small bandwidth delay product and switch buffers lead to several congestion problems that are not handled well by traditional congestion control mechanisms such as TCP. Existing work try to address the problem by modifying TCP to suit the operational nature of data centers. This is practically feasible in private settings, however, in public environments, such modifications are prohibited. Therefore, in this work, we design simple switch based queue management to deal with such congestion issues adequately. This approach entails no modification to the TCP sender and receiver algorithms which enables easy and seamless deployment in public data centers. We present a theoretical analysis to show the stability and effectiveness of the scheme. We also present, three different real implementations (as a Linux kernel module and as an added feature to OpenvSwitch) and give numerical results from both NS 2 simulation and experiments of real deployment in a small test bed cluster to show its effectiveness in achieving high throughput overall, a good fairness and short flow completion times for delay sensitive flows.


Algorithmic Reduction of Biological Networks With Multiple Time Scales. We present a symbolic algorithmic approach that allows to compute invariant manifolds and corresponding reduced systems for differential equations modeling biological networks which comprise chemical reaction networks for cellular biochemistry, and compartmental models for pharmacology, epidemiology and ecology. Multiple time scales of a given network are obtained by scaling, based on tropical geometry. Our reduction is mathematically justified within a singular perturbation setting. The existence of invariant manifolds is subject to hyperbolicity conditions, for which we propose an algorithmic test based on Hurwitz criteria. We finally obtain a sequence of nested invariant manifolds and respective reduced systems on those manifolds. Our theoretical results are generally accompanied by rigorous algorithmic descriptions suitable for direct implementation based on existing off the shelf software systems, specifically symbolic computation libraries and Satisfiability Modulo Theories solvers. We present computational examples taken from the well known BioModels database using our own prototypical implementations.


Universal precursor seismicity pattern before locked segment rupture. Despite the enormous efforts towards searching for precursors, no precursors have exhibited real predictive power with respect to an earthquake thus far. Seismogenic locked segments that can accumulate adequate strain energy to cause major earthquakes are very heterogeneous and less brittle progressive failures of the locked segments with these properties can produce an interesting seismic phenomenon a characteristic earthquake and a sequence of smaller subsequent earthquakes (pre shocks) always arise prior to another characteristic earthquake within a well defined seismic zone and its current seismic period. Applying a mechanical model and magnitude constraint conditions, we show that two adjacent characteristic earthquakes reliably occur at the volume expansion and peak stress points of a locked segment. Such a seismicity pattern has occurred in 62 seismic zones worldwide, suggesting that the pattern applies universally. Both the precursor pattern and the model quantifying it permit the prediction of certain characteristic earthquakes in a seismic zone.


Identifying Properties of Real World Optimisation Problems through a Questionnaire. Optimisation algorithms are commonly compared on benchmarks to get insight into performance differences. However, it is not clear how closely benchmarks match the properties of real world problems because these properties are largely unknown. This work investigates the properties of real world problems through a questionnaire to enable the design of future benchmark problems that more closely resemble those found in the real world. The results, while not representative as they are based on only 45 responses, indicate that many problems possess at least one of the following properties they are constrained, deterministic, have only continuous variables, require substantial computation times for both the objectives and the constraints, or allow a limited number of evaluations. Properties like known optimal solutions and analytical gradients are rarely available, limiting the options in guiding the optimisation process. These are all important aspects to consider when designing realistic benchmark problems. At the same time, the design of realistic benchmarks is difficult, because objective functions are often reported to be black box and many problem properties are unknown. To further improve the understanding of real world problems, readers working on a real world optimisation problem are encouraged to fill out the questionnaire https tinyurl.com opt survey


On the spectral radius of block graphs having all their blocks of the same size. Let mathcal B (n,q) be the class of block graphs on n vertices having all their blocks of the same size. We prove that if G in mathcal B (n,q) has at most three pairwise adjacent cut vertices then the minimum spectral radius rho(G) is attained at a unique graph. In addition, we present a lower bound for rho(G) when G in mathcal B (n,q) .


A highly scalable Met Office NERC Cloud model. Large Eddy Simulation is a critical modelling tool for scientists investigating atmospheric flows, turbulence and cloud microphysics. Within the UK, the principal LES model used by the atmospheric research community is the Met Office Large Eddy Model (LEM). The LEM was originally developed in the late 1980s using computational techniques and assumptions of the time, which means that the it does not scale beyond 512 cores. In this paper we present the Met Office NERC Cloud model, MONC, which is a re write of the existing LEM. We discuss the software engineering and architectural decisions made in order to develop a flexible, extensible model which the community can easily customise for their own needs. The scalability of MONC is evaluated, along with numerous additional customisations made to further improve performance at large core counts. The result of this work is a model which delivers to the community significant new scientific modelling capability that takes advantage of the current and future generation HPC machines.


Equation of motion MLCCSD and CCSD in HF oscillator strengths and their application to core excitations. We present an implementation of equation of motion oscillator strengths for the multilevel CCSD (MLCCSD) model where CCS is used as the lower level method (CCS CCSD). In this model, the double excitations of the cluster operator are restricted to an active orbital space, whereas the single excitations are unrestricted. Calculated nitrogen K edge spectra of adenosine, adenosine triphosphate (ATP), and an ATP water system are used to demonstrate the performance of the model. Projected atomic orbitals (PAOs) are used to partition the virtual space into active and inactive orbital sets. Cholesky decomposition of the Hartree Fock density is used to partition the occupied orbitals. This Cholesky PAO partitioning is cheap, scaling as mathcal O (N 3) , and is suitable for the calculation of core excitations which are localized in character. By restricting the single excitations of the cluster operator to the active space, as well as the double excitations, the CCSD in HF model is obtained. A comparison of the two models MLCCSD and CCSD in HF is presented for the core excitation spectra of the adenosine and ATP systems.


Asymmetric truncated Toeplitz operators and conjugations. Truncated Toeplitz operators in a model space are C symmetric with respect to a natural conjugation in that space. We show that this and another conjugation associated to an orthogonal decomposition possess unique properties and we study their relations with asymmetric truncated Toeplitz operators in terms of C symmetry. New connections with Hankel operators are established through this approach.


Impartial Selection with Additive Approximation Guarantees. Impartial selection has recently received much attention within the multi agent systems community. The task is, given a directed graph representing nominations to the members of a community by other members, to select the member with the highest number of nominations. This seemingly trivial goal becomes challenging when there is an additional impartiality constraint, requiring that no single member can influence her chance of being selected. Recent progress has identified impartial selection rules with optimal approximation ratios. Moreover, it was noted that worst case instances are graphs with few vertices. Motivated by this fact, we propose the study of em additive approximation , the difference between the highest number of nominations and the number of nominations of the selected member, as an alternative measure of the quality of impartial selection. Our positive results include two randomized impartial selection mechanisms which have additive approximation guarantees of Theta( sqrt n ) and Theta(n 2 3 ln 1 3 n) for the two most studied models in the literature, where n denotes the community size. We complement our positive results by providing negative results for various cases. First, we provide a characterization for the interesting class of strong sample mechanisms, which allows us to obtain lower bounds of n 2 , and of Omega( sqrt n ) for their deterministic and randomized variants respectively. Finally, we present a general lower bound of 2 for all deterministic impartial mechanisms.