NatCSNN A Convolutional Spiking Neural Network for recognition of objects extracted from natural images. Biological image processing is performed by complex neural networks composed of thousands of neurons interconnected via thousands of synapses, some of which are excitatory and others inhibitory. Spiking neural models are distinguished from classical neurons by being biological plausible and exhibiting the same dynamics as those observed in biological neurons. This paper proposes a Natural Convolutional Neural Network (NatCSNN) which is a 3 layer bio inspired Convolutional Spiking Neural Network (CSNN), for classifying objects extracted from natural images. A two stage training algorithm is proposed using unsupervised Spike Timing Dependent Plasticity (STDP) learning (phase 1) and ReSuMe supervised learning (phase 2). The NatCSNN was trained and tested on the CIFAR 10 dataset and achieved an average testing accuracy of 84.7 which is an improvement over the 2 layer neural networks previously applied to this dataset.


ACORNS An Easy To Use Code Generator for Gradients and Hessians. The computation of first and second order derivatives is a staple in many computing applications, ranging from machine learning to scientific computing. We propose an algorithm to automatically differentiate algorithms written in a subset of C99 code and its efficient implementation as a Python script. We demonstrate that our algorithm enables automatic, reliable, and efficient differentiation of common algorithms used in physical simulation and geometry processing.


SynthCity A large scale synthetic point cloud. With deep learning becoming a more prominent approach for automatic classification of three dimensional point cloud data, a key bottleneck is the amount of high quality training data, especially when compared to that available for two dimensional images. One potential solution is the use of synthetic data for pre training networks, however the ability for models to generalise from synthetic data to real world data has been poorly studied for point clouds. Despite this, a huge wealth of 3D virtual environments exist which, if proved effective can be exploited. We therefore argue that research in this domain would be of significant use. In this paper we present SynthCity an open dataset to help aid research. SynthCity is a 367.9M point synthetic full colour Mobile Laser Scanning point cloud. Every point is assigned a label from one of nine categories. We generate our point cloud in a typical Urban Suburban environment using the Blensor plugin for Blender.


Engineering Music to Slow Breathing and Invite Relaxed Physiology. We engineered an interactive music system that influences a user's breathing rate to induce a relaxation response. This system generates ambient music containing periodic shifts in loudness that are determined by the user's own breathing patterns. We evaluated the efficacy of this music intervention for participants who were engaged in an attention demanding task, and thus explicitly not focusing on their breathing or on listening to the music. We measured breathing patterns in addition to multiple peripheral and cortical indicators of physiological arousal while users experienced three different interaction designs (1) a "Fixed Tempo" amplitude modulation rate at six beats per minute (2) a "Personalized Tempo" modulation rate fixed at 75 of each individual's breathing rate baseline, and (3) a "Personalized Envelope" design in which the amplitude modulation matches each individual's breathing pattern in real time. Our results revealed that each interactive music design slowed down breathing rates, with the "Personalized Tempo" design having the largest effect, one that was more significant than the non personalized design. The physiological arousal indicators (electrodermal activity, heart rate, and slow cortical potentials measured in EEG) showed concomitant reductions, suggesting that slowing users' breathing rates shifted them towards a more calmed state. These results suggest that interactive music incorporating biometric data may have greater effects on physiology than traditional recorded music.


Model predictive approach to integrated path planning and tracking for autonomous vehicles. In the path planning problem of autonomous application, the existing studies separately consider the path planning and trajectory tracking control of the autonomous vehicle and few of them have integrated the trajectory planning and trajectory control together. To fill in this research gap, this study proposes an integrated trajectory planning and trajectory control method. This paper also studies the collision avoidance problem of autonomous by considering static and dynamic obstacles. Simulation results have been presented to show the effectiveness of the proposed control method.


On Resolvable Golomb Rulers, Symmetric Configurations and Progressive Dinner Parties. We define a new type of Golomb ruler, which we term a resolvable Golomb ruler. These are Golomb rulers that satisfy an additional "resolvability" condition that allows them to generate resolvable symmetric configurations. The resulting configurations give rise to progressive dinner parties. In this paper, we investigate existence results for resolvable Golomb rulers and their application to the construction of resolvable symmetric configurations and progressive dinner parties. In particular, we determine the existence or nonexistence of all possible resolvable symmetric configurations and progressive dinner parties having block size at most 13, with nine possible exceptions. For arbitrary block size k, we prove that these designs exist if the number of points is divisible by k and at least k 3.


Automorphisms of a Clifford like parallelism. In this paper we focus on the description of the automorphism group Gamma parallel of a Clifford like parallelism parallel on a 3 dimensional projective double space bigl( mathbb P (H F), mathrel parallel ell , mathrel parallel r bigr) over a quaternion skew field H (with centre a field F of any characteristic). We compare Gamma parallel with the automorphism group Gamma ell of the left parallelism mathrel parallel ell , which is strictly related to mathrm Aut (H) . We build up and discuss several examples showing that over certain quaternion skew fields it is possible to choose parallel in such a way that Gamma parallel is either properly contained in Gamma ell or coincides with Gamma ell even though parallel neq mathrel parallel ell .


One Point, One Object Simultaneous 3D Object Segmentation and 6 DOF Pose Estimation. We propose a single shot method for simultaneous 3D object segmentation and 6 DOF pose estimation in pure 3D point clouds scenes based on a consensus that emph one point only belongs to one object , i.e., each point has the potential power to predict the 6 DOF pose of its corresponding object. Unlike the recently proposed methods of the similar task, which rely on 2D detectors to predict the projection of 3D corners of the 3D bounding boxes and the 6 DOF pose must be estimated by a PnP like spatial transformation method, ours is concise enough not to require additional spatial transformation between different dimensions. Due to the lack of training data for many objects, the recently proposed 2D detection methods try to generate training data by using rendering engine and achieve good results. However, rendering in 3D space along with 6 DOF is relatively difficult. Therefore, we propose an augmented reality technology to generate the training data in semi virtual reality 3D space. The key component of our method is a multi task CNN architecture that can simultaneously predicts the 3D object segmentation and 6 DOF pose estimation in pure 3D point clouds. For experimental evaluation, we generate expanded training data for two state of the arts 3D object datasets cite PLCHF cite TLINEMOD by using Augmented Reality technology (AR). We evaluate our proposed method on the two datasets. The results show that our method can be well generalized into multiple scenarios and provide performance comparable to or better than the state of the arts.


Sorting networks, staircase Young tableaux and last passage percolation. We present new combinatorial and probabilistic identities relating three random processes the oriented swap process on n particles, the corner growth process, and the last passage percolation model. We prove one of the probabilistic identities, relating a random vector of last passage percolation times to its dual, using the duality between the Robinson Schensted Knuth and Burge correspondences. A second probabilistic identity, relating those two vectors to a vector of "last swap times" in the oriented swap process, is conjectural. We give a computer assisted proof of this identity for n le 6 after first reformulating it as a purely combinatorial identity, and discuss its relation to the Edelman Greene correspondence.


Spatiotemporal Adaptive Quantization for Video Compression Applications. JCT VC HEVC HM 16 includes a Coding Unit (CU) level adaptive Quantization Parameter (QP) technique named AdaptiveQP. It is designed to perceptually adjust the QP in Y, Cb and Cr Coding Blocks (CBs) based only on the variance of samples in a luma CB. In this paper, we propose an adaptive quantisation technique that consists of two contributions. The first contribution relates to accounting for the variance of chroma samples, in addition to luma samples, in a CU. The second contribution relates to accounting for CU temporal information as well as CU spatial information. Moreover, we integrate into our method a lambda refined QP technique to reduce complexity associated multiple QP optimizations in the Rate Distortion Optimization process. We evaluate the proposed technique on 4 4 4, 4 2 2, 4 2 0 and 4 0 0 YCbCr test sequences, for which we quantify the results using the Bjontegaard Delta Rate (BD Rate) metric. Our method achieves a maximum BD Rate reduction of 23.1 (Y), 26.7 (Cr) and 25.2 (Cb). Furthermore, a maximum encoding time reduction of 4.4 is achieved.


Convergence problems along curves for generalized Schr " o dinger operators with polynomial growth. In this paper we build the relationship between smoothness of the functions and convergence rate along curves for a class of generalized Schr " o dinger operators with polynomial growth. We show that the convergence rate depends only on the growth condition of the phase function and regularity of the curve. Our result can be applied to a wide class of operators. In particular, convergence results along curves for a class of generalized Schr " o dinger operators with non homogeneous phase functions is built and then the convergence rate is established.


Height functions associated with closed subschemes. This is an expository note on height functions associated with closed subschemes. This manuscript contains nothing new.


Lambda adic Families of Jacobi Forms. We show that Hida's families of p adic elliptic modular forms generalize to p adic families of Jacobi forms. We also construct p adic versions of theta lifts from elliptic modular forms to Jacobi forms. Our results extend to Jacobi forms previous works by Hida and Stevens on the related case of half integral weight modular forms.


Mining Closed Strict Episodes. Discovering patterns in a sequence is an important aspect of data mining. One popular choice of such patterns are episodes, patterns in sequential data describing events that often occur in the vicinity of each other. Episodes also enforce in which order the events are allowed to occur. In this work we introduce a technique for discovering closed episodes. Adopting existing approaches for discovering traditional patterns, such as closed itemsets, to episodes is not straightforward. First of all, we cannot define a unique closure based on frequency because an episode may have several closed superepisodes. Moreover, to define a closedness concept for episodes we need a subset relationship between episodes, which is not trivial to define. We approach these problems by introducing strict episodes. We argue that this class is general enough, and at the same time we are able to define a natural subset relationship within it and use it efficiently. In order to mine closed episodes we define an auxiliary closure operator. We show that this closure satisfies the needed properties so that we can use the existing framework for mining closed patterns. Discovering the true closed episodes can be done as a post processing step. We combine these observations into an efficient mining algorithm and demonstrate empirically its performance in practice.


A General Approach for Multireference Ground and Excited States using Non Orthogonal Configuration Interaction. A balanced description of ground and excited states is essential for the description of many chemical processes. However, few methods can handle cases where static correlation is present, and often these scale very unfavourably with system size. Recently, multiple Hartree Fock (HF) solutions have been proposed as a basis for non orthogonal configuration interaction (NOCI) to provide multireference ground and excited state energies, although applications across multiple geometries have been limited by the coalescence of HF solutions. Holomorphic HF (h HF) theory allows solutions to be analytically continued beyond the Coulson Fischer points at which they vanish but, until now, this has only been demonstrated for small model systems. In this work, we propose a general protocol for computing NOCI ground and excited state energies using multiple HF solutions. To do so, we outline an active space variation of SCF metadynamics that allows a chemically relevant set of HF states to be identified, and describe how these states can be routinely traced across all molecular geometries by exploiting the topology of h HF solutions in the complex plane. Finally, we illustrate our approach using the dissociation of the fluorine dimer and the pseudo Jahn Teller distortion of cyclobutadiene, demonstrating its applicability for multireference ground and excited states.


Functional Connectome Fingerprint Gradients in Young Adults. The assessment of brain fingerprints has emerged in the recent years as an important tool to study individual differences and to infer quality of neuroimaging datasets. Studies so far have mainly focused on connectivity fingerprints between different brain scans of the same individual. Here, we extend the concept of brain connectivity fingerprints beyond test retest and assess fingerprint gradients in young adults by developing an extension of the differential identifiability framework. To do so, we look at the similarity between not only the multiple scans of an individual (subject fingerprint), but also between the scans of monozygotic and dizygotic twins (twin fingerprint). We have carried out this analysis on the 8 fMRI conditions present in the Human Connectome Project Young Adult dataset, which we processed into functional connectomes (FCs) and timeseries parcellated according to the Schaefer Atlas scheme, which has multiple levels of resolution. Our differential identifiability results show that the fingerprint gradients based on genetic and environmental similarities are indeed present when comparing FCs for all parcellations and fMRI conditions. Importantly, only when assessing optimally reconstructed FCs, we fully uncover fingerprints present in higher resolution atlases. We also study the effect of scanning length on subject fingerprint of resting state FCs to analyze the effect of scanning length and parcellation. In the pursuit of open science, we have also made available the processed and parcellated FCs and timeseries for all conditions for 1200 subjects part of the HCP YA dataset to the scientific community.


Determining Sequence of Image Processing Technique (IPT) to Detect Adversarial Attacks. Developing secure machine learning models from adversarial examples is challenging as various methods are continually being developed to generate adversarial attacks. In this work, we propose an evolutionary approach to automatically determine Image Processing Techniques Sequence (IPTS) for detecting malicious inputs. Accordingly, we first used a diverse set of attack methods including adaptive attack methods (on our defense) to generate adversarial samples from the clean dataset. A detection framework based on a genetic algorithm (GA) is developed to find the optimal IPTS, where the optimality is estimated by different fitness measures such as Euclidean distance, entropy loss, average histogram, local binary pattern and loss functions. The "image difference" between the original and processed images is used to extract the features, which are then fed to a classification scheme in order to determine whether the input sample is adversarial or clean. This paper described our methodology and performed experiments using multiple data sets tested with several adversarial attacks. For each attack type and dataset, it generates unique IPTS. A set of IPTS selected dynamically in testing time which works as a filter for the adversarial attack. Our empirical experiments exhibited promising results indicating the approach can efficiently be used as processing for any AI model.


Efficient Trace Encodings of Bounded Synthesis for Asynchronous Distributed Systems. The manual implementation of distributed systems is an error prone task because of the asynchronous interplay of components and the environment. Bounded synthesis automatically generates an implementation for the specification of the distributed system if one exists. So far, bounded synthesis for distributed systems does not utilize their asynchronous nature. Instead, concurrent behavior of components is encoded by all interleavings and only then checked against the specification. We close this gap by identifying true concurrency in synthesis of asynchronous distributed systems represented as Petri games. This defines when several interleavings can be subsumed by one true concurrent trace. Thereby, fewer and shorter verification problems have to be solved in each iteration of the bounded synthesis algorithm. For Petri games, experimental results show that our implementation using true concurrency outperforms the implementation based on checking all interleavings.


Double Backpropagation for Training Autoencoders against Adversarial Attack. Deep learning, as widely known, is vulnerable to adversarial samples. This paper focuses on the adversarial attack on autoencoders. Safety of the autoencoders (AEs) is important because they are widely used as a compression scheme for data storage and transmission, however, the current autoencoders are easily attacked, i.e., one can slightly modify an input but has totally different codes. The vulnerability is rooted the sensitivity of the autoencoders and to enhance the robustness, we propose to adopt double backpropagation (DBP) to secure autoencoder such as VAE and DRAW. We restrict the gradient from the reconstruction image to the original one so that the autoencoder is not sensitive to trivial perturbation produced by the adversarial attack. After smoothing the gradient by DBP, we further smooth the label by Gaussian Mixture Model (GMM), aiming for accurate and robust classification. We demonstrate in MNIST, CelebA, SVHN that our method leads to a robust autoencoder resistant to attack and a robust classifier able for image transition and immune to adversarial attack if combined with GMM.


Groups GL( infty) over finite fields and multiplications of double cosets. Let mathbb F be a finite field. Consider a direct sum V of an infinite number of copies of mathbb F , consider the dual space V diamond , i. e., the direct product of an infinite number of copies of mathbb F . Consider the direct sum mathbb V V oplus V diamond . The object of the paper is the group mathbf GL of continuous linear operators in mathbb V . We reduce the theory of unitary representations of mathbf GL to projective representations of a certain category whose morphisms are linear relations in finite dimensional linear spaces over mathbb F . In fact we consider a certain family Q alpha of subgroups in mathbb V preserving two element flags, show that there is a natural multiplication on spaces of double cosets with respect to Q alpha , and reduce this multiplication to products of linear relations. We show that this group has type mathrm I and obtain an 'upper estimate' of the set of all irreducible unitary representations of mathbf GL .


A simplified model for expected development of the SARS CoV 2 (Corona) spread in Germany and US after social distancing. Widespread opinions and discussion exist regarding the efficiency of social distancing after crucial spread of the SARS CoV 2 virus during the actual Covid 19 pandemic. While Germany has released a federal law that prohibits any type of direct contact for more than 2 people other countries including the US released curfews. People are now wondering whether these measures are helpful to stop or hamper the Covid 19 pandemic and to limit the spread of the new corona virus. A quantitative statement on this question depends on many parameters that are difficult to grasp mathematically and cannot therefore be made conclusively (they include consistent adherence to the measures decided, the estimated number of unreported cases, the possible limitation by test capacities, possible mutations of the virus, etc ...). However, it turns out that a reduction in the actual daily new infection rate (actual daily growth rate of reported cases, in short infection rate) from the current value of 30 35 in the US to 10 would be extremely effective in stopping the spread of the virus. The severe restrictions in Germany which closed any public events, schools and universities a week ago might already have contributed to a reduction of the growth rate of reported cases below 30 .


Envelope Dynamics and Stability with non linear Space Charge Forces. We developed a model to calculate the stability of Gaussian beam distributions with non linear space charge forces in the presence of random and skew quadrupole errors. The effect of the space charge force on the beam matrix is calculated analytically including full cross plane coupling in 4D phase space, which allows us to perform fast parameter studies. For stability analysis, we find the fixed points of the beam including the space charge forces and construct a Jacobi matrix by slightly perturbing the periodic solution. The stability of envelope oscillations is inferred by eigenvalue analysis. Furthermore, we employ envelope tracking as a complementary method and compare the results of the eigenvalue analysis with FFT data from the tracked envelope. The non linearity of the space charge force in combination with lattice errors and beam coupling opens up for envelope lattice resonances and envelope coupling resonances. Hitting these resonances leads to envelope blow up, causing an effective beam mismatch. Therefore, we finally examine the effect of beam mismatch on the envelope tune shift and its stability.


High brightness seven octave carrier envelope phase stable light source. High brightness sources of coherent and few cycle duration light waveforms with spectral coverage from the UV to the THz would offer unprecedented versatility and opportunities for a spectacular range of applications from bio chemical sensing, to time resolved and nonlinear spectroscopy, to attosecond light wave electronics. Combinations of various sources with frequency conversion and supercontinuum generation can provide relatively large spectral coverage, but many applications require much broader spectral range and low jitter synchronization for time domain measurements. Here, we present a carrier envelope phase stable light source, seeded by a mid IR frequency comb, with simultaneous spectral coverage across 7 optical octaves, from the UV (340 nm) into the THz (40,000 nm). Combining soliton self compression and dispersive wave generation in an anti resonant reflection photonic crystal fibre with intra pulse difference frequency generation in BaGa2GeSe6, the spectral brightness is 2 5 orders of magnitude above synchrotron sources. This enables high dynamic range spectroscopies and provides enticing prospects for attosecond physics and material sciences.


A note on Higgs de Rham flows of level zero. The notion of Higgs de Rham flows was introduced by Lan Sheng Zuo, as an analogue of Yang Mills Higgs flows in the complex nonabelian Hodge theory. In this short note we investigate a small part of this theory, and study those Higgs de Rham flows which are of level zero. We improve the original definition of level zero Higgs de Rham flows (which works for general levels), and establish a Hitchin Simpson type correspondence between such objects and certain representations of fundamental groups in positive characteristic, which generalizes the classical results of Katz. We compare the deformation theories of two sides in the correspondence, and translate the Galois action on the geometric fundamental groups of algebraic varieties defined over finite fields into the Higgs side.


Generalized chromatic polynomials of graphs from Heaps of pieces. Let G be a simple graph and let mathcal L (G) be the free partially commutative Lie algebra associated to G . In this paper, using heaps of pieces, we prove an expression for the generalized textbf k chromatic polynomial of G in terms of dimensions of the grade spaces of mathcal L (G) . This will give us a new interpretation for the chromatic polynomials in terms of multilinear heaps and Lyndon length. The classical results of Stanley, and Greene and Zaslavsky regarding the acyclic orientations of G are obtained as corollaries. A heap with a unique minimal piece is said to be a pyramid and our main theorem is proved using the properties of pyramids. For this reason, we prove two important properties of pyramids namely the pyramid proportionality lemma, and the pyramid and Lyndon heap lemma. In the last section, we will introduce the (m, lambda) labelling on acyclic orientations which is similar to Stanley's lambda compatible pairs. As an application of our main theorem, using this (m, lambda) labelled acyclic orientations, we will prove the reciprocity theorem for the derivatives of the chromatic polynomials.


Minimal mass blow up solutions to rough nonlinear Schroedinger equations. We study the focusing mass critical rough nonlinear Schroedinger equations, where the stochastic integration is taken in the sense of controlled rough path. We obtain the global well posedness if the mass of initial data is below that of the ground state. Moreover, the existence of minimal mass blow up solutions is also obtained in both dimensions one and two. In particular, these yield that the mass of ground state is exactly the threshold of global well posedness and blow up of solutions in the stochastic focusing mass critical case. Similar results are also obtained for a class of nonlinear Schroedinger equations with lower order perturbations.


LaND Learning to Navigate from Disengagements. Consistently testing autonomous mobile robots in real world scenarios is a necessary aspect of developing autonomous navigation systems. Each time the human safety monitor disengages the robot's autonomy system due to the robot performing an undesirable maneuver, the autonomy developers gain insight into how to improve the autonomy system. However, we believe that these disengagements not only show where the system fails, which is useful for troubleshooting, but also provide a direct learning signal by which the robot can learn to navigate. We present a reinforcement learning approach for learning to navigate from disengagements, or LaND. LaND learns a neural network model that predicts which actions lead to disengagements given the current sensory observation, and then at test time plans and executes actions that avoid disengagements. Our results demonstrate LaND can successfully learn to navigate in diverse, real world sidewalk environments, outperforming both imitation learning and reinforcement learning approaches. Videos, code, and other material are available on our website https sites.google.com view sidewalk learning


Electrical voltage by electron spin vorticity coupling in laminar ducts. We report a linear scaling law for an electrical voltage as a function of the pressure drop in capillary pipes and ducts. This voltage is generated by a process which is termed spin hydrodynamic generation (SHDG), a result of the collective electron spin coupling to the vorticity field in the laminar flow in combination with an inverse spin Hall effect. We study this phenomenon in laminar duct flows with different width to height aspect ratios ranging from 1 (square ducts) to infinite (two dimensional channels). First, we analytically solve the governing Valet Fert spin diffusion equations for the SHDG by means of the method of small parameters together with proper boundary conditions for the set of inhomogeneous elliptic partial differential equations. Secondly, the proposed linear scaling law is validated through a series of experiments using capillary tubes with rectangular and square cross sections. The experimental results show a very good agreement to the analytically found scaling law. A subsequent substitution of the bulk velocity of the laminar wall bounded flows by the pressure drop reveals a universal scaling law for the electrical voltage that incorporates all pipe and duct geometries which we could study in our experiments. Finally, the efficiency of the system is estimated for circular pipes, rectangular and square ducts. This study shows that the efficiency of a spin hydrodynamic generator is the same for a circular pipe and a square duct with the same diameter and height, respectively. Hence, due to the ease of manufacturing and the possibility to scale the experiments up to parallel settings in a compact form, micro channels with a square cross section seem to be the optimum for a spin hydrodynamic generator.


Explorative gradient method for active drag reduction of the fluidic pinball and slanted Ahmed body. We address a challenge of active flow control the optimization of many actuation parameters guaranteeing fast convergence and avoiding suboptimal local minima. This challenge is addressed by a new optimizer, called explorative gradient method (EGM). EGM alternatively performs one exploitive downhill simplex step and an explorative Latin hypercube sampling iteration. Thus, the convergence rate of a gradient based method is guaranteed while, at the same time, better minima are explored. For an analytical multi modal test function, EGM is shown to significantly outperform the downhill simplex method, the random restart variant, Latin hypercube sampling, Monte Carlo iterations and the genetic algorithm. EGM is applied to minimize the net drag power of the two dimensional fluidic pinball benchmark with three cylinder rotations as actuation parameters. The net drag power is reduced by 40 employing direct numerical simulations at a Reynolds number of 100 based on the cylinder diameter. This optimal actuation leads to 98 drag reduction employing Coanda forcing for boat tailing and partial stabilization of vortex shedding. The price is an actuation energy corresponding to 58 of the unforced parasitic drag power. EGM is also used to minimize drag of the 35 circ slanted Ahmed body employing distributed steady blowing with 10 inputs. 17 drag reduction are achieved using Reynolds Averaged Navier Stokes simulations (RANS) at the Reynolds number Re H 1.9 times 10 5 based on the height of the Ahmed body. The optimal actuation emulates boat tailing by inward directed blowing with velocities which are comparable to the oncoming velocity. We expect that EGM will be employed as efficient optimizer in many future active flow control plants.


A modelling study of hydrodynamical and biogeochemical processes within the California Upwelling System. The ROMS modeling system was applied to the California Upwelling System (CalUS) to understand the key hydrodynamic conditions and dynamics of the nitrogen based ecosystem using the NPZD model proposed by Powell et al. (2006). A new type of sponge layer has been successfully implemented in the ROMS modelling system in order to stabilize the hydrodynamic part of the modeling system when using so called reduced boundary conditions. The hydrodynamic performance of the model was examined using a tidal analysis based on tidal measurement data, a comparison of the modeled sea surface temperature (SST) with buoy and satellite data, and vertical sections of the currents along the coast and the water temperature. This validation process shows that the hydrodynamic module used in this study can reproduce the basic hydrodynamic and circulation characteristics within the CalUS. The results of the ecosystem model show the characteristic features of upwelling regions as well as the well known spotty horizontal structures of the zooplankton community. The model thus provides a solid basis for the hydrodynamic and ecological characteristics of the CalUS and enables the ecological model to be expanded into a complex ecological model for investigating the effects of climate change on the ecological balance in the area investigated.


Bootstrapping Disjoint Datasets for Multilingual Multimodal Representation Learning. Recent work has highlighted the advantage of jointly learning grounded sentence representations from multiple languages. However, the data used in these studies has been limited to an aligned scenario the same images annotated with sentences in multiple languages. We focus on the more realistic disjoint scenario in which there is no overlap between the images in multilingual image caption datasets. We confirm that training with aligned data results in better grounded sentence representations than training with disjoint data, as measured by image sentence retrieval performance. In order to close this gap in performance, we propose a pseudopairing method to generate synthetically aligned English German image triplets from the disjoint sets. The method works by first training a model on the disjoint data, and then creating new triples across datasets using sentence similarity under the learned model. Experiments show that pseudopairs improve image sentence retrieval performance compared to disjoint training, despite requiring no external data or models. However, we do find that using an external machine translation model to generate the synthetic data sets results in better performance.


Topology of isoenergy surfaces of Kovalevskaya integrable case on the Lie algebra so(4). In the paper we determine the class of diffeomorphism of three dimensional regular common level surfaces of Hamiltonian and Casimir functions for the analog of Kovalevskaya case on Lie algebra textrm so (4) . We start from Fomenko Zieschang invariants of Lioville foliations on these manifolds that were calculated by the author earlier.


A computational study of preconditioning techniques for the stochastic diffusion equation with lognormal coefficient. We present a computational study of several preconditioning techniques for the GMRES algorithm applied to the stochastic diffusion equation with a lognormal coefficient discretized with the stochastic Galerkin method. The clear block structure of the system matrix arising from this type of discretization motivates the analysis of preconditioners designed according to a field splitting strategy of the stochastic variables. This approach is inspired by a similar procedure used within the framework of physics based preconditioners for deterministic problems, and its application to stochastic PDEs represents the main novelty of this work. Our numerical investigation highlights the superior properties of the field split type preconditioners over other existing strategies in terms of computational time and stochastic parameter dependence.


Motion Reasoning for Goal Based Imitation Learning. We address goal based imitation learning, where the aim is to output the symbolic goal from a third person video demonstration. This enables the robot to plan for execution and reproduce the same goal in a completely different environment. The key challenge is that the goal of a video demonstration is often ambiguous at the level of semantic actions. The human demonstrators might unintentionally achieve certain subgoals in the demonstrations with their actions. Our main contribution is to propose a motion reasoning framework that combines task and motion planning to disambiguate the true intention of the demonstrator in the video demonstration. This allows us to robustly recognize the goals that cannot be disambiguated by previous action based approaches. We evaluate our approach by collecting a dataset of 96 video demonstrations in a mockup kitchen environment. We show that our motion reasoning plays an important role in recognizing the actual goal of the demonstrator and improves the success rate by over 20 . We further show that by using the automatically inferred goal from the video demonstration, our robot is able to reproduce the same task in a real kitchen environment.


Time Continuous Energy Conservation Neural Network for Structural Dynamics Analysis. Fast and accurate structural dynamics analysis is important for structural design and damage assessment. Structural dynamics analysis leveraging machine learning techniques has become a popular research focus in recent years. Although the basic neural network provides an alternative approach for structural dynamics analysis, the lack of physics law inside the neural network limits the model accuracy and fidelity. In this paper, a new family of the energy conservation neural network is introduced, which respects the physical laws. The neural network is explored from a fundamental single degree of freedom system to a complicated multiple degrees of freedom system. The damping force and external forces are also considered step by step. To improve the parallelization of the algorithm, the derivatives of the structural states are parameterized with the novel energy conservation neural network instead of specifying the discrete sequence of structural states. The proposed model uses the system energy as the last layer of the neural network and leverages the underlying automatic differentiation graph to incorporate the system energy naturally, which ultimately improves the accuracy and long term stability of structures dynamics response calculation under an earthquake impact. The trade off between computation accuracy and speed is discussed. As a case study, a 3 story building earthquake simulation is conducted with realistic earthquake records.


Domain Specific Language to Encode Induction Heuristics. Proof assistants, such as Isabelle HOL, offer tools to facilitate inductive theorem proving. Isabelle experts know how to use these tools effectively however, they did not have a systematic way to encode their expertise. To address this problem, we present our domain specific language, LiFtEr. LiFtEr allows experienced Isabelle users to encode their induction heuristics in a style independent of any problem domain. LiFtEr's interpreter mechanically checks if a given application of induction tool matches the heuristics specified by experienced users, thus systematically transferring experienced users' expertise to new Isabelle users.


ZeroShotCeres Zero Shot Relation Extraction from Semi Structured Webpages. In many documents, such as semi structured webpages, textual semantics are augmented with additional information conveyed using visual elements including layout, font size, and color. Prior work on information extraction from semi structured websites has required learning an extraction model specific to a given template via either manually labeled or distantly supervised data from that template. In this work, we propose a solution for "zero shot" open domain relation extraction from webpages with a previously unseen template, including from websites with little overlap with existing sources of knowledge for distant supervision and websites in entirely new subject verticals. Our model uses a graph neural network based approach to build a rich representation of text fields on a webpage and the relationships between them, enabling generalization to new templates. Experiments show this approach provides a 31 F1 gain over a baseline for zero shot extraction in a new subject vertical.


The Effect of Downstream Classification Tasks for Evaluating Sentence Embeddings. One popular method for quantitatively evaluating the utility of sentence embeddings involves using them in downstream language processing tasks that require sentence representations as input. One simple such task is classification, where the sentence representations are used to train and test models on several classification datasets. We argue that by evaluating sentence representations in such a manner, the goal of the representations becomes learning a low dimensional factorization of a sentence task label matrix. We show how characteristics of this matrix can affect the ability for a low dimensional factorization to perform as sentence representations in a suite of classification tasks. Primarily, sentences that have more labels across all possible classification tasks have a higher reconstruction loss, however the general nature of this effect is ultimately dependent on the overall distribution of labels across all possible sentences.


Farley Sabalka's Morse theory model and the higher topological complexity of ordered configuration spaces on trees. Using the ordered analogue of Farley Sabalka's discrete gradient field on the configuration space of a graph, we unravel a levelwise behavior of the generators of the pure braid group on a tree. This allows us to generalize Farber's equivariant description of the homotopy type of the configuration space on a tree on two particles. The results are applied to the calculation of all the higher topological complexities of ordered configuration spaces on trees on any number of particles.


Comparison of Centralized and Decentralized Approaches in Cooperative Coverage Problems with Energy Constrained Agents. A multi agent coverage problem is considered with energy constrained agents. The objective of this paper is to compare the coverage performance between centralized and decentralized approaches. To this end, a near optimal centralized coverage control method is developed under energy depletion and repletion constraints. The optimal coverage formation corresponds to the locations of agents where the coverage performance is maximized. The optimal charging formation corresponds to the locations of agents with one agent fixed at the charging station and the remaining agents maximizing the coverage performance. We control the behavior of this cooperative multi agent system by switching between the optimal coverage formation and the optimal charging formation. Finally, the optimal dwell times at coverage locations, charging time, and agent trajectories are determined so as to maximize coverage over a given time interval. In particular, our controller guarantees that at any time there is at most one agent leaving the team for energy repletion.


A model for genuine equivariant commutative ring spectra away from the group order. We use geometric fixed points to describe the homotopy theory of genuine equivariant commutative ring spectra after inverting the group order. The main innovation is the use of the extra structure provided by the Hill Hopkins Ravenel norms in the form of additional norm maps on geometric fixed point diagrams, which turns out to be computationally managable.


Lucas' theorem modulo p 2 . Lucas' theorem describes how to reduce a binomial coefficient binom a b modulo p by breaking off the least significant digits of a and b in base p . We characterize the pairs of these digits for which Lucas' theorem holds modulo p 2 . This characterization is naturally expressed using symmetries of Pascal's triangle.


Channeling of electrons and positrons in straight and periodically bent diamond(110) crystals. In this paper we present the results of a systematic numerical analysis of the channeling properties of electrons and positrons in oriented straight and periodically bent diamond(110) crystals. We analyse dependence of the intensity of the radiation emitted on the projectile energy as well as on the bending amplitude. The analysis presented is based on the grounds of accurate numerical simulations of the channeling process. The simulation parameters, such as the crystal orientation, thickness and bending parameters of the crystals as well as the energy of the projectiles, were chosen to match those used in past and ongoing experiments. The peculiarities which appear in the radiation spectra are attributed to the interplay of various radiation mechanisms. The analysis performed can be used to predict and explain future experimental results.


Polarization Singularities in Light Scattering by Small Particles. Using full wave numerical simulations and analytical multipole expansions we investigated the properties of real space polarization singularities that emerge in light scattering by subwavelength particles. We considered spherical and torus particles made of dielectric or perfect electric conductor material. We determined the topological indices and the trajectories of electric field polarization singularities in both the near field and far field regions. In the far field region, a total of four singularities are identified and the sum of their polarization topological indices is two, independent of the particle's geometric shape. In the near field region, the polarization singularities strongly depend on the particle's shape and the polarization of incident light, and their index sum is not governed by the Poincar 'e Hopf theorem anymore due to the non transverse nature of the fields. From near field to far field, a flipping of sign can happen to the polarization topological indices of the C lines. The far field properties of the singularities can be well explained by the interference of the excited multipoles, but their near field properties can be strongly affected by the evanescent fields that are not captured by the multipole expansions. Our work uncovers the important relationship between particles' geometric properties and the polarization singularities of their scattering field. The results can be applied to manipulate polarization singularities in nanophotonic systems and could generate novel applications in optical sensing.


groups with the same number of centralizers. For any group G , let nacent(G) denote the set of all nonabelian centralizers of G . Amiri and Rostami in (Publ. Math. Debrecen 87 3 4 (2015), 429 437) put forward the following question Let H and G be finite simple groups. Is it true that if nacent(H) nacent(G) , then G is isomorphic to H ? In this paper, among other things, we give a negative answer to this question.


Language Inclusion for Finite Prime Event Structures. We study the problem of language inclusion between finite, labeled prime event structures. Prime event structures are a formalism to compactly represent concurrent behavior of discrete systems. A labeled prime event structure induces a language of sequences of labels produced by the represented system. We study the problem of deciding inclusion and membership for languages encoded by finite prime event structures and provide complexity results for both problems. We provide a family of examples where prime event structures are exponentially more succinct than formalisms that do not take concurrency into account. We provide a decision algorithm for language inclusion that exploits this succinctness. Furthermore, we provide an implementation of the algorithm and an evaluation on a series of benchmarks. Finally, we demonstrate how our results can be applied to mutation based test case generation.


PAG Net Progressive Attention Guided Depth Super resolution Network. In this paper, we propose a novel method for the challenging problem of guided depth map super resolution, called PAGNet. It is based on residual dense networks and involves the attention mechanism to suppress the texture copying problem arises due to improper guidance by RGB images. The attention module mainly involves providing the spatial attention to guidance image based on the depth features. We evaluate the proposed trained models on test dataset and provide comparisons with the state of the art depth super resolution methods.


Entropy, mutual information, and systematic measures of structured spiking neural networks. The aim of this paper is to investigate various information theoretic measures, including entropy, mutual information, and some systematic measures that based on mutual information, for a class of structured spiking neuronal network. In order to analyze and compute these information theoretic measures for large networks, we coarse grained the data by ignoring the order of spikes that fall into the same small time bin. The resultant coarse grained entropy mainly capture the information contained in the rhythm produced by a local population of the network. We first proved that these information theoretical measures are well defined and computable by proving the stochastic stability and the law of large numbers. Then we use three neuronal network examples, from simple to complex, to investigate these information theoretic measures. Several analytical and computational results about properties of these information theoretic measures are given.


A Novel Cascade Binary Tagging Framework for Relational Triple Extraction. Extracting relational triples from unstructured text is crucial for large scale knowledge graph construction. However, few existing works excel in solving the overlapping triple problem where multiple relational triples in the same sentence share the same entities. In this work, we introduce a fresh perspective to revisit the relational triple extraction task and propose a novel cascade binary tagging framework (CasRel) derived from a principled problem formulation. Instead of treating relations as discrete labels as in previous works, our new framework models relations as functions that map subjects to objects in a sentence, which naturally handles the overlapping problem. Experiments show that the CasRel framework already outperforms state of the art methods even when its encoder module uses a randomly initialized BERT encoder, showing the power of the new tagging framework. It enjoys further performance boost when employing a pre trained BERT encoder, outperforming the strongest baseline by 17.5 and 30.2 absolute gain in F1 score on two public datasets NYT and WebNLG, respectively. In depth analysis on different scenarios of overlapping triples shows that the method delivers consistent performance gain across all these scenarios. The source code and data are released online.


Counting of Grapevine Berries in Images via Semantic Segmentation using Convolutional Neural Networks. The extraction of phenotypic traits is often very time and labour intensive. Especially the investigation in viticulture is restricted to an on site analysis due to the perennial nature of grapevine. Traditionally skilled experts examine small samples and extrapolate the results to a whole plot. Thereby different grapevine varieties and training systems, e.g. vertical shoot positioning (VSP) and semi minimal pruned hedges (SMPH) pose different challenges. In this paper we present an objective framework based on automatic image analysis which works on two different training systems. The images are collected semi automatic by a camera system which is installed in a modified grape harvester. The system produces overlapping images from the sides of the plants. Our framework uses a convolutional neural network to detect single berries in images by performing a semantic segmentation. Each berry is then counted with a connected component algorithm. We compare our results with the Mask RCNN, a state of the art network for instance segmentation and with a regression approach for counting. The experiments presented in this paper show that we are able to detect green berries in images despite of different training systems. We achieve an accuracy for the berry detection of 94.0 in the VSP and 85.6 in the SMPH.


A Study of Cross Lingual Ability and Language specific Information in Multilingual BERT. Recently, multilingual BERT works remarkably well on cross lingual transfer tasks, superior to static non contextualized word embeddings. In this work, we provide an in depth experimental study to supplement the existing literature of cross lingual ability. We compare the cross lingual ability of non contextualized and contextualized representation model with the same data. We found that datasize and context window size are crucial factors to the transferability. We also observe the language specific information in multilingual BERT. By manipulating the latent representations, we can control the output languages of multilingual BERT, and achieve unsupervised token translation. We further show that based on the observation, there is a computationally cheap but effective approach to improve the cross lingual ability of multilingual BERT.


Hyberbolic Belyi maps and Shabat Blaschke products. We first introduce hyperbolic analogues of Belyi maps, Shabat polynomials and Grothendieck's dessins d'enfant. In particular we introduce and study the Shabat Blaschke products and the size of their hyperbolic dessin d'enfants in the unit disk. We then study a special class of Shabat Blaschke products, namely the Chebyshev Blaschke products. Inspired by the work of Ismail and Zhang (2007) on the coefficients of the Ramanujan's entire function, we will give similar arithmetic properties of the coefficients of the Chebyshev Blaschke products and then use them to prove some Landen type identities for theta functions.


Deep Learning Frameworks for Pavement Distress Classification A Comparative Analysis. Automatic detection and classification of pavement distresses is critical in timely maintaining and rehabilitating pavement surfaces. With the evolution of deep learning and high performance computing, the feasibility of vision based pavement defect assessments has significantly improved. In this study, the authors deploy state of the art deep learning algorithms based on different network backbones to detect and characterize pavement distresses. The influence of different backbone models such as CSPDarknet53, Hourglass 104 and EfficientNet were studied to evaluate their classification performance. The models were trained using 21,041 images captured across urban and rural streets of Japan, Czech Republic and India. Finally, the models were assessed based on their ability to predict and classify distresses, and tested using F1 score obtained from the statistical precision and recall values. The best performing model achieved an F1 score of 0.58 and 0.57 on two test datasets released by the IEEE Global Road Damage Detection Challenge. The source code including the trained models are made available at 1 .


Synthesis of Weighted Marked Graphs from Constrained Labelled Transition Systems A Geometric Approach. Recent studies investigated the problems of analysing Petri nets and synthesising them from labelled transition systems (LTS) with two labels (transitions) only. In this paper, we extend these works by providing new conditions for the synthesis of Weighted Marked Graphs (WMGs), a well known and useful class of weighted Petri nets in which each place has at most one input and one output. Some of these new conditions do not restrict the number of labels the other ones consider up to 3 labels. Additional constraints are investigated when the LTS is either finite or infinite, and either cyclic or acyclic. We show that one of these conditions, developed for 3 labels, does not extend to 4 nor to 5 labels. Also, we tackle geometrically the WMG solvability of finite, acyclic LTS with any number of labels.


A transcendental dynamical degree. We give an example of a dominant rational selfmap of the projective plane whose dynamical degree is a transcendental number.


Gauss maps of surfaces in 3 dimensional Heisenberg group. In this paper, we study the Gauss map of surfaces in 3 dimensional Heisenberg group using the Gans model of the hyperbolic plane. We establish a relationship between the tension field of the Gauss map and mean curvature of a surface in mathcal H 3 .


Analyzing Representations inside Convolutional Neural Networks. How can we discover and succinctly summarize the concepts that a neural network has learned? Such a task is of great importance in applications of networks in areas of inference that involve classification, like medical diagnosis based on fMRI x ray etc. In this work, we propose a framework to categorize the concepts a network learns based on the way it clusters a set of input examples, clusters neurons based on the examples they activate for, and input features all in the same latent space. This framework is unsupervised and can work without any labels for input features, it only needs access to internal activations of the network for each input example, thereby making it widely applicable. We extensively evaluate the proposed method and demonstrate that it produces human understandable and coherent concepts that a ResNet 18 has learned on the CIFAR 100 dataset.


Understanding Electricity Theft Behavior via Multi Source Data. Electricity theft, the behavior that involves users conducting illegal operations on electrical meters to avoid individual electricity bills, is a common phenomenon in the developing countries. Considering its harmfulness to both power grids and the public, several mechanized methods have been developed to automatically recognize electricity theft behaviors. However, these methods, which mainly assess users' electricity usage records, can be insufficient due to the diversity of theft tactics and the irregularity of user behaviors. In this paper, we propose to recognize electricity theft behavior via multi source data. In addition to users' electricity usage records, we analyze user behaviors by means of regional factors (non technical loss) and climatic factors (temperature) in the corresponding transformer area. By conducting analytical experiments, we unearth several interesting patterns for instance, electricity thieves are likely to consume much more electrical power than normal users, especially under extremely high or low temperatures. Motivated by these empirical observations, we further design a novel hierarchical framework for identifying electricity thieves. Experimental results based on a real world dataset demonstrate that our proposed model can achieve the best performance in electricity theft detection (e.g., at least 3.0 in terms of F0.5) compared with several baselines. Last but not least, our work has been applied by the State Grid of China and used to successfully catch electricity thieves in Hangzhou with a precision of 15 (an improvement form 0 attained by several other models the company employed) during monthly on site investigation.


FlashFlow A Secure Speed Test for Tor. The Tor network uses a measurement system to estimate its relays' forwarding capacity and to balance traffic among them. This system has been shown to be vulnerable to adversarial manipulation. Moreover, its accuracy and effectiveness in benign circumstances has never been fully quantified. We first obtain such a quantification by analyzing Tor metrics data and performing experiments on the live network. Our results show that Tor currently underestimates its true capacity by about 50 and improperly balances its traffic by 15 25 . Then, to solve the problems with security and accuracy, we present FlashFlow, a system to measure the capacity of Tor relays. Our analysis shows that FlashFlow limits a malicious relay to obtaining a capacity estimate at most 1.33 times its true capacity. Through realistic Internet experiments, we find that FlashFlow measures relay capacity with at least 89 accuracy 95 of the time. Through simulation, we find that FlashFlow can measure the entire Tor network in less than 5 hours using 3 measurers with 1 Gbit s of bandwidth each. Finally, simulations using FlashFlow for load balancing shows that, compared to TorFlow, network weight error decreases by 86 , while the median of 50 KiB, 1 MiB, and 5 MiB transfer times decreases by 15 , 29 , and 37 , respectively. Moreover, FlashFlow yields more consistent client performance the median rate of transfer timeouts decreases by 100 , while the standard deviation of 50 KiB, 1 MiB, and 5 MiB transfer times decreases by 55 , 61 , and 41 , respectively. We also find that the performance improvements increase relative to TorFlow as the total client traffic load increases, demonstrating that FlashFlow is better suited to supporting network growth.


Prescribing Gaussian curvature on surfaces with conical singularities and geodesic boundary. We study conformal metrics with prescribed Gaussian curvature on surfaces with conical singularities and geodesic boundary in supercritical regimes. Exploiting a variational argument, we derive a general existence result for surfaces with at least two boundary components. This seems to be the first result in this setting. Moreover, we allow to have conical singularities with both positive and negative orders, that is cone angles both less and grater than 2 pi .


SDN Enabled and OpenFlow Compatible Network Performance Monitoring System. Network performance monitoring holds a pivotal role in improving the overall network performance. It is essential to monitor the traffic statistics at Internet eXchange Points (IXPs) to optimize the traffic flows. The existing monitoring system either lacks usability or programmability. We present a Software Defined Networking (SDN) enabled and OpenFlow (OF) compatible network performance monitoring system (SDX Manager) to improve the usability or programmability of IXP simultaneously. The proposed system integrates traditional IXP Manager with the SDN controller and Grafana to better visualize the traffic. It provides a dashboard to the network administrator for defining rules over IXP, such as port blocking and traffic redirection. Furthermore, it facilitates the administrative tasks that include adding, modifying, and deleting the users and IXP objects (Ports, Switches). The proposed SDX Manager is deployed and tested in a virtual and physical environment using OF enabled Allied Telesis Switch. Results indicate that SDX Manager has improved network analysis using different statistics such as packets in out per second, bits in out per second, scrape duration, and query count.


A versatile combinatorial approach of studying products of long cycles in symmetric groups. In symmetric groups, studies of permutation factorizations or triples of permutations satisfying certain conditions have a long history. One particular interesting case is when two of the involved permutations are long cycles, for which many surprisingly simple formulas have been obtained. Here we combinatorially enumerate the pairs of long cycles whose product has a given cycle type and separates certain elements, extending several lines of studies, and we obtain general quantitative relations. As consequences, in a unified way, we recover a number of results expecting simple combinatorial proofs, including results of Boccara (1980), Zagier (1995), Stanley (2011), F ' e ray and Vassilieva (2012), as well as Hultman (2014). We obtain a number of new results as well. In particular, for the first time, given a partition of a set, we obtain an explicit formula for the number of pairs of long cycles on the set such that the product of the long cycles does not mix the elements from distinct blocks of the partition and has an independently prescribed number of cycles for each block of elements. As applications, we obtain new explicit formulas concerning factorizations of any even permutation into long cycles and the first nontrivial explicit formula for computing strong separation probabilities solving an open problem of Stanley (2010).


Distance Based Anomaly Detection for Industrial Surfaces Using Triplet Networks. Surface anomaly detection plays an important quality control role in many manufacturing industries to reduce scrap production. Machine based visual inspections have been utilized in recent years to conduct this task instead of human experts. In particular, deep learning Convolutional Neural Networks (CNNs) have been at the forefront of these image processing based solutions due to their predictive accuracy and efficiency. Training a CNN on a classification objective requires a sufficiently large amount of defective data, which is often not available. In this paper, we address that challenge by training the CNN on surface texture patches with a distance based anomaly detection objective instead. A deep residual based triplet network model is utilized, and defective training samples are synthesized exclusively from non defective samples via random erasing techniques to directly learn a similarity metric between the same class samples and out of class samples. Evaluation results demonstrate the approach's strength in detecting different types of anomalies, such as bent, broken, or cracked surfaces, for known surfaces that are part of the training data and unseen novel surfaces.


Migrant mobility flows characterized with digital data. Monitoring migration flows is crucial to respond to humanitarian crisis and to design efficient policies. This information usually comes from surveys and border controls, but timely accessibility and methodological concerns reduce its usefulness. Here, we propose a method to detect migration flows worldwide using geolocated Twitter data. We focus on the migration crisis in Venezuela and show that the calculated flows are consistent with official statistics at country level. Our method is versatile and far reaching, as it can be used to study different features of migration as preferred routes, settlement areas, mobility through several countries, spatial integration in cities, etc. It provides finer geographical and temporal resolutions, allowing the exploration of issues not contemplated in official records. It is our hope that these new sources of information can complement official ones, helping authorities and humanitarian organizations to better assess when and where to intervene on the ground.


Conditions on the regularity of balanced c partite tournaments for the existence of strong subtournaments with high minimum degree. We consider the following problem posed by Volkmann in 2007 How close to regular must a c partite tournament be, to secure a strongly connected subtournament of order c ? We give sufficient conditions on the regularity of balanced c partite tournaments to assure the existence of strong maximal subtournament with minimum degree at least left lfloor frac c 2 4 right rfloor 1 . We obtain this result as an application of counting the number of subtournaments of order c for which a vertex has minimum out degree (resp. in degree) at most q geq 0 .


An Integrated Approach for Improving Brand Consistency of Web Content Modeling, Analysis and Recommendation. A consumer dependent (business to consumer) organization tends to present itself as possessing a set of human qualities, which is termed as the brand personality of the company. The perception is impressed upon the consumer through the content, be it in the form of advertisement, blogs or magazines, produced by the organization. A consistent brand will generate trust and retain customers over time as they develop an affinity towards regularity and common patterns. However, maintaining a consistent messaging tone for a brand has become more challenging with the virtual explosion in the amount of content which needs to be authored and pushed to the Internet to maintain an edge in the era of digital marketing. To understand the depth of the problem, we collect around 300K web page content from around 650 companies. We develop trait specific classification models by considering the linguistic features of the content. The classifier automatically identifies the web articles which are not consistent with the mission and vision of a company and further helps us to discover the conditions under which the consistency cannot be maintained. To address the brand inconsistency issue, we then develop a sentence ranking system that outputs the top three sentences that need to be changed for making a web article more consistent with the company's brand personality.


ReconViguRation Reconfiguring Physical Keyboards in Virtual Reality. Physical keyboards are common peripherals for personal computers and are efficient standard text entry devices. Recent research has investigated how physical keyboards can be used in immersive head mounted display based Virtual Reality (VR). So far, the physical layout of keyboards has typically been transplanted into VR for replicating typing experiences in a standard desktop environment. In this paper, we explore how to fully leverage the immersiveness of VR to change the input and output characteristics of physical keyboard interaction within a VR environment. This allows individual physical keys to be reconfigured to the same or different actions and visual output to be distributed in various ways across the VR representation of the keyboard. We explore a set of input and output mappings for reconfiguring the virtual presentation of physical keyboards and probe the resulting design space by specifically designing, implementing and evaluating nine VR relevant applications emojis, languages and special characters, application shortcuts, virtual text processing macros, a window manager, a photo browser, a whack a mole game, secure password entry and a virtual touch bar. We investigate the feasibility of the applications in a user study with 20 participants and find that, among other things, they are usable in VR. We discuss the limitations and possibilities of remapping the input and output characteristics of physical keyboards in VR based on empirical findings and analysis and suggest future research directions in this area.


Patient Knowledge Distillation for BERT Model Compression. Pre trained language models such as BERT have proven to be highly effective for natural language processing (NLP) tasks. However, the high demand for computing resources in training such models hinders their application in practice. In order to alleviate this resource hunger in large scale model training, we propose a Patient Knowledge Distillation approach to compress an original large model (teacher) into an equally effective lightweight shallow network (student). Different from previous knowledge distillation methods, which only use the output from the last layer of the teacher network for distillation, our student model patiently learns from multiple intermediate layers of the teacher model for incremental knowledge extraction, following two strategies ( i ) PKD Last learning from the last k layers and ( ii ) PKD Skip learning from every k layers. These two patient distillation schemes enable the exploitation of rich information in the teacher's hidden layers, and encourage the student model to patiently learn from and imitate the teacher through a multi layer distillation process. Empirically, this translates into improved results on multiple NLP tasks with significant gain in training efficiency, without sacrificing model accuracy.


Optimal Tracking Portfolio with A Ratcheting Capital Benchmark. This paper studies the finite horizon portfolio management by optimally tracking a ratcheting capital benchmark process. It is assumed that the fund manager can dynamically inject capital into the portfolio account such that the total capital dominates a non decreasing benchmark floor process at each intermediate time. The tracking problem is formulated to minimize the cost of accumulated capital injection. We first transform the original problem with floor constraints into an unconstrained control problem, however, under a running maximum cost. By identifying a controlled state process with reflection, the problem is further shown to be equivalent to an auxiliary problem, which leads to a nonlinear Hamilton Jacobi Bellman (HJB) equation with a Neumann boundary condition. By employing the dual transform, the probabilistic representation and some stochastic flow analysis, the existence of the unique classical solution to the HJB equation is established. The verification theorem is carefully proved, which gives the complete characterization of the feedback optimal portfolio. The application to market index tracking is also discussed when the index process is modeled by a geometric Brownian motion.


Broadcast Age of Information in CSMA CA Based Wireless Networks. We consider a wireless sensor network in which all the nodes wish to spread their updates over the network using CSMA CA protocol. We investigate the age of information of the spreading process from a transmitter perspective, which is referred to as the textit broadcast age of information (BAoI) . To be specific, BAoI is the age of the latest update successfully broadcasted to the one hop neighbors of a node, and thus is suitable to measure the rapidity of the update spreading process. We establish an equivalent transmission model of the network by deriving the transmission probability and the collision probability of nodes. With this equivalent model, we then present the average BAoI of the network explicitly. Our results present the scaling laws of average BAoI with respect to node density and frame length, and are further illustrated through numerical results. As is shown, the average BAoI is increasing with node density and is convex in frame length, i.e., would be large when frame length is very small or very large.


Weakly supervised Caricature Face Parsing through Domain Adaptation. A caricature is an artistic form of a person's picture in which certain striking characteristics are abstracted or exaggerated in order to create a humor or sarcasm effect. For numerous caricature related applications such as attribute recognition and caricature editing, face parsing is an essential pre processing step that provides a complete facial structure understanding. However, current state of the art face parsing methods require large amounts of labeled data on the pixel level and such process for caricature is tedious and labor intensive. For real photos, there are numerous labeled datasets for face parsing. Thus, we formulate caricature face parsing as a domain adaptation problem, where real photos play the role of the source domain, adapting to the target caricatures. Specifically, we first leverage a spatial transformer based network to enable shape domain shifts. A feed forward style transfer network is then utilized to capture texture level domain gaps. With these two steps, we synthesize face caricatures from real photos, and thus we can use parsing ground truths of the original photos to learn the parsing model. Experimental results on the synthetic and real caricatures demonstrate the effectiveness of the proposed domain adaptation algorithm. Code is available at https github.com ZJULearning CariFaceParsing .


Improved Baselines with Momentum Contrastive Learning. Contrastive unsupervised learning has recently shown encouraging progress, e.g., in Momentum Contrast (MoCo) and SimCLR. In this note, we verify the effectiveness of two of SimCLR's design improvements by implementing them in the MoCo framework. With simple modifications to MoCo namely, using an MLP projection head and more data augmentation we establish stronger baselines that outperform SimCLR and do not require large training batches. We hope this will make state of the art unsupervised learning research more accessible. Code will be made public.


The Monodromy problem for hyperelliptic curves. We study the Dynkin diagram associated to the monodromy of direct sums of polynomials. The monodromy problem asks under which conditions on a polynomial, the monodromy of a vanishing cycle generates the whole homology of a regular fiber. We consider the case y 4 g(x) , which is a generalization of the results of Christopher and Marde check s i 'c about the monodromy problem for hyperelliptic curves. Moreover, We solve the monodromy problem for direct sums of fourth degree polynomials.


A Quaternion based Certifiably Optimal Solution to the Wahba Problem with Outliers. The Wahba problem, also known as rotation search, seeks to find the best rotation to align two sets of vector observations given putative correspondences, and is a fundamental routine in many computer vision and robotics applications. This work proposes the first polynomial time certifiably optimal approach for solving the Wahba problem when a large number of vector observations are outliers. Our first contribution is to formulate the Wahba problem using a Truncated Least Squares (TLS) cost that is insensitive to a large fraction of spurious correspondences. The second contribution is to rewrite the problem using unit quaternions and show that the TLS cost can be framed as a Quadratically Constrained Quadratic Program (QCQP). Since the resulting optimization is still highly non convex and hard to solve globally, our third contribution is to develop a convex Semidefinite Programming (SDP) relaxation. We show that while a naive relaxation performs poorly in general, our relaxation is tight even in the presence of large noise and outliers. We validate the proposed algorithm, named QUASAR (QUAternion based Semidefinite relAxation for Robust alignment), in both synthetic and real datasets showing that the algorithm outperforms RANSAC, robust local optimization techniques, global outlier removal procedures, and Branch and Bound methods. QUASAR is able to compute certifiably optimal solutions (i.e. the relaxation is exact) even in the case when 95 of the correspondences are outliers.


Some new series for 1 pi motivated by congruences. In this paper, we deduce a family of six new series for 1 pi for example, sum n 0 infty frac 41673840n 4777111 5780 n W n left( frac 1444 1445 right) frac 147758475 sqrt 95 , pi where W n(x) sum k 0 n binom nk binom n k k binom 2k k binom 2(n k) n k x k . To do so, we transform our series to series of the type sum n 0 infty frac an b m n sum k 0 n binom nk 4 studied by Cooper in 2012. In addition, we pose 19 new series for 1 pi motivated by congruences for example, we conjecture that sum k 0 infty frac 4290k 367 3136 k binom 2k kT k(14,1)T k(17,16) frac 5390 pi , where T k(b,c) is the coefficient of x k in the expansion of (x 2 bx c) k .


Weak greedy algorithms and the equivalence between semi greedy and almost greedy Markushevich bases. We introduce and study the notion of weak semi greedy systems which is inspired in the concepts of semi greedy and Branch semi greedy systems and weak thresholding sets , and prove that in the context Markushevich bases in infinite dimensional Banach spaces, the notions of textit semi greedy, branch semi greedy, weak semi greedy, and almost greedy Markushevich bases are all equivalent. This completes and extends some results from cite Berna2019 , cite Dilworth2003b , and cite Dilworth2012 . We also exhibit an example of a semi greedy system that is neither almost greedy nor a Markushevich basis, showing that the Markushevich condition cannot be dropped from the equivalence result. In some cases, we obtain improved upper bounds for the corresponding constants of the systems.


On the exponential stability of a stratified flow to the 2D IDEAL MHD equations with damping. We study the stability of a type of stratified flows of the two dimensional inviscid incompressible MHD equations with velocity damping. The exponential stability for the perturbation near certain stratified flow is investigated in a strip type area R 0,1 . Although the magnetic filed potential is governed by a transport equation, by using the algebraic structure of the incompressible condition, it turns out that the linearized MHD equations around the given stratified flow retain a non local damping mechanism. After carefully analyzing the non linear structure and introducing some suitable weighted energy norms, we get the exponential stability by combining the exponential decay in time in the lower order energy with that in the high order energy.


Completions of affine spaces into Mori fiber spaces with non rational fibers. We describe a method to construct completions of affine spaces into total spaces of mathbb Q factorial terminal Mori fiber spaces over the projective line. As an application we provide families of examples with non rational, birationally rigid and non stably rational general fibers.


Signature Restriction for Polymorphic Algebraic Effects. The naive combination of polymorphic effects and polymorphic type assignment has been well known to break type safety. Existing approaches to this problem are classified into two groups one for restricting how effects are triggered and the other for restricting how they are implemented. This work explores a new approach to ensuring the safety of polymorphic effects in polymorphic type assignment. A novelty of our work lies in finding a restriction on effect interfaces. To formalize our idea, we employ algebraic effects and handlers, where an effect interface is given by a set of operations coupled with type signatures. We propose signature restriction, a new notion to restrict the type signatures of operations, and show that signature restriction is sufficient to ensure type safety of an effectful language equipped with unrestricted polymorphic type assignment. We also develop a type and effect system to enable the use of both operations that satisfy and do not satisfy the signature restriction in a single program.


Context Aware Graph Convolution Network for Target Re identification. Most existing re identification methods focus on learning robust and discriminative features with deep convolution networks. However, many of them consider content similarity separately and fail to utilize the context information of the query and gallery sets, e.g. probe gallery and gallery gallery relations, thus hard samples may not be well solved due to the limited or even misleading information. In this paper, we present a novel Context Aware Graph Convolution Network (CAGCN), where the probe gallery relations are encoded into the graph nodes and the graph edge connections are well controlled by the gallery gallery relations. In this way, hard samples can be addressed with the context information flows among other easy samples during the graph reasoning. Specifically, we adopt an effective hard gallery sampler to obtain high recall for positive samples while keeping a reasonable graph size, which can also weaken the imbalanced problem in training process with low computation complexity.Experiments show that the proposed method achieves state of the art performance on both person and vehicle re identification datasets in a plug and play fashion with limited overhead.


On algebraic integers which are 2 Salem elements in positive characteristic. Bateman and Duquette have initiated the study of Salem elements in positive characteristic. This work extends their results to 2 Salem elements whose minimal polynomials are of the type Y n lambda n 1 Y n 1 ldots lambda 1Y lambda 0 in mathbb F q X Y where n geq2, lambda 0 neq 0 and deg lambda n 1 deg lambda n 2 max i neq n 2 deg( lambda i) . This work provides an analogue of their results for 2 Salem elements whose minimal polynomials meet certain requirements.


Intransitive dice tournament is not quasirandom. We settle a version of the conjecture about intransitive dice posed by Conrey, Gabbard, Grant, Liu and Morrison in 2016 and Polymath in 2017. We consider generalized dice with n faces and we say that a die A beats B if a random face of A is more likely to show a higher number than a random face of B . We study random dice with faces drawn iid from the uniform distribution on 0,1 and conditioned on the sum of the faces equal to n 2 . Considering the "beats" relation for three such random dice, Polymath showed that each of eight possible tournaments between them is asymptotically equally likely. In particular, three dice form an intransitive cycle with probability converging to 1 4 . In this paper we prove that for four random dice not all tournaments are equally likely and the probability of a transitive tournament is strictly higher than 3 8 .


Mining Public Transit Ridership Flow and Origin Destination Information from Wi Fi and Bluetooth Sensing Data. Transit ridership flow and origin destination (O D) information is essential for enhancing transit network design, optimizing transit route and improving service. The effectiveness and preciseness of the traditional survey based and smart card data driven method for O D information inference have multiple disadvantages due to the insufficient sample, the high time and energy cost, and the lack of inferring results validation. By considering the ubiquity of smart mobile devices in the world, several methods were developed for estimating the transit ridership flow from Wi Fi and Bluetooth sensing data by filtering out the non passenger MAC addresses based on the predefined thresholds. However, the accuracy of the filtering methods is still questionable for the indeterminate threshold values and the lack of quantitative results validation. By combining the consideration of the assumed overlapped feature space of passenger and non passenger with the above concerns, a three steps data driven method for estimating transit ridership flow and O D information from Wi Fi and Bluetooth sensing data is proposed in this paper. The observed ridership flow is used as ground truth for calculating the performance measurements. According to the results, the proposed approach outperformed all selected baseline models and existing filtering methods. The findings of this study can help to provide real time and precise transit ridership flow and O D information for supporting transit vehicle management and the quality of service enhancement.


Balancing Fiscal and Mortality Impact of SARS CoV 2 Mitigation Measurements. An epidemic carries human and fiscal costs. In the case of imported pandemics, the first best solution is to restrict national borders to identify and isolate infected individuals. However, when that opportunity is not fully seized and there is no preventative intervention available, second best options must be chosen. In this article we develop a system of differential equations that simulate both the fiscal and human costs associated to different mitigation measurements. After simulating several scenarios, we conclude that herd immunity (or unleashing the pandemic) is the worst policy in terms of both human and fiscal cost. We found that the second best policy would be a strict policy (e.g. physical distancing with massive testing) established under the first 20 days after the pandemic, that lowers the probability of infection by 80 . In the case of the US, this strict policy would save more than 239 thousands lives and almost 170.8 billion to taxpayers when compared to the herd immunity case.


A process algebra with global variables. In standard process algebra, parallel components do not share a common state and communicate through synchronisation. The advantage of this type of communication is that it facilitates compositional reasoning. For modelling and analysing systems in which parallel components operate on shared memory, however, the communication through synchronisation paradigm is sometimes less convenient. In this paper we study a process algebra with a notion of global variable. We also propose an extension of Hennessy Milner logic with predicates to test and set the values of the global variables, and prove correspondence results between validity of formulas in the extended logic and stateless bisimilarity and between validity of formulas in the extended logic without the set operator and state based bisimilarity. We shall also present a translation from the process algebra with global variables to a fragment of mCRL2 that preserves the validity of formulas in the extended Hennessy Milner logic.


Limit theorems for excursion sets of subordinated Gaussian random fields with long range dependence. This paper considers the asymptotic behaviour of volumes of excursion sets of subordinated Gaussian random fields with (possibly) infinite variance. Actually, we consider integral functionals of such fields and obtain their limiting distribution using the Hermite expansion of the integrand. We consider the general non stationary Gaussian random fields, including stationary and anisotropic special cases. The limiting random variables in our limit theorems have the form of multiple Wiener It o integrals. We illustrate most results with corresponding examples.


Weak compactness criteria in L 1 space in terms of Orlicz function. In this paper, we provide a direct proof for the equivalence of K.M. Chong's and De la Vall ' e e Poussin's criteria of weak compactness of a subset K of L 1(0,1) in terms of some Orlicz function. Furthermore, we discuss the equivalence in L 1(0, infty) .


Sampling an Edge Uniformly in Sublinear Time. The area of sublinear algorithms have recently received a lot of attention. In this setting, one has to choose specific access model for the input, as the algorithm does not have time to pre process or even to see the whole input. A fundamental question remained open on the relationship between the two common models for graphs with and without access to the "random edge" query namely whether it is possible to sample an edge uniformly at random in the model without access to the random edge queries. In this paper, we answer this question positively. Specifically, we give an algorithm solving this problem that runs in expected time O( frac n sqrt m log n) . This is only a logarithmic factor slower than the lower bound given in 5 . Our algorithm uses the algorithm from 7 which we analyze in a more careful way, leading to better bounds in general graphs. We also show a way to sample edges epsilon close to uniform in expected time O( frac n sqrt m log frac 1 epsilon ) , improving upon the best previously known algorithm. We also note that sampling edges from a distribution sufficiently close to uniform is sufficient to be able to simulate sublinear algorithms that use the random edge queries while decreasing the success probability of the algorithm only by o(1) . This allows for a much simpler algorithm that can be used to emulate random edge queries.


Model Compression Using Optimal Transport. Model compression methods are important to allow for easier deployment of deep learning models in compute, memory and energy constrained environments such as mobile phones. Knowledge distillation is a class of model compression algorithm where knowledge from a large teacher network is transferred to a smaller student network thereby improving the student's performance. In this paper, we show how optimal transport based loss functions can be used for training a student network which encourages learning student network parameters that help bring the distribution of student features closer to that of the teacher features. We present image classification results on CIFAR 100, SVHN and ImageNet and show that the proposed optimal transport loss functions perform comparably to or better than other loss functions.


Approximation by periodic multivariate quasi projection operators. Approximation properties of periodic quasi projection operators with matrix dilations are studied. Such operators are generated by a sequence of functions varphi j and a sequence of distributions functions widetilde varphi j . Error estimates for sampling type quasi projection operators are obtained under the periodic Strang Fix conditions for varphi j and the compatibility conditions for varphi j and widetilde varphi j . These estimates are given in terms of the Fourier coefficients of approximated functions and provide analogs of some known non periodic results. Under some additional assumptions error estimates are given in other terms in particular using the best approximation. A number of examples are provided.


Covering of a rectangle by squares. We prove that one can cover the 1 times b rectangle by equal squares on both sides in one layer iff b p pm sqrt p 2 r 2 , where p ge r ge 0 and p,q in mathbb Q .


Stop Tracking Me Bro! Differential Tracking Of User Demographics On Hyper partisan Websites. Websites with hyper partisan, left or right leaning focus offer content that is typically biased towards the expectations of their target audience. Such content often polarizes users, who are repeatedly primed to specific (extreme) content, usually reflecting hard party lines on political and socio economic topics. Though this polarization has been extensively studied with respect to content, it is still unknown how it associates with the online tracking experienced by browsing users, especially when they exhibit certain demographic characteristics. For example, it is unclear how such websites enable the ad ecosystem to track users based on their gender or age. In this paper, we take a first step to shed light and measure such potential differences in tracking imposed on users when visiting specific party line's websites. For this, we design and deploy a methodology to systematically probe such websites and measure differences in user tracking. This methodology allows us to create user personas with specific attributes like gender and age and automate their browsing behavior in a consistent and repeatable manner. Thus, we systematically study how personas are being tracked by these websites and their third parties, especially if they exhibit particular demographic properties. Overall, we test 9 personas on 556 hyper partisan websites and find that right leaning websites tend to track users more intensely than left leaning, depending on user demographics, using both cookies and cookie synchronization methods and leading to more costly delivered ads.


A note on Lusin type approximation of Sobolev functions on Gaussian spaces. We establish new approximation results in the sense of Lusin for Sobolev functions f with nabla f in L log L on infinite dimensional spaces equipped with Gaussian measures. The proof relies on some new pointwise estimate for the approximations based on the corresponding semigroup which can be of independent interest.


Virtually special non finitely presented groups via linear characters. We present a new method for showing that groups are virtually special. This is done by considering finite quotients and linear characters. We use this to show that an infinite family of groups, related to Bestvina Brady groups and branching, provides new examples of virtually special groups outside of a hyperbolic context.


Decision making via generalized Bajraktarevi 'c means. We define decision making functions which arise from studying the multidimensional generalization of the weighted Bajraktarevi 'c means. It allows a nonlinear approach to optimization problems. These functions admit several interesting (from the point of view of decision making) properties, for example, delegativity (which states that each subgroup of decision makers can aggregate their decisions and efforts), casuativity (each decision affects the final outcome except two trivial cases) and convexity type properties. Beyond establishing the most important properties of such means, we solve their equality problem, we introduce a notion of synergy and characterize the null synergy decision making functions of this type.


Dissipative instability of shock waves. A new condition for the linear dissipative instability of the strong plane shock wave in an arbitrary medium is obtained. The instability of the shock is realized due to the flow instability behind its front, which is similar to the known dissipative instability in the boundary layer for the Tollmien Schlichting waves. It is found that within the limit of low viscosity the one dimensional longitudinal disturbances grow much faster than the two dimensional corrugation ones. It points to a better correspondence to experiment of the new condition for the absolute instability of the shock in comparison with theory, which does not take viscosity into account.


On uniform Mazur intersection property. In this paper, we show that a Banach space X has the Uniform Mazur Intersection Property (UMIP) if and only if every f in S(X ) is uniformly w semidenting point of B(X ) . We also prove analogous results for uniform w MIP.


Supertrees. A k universal permutation, or k superpermutation, is a permutation that contains all permutations of length k as patterns. The problem of finding the minimum length of a k superpermutation has recently received significant attention in the field of permutation patterns. One can ask analogous questions for other classes of objects. In this paper, we study k supertrees. For each d geq 2 , we focus on two types of rooted plane trees called d ary plane trees and d trees. Motivated by recent developments in the literature, we consider "contiguous" and "noncontiguous" notions of pattern containment for each type of tree. We obtain both upper and lower bounds on the minimum possible size of a k supertree in three cases in the fourth, we determine the minimum size exactly. One of our lower bounds makes use of a recent result of Albert, Engen, Pantone, and Vatter on k universal layered permutations.


Residue formula for an obstruction to Coupled K "ahler Einstein metrics. We obtain a residue formula for an obstruction to the existence of coupled K "ahler Einstein metrics described by Futaki Zhang. We apply it to an example studied separately by Futaki and Hultgren which is a toric Fano manifold with reductive automorphism, does not admit a K "ahler Einstein metric but still admits coupled K "ahler Einstein metrics.