Autonomous Envelopes and Conservativity. We prove 2 categorical conservativity for any 0,T free fragment of MALL over its corresponding intuitionistic version that is, that the universal map from a closed symmetric monoidal category to the autonomous category that it freely generates is fully faithful, and similarly for other doctrines. This implies that linear logics and graphical calculi for autonomous categories can also be interpreted canonically in closed symmetric monoidal categories. In particular, every closed symmetric monoidal category can be fully embedded in a autonomous category, preserving both tensor products and internal homs. In fact, we prove this directly first with a Yoneda style embedding (an enhanced "Hyland envelope" that can be regarded as a polycategorical form of Day convolution), and deduce 2 conservativity afterwards from Hyland Schalk double gluing and a technique of Lafont. The same is true for other fragments of autonomous structure, such as linear distributivity, and the embedding can be enhanced to preserve any desired family of nonempty limits and colimits.


1st Place Solution to Google Landmark Retrieval 2020. This paper presents the 1st place solution to the Google Landmark Retrieval 2020 Competition on Kaggle. The solution is based on metric learning to classify numerous landmark classes, and uses transfer learning with two train datasets, fine tuning on bigger images, adjusting loss weight for cleaner samples, and esemble to enhance the model's performance further. Finally, it scored 0.38677 mAP 100 on the private leaderboard.


A dual approach to Burkholder's L p estimates. The paper contains an alternative proof of the celebrated L p estimates for differentially subordinate martingales established by Burkholder and Wang in the eighties and nineties. The approach links the validity of the estimate to the existence of a lower solution to a novel boundary value problem.


Optimal placement of inertia and primary control a matrix perturbation theory approach. The increasing penetration of inertialess new renewable energy sources reduces the overall mechanical inertia available in power grids and accordingly raises a number of issues of grid stability over short to medium time scales. It has been suggested that this reduction of overall inertia can be compensated to some extent by the deployment of substitution inertia synthetic inertia, flywheels or synchronous condensers. Of particular importance is to optimize the placement of the limited available substitution inertia, to mitigate voltage angle and frequency disturbances following a fault such as an abrupt power loss. Performance measures in the form of H2 norms have been recently introduced to evaluate the overall magnitude of such disturbances on an electric power grid. However, despite the mathematical conveniance of these measures, analytical results can be obtained only under rather restrictive assumptions of uniform damping ratio, or homogeneous distribution of inertia and or primary control in the system. Here, we introduce matrix perturbation theory to obtain analytical results for optimal inertia and primary control placement where both are heterogeneous. Armed with that efficient tool, we construct two simple algorithms that independently determine the optimal geographical distribution of inertia and primary control. These algorithms are then implemented on a model of the synchronous transmission grid of continental Europe. We find that the optimal distribution of inertia is geographically homogeneous but that primary control should be mainly located on the slow modes of the network, where the intrinsic grid dynamics takes more time to damp frequency disturbances.


Modelling of a spherical deflagration at constant speed. We build in this paper a numerical solution procedure to compute the flow induced by a spherical flame expanding from a point source at a constant expansion velocity, with an instantaneous chemical reaction. The solution is supposed to be self similar and the flow is split in three zones an inner zone composed of burnt gases at rest, an intermediate zone where the solution is regular and the initial atmosphere composed of fresh gases at rest. The intermediate zone is bounded by the reactive shock (inner side) and the so called precursor shock (outer side), for which Rankine Hugoniot conditions are written the solution in this zone is governed by two ordinary differential equations which are solved numerically. We show that, for any admissible precursor shock speed, the construction combining this numerical resolution with the exploitation of jump conditions is unique, and yields decreasing pressure, density and velocity profiles in the intermediate zone. In addition, the reactive shock speed is larger than the velocity on the outer side of the shock, which is consistent with the fact that the difference of these two quantities is the so called flame velocity, i.e. the (relative) velocity at which the chemical reaction progresses in the fresh gases. Finally, we also observe numerically that the function giving the flame velocity as a function of the precursor shock speed is increasing this allows to embed the resolution in a Newton like procedure to compute the flow for a given flame speed (instead of for a given precursor shock speed). The resulting numerical algorithm is applied to stoichiometric hydrogen air mixtures. Key words. spherical flames, reactive Euler equations, Riemann problems burnt zone (constant state) intermediate zone (regular solution) unburnt zone (constant initial state) W b W 2 W 1 W 0 reactive shock, r sigma r t. precursor shock, r sigma p t. W ( rho , u, p) local fluid state. Fig. 1.1. Structure of the solution. 1. Problem position. We address the flame propagation in a reactive infinite atmosphere of initial constant composition. The ignition is supposed to occur at a single point (chosen to be the origin of R 3) and the flow is supposed to satisfy a spherical symmetry property the density rho , the pressure p, the internal energy e and the entropy s only depend on the distance r to the origin and the velocity reads u ur r, where r stands for the position vector. The flame is supposed to be infinitely thin and to move at a constant speed. The flow is governed by the Euler equations, and we seek a solution with the following structure


Local and nonlocal optimal control in the source. The analysis of an optimal control problem of nonlocal type is analyzed. The results obtained are applied to the study the corresponding local optimal control problems. The state equations are governed by p laplacian elliptic operators, of local and nonlocal type, and the costs belong to a wide class of integral functionals. The nonlocal problem is formulated by means of a convolution of the states with a kernel. This kernel depends on a parameter, called horizon which, is responsible for the nonlocality of the equation. The input function is the source of the elliptic equation. Existence of nonlocal controls is obtained and a G convergence result is employed in this task. The limit of the solutions of the nonlocal optimal control, when the horizon tends to zero, is analyzed and compared to the solution of the underlying local optimal control problem.


hlslib Software Engineering for Hardware Design. High level synthesis (HLS) tools have brought FPGA development into the mainstream, by allowing programmers to design architectures using familiar languages such as C, C , and OpenCL. While the move to these languages has brought significant benefits, many aspects of traditional software engineering are still unsupported, or not exploited by developers in practice. Furthermore, designing reconfigurable architectures requires support for hardware constructs, such as FIFOs and shift registers, that are not native to CPU oriented languages. To address this gap, we have developed hlslib, a collection of software tools, plug in hardware modules, and code samples, designed to enhance the productivity of HLS developers. The goal of hlslib is two fold first, create a community driven arena of bleeding edge development, which can move quicker, and provides more powerful abstractions than what is provided by vendors and second, collect a wide range of example codes, both minimal proofs of concept, and larger, real world applications, that can be reused directly or inspire other work. hlslib is offered as an open source library, containing CMake files, C headers, convenience scripts, and examples codes, and is receptive to any contribution that can benefit HLS developers, through general functionality or examples.


A Distortion Matrix Framework for High Resolution Passive Seismic 3 D Imaging Application to the San Jacinto Fault Zone, California. Reflection seismic imaging usually suffers from a loss of resolution and contrast because of the fluctuations of the wave velocities in the Earth's crust. In the literature, phase distortion issues are generally circumvented by means of a background wave velocity model. However, it requires a prior tomography of the wave velocity distribution in the medium, which is often not possible, especially in depth. In this paper, a matrix approach of seismic imaging is developed to retrieve a three dimensional image of the subsoil, despite a rough knowledge of the background wave velocity. To do so, passive noise cross correlations between geophones of a seismic array are investigated under a matrix formalism. More precisely, the detrimental effect of wave velocity fluctuations on imaging is overcome by introducing a novel mathematical object The distortion matrix. This operator essentially connects any virtual source inside the medium with the distortion that a wavefront, emitted from that point, experiences due to heterogeneities. A time reversal analysis of the distortion matrix enables the estimation of the transmission matrix that links each real geophone at the surface and each virtual geophone in depth. Phase distortions can then be compensated for any point of the underground. Applied to seismic data recorded along the Clark branch of the San Jacinto fault zone, the present method is shown to provide an image of the fault until a depth of 4 km with a transverse resolution of 80 m. Strikingly, this resolution is almost one eighth below the diffraction limit imposed by the geophone array aperture. The heterogeneities of the subsoil play the role of a scattering lens and of a transverse wave guide which increase drastically the array aperture.


Extrinsic curvature flows and applications. These notes arose from a mini lecture series the author gave at the Early Career Researchers Workshop on Geometric Analysis and PDEs, held in January 2020 at the Matrix institute of the University of Melbourne. We discussed some classical aspects of expanding curvature flows and obtained first applications. In these notes we will give a detailed account on what was covered during the lectures.


Existence and Uniqueness of viscosity solutions of Value function of Local Cahn Hilliard Navier Stokes system. In this work, we consider the local Cahn Hilliard Navier Stokes equation with regular potential in two dimensional bounded domain. We formulate distributed optimal control problem as the minimization of a suitable cost functional subject to the controlled local Cahn Hilliard Navier Stokes system and define the associated value function. We prove the Dynamic Programming Principle satisfied by the value function. Due to the lack of smoothness properties for the value function, we use the method of viscosity solutions to obtain the corresponding solution of the infinite dimensional Hamilton Jacobi Bellman equation. We show that the value function is the unique viscosity solution of the Hamilton Jacobi Bellman equation. The uniqueness of the viscosity solution is established via comparison principle.


Integer Forcing Architectures for Uplink Cloud Radio Access Networks. Consider an uplink cloud radio access network where users are observed simultaneously by several base stations, each with a rate limited link to a central processor, which wishes to decode all transmitted messages. Recent efforts have demonstrated the advantages of compression based strategies that send quantized channel observations to the central processor, rather than attempt local decoding. We study the setting where channel state information is not available at the transmitters, but known fully or partially at the base stations. We propose an end to end integer forcing framework for compression based uplink cloud radio access, and show that it operates within a constant gap from the optimal outage probability if channel state information is fully available at the base stations. We demonstrate via simulations that our framework is competitive with state of the art Wyner Ziv based strategies.


Neural Network Training Techniques Regularize Optimization Trajectory An Empirical Study. Modern deep neural network (DNN) trainings utilize various training techniques, e.g., nonlinear activation functions, batch normalization, skip connections, etc. Despite their effectiveness, it is still mysterious how they help accelerate DNN trainings in practice. In this paper, we provide an empirical study of the regularization effect of these training techniques on DNN optimization. Specifically, we find that the optimization trajectories of successful DNN trainings consistently obey a certain regularity principle that regularizes the model update direction to be aligned with the trajectory direction. Theoretically, we show that such a regularity principle leads to a convergence guarantee in nonconvex optimization and the convergence rate depends on a regularization parameter. Empirically, we find that DNN trainings that apply the training techniques achieve a fast convergence and obey the regularity principle with a large regularization parameter, implying that the model updates are well aligned with the trajectory. On the other hand, DNN trainings without the training techniques have slow convergence and obey the regularity principle with a small regularization parameter, implying that the model updates are not well aligned with the trajectory. Therefore, different training techniques regularize the model update direction via the regularity principle to facilitate the convergence.


On Efficient Data Transfers Across Geographically Dispersed Datacenters. As applications become more distributed to improve user experience and offer higher availability, businesses rely on geographically dispersed datacenters that host such applications more than ever. Dedicated inter datacenter networks have been built that provide high visibility into the network status and flexible control over traffic forwarding to offer quality communication across the instances of applications hosted on many datacenters. These networks are relatively small, with tens to hundreds of nodes and are managed by the same organization that operates the datacenters which make centralized traffic engineering feasible. Using coordinated data transmission from the services and routing over the inter datacenter network, one can optimize the network performance according to a variety of utility functions that take into account data transfer deadlines, network capacity consumption, and transfer completion times. In this dissertation, we study techniques and algorithms for fast and efficient data transfers across geographically dispersed datacenters over the inter datacenter networks. We discuss different forms and properties of inter datacenter transfers and present a generalized optimization framework to maximize an operator selected utility function. Next, in the several chapters that follow, we study, in detail, the problems of admission control for transfers with deadlines and inter datacenter multicast transfers. For the admission control problem, our solutions offer significant speed up in the admission control process while offering almost identical performance in the total traffic admitted into the network. For the bulk multicasting problem, our techniques enable significant performance gain in receiver completion times with low computational complexity, which makes them highly applicable to inter datacenter networks.


Metric Fourier approximation of set valued functions of bounded variation. We introduce and investigate an adaptation of Fourier series to set valued functions (multifunctions, SVFs) of bounded variation. In our approach we define an analogue of the partial sums of the Fourier series with the help of the Dirichlet kernel using the newly defined weighted metric integral. We derive error bounds for these approximants. As a consequence, we prove that the sequence of the partial sums converges pointwisely in the Hausdorff metric to the values of the approximated set valued function at its points of continuity, or to a certain set described in terms of the metric selections of the approximated multifunction at a point of discontinuity. Our error bounds are obtained with the help of the new notions of one sided local moduli and quasi moduli of continuity which we discuss more generally for functions with values in metric spaces.


Effective Removal of Operational Log Messages an Application to Model Inference. Model inference aims to extract accurate models from the execution logs of software systems. However, in reality, logs may contain some "noise" that could deteriorate the performance of model inference. One form of noise can commonly be found in system logs that contain not only transactional messages logging the functional behavior of the system but also operational messages recording the operational state of the system (e.g., a periodic heartbeat to keep track of the memory usage). In low quality logs, transactional and operational messages are randomly interleaved, leading to the erroneous inclusion of operational behaviors into a system model, that ideally should only reflect the functional behavior of the system. It is therefore important to remove operational messages in the logs before inferring models. In this paper, we propose LogCleaner, a novel technique for removing operational logs messages. LogCleaner first performs a periodicity analysis to filter out periodic messages, and then it performs a dependency analysis to calculate the degree of dependency for all log messages and to remove operational messages based on their dependencies. The experimental results on two proprietary and 11 publicly available log datasets show that LogCleaner, on average, can accurately remove 98 of the operational messages and preserve 81 of the transactional messages. Furthermore, using logs pre processed with LogCleaner decreases the execution time of model inference (with a speed up ranging from 1.5 to 946.7 depending on the characteristics of the system) and significantly improves the accuracy of the inferred models, by increasing their ability to accept correct system behaviors ( 43.8 pp on average, with pp percentage points) and to reject incorrect system behaviors ( 15.0 pp on average).


On the Evolution of the Vortex Filament Equation for regular M polygons with nonzero torsion. In this paper, we consider the evolution of the Vortex Filament equation (VFE) begin equation mathbf X t mathbf Xs wedge mathbf Xss, end equation taking M sided regular polygons with nonzero torsion as initial data. Using algebraic techniques, backed by numerical simulations, we show that the solutions are polygons at rational times, as in the zero torsion case. However, unlike in that case, the evolution is not periodic in time moreover, the multifractal trajectory of the point mathbf X(0,t) is not planar, and appears to be a helix for large times. These new solutions of VFE can be used to illustrate numerically that the smooth solutions of VFE given by helices and straight lines share the same instability as the one already established for circles. This is accomplished by showing the existence of variants of the so called Riemann's non differentiable function that are as close to smooth curves as desired, when measured in the right topology. This topology is motivated by some recent results on the well posedness of VFE, which prove that the selfsimilar solutions of VFE have finite renormalized energy.


Second harmonic and sum frequency generations from a silicon metasurface integrated with a two dimensional material. Silicon based nonlinear metasurfaces were implemented only with third order nonlinearity due to the crystal centrosymmetry and the efficiencies are considerably low, which hinders their practical applications with low power lasers. Here, we propose to integrate a two dimensional GaSe flake onto a silicon metasurface to assist high efficiency second order nonlinear processes, including second harmonic generation (SHG) and sum frequency generation (SFG). By resonantly pumping the integrated GaSe metasurface, which supports a Fano resonance, the obtained SHG is about two orders of magnitude stronger than the third harmonic generation from the bare silicon metasurface. In addition, thanks to the resonant field enhancement and GaSe's strong second order nonlinearity, SHG of the integrated structure could be excited successfully with a low power continuous wave laser, which makes it possible to further implement SFG. The high efficiency second order nonlinear processes assisted by two dimensional materials present potentials to expand silicon metasurface's functionalities in nonlinear regime.


Temporally Consistent Depth Prediction with Flow Guided Memory Units. Predicting depth from a monocular video sequence is an important task for autonomous driving. Although it has advanced considerably in the past few years, recent methods based on convolutional neural networks (CNNs) discard temporal coherence in the video sequence and estimate depth independently for each frame, which often leads to undesired inconsistent results over time. To address this problem, we propose to memorize temporal consistency in the video sequence, and leverage it for the task of depth prediction. To this end, we introduce a two stream CNN with a flow guided memory module, where each stream encodes visual and temporal features, respectively. The memory module, implemented using convolutional gated recurrent units (ConvGRUs), inputs visual and temporal features sequentially together with optical flow tailored to our task. It memorizes trajectories of individual features selectively and propagates spatial information over time, enforcing a long term temporal consistency to prediction results. We evaluate our method on the KITTI benchmark dataset in terms of depth prediction accuracy, temporal consistency and runtime, and achieve a new state of the art. We also provide an extensive experimental analysis, clearly demonstrating the effectiveness of our approach to memorizing temporal consistency for depth prediction.


An efficient, conservative, time implicit solver for the fully kinetic arbitrary species 1D 2V Vlasov Amp ere system. We consider the solution of the fully kinetic (including electrons) Vlasov Amp ere system in a one dimensional physical space and two dimensional velocity space (1D 2V) for an arbitrary number of species with a time implicit Eulerian algorithm. The problem of velocity space meshing for disparate thermal and bulk velocities is dealt with by an adaptive coordinate transformation of the Vlasov equation for each species, which is then discretized, including the resulting inertial terms. Mass, momentum, and energy are conserved, and Gauss's law is enforced to within the nonlinear convergence tolerance of the iterative solver through a set of nonlinear constraint functions while permitting significant flexibility in choosing discretizations in time, configuration, and velocity space. We mitigate the temporal stiffness introduced by, e.g., the plasma frequency through the use of high order low order (HOLO) acceleration of the iterative implicit solver. We present several numerical results for canonical problems of varying degrees of complexity, including the multiscale ion acoustic shock wave problem, which demonstrate the efficacy, accuracy, and efficiency of the scheme.


A Secure Consensus Protocol for Sidechains. Sidechain technology has been envisioned as a promising solution to accelerate today's public blockchains in terms of scalability and interoperability. By relying on the mainchain for security, different sidechains can formulate their own rules to reach consensus. Although the literature has considered the possibility of using consensus protocols in the sidechain, so far a tailor made consensus protocol for sidechains with high performance and formal security proof has not been attempted. To fill this gap, we introduce Cumulus, a low overhead, highly efficient, security provable sidechain protocol. Cumulus makes use of smart contracts to ensure that only one block proposed in the sidechain will be enforced on the mainchain in each round, thereby achieving consensus in an efficient manner. We give a formal specification of Cumulus which ensures safety and liveness without any online requirements of clients. For security analysis, we provide formal security definitions and proofs under Universally Composable Security (UCS) model. As a proof of concept, we implement Cumulus and evaluate it in an Ethereum testnet.


A robust Kalman Bucy filtering problem. A generalized Kalman Bucy model under model uncertainty and a corresponding robust problem are studied in this paper. We find that this robust problem is equivalent to an estimate problem under a sublinear operator. By Girsanov transformation and the minimax theorem, we prove that this problem can be reformulated as a classical Kalman Bucy filtering problem under a new probability measure. The equation which governs the optimal estimator is obtained. Moreover, the optimal estimator can be decomposed into the classical optimal estimator and a term related to model uncertainty.


Dynamic Skyline Queries on Encrypted Data Using Result Materialization. Skyline computation is an increasingly popular query, with broad applicability in domains such as healthcare, travel and finance. Given the recent trend to outsource databases and query evaluation, and due to the proprietary and sometimes highly sensitivity nature of the data (e.g., in healthcare), it is essential to evaluate skylines on encrypted datasets. Several research efforts acknowledged the importance of secure skyline computation, but existing solutions suffer from at least one of the following shortcomings (i) they only provide ad hoc security (ii) they are prohibitively expensive or (iii) they rely on unrealistic assumptions, such as the presence of multiple non colluding parties in the protocol. Inspired from solutions for secure nearest neighbors (NN) computation, we conjecture that the most secure and efficient way to compute skylines is through result materialization. However, this approach is significantly more challenging for skylines than for NN queries. We exhaustively study and provide algorithms for pre computation of skyline results, and we perform an in depth theoretical analysis of this process. We show that pre computing results while minimizing storage overhead is NP hard, and we provide dynamic programming and greedy heuristics that solve the problem more efficiently, while maintaining storage at reasonable levels. Our algorithms are novel and applicable to plain text skyline computation, but we focus on the encrypted setting where materialization reduces the cost of skyline computation from hours to seconds. Extensive experiments show that we clearly outperform existing work in terms of performance, and our security analysis proves that we obtain a smaller (and quantifiable) data leakage than competitors.


A Knowledge Graph based Approach for Mobile Application Recommendation. With the rapid prevalence of mobile devices and the dramatic proliferation of mobile applications (apps), app recommendation becomes an emergent task that would benefit both app users and stockholders. How to effectively organize and make full use of rich side information of users and apps is a key challenge to address the sparsity issue for traditional approaches. To meet this challenge, we proposed a novel end to end Knowledge Graph Convolutional Embedding Propagation Model (KGEP) for app recommendation. Specifically, we first designed a knowledge graph construction method to model the user and app side information, then adopted KG embedding techniques to capture the factual triplet focused semantics of the side information related to the first order structure of the KG, and finally proposed a relation weighted convolutional embedding propagation model to capture the recommendation focused semantics related to high order structure of the KG. Extensive experiments conducted on a real world dataset validate the effectiveness of the proposed approach compared to the state of the art recommendation approaches.


Towards United Reasoning for Automatic Induction in Isabelle HOL. Inductive theorem proving is an important long standing challenge in computer science. In this extended abstract, we first summarize the recent developments of proof by induction for Isabelle HOL. Then, we propose united reasoning, a novel approach to further automating inductive theorem proving. Upon success, united reasoning takes the best of three schools of reasoning deductive reasoning, inductive reasoning, and inductive reasoning, to prove difficult inductive problems automatically.


Strong measure zero sets on 2 kappa for kappa inaccessible. We show the relative consistency of ' vert 2 kappa vert kappa and forall X subset 2 kappa colon X is strong measure zero if and only if it has size leq kappa ' for kappa inaccessible. Furthermore, we also investigate the stronger notion of stationary strong measure zero, and show that the equivalence of the two notions is undecidable in ZFC.


A class of Randers metrics of scalar flag curvature. One of the most important problems in Finsler geometry is to classify Finsler metrics of scalar flag curvature. In this paper, we study the classification problem of Randers metrics of scalar flag curvature. Under the condition that beta is a Killing 1 form, we obtain some important necessary conditions for Randers metrics to be of scalar flag curvature.


Computer Vision based Animal Collision Avoidance Framework for Autonomous Vehicles. Animals have been a common sighting on roads in India which leads to several accidents between them and vehicles every year. This makes it vital to develop a support system for driverless vehicles that assists in preventing these forms of accidents. In this paper, we propose a neoteric framework for avoiding vehicle to animal collisions by developing an efficient approach for the detection of animals on highways using deep learning and computer vision techniques on dashcam video. Our approach leverages the Mask R CNN model for detecting and identifying various commonly found animals. Then, we perform lane detection to deduce whether a detected animal is on the vehicle's lane or not and track its location and direction of movement using a centroid based object tracking algorithm. This approach ensures that the framework is effective at determining whether an animal is obstructing the path or not of an autonomous vehicle in addition to predicting its movement and giving feedback accordingly. This system was tested under various lighting and weather conditions and was observed to perform relatively well, which leads the way for prominent driverless vehicle's support systems for avoiding vehicular collisions with animals on Indian roads in real time.


Message Passing Adaptive Resonance Theory for Online Active Semi supervised Learning. Active learning is widely used to reduce labeling effort and training time by repeatedly querying only the most beneficial samples from unlabeled data. In real world problems where data cannot be stored indefinitely due to limited storage or privacy issues, the query selection and the model update should be performed as soon as a new data sample is observed. Various online active learning methods have been studied to deal with these challenges however, there are difficulties in selecting representative query samples and updating the model efficiently without forgetting. In this study, we propose Message Passing Adaptive Resonance Theory (MPART) that learns the distribution and topology of input data online. Through message passing on the topological graph, MPART actively queries informative and representative samples, and continuously improves the classification performance using both labeled and unlabeled data. We evaluate our model in stream based selective sampling scenarios with comparable query selection strategies, showing that MPART significantly outperforms competitive models.


Repeat Free Codes. In this paper we consider the problem of encoding data into textit repeat free sequences in which sequences are imposed to contain any k tuple at most once (for predefined k ). First, the capacity of the repeat free constraint are calculated. Then, an efficient algorithm, which uses two bits of redundancy, is presented to encode length n sequences for k 2 2 log (n) . This algorithm is then improved to support any value of k of the form k a log (n) , for 1 a , while its redundancy is o(n) . We also calculate the capacity of repeat free sequences when combined with local constraints which are given by a constrained system, and the capacity of multi dimensional repeat free codes.


More (or Less) Economic Limits of the Blockchain. This paper extends the blockchain sustainability framework of Budish (2018) to consider proof of stake (in addition to proof of work) consensus mechanisms and permissioned (where the number of nodes are fixed) networks. It is demonstrated that an economically sustainable network will involve the same cost regardless of whether it is proof of work or proof of stake although in the later the cost will take the form of illiquid financial resources. In addition, it is shown that regulating the number of nodes (as in a permissioned network) does not lead to additional cost savings that cannot otherwise be achieved via a setting of block rewards in a permissionless (i.e., free entry) network. This suggests that permissioned networks will not be able to economize on costs relative to permissionless networks.


High fidelity epigenetic inheritance Information theoretic model predicts k threshold filling of histone modifications post replication. Beyond the genetic code, there is another layer of information encoded as chemical modifications on histone proteins positioned along the DNA. Maintaining these modifications is crucial for survival and identity of cells. How the information encoded in the histone marks gets inherited, given that only half the parental nucleosomes are transferred to each daughter chromatin, is a puzzle. We address this problem using ideas from Information theory and understanding from recent biological experiments. Mapping the replication and reconstruction of modifications to equivalent problems in communication, we ask how well an enzyme machinery can recover information, if they were ideal computing machines. Studying a parameter regime where realistic enzymes can function, our analysis predicts that, pragmatically, enzymes may implement a threshold k filling algorithm which derives from maximum a posteriori probability decoding. Simulations using our method produce modification patterns similar to what is observed in recent experiments.


Linear instability of viscoelastic pipe flow. A modal stability analysis shows that pressure driven pipe flow of an Oldroyd B fluid is linearly unstable to axisymmetric perturbations, in stark contrast to its Newtonian counterpart which is linearly stable at all Reynolds numbers. The dimensionless groups that govern stability are the Reynolds number, the elasticity number, and the ratio of solvent to solution viscosity. The unstable mode has a phase speed close to the base state maximum over the entire unstable region in the relevant parameter space, implying that the unstable mode belongs to a class of viscoelastic center modes. Unlike the Newtonian transition which is dominated by nonlinear processes, the linear instability discussed here could be very relevant to the onset of turbulence in viscoelastic pipe flows. The prediction of an instability is, in fact, consistent with several experimental studies on pipe flow of polymer solutions, ranging from previous reports of early turbulence to the more recent discovery of elasto inertial turbulence. The instability identified in this study comprehensively dispels the prevailing notion of pipe flow of viscoelastic fluids being linearly stable in the Reynolds Weissenberg plane, marking a possible paradigm shift in our understanding of transition in rectilinear viscoelastic shearing flows.


Infinite families of potential modular data related to quadratic categories. We present several infinite families of potential modular data motivated by examples of Drinfeld centers of quadratic categories. In each case, the input is a pair of involutive metric groups with Gauss sums differing by a sign, along with some conditions on the fixed points of the involutions and the relative sizes of the groups. From this input we construct S and T matrices which satisfy the modular relations and whose Verlinde coefficients are non negative integers. We also check certain restrictions coming from Frobenius Schur indicators. These families generalize Evans and Gannon's conjectures for the modular data associated to generalized Haagerup and near group categories for odd groups, and include the modular data of the Drinfeld centers of almost all known quadratic categories. In addition to the subfamilies which are conjecturally realized by centers of quadratic categories, these families include many examples of potential modular data which do not correspond to known types of modular tensor categories.


Provably Robust Runtime Monitoring of Neuron Activation Patterns. For deep neural networks (DNNs) to be used in safety critical autonomous driving tasks, it is desirable to monitor in operation time if the input for the DNN is similar to the data used in DNN training. While recent results in monitoring DNN activation patterns provide a sound guarantee due to building an abstraction out of the training data set, reducing false positives due to slight input perturbation has been an issue towards successfully adapting the techniques. We address this challenge by integrating formal symbolic reasoning inside the monitor construction process. The algorithm performs a sound worst case estimate of neuron values with inputs (or features) subject to perturbation, before the abstraction function is applied to build the monitor. The provable robustness is further generalized to cases where monitoring a single neuron can use more than one bit, implying that one can record activation patterns with a fine grained decision on the neuron value interval.


An Empirical Study of Contextual Data Augmentation for Japanese Zero Anaphora Resolution. One critical issue of zero anaphora resolution (ZAR) is the scarcity of labeled data. This study explores how effectively this problem can be alleviated by data augmentation. We adopt a state of the art data augmentation method, called the contextual data augmentation (CDA), that generates labeled training instances using a pretrained language model. The CDA has been reported to work well for several other natural language processing tasks, including text classification and machine translation. This study addresses two underexplored issues on CDA, that is, how to reduce the computational cost of data augmentation and how to ensure the quality of the generated data. We also propose two methods to adapt CDA to ZAR MASK based augmentation and linguistically controlled masking. Consequently, the experimental results on Japanese ZAR show that our methods contribute to both the accuracy gain and the computation cost reduction. Our closer analysis reveals that the proposed method can improve the quality of the augmented training data when compared to the conventional CDA.


On the local pressure expansion for the Navier Stokes equations. We show that the pressure associated with a distributional solution of the Navier Stokes equations on the whole space satisfies a local expansion defined as a distribution if and only if the solution is mild. This gives a new perspective on Lemari 'e Rieusset's "equivalence theorem." Here, the Leray projection operator composed with a gradient is defined without using the Littlewood Paley decomposition. Prior sufficient conditions for the local expansion assumed spatial decay or estimates on the gradient and imply the considered solution is mild. An important tool is an explicit description of the bounded mean oscillation solution to a Poisson equation, which we examine in detail. As applications we include an improvement of a uniqueness criteria by the authors in Morrey spaces and revisit a proof of a regularity criteria in dynamically restricted local Morrey spaces due to Gruji 'c and Xu.


Adversarial Cross Modal Retrieval via Learning and Transferring Single Modal Similarities. Cross modal retrieval aims to retrieve relevant data across different modalities (e.g., texts vs. images). The common strategy is to apply element wise constraints between manually labeled pair wise items to guide the generators to learn the semantic relationships between the modalities, so that the similar items can be projected close to each other in the common representation subspace. However, such constraints often fail to preserve the semantic structure between unpaired but semantically similar items (e.g. the unpaired items with the same class label are more similar than items with different labels). To address the above problem, we propose a novel cross modal similarity transferring (CMST) method to learn and preserve the semantic relationships between unpaired items in an unsupervised way. The key idea is to learn the quantitative similarities in single modal representation subspace, and then transfer them to the common representation subspace to establish the semantic relationships between unpaired items across modalities. Experiments show that our method outperforms the state of the art approaches both in the class based and pair based retrieval tasks.


DNS Typo squatting Domain Detection A Data Analytics Machine Learning Based Approach. Domain Name System (DNS) is a crucial component of current IP based networks as it is the standard mechanism for name to IP resolution. However, due to its lack of data integrity and origin authentication processes, it is vulnerable to a variety of attacks. One such attack is Typosquatting. Detecting this attack is particularly important as it can be a threat to corporate secrets and can be used to steal information or commit fraud. In this paper, a machine learning based approach is proposed to tackle the typosquatting vulnerability. To that end, exploratory data analytics is first used to better understand the trends observed in eight domain name based extracted features. Furthermore, a majority voting based ensemble learning classifier built using five classification algorithms is proposed that can detect suspicious domains with high accuracy. Moreover, the observed trends are validated by studying the same features in an unlabeled dataset using K means clustering algorithm and through applying the developed ensemble learning classifier. Results show that legitimate domains have a smaller domain name length and fewer unique characters. Moreover, the developed ensemble learning classifier performs better in terms of accuracy, precision, and F score. Furthermore, it is shown that similar trends are observed when clustering is used. However, the number of domains identified as potentially suspicious is high. Hence, the ensemble learning classifier is applied with results showing that the number of domains identified as potentially suspicious is reduced by almost a factor of five while still maintaining the same trends in terms of features' statistics.


MBWU Benefit Quantification for Data Access Function Offloading. The storage industry is considering new kinds of storage devices that support data access function offloading, i.e. the ability to perform data access functions on the storage device itself as opposed to performing it on a separate compute system to which the storage device is connected. But what is the benefit of offloading to a storage device that is controlled by an embedded platform, very different from a host platform? To quantify the benefit, we need a measurement methodology that enables apple to apple comparisons between different platforms. We propose a Media based Work Unit (MBWU, pronounced "MibeeWu"), and an MBWU based measurement methodology to standardize the platform efficiency evaluation so as to quantify the benefit of offloading. To demonstrate the merit of this methodology, we implemented a prototype to automate quantifying the benefit of offloading the key value data access function.


Large scale, real time visual inertial localization revisited. The overarching goals in image based localization are scale, robustness and speed. In recent years, approaches based on local features and sparse 3D point cloud models have both dominated the benchmarks and seen successful realworld deployment. They enable applications ranging from robot navigation, autonomous driving, virtual and augmented reality to device geo localization. Recently end to end learned localization approaches have been proposed which show promising results on small scale datasets. However the positioning accuracy, scalability, latency and compute storage requirements of these approaches remain open challenges. We aim to deploy localization at global scale where one thus relies on methods using local features and sparse 3D models. Our approach spans from offline model building to real time client side pose fusion. The system compresses appearance and geometry of the scene for efficient model storage and lookup leading to scalability beyond what what has been previously demonstrated. It allows for low latency localization queries and efficient fusion run in real time on mobile platforms by combining server side localization with real time visual inertial based camera pose tracking. In order to further improve efficiency we leverage a combination of priors, nearest neighbor search, geometric match culling and a cascaded pose candidate refinement step. This combination outperforms previous approaches when working with large scale models and allows deployment at unprecedented scale. We demonstrate the effectiveness of our approach on a proof of concept system localizing 2.5 million images against models from four cities in different regions on the world achieving query latencies in the 200ms range.


Mean Li Yorke chaos along polynomials of several variables and prime numbers. In this paper, for any given polynomial, by analyzing the limiting behavior of ergodic averages along polynomials of several variables and prime numbers, we prove that for a topology dynamical system, positive entropy implies mean Li Yoke chaos along non constant polynomials of several variables and prime numbers.


Dual Adversarial Inference for Text to Image Synthesis. Synthesizing images from a given text description involves engaging two types of information the content, which includes information explicitly described in the text (e.g., color, composition, etc.), and the style, which is usually not well described in the text (e.g., location, quantity, size, etc.). However, in previous works, it is typically treated as a process of generating images only from the content, i.e., without considering learning meaningful style representations. In this paper, we aim to learn two variables that are disentangled in the latent space, representing content and style respectively. We achieve this by augmenting current text to image synthesis frameworks with a dual adversarial inference mechanism. Through extensive experiments, we show that our model learns, in an unsupervised manner, style representations corresponding to certain meaningful information present in the image that are not well described in the text. The new framework also improves the quality of synthesized images when evaluated on Oxford 102, CUB and COCO datasets.


Lane Boundary Geometry Extraction from Satellite Imagery. Autonomous driving car is becoming more of a reality, as a key component,high definition(HD) maps shows its value in both market place and industry. Even though HD maps generation from LiDAR or stereo perspective imagery has achieved impressive success, its inherent defects cannot be ignored. In this paper, we proposal a novel method for Highway HD maps modeling using pixel wise segmentation on satellite imagery and formalized hypotheses linking, which is cheaper and faster than current HD maps modeling approaches from LiDAR point cloud and perspective view imagery, and let it becomes an ideal complementary of state of the art. We also manual code label an HD road model dataset as ground truth, aligned with Bing tile image server, to train, test and evaluate our methodology. This dataset will be publish at same time to contribute research in HD maps modeling from aerial imagery.


Visible Feature Guidance for Crowd Pedestrian Detection. Heavy occlusion and dense gathering in crowd scene make pedestrian detection become a challenging problem, because it's difficult to guess a precise full bounding box according to the invisible human part. To crack this nut, we propose a mechanism called Visible Feature Guidance (VFG) for both training and inference. During training, we adopt visible feature to regress the simultaneous outputs of visible bounding box and full bounding box. Then we perform NMS only on visible bounding boxes to achieve the best fitting full box in inference. This manner can alleviate the incapable influence brought by NMS in crowd scene and make full bounding box more precisely. Furthermore, in order to ease feature association in the post application process, such as pedestrian tracking, we apply Hungarian algorithm to associate parts for a human instance. Our proposed method can stably bring about 2 3 improvements in mAP and AP50 for both two stage and one stage detector. It's also more effective for MR 2 especially with the stricter IoU. Experiments on Crowdhuman, Cityperson, Caltech and KITTI datasets show that visible feature guidance can help detector achieve promisingly better performances. Moreover, parts association produces a strong benchmark on Crowdhuman for the vision community.


The convergence of the Generalized Lanczos Trust Region Method for the Trust Region Subproblem. Solving the trust region subproblem (TRS) plays a key role in numerical optimization and many other applications. The generalized Lanczos trust region (GLTR) method is a well known Lanczos type approach for solving a large scale TRS. The method projects the original large scale TRS onto a k dimensional Krylov subspace, whose orthonormal basis is generated by the symmetric Lanczos process, and computes an approximate solution from the underlying subspace. There have been some a priori error bounds for the optimal solution and the optimal objective value in the literature, but no a priori result exists on the convergence of Lagrangian multipliers involved in projected TRS's and the residual norm of approximate solution. In this paper, a general convergence theory of the GLTR method is established, and a priori bounds are derived for the errors of the optimal Lagrangian multiplier, the optimal solution, the optimal objective value and the residual norm of approximate solution. Numerical experiments demonstrate that our bounds are realistic and predict the convergence rates of the three errors and residual norms accurately.


Hereditary cotorsion pairs on extriangulated subcategories. Let mathcal B be an extriangulated category with enough projectives and enough injectives. We define a proper m term subcategory mathcal G on mathcal B , which is an extriangulated subcategory. Then we give a correspondence between cotorsion pairs on mathcal G , support tau tilting subcategories on an abelian quotient of mathcal G when m 2 . If such mathcal G is induced by a hereditary cotorsion pair, then we give a correspondence between cotorsion pairs on mathcal G and intermediate cotorsion pairs on mathcal B under certain assumptions. At last, we study an important property of such extriangulated subcategory mathcal G .


Electronic excited states of benzene in interaction with water clusters influence of structure and size. This work is dedicated to the theoretical investigation of the influence of water clusters' organisation and size on the electronic spectrum of an interacting benzene (Bz) molecule using both TD DFT and CASPT2 approaches. Two series of geometries, namely Geo IEI and Geo IED were extracted from two Bz hexagonal ice configurations leading to maximum and minimum ionization energies respectively. An appropriate basis set containing atomic diffuse and polarisation orbitals and describing the Rydberg states of Bz was determined. The TD DFT approach was carefully benchmarked against CASPT2 results for the smallest systems.Despite some discrepancies, the trends were found to be similar at both levels of theory the positions and intensities of the main pi rightarrow pi star transitions were found slightly split due to symmetry breaking. For the smallest systems, our results clearly show the dependence of the electronic transitions on the clusters' structures. Of particular interest, low energy transitions of non negligible oscillator strength from a Bz pi orbital to a virtual orbital of Rydberg character, also involving atomic diffuse functions and partially expanded on the water cluster, were found for the Geo IED series. The energies of such transitions were determined to be more than 2 ,eV below the ionization potential of Bz. When the cluster's size increases, similar transitions were found for all structures, the virtual orbitals becoming mainly developed on the H atoms of the water molecules at the edge of the cluster. Given their nature and energy, such transitions could play a role in the photochemistry of aromatic species in interaction with water clusters or ice, such processes being of astrophysical interest.


Chromatic Aberration in Metalenses. This paper provides a mathematical approach to study chromatic aberration in metalenses. It is shown that radiation of a given wavelength is refracted according to a generalized Snell's law which together with the notion of envelope yields the existence of phase discontinuities. This is then used to establish a quantitative measure of dispersion in metalenses concluding that in the visible spectrum it has the same order of magnitude as for standard lenses.


A cross sectional study of social inequities in medical crowdfunding campaigns in the United States. Americans are increasingly relying on crowdfunding to pay for the costs of healthcare. In medical crowdfunding, online platforms allow individuals to appeal to social networks to request donations for health and medical needs. Users are often told that success depends on how they organize and share their campaigns to increase social network engagement. However, experts have cautioned that MCF could exacerbate health and social disparities by amplifying the choices and biases of the crowd and leveraging these to determine who has access to financial support for healthcare. To date, research on potential axes of disparity in MCF, and their impacts on fundraising outcomes, has been limited. This paper presents an exploratory cross sectional study of a randomized sample of 637 MCF campaigns on the popular platform Gofundme, for which the race, gender, age, and relationships of campaigners and campaign recipients were categorized alongside campaign characteristics and outcomes. Our analyses examine race, gender, and age disparities in MCF use, and tests how these are associated with differential campaign outcomes. The results show systemic disparities in MCF use and outcomes non white users are under represented. There is significant evidence of an additional digital care labor burden on women organizers of campaigns, and marginalized race and gender groups are associated with poorer fundraising outcomes. Outcomes are only minimally associated with campaign characteristics under users' control, such as photos, videos, and updates. These results corroborate widespread concerns how technology fuels health inequities, and about how crowdfunding may be creating an unequal and biased marketplace for those seeking financial support to access healthcare. Further research and better data access are needed to explore these dynamics more deeply and inform policy for this largely unregulated industry.


Optimal Dividend Payout under Stochastic Discounting. Adopting a probabilistic approach we determine the optimal dividend payout policy of a firm whose surplus process follows a controlled arithmetic Brownian motion and whose cash flows are discounted at a stochastic dynamic rate. Dividends can be paid to shareholders at unrestricted rates so that the problem is cast as one of singular stochastic control. The stochastic interest rate is modelled by a Cox Ingersoll Ross (CIR) process and the firm's objective is to maximize the total expected flow of discounted dividends until a possible insolvency time. We find an optimal dividend payout policy which is such that the surplus process is kept below an endogenously determined stochastic threshold expressed as a decreasing continuous function r mapsto b(r) of the current interest rate value. We also prove that the value function of the singular control problem solves a variational inequality associated to a second order, non degenerate elliptic operator, with a gradient constraint.


Improved Generalization of Heading Direction Estimation for Aerial Filming Using Semi supervised Regression. In the task of Autonomous aerial filming of a moving actor (e.g. a person or a vehicle), it is crucial to have a good heading direction estimation for the actor from the visual input. However, the models obtained in other similar tasks, such as pedestrian collision risk analysis and human robot interaction, are very difficult to generalize to the aerial filming task, because of the difference in data distributions. Towards improving generalization with less amount of labeled data, this paper presents a semi supervised algorithm for heading direction estimation problem. We utilize temporal continuity as the unsupervised signal to regularize the model and achieve better generalization ability. This semi supervised algorithm is applied to both training and testing phases, which increases the testing performance by a large margin. We show that by leveraging unlabeled sequences, the amount of labeled data required can be significantly reduced. We also discuss several important details on improving the performance by balancing labeled and unlabeled loss, and making good combinations. Experimental results show that our approach robustly outputs the heading direction for different types of actor. The aesthetic value of the video is also improved in the aerial filming task.


Mixed Convective Heat Transfer Enhancement in a Ventilated Cavity by Flow Modulation via Rotating Plate. The present study numerically explores the mixed convection phenomena in a differentially heated ventilated square cavity with active flow modulation via a rotating plate. Forced convection flow in the cavity is attained by maintaining an external fluid flow through an opening at the bottom of the left cavity wall while leaving it through another opening at the right cavity wall. A counter clockwise rotating plate at the center of the cavity acts as active flow modulator. Moving mesh approach is used for the rotation of the plate and the numerical solution is achieved using Arbitrary Lagrangian Eulerian (ALE) finite element formulation with a quadrilateral discretization scheme. Transient parametric simulations have been performed for various frequency of the rotating plate for a fixed Reynolds number (Re) of 100 based on maximum inlet flow velocity while the Richardson number (Ri) is maintained at unity. Heat transfer performance has been evaluated in terms of spatially averaged Nusselt number and time averaged Nusselt number along the heated wall. Power spectrum analysis in the frequency domain obtained from the fast Fourier transform (FFT) analysis indicates that thermal frequency and plate frequency start to deviate from each other at higher values of velocity ratio ( 4).


An Optimization Model for Scheduling Freight Trains on a Single Rail Track. In many countries, a rail network consists of single lines with sidings where interactions between trains occur (meet, pass). In this paper, we study two issues of these networks first, the scheduling of freight trains in a single line corridor while ensuring safe interactions and second, the allocation of freight to freight trains regarding the release dates of freight, weight of freight, and weight capacity of the trains. Both of these issues must be addressed when examining real world freight train scheduling problems. The objective functions of this study are the minimization of a train's travelling time, the allocation of freight to freight trains, and the reduction of tardiness of freight at destination. Both scheduling and allocation problems are presented using integer linear programming models. In addition, an integrated novel heuristic algorithm has been proposed to solve them. Computational results demonstrated through a generated dataset show both model validation and efficiency of the heuristic algorithm. The heuristic algorithm has been designed to incorporate the practical operational railway rules with modest modification. Although its outputs slightly differ from the exact solutions, it can solve both models simultaneously in large scale problems.


Drawbacks and Proposed Solutions for Real time Processing on Existing State of the art Locality Sensitive Hashing Techniques. Nearest neighbor query processing is a fundamental operation for many image retrieval applications. Often, images are stored and represented by high dimensional vectors that are generated by feature extraction algorithms. Since tree based index structures are shown to be ineffective for high dimensional processing due to the well known "Curse of Dimensionality", approximate nearest neighbor techniques are used for faster query processing. Locality Sensitive Hashing (LSH) is a very popular and efficient approximate nearest neighbor technique that is known for its sublinear query processing complexity and theoretical guarantees. Nowadays, with the emergence of technology, several diverse application domains require real time high dimensional data storing and processing capacity. Existing LSH techniques are not suitable to handle real time data and queries. In this paper, we discuss the challenges and drawbacks of existing LSH techniques for processing real time high dimensional image data. Additionally, through experimental analysis, we propose improvements for existing state of the art LSH techniques for efficient processing of high dimensional image data.


A Comparison Map for Symmetric Homology and Gamma Homology. We construct a comparison map between the gamma homology theory of Robinson and Whitehouse and the symmetric homology theory of Fiedorowicz and Ault in the case of an augmented, commutative algebra over a unital commutative ground ring.


CBR Controlled Burst Recording. Collecting traces from software running in the field is both useful and challenging. Traces may indeed help revealing unexpected usage scenarios, detecting and reproducing failures, and building behavioral models that reflect how the software is actually used. On the other hand, recording traces is an intrusive activity that may annoy users, negatively affecting the usability of the applications, if not properly designed. In this paper we address field monitoring by introducing Controlled Burst Recording, a monitoring solution that can collect comprehensive runtime data without compromising the quality of the user experience. The technique encodes the knowledge extracted from the monitored application as a finite state model that both represents the sequences of operations that can be executed by the users and the corresponding internal computations that might be activated by each operation. Our initial assessment with information extracted from ArgoUML shows that Controlled Burst Recording can reconstruct behavioral information more effectively than competing sampling techniques, with a low impact on the system response time.


Ask Your Humans Using Human Instructions to Improve Generalization in Reinforcement Learning. Complex, multi task problems have proven to be difficult to solve efficiently in a sparse reward reinforcement learning setting. In order to be sample efficient, multi task learning requires reuse and sharing of low level policies. To facilitate the automatic decomposition of hierarchical tasks, we propose the use of step by step human demonstrations in the form of natural language instructions and action trajectories. We introduce a dataset of such demonstrations in a crafting based grid world. Our model consists of a high level language generator and low level policy, conditioned on language. We find that human demonstrations help solve the most complex tasks. We also find that incorporating natural language allows the model to generalize to unseen tasks in a zero shot setting and to learn quickly from a few demonstrations. Generalization is not only reflected in the actions of the agent, but also in the generated natural language instructions in unseen tasks. Our approach also gives our trained agent interpretable behaviors because it is able to generate a sequence of high level descriptions of its actions.


Morse index and stability of the planar N vortex problem. This paper concerns the investigation of the stability properties of relative equilibria which are rigidly rotating vortex configurations sometimes called vortex crystals, in the N vortex problem. Such a configurations can be characterized as critical point of the Hamiltonian function restricted on the constant angular impulse hypersurface in the phase space (topologically a pseudo sphere whose coefficients are the circulation strengths of the vortices). Relative equilibria are generated by the circle action on the so called shape pseudo sphere (which generalize the standard shape sphere appearing in the study of the N body problem). Inspired by the planar gravitational N body problem, and after a geometrical and dynamical discussion, we investigate the relation intertwining the stability of relative equilibria and the inertia indices of the central configurations generating such equilibria. In the last section we apply our main results to some symmetric three and four vortices relative equilibria.


Graph Repair and its Application to Meta Modeling. Model repair is an essential topic in model driven engineering. We present typed graph repair programs for specific conditions application to any typed graph yields a typed graph satisfying the condition. A model graph based on the Eclipse Modeling Framework (EMF), short EMF model graph, is a typed graph satisfying some structural EMF constraints. Application of the results to the EMF world yields model repair programs for EMFk constraints, a first order variant of EMF constraints application to any typed graph yields an EMFk model graph. From these results, we derive results for EMF model repair.


DDPNOpt Differential Dynamic Programming Neural Optimizer. Interpretation of Deep Neural Networks (DNNs) training as an optimal control problem with nonlinear dynamical systems has received considerable attention recently, yet the algorithmic development remains relatively limited. In this work, we make an attempt along this line by reformulating the training procedure from the trajectory optimization perspective. We first show that most widely used algorithms for training DNNs can be linked to the Differential Dynamic Programming (DDP), a celebrated second order method rooted in the Approximate Dynamic Programming. In this vein, we propose a new class of optimizer, DDP Neural Optimizer (DDPNOpt), for training feedforward and convolution networks. DDPNOpt features layer wise feedback policies which improve convergence and reduce sensitivity to hyper parameter over existing methods. It outperforms other optimal control inspired training methods in both convergence and complexity, and is competitive against state of the art first and second order methods. We also observe DDPNOpt has surprising benefit in preventing gradient vanishing. Our work opens up new avenues for principled algorithmic design built upon the optimal control theory.


Legendrian Hopf links. We completely classify Legendrian realisations of the Hopf link, up to coarse equivalence, in the 3 sphere with any contact structure.


Multi scale deep neural networks for real image super resolution. Single image super resolution (SR) is extremely difficult if the upscaling factors of image pairs are unknown and different from each other, which is common in real image SR. To tackle the difficulty, we develop two multi scale deep neural networks (MsDNN) in this work. Firstly, due to the high computation complexity in high resolution spaces, we process an input image mainly in two different downscaling spaces, which could greatly lower the usage of GPU memory. Then, to reconstruct the details of an image, we design a multi scale residual network (MsRN) in the downscaling spaces based on the residual blocks. Besides, we propose a multi scale dense network based on the dense blocks to compare with MsRN. Finally, our empirical experiments show the robustness of MsDNN for image SR when the upscaling factor is unknown. According to the preliminary results of NTIRE 2019 image SR challenge, our team (ZXHresearch fudan) ranks 21 st among all participants. The implementation of MsDNN is released https github.com shangqigao gsq image SR


A Reduced Basis Method For Fractional Diffusion Operators II. We present a novel numerical scheme to approximate the solution map s mapsto u(s) mathcal L s f to partial differential equations involving fractional elliptic operators. Reinterpreting mathcal L s as interpolation operator allows us to derive an integral representation of u(s) which includes solutions to parametrized reaction diffusion problems. We propose a reduced basis strategy on top of a finite element method to approximate its integrand. Unlike prior works, we deduce the choice of snapshots for the reduced basis procedure analytically. Avoiding further discretization, the integral is interpreted in a spectral setting to evaluate the surrogate directly. Its computation boils down to a matrix approximation L of the operator whose inverse is projected to a low dimensional space, where explicit diagonalization is feasible. The universal character of the underlying s independent reduced space allows the approximation of (u(s)) s in(0,1) in its entirety. We prove exponential convergence rates and confirm the analysis with a variety of numerical examples. Further improvements are proposed in the second part of this investigation to avoid inversion of L . Instead, we directly project the matrix to the reduced space, where its negative fractional power is evaluated. A numerical comparison with the predecessor highlights its competitive performance.


Spectral Inclusion and Pollution for a Class of Dissipative Perturbations. Spectral inclusion and spectral pollution results are proved for sequences of linear operators of the form T 0 i gamma s n on a Hilbert space, where s n is strongly convergent to the identity operator and gamma 0 . We work in both an abstract setting and a more concrete Sturm Liouville framework. The results provide rigorous justification for a method of computing eigenvalues in spectral gaps.


Stability of pair graphs. We start up the study of the stability of general graph pairs. This notion is a generalization of the concept of the stability of graphs. We say that a pair of graphs ( Gamma, Sigma) is stable if Aut( Gamma times Sigma) cong Aut( Gamma) times Aut( Sigma) and unstable otherwise, where Gamma times Sigma is the direct product of Gamma and Sigma . An unstable graph pair ( Gamma, Sigma) is said to be a nontrivially unstable graph pair if Gamma and Sigma are connected coprime graphs, at least one of them is non bipartite, and each of them has the property that different vertices have distinct neighbourhoods. We obtain necessary conditions for a pair of graphs to be stable. We also give a characterization of a pair of graphs ( Gamma, Sigma) to be nontrivially unstable in the case when both graphs are connected and regular with coprime valencies and Sigma is vertex transitive. This characterization is given in terms of the Sigma automorphisms of Gamma , which are a new concept introduced in this paper as a generalization of both automorphisms and two fold automorphisms of a graph.


Non left orderability of lattices in higher rank semi simple Lie groups. We prove that an irreducible lattice in a real semi simple Lie group of real rank at least two and finite center is not left orderable.


VRUNet Multi Task Learning Model for Intent Prediction of Vulnerable Road Users. Advanced perception and path planning are at the core for any self driving vehicle. Autonomous vehicles need to understand the scene and intentions of other road users for safe motion planning. For urban use cases it is very important to perceive and predict the intentions of pedestrians, cyclists, scooters, etc., classified as vulnerable road users (VRU). Intent is a combination of pedestrian activities and long term trajectories defining their future motion. In this paper we propose a multi task learning model to predict pedestrian actions, crossing intent and forecast their future path from video sequences. We have trained the model on naturalistic driving open source JAAD dataset, which is rich in behavioral annotations and real world scenarios. Experimental results show state of the art performance on JAAD dataset and how we can benefit from jointly learning and predicting actions and trajectories using 2D human pose features and scene context.


Coloring count cones of planar graphs. For a plane near triangulation G with the outer face bounded by a cycle C , let n star G denote the function that to each 4 coloring psi of C assigns the number of ways psi extends to a 4 coloring of G . The block count reducibility argument (which has been developed in connection with attempted proofs of the Four Color Theorem) is equivalent to the statement that the function n star G belongs to a certain cone in the space of all functions from 4 colorings of C to real numbers. We investigate the properties of this cone for C 5 , formulate a conjecture strengthening the Four Color Theorem, and present evidence supporting this conjecture.


On the Lyapunov Foster criterion and Poincar 'e inequality for Reversible Markov Chains. This paper presents an elementary proof of stochastic stability of a discrete time reversible Markov chain starting from a Foster Lyapunov drift condition. Besides its relative simplicity, there are two salient features of the proof (i) it relies entirely on functional analytic non probabilistic arguments and (ii) it makes explicit the connection between a Foster Lyapunov function and Poincar 'e inequality. The proof is used to derive an explicit bound for the spectral gap. An extension to the non reversible case is also presented.


The tame site of a scheme. 'Etale cohomology with non invertible coefficients has some unpleasant properties, e.g., it is not A 1 homotopy invariant and for constructible coefficients the expected finiteness properties do not hold. In this paper we introduce the tame site' which is slightly coarser than the 'etale site. Tame cohomology coincides with 'etale cohomology for invertible coefficients but is better behaved in the general case. The fundamental group of the tame site is the (curve )tame fundamental group of Wiesend and Kerz Schmidt. The higher tame homotopy groups hopefully have a better behaviour than the higher 'etale homotopy groups, which vanish for affine schemes in positive characteristic by a result of Achinger.


A Novel Update Mechanism for Q Networks Based On Extreme Learning Machines. Reinforcement learning is a popular machine learning paradigm which can find near optimal solutions to complex problems. Most often, these procedures involve function approximation using neural networks with gradient based updates to optimise weights for the problem being considered. While this common approach generally works well, there are other update mechanisms which are largely unexplored in reinforcement learning. One such mechanism is Extreme Learning Machines. These were initially proposed to drastically improve the training speed of neural networks and have since seen many applications. Here we attempt to apply extreme learning machines to a reinforcement learning problem in the same manner as gradient based updates. This new algorithm is called Extreme Q Learning Machine (EQLM). We compare its performance to a typical Q Network on the cart pole task a benchmark reinforcement learning problem and show EQLM has similar long term learning performance to a Q Network.


Morse theory with homotopy coherent diagrams. We study Morse theory on noncompact manifolds equipped with exhaustions by compact pieces, defining the Morse homology of a pair which consists of the manifold and related geometric homotopy data. We construct a collection of Morse data parametrized by cubes of arbitrary dimensions. From this collection, we obtain a family of linear maps subject to some coherency conditions, which can be packaged into a homotopy coherent diagram. We introduce a chain complex which is a colimit for the diagram and show that it computes the Morse homology.


Quasi optimal mesh sequence construction through Smoothed Adaptive Finite Element Method. We propose a new algorithm for Adaptive Finite Element Methods (AFEMs) based on smoothing iterations (S AFEM), for linear, second order, elliptic partial differential equations (PDEs). The algorithm is inspired by the ascending phase of the V cycle multigrid method we replace accurate algebraic solutions in intermediate cycles of the classical AFEM with the application of a prolongation step, followed by the application of a smoother. Even though these intermediate solutions are far from the exact algebraic solutions, their a posteriori error estimation produces a refinement pattern that is substantially equivalent to the one that would be generated by classical AFEM, at a considerable fraction of the computational cost. We provide a qualitative analysis of how the error propagates throughout the algorithm, and we present a series of numerical experiments that highlight the efficiency and the computational speedup of S AFEM.


Radical pair intersystem crossing Quantum dynamics or incoherent kinetics?. Magnetic field effects on radical pair reactions arise due to the interplay of coherent electron spin dynamics and spin relaxation effects, a rigorous treatment of which requires the solution of the Liouville von Neumann equation. However, it is often found that simple incoherent kinetic models of the radical pair singlet triplet intersystem crossing provide an acceptable description of experimental measurements. In this paper we outline the theoretical basis for this incoherent kinetic description, elucidating its connection to exact quantum mechanics. We show in particular how the finite lifetime of the radical pair spin states, as well as any additional spin state dephasing, leads to incoherent intersystem crossing. We arrive at simple expressions for the radical pair spin state interconversion rates to which the functional form proposed recently by Steiner et al. J. Phys. Chem. C 122, 11701 (2018) can be regarded as an approximation. We also test the kinetic master equation against exact quantum dynamical simulations for a model radical pair and for a series of text PTZ bullet text Ph text n text PDI bullet molecular wires.


Effects of neuronal variability on phase synchronization of neural networks. An important idea in neural information processing is the communication through coherence hypothesis, according to which communication between two brain regions is effective only if they are phase locked. Also of importance is neuronal variability, a phenomenon in which a single neuron's inter firing times may be highly variable. In this work, we aim to connect these two ideas by studying the effects of that variability on the capability of neurons to reach phase synchronization. We simulate a network of modified Hodgkin Huxley bursting neurons possessing a small world topology. First, variability is shown to be correlated with the average degree of phase synchronization of the network. Next, restricting to spatial variability which measures the deviation of firing times between all neurons in the network we show that it is positively correlated to a behavior we call promiscuity, which is the tendency of neurons to to have their relative phases change with time. This relation is observed in all cases we tested, regardless of the degree of synchronization or the strength of the inter neuronal coupling high variability implies high promiscuity (low duration of phase locking), even if the network as a whole is synchronized and the coupling is strong. We argue that spatial variability actually generates promiscuity. Therefore, we conclude that variability has a strong influence on both the degree and the manner in which neurons phase synchronize, which is another reason for its relevance in neural communication.


Attention Is All You Need for Chinese Word Segmentation. Taking greedy decoding algorithm as it should be, this work focuses on further strengthening the model itself for Chinese word segmentation (CWS), which results in an even more fast and more accurate CWS model. Our model consists of an attention only stacked encoder and a light enough decoder for the greedy segmentation plus two highway connections for smoother training, in which the encoder is composed of a newly proposed Transformer variant, Gaussian masked Directional (GD) Transformer, and a biaffine attention scorer. With the effective encoder design, our model only needs to take unigram features for scoring. Our model is evaluated on SIGHAN Bakeoff benchmark datasets. The experimental results show that with the highest segmentation speed, the proposed model achieves new state of the art or comparable performance against strong baselines in terms of strict closed test setting.


Integral foliated simplicial volume and circle foliations. We show that the integral foliated simplicial volume of a connected compact oriented smooth manifold with a regular foliation by circles vanishes.


Graphs for deep learning representations. In recent years, Deep Learning methods have achieved state of the art performance in a vast range of machine learning tasks, including image classification and multilingual automatic text translation. These architectures are trained to solve machine learning tasks in an end to end fashion. In order to reach top tier performance, these architectures often require a very large number of trainable parameters. There are multiple undesirable consequences, and in order to tackle these issues, it is desired to be able to open the black boxes of deep learning architectures. Problematically, doing so is difficult due to the high dimensionality of representations and the stochasticity of the training process. In this thesis, we investigate these architectures by introducing a graph formalism based on the recent advances in Graph Signal Processing (GSP). Namely, we use graphs to represent the latent spaces of deep neural networks. We showcase that this graph formalism allows us to answer various questions including ensuring generalization abilities, reducing the amount of arbitrary choices in the design of the learning process, improving robustness to small perturbations added to the inputs, and reducing computational complexity


Ethical Dilemmas in Strategic Games. An agent, or a coalition of agents, faces an ethical dilemma between several statements if she is forced to make a conscious choice between which of these statements will be true. This paper proposes to capture ethical dilemmas as a modality in strategic game settings with and without limit on sacrifice and for perfect and imperfect information games. The authors show that the dilemma modality cannot be defined through the earlier proposed blameworthiness modality. The main technical result is a sound and complete axiomatization of the properties of this modality with sacrifice in games with perfect information.


On the Upload versus Download Cost for Secure and Private Matrix Multiplication. In this paper, we study the problem of secure and private distributed matrix multiplication. Specifically, we focus on a scenario where a user wants to compute the product of a confidential matrix A , with a matrix B theta , where theta in 1, dots,M . The set of candidate matrices B 1, dots,B M are public, and available at all the N servers. The goal of the user is to distributedly compute AB theta , such that (a) no information is leaked about the matrix A to any server and (b) the index theta is kept private from each server. Our goal is to understand the fundamental tradeoff between the upload vs download cost for this problem. Our main contribution is to show that the lower convex hull of following (upload, download) pairs (U,D) (N (K 1),(K (K 1))(1 (K N) dots (K N) M 1 )) for K 2, dots,N is achievable. The scheme improves upon state of the art existing schemes for this problem, and leverages ideas from secret sharing and coded private information retrieval.


Comparison studies between BHBT2 PC71BM composite nanotubes and its bulk heterojunction properties. In this study, we investigate the morphological, structural, and optical properties of both bulk heterojunction and composite nanotubes that composed of thiophene based small molecules BHBT2 and fullerene PC71BM. Mix blended and template assisted methods were used to fabricate the bulk heterojunction and composite nanotubes, respectively. A single material of BHBT2 thin films and nanotubes that fabricated via spin coating and template assisted methods, respectively, was also studied. Two different formations between bulk heterojunction and composite nanotubes were compared to elaborate their advancement in properties. Absorption spectra of BHBT2 PC71BM bulk heterojunction and composite nanotubes have fallen within the ultraviolet visible (UV vis) range. Field emission scanning electron microscope (FESEM) and high resolution transmission electron microscope (HRTEM) images show that the carbon rich of PC71BM, has successfully infiltrated into the BHBT2 nanotube to form the BHBT2 PC71BM composite nanotubes. However, due to the informality distribution of infiltration, charge carrier transfer is seen to be better in bulk heterojunction rather than in the composite nanotubes.


Distributed Nash Equilibrium Seeking with Limited Cost Function Knowledge via A Consensus Based Gradient Free Method. This paper considers a distributed Nash equilibrium seeking problem, where the players only have partial access to other players' actions, such as their neighbors' actions. Thus, the players are supposed to communicate with each other to estimate other players' actions. To solve the problem, a leader following consensus gradient free distributed Nash equilibrium seeking algorithm is proposed. This algorithm utilizes only the measurements of the player's local cost function without the knowledge of its explicit expression or the requirement on its smoothness. Hence, the algorithm is gradient free during the entire updating process. Moreover, the analysis on the convergence of the Nash equilibrium is studied for the algorithm with both diminishing and constant step sizes, respectively. Specifically, in the case of diminishing step size, it is shown that the players' actions converge to the Nash equilibrium almost surely, while in the case of fixed step size, the convergence to the neighborhood of the Nash equilibrium is achieved. The performance of the proposed algorithm is verified through numerical simulations.


Competitive Coevolution as an Adversarial Approach to Dynamic Optimization. Dynamic optimization, for which the objective functions change over time, has attracted intensive investigations due to the inherent uncertainty associated with many real world problems. For its robustness with respect to noise, Evolutionary Algorithms (EAs) have been expected to have great potential for dynamic optimization. On the other hand, EAs are also criticized for its high computational complexity, which appears to be contradictory to the core requirement of real world dynamic optimization, i.e., fast adaptation (typically in terms of wall clock time) to the environmental change. So far, whether EAs would indeed lead to a truly effective approach for real world dynamic optimization remain unclear. In this paper, a new framework of employing EAs in the context of dynamic optimization is explored. We suggest that, instead of online evolving (searching) solutions for the ever changing objective function, EAs are more suitable for acquiring an archive of solutions in an offline way, which could be adopted to construct a system to provide high quality solutions efficiently in a dynamic environment. To be specific, we first re formulate dynamic optimization problems as static set oriented optimization problems. Then, a particular type of EAs, namely competitive coevolution, is employed to search for the archive of solutions in an adversarial way. The general framework is instantiated for continuous dynamic constrained optimization problems, and the empirical results showed the potential of the proposed framework.


Code Aware Combinatorial Interaction Testing. Combinatorial interaction testing (CIT) is a useful testing technique to address the interaction of input parameters in software systems. In many applications, the technique has been used as a systematic sampling technique to sample the enormous possibilities of test cases. In the last decade, most of the research activities focused on the generation of CIT test suites as it is a computationally complex problem. Although promising, less effort has been paid for the application of CIT. In general, to apply the CIT, practitioners must identify the input parameters for the Software under test (SUT), feed these parameters to the CIT tool to generate the test suite, and then run those tests on the application with some pass and fail criteria for verification. Using this approach, CIT is used as a black box testing technique without knowing the effect of the internal code. Although useful, practically, not all the parameters having the same impact on the SUT. This paper introduces a different approach to use the CIT as a gray box testing technique by considering the internal code structure of the SUT to know the impact of each input parameter and thus use this impact in the test generation stage. We applied our approach to five reliable case studies. The results showed that this approach would help to detect new faults as compared to the equal impact parameter approach.


Brewers Conjecture and a characterization of the limits, and relationships between Consistency, Availability and Partition Tolerance in a distributed service. In designing a distributed service, three desirable attributes are Consistency, Availability and Partition Tolerance. In this note we explore a framework for characterizing these three in a manner that establishes definite limits and relationships between them, and explore some implications of this characterization.


Sensitive instances of the Constraint Satisfaction Problem. We investigate the impact of modifying the constraining relations of a Constraint Satisfaction Problem (CSP) instance, with a fixed template, on the set of solutions of the instance. More precisely we investigate sensitive instances an instance of the CSP is called sensitive, if removing any tuple from any constraining relation invalidates some solution of the instance. Equivalently, one could require that every tuple from any one of its constraints extends to a solution of the instance. Clearly, any non trivial template has instances which are not sensitive. Therefore we follow the direction proposed (in the context of strict width) by Feder and Vardi (SICOMP 1999) and require that only the instances produced by a local consistency checking algorithm are sensitive. In the language of the algebraic approach to the CSP we show that a finite idempotent algebra mathbf A has a k 2 variable near unanimity term operation if and only if any instance that results from running the (k, k 1) consistency algorithm on an instance over mathbf A 2 is sensitive. A version of our result, without idempotency but with the sensitivity condition holding in a variety of algebras, settles a question posed by G. Bergman about systems of projections of algebras that arise from some subalgebra of a finite product of algebras. Our results hold for infinite (albeit in the case of mathbf A idempotent) algebras as well and exhibit a surprising similarity to the strict width k condition proposed by Feder and Vardi. Both conditions can be characterized by the existence of a near unanimity operation, but the arities of the operations differ by 1.


Deformations of relative Rota Baxter operators on Leibniz algebras. In this paper, we introduce the cohomology theory of relative Rota Baxter operators on Leibniz algebras. We use the cohomological approach to study linear and formal deformations of relative Rota Baxter operators. In particular, the notion of Nijenhuis elements is introduced to characterize trivial linear deformations. Formal deformations and extendibility of order n deformations of a relative Rota Baxter operator are also characterized in terms of the cohomology theory.


Error estimates for backward fractional Feynman Kac equation with non smooth initial data. In this paper, we are concerned with the numerical solution for the backward fractional Feynman Kac equation with non smooth initial data. Here we first provide the regularity estimate of the solution. And then we use the backward Euler and second order backward difference convolution quadratures to approximate the Riemann Liouville fractional substantial derivative and get the first and second order convergence in time. The finite element method is used to discretize the Laplace operator with the optimal convergence rates. Compared with the previous works for the backward fractional Feynman Kac equation, the main advantage of the current discretization is that we don't need the assumption on the regularity of the solution in temporal and spatial directions. Moreover, the error estimates of the time semi discrete schemes and the fully discrete schemes are also provided. Finally, we perform the numerical experiments to verify the effectiveness of the presented algorithms.


Proximal Operator and Optimality Conditions for Ramp Loss SVM. Support vector machines with ramp loss (dubbed as L r SVM) have attracted wide attention due to the boundedness of ramp loss. However, the corresponding optimization problem is non convex and the given Karush Kuhn Tucker (KKT) conditions are only the necessary conditions. To enrich the optimality theory of L r SVM and go deep into its statistical nature, we first introduce and analyze the proximal operator for ramp loss, and then establish a stronger optimality conditions P stationarity, which is proved to be the first order necessary and sufficient conditions for local minimizer of L r SVM. Finally, we define the L r support vectors based on the concept of P stationary point, and show that all L r support vectors fall into the support hyperplanes, which possesses the same feature as the one of hard margin SVM.


cs.LG physics.bio-ph physics.comp-ph q-bio.BM

ATOM3D Tasks On Molecules in Three Dimensions. Computational methods that operate on three dimensional molecular structure have the potential to solve important questions in biology and chemistry. In particular, deep neural networks have gained significant attention, but their widespread adoption in the biomolecular domain has been limited by a lack of either systematic performance benchmarks or a unified toolkit for interacting with molecular data. To address this, we present ATOM3D, a collection of both novel and existing benchmark datasets spanning several key classes of biomolecules. We implement several classes of three dimensional molecular learning methods for each of these tasks and show that they consistently improve performance relative to methods based on one and two dimensional representations. The specific choice of architecture proves to be critical for performance, with three dimensional convolutional networks excelling at tasks involving complex geometries, graph networks performing well on systems requiring detailed positional information, and the more recently developed equivariant networks showing significant promise. Our results indicate that many molecular problems stand to gain from three dimensional molecular learning, and that there is potential for improvement on many tasks which remain underexplored. To lower the barrier to entry and facilitate further developments in the field, we also provide a comprehensive suite of tools for dataset processing, model training, and evaluation in our open source atom3d Python package. All datasets are available for download from https www.atom3d.ai .


Guided mode resonance filter extended cavity diode laser. We characterize a semiconductor external cavity diode laser whose optical feedback is provided by a guided mode resonance filter (GMRF). We focus on the spectral properties. The wavelength of operation falls in the telecom range (1506 nm). The GMRF acting both as a wavelength intracavity filter and feedback mirror allows for a compact laser design. The single mode operation is verified in a wide range of driving currents. We finely tune the cavity length to adjust the frequency by 14 GHz without mode hops in agreement with the expected free spectral range of the resonator sim 20 GHz. The compactness of the cavity allows fast frequency sweeps when modulating the current (90 MHz mA at 100 kHz, the modulation bandwidth). The frequency noise (366 kHz white noise contribution) is also analysed to evaluate the potential of our design for high resolution applications.