The weak separation in higher dimensions. For an odd integer r 0 and an integer n r , we introduce a notion of weakly r separated collections of subsets of n 1,2, ldots,n . When r 1 , this corresponds to the concept of weak separation introduced by Leclerc and Zelevinsky. In this paper, extending results due to Leclerc Zelevinsky, we develop a geometric approach to establish a number of nice combinatorial properties of maximal weakly r separated collections. As a supplement, we also discuss an analogous concept when r is even.


Recognizing the Tractability in Big Data Computing. Due to the limitation on computational power of existing computers, the polynomial time does not works for identifying the tractable problems in big data computing. This paper adopts the sublinear time as the new tractable standard to recognize the tractability in big data computing, and the random access Turing machine is used as the computational model to characterize the problems that are tractable on big data. First, two pure tractable classes are first proposed. One is the class mathrm PL consisting of the problems that can be solved in polylogarithmic time by a RATM. The another one is the class mathrm ST including all the problems that can be solved in sublinear time by a RATM. The structure of the two pure tractable classes is deeply investigated and they are proved mathrm PL i subsetneq mathrm PL i 1 and mathrm PL subsetneq mathrm ST . Then, two pseudo tractable classes, mathrm PTR and mathrm PTE , are proposed. mathrm PTR consists of all the problems that can solved by a RATM in sublinear time after a PTIME preprocessing by reducing the size of input dataset. mathrm PTE includes all the problems that can solved by a RATM in sublinear time after a PTIME preprocessing by extending the size of input dataset. The relations among the two pseudo tractable classes and other complexity classes are investigated and they are proved that mathrm PT subseteq mathrm P , sqcap' mathrm T 0 Q subsetneq mathrm PTR 0 Q and mathrm PT P mathrm P .


Homomorphisms of planar (m, n) colored mixed graphs to planar targets. An (m, n) colored mixed graph G (V, A 1, A 2, cdots, A m, E 1, E 2, cdots, E n) is a graph having m colors of arcs and n colors of edges. We do not allow two arcs or edges to have the same endpoints. A homomorphism from an (m,n) colored mixed graph G to another (m, n) colored mixed graph H is a morphism varphi V(G) rightarrow V(H) such that each edge (resp. arc) of G is mapped to an edge (resp. arc) of H of the same color (and orientation). An (m,n) colored mixed graph T is said to be P g (m, n) universal if every graph in P g (m, n) (the planar (m, n) colored mixed graphs with girth at least g ) admits a homomorphism to T . We show that planar P g (m, n) universal graphs do not exist for 2m n ge3 (and any value of g ) and find a minimal (in the number vertices) planar P g (m, n) universal graphs in the other cases.


Analysis of infected population threshold exceedance in an SIR epidemiological model. We consider an epidemiological SIR model and a positive threshold M . Using a parametric expression for the solution curve of the SIR model and the Lambert W function, we establish necessary and sufficient conditions on the basic reproduction number mathcal R 0 to ensure that the infected population does not exceed the threshold M . We also propose and analyze different measures to quantify a possible threshold exceedance.


The structure of the blue whirl revealed. The blue whirl is a small, stable, spinning blue flame that evolved spontaneously in laboratory experiments while studying, violent, turbulent fire whirls. The blue whirl cleanly burns heavy, liquid hydrocarbon fuels with no soot production, presenting a new potential way for low emission combustion. It is reproducible, appears for a range of different fuels and initial conditions, is quiet, appears laminar, and has characteristics which led to the idea that it results from vortex breakdown in whirling, reacting fluid. Since its discovery, considerable effort has been put into measurements, which have shown its temperature structure and sensitivity to the boundary layer near the surface. This has led to considerable speculation about the type of flames that comprise it. Simultaneously, there was a numerical effort to study its structure by performing simulations of vortex breakdown in gaseous reactive flows. The simulations described in this paper show that the stable blue whirl is composed of three different flame structures a diffusion flame and a premixed rich and lean flame all of which meet in a fourth structure, a triple flame which appears as a whirling blue ring. In addition, the blue whirl structure emerges as the result of vortex breakdown in a swirling reactive flow, as evidenced in the simulation by a bubble mode that is usually invisible in the experiments but at the center of the whirl. This paper also presents the tool used for the study and discusses how this might be used for future investigations.


Periodic Minimizers of a Ternary Non Local Isoperimetric Problem. We study a two dimensional ternary inhibitory system derived as a sharp interface limit of the Nakazawa Ohta density functional theory of triblock copolymers. This free energy functional combines an interface energy favoring micro domain growth with a Coulomb type long range interaction energy which prevents micro domains from unlimited spreading. Here we consider a limit in which two species are vanishingly small, but interactions are correspondingly large to maintain a nontrivial limit. In this limit two energy levels are distinguished the highest order limit encodes information on the geometry of local structures as a two component isoperimetric problem, while the second level describes the spatial distribution of components in global minimizers. We provide a sharp rigorous derivation of the asymptotic limit, both for minimizers and in the context of Gamma convergence. Geometrical descriptions of limit configurations are derived among other results, we will show that, quite unexpectedly, coexistence of single and double bubbles can arise. The main difficulties are hidden in the optimal solution of two component isoperimetric problem compared to binary systems, not only it lacks an explicit formula, but, more crucially, it can be neither concave nor convex on parts of its domain.


Verifying Cryptographic Security Implementations in C Using Automated Model Extraction. This thesis presents an automated method for verifying security properties of protocol implementations written in the C language. We assume that each successful run of a protocol follows the same path through the C code, justified by the fact that typical security protocols have linear structure. We then perform symbolic execution of that path to extract a model expressed in a process calculus similar to the one used by the CryptoVerif tool. The symbolic execution uses a novel algorithm that allows symbolic variables to represent bitstrings of potentially unknown length to model incoming protocol messages. The extracted models do not use pointer addressed memory, but they may still contain low level details concerning message formats. In the next step we replace the message formatting expressions by abstract tupling and projection operators. The properties of these operators, such as the projection operation being the inverse of the tupling operation, are typically only satisfied with respect to inputs of correct types. Therefore we typecheck the model to ensure that all type safety constraints are satisfied. The resulting model can then be verified with CryptoVerif to obtain a computational security result directly, or with ProVerif, to obtain a computational security result by invoking a computational soundness theorem. Our method achieves high automation and does not require user input beyond what is necessary to specify the properties of the cryptographic primitives and the desired security goals. We evaluated the method on several protocol implementations, totalling over 3000 lines of code. The biggest case study was a 1000 line implementation that was independently written without verification in mind. We found several flaws that were acknowledged and fixed by the authors, and were able to verify the fixed code without any further modifications to it.


Curve Based Approximation of Measures on Manifolds by Discrepancy Minimization. The approximation of probability measures on compact metric spaces and in particular on Riemannian manifoldsby atomic or empirical ones is a classical task in approximation and complexity theory with a wide range of applications. Instead of point measures we are concerned with the approximation by measures supported on Lipschitz curves. Special attention is paid to push forward measures of Lebesgue measures on the interval by such curves. Using the discrepancy as distance between measures, we prove optimal approximation rates in terms of Lipschitz constants of curves. Having established the theoretical convergence rates, we are interested in the numerical minimization of the discrepancy between a given probability measure and the set of push forward measures of Lebesgue measures on the interval by Lipschitz curves. We present numerical examples for measures on the 2 and 3 dimensional torus, the 2 sphere, the rotation group on mathbb R 3 and the Grassmannian of all 2 dimensional linear subspaces of mathbb R 4 . Our algorithm of choice is a conjugate gradient method on these manifolds which incorporates second oder information. For efficiently computing the gradients and the Hessians within the algorithm, we approximate the given measures by truncated Fourier series and use fast Fourier transform techniques on these manifolds.


Positivity of mild solution to stochastic evolution equations with an application to forward rates. We prove a maximum principle for mild solutions to stochastic evolution equations with (locally) Lipschitz coefficients and Wiener noise on weighted L 2 spaces. As an application, we provide sufficient conditions for the positivity of forward rates in the Heath Jarrow Morton model, considering the associated Musiela SPDE on a homogeneous weighted Sobolev space.


Homogeneous 8 manifolds admitting invariant Spin(7) structures. We study compact, simply connected, homogeneous 8 manifolds admitting invariant Spin(7) structures, classifying all canonical presentations G H of such spaces, with G simply connected. For each presentation, we exhibit explicit examples of invariant Spin(7) structures and we describe their type, according to Fern 'andez classification. Finally, we analyse the associated Spin(7) connection with torsion.


Simple, Scalable Adaptation for Neural Machine Translation. Fine tuning pre trained Neural Machine Translation (NMT) models is the dominant approach for adapting to new languages and domains. However, fine tuning requires adapting and maintaining a separate model for each target task. We propose a simple yet efficient approach for adaptation in NMT. Our proposed approach consists of injecting tiny task specific adapter layers into a pre trained model. These lightweight adapters, with just a small fraction of the original model size, adapt the model to multiple individual tasks simultaneously. We evaluate our approach on two tasks (i) Domain Adaptation and (ii) Massively Multilingual NMT. Experiments on domain adaptation demonstrate that our proposed approach is on par with full fine tuning on various domains, dataset sizes and model capacities. On a massively multilingual dataset of 103 languages, our adaptation approach bridges the gap between individual bilingual models and one massively multilingual model for most language pairs, paving the way towards universal machine translation.


Safe and Chaotic Compilation for Hidden Deterministic Hardware Aliasing. Hardware aliasing occurs when the same logical address can access different physical memory locations. This is a problem for software on some embedded systems and more generally when hardware becomes faulty in irretrievable locations, such as on a Mars Lander. We show how to work around the hardware problem with software logic, compiling code so it works on any platform with hardware aliasing with hidden determinism. That is (i) a copy of an address accesses the same location, and (ii) repeating an address calculation exactly will repeat the same access again. Stuck bits can mean that even adding zero to an address can make a difference in that environment so nothing but a systematic approach has a chance of working. The technique is extended to generate aliasing as well as compensate for it, in so called chaotic compilation, and a sketch proof is included to show it may produce object code that is secure against discovery of the programmer's intention. A prototype compiler implementing the technology covers all of ANSI C except longjmp setjmp.


A comparison of remotely sensed and inventory datasets for burned area in Mediterranean Europe. Quantitative estimate of observational uncertainty is an essential ingredient to correctly interpret changes in climatic and environmental variables such as wildfires. In this work we compare four state of the art satellite fire products with the gridded, ground based EFFIS dataset for Mediterranean Europe and analyse their statistical differences. The data are compared for spatial and temporal similarities at different aggregations to identify a spatial scale at which most of the observations provide equivalent results. The results of the analysis indicate that the datasets show high temporal correlation with each other (0.5 0.6) when aggregating the data at resolution of at least 1.0 deg or at NUTS3 level. However, burned area estimates vary widely between datasets. Filtering out satellite fires located on urban and crop land cover classes greatly improves the agreement with EFFIS data. Finally, in spite of the differences found in the area estimates, the spatial pattern is similar for all the datasets, with spatial correlation increasing as the resolution decreases. Also, the general reasonable agreement between satellite products builds confidence in using these datasets and in particular the most recent developed dataset, FireCCI51, shows the best agreement with EFFIS overall. As a result, the main conclusion of the study is that users should carefully consider the limitations of the satellite fire estimates currently available, as their uncertainties cannot be neglected in the overall uncertainty estimate cascade that should accompany global or regional change studies and that removing fires on human dominated land areas is key to analyze forest fires estimation from satellite products.


6D Object Pose Regression via Supervised Learning on Point Clouds. This paper addresses the task of estimating the 6 degrees of freedom pose of a known 3D object from depth information represented by a point cloud. Deep features learned by convolutional neural networks from color information have been the dominant features to be used for inferring object poses, while depth information receives much less attention. However, depth information contains rich geometric information of the object shape, which is important for inferring the object pose. We use depth information represented by point clouds as the input to both deep networks and geometry based pose refinement and use separate networks for rotation and translation regression. We argue that the axis angle representation is a suitable rotation representation for deep learning, and use a geodesic loss function for rotation regression. Ablation studies show that these design choices outperform alternatives such as the quaternion representation and L2 loss, or regressing translation and rotation with the same network. Our simple yet effective approach clearly outperforms state of the art methods on the YCB video dataset. The implementation and trained model are avaliable at https github.com GeeeG CloudPose.


Multifunctional Meta Optic Systems Inversely Designed with Artificial Intelligence. Flat optics foresees a new era of ultra compact optical devices, where metasurfaces serve as the foundation. Conventional designs of metasurfaces start with a certain structure as the prototype, followed by an extensive parametric sweep to accommodate the requirements of phase and amplitude of the emerging light. Regardless of how computation consuming the process is, a predefined structure can hardly realize the independent control over the polarization, frequency, and spatial channels, which hinders the potential of metasurfaces to be multifunctional. Besides, achieving complicated and multiple functions calls for designing a meta optic system with multiple cascading layers of metasurfaces, which introduces super exponential complexity. In this work we present an artificial intelligence framework for designing multilayer meta optic systems with multifunctional capabilities. We demonstrate examples of a polarization multiplexed dual functional beam generator, a second order differentiator for all optical computation, and a space polarization wavelength multiplexed hologram. These examples are barely achievable by single layer metasurfaces and unattainable by traditional design processes.


Revisiting the Late Time Growth of Single mode Rayleigh Taylor Instability and the Role of Vorticity. Growth of the single fluid single mode Rayleigh Taylor instability (RTI) is revisited in 2D and 3D using fully compressible high resolution simulations. We conduct a systematic analysis of the effects of perturbation Reynolds number ( Re p ) and Atwood number ( A ) on RTI's late time growth. Contrary to the common belief that single mode RTI reaches a terminal bubble velocity, we show that the bubble re accelerates when Re p is sufficiently large, consistent with Ramaparabhu et al. 2006, Wei and Livescu 2012 . However, unlike in Ramaparabhu et al. 2006 , we find that for a sufficiently high Re p , the bubble's late time acceleration is persistent and does not vanish. Analysis of vorticity dynamics shows a clear correlation between vortices inside the bubble and re acceleration. Due to symmetry around the bubble and spike (vertical) axes, the self propagation velocity of vortices points in the vertical direction. If viscosity is sufficiently small, the vortices persist long enough to enter the bubble tip and accelerate the bubble Wei and Livescu 2012 . A similar effect has also been observed in ablative RTI Betti and Sanz 2006 . As the spike growth increases relative to that of the bubble at higher A , vorticity production shifts downward, away from the centerline and toward the spike tip. We modify the Betti Sanz model for bubble velocity by introducing a vorticity efficiency factor eta 0.45 to accurately account for re acceleration caused by vorticity in the bubble tip. It had been previously suggested that vorticity generation and the associated bubble re acceleration are suppressed at high A . However, we present evidence that if the large Re p limit is taken first, bubble re acceleration is still possible. Our results also show that re acceleration is much easier to occur in 3D than 2D, requiring smaller Re p thresholds.


The Taylor joint spectrum and restriction to hyperinvariant subspaces. It is well known that for a single bounded operator A 0 on a Hilbert mathfrak H , if mathfrak M subset mathfrak H is hyperinvariant for A 0 , then the spectrum of A 0 mathfrak M is contained in the spectrum of A 0 . In this note, we modify an example of Taylor to prove the following. There exist a quadruple A (A 1,A 2,A 3,A 4) of commuting bounded Hilbert space operators and a hyperinvariant subspace mathfrak X 1 for A such that the Taylor joint spectrum of A restricted to mathfrak X 1 is a not a subset of the Taylor joint spectrum of A .


Dynamic Past and Future for Neural Machine Translation. Previous studies have shown that neural machine translation (NMT) models can benefit from explicitly modeling translated (Past) and untranslated (Future) to groups of translated and untranslated contents through parts to wholes assignment. The assignment is learned through a novel variant of routing by agreement mechanism (Sabour et al., 2017), namely em Guided Dynamic Routing , where the translating status at each decoding step em guides the routing process to assign each source word to its associated group (i.e., translated or untranslated content) represented by a capsule, enabling translation to be made from holistic context. Experiments show that our approach achieves substantial improvements over both RNMT and Transformer by producing more adequate translations. Extensive analysis demonstrates that our method is highly interpretable, which is able to recognize the translated and untranslated contents as expected.


CiwGAN and fiwGAN Encoding information in acoustic data to model lexical learning with Generative Adversarial Networks. How can deep neural networks encode information that corresponds to words in human speech into raw acoustic data? This paper proposes two neural network architectures for modeling unsupervised lexical learning from raw acoustic inputs, ciwGAN (Categorical InfoWaveGAN) and fiwGAN (Featural InfoWaveGAN), that combine a Deep Convolutional GAN architecture for audio data (WaveGAN arXiv 1705.07904) with an information theoretic extension of GAN InfoGAN (arXiv 1606.03657), and propose a new latent space structure that can model featural learning simultaneously with a higher level classification and allows for a very low dimension vector representation of lexical items. Lexical learning is modeled as emergent from an architecture that forces a deep neural network to output data such that unique information is retrievable from its acoustic outputs. The networks trained on lexical items from TIMIT learn to encode unique information corresponding to lexical items in the form of categorical variables in their latent space. By manipulating these variables, the network outputs specific lexical items. The network occasionally outputs innovative lexical items that violate training data, but are linguistically interpretable and highly informative for cognitive modeling and neural network interpretability. Innovative outputs suggest that phonetic and phonological representations learned by the network can be productively recombined and directly paralleled to productivity in human speech a fiwGAN network trained on suit' and dark' outputs innovative start', even though it never saw start' or even a st sequence in the training data. We also argue that setting latent featural codes to values well beyond training range results in almost categorical generation of prototypical lexical items and reveals underlying values of each latent code.


Surface acoustic wave photonic devices in silicon on insulator. Opto mechanical interactions in planar photonic integrated circuits draw great interest in basic research and applications. However, opto mechanics is practically absent in the most technologically significant photonics platform silicon on insulator. Previous demonstrations required the under etching and suspension of silicon structures. Here we present surface acoustic wave photonic devices in silicon on insulator, up to 8 GHz frequency. Surface waves are launched through absorption of modulated pump light in metallic gratings and thermoelastic expansion. The surface waves are detected through photo elastic modulation of an optical probe in standard race track resonators. Devices do not involve piezo electric actuation, suspension of waveguides or hybrid material integration. Wavelength conversion of incident microwave signals and acoustic true time delays up to 40 ns are demonstrated on chip. Lastly, discrete time microwave photonic filters with up to six taps and 20 MHz wide passbands are realized using acoustic delays. The concept is suitable for integrated microwave photonics signal processing


Smoothed Analysis of Trie Height by Star like PFAs. Tries are general purpose data structures for information retrieval. The most significant parameter of a trie is its height H which equals the length of the longest common prefix of any two string in the set A over which the trie is built. Analytical investigations of random tries suggest that bf E (H) in O( log( A )) , although H is unbounded in the worst case. Moreover, sharp results on the distribution function of H are known for many different random string sources. But because of the inherent weakness of the modeling behind average case analysis analyses being dominated by random data these results can utterly explain the fact that in many practical situations the trie height is logarithmic. We propose a new semi random string model and perform a smoothed analysis in order to give a mathematically more rigorous explanation for the practical findings. The perturbation functions which we consider are based on probabilistic finite automata (PFA) and we show that the transition probabilities of the representing PFA completely characterize the asymptotic growth of the smoothed trie height. Our main result is of dichotomous nature logarithmic or unbounded and is certainly not surprising at first glance, but we also give quantitative upper and lower bounds, which are derived using multivariate generating function in order to express the computations of the perturbing PFA. A direct consequence is the logarithmic trie height for edit perturbations(i.e., random insertions, deletions and substitutions).


Two theorems on the outer product of input and output Stokes vectors for deterministic optical systems. 2 times2 complex Jones matrix transforms two dimensional complex Jones vectors into complex Jones vectors and accounts for phase introduced by deterministic optical systems. On the other hand, Mueller Jones matrix transforms four parameter real Stokes vectors into four parameter real Stokes vectors that contain no information about phase. Previously, a 4 times4 complex matrix ( mathbf Z matrix) was introduced. mathbf Z matrix is analogous to the Jones matrix and it is also akin to the Mueller Jones matrix by the relation mathbf M mathbf Z mathbf Z . It was shown that mathbf Z matrix transforms Stokes vectors (Stokes matrices) into complex vectors (complex matrices) that contain relevant phases besides the other information. In this note it is shown that, for deterministic optical systems, there exist two relations between outer product of experimentally measured real input output Stokes vectors and complex vectors (matrices) that represent the polarization state and phase of totally polarized output light.


Cosine meets Softmax A tough to beat baseline for visual grounding. In this paper, we present a simple baseline for visual grounding for autonomous driving which outperforms the state of the art methods, while retaining minimal design choices. Our framework minimizes the cross entropy loss over the cosine distance between multiple image ROI features with a text embedding (representing the give sentence phrase). We use pre trained networks for obtaining the initial embeddings and learn a transformation layer on top of the text embedding. We perform experiments on the Talk2Car dataset and achieve 68.7 AP50 accuracy, improving upon the previous state of the art by 8.6 . Our investigation suggests reconsideration towards more approaches employing sophisticated attention mechanisms or multi stage reasoning or complex metric learning loss functions by showing promise in simpler alternatives.


Sub Finsler horofunction boundaries of the Heisenberg group. We give a complete analytic and geometric description of the horofunction boundary for polygonal sub Finsler metrics that is, those that arise as asymptotic cones of word metrics on the Heisenberg group. We develop theory for the more general case of horofunction boundaries in homogeneous groups by connecting horofunctions to Pansu derivatives of the distance function.


Free boundary minimal surfaces in the unit ball recent advances and open questions. In this survey, we discuss some recent results on free boundary minimal surfaces in the Euclidean unit ball. The subject has been a very active field of research in the past few years due to the seminal work of Fraser and Schoen on the extremal Steklov eigenvalue problem. We review several different techniques of constructing examples of embedded free boundary minimal surfaces in the unit ball. Next, we discuss some uniqueness results for free boundary minimal disks and the conjecture about the uniqueness of critical catenoid. We also discuss several Morse index estimates for free boundary minimal surfaces. Moreover, we describe estimates for the first Steklov eigenvalue on such free boundary minimal surfaces and various smooth compactness results. Finally, we mention some sharp area bounds for free boundary minimal submanifolds and related questions.


Probabilistic 3D Multilabel Real time Mapping for Multi object Manipulation. Probabilistic 3D map has been applied to object segmentation with multiple camera viewpoints, however, conventional methods lack of real time efficiency and functionality of multilabel object mapping. In this paper, we propose a method to generate three dimensional map with multilabel occupancy in real time. Extending our previous work in which only target label occupancy is mapped, we achieve multilabel object segmentation in a single looking around action. We evaluate our method by testing segmentation accuracy with 39 different objects, and applying it to a manipulation task of multiple objects in the experiments. Our mapping based method outperforms the conventional projection based method by 40 96 relative (12.6 mean IU 3d ), and robot successfully recognizes (86.9 ) and manipulates multiple objects (60.7 ) in an environment with heavy occlusions.


A Closer Look at Few shot Classification. Few shot classification aims to learn a classifier to recognize unseen classes during training with limited labeled examples. While significant progress has been made, the growing complexity of network designs, meta learning algorithms, and differences in implementation details make a fair comparison difficult. In this paper, we present 1) a consistent comparative analysis of several representative few shot classification algorithms, with results showing that deeper backbones significantly reduce the performance differences among methods on datasets with limited domain differences, 2) a modified baseline method that surprisingly achieves competitive performance when compared with the state of the art on both the miniI and the CUB datasets, and 3) a new experimental setting for evaluating the cross domain generalization ability for few shot classification algorithms. Our results reveal that reducing intra class variation is an important factor when the feature backbone is shallow, but not as critical when using deeper backbones. In a realistic cross domain evaluation setting, we show that a baseline method with a standard fine tuning practice compares favorably against other state of the art few shot learning algorithms.


A Game Generative Network Framework with its Application to Relationship Inference. A game process is a system where the decisions of one agent can influence the decisions of other agents. In the real world, social influences and relationships between agents may influence the decision makings of agents with game behaviors. And in turn, this also gives us the opportunity to mine such information from agents by the observed interactions of them in a game process. In this paper, we propose a Game Generative Network (GGN) framework that utilizes the deviation between the real game outcome and the ideal game model to generate networks for game processes, which opens a door for understanding agents with game behaviors by network mining approaches. We illustrate how to apply GGNs to infer the hidden relationships between agents with game behaviors and conduct experiments on team games as a concrete example. Experimental results demonstrate that our proposed framework can reveal the hidden relationships of agents in such games.


CATBERT Context Aware Tiny BERT for Detecting Social Engineering Emails. Targeted phishing emails are on the rise and facilitate the theft of billions of dollars from organizations a year. While malicious signals from attached files or malicious URLs in emails can be detected by conventional malware signatures or machine learning technologies, it is challenging to identify hand crafted social engineering emails which don't contain any malicious code and don't share word choices with known attacks. To tackle this problem, we fine tune a pre trained BERT model by replacing the half of Transformer blocks with simple adapters to efficiently learn sophisticated representations of the syntax and semantics of the natural language. Our Context Aware network also learns the context representations between email's content and context features from email headers. Our CatBERT(Context Aware Tiny Bert) achieves a 87 detection rate as compared to DistilBERT, LSTM, and logistic regression baselines which achieve 83 , 79 , and 54 detection rates at false positive rates of 1 , respectively. Our model is also faster than competing transformer approaches and is resilient to adversarial attacks which deliberately replace keywords with typos or synonyms.


Differential Privacy Via a Truncated and Normalized Laplace Mechanism. When querying databases containing sensitive information, the privacy of individuals stored in the database has to be guaranteed. Such guarantees are provided by differentially private mechanisms which add controlled noise to the query responses. However, most such mechanisms do not take into consideration the valid range of the query being posed. Thus, noisy responses that fall outside of this range may potentially be produced. To rectify this and therefore improve the utility of the mechanism, the commonly used Laplace distribution can be truncated to the valid range of the query and then normalized. However, such a data dependent operation of normalization leaks additional information about the true query response thereby violating the differential privacy guarantee. Here, we propose a new method which preserves the differential privacy guarantee through a careful determination of an appropriate scaling parameter for the Laplace distribution. We also generalize the privacy guarantee in the context of the Laplace distribution to account for data dependent normalization factors and study this guarantee for different classes of range constraint configurations. We provide derivations of the optimal scaling parameter (i.e., the minimal value that preserves differential privacy) for each class or provide an approximation thereof. As a consequence of this work, one can use the Laplace distribution to answer queries in a range adherent and differentially private manner.


Predictive K means with local models. Supervised classification can be effective for prediction but sometimes weak on interpretability or explainability (XAI). Clustering, on the other hand, tends to isolate categories or profiles that can be meaningful but there is no guarantee that they are useful for labels prediction. Predictive clustering seeks to obtain the best of the two worlds. Starting from labeled data, it looks for clusters that are as pure as possible with regards to the class labels. One technique consists in tweaking a clustering algorithm so that data points sharing the same label tend to aggregate together. With distance based algorithms, such as k means, a solution is to modify the distance used by the algorithm so that it incorporates information about the labels of the data points. In this paper, we propose another method which relies on a change of representation guided by class densities and then carries out clustering in this new representation space. We present two new algorithms using this technique and show on a variety of data sets that they are competitive for prediction performance with pure supervised classifiers while offering interpretability of the clusters discovered.


Deep Face Representations for Differential Morphing Attack Detection. The vulnerability of facial recognition systems to face morphing attacks is well known. Many different approaches for morphing attack detection have been proposed in the scientific literature. However, the morphing attack detection algorithms proposed so far have only been trained and tested on datasets whose distributions of image characteristics are either very limited (e.g. only created with a single morphing tool) or rather unrealistic (e.g. no print scan transformation). As a consequence, these methods easily overfit on certain image types and the results presented cannot be expected to apply to real world scenarios. For example, the results of the latest NIST Face Recognition Vendor Test MORPH show that the submitted MAD algorithms lack robustness and performance when considering unseen and challenging datasets. In this work, subsets of the FERET and FRGCv2 face databases are used to create a large realistic database for training and testing of morphing attack detection algorithms, containing a large number of ICAO compliant bona fide facial images, corresponding unconstrained probe images, and morphed images created with four different tools. Furthermore, multiple post processings are applied on the reference images, e.g. print scan and JPEG2000 compression. On this database, previously proposed differential morphing algorithms are evaluated and compared. In addition, the application of deep face representations for differential morphing attack detection algorithms is investigated. It is shown that algorithms based on deep face representations can achieve very high detection performance (less than 3 mbox D EER ) and robustness with respect to various post processings. Finally, the limitations of the developed methods are analyzed.


Multilevel Monte Carlo estimation of the expected value of sample information. We study Monte Carlo estimation of the expected value of sample information (EVSI) which measures the expected benefit of gaining additional information for decision making under uncertainty. EVSI is defined as a nested expectation in which an outer expectation is taken with respect to one random variable Y and an inner conditional expectation with respect to the other random variable theta . Although the nested (Markov chain) Monte Carlo estimator has been often used in this context, a root mean square accuracy of varepsilon is achieved notoriously at a cost of O( varepsilon 2 1 alpha ) , where alpha denotes the order of convergence of the bias and is typically between 1 2 and 1 . In this article we propose a novel efficient Monte Carlo estimator of EVSI by applying a multilevel Monte Carlo (MLMC) method. Instead of fixing the number of inner samples for theta as done in the nested Monte Carlo estimator, we consider a geometric progression on the number of inner samples, which yields a hierarchy of estimators on the inner conditional expectation with increasing approximation levels. Based on an elementary telescoping sum, our MLMC estimator is given by a sum of the Monte Carlo estimates of the differences between successive approximation levels on the inner conditional expectation. We show, under a set of assumptions on decision and information models, that successive approximation levels are tightly coupled, which directly proves that our MLMC estimator improves the necessary computational cost to optimal O( varepsilon 2 ) . Numerical experiments confirm the considerable computational savings as compared to the nested Monte Carlo estimator.


Laser excited super resolution thermal imaging for nondestructive inspection of internal defects. A photothermal super resolution technique is proposed for an improved inspection of internal defects. To evaluate the potential of the laser based thermographic technique, an additively manufactured stainless steel specimen with closely spaced internal cavities is used. Four different experimental configurations in transmission, reflection, stepwise and continuous scanning are investigated. The applied image post processing method is based on compressed sensing and makes use of the block sparsity from multiple measurement events. This concerted approach of experimental measurement strategy and numerical optimization enables the resolution of internal defects and outperforms conventional thermographic inspection techniques.


Automated Composition of Picture Synched Music Soundtracks for Movies. We describe the implementation of and early results from a system that automatically composes picture synched musical soundtracks for videos and movies. We use the phrase "picture synched" to mean that the structure of the automatically composed music is determined by visual events in the input movie, i.e. the final music is synchronised to visual events and features such as cut transitions or within shot key frame events. Our system combines automated video analysis and computer generated music composition techniques to create unique soundtracks in response to the video input, and can be thought of as an initial step in creating a computerised replacement for a human composer writing music to fit the picture locked edit of a movie. Working only from the video information in the movie, key features are extracted from the input video, using video analysis techniques, which are then fed into a machine learning based music generation tool, to compose a piece of music from scratch. The resulting soundtrack is tied to video features, such as scene transition markers and scene level energy values, and is unique to the input video. Although the system we describe here is only a preliminary proof of concept, user evaluations of the output of the system have been positive.


Animal Detection in Man made Environments. Automatic detection of animals that have strayed into human inhabited areas has important security and road safety applications. This paper attempts to solve this problem using deep learning techniques from a variety of computer vision fields including object detection, tracking, segmentation and edge detection. Several interesting insights into transfer learning are elicited while adapting models trained on benchmark datasets for real world deployment. Empirical evidence is presented to demonstrate the inability of detectors to generalize from training images of animals in their natural habitats to deployment scenarios of man made environments. A solution is also proposed using semi automated synthetic data generation for domain specific training. Code and data used in the experiments are made available to facilitate further work in this domain.


Real hypersurfaces in the complex quadric with Reeb parallel structure Jacobi operator. In this paper, we first introduce the full express of the Riemannian curvature tensor of a real hypersurface M in complex quadric Q m from the equation of Gauss. Next we derive a formula for the structure Jacobi operator R xi and its derivative under the Levi Civita connection of M . We give a complete classification of Hopf real hypersurfaces with Reeb parallel structure Jacobi operator, nabla xi R xi 0 , in the complex quadric Q m , m geq 3 .


Bandwidth Cost of Code Conversions in Distributed Storage Fundamental Limits and Optimal Constructions. Erasure codes have become an integral part of distributed storage systems as a tool for providing data reliability and durability under the constant threat of device failures. In such systems, an n, k code over a finite field mathbb F q encodes k message symbols into n codeword symbols from mathbb F q which are then stored on n different nodes in the system. Recent work has shown that significant savings in storage space can be obtained by tuning n and k to variations in device failure rates. Such a tuning necessitates code conversion the process of converting already encoded data under an initial n I, k I code to its equivalent under a final n F, k F code. The default approach to conversion is to reencode data, which places significant burden on system resources. Convertible codes are a recently proposed class of codes for enabling resource efficient conversions. Existing work on convertible codes has focused on minimizing access cost, i.e., the number of code symbols accessed during conversion. Bandwidth, which corresponds to the amount of data read and transferred, is another important resource to optimize. In this paper, we initiate the study on the fundamental limits on bandwidth used during code conversion and present constructions for bandwidth optimal convertible codes. First, we model the code conversion problem using network information flow graphs with variable capacity edges. Second, focusing on MDS codes and an important parameter regime called the merge regime, we derive tight lower bounds on the bandwidth cost of conversion. The derived bounds show that bandwidth cost can be significantly reduced even in regimes where access cost cannot be reduced as compared to the default approach. Third, we present a new construction for MDS convertible codes which matches the proposed lower bound and is thus bandwidth optimal during conversion.


Manifold Approximations via Transported Subspaces Model reduction for transport dominated problems. This work presents a method for constructing online efficient reduced models of large scale systems governed by parametrized nonlinear scalar conservation laws. The solution manifolds induced by transport dominated problems such as hyperbolic conservation laws typically exhibit nonlinear structures, which means that traditional model reduction methods based on linear approximations are inefficient when applied to these problems. In contrast, the approach introduced in this work derives reduced approximations that are nonlinear by explicitly composing global transport dynamics with locally linear approximations of the solution manifolds. A time stepping scheme evolves the nonlinear reduced models by transporting local approximation spaces along the characteristic curves of the governing equations. The proposed computational procedure allows an offline online decomposition and is online efficient in the sense that the complexity of accurately time stepping the nonlinear reduced model is independent of that of the full model. Numerical experiments with transport through heterogeneous media and the Burgers' equation show orders of magnitude speedups of the proposed nonlinear reduced models based on transported subspaces compared to traditional linear reduced models and full models.


Hierarchically Refined Label Attention Network for Sequence Labeling. CRF has been used as a powerful model for statistical sequence labeling. For neural sequence labeling, however, BiLSTM CRF does not always lead to better results compared with BiLSTM softmax local classification. This can be because the simple Markov label transition model of CRF does not give much information gain over strong neural encoding. For better representing label sequences, we investigate a hierarchically refined label attention network, which explicitly leverages label embeddings and captures potential long term label dependency by giving each word incrementally refined label distributions with hierarchical attention. Results on POS tagging, NER and CCG supertagging show that the proposed model not only improves the overall tagging accuracy with similar number of parameters, but also significantly speeds up the training and testing compared to BiLSTM CRF.


Vision and Language from Visual Perception to Content Creation. Vision and language are two fundamental capabilities of human intelligence. Humans routinely perform tasks through the interactions between vision and language, supporting the uniquely human capacity to talk about what they see or hallucinate a picture on a natural language description. The valid question of how language interacts with vision motivates us researchers to expand the horizons of computer vision area. In particular, "vision to language" is probably one of the most popular topics in the past five years, with a significant growth in both volume of publications and extensive applications, e.g., captioning, visual question answering, visual dialog, language navigation, etc. Such tasks boost visual perception with more comprehensive understanding and diverse linguistic representations. Going beyond the progresses made in "vision to language," language can also contribute to vision understanding and offer new possibilities of visual content creation, i.e., "language to vision." The process performs as a prism through which to create visual content conditioning on the language inputs. This paper reviews the recent advances along these two dimensions "vision to language" and "language to vision." More concretely, the former mainly focuses on the development of image video captioning, as well as typical encoder decoder structures and benchmarks, while the latter summarizes the technologies of visual content creation. The real world deployment or services of vision and language are elaborated as well.


The Lexicographic Method for the Threshold Cover Problem. Threshold graphs are a class of graphs that have many equivalent definitions and have applications in integer programming and set packing problems. A graph is said to have a threshold cover of size k if its edges can be covered using k threshold graphs. Chv 'atal and Hammer, in 1977, defined the threshold dimension mathrm th (G) of a graph G to be the least integer k such that G has a threshold cover of size k and observed that mathrm th (G) geq chi(G ) , where G is a suitably constructed auxiliary graph. Raschle and Simon Proceedings of the Twenty seventh Annual ACM Symposium on Theory of Computing, STOC '95, pages 650 661, 1995 proved that mathrm th (G) chi(G ) whenever G is bipartite. We show how the lexicographic method of Hell and Huang can be used to obtain a completely new and, we believe, simpler proof for this result. For the case when G is a split graph, our method yields a proof that is much shorter than the ones known in the literature.


Biometric Backdoors A Poisoning Attack Against Unsupervised Template Updating. In this work, we investigate the concept of biometric backdoors a template poisoning attack on biometric systems that allows adversaries to stealthily and effortlessly impersonate users in the long term by exploiting the template update procedure. We show that such attacks can be carried out even by attackers with physical limitations (no digital access to the sensor) and zero knowledge of training data (they know neither decision boundaries nor user template). Based on the adversaries' own templates, they craft several intermediate samples that incrementally bridge the distance between their own template and the legitimate user's. As these adversarial samples are added to the template, the attacker is eventually accepted alongside the legitimate user. To avoid detection, we design the attack to minimize the number of rejected samples. We design our method to cope with the weak assumptions for the attacker and we evaluate the effectiveness of this approach on state of the art face recognition pipelines based on deep neural networks. We find that in scenarios where the deep network is known, adversaries can successfully carry out the attack over 70 of cases with less than ten injection attempts. Even in black box scenarios, we find that exploiting the transferability of adversarial samples from surrogate models can lead to successful attacks in around 15 of cases. Finally, we design a poisoning detection technique that leverages the consistent directionality of template updates in feature space to discriminate between legitimate and malicious updates. We evaluate such a countermeasure with a set of intra user variability factors which may present the same directionality characteristics, obtaining equal error rates for the detection between 7 14 and leading to over 99 of attacks being detected after only two sample injections.


MicroNet Towards Image Recognition with Extremely Low FLOPs. In this paper, we present MicroNet, which is an efficient convolutional neural network using extremely low computational cost (e.g. 6 MFLOPs on ImageNet classification). Such a low cost network is highly desired on edge devices, yet usually suffers from a significant performance degradation. We handle the extremely low FLOPs based upon two design principles (a) avoiding the reduction of network width by lowering the node connectivity, and (b) compensating for the reduction of network depth by introducing more complex non linearity per layer. Firstly, we propose Micro Factorized convolution to factorize both pointwise and depthwise convolutions into low rank matrices for a good tradeoff between the number of channels and input output connectivity. Secondly, we propose a new activation function, named Dynamic Shift Max, to improve the non linearity via maxing out multiple dynamic fusions between an input feature map and its circular channel shift. The fusions are dynamic as their parameters are adapted to the input. Building upon Micro Factorized convolution and dynamic Shift Max, a family of MicroNets achieve a significant performance gain over the state of the art in the low FLOP regime. For instance, MicroNet M1 achieves 61.1 top 1 accuracy on ImageNet classification with 12 MFLOPs, outperforming MobileNetV3 by 11.3 .


A greedoid and a matroid inspired by Bhargava's p orderings. Consider a finite set E . Assume that each e in E has a "weight" w left(e right) in mathbb R assigned to it, and any two distinct e, f in E have a "distance" d left(e, f right) d left(f, e right) in mathbb R assigned to them, such that the distances satisfy the ultrametric triangle inequality d(a,b) leqslant max left d(a,c),d(b,c) right . We look for a subset of E of given size with maximum perimeter (where the perimeter is defined by summing the weights of all elements and their pairwise distances). We show that any such subset can be found by a greedy algorithm (which starts with the empty set, and then adds new elements one by one, maximizing the perimeter at each step). We use this to define numerical invariants, and also to show that the maximum perimeter subsets of all sizes form a strong greedoid, and the maximum perimeter subsets of any given size are the bases of a matroid. This essentially generalizes the " P orderings" constructed by Bhargava in order to define his generalized factorials, and is also similar to the strong greedoid of maximum diversity subsets in phylogenetic trees studied by Moulton, Semple and Steel. We further discuss some numerical invariants of E, w, d stemming from this construction, as well as an analogue where maximum perimeter subsets are replaced by maximum perimeter tuples (i.e., elements can appear multiple times).


The Hahn embedding theorem for a class of residuated semigroups. Hahn's embedding theorem asserts that linearly ordered abelian groups embed in some lexicographic product of real groups. Hahn's theorem is generalized to a class of residuated semigroups in this paper, namely, to odd involutive commutative residuated chains which possess only finitely many idempotent elements. To this end, the partial sublex product construction is introduced to construct new odd involutive commutative residuated lattices from a pair of odd involutive commutative residuated lattices, and a representation theorem for odd involutive commutative residuated chains which possess only finitely many idempotent elements, by means of linearly ordered abelian groups and the partial sublex product construction is presented.


Understanding Classifier Mistakes with Generative Models. Although deep neural networks are effective on supervised learning tasks, they have been shown to be brittle. They are prone to overfitting on their training distribution and are easily fooled by small adversarial perturbations. In this paper, we leverage generative models to identify and characterize instances where classifiers fail to generalize. We propose a generative model of the features extracted by a classifier, and show using rigorous hypothesis testing that errors tend to occur when features are assigned low probability by our model. From this observation, we develop a detection criteria for samples on which a classifier is likely to fail at test time. In particular, we test against three different sources of classification failures mistakes made on the test set due to poor model generalization, adversarial samples and out of distribution samples. Our approach is agnostic to class labels from the training set which makes it applicable to models trained in a semi supervised way.


Certified lattice reduction. Quadratic form reduction and lattice reduction are fundamental tools in computational number theory and in computer science, especially in cryptography. The celebrated Lenstra Lenstra Lov 'asz reduction algorithm (so called LLL) has been improved in many ways through the past decades and remains one of the central methods used for reducing integral lattice basis. In particular, its floating point variants where the rational arithmetic required by Gram Schmidt orthogonalization is replaced by floating point arithmetic are now the fastest known. However, the systematic study of the reduction theory of real quadratic forms or, more generally, of real lattices is not widely represented in the literature. When the problem arises, the lattice is usually replaced by an integral approximation of (a multiple of) the original lattice, which is then reduced. While practically useful and proven in some special cases, this method doesn't offer any guarantee of success in general. In this work, we present an adaptive precision version of a generalized LLL algorithm that covers this case in all generality. In particular, we replace floating point arithmetic by Interval Arithmetic to certify the behavior of the algorithm. We conclude by giving a typical application of the result in algebraic number theory for the reduction of ideal lattices in number fields.


Wall crossing from Lagrangian Cobordisms. Biran and Cornea showed that monotone Lagrangian cobordisms give an equivalence of objects in the Fukaya category. However, there are currently no known non trivial examples of monotone Lagrangian cobordisms with two ends. We look at an extension of their theory to the pearly model of Lagrangian Floer cohomology and unobstructed Lagrangian cobordisms. In particular, we examine the suspension cobordism of a Hamiltonian isotopy and the Haug mutation cobordism between mutant Lagrangian surfaces. In both cases, we show that these Lagrangian cobordisms can be unobstructed by bounding cochain and additionally induce an A infty homomorphism between the Floer cohomology of the ends. This gives a first example of a two ended Lagrangian cobordism giving a non trivial equivalence of Lagrangian Floer cohomology. A brief computation is also included which shows that the incorporation of bounding cochain from this equivalence accounts for the "instanton corrections" considered by Auroux, Ekholm, Pascaleff, Rizell, and Tonkonog for the wall crossing formula between Chekanov and product tori in ( mathbb C 2) setminus z 1z 2 1 . We additionally prove some auxiliary results that may be of independent interest. These include a weakly filtered version of the Whitehead theorem for A infty algebras and an extension of Charest Woodward's stabilizing divisor model of Lagrangian Floer cohomology to Lagrangian cobordisms.


Weakly Supervised Segmentation of Cracks on Solar Cells using Normalized Lp Norm. Photovoltaic is one of the most important renewable energy sources for dealing with world wide steadily increasing energy consumption. This raises the demand for fast and scalable automatic quality management during production and operation. However, the detection and segmentation of cracks on electroluminescence (EL) images of mono or polycrystalline solar modules is a challenging task. In this work, we propose a weakly supervised learning strategy that only uses image level annotations to obtain a method that is capable of segmenting cracks on EL images of solar cells. We use a modified ResNet 50 to derive a segmentation from network activation maps. We use defect classification as a surrogate task to train the network. To this end, we apply normalized Lp normalization to aggregate the activation maps into single scores for classification. In addition, we provide a study how different parameterizations of the normalized Lp layer affect the segmentation performance. This approach shows promising results for the given task. However, we think that the method has the potential to solve other weakly supervised segmentation problems as well.


On the vanishing viscosity limit for 2D incompressible flows with unbounded vorticity. We show strong convergence of the vorticities in the vanishing viscosity limit for the incompressible Navier Stokes equations on the two dimensional torus, assuming only that the initial vorticity of the limiting Euler equations is in L p for some p 1 . This substantially extends a recent result of Constantin, Drivas and Elgindi, who proved strong convergence in the case p infty . Our proof, which relies on the classical renormalization theory of DiPerna Lions, is surprisingly simple.


Invariant curves for endomorphisms of mathbb P 1 times mathbb P 1 . Let A 1, A 2 in mathbb C(z) be rational functions of degree at least two that are neither Latt es maps nor conjugate to z pm n or pm T n. We describe invariant, periodic, and preperiodic algebraic curves for endomorphisms of ( mathbb P 1( mathbb C)) 2 of the form (z 1,z 2) rightarrow (A 1(z 1),A 2(z 2)). In particular, we show that if A in mathbb C(z) is not a generalized Latt es map'', then any (A,A) invariant curve has genus zero and can be parametrized by rational functions commuting with A . As an application, for A defined over a subfield K of mathbb C we give a criterion for a point of ( mathbb P 1(K)) 2 to have a Zariski dense (A, A) orbit in terms of canonical heights, and deduce from this criterion a version of a conjecture of Zhang on the existence of rational points with Zariski dense forward orbits. We also prove a result about functional decompositions of iterates of rational functions, which implies in particular that there exist at most finitely many (A 1, A 2) invariant curves of any given bi degree (d 1,d 2).


Local limit theorems for subgraph counts. We introduce a general framework for studying anticoncentration and local limit theorems for random variables, including graph statistics. Our methods involve an interplay between Fourier analysis, decoupling, hypercontractivity of Boolean functions, and transference between fixed size'' and independent'' models. We also adapt a notion of graph factors'' due to Janson. As a consequence, we derive a local central limit theorem for connected subgraph counts in the Erd H o s Renyi random graph G(n,p) , building on work of Gilmer and Kopparty and of Berkowitz. These results improve an anticoncentration result of Fox, Kwan, and Sauermann and partially answers a question of Fox, Kwan, and Sauermann. We also derive a local limit central limit theorem for induced subgraph counts, as long as p is bounded away from a set of problematic'' densities, partially answering a question of Fox, Kwan, and Sauermann. We then prove these restrictions are necessary by exhibiting a disconnected graph for which anticoncentration for subgraph counts at the optimal scale fails for all constant p , and finding a graph H for which anticoncentration for induced subgraph counts fails in G(n,1 2) . These counterexamples resolve anticoncentration conjectures of Fox, Kwan, and Sauermann in the negative. Finally, we also examine the behavior of counts of k term arithmetic progressions in subsets of mathbb Z n mathbb Z and deduce a local limit theorem wherein the behavior is Gaussian at a global scale but has nontrivial local oscillations (according to a Ramanujan theta function). These results improve on results of and answer questions of the authors and Berkowitz, and answer a question of Fox, Kwan, and Sauermann.


Sequent Type Proof Systems for Three Valued Default Logic. Sequent type proof systems constitute an important and widely used class of calculi well suited for analysing proof search. In my master's thesis, I introduce sequent type calculi for a variant of default logic employing Lukasiewicz's three valued logic as the underlying base logic. This version of default logic has been introduced by Radzikowska addressing some representational shortcomings of standard default logic. More specifically, the calculi discussed in my thesis axiomatise brave and skeptical reasoning for this version of default logic, respectively following the sequent method first introduced in the context of nonmonotonic reasoning by Bonatti and Olivetti, which employ a complementary calculus for axiomatising invalid formulas, taking care of expressing the consistency condition of defaults.


Research on Evaluation Model of Road Congestion of Tourist Attraction Based on Spatial Syntax and Neural Network Method A Case of Gulangyu Island,Xiamen,China. In order to more accurately predict the pedestrian flow and understand the interactive relationship between tourist space and pedestrians, this paper uses spatial syntax and neural network methods to construct an evaluation model of tourist road congestion. This model makes full use of the advantages of neural network method and spatial syntax. For example, neural network method can objectively and dynamically assign the weight of attractions, and it can estimate the weight of other attractions through training. Analysis, we can clearly understand the connection relationship between roads then we use mathematical formulas to effectively combine the road network structure and landscape attractions, which can correspond to the street network structure, the distribution of attractions and pedestrian movement The ability to estimate road congestion in low and inconsistent situations. We experimented with Gulangyu Island in Xiamen. As a result, we found that 1.the attractions of Gulangyu Island are mainly located on the edge of the island, and the attraction of several attractions that sell tickets reaches above 0.9 2.The topological model of spatial syntax can better predict the walking results of tourists in Gulangyu Island 3.The road accessibility and the distribution of scenic spots in Gulangyu Island have no great spatial correlation, but the model can predict the degree of road congestion To bring it closer to the truth. The results of our research can be used as a basis for future tourism space management and can enrich the research of tourism space.


Introducing Orthogonal Constraint in Structural Probes. With the recent success of pre trained models in NLP, a significant focus was put on interpreting their representations. One of the most prominent approaches is structural probing (Hewitt and Manning, 2019), where a linear projection of word embeddings is performed in order to approximate the topology of dependency structures. In this work, we introduce a new type of structural probing, where the linear projection is decomposed into 1. isomorphic space rotation 2. linear scaling that identifies and scales the most relevant dimensions. In addition to syntactic dependency, we evaluate our method on novel tasks (lexical hypernymy and position in a sentence). We jointly train the probes for multiple tasks and experimentally show that lexical and syntactic information is separated in the representations. Moreover, the orthogonal constraint makes the Structural Probes less vulnerable to memorization.


Representing Ambiguity in Registration Problems with Conditional Invertible Neural Networks. Image registration is the basis for many applications in the fields of medical image computing and computer assisted interventions. One example is the registration of 2D X ray images with preoperative three dimensional computed tomography (CT) images in intraoperative surgical guidance systems. Due to the high safety requirements in medical applications, estimating registration uncertainty is of a crucial importance in such a scenario. However, previously proposed methods, including classical iterative registration methods and deep learning based methods have one characteristic in common They lack the capacity to represent the fact that a registration problem may be inherently ambiguous, meaning that multiple (substantially different) plausible solutions exist. To tackle this limitation, we explore the application of invertible neural networks (INN) as core component of a registration methodology. In the proposed framework, INNs enable going beyond point estimates as network output by representing the possible solutions to a registration problem by a probability distribution that encodes different plausible solutions via multiple modes. In a first feasibility study, we test the approach for a 2D 3D registration setting by registering spinal CT volumes to X ray images. To this end, we simulate the X ray images taken by a C Arm with multiple orientations using the principle of digitially reconstructed radiographs (DRRs). Due to the symmetry of human spine, there are potentially multiple substantially different poses of the C Arm that can lead to similar projections. The hypothesis of this work is that the proposed approach is able to identify multiple solutions in such ambiguous registration problems.


Simultaneous drone localisation and wind turbine model fitting during autonomous surface inspection. We present a method for simultaneous localisation and wind turbine model fitting for a drone performing an automated surface inspection. We use a skeletal parameterisation of the turbine that can be easily integrated into a non linear least squares optimiser, combined with a pose graph representation of the drone's 3 D trajectory, allowing us to optimise both sets of parameters simultaneously. Given images from an onboard camera, we use a CNN to infer projections of the skeletal model, enabling correspondence constraints to be established through a cost function. This is then coupled with GPS IMU measurements taken at key frames in the graph to allow successive optimisation as the drone navigates around the turbine. We present two variants of the cost function, one based on traditional 2D point correspondences and the other on direct image interpolation within the inferred projections. Results from experiments on simulated and real world data show that simultaneous optimisation provides improvements to localisation over only optimising the pose and that combined use of both cost functions proves most effective.


Subject independent Human Pose Image Construction with Commodity Wi Fi. Recently, commodity Wi Fi devices have been shown to be able to construct human pose images, i.e., human skeletons, as fine grained as cameras. Existing papers achieve good results when constructing the images of subjects who are in the prior training samples. However, the performance drops when it comes to new subjects, i.e., the subjects who are not in the training samples. This paper focuses on solving the subject generalization problem in human pose image construction. To this end, we define the subject as the domain. Then we design a Domain Independent Neural Network (DINN) to extract subject independent features and convert them into fine grained human pose images. We also propose a novel training method to train the DINN and it has no re training overhead comparing with the domain adversarial approach. We build a prototype system and experimental results demonstrate that our system can construct fine grained human pose images of new subjects with commodity Wi Fi in both the visible and through wall scenarios, which shows the effectiveness and the subject generalization ability of our model.


New binary self dual codes via a generalization of the four circulant construction. In this work, we generalize the four circulant construction for self dual codes. By applying the constructions over the alphabets F 2, F 2 uF 2, F 4 uF 4, we were able to obtain extremal binary self dual codes of lengths 40, 64 including new extremal binary self dual codes of length 68. More precisely, 43 new extremal binary self dual codes of length 68, with rare new parameters have been constructed.


Finitely generated abelian groups of units. In 1960 Fuchs posed the problem of characterizing the groups which are the groups of units of commutative rings. In the following years, some partial answers have been given to this question in particular cases. In this paper we address Fuchs' question for it finitely generated abelian groups and we consider the problem of characterizing those groups which arise in some fixed classes of rings mathcal C , namely the integral domains, the torsion free rings and the reduced rings. To determine the realizable groups we have to establish what finite abelian groups T (up to isomorphism) occur as torsion subgroup of A when A varies in mathcal C , and on the other hand, we have to determine what are the possible values of the rank of A when (A ) tors cong T . Most of the paper is devoted to the study of the class of torsion free rings, which needs a substantially deeper study.


A study of the U.S. domestic air transportation network Temporal evolution of network topology and robustness from 2001 to 2016. The U.S. air transportation network (ATN) is critical to the mobility and the functioning of the United States. It is thus necessary to ensure that it is well connected, efficient, and robust. Despite extensive research on its topology, the temporal evolution of the network's robustness and tolerance remains largely unexplored. In the present paper, a temporal study of the domestic U.S. ATN was performed based on annual flight data from 1996 to 2016 and network analytics were used to examine the effects of restructuring that followed the 9 11 events along with the current state of the system. Centrality measures were computed to assess the system's topology and its global robustness. A node deletion method was applied to assess the network's tolerance by simulating a targeted attack scenario. The study showed that the 9 11 terrorist attacks triggered vast restructuring of the network, in terms of efficiency and security. Air traffic expanded, as new airports and air routes were introduced. Airlines reconsidered their strategy and optimized their operations, thus allowing the network to recover rapidly and become even more efficient. Security concerns resulted in significant improvement of the network's robustness. Since 2001, the global traffic and topological properties of the U.S. ATN have displayed continuous growth, due to the network's expansion. On the other hand, the robustness of the system has not shown an improving tendency. Findings suggest that although the system's ability to sustain its operational level under extreme circumstances has lately improved, its tolerance to targeted attacks has deteriorated. The presented methodology may be applied on different network levels or different transportation networks, to provide a general perspective of the system's vulnerabilities.


On pattern formation in reaction diffusion systems containing self and cross diffusion. In this article we propose a unified framework in order to study reaction diffusion systems containing self and cross diffusion using a free energy approach. This framework naturally leads to the formulation of an energy law, and to a numerical method respecting a discrete version of the latter. It constitutes an alternative method and complements the standard linear stability analysis, as it allows for the numerical study of nonlinear patterns, while monitoring the energy evolution, even in complex geometries. As an application, we propose and study a modified Gray Scott system augmented with self and cross diffusion terms. Numerical simulations unveil original patterns, clearly distinct from those obtained with linear diffusion only


ECCOLA a Method for Implementing Ethically Aligned AI Systems. Various recent Artificial Intelligence (AI) system failures, some of which have made the global headlines, have highlighted issues in these systems. These failures have resulted in calls for more ethical AI systems that better take into account their effects on various stakeholders. However, implementing AI ethics into practice is still an on going challenge. High level guidelines for doing so exist, devised by governments and private organizations alike, but lack practicality for developers. To address this issue, in this paper, we present a method for implementing AI ethics. The method, ECCOLA, has been iteratively developed using a cyclical action design research approach. The method aims at making the high level AI ethics principles more practical, making it possible for developers to more easily implement them in practice.


Simulations of particle tracking in the oligociliated mouse node and implications for left right symmetry breaking mechanics. The concept of internal anatomical asymmetry is familiar usually in humans the heart is on the left and the liver is on the right, however how does the developing embryo know to produce this consistent laterality? Symmetry breaking initiates with left right asymmetric cilia driven fluid mechanics in a small fluid filled structure called the ventral node in mice. However the question of what converts this flow into left right asymmetric development remains unanswered. A leading hypotheses is that flow transports morphogen containing vesicles within the node, the absorption of which results in asymmetrical gene expression. To investigate how vesicle transport might result in the situs patterns observed in wildtype and mutant experiments, we extend the open source Stokes flow package, NEAREST, to consider the hydrodynamic and Brownian motion of particles in a mouse model with flow driven by one, two, and 112 beating cilia. Three models for morphogen containing particle released are simulated to assess their compatibility with observed results in oligociliated and wildtype mouse embryos uniformly random release, localised cilium stress induced release, and localised release from motile cilia themselves. Only the uniformly random release model appears consistent with the data, with neither localised release model resulting in significant transport in the oligociliated embryo.


Solving p adic polynomial systems via iterative eigenvector algorithms. In this article, we describe an implementation of a polynomial system solver to compute the approximate solutions of a 0 dimensional polynomial system with finite precision p adic arithmetic. We also describe an improvement to an algorithm of Caruso, Roe, and Vaccon for calculating the eigenvalues and eigenvectors of a p adic matrix.


Packet Chasing Spying on Network Packets over a Cache Side Channel. This paper presents Packet Chasing, an attack on the network that does not require access to the network, and works regardless of the privilege level of the process receiving the packets. A spy process can easily probe and discover the exact cache location of each buffer used by the network driver. Even more useful, it can discover the exact sequence in which those buffers are used to receive packets. This then enables packet frequency and packet sizes to be monitored through cache side channels. This allows both covert channels between a sender and a remote spy with no access to the network, as well as direct attacks that can identify, among other things, the web page access patterns of a victim on the network. In addition to identifying the potential attack, this work proposes a software based short term mitigation as well as a light weight, adaptive, cache partitioning mitigation that blocks the interference of I O and CPU requests in the last level cache.


PR Product A Substitute for Inner Product in Neural Networks. In this paper, we analyze the inner product of weight vector w and data vector x in neural networks from the perspective of vector orthogonal decomposition and prove that the direction gradient of w decreases with the angle between them close to 0 or pi . We propose the Projection and Rejection Product (PR Product) to make the direction gradient of w independent of the angle and consistently larger than the one in standard inner product while keeping the forward propagation identical. As a reliable substitute for standard inner product, the PR Product can be applied into many existing deep learning modules, so we develop the PR Product version of fully connected layer, convolutional layer and LSTM layer. In static image classification, the experiments on CIFAR10 and CIFAR100 datasets demonstrate that the PR Product can robustly enhance the ability of various state of the art classification networks. On the task of image captioning, even without any bells and whistles, our PR Product version of captioning model can compete or outperform the state of the art models on MS COCO dataset. Code has been made available at https github.com wzn0828 PR Product.


Type III contractions and quintic threefolds. We study type III contractions of Calabi Yau threefolds containing a ruled surface over a smooth curve. We discuss the conditions necessary for the image threefold to by smoothable. We describe the change in Hodge numbers caused by this contraction and smoothing deformation. A generalization of a fomula for calculating Hodge numbers of hypersurfaces in mathbb P 4 with ordinary double and triple points is presented. We use these results to construct new Calabi Yau threefolds of Picard rank two arising from a family of quintic threefolds containing a cone.


NestFuse An Infrared and Visible Image Fusion Architecture based on Nest Connection and Spatial Channel Attention Models. In this paper we propose a novel method for infrared and visible image fusion where we develop nest connection based network and spatial channel attention models. The nest connection based network can preserve significant amounts of information from input data in a multi scale perspective. The approach comprises three key elements encoder, fusion strategy and decoder respectively. In our proposed fusion strategy, spatial attention models and channel attention models are developed that describe the importance of each spatial position and of each channel with deep features. Firstly, the source images are fed into the encoder to extract multi scale deep features. The novel fusion strategy is then developed to fuse these features for each scale. Finally, the fused image is reconstructed by the nest connection based decoder. Experiments are performed on publicly available datasets. These exhibit that our proposed approach has better fusion performance than other state of the art methods. This claim is justified through both subjective and objective evaluation. The code of our fusion method is available at https github.com hli1221 imagefusion nestfuse


XCSP3 core A Format for Representing Constraint Satisfaction Optimization Problems. In this document, we introduce XCSP3 core, a subset of XCSP3 that allows us to represent constraint satisfaction optimization problems. The interest of XCSP3 core is multiple (i) focusing on the most popular frameworks (CSP and COP) and constraints, (ii) facilitating the parsing process by means of dedicated XCSP3 core parsers written in Java and C (using callback functions), (iii) and defining a core format for comparisons (competitions) of constraint solvers.


RGB D Salient Object Detection with Cross Modality Modulation and Selection. We present an effective method to progressively integrate and refine the cross modality complementarities for RGB D salient object detection (SOD). The proposed network mainly solves two challenging issues 1) how to effectively integrate the complementary information from RGB image and its corresponding depth map, and 2) how to adaptively select more saliency related features. First, we propose a cross modality feature modulation (cmFM) module to enhance feature representations by taking the depth features as prior, which models the complementary relations of RGB D data. Second, we propose an adaptive feature selection (AFS) module to select saliency related features and suppress the inferior ones. The AFS module exploits multi modality spatial feature fusion with the self modality and cross modality interdependencies of channel features are considered. Third, we employ a saliency guided position edge attention (sg PEA) module to encourage our network to focus more on saliency related regions. The above modules as a whole, called cmMS block, facilitates the refinement of saliency features in a coarse to fine fashion. Coupled with a bottom up inference, the refined saliency features enable accurate and edge preserving SOD. Extensive experiments demonstrate that our network outperforms state of the art saliency detectors on six popular RGB D SOD benchmarks.


Gr "obner cells of punctual Hilbert schemes in dimension two. We begin with a comprehensive discussion of the punctual Hilbert scheme of the regular two dimensional local ring in terms of the Gr "obner cells. These schemes are the most degenerate fibers of the Grothendieck Deligne norm map (the Hilbert Chow morphism), playing an important role in the study of Hilbert schemes of smooth surfaces. They are generally singular, but their Gr "obner cells are affine spaces they admit an explicit parametrization due to Conca and Valla. We use this to obtain the Gr "obner decomposition of compactified Jacobians of plane curve singularities, which is non trivial even for the generalized Jacobians (principal ideals only). One of the application is the topological invariance of certain variants of compactified Jacobians and the corresponding motivic superpolynomials for analytic deformations of quasi homogenous plane curve singularities and some similar families.


Multi Likelihood Methods for Developing Stock Relationship Networks Using Financial Big Data. Development of stock networks is an important approach to explore the relationship between different stocks in the era of big data. Although a number of methods have been designed to construct the stock correlation networks, it is still a challenge to balance the selection of prominent correlations and connectivity of networks. To address this issue, we propose a new approach to select essential edges in stock networks and also maintain the connectivity of established networks. This approach uses different threshold values for choosing the edges connecting to a particular stock, rather than employing a single threshold value in the existing asset value method. The innovation of our algorithm includes the multiple distributions in a maximum likelihood estimator for selecting the threshold value rather than the single distribution estimator in the existing methods. Using the Chinese Shanghai security market data of 151 stocks, we develop a stock relationship network and analyze the topological properties of the developed network. Our results suggest that the proposed method is able to develop networks that maintain appropriate connectivities in the type of assets threshold methods.


Temperature Dependence of Reconfigurable Bandstop Filters Using Vanadium Dioxide Switches. In this letter we report and investigate the temperature dependency of various radio frequency parameters (RF) for a fabricated reconfigurable bandstop filter with vanadium dioxide (VO2) switches measured up to 55 GHz. Here the insulator to metal (ITM) and metal to insulator transition (MIT) hysteresis of the VO2 thin film influence on the RF characteristics of the filters is analyzed from 25 deg C and 120 deg C in heating and cooling. The resonance frequency and maximum insertion loss (IL) stability and sensitivity with temperature variations are explored. It is noticed that increasing the temperature with 50 deg C from 25 deg C (or decreasing it with 50 deg C from 120 deg C) will result in a less than 1 fractional frequency shift in respect to the off and on resonance frequencies. The sharp DC conductivity levels variations of the VO2 thin film around the transition temperatures translate into sharp effects on the resonance characteristics of the filters. On the contrary, the maximum IL levels are less sensitive to the DC films sharp conductivity changes around the VO2 transition temperature. Last, we see that the RF parameters in heating and cooling at 80 deg C, above (but close to) the DC transition temperatures of VO2 exhibit completely different resonance frequencies. The RF results reported close to the transition temperatures for the VO2 thin films can diverge in heating and cooling, thus of a more insightful understanding of VO2 reconfigurable RF devices has to include temperature dependent measurements at various temperatures below MIT and ITM in the RF ranges too


Approximating Euclidean by Imprecise Markov Decision Processes. Euclidean Markov decision processes are a powerful tool for modeling control problems under uncertainty over continuous domains. Finite state imprecise, Markov decision processes can be used to approximate the behavior of these infinite models. In this paper we address two questions first, we investigate what kind of approximation guarantees are obtained when the Euclidean process is approximated by finite state approximations induced by increasingly fine partitions of the continuous state space. We show that for cost functions over finite time horizons the approximations become arbitrarily precise. Second, we use imprecise Markov decision process approximations as a tool to analyse and validate cost functions and strategies obtained by reinforcement learning. We find that, on the one hand, our new theoretical results validate basic design choices of a previously proposed reinforcement learning approach. On the other hand, the imprecise Markov decision process approximations reveal some inaccuracies in the learned cost functions.


A convergent FV FEM scheme for the stationary compressible Navier Stokes equations. In this paper, we propose a discretization of the multi dimensional stationary compressible Navier Stokes equations combining finite element and finite volume techniques. As the mesh size tends to 0, the numerical solutions are shown to converge (up to a subsequence) towards a weak solution of the continuous problem for ideal gas pressure laws p( rho ) a rho gamma , with gamma 3 2 in the three dimensional case. It is the first convergence result for a numerical method with adiabatic exponents gamma less than 3 when the space dimension is three. The present convergence result can be seen as a discrete counterpart of the construction of weak solutions established by P. L. Lions and by S. Novo, A. Novotn 'y .


The ReadoutCard userspace driver for the new ALICE O 2 computing system. The ALICE (A Large Ion Collider Experiment) experiment focuses on the study of the quark gluon plasma as a product of heavy ion collisions at the CERN LHC (Large Hadron Collider). During the Long Shutdown 2 of the LHC in 2019 2020, a major upgrade is underway in order to cope with a hundredfold input data rate increase with peaks of up to 3.4 TB s. This upgrade includes the new Online Offline computing system called O2. The O2 readout chain runs on commodity Linux servers equipped with custom PCIe FPGA based readout cards the PCIe v3 x16, Intel Arria 10 based CRU (Common Readout Unit) and the PCIe v2 x8, Xilinx Vertex6 based CRORC (Common ReadOut Receiver Card). Access to the cards is provided through the O2 ReadoutCard userspace driver which handles synchronisation and communication for DMA transfers, provides BAR access, and facilitates card configuration and monitoring. The ReadoutCard driver is the lowest level interface to the readout cards within O2 and is in use by all central systems and detector teams of the ALICE experiment. This communication presents the architecture of the driver, and the suite of tools used for card configuration and monitoring. It also discusses its interaction with the tangent subsystems within the O2 framework.


Ionization and excitation of low lying circular states of the hydrogen atom in strong circularly polarized laser fields. We perform ab initio calculations for the hydrogen atom initially in one of the six circular bound states with the principal quantum numbers n 2, 3 and 4, irradiated by a short circularly polarized laser pulse of 400 nm. The field propagates in the direction parallel to the z component of the angular momentum of the atom. We investigate probabilities for the atom to ionize or to get on some bound (excited) state or to remain in the initial state after the end of the laser pulse. In most cases, we find pronounced differences in ionization probabilities for atoms in states having different signs of magnetic quantum number. Usually electrons corotating (with respect to the laser field) ionize faster than their counter rotating equivalents. We have found important difference in the behavior of the excitation (as a function of the peak laser intensity) for initial states with n 2 and other n (3 or 4). For higher n the excitation is always weaker than the ionization and starts for higher intensities. For n 2 the strong excitation appears before strong ionization due to large probability of one photon absorption combined with population of many bound states having principal quantum numbers n from 3 up to several dozen. Quite accurate analysis of the excitation process is presented.


Weak Exponential Attractors for Coleman Gurtin Equations with Dynamic Boundary Conditions Possessing Different Memory Kernels. The well posedness of a generalized Coleman Gurtin equation equipped with dynamic boundary conditions with memory was recently established by C.G. Gal and the author. Additionally, it was established by the author that the problem admits a finite dimensional global attractor and a robust family of exponential attractors in the case where singularly perturbed memory kernels defined on the interior of the domain and on the boundary of the domain coincide. In the present article we report advances concerning the asymptotic behavior of this heat transfer model when the memory kernels do em not coincide. In this setting we obtain a weak exponential attractor whose basin of attraction is the entire phase space, that is, a finite dimensional exponentially attracting compact set in the weak topology of the phase space. This result completes an analysis of the finite dimensional attractors for the generalized Coleman Gurtin equation equipped with dynamic boundary conditions with memory.


What Object Should I Use? Task Driven Object Detection. When humans have to solve everyday tasks, they simply pick the objects that are most suitable. While the question which object should one use for a specific task sounds trivial for humans, it is very difficult to answer for robots or other autonomous systems. This issue, however, is not addressed by current benchmarks for object detection that focus on detecting object categories. We therefore introduce the COCO Tasks dataset which comprises about 40,000 images where the most suitable objects for 14 tasks have been annotated. We furthermore propose an approach that detects the most suitable objects for a given task. The approach builds on a Gated Graph Neural Network to exploit the appearance of each object as well as the global context of all present objects in the scene. In our experiments, we show that the proposed approach outperforms other approaches that are evaluated on the dataset like classification or ranking approaches.


WITCHER Detecting Crash Consistency Bugs in Non volatile Memory Programs. The advent of non volatile main memory (NVM) enables the development of crash consistent software without paying storage stack overhead. However, building a correct crash consistent program remains very challenging in the presence of a volatile cache. This paper presents WITCHER, a crash consistency bug detector for NVM software, that is (1) scalable does not suffer from test space explosion, (2) automatic does not require manual source code annotations, and (3) precise does not produce false positives. WITCHER first infers a set of "likely invariants" that are believed to be true to be crash consistent by analyzing source codes and NVM access traces. WITCHER automatically composes NVM images that simulate those potentially inconsistent (crashing) states violating the likely invariants. Then WITCHER performs "output equivalence checking" by comparing the output of program executions with and without a simulated crash. It validates if a likely invariant violation under test is a true crash consistency bug. Evaluation with ten persistent data structures, two real world servers, and five example codes in Intel's PMDK library shows that WITCHER outperforms state of the art tools. WITCHER discovers 37 (32 new) crash consistency bugs, which were all confirmed.


Teaching Key Machine Learning Principles Using Anti learning Datasets. Much of the teaching of machine learning focuses on iterative hill climbing approaches and the use of local knowledge to gain information leading to local or global maxima. In this paper we advocate the teaching of alternative methods of generalising to the best possible solution, including a method called anti learning. By using simple teaching methods, students can achieve a deeper understanding of the importance of validation on data excluded from the training process and that each problem requires its own methods to solve. We also exemplify the requirement to train a model using sufficient data by showing that different granularities of cross validation can yield very different results.


Non portability of Algorithmic Fairness in India. Conventional algorithmic fairness is Western in its sub groups, values, and optimizations. In this paper, we ask how portable the assumptions of this largely Western take on algorithmic fairness are to a different geo cultural context such as India. Based on 36 expert interviews with Indian scholars, and an analysis of emerging algorithmic deployments in India, we identify three clusters of challenges that engulf the large distance between machine learning models and oppressed communities in India. We argue that a mere translation of technical fairness work to Indian subgroups may serve only as a window dressing, and instead, call for a collective re imagining of Fair ML, by re contextualising data and models, empowering oppressed communities, and more importantly, enabling ecosystems.