Graph Convolutional Neural Networks for Body Force Prediction. Many scientific and engineering processes produce spatially unstructured data. However, most data driven models require a feature matrix that enforces both a set number and order of features for each sample. They thus cannot be easily constructed for an unstructured dataset. Therefore, a graph based data driven model to perform inference on fields defined on an unstructured mesh, using a Graph Convolutional Neural Network (GCNN) is presented. The ability of the method to predict global properties from spatially irregular measurements with high accuracy is demonstrated by predicting the drag force associated with laminar flow around airfoils from scattered velocity measurements. The network can infer from field samples at different resolutions, and is invariant to the order in which the measurements within each sample are presented. The GCNN method, using inductive convolutional layers and adaptive pooling, is able to predict this quantity with a validation R 2 above 0.98, and a Normalized Mean Squared Error below 0.01, without relying on spatial structure.


Nonlocal Poincar ' e Inequalities for Integral Operators with Integrable Nonhomogeneous Kernels. The paper provides two versions of nonlocal Poincar 'e type inequalities for integral operators with a convolution type structure and functions satisfying a zero Dirichlet like condition. The inequalities extend existing results to a large class of nonhomogeneous kernels with supports that can vary discontinuously and need not contain a common set throughout the domain. The measure of the supports may even vanish allowing the zero Dirichlet condition to be imposed on only a lower dimensional manifold, with or without boundary. The conditions may be imposed on sets with co dimension larger than one or even at just a single point. This appears to currently be the first such results in a nonlocal setting with integrable kernels. The arguments used are direct, and examples are provided demonstrating the explicit dependence of bounds for the Poincar ' e constant upon structural parameters of the kernel and domain.


Information Propagation Model in Hybrid Networks. It is in practice impossible to describe the topology of a real network or its message propagation process using a single dynamic model. To address this issue, we constructed a new hybrid network model based on scale free (SF), small world (SW) features that functions as closely as possible to a real network. And the hybrid propagation model is constructed with susceptible infected susceptible (SIS), susceptible infected recovered (SIR) and susceptible infected recovered susceptible (SIRS) model mixed in arbitrary proportions. The model applies the concepts of blockbuster effect and implicit node edges to reflect explosive spread as a significant characteristic of information propagation. A theoretical analysis and derivation of the new model in which hybrid networks were simulated revealed that the network degree distribution closely follows a power law. Using an improved similarity function to define the degree of closeness to real network cases, the proposed model was shown to be valid and very close to a real network.


Robust Multimodal Image Registration Using Deep Recurrent Reinforcement Learning. The crucial components of a conventional image registration method are the choice of the right feature representations and similarity measures. These two components, although elaborately designed, are somewhat handcrafted using human knowledge. To this end, these two components are tackled in an end to end manner via reinforcement learning in this work. Specifically, an artificial agent, which is composed of a combined policy and value network, is trained to adjust the moving image toward the right direction. We train this network using an asynchronous reinforcement learning algorithm, where a customized reward function is also leveraged to encourage robust image registration. This trained network is further incorporated with a lookahead inference to improve the registration capability. The advantage of this algorithm is fully demonstrated by our superior performance on clinical MR and CT image pairs to other state of the art medical image registration methods.


Probabilistic Programming with CuPPL. Probabilistic Programming Languages (PPLs) are a powerful tool in machine learning, allowing highly expressive generative models to be expressed succinctly. They couple complex inference algorithms, implemented by the language, with an expressive modelling language that allows a user to implement any computable function as the generative model. Such languages are usually implemented on top of existing high level programming languages and do not make use of hardware accelerators. PPLs that do make use of accelerators exist, but restrict the expressivity of the language in order to do so. In this paper, we present a language and toolchain that generates highly efficient code for both CPUs and GPUs. The language is functional in style, and the tool chain is built on top of LLVM. Our implementation uses de limited continuations on CPU to perform inference, and custom CUDA codes on GPU. We obtain significant speed ups across a suite of PPL workloads, compared to other state of the art approaches on CPU. Furthermore, our compiler can also generate efficient code that runs on CUDA GPUs.


Local Limit Theorems for Random Walks in a Random Environment on a Strip. The paper consists of two parts. In the first part we review recent work on limit theorems for random walks in random environment (RWRE) on a strip with jumps to the nearest layers. In the second part, we prove the quenched Local Limit Theorem (LLT) for the position of the walk in the transient diffusive regime. This fills an important gap in the literature. We then obtain two corollaries of the quenched LLT. The first one is the annealed version of the LLT on a strip. The second one is the proof of the fact that the distribution of the environment viewed from the particle (EVFP) has a limit for a. e. environment. In the case of the random walk with jumps to nearest neighbours in dimension one, the latter result is a theorem of Lally cite L . Since the strip model incorporates the walks with bounded jumps on a one dimensional lattice, the second corollary also solves the long standing problem of extending Lalley's result to this case.


HellaSwag Can a Machine Really Finish Your Sentence?. Recent work by Zellers et al. (2018) introduced a new task of commonsense natural language inference given an event description such as "A woman sits at a piano," a machine must select the most likely followup "She sets her fingers on the keys." With the introduction of BERT, near human level performance was reached. Does this mean that machines can perform human level commonsense inference? In this paper, we show that commonsense inference still proves difficult for even state of the art models, by presenting HellaSwag, a new challenge dataset. Though its questions are trivial for humans ( 95 accuracy), state of the art models struggle ( 48 ). We achieve this via Adversarial Filtering (AF), a data collection paradigm wherein a series of discriminators iteratively select an adversarial set of machine generated wrong answers. AF proves to be surprisingly robust. The key insight is to scale up the length and complexity of the dataset examples towards a critical 'Goldilocks' zone wherein generated text is ridiculous to humans, yet often misclassified by state of the art models. Our construction of HellaSwag, and its resulting difficulty, sheds light on the inner workings of deep pretrained models. More broadly, it suggests a new path forward for NLP research, in which benchmarks co evolve with the evolving state of the art in an adversarial way, so as to present ever harder challenges.


Measurement and Shaping of Circular Airy Vortex via Cross Phase. We apply the CP to CAVs for the first time experimentally. Firstly, we introduce the propagation properties of a CAV with the LOCP in the process of measuring TCs, and measure the TCs of CAVs in the self focusing areas experimentally. Secondly, we shape the CAVs via the HOCP and discuss the manipulaiton of singularities.


A Generic Approach for Accelerating Belief Propagation based DCOP Algorithms via A Branch and Bound Technique. Belief propagation approaches, such as Max Sum and its variants, are a kind of important methods to solve large scale Distributed Constraint Optimization Problems (DCOPs). However, for problems with n ary constraints, these algorithms face a huge challenge since their computational complexity scales exponentially with the number of variables a function holds. In this paper, we present a generic and easy to use method based on a branch and bound technique to solve the issue, called Function Decomposing and State Pruning (FDSP). We theoretically prove that FDSP can provide monotonically non increasing upper bounds and speed up belief propagation based DCOP algorithms without an effect on solution quality. Also, our empirically evaluation indicates that FDSP can reduce 97 of the search space at least and effectively accelerate Max Sum, compared with the state of the art.


Group Decision Support for agriculture planning by a combination of Mathematical Model and Collaborative Tool. Decision making in the Agriculture domain can be a complex task. The land area allocated to each crop should be fixed every season according to several parameters prices, demand, harvesting periods, seeds, ground, season etc... The decision to make becomes more difficult when a group of farmers must fix the price and all parameters all together. Generally, optimization models are useful for farmers to find no dominated solutions, but it remains difficult if the farmers have to agree on one solution. We combine two approaches in order to support a group of farmers engaged in this kind of decision making process. We firstly generate a set of no dominated solutions thanks to a centralized optimization model. Based on this set of solution we then used a Group Decision Support System called GRUS for choosing the best solution for the group of farmers. The combined approach allows us to determine the best solution for the group in a consensual way. This combination of approaches is very innovative for the Agriculture. This approach has been tested in laboratory in a previous work. In the current work the same experiment has been conducted with real business (farmers) in order to benefit from their expertise. The two experiments are compared.


An extended Speculation Game for the recovery of Hurst exponent of financial time series. The speculation game is an agent based toy model to investigate the dynamics of the financial market. Our model has achieved the reproduction of 10 of the well known stylized facts for financial time series. However, there is also a divergence from the behavior of real market. The market price of the model tends to be anti persistent to the initial price, resulting in the quite small value of Hurst exponent of price change. To overcome this problem, we extend the speculation game by introducing a perturbative part to the price change with the consideration of other effects besides pure speculative behaviors.


A unifying framework for continuity and complexity in higher types. We set up a parametrised monadic translation for a class of call by value functional languages, and prove a corresponding soundness theorem. We then present a series of concrete instantiations of our translation, demonstrating that a number of fundamental notions concerning higher order computation, including termination, continuity and complexity, can all be subsumed into our framework. Our main goal is to provide a unifying scheme which brings together several concepts which are often treated separately in the literature. However, as a by product, we also obtain (i) a method for extracting moduli of continuity for closed functionals of type ( mathbb N to mathbb N ) to mathbb N definable in (extensions of) System T, and (ii) a characterisation of the time complexity of bar recursion.


H "ormander's method for the characteristic Cauchy problem and conformal scattering for a non linear wave equation. The purpose of this note is to prove the existence of a conformal scattering operator for the cubic defocusing wave equation on a non stationary background. The proof essentially relies on solving the characteristic initial value problem by the method developed by H "ormander. This method consists in slowing down the propagation speed of the waves to transform a characteristic initial value problem into a standard Cauchy problem.


Context Aware Temporal Logic for Probabilistic Systems. In this paper, we introduce the context aware probabilistic temporal logic (CAPTL) that provides an intuitive way to formalize system requirements by a set of PCTL objectives with a context based priority structure. We formally present the syntax and semantics of CAPTL and propose a synthesis algorithm for CAPTL requirements. We also implement the algorithm based on the PRISM games model checker. Finally, we demonstrate the usage of CAPTL on two case studies a robotic task planning problem, and synthesizing error resilient scheduler for micro electrode dot array digital microfluidic biochips.


Continual and Multi Task Architecture Search. Architecture search is the process of automatically learning the neural model or cell structure that best suits the given task. Recently, this approach has shown promising performance improvements (on language modeling and image classification) with reasonable training speed, using a weight sharing strategy called Efficient Neural Architecture Search (ENAS). In our work, we first introduce a novel continual architecture search (CAS) approach, so as to continually evolve the model parameters during the sequential training of several tasks, without losing performance on previously learned tasks (via block sparsity and orthogonality constraints), thus enabling life long learning. Next, we explore a multi task architecture search (MAS) approach over ENAS for finding a unified, single cell structure that performs well across multiple tasks (via joint controller rewards), and hence allows more generalizable transfer of the cell structure knowledge to an unseen new task. We empirically show the effectiveness of our sequential continual learning and parallel multi task learning based architecture search approaches on diverse sentence pair classification tasks (GLUE) and multimodal generation based video captioning tasks. Further, we present several ablations and analyses on the learned cell structures.


Automatic Fashion Knowledge Extraction from Social Media. Fashion knowledge plays a pivotal role in helping people in their dressing. In this paper, we present a novel system to automatically harvest fashion knowledge from social media. It unifies three tasks of occasion, person and clothing discovery from multiple modalities of images, texts and metadata. A contextualized fashion concept learning model is applied to leverage the rich contextual information for improving the fashion concept learning performance. At the same time, to counter the label noise within training data, we employ a weak label modeling method to further boost the performance. We build a website to demonstrate the quality of fashion knowledge extracted by our system.


Deceptive Deletions for Protecting Withdrawn Posts on Social Platforms. Over sharing poorly worded thoughts and personal information is prevalent on online social platforms. In many of these cases, users regret posting such content. To retrospectively rectify these errors in users' sharing decisions, most platforms offer (deletion) mechanisms to withdraw the content, and social media users often utilize them. Ironically and perhaps unfortunately, these deletions make users more susceptible to privacy violations by malicious actors who specifically hunt post deletions at large scale. The reason for such hunting is simple deleting a post acts as a powerful signal that the post might be damaging to its owner. Today, multiple archival services are already scanning social media for these deleted posts. Moreover, as we demonstrate in this work, powerful machine learning models can detect damaging deletions at scale. Towards restraining such a global adversary against users' right to be forgotten, we introduce Deceptive Deletion, a decoy mechanism that minimizes the adversarial advantage. Our mechanism injects decoy deletions, hence creating a two player minmax game between an adversary that seeks to classify damaging content among the deleted posts and a challenger that employs decoy deletions to masquerade real damaging deletions. We formalize the Deceptive Game between the two players, determine conditions under which either the adversary or the challenger provably wins the game, and discuss the scenarios in between these two extremes. We apply the Deceptive Deletion mechanism to a real world task on Twitter hiding damaging tweet deletions. We show that a powerful global adversary can be beaten by a powerful challenger, raising the bar significantly and giving a glimmer of hope in the ability to be really forgotten on social platforms.


Playing a game of billiard with Fibonacci. By making use of the greatest common divisor's ( gcd ) properties we can highlight some connections between playing billiard inside a unit square and the Fibonacci sequence as well as the Euclidean algorithm. In particular by defining two maps tau and sigma corresponding to translations and mirroring we are able to rederive Lam ' e 's theorem and to equip it with a geometric interpretation realizing a new way to construct the golden ratio. Further we discuss distributions of the numbers p,q in mathbb N with gcd(q,p) 1 and show that these also relate to the Fibonacci sequence.


Regularized Stochastic Block Model for robust community detection in complex networks. The stochastic block model is able to generate different network partitions, ranging from traditional assortative communities to disassortative structures. Since the degree corrected stochastic block model does not specify which mixing pattern is desired, the inference algorithms, which discover the most likely partition of the networks nodes, are likely to get trapped in the local optima of the log likelihood. Here we introduce a new model constraining nodes' internal degrees ratios in the objective function to stabilize the inference of block models from the observed network data. Given the regularized model, the inference algorithms, such as Markov chain Monte Carlo, reliably finds assortative or disassortive structure as directed by the value of a single parameter. We show experimentally that the inference of our proposed model quickly converges to the desired assortative or disassortative partition while the inference of degree corrected stochastic block model gets often trapped at the inferior local optimal partitions when the traditional assortative community structure is not strong in the observed networks.


Decomposing Collectives for Exploiting Multi lane Communication. Many modern, high performance systems increase the cumulated node bandwidth by offering more than a single communication network and or by having multiple connections to the network. Efficient algorithms and implementations for collective operations as found in, e.g., MPI must be explicitly designed for such multi lane capabilities. We discuss a model for the design of multi lane algorithms, and in particular give a recipe for converting any standard, one ported, (pipelined) communication tree algorithm into a multi lane algorithm that can effectively use k lanes simultaneously. We first examine the problem from the perspective of emph self consistent performance guidelines , and give simple, emph full lane, mock up implementations of the MPI broadcast, reduction, scan, gather, scatter, allgather, and alltoall operations using only similar operations of the given MPI library itself in such a way that multi lane capabilities can be exploited. These implementations which rely on a decomposition of the communication domain into communicators for nodes and lanes are full fledged and readily usable implementations of the MPI collectives. The mock up implementations, contrary to expectation, in many cases show surprising performance improvements with different MPI libraries on a small 36 node dual socket, dual lane Intel OmniPath cluster, indicating severe problems with the native MPI library implementations. Our full lane implementations are in many cases considerably more than a factor of two faster than the corresponding MPI collectives. We see similar results on the larger Vienna Scientific Cluster, VSC 3. These experiments indicate considerable room for improvement of the MPI collectives in current libraries including more efficient use of multi lane communication.


Bridging the Gap FPGAs as Programmable Switches. The emergence of P4, a domain specific language, coupled to PISA, a domain specific architecture, is revolutionizing the networking field. P4 allows to describe how packets are processed by a programmable data plane, spanning ASICs and CPUs, implementing PISA. Because the processing flexibility can be limited on ASICs, while the CPUs performance for networking tasks lag behind, recent works have proposed to implement PISA on FPGAs. However, little effort has been dedicated to analyze whether FPGAs are good candidates to implement PISA. In this work, we take a step back and evaluate the micro architecture efficiency of various PISA blocks. We demonstrate, supported by a theoretical and experimental analysis, that the performance of a few PISA blocks is severely limited by the current FPGA architectures. Specifically, we show that match tables and programmable packet schedulers represent the main performance bottlenecks for FPGA based programmable switches. Thus, we explore two avenues to alleviate these shortcomings. First, we identify network applications well tailored to current FPGAs. Second, to support a wider range of networking applications, we propose modifications to the FPGA architectures which can also be of interest out of the networking field.


FDMA with Layers based Optimized Mobile Relays Subsets Algorithm in B5G 6G Cognitive IoT Networks. In view of noteworthy communications performance improvements for future B5G 6G (such as cognitive Internet of Things, space ground integration network and so on), cooperative communications (CC) diversity with relays selection algorithms have been extensively studied to significantly improve communications quality, but so far there is still a lot of potential optimization work with CC schemes. In this paper, in the light of NP hard problem of subsets relays selection, further studies for theorems of relays subsets with K layers power allocation standard have been put forward to explore better performance in B5G 6G cognitive IoT (Internet of Things) networks, we propose unified layers based optimized mobile relays subsets algorithms for full duplex (FD) non orthogonal multiple access (NOMA) to greatly improve transmission rate. After revealing and taking into account fundamental properties of relays, such as mobile relays nodes state, relays locations, fading characteristics and so on, optimized FD NOMA algorithm based on these relays features has been presented to improve transmission validity, and a related series of relays subsets theorems have been derived and proved, then minimum upper bound of maximum transmission rates has been estimated to reveal two way balanced optimal transmission conclusion for FD NOMA. In general, proposed general and optimized algorithm can be used in multiple future cooperative communications scenarios in B5G 6G networks such as cognitive IoT. Simulations results show that proposed scheme has several times transmission rates than other classical relays selection algorithms


Intrinsic motivation in virtual assistant interaction for fostering spontaneous interactions. With the growing utility of today's conversational virtual assistants, the importance of user motivation in human AI interaction is becoming more obvious. However, previous studies in this and related fields, such as human computer interaction and human robot interaction, scarcely discussed intrinsic motivation and its affecting factors. Those studies either treated motivation as an inseparable concept or focused on non intrinsic motivation. The current study aims to cover intrinsic motivation by taking an affective engineering approach. A novel motivation model is proposed, in which intrinsic motivation is affected by two factors that derive from user interactions with virtual assistants expectation of capability and uncertainty. Experiments are conducted where these two factors are manipulated by making participants believe they are interacting with the smart speaker "Amazon Echo". Intrinsic motivation is measured both by using questionnaires and by covertly monitoring a five minute free choice period in the experimenter's absence, during which the participants could decide for themselves whether to interact with the virtual assistants. Results of the first experiment showed that high expectation engenders more intrinsically motivated interaction compared with low expectation. The results also suggested suppressive effects by uncertainty on intrinsic motivation, though we had not hypothesized before experiments. We then revised our hypothetical model of action selection accordingly and conducted a verification experiment of uncertainty's effects. Results of the verification experiment showed that reducing uncertainty encourages more interactions and causes the motivation behind these interactions to shift from non intrinsic to intrinsic.


A Consistent Discrete 3D Hodge type Decomposition implementation and practical evaluation. The Hodge decomposition provides a very powerful mathematical method for the analysis of 2D and 3D vector fields. It states roughly that any vector field can be L 2 orthogonally decomposed into a curl free, divergence free, and a harmonic field. The harmonic field itself can be further decomposed into three components, two of which are closely tied to the topology of the underlying domain. For practical computations it is desirable to find a discretization which preserves as many aspects inherent to the smooth theory as possible while at the same time remains computationally tractable, in particular on large sized models. The correctness and convergence of such a discretization depends strongly on the choice of ansatz spaces defined on the surface or volumetric mesh to approximate infinite dimensional subspaces. This paper presents a consistent discretization of Hodge type decomposition for piecewise constant vector fields on volumetric meshes. Our approach is based on a careful interplay between edge based textNedelec elements and face based Crouzeix Raviart elements resulting in a very simple formulation. The method is stable under noisy vector field and mesh resolution, and has a good performance for large sized models. We give pseudocodes for a possible implementation of the method together with some insights on how the Hodge decomposition could answer some central question in computational fluid.


The activity of native vacuolar proton ATPase in an oscillating electric field demystifying an apparent effect of music on a biomolecule. The effect of an oscillating electric field generated from music on yeast vacuolar proton ATPase (V ATPase) activity in its native environment is reported. An oscillating electric field is generated by electrodes that are immersed into a dispersion of yeast vacuolar membrane vesicles natively hosting a high concentration of active V ATPase. The substantial difference in the ATP hydrolysing activity of V ATPase under the most stimulating and inhibiting music is unprecedented. Since the topic, i.e. an effect of music on biomolecules, is very attractive for non scientific, esoteric mystification, we provide a rational explanation for the observed new phenomenon. Good correlation is found between changes in the specific activity of the enzyme and the combined intensity of certain frequency bands of the Fourier spectra of the music clips. Most prominent identified frequencies are harmonically related to each other and to the estimated rotation rate of the enzyme. These results lead to the conclusion that the oscillating electric field interferes with periodic trans membrane charge motions in the working enzyme.


Persistent Magnitude. In this paper we introduce the persistent magnitude, a new numerical invariant of (sufficiently nice) graded persistence modules. It is a weighted and signed count of the bars of the persistence module, in which a bar of the form a,b) in degree d is counted with weight (e a e b ) and sign ( 1) d . Persistent magnitude has good formal properties, such as additivity with respect to exact sequences and compatibility with tensor products, and has interpretations in terms of both the associated graded functor, and the Laplace transform. Our definition is inspired by Otter's notion of blurred magnitude homology we show that the magnitude of a finite metric space is precisely the persistent magnitude of its blurred magnitude homology. Turning this result on its head, we obtain a strategy for turning existing persistent homology theories into new numerical invariants by applying the persistent magnitude. We explore this strategy in detail in the case of persistent homology of Morse functions, and in the case of Rips homology.


A Semi Dynamic Bus Routing Infrastructure based on MBTA Bus Data. Transportation is quickly evolving in the emerging smart city ecosystem with personalized ride sharing services quickly advancing. Yet, the public bus infrastructure has been slow to respond to these trends. With our research, we propose a semi dynamic bus routing framework that is data driven and responsive to relevant parameters in bus transport. We use newly published bus event data from a bus line in Boston and several algorithmic heuristics to create this framework and demonstrate the capabilities and results. We find that this approach yields a very promising routing infrastructure that is smarter and more dynamic than the existing system.


The Quotient in Preorder Theories. Seeking the largest solution to an expression of the form A x B is a common task in several domains of engineering and computer science. This largest solution is commonly called quotient. Across domains, the meanings of the binary operation and the preorder are quite different, yet the syntax for computing the largest solution is remarkably similar. This paper is about finding a common framework to reason about quotients. We only assume we operate on a preorder endowed with an abstract monotonic multiplication and an involution. We provide a condition, called admissibility, which guarantees the existence of the quotient, and which yields its closed form. We call preordered heaps those structures satisfying the admissibility condition. We show that many existing theories in computer science are preordered heaps, and we are thus able to derive a quotient for them, subsuming existing solutions when available in the literature. We introduce the concept of sieved heaps to deal with structures which are given over multiple domains of definition. We show that sieved heaps also have well defined quotients.


Microcavity based Generation of Full Poincar ' e Beams with Arbitrary Skyrmion Numbers. A full Poincar 'e (FP) beam possesses all possible optical spin states in its cross section, which constitutes an optical analogue of a skyrmion. Until now, FP beams have been exclusively generated using bulk optics. Here, we propose a generation scheme of an FP beam based on an optical microring cavity. We position two different angular gratings along with chiral lines on a microring cavity and generate an FP beam as a superposition of two light beams with controlled spin and orbital angular momenta. We numerically show that FP beams with tailored skyrmion numbers can be generated from this device, opening a route for developing compact light sources with unique optical spin fields.


Valuations and henselization. We study the extension of valuations centered in a local domain to its henseliza tion. We prove that a valuation nu centered in a local domain R uniquely determines a minimal prime H( nu ) of the henselization R h of R and an extension of nu centered in R h H( nu ), which has the same value group as nu . Our method, which assumes neither that R is noetherian nor that it is integrally closed, is to reduce the problem to the extension of the valuation to a quotient of a standard 'e tale local R algebra and in that situation to draw valuative consequences from the observation that the Newton Hensel algorithm for constructing roots of polynomials produces sequences that are always pseudo convergent in the sense of Ostrowski. We then apply this method to the study of the approximation of elements of the henselization of a valued field by elements of the field and give a characterization of the henselian property of a local domain (R, m R) in terms of the limits of certain pseudo convergent sequences of elements of m R for a valuation centered in it. Another consequence of our work is to establish in full generality a bijective correspondence between the minimal primes of the henselization of a local domain R and the connected components of the Riemann Zariski space of valuations centered in R.


Multilingual Transfer Learning for QA Using Translation as Data Augmentation. Prior work on multilingual question answering has mostly focused on using large multilingual pre trained language models (LM) to perform zero shot language wise learning train a QA model on English and test on other languages. In this work, we explore strategies that improve cross lingual transfer by bringing the multilingual embeddings closer in the semantic space. Our first strategy augments the original English training data with machine translation generated data. This results in a corpus of multilingual silver labeled QA pairs that is 14 times larger than the original training set. In addition, we propose two novel strategies, language adversarial training and language arbitration framework, which significantly improve the (zero resource) cross lingual transfer performance and result in LM embeddings that are less language variant. Empirically, we show that the proposed models outperform the previous zero shot baseline on the recently introduced multilingual MLQA and TyDiQA datasets.


Approximative Atomic Systems for operators in Banach spaces. K frames and atomic systems for an operator K in Hilbert spaces were introduced by Gavruta cite 12 and further studied by Xio, Zhu and Gavruta cite 21 . In this paper, we have introduced the notion of an approximative atomic system for an operator K in Banach spaces and obtained interesting results. A complete characterization of family of approximative local atoms of subspace of Banach space has been obtained. Also, a necessary and sufficient condition for the existence of an approximative atomic system for an operator K is given. Finally, explicit methods are given for the construction of an approximative atomic systems for an operator K from a given Bessel sequence and approximative mathcal X d Bessel sequence.


Novel High Efficiency Quadruple Junction Solar Cell with Current Matching and Optimized Quantum Efficiency. A high photon to electricity conversion efficiency of 47.2082 was achieved by a novel combination of In0.51Ga0.49P, GaAs, In0.24Ga0.76As and In0.19Ga0.81Sb subcell layers in a quadruple junction solar cell design. The electronic bandgap of these materials are 1.9 eV, 1.42 eV, 1.08 eV and 0.55 eV respectively. This novel III V arrangement enables the cell to absorb photons from the ultraviolet to deep infrared wavelengths of the solar spectrum. After careful consideration of important semiconductor parameters such as thicknesses of emitter and base layers, doping concentrations, diffusion lengths, minority carrier lifetimes and surface recombination velocities an optimized quadruple junction design has been suggested. Current matching of the subcell layers was ensured to obtain maximum efficiency from the proposed design. The short circuit current density, open circuit voltage and fill factor of the solar cell are 14.7 mA cm2, 3.3731 V and 0.9553 respectively. In the design process, 1 sun AM1.5 global solar spectrum was considered. The cell performance was also investigated for extraterrestrial illumination (AM0). A modified design is proposed for space applications. With a short circuit current density of 18.5 mA cm2, open circuit voltage of 3.4104 and the fill factor of 0.9557, the power conversion efficiency of the modified quadruple junction design is 44.5473 in space.


Collecting the Public Perception of AI and Robot Rights. Whether to give rights to artificial intelligence (AI) and robots has been a sensitive topic since the European Parliament proposed advanced robots could be granted "electronic personalities." Numerous scholars who favor or disfavor its feasibility have participated in the debate. This paper presents an experiment (N 1270) that 1) collects online users' first impressions of 11 possible rights that could be granted to autonomous electronic agents of the future and 2) examines whether debunking common misconceptions on the proposal modifies one's stance toward the issue. The results indicate that even though online users mainly disfavor AI and robot rights, they are supportive of protecting electronic agents from cruelty (i.e., favor the right against cruel treatment). Furthermore, people's perceptions became more positive when given information about rights bearing non human entities or myth refuting statements. The style used to introduce AI and robot rights significantly affected how the participants perceived the proposal, similar to the way metaphors function in creating laws. For robustness, we repeated the experiment over a more representative sample of U.S. residents (N 164) and found that perceptions gathered from online users and those by the general population are similar.


Charnes Cooper Scalarization and Convex Vector Optimization. Our aim in this article is two fold. We use the Charnes Cooper scalarization technique to develop KKT type conditions to completely characterize Pareto minimizers of convex vector optimization problems and further, we use that scalarization technique to develop a simple and efficient algorithm for convex vector optimization problems. Numerical examples are presented to illustrate the use of our algorithm.


Preparing Lessons Improve Knowledge Distillation with Better Supervision. Knowledge distillation (KD) is widely used for training a compact model with the supervision of another large model, which could effectively improve the performance. Previous methods mainly focus on two aspects 1) training the student to mimic representation space of the teacher 2) training the model progressively or adding extra module like discriminator. Knowledge from teacher is useful, but it is still not exactly right compared with ground truth. Besides, overly uncertain supervision also influences the result. We introduce two novel approaches, Knowledge Adjustment (KA) and Dynamic Temperature Distillation (DTD), to penalize bad supervision and improve student model. Experiments on CIFAR 100, CINIC 10 and Tiny ImageNet show that our methods get encouraging performance compared with state of the art methods. When combined with other KD based methods, the performance will be further improved.


GenderRobustness Robustness of Gender Detection in Facial Recognition Systems with variation in Image Properties. In recent times, there have been increasing accusations on artificial intelligence systems and algorithms of computer vision of possessing implicit biases. Even though these conversations are more prevalent now and systems are improving by performing extensive testing and broadening their horizon, biases still do exist. One such class of systems where bias is said to exist is facial recognition systems, where bias has been observed on the basis of gender, ethnicity, skin tone and other facial attributes. This is even more disturbing, given the fact that these systems are used in practically every sector of the industries today. From as critical as criminal identification to as simple as getting your attendance registered, these systems have gained a huge market, especially in recent years. That in itself is a good enough reason for developers of these systems to ensure that the bias is kept to a bare minimum or ideally non existent, to avoid major issues like favoring a particular gender, race, or class of people or rather making a class of people susceptible to false accusations due to inability of these systems to correctly recognize those people.


An Incentive Security Model to Provide Fairness for Peer to Peer Networks. Peer to Peer networks are designed to rely on resources of their own users. Therefore, resource management plays an important role in P2P protocols. Therefore, resource management plays an important role in P2P protocols. Early P2P networks did not use proper mechanisms to manage fairness. However, after seeing difficulties and rise of freeloaders in networks like Gnutella, the importance of providing fairness for users have become apparent. In this paper, we propose an incentive based security model which leads to a network infrastructure that lightens the work of Seeders and makes Leechers to contribute more. This method is able to prevent betrayals in Leecher to Leecher transactions and more importantly, helps Seeders to be treated more fairly. This is what other incentive methods such as Bittorrent are incapable of doing. Additionally, by getting help from cryptography and combining it with our method, it is also possible to achieve secure channels, immune to spying, next to a fair network. The simulation results clearly show that how our proposed approach can overcome free riding issue. In addition, our findings revealed that our approach is able to provide an appropriate level of fairness for the users and can decrease the download time.


Exploiting Complexity in Pen and Touch based Signature Biometrics. Biometric signature verification has been traditionally performed in pen based office like scenarios using devices specifically designed for acquiring handwriting. However, the high deployment of devices such as smartphones and tablets has given rise to new and thriving scenarios for signature biometrics where handwriting can be performed using not only a pen stylus but also the finger via touch interaction. Some preliminary studies have highlighted the challenge of this new scenario and the necessity of further research on the topic. The main contribution of this work is to propose a new on line signature verification architecture adapted to the signature complexity in order to tackle this new and challenging scenario. Additionally, an exhaustive comparative analysis of both pen and touch based scenarios using our proposed methodology is carried out along with a review of the most relevant and recent studies in the field. Significant improvements of biometric verification performance and practical insights are extracted for the application of signature verification in real scenarios.


The harmonic polytope. We study the harmonic polytope, which arose in Ardila, Denham, and Huh's work on the Lagrangian geometry of matroids. We describe its combinatorial structure, showing that it is a (2n 2) dimensional polytope with (n!) 2(1 frac12 cdots frac1n) vertices and 3 n 3 facets. We also give a formula for its volume it is a weighted sum of the degrees of the projective varieties of all the toric ideals of connected bipartite graphs with n edges or equivalently, a weighted sum of the lattice point counts of all the corresponding trimmed generalized permutahedra.


Low Complexity Models for Acoustic Scene Classification Based on Receptive Field Regularization and Frequency Damping. Deep Neural Networks are known to be very demanding in terms of computing and memory requirements. Due to the ever increasing use of embedded systems and mobile devices with a limited resource budget, designing low complexity models without sacrificing too much of their predictive performance gained great importance. In this work, we investigate and compare several well known methods to reduce the number of parameters in neural networks. We further put these into the context of a recent study on the effect of the Receptive Field (RF) on a model's performance, and empirically show that we can achieve high performing low complexity models by applying specific restrictions on the RFs, in combination with parameter reduction methods. Additionally, we propose a filter damping technique for regularizing the RF of models, without altering their architecture and changing their parameter counts. We will show that incorporating this technique improves the performance in various low complexity settings such as pruning and decomposed convolution. Using our proposed filter damping, we achieved the 1st rank at the DCASE 2020 Challenge in the task of Low Complexity Acoustic Scene Classification.


Eulerian Lagrangian modelling of bio aerosols irradiated by UV C light in relation to SARS CoV 2 transmission. It is well known that several viruses, as well as SARS CoV 2, can be transmitted through airborne diffusion of saliva micro droplets. For this reason many reserach groups have been devoted their efforts in order to gain new insight into the transport of fluids and particles originted from human respiratory tracts. This paper aims to provide a contribution to the numerical modelling of bio aerosols. In particular, the well known problem around the safety distance to be held for avoiding virus transmission in the absence of external wind is further investigated. Thus, new indexes capable of evaluating the contamination risk are introduced and the possibility to inactivate virus particles by means of an external UV C radiation source is studied. For this purpose, a new model which takes into account biological inactivation deriving from UV C exposure in a Eulerian Lagrangian framework is presented.


Complexity of Stochastic Dual Dynamic Programming. Stochastic dual dynamic programming is a cutting plane type algorithm for multi stage stochastic optimization originated about 30 years ago. In spite of its popularity in practice, there does not exist any analysis on the convergence rates of this method. In this paper, we first establish the number of iterations, i.e., iteration complexity, required by a basic dynamic cutting plane method for solving relatively simple multi stage optimization problems, by introducing novel mathematical tools including the saturation of search points. We then refine these basic tools and establish the iteration complexity for both deterministic and stochastic dual dynamic programming methods for solving more general multi stage stochastic optimization problems under the standard stage wise independence assumption. Our results indicate that the complexity of some deterministic variants of these methods mildly increases with the number of stages T , in fact linearly dependent on T for discounted problems. Therefore, they are efficient for strategic decision making which involves a large number of stages, but with a relatively small number of decision variables in each stage. Without explicitly discretizing the state and action spaces, these methods might also be pertinent to the related reinforcement learning and stochastic control areas.


Sharp Constants of Approximation Theory. IV. Asymptotic Relations in General Settings. In this paper we first introduce the unified definition of the sharp constant that includes constants in three major problems of approximation theory, such as, inequalities for approximating elements, approximation of individual elements, and approximation on classes of elements. Second, we find sufficient conditions that imply limit relations between various sharp constants of approximation theory in general settings. Third, a number of examples from various areas of approximation theory illustrates the general approach.


Controllability and ergodicity of 3D primitive equations driven by a finite dimensional force. We study the problems of controllability and ergodicity of the system of 3D primitive equations modeling large scale oceanic and atmospheric motions. The system is driven by an additive force acting only on a finite number of Fourier modes in the temperature equation. We first show that the velocity and temperature components of the equations can be simultaneously approximately controlled to arbitrary position in the phase space. The proof is based on Agrachev Sarychev type geometric control approach. Next, we study the controllability of the linearisation of primitive equations around a non stationary trajectory of randomly forced system. Assuming that the probability law of the forcing is decomposable and observable, we prove almost sure approximate controllability by using the same Fourier modes as in the nonlinear setting. Finally, combining the controllability of the linearised system with a criterion from arXiv 1802.03250, we establish exponential mixing for the nonlinear primitive equations with a random force.


Transition cancellations of 87 Rb and 85 Rb atoms in a magnetic field setting new standards. We have analyzed the magnetic field dependences of intensities of all the optical transitions between magnetic sublevels of hyperfine levels, excited with sigma , pi and sigma polarized light, for the D 1 and D 2 lines of 87 Rb and 85 Rb atoms. Depending on the type of transition and the quantum numbers of involved levels, the Hamiltonian matrices are of 1 times 1 , 2 times 2 , 3 times 3 or 4 times 4 dimension. As an example, analytical expressions are presented for the case of 2 times 2 dimension matrices for D 1 line of both isotopes. Eigenvalues and eigenkets are given, and the expression for the transition intensity as a function of B has been determined. It is found that some pi transitions of 87 Rb and 85 Rb get completely canceled for certain, extremely precise, values of B . No cancellation occurs for sigma or sigma transitions of D 1 line. For matrices with size over 2 times 2 , analytical formulas are heavy, and we have performed numerical calculations. All the B values cancelling sigma , pi and sigma transitions of D 1 and D 2 lines of 87 Rb and 85 Rb are calculated, with an accuracy limited by the precision of the involved physical quantities. We believe our modeling can serve as a tool for determination of standardized values of magnetic field. The experimental implementation feasibility and its possible outcome are addressed. We believe the experimental realization will allow to increase precision of the physical quantities involved, in particular the upper state atomic levels energy.


Bargmann transfoms associated with reproducing kernel Hilbert space and application to Dirichlet spaces. The aim of the present paper is three folds. For a reproducing kernel Hilbert space mathcal A (R.K.H.S) and a sigma finite measure space (M 1 ,d mu 1 ) for which the corresponding L 2 space is a separable Hilbert space, we first build an isometry of Bargmann type as an integral transform from L 2 (M 1 ,d mu 1 ) into mathcal A . Secondly, in the case where there exists a sigma finite measure space (M 2 ,d mu 2 ) such that the Hilbert space L 2 (M 2 ,d mu 2 ) is separable and mathcal A subset L 2 (M 2 ,d mu 2 ) the inverse isometry is also given in an explicit form as an integral transform. As consequence, we recover some classical isometries of Bargmann type. Thirdly, for the classical Dirichlet space as R.K.H.S, we elaborate a new isometry of Bargmann type. Furthermore, for this Dirichlet space, we give a new characterization, as harmonic space of a single second order elliptic partial differential operator for which, we present some spectral properties. Finally, we extend the same results to a class of generalized Bergman Dirichlet space.


Hardware Conscious Stream Processing A Survey. Data stream processing systems (DSPSs) enable users to express and run stream applications to continuously process data streams. To achieve real time data analytics, recent researches keep focusing on optimizing the system latency and throughput. Witnessing the recent great achievements in the computer architecture community, researchers and practitioners have investigated the potential of adoption hardware conscious stream processing by better utilizing modern hardware capacity in DSPSs. In this paper, we conduct a systematic survey of recent work in the field, particularly along with the following three directions 1) computation optimization, 2) stream I O optimization, and 3) query deployment. Finally, we advise on potential future research directions.


CoInGP Convolutional Inpainting with Genetic Programming. We investigate the use of Genetic Programming (GP) as a convolutional predictor for missing pixels in images. The training phase is performed by sweeping a sliding window over an image, where the pixels on the border represent the inputs of a GP tree. The output of the tree is taken as the predicted value for the central pixel. We consider two topologies for the sliding window, namely the Moore and the Von Neumann neighborhood. The best GP tree scoring the lowest prediction error over the training set is then used to predict the pixels in the test set. We experimentally assess our approach through two experiments. In the first one, we train a GP tree over a subset of 1000 complete images from the MNIST dataset. The results show that GP can learn the distribution of the pixels with respect to a simple baseline predictor, with no significant differences observed between the two neighborhoods. In the second experiment, we train a GP convolutional predictor on two degraded images, removing around 20 of their pixels. In this case, we observe that the Moore neighborhood works better, although the Von Neumann neighborhood allows for a larger training set.


The HRS tilting process and Grothendieck hearts of t structures. In this paper we revisit the problem of determining when the heart of a t structure is a Grothendieck category, with special attention to the case of the Happel Reiten Smal o (HSR) t structure in the derived category of a Grothendieck category associated to a torsion pair in the latter. We revisit the HRS tilting process deriving from it a lot of information on the HRS t structures which have a projective generator or an injective cogenerator, and obtain several bijections between classes of pairs ( mathcal A , mathbf t ) consisting of an abelian category and a torsion pair in it. We use these bijections to re prove, by different methods, a recent result of Tilting Theory and the fact that if mathbf t ( mathcal T , mathcal F ) is a torsion pair in a Grothendieck category mathcal G , then the heart of the associated HRS t structure is itself a Grothendieck category if, and only if, mathbf t is of finite type. We survey this last problem and recent results after its solution.


The Effectiveness of Memory Replay in Large Scale Continual Learning. We study continual learning in the large scale setting where tasks in the input sequence are not limited to classification, and the outputs can be of high dimension. Among multiple state of the art methods, we found vanilla experience replay (ER) still very competitive in terms of both performance and scalability, despite its simplicity. However, a degraded performance is observed for ER with small memory. A further visualization of the feature space reveals that the intermediate representation undergoes a distributional drift. While existing methods usually replay only the input output pairs, we hypothesize that their regularization effect is inadequate for complex deep models and diverse tasks with small replay buffer size. Following this observation, we propose to replay the activation of the intermediate layers in addition to the input output pairs. Considering that saving raw activation maps can dramatically increase memory and compute cost, we propose the Compressed Activation Replay technique, where compressed representations of layer activation are saved to the replay buffer. We show that this approach can achieve superior regularization effect while adding negligible memory overhead to replay method. Experiments on both the large scale Taskonomy benchmark with a diverse set of tasks and standard common datasets (Split CIFAR and Split miniImageNet) demonstrate the effectiveness of the proposed method.


Billiards in ellipses revisited. We prove some recent experimental observations of D. Reznik concerning periodic billiard orbits in ellipses. For example, the sum of cosines of the angles of a periodic billiard polygon remains constant in the one parameter family of such polygons (that exist due to the Poncelet porism). In our proofs, we use geometric and complex analytic methods.


Asymmetric nonlinear optics of a polar chemical bond. A dielectric material's response to light is macroscopically described by electric displacement fields due to polarization and susceptibility, but the atomistic origin is light cycle driven motion of electron densities in the restoring forces of the atomic environment. Here we report how the macroscopic nonlinear optical response of a heteronuclear crystal relates to the alignment and orientation of its chemical bonds. Substantial nonlinear emission is only observed if the electric field of an optical single cycle pulse points from the less electronegative to the more electronegative element and not vice versa. This asymmetry is a consequence of the unbalanced real space motion of valence charges along the direction of the bonds. These results connect a material's chemical structure to the optical response and may facilitate the comprehension and design of novel materials for applications in optics and lasers on basis of the atoms and how they connect.


Low rank tensor reconstruction of concentrated densities with application to Bayesian inversion. Transport maps have become a popular mechanic to express complicated probability densities using sample propagation through an optimized push forward. Beside their broad applicability and well known success, transport maps suffer from several drawbacks such as numerical inaccuracies induced by the optimization process and the fact that sampling schemes have to be employed when quantities of interest, e.g. moments are to compute. This paper presents a novel method for the accurate functional approximation of probability density functions (PDF) that copes with those issues. By interpreting the pull back result of a target PDF through an inexact transport map as a perturbed reference density, a subsequent functional representation in a more accessible format allows for efficient and more accurate computation of the desired quantities. We introduce a layer based approximation of the perturbed reference density in an appropriate coordinate system to split the high dimensional representation problem into a set of independent approximations for which separately chosen orthonormal basis functions are available. This effectively motivates the notion of h and p refinement (i.e. mesh size'' and polynomial degree) for the approximation of high dimensional PDFs. To circumvent the curse of dimensionality and enable sampling free access to certain quantities of interest, a low rank reconstruction in the tensor train format is employed via the Variational Monte Carlo method. An a priori convergence analysis of the developed approach is derived in terms of Hellinger distance and the Kullback Leibler divergence. Applications comprising Bayesian inverse problems and several degrees of concentrated densities illuminate the (superior) convergence in comparison to Monte Carlo and Markov Chain Monte Carlo methods.


Counting locally flat foldable origami configurations via 3 coloring graphs. Origami, where two dimensional sheets are folded into complex structures, is proving to be rich with combinatorial and geometric structure, most of which remains to be fully understood. In this paper we consider emph flat origami , where the sheet of material is folded into a two dimensional object, and consider the mountain (convex) and valley (concave) creases made by such foldings, called a emph MV assignment of the crease pattern. We establish a method to, given a flat foldable crease pattern C under certain conditions, create a planar graph C whose 3 colorings are in one to one correspondence with the locally valid MV assignments of C . This reduces the general, unsolved problem of enumerating locally valid MV assignments to the enumeration of 3 colorings of graphs.


Soft Anchor Point Object Detection. Recently, anchor free detection methods have been through great progress. The major two families, anchor point detection and key point detection, are at opposite edges of the speed accuracy trade off, with anchor point detectors having the speed advantage. In this work, we boost the performance of the anchor point detector over the key point counterparts while maintaining the speed advantage. To achieve this, we formulate the detection problem from the anchor point's perspective and identify ineffective training as the main problem. Our key insight is that anchor points should be optimized jointly as a group both within and across feature pyramid levels. We propose a simple yet effective training strategy with soft weighted anchor points and soft selected pyramid levels to address the false attention issue within each pyramid level and the feature selection issue across all the pyramid levels, respectively. To evaluate the effectiveness, we train a single stage anchor free detector called Soft Anchor Point Detector (SAPD). Experiments show that our concise SAPD pushes the envelope of speed accuracy trade off to a new level, outperforming recent state of the art anchor free and anchor based detectors. Without bells and whistles, our best model can achieve a single model single scale AP of 47.4 on COCO.


Spherical maximal functions and fractal dimensions of dilation sets. For the spherical mean operators mathcal A t in mathbb R d , d ge 2 , we consider the maximal functions M Ef sup t in E mathcal A t f , with dilation sets E subset 1,2 . In this paper we give a surprising characterization of the closed convex sets which can occur as closure of the sharp L p improving region of M E for some E . This region depends on the Minkowski dimension of E , but also other properties of the fractal geometry such the Assouad spectrum of E and subsets of E . A key ingredient is an essentially sharp result on M E for a class of sets called (quasi )Assouad regular which is new in two dimensions.


Network Modularity Controls the Speed of Information Diffusion. The rapid diffusion of information and the adoption of social behaviors are of critical importance in situations as diverse as collective actions, pandemic prevention, or advertising and marketing. Although the dynamics of large cascades have been extensively studied in various contexts, few have systematically examined the impact of network topology on the efficiency of information diffusion. Here, by employing the linear threshold model on networks with communities, we demonstrate that a prominent network feature the modular structure strongly affects the speed of information diffusion in complex contagion. Our simulations show that there always exists an optimal network modularity for the most efficient spreading process. Beyond this critical value, either a stronger or a weaker modular structure actually hinders the diffusion speed. These results are confirmed by an analytical approximation. We further demonstrate that the optimal modularity varies with both the seed size and the target cascade size, and is ultimately dependent on the network under investigation. We underscore the importance of our findings in applications from marketing to epidemiology, from neuroscience to engineering, where the understanding of the structural design of complex systems focuses on the efficiency of information propagation.


How many ways to color the map of America?. Although the Four Color Conjecture originated in cartography, surprisingly, there is nothing in the literature on the number of ways to color an actual geographic map with four or fewer colors. In this paper, we compute these numbers, with exponentially increasing order of difficulty, for the maps of Canada, France, and the USA. Our attempts to compute the latter two lead to some new results on the chromatic polynomial of graphs.


Factor maps for automorphism groups via Cayley diagrams. A Cayley diagram is an edge labelling of a Cayley graph G ( Gamma, E) by elements of the generating set E so that the cycles correspond exactly to paths labelled by relations in Gamma . We show that if G admits an operatorname Aut (G) f.i.i.d. Cayley diagram, then any Gamma f.i.i.d. solution to a local labelling problem lifts to an operatorname Aut (G) f.i.i.d. solution, and that approximate solutions lift similarly given an approximate Cayley diagram. We also establish a number of results on which graphs admit such a Cayley diagram. We show that regular trees and Cayley graphs of amenable groups always admit operatorname Aut (G) f.i.i.d. approximate Cayley diagrams, and that torsion free nilpotent groups never admit nontrivial operatorname Aut (G) f.i.i.d. Cayley diagrams. Finally, we construct a Cayley graph with a Gamma f.i.i.d. 3 colorings that does not lift to even an approximate operatorname Aut (G) f.i.i.d. 3 coloring. Our construction also answers a question of Weilacher.


Assessing the Security of OPC UA Deployments. To address the increasing security demands of industrial deployments, OPC UA is one of the first industrial protocols explicitly designed with security in mind. However, deploying it securely requires a thorough configuration of a wide range of options. Thus, assessing the security of OPC UA deployments and their configuration is necessary to ensure secure operation, most importantly confidentiality and integrity of industrial processes. In this work, we present extensions to the popular Metasploit Framework to ease network based security assessments of OPC UA deployments. To this end, we discuss methods to discover OPC UA servers, test their authentication, obtain their configuration, and check for vulnerabilities. Ultimately, our work enables operators to verify the (security) configuration of their systems and identify potential attack vectors.


Ranking top k trees in tree based phylogenetic networks. 'Tree based' phylogenetic networks proposed by Francis and Steel have attracted much attention of theoretical biologists in the last few years. At the heart of the definitions of tree based phylogenetic networks is the notion of 'support trees', about which there are numerous algorithmic problems that are important for evolutionary data analysis. Recently, Hayamizu (arXiv 1811.05849 math.CO ) proved a structure theorem for tree based phylogenetic networks and obtained linear time and linear delay algorithms for many basic problems on support trees, such as counting, optimisation, and enumeration. In the present paper, we consider the following fundamental problem in statistical data analysis given a tree based phylogenetic network N whose arcs are associated with probability, create the top k support tree ranking for N by their likelihood values. We provide a linear delay (and hence optimal) algorithm for the problem and thus reveal the interesting property of tree based phylogenetic networks that ranking top k support trees is as computationally easy as picking k arbitrary support trees.


Quantitative Coding and Complexity Theory of Continuous Data. Specifying a computational problem requires fixing encodings for input and output encoding graphs as adjacency matrices, characters as integers, integers as bit strings, and vice versa. For such discrete data, the actual encoding is usually straightforward and or complexity theoretically inessential (up to polynomial time, say) but concerning continuous data, already real numbers naturally suggest various encodings (so called REPRESENTATIONS) with very different properties, ranging from the computably 'unreasonable' binary expansion via qualitatively to polynomially and even linearly complexity theoretically 'reasonable' signed digit expansion. But how to distinguish between un suitable encodings of other spaces common in Calculus and Numerics, such as Sobolev? With respect to qualitative computability, Kreitz and Weihrauch (1985) had identified ADMISSIBILITY as crucial criterion for a representation over the Cantor space of infinite binary sequences to be 'reasonable' cmp. doi 10.1007 11780342 48 . Refining computability over topological to complexity over metric spaces, we develop the theory of POLYNOMIAL LINEAR ADMISSIBILITY as two quantitative refinements of qualitative admissibility. We also rephrase quantitative admissibility as quantitative continuity of both the representation and of its set valued inverse, the latter adopting from doi 10.4115 jla.2013.5.7 a new notion of 'sequential' continuity for multifunctions. By establishing a quantitative continuous selection theorem for multifunctions between compact ultrametric spaces, we can extend our above quantitative MAIN THEOREM from functions to multifunctions aka search problems. Higher type complexity is captured by generalizing Cantor's (and Baire's) ground space for encodings to other (compact) ULRAmetric spaces.


Generalized Extended Riemann Liouville type fractional derivative operator. In this paper, we aim to present new extensions of incomplete gamma, beta, Gauss hypergeometric, confluent hypergeometric function and Appell Lauricella hypergeometric functions, by using the extended Bessel function due to Boudjelkha 4 . Some recurrence relations, transformation formulas, Mellin transform and integral representations are obtained for these generalizations. Further, an extension of the Riemann Liouville fractional derivative operator is established.


Unsupervised Learning Based Robust Multivariate Intrusion Detection System for Cyber Physical Systems using Low Rank Matrix. Regular and uninterrupted operation of critical infrastructures such as power, transport, communication etc. are essential for proper functioning of a country. Cyber attacks causing disruption in critical infrastructure service in the past, are considered as a significant threat. With the advancement in technology and the progress of the critical infrastructures towards IP based communication, cyber physical systems are lucrative targets of the attackers. In this paper, we propose a robust multivariate intrusion detection system called RAD for detecting attacks in the cyber physical systems in O(d) space and time complexity, where d is the number parameters in the system state vector. The proposed Intrusion Detection System(IDS) is developed in an unsupervised learning setting without using labelled data denoting attacks. It allows a fraction of the training data to be corrupted by outliers or under attack, by subscribing to robust training procedure. The proposed IDS outperforms existing anomaly detection techniques in several real world datasets and attack scenarios.


Address Event Variable Length Compression for Time Encoded Data. Time encoded signals, such as social network update logs and spiking traces in neuromorphic processors, are defined by multiple traces carrying information in the timing of events, or spikes. When time encoded data is processed at a remote site with respect to the location it is produced, the occurrence of events needs to be encoded and transmitted in a timely fashion. The standard Address Event Representation (AER) protocol for neuromorphic chips encodes the indices of the "spiking" traces in the payload of a packet produced at the same time the events are recorded, hence implicitly encoding the events' timing in the timing of the packet. This paper investigates the potential bandwidth saving that can be obtained by carrying out variable length compression of packets' payloads. Compression leverages both intra trace and inter trace correlations over time that are typical in applications such as social networks or neuromorphic computing. The approach is based on discrete time Hawkes processes and entropy coding with conditional codebooks. Results from an experiment based on a real world retweet dataset are also provided.


Fully superconducting machine for electric aircraft propulsion study of AC loss for HTS stator. Fully superconducting machines provide the high power density required for future electric aircraft propulsion. However, superconducting windings generate AC losses in AC electrical machine environments. These AC losses are difficult to remove at low temperatures and they add an extra burden to the aircraft cooling system. Due to heavy cooling penalty, AC losses in the HTS stator, is one of the key topics in HTS machine design. In order to evaluate the AC loss of superconducting stator windings in a rotational machine environment, we designed and built a novel axial flux high temperature superconducting (HTS) machine platform. The AC loss measurement is based on calorimetrically boiling off liquid nitrogen. Both total AC loss and magnetisation loss in HTS stator are measured in a rotational magnetic field condition. This platform is essential to study ways to minimise AC losses in HTS stator, in order to maximum the efficiency of fully HTS machines.


Explainability in Deep Reinforcement Learning. A large set of the explainable Artificial Intelligence (XAI) literature is emerging on feature relevance techniques to explain a deep neural network (DNN) output or explaining models that ingest image source data. However, assessing how XAI techniques can help understand models beyond classification tasks, e.g. for reinforcement learning (RL), has not been extensively studied. We review recent works in the direction to attain Explainable Reinforcement Learning (XRL), a relatively new subfield of Explainable Artificial Intelligence, intended to be used in general public applications, with diverse audiences, requiring ethical, responsible and trustable algorithms. In critical situations where it is essential to justify and explain the agent's behaviour, better explainability and interpretability of RL models could help gain scientific insight on the inner workings of what is still considered a black box. We evaluate mainly studies directly linking explainability to RL, and split these into two categories according to the way the explanations are generated transparent algorithms and post hoc explainaility. We also review the most prominent XAI works from the lenses of how they could potentially enlighten the further deployment of the latest advances in RL, in the demanding present and future of everyday problems.


PAWS Paraphrase Adversaries from Word Scrambling. Existing paraphrase identification datasets lack sentence pairs that have high lexical overlap without being paraphrases. Models trained on such data fail to distinguish pairs like flights from New York to Florida and flights from Florida to New York. This paper introduces PAWS (Paraphrase Adversaries from Word Scrambling), a new dataset with 108,463 well formed paraphrase and non paraphrase pairs with high lexical overlap. Challenging pairs are generated by controlled word swapping and back translation, followed by fluency and paraphrase judgments by human raters. State of the art models trained on existing datasets have dismal performance on PAWS ( 40 accuracy) however, including PAWS training data for these models improves their accuracy to 85 while maintaining performance on existing tasks. In contrast, models that do not capture non local contextual information fail even with PAWS training examples. As such, PAWS provides an effective instrument for driving further progress on models that better exploit structure, context, and pairwise comparisons.


Graph Convolutional Subspace Clustering A Robust Subspace Clustering Framework for Hyperspectral Image. Hyperspectral image (HSI) clustering is a challenging task due to the high complexity of HSI data. Subspace clustering has been proven to be powerful for exploiting the intrinsic relationship between data points. Despite the impressive performance in the HSI clustering, traditional subspace clustering methods often ignore the inherent structural information among data. In this paper, we revisit the subspace clustering with graph convolution and present a novel subspace clustering framework called Graph Convolutional Subspace Clustering (GCSC) for robust HSI clustering. Specifically, the framework recasts the self expressiveness property of the data into the non Euclidean domain, which results in a more robust graph embedding dictionary. We show that traditional subspace clustering models are the special forms of our framework with the Euclidean data. Basing on the framework, we further propose two novel subspace clustering models by using the Frobenius norm, namely Efficient GCSC (EGCSC) and Efficient Kernel GCSC (EKGCSC). Both models have a globally optimal closed form solution, which makes them easier to implement, train, and apply in practice. Extensive experiments on three popular HSI datasets demonstrate that EGCSC and EKGCSC can achieve state of the art clustering performance and dramatically outperforms many existing methods with significant margins.


Enhancing PIO Element Detection in Medical Text Using Contextualized Embedding. In this paper, we investigate a new approach to Population, Intervention and Outcome (PIO) element detection, a common task in Evidence Based Medicine (EBM). The purpose of this study is two fold to build a training dataset for PIO element detection with minimum redundancy and ambiguity and to investigate possible options in utilizing state of the art embedding methods for the task of PIO element detection. For the former purpose, we build a new and improved dataset by investigating the shortcomings of previously released datasets. For the latter purpose, we leverage the state of the art text embedding, Bidirectional Encoder Representations from Transformers (BERT), and build a multi label classifier. We show that choosing a domain specific pre trained embedding further optimizes the performance of the classifier. Furthermore, we show that the model could be enhanced by using ensemble methods and boosting techniques provided that features are adequately chosen.


Modularity and Projection of Bipartite Networks. This paper investigates community detection by modularity maximisation on bipartite networks. In particular we are interested in how the operation of projection, using one node set of the bipartite network to infer connections between nodes in the other set, interacts with community detection. We first define a notion of modularity appropriate for a projected bipartite network and outline an algorithm for maximising it in order to partition the network. Using both real and synthetic networks we compare the communities found by five different algorithms, where each algorithm maximises a different modularity function and sees different aspects of the bipartite structure. Based on these results we suggest a simple heuristic for finding communities in bipartite networks.


Feedback Motion Planning for Long Range Autonomous Underwater Vehicles. Ocean ecosystems have spatiotemporal variability and dynamic complexity that require a long term deployment of an autonomous underwater vehicle for data collection. A new long range autonomous underwater vehicle called Tethys is adapted to study different oceanic phenomena. Additionally, an ocean environment has external forces and moments along with changing water currents which are generally not considered in a vehicle kinematic model. In this scenario, it is not enough to generate a simple trajectory from an initial location to a goal location in an uncertain ocean as the vehicle can deviate from its intended trajectory. As such, we propose to compute a feedback plan that adapts the vehicle trajectory in the presence of any modeled or unmodeled uncertainties. In this work, we present a feedback motion planning method for the Tethys vehicle by combining a predictive ocean model and its kinematic modeling. Given a goal location, the Tethys kinematic model, and the water flow pattern, our method computes a feedback plan for the vehicle in a dynamic ocean environment that reduces its energy consumption. The computed feedback plan provides the optimal action for the Tethys vehicle to take from any location of the environment to reach the goal location considering its orientation. Our results based on actual ocean model prediction data demonstrate the applicability of our method.


RF Helicon based Inductive Plasma Thruster (IPT) Design for an Atmosphere Breathing Electric Propulsion system (ABEP). Challenging space missions include those at very low altitudes, where the atmosphere is source of aerodynamic drag on the spacecraft. To extend such missions lifetime, an efficient propulsion system is required. One solution is Atmosphere Breathing Electric Propulsion (ABEP). It collects atmospheric particles to be used as propellant for an electric thruster. The system would minimize the requirement of limited propellant availability and can also be applied to any planet with atmosphere, enabling new mission at low altitude ranges for longer times. Challenging is also the presence of reactive chemical species, such as atomic oxygen in Earth orbit. Such species cause erosion of (not only) propulsion system components, i.e. acceleration grids, electrodes, and discharge channels of conventional EP systems. IRS is developing within the DISCOVERER project, an intake and a thruster for an ABEP system. The paper describes the design and implementation of the RF helicon based inductive plasma thruster (IPT). This paper deals in particular with the design and implementation of a novel antenna called the birdcage antenna, a device well known in magnetic resonance imaging (MRI), and also lately employed for helicon wave based plasma sources in fusion research. The IPT is based on RF electrodeless operation aided by an externally applied static magnetic field. The IPT is composed by an antenna, a discharge channel, a movable injector, and a solenoid. By changing the operational parameters along with the novel antenna design, the aim is to minimize losses in the RF circuit, and accelerate a quasi neutral plasma plume. This is also to be aided by the formation of helicon waves within the plasma that are to improve the overall efficiency and achieve higher exhaust velocities. Finally, the designed IPT with a particular focus on the birdcage antenna design procedure is presented


Reference Language based Unsupervised Neural Machine Translation. Exploiting a common language as an auxiliary for better translation has a long tradition in machine translation and lets supervised learning based machine translation enjoy the enhancement delivered by the well used pivot language in the absence of a source language to target language parallel corpus. The rise of unsupervised neural machine translation (UNMT) almost completely relieves the parallel corpus curse, though UNMT is still subject to unsatisfactory performance due to the vagueness of the clues available for its core back translation training. Further enriching the idea of pivot translation by extending the use of parallel corpora beyond the source target paradigm, we propose a new reference language based framework for UNMT, RUNMT, in which the reference language only shares a parallel corpus with the source, but this corpus still indicates a signal clear enough to help the reconstruction training of UNMT through a proposed reference agreement mechanism. Experimental results show that our methods improve the quality of UNMT over that of a strong baseline that uses only one auxiliary language, demonstrating the usefulness of the proposed reference language based UNMT and establishing a good start for the community.


Symbolic AI for XAI Evaluating LFIT Inductive Programming for Fair and Explainable Automatic Recruitment. Machine learning methods are growing in relevance for biometrics and personal information processing in domains such as forensics, e health, recruitment, and e learning. In these domains, white box (human readable) explanations of systems built on machine learning methods can become crucial. Inductive Logic Programming (ILP) is a subfield of symbolic AI aimed to automatically learn declarative theories about the process of data. Learning from Interpretation Transition (LFIT) is an ILP technique that can learn a propositional logic theory equivalent to a given black box system (under certain conditions). The present work takes a first step to a general methodology to incorporate accurate declarative explanations to classic machine learning by checking the viability of LFIT in a specific AI application scenario fair recruitment based on an automatic tool generated with machine learning methods for ranking Curricula Vitae that incorporates soft biometric information (gender and ethnicity). We show the expressiveness of LFIT for this specific problem and propose a scheme that can be applicable to other domains.


Ends of digraphs I basic theory. In a series of three papers we develop an end space theory for directed graphs. As for undirected graphs, the ends of a digraph are points at infinity to which its rays converge. Unlike for undirected graphs, some ends are joined by limit edges these are crucial for obtaining the end space of a digraph as a natural (inverse) limit of its finite contraction minors. As our main result in this first paper of our series we show that the notion of directions of an undirected graph, a tangle like description of its ends, extends to digraphs there is a one to one correspondence between the directions' of a digraph and its ends and limit edges. In the course of this we extend to digraphs a number of fundamental tools and techniques for the study of ends of graphs, such as the star comb lemma and Schmidt's ranking of rayless graphs.


On the derived category of the Iwahori Hecke algebra. We state a conjecture that relates the derived category of smooth representations of a p adic split reductive group with the derived category of (quasi )coherent sheaves on a stack of L parameters. We investigate the conjecture in the case of the principal block of GL n by showing that the functor should be given by the derived tensor product with the family of representations interpolating the modified Langlands correspondence over the stack of L parameters that is suggested by the work of Helm and Emerton Helm.


Fireiron A Scheduling Language for High Performance Linear Algebra on GPUs. Achieving high performance GPU kernels requires optimizing algorithm implementations to the targeted GPU architecture. It is of utmost importance to fully use the compute and memory hierarchy, as well as available specialised hardware. Currently, vendor libraries like cuBLAS and cuDNN provide the best performing implementations of GPU algorithms. However the task of the library programmer is incredibly challenging for each provided algorithm, high performance implementations have to be developed for all commonly used architectures, input sizes, and different storage formats. These implementations are generally provided as optimized assembly code because performance critical architectural features are only exposed at this level. This prevents reuse between different implementations of even the same algorithm, as simple differences can have major effects on low level implementation details. In this paper we introduce Fireiron, a DSL and compiler which allows the specification of high performance GPU implementations as compositions of simple and reusable building blocks. We show how to use Fireiron to optimize matrix multiplication implementations, achieving performance matching hand coded CUDA kernels, even when using specialised hardware such as NIVIDA Tensor Cores, and outperforming state of the art implementations provided by cuBLAS by more than 2x.


Existence and regularity results for some Fully Non Linear singular or degenerate equation. In this article we prove existence, uniqueness and regularity for the singular equation begin eqnarray label eqfln begin cases nabla u alpha (F(D 2 u) h(x) cdot nabla u) c(x) u alpha u p(x)u gamma 0 mbox in Omega u 0 mbox in Omega , mbox u 0 mbox on partial Omega end cases end eqnarray when p is some continuous and positive function, c and h are continuous, alpha 1 and F is Fully non linear elliptic. Some conditions on the first eigenvalue for the operator nabla u alpha (F(D 2 u) h(x) cdot nabla u) c(x) u alpha u are required. The results generalizes the well known results of Lazer and Mac Kenna.


Divisibility and Arithmetic Properties of a Class of Sparse Polynomials. We investigate algebraic and arithmetic properties of a class of sequences of sparse polynomials that have binomial coefficients both as exponents and as coefficients. In addition to divisibility and irreducibility results we also consider rational roots. This leads to the study of an infinite class of integer sequences which have interesting properties and satisfy linear recurrence relations.


A Vision for Numerical Weather Prediction in 2030. In this essay, I outline a personal vision of how I think Numerical Weather Prediction (NWP) should evolve in the years leading up to 2030 and hence what it should look like in 2030. By NWP I mean initial value predictions from timescales of hours to seasons ahead. Here I want to focus on how NWP can better help save lives from increasingly extreme weather in those parts of the world where society is most vulnerable. Whilst we can rightly be proud of many parts of our NWP heritage, its evolution has been influenced by national or institutional politics as well as by underpinning scientific principles. Sometimes these conflict with each other. It is important to be able to separate these issues when discussing how best meteorological science can serve society in 2030 otherwise any disruptive change no matter how compelling the scientific case for it becomes impossibly difficult.


Relative Equivariant Coarse Index Theorem and Relative L 2 Index Theorem. In this paper, we give a definition of the relative equivariant coarse index for proper actions and derive a relative equivariant coarse index theorem connecting this index with the localized equivariant coarse indices. This is an equivariant version of Roe's relative coarse index theorem in arXiv arch ive 1210.6100. Furthermore, we present a definition of the relative L 2 index and prove a relative L 2 index theorem which is a relative version of Atiyah's L 2 index theorem.


The structure of group preserving operators. In this paper, we prove the existence of a particular diagonalization for normal bounded operators defined on subspaces of L 2( mathfrak S ) where mathfrak S is a second countable LCA group. The subspaces where the operators act are invariant under the action of a group Gamma which is a semi direct product of a uniform lattice of mathfrak S with a discrete group of automorphisms. This class includes the crystal groups which are important in applications as models for images. The operators are assumed to be Gamma preserving. i.e. they commute with the action of Gamma . In particular we obtain a spectral decomposition for these operators. This generalizes recent results on shift preserving operators acting on lattice invariant subspaces where mathfrak S is the Euclidean space.


A Regularized System for the Nonlinear Variational Wave Equation. We derive a new generalization of the nonlinear variational wave equation. We prove existence of local, smooth solutions for this system. As a limiting case, we recover the nonlinear variational wave equation.


COCAS A Large Scale Clothes Changing Person Dataset for Re identification. Recent years have witnessed great progress in person re identification (re id). Several academic benchmarks such as Market1501, CUHK03 and DukeMTMC play important roles to promote the re id research. To our best knowledge, all the existing benchmarks assume the same person will have the same clothes. While in real world scenarios, it is very often for a person to change clothes. To address the clothes changing person re id problem, we construct a novel large scale re id benchmark named ClOthes ChAnging Person Set (COCAS), which provides multiple images of the same identity with different clothes. COCAS totally contains 62,382 body images from 5,266 persons. Based on COCAS, we introduce a new person re id setting for clothes changing problem, where the query includes both a clothes template and a person image taking another clothes. Moreover, we propose a two branch network named Biometric Clothes Network (BC Net) which can effectively integrate biometric and clothes feature for re id under our setting. Experiments show that it is feasible for clothes changing re id with clothes templates.


A Survey on Contextual Embeddings. Contextual embeddings, such as ELMo and BERT, move beyond global word representations like Word2Vec and achieve ground breaking performance on a wide range of natural language processing tasks. Contextual embeddings assign each word a representation based on its context, thereby capturing uses of words across varied contexts and encoding knowledge that transfers across languages. In this survey, we review existing contextual embedding models, cross lingual polyglot pre training, the application of contextual embeddings in downstream tasks, model compression, and model analyses.


A convergence criterion for systems of point processes from the convergence of their stochastic intensities. We study systems of simple point processes that admit stochastic intensities. We represent these point processes as thinnings of Poisson measures and are interested in a convergence result of such systems. This result states that, if the stochastic intensities of the limit point processes are independent of the underlying Poisson measures, the convergence in distribution in Skorohod topology of the stochastic intensities implies the same convergence for the point processes.


Inverse parabolic problems of determining functions with one spatial component independence by Carleman estimate. For an initial boundary value problem for a parabolic equation in the spatial variable x (x 1,.., x n) and time t , we consider an inverse problem of determining a coefficient which is independent of one spatial component x n by extra lateral boundary data. We apply a Carleman estimate to prove a conditional stability estimate for the inverse problem. Also we prove similar results for the corresponding inverse source problem.


Size matters in the modal mu calculus. We discuss and compare complexity measures for the modal mu calculus, focusing on size and alternation depth. As a yardstick we take Wilke's alternating tree automata, which we shall call parity formulas in the text. Building on work by Bruse, Friedmann Lange, we compare two size measures for mu calculus formulas subformula size,i.e. , the number of subformulas of the given formula, and closure size. These notions correspond to the representation of a formula as a parity formula based on, respectively, its subformula dag, and its closure graph. What distinguishes our approach is that we are explicit about the role of alpha equivalence, as naively renaming bound variables can lead to an exponential blow up. In addition, we match the formula's alternation depth with the index of the parity formula. We start in a setting without alpha equivalence. We define subformula size and closure size and recall that a mu calculus formula can be transformed into a parity formula of size linear wrt subformula size, and give a construction that transforms a mu calculus formula into an equivalent parity formula linear wrt closure size. Conversely, there is a standard transformation producing a mu calculus formula of exponential subformula but linear closure size in terms of the size of the original parity formula. We identify so called untwisted parity formulas for which a transformation linear in subformula size exists. We then introduce size notions that are completely invariant under alpha equivalence. We transfer the result of Bruse et alii, showing that also in our setting closure size can be exponentially smaller than subformula size. We also show how to rename bound variables so that alpha equivalence becomes syntactic identity on the closure set. Finally, we review the complexity of guarded transformations.


Random growth on a Ramanujan graph. The behavior of a certain random growth process is analyzed on arbitrary regular and non regular graphs. Our argument is based on the Expander Mixing Lemma, which entails that the results are strongest for Ramanujan graphs, which asymptotically maximize the spectral gap. Further, we consider Erd H o s R 'enyi random graphs and compare our theoretical results with computational experiments on flip graphs of point configurations. The latter is relevant for enumerating triangulations.


On number of pendants in local antimagic chromatic number. An edge labeling of a connected graph G (V, E) is said to be local antimagic if it is a bijection f E to 1, ldots , E such that for any pair of adjacent vertices x and y , f (x) not f (y) , where the induced vertex label f (x) sum f(e) , with e ranging over all the edges incident to x . The local antimagic chromatic number of G , denoted by chi la (G) , is the minimum number of distinct induced vertex labels over all local antimagic labelings of G . Let chi(G) be the chromatic number of G . In this paper, sharp upper and lower bounds of chi la (G) for G with pendant vertices, and sufficient conditions for the bounds to equal, are obtained. Consequently, for k ge 1 , there are infinitely many graphs with k ge chi(G) 1 pendant vertices and chi la (G) k 1 . We conjecture that every tree T k , other than certain caterpillars, spiders and lobsters, with k ge 1 pendant vertices has chi la (T k) k 1 .