Best Practices for Learning Domain Specific Cross Lingual Embeddings. Cross lingual embeddings aim to represent words in multiple languages in a shared vector space by capturing semantic similarities across languages. They are a crucial component for scaling tasks to multiple languages by transferring knowledge from languages with rich resources to low resource languages. A common approach to learning cross lingual embeddings is to train monolingual embeddings separately for each language and learn a linear projection from the monolingual spaces into a shared space, where the mapping relies on a small seed dictionary. While there are high quality generic seed dictionaries and pre trained cross lingual embeddings available for many language pairs, there is little research on how they perform on specialised tasks. In this paper, we investigate the best practices for constructing the seed dictionary for a specific domain. We evaluate the embeddings on the sequence labelling task of Curriculum Vitae parsing and show that the size of a bilingual dictionary, the frequency of the dictionary words in the domain corpora and the source of data (task specific vs generic) influence the performance. We also show that the less training data is available in the low resource language, the more the construction of the bilingual dictionary matters, and demonstrate that some of the choices are crucial in the zero shot transfer learning case.


Enhancing frustrated double ionisation with no electronic correlation in triatomic molecules using counter rotating two color circular laser fields. We demonstrate significant enhancement of frustrated double ionization (FDI) in the two electron triatomic molecule D 3 when driven by counter rotating two color circular (CRTC) laser fields. We employ a three dimensional semiclassical model that fully accounts for electron and nuclear motion in strong fields. For different pairs of wavelengths, we compute the probabilities of the FDI pathways as a function of the ratio of the two field strengths. We identify a pathway of frustrated double ionization that is not present in strongly driven molecules with linear fields. In this pathway the first ionization step is "frustrated" and electronic correlation is essentially absent. This pathway is responsible for enhancing frustrated double ionization with CRTC fields. We also employ a simple model that predicts many of the main features of the probabilities of the FDI pathways as a function of the ratio of the two field strengths.


Modeling Penetration Testing with Reinforcement Learning Using Capture the Flag Challenges Trade offs between Model free Learning and A Priori Knowledge. Penetration testing is a security exercise aimed at assessing the security of a system by simulating attacks against it. So far, penetration testing has been carried out mainly by trained human attackers and its success critically depended on the available expertise. Automating this practice constitutes a non trivial problem, as the range of actions that a human expert may attempts against a system and the range of knowledge she relies on to take her decisions are hard to capture. In this paper, we focus our attention on simplified penetration testing problems expressed in the form of capture the flag hacking challenges, and we analyze how model free reinforcement learning algorithms may help to solve them. In modeling these capture the flag competitions as reinforcement learning problems we highlight that a specific challenge that characterize penetration testing is the problem of discovering the structure of the problem at hand. We then show how this challenge may be eased by relying on different forms of prior knowledge that may be provided to the agent. In this way we demonstrate how the feasibility of tackling penetration testing using reinforcement learning may rest on a careful trade off between model free and model based algorithms. By using techniques to inject a priori knowledge, we show it is possible to better direct the agent and restrict the space of its exploration problem, thus achieving solutions more efficiently.


wisardpkg A library for WiSARD based models. In order to facilitate the production of codes using WiSARD based models, LabZero developed an ML library C Python called wisardpkg. This library is an MIT licensed open source package hosted on GitHub under the license.


Adaptive activation functions accelerate convergence in deep and physics informed neural networks. We employ adaptive activation functions for regression in deep and physics informed neural networks (PINNs) to approximate smooth and discontinuous functions as well as solutions of linear and nonlinear partial differential equations. In particular, we solve the nonlinear Klein Gordon equation, which has smooth solutions, the nonlinear Burgers equation, which can admit high gradient solutions, and the Helmholtz equation. We introduce a scalable hyper parameter in the activation function, which can be optimized to achieve best performance of the network as it changes dynamically the topology of the loss function involved in the optimization process. The adaptive activation function has better learning capabilities than the traditional one (fixed activation) as it improves greatly the convergence rate, especially at early training, as well as the solution accuracy. To better understand the learning process, we plot the neural network solution in the frequency domain to examine how the network captures successively different frequency bands present in the solution. We consider both forward problems, where the approximate solutions are obtained, as well as inverse problems, where parameters involved in the governing equation are identified. Our simulation results show that the proposed method is a very simple and effective approach to increase the efficiency, robustness and accuracy of the neural network approximation of nonlinear functions as well as solutions of partial differential equations, especially for forward problems.


Nonlinear mechanism of the self sustaining process in the buffer and logarithmic layer of wall bounded flows. The nonlinear mechanism in the self sustaining process (SSP) of wall bounded turbulence is investigated. Resolvent analysis is used to identify the principal forcing mode which produces the maximum amplification of the velocities in numerical simulations of the minimal channel for the buffer layer and a modified logarithmic (log) layer. The wavenumbers targeted in this study are those of the fundamental mode that is infinitely long in the streamwise direction and once periodic in the spanwise direction. The identified mode is then projected out from the nonlinear term of the Navier Stokes equations at each time step from the simulation of the corresponding minimal channel. The results show that the removal of the principal forcing mode of the fundamental wavenumber can inhibit turbulence in both the buffer and log layer, with the effect being greater in the buffer layer. Removing other modes instead of the principal mode of the fundamental wavenumber only marginally affects the flow. Closer inspection of the dyadic interactions in the nonlinear term shows that contributions toward the principal forcing mode come from a limited set of wavenumber interactions. Using conditional averaging, the flow structures that are responsible for generating the nonlinear interaction to self sustain turbulence are identified as spanwise rolls interacting with oblique streaks. This method, based on the equations of motion, validates the similarities in the SSP of the buffer and log layer, and characterises the underlying quadratic interactions in the SSP of the minimal channel.


Context aware Feature Generation for Zero shot Semantic Segmentation. Existing semantic segmentation models heavily rely on dense pixel wise annotations. To reduce the annotation pressure, we focus on a challenging task named zero shot semantic segmentation, which aims to segment unseen objects with zero annotations. This task can be accomplished by transferring knowledge across categories via semantic word embeddings. In this paper, we propose a novel context aware feature generation method for zero shot segmentation named CaGNet. In particular, with the observation that a pixel wise feature highly depends on its contextual information, we insert a contextual module in a segmentation network to capture the pixel wise contextual information, which guides the process of generating more diverse and context aware features from semantic word embeddings. Our method achieves state of the art results on three benchmark datasets for zero shot segmentation. Codes are available at https github.com bcmi CaGNet Zero Shot Semantic Segmentation.


Adaptive Attentional Network for Few Shot Knowledge Graph Completion. Few shot Knowledge Graph (KG) completion is a focus of current research, where each task aims at querying unseen facts of a relation given its few shot reference entity pairs. Recent attempts solve this problem by learning static representations of entities and references, ignoring their dynamic properties, i.e., entities may exhibit diverse roles within task relations, and references may make different contributions to queries. This work proposes an adaptive attentional network for few shot KG completion by learning adaptive entity and reference representations. Specifically, entities are modeled by an adaptive neighbor encoder to discern their task oriented roles, while references are modeled by an adaptive query aware aggregator to differentiate their contributions. Through the attention mechanism, both entities and references can capture their fine grained semantic meanings, and thus render more expressive representations. This will be more predictive for knowledge acquisition in the few shot scenario. Evaluation in link prediction on two public datasets shows that our approach achieves new state of the art results with different few shot sizes.


CrowdOS A Ubiquitous Operating System for Crowdsourcing and Mobile Crowd Sensing. With the rise of crowdsourcing and mobile crowdsensing techniques, a large number of crowdsourcing applications or platforms (CAP) have appeared. In the mean time, CAP related models and frameworks based on different research hypotheses are rapidly emerging, and they usually address specific issues from a certain perspective. Due to different settings and conditions, different models are not compatible with each other. However, CAP urgently needs to combine these techniques to form a unified framework. In addition, these models needs to be learned and updated online with the extension of crowdsourced data and task types, thus requiring a unified architecture that integrates lifelong learning concepts and breaks down the barriers between different modules. This paper draws on the idea of ubiquitous operating systems and proposes a novel OS (CrowdOS), which is an abstract software layer running between native OS and application layer. In particular, based on an in depth analysis of the complex crowd environment and diverse characteristics of heterogeneous tasks, we construct the OS kernel and three core frameworks including Task Resolution and Assignment Framework (TRAF), Integrated Resource Management (IRM), and Task Result quality Optimization (TRO). In addition, we validate the usability of CrowdOS, module correctness and development efficiency. Our evaluation further reveals TRO brings enormous improvement in efficiency and a reduction in energy consumption.


Machine learning technique using the signature method for automated quality control of the Argo profiles. A profile from the Argo ocean observation array is a sequence of three dimensional vectors composed of pressure, salinity, and temperature, appearing as a continuous curve in three dimensional space. The shape of this curve is faithfully represented by a path signature, which is a collection of all the iterated integrals. Moreover, the product of two terms of the signature of a path can be expressed as the sum of higher order terms. Thanks to this algebraic property, a nonlinear function of profile shape can always be represented by a weighted linear combination of the iterated integrals, which enables machine learning of a complicated function of the profile shape. In this study, we performed supervised learning for existing Argo data with quality control flags by using the signature method, and demonstrated the estimation performance by cross validation. Unlike rule based approaches, which require several complicated and possibly subjective rules, this method is simple and objective in nature because it relies only on past knowledge regarding the shape of profiles. This technique should be critical to realizing automatic quality control for Argo profile data.


iHorology Lowering the Barrier to Microsecond level Internet Time. High precision, synchronized clocks are essential to a growing number of Internet applications. Standard protocols and their associated server infrastructure have been shown to typically enable client clocks to synchronize on the order of tens of milliseconds. We address one of the key challenges to high precision Internet timekeeping the intrinsic contribution to clock error of path asymmetry between client and time server, a fundamental barrier to microsecond level accuracy. We first exploit results of a measurement study to quantify asymmetry and its effect on timing. We then describe three approaches to addressing the path asymmetry problem LBBE, SBBE and K SBBE, each based on timestamp exchange with multiple servers, with the goal of tightening bounds on asymmetry for each client. We explore their capabilities and limitations through simulation and argument. We show that substantial improvements are possible, and discuss whether, and how, the goal of microsecond accuracy might be attained.


Rainy screens Collecting rainy datasets, indoors. Acquisition of data with adverse conditions in robotics is a cumbersome task due to the difficulty in guaranteeing proper ground truth and synchronising with desired weather conditions. In this paper, we present a simple method recording a high resolution screen for generating diverse rainy images from existing clear ground truth images that is domain and source agnostic, simple and scales up. This setup allows us to leverage the diversity of existing datasets with auxiliary task ground truth data, such as semantic segmentation, object positions etc. We generate rainy images with real adherent droplets and rain streaks based on Cityscapes and BDD, and train a de raining model. We present quantitative results for image reconstruction and semantic segmentation, and qualitative results for an out of sample domain, showing that models trained with our data generalize well.


Performance Analysis of Physical Layer Security over Fluctuating Beckmann Fading Channels. In this paper, we analyse the performance of physical layer security over Fluctuating Beckmann (FB) fading channel which is an extended model of both the kappa mu shadowed and the classical Beckmann distributions. Specifically, the average secrecy capacity (ASC), secure outage probability (SOP), the lower bound of SOP (SOP L ), and the probability of strictly positive secrecy capacity (SPSC) are derived in exact closed form expressions using two different values of the fading parameters, namely, m and mu which represent the multipath and shadowing severity impacts, respectively. Firstly, when the fading parameters are arbitrary values, the performance metrics are derived in exact closed form in terms of the extended generalised bivariate Fox's H function (EGBFHF) that has been widely implemented in the open literature. In the second case, to obtain simple mathematically tractable expressions in terms of analytic functions as well as to gain more insight on the behaviour of the physical layer security over Fluctuating Beckmann fading channel models, m and mu are assumed to be integer and even numbers, respectively. The numerical results of this analysis are verified via Monte Carlo simulations.


Transfers of energy through fast diffusion channels in some resonant PDEs on the circle. In this paper we consider two classes of resonant Hamiltonian PDEs on the circle with non convex (respect to actions) first order resonant Hamiltonian. We show that, for appropriate choices of the nonlinearities we can find time independent linear potentials that enable the construction of solutions that undergo a prescribed growth in the Sobolev norms. The solutions that we provide follow closely the orbits of a nonlinear resonant model, which is a good approximation of the full equation. The non convexity of the resonant Hamiltonian allows the existence of fast diffusion channels along which the orbits of the resonant model experience a large drift in the actions in the optimal time. This phenomenon induces a transfer of energy among the Fourier modes of the solutions which in turn is responsible for the growth of higher order Sobolev norms.


Ego2Hands A Dataset for Egocentric Two hand Segmentation and Detection. Hand segmentation and detection in truly unconstrained RGB based settings is important for many applications. However, existing datasets are far from sufficient in terms of size and variety due to the infeasibility of manual annotation of large amounts of segmentation and detection data. As a result, current methods are limited by many underlying assumptions such as constrained environment, consistent skin color and lighting. In this work, we present Ego2Hands, a large scale RGB based egocentric hand segmentation detection dataset that is semi automatically annotated and a color invariant compositing based data generation technique capable of creating training data with large quantity and variety. For quantitative analysis, we manually annotated an evaluation set that significantly exceeds existing benchmarks in quantity, diversity and annotation accuracy. We provide cross dataset evaluation as well as thorough analysis on the performance of state of the art models on Ego2Hands to show that our dataset and data generation technique can produce models that generalize to unseen environments without domain adaptation.


Controlling the Hidden Growth of COVID 19. The COVID 19 pandemic has plagued the world for months. The U.S. has taken measures to counter it. On a daily basis, newly confirmed cases have been reported. In the early days, these numbers showed an increasing trend. Recently, the numbers have been generally flattened out. This report tries to estimate the hidden number of currently alive infections in the population by using the confirmed cases. A major result indicates an existing infections estimate at about 10 50 times the daily confirmed new cases, with the stringent social distancing policy tipping to the upper end of this range. It clarifies the relationship between the infection rate and the test rate to put the epidemic under control, which says that the test rate shall keep up at the same pace as infection rate to prevent an outbreak. This relationship is meaningful in the wake of business re opening in the U.S. and the world. The report also reveals the connections of all the measures taken to the epidemic spread. A stratified sampling method is proposed to add to the current tool kits of epidemic control. Again, this report is a summary of some straight observations and thoughts, not through a thorough study backed with field data. The results appear obvious and suitable for general education to interested policymakers and the public.


EmotionX KU BERT Max based Contextual Emotion Classifier. We propose a contextual emotion classifier based on a transferable language model and dynamic max pooling, which predicts the emotion of each utterance in a dialogue. A representative emotion analysis task, EmotionX, requires to consider contextual information from colloquial dialogues and to deal with a class imbalance problem. To alleviate these problems, our model leverages the self attention based transferable language model and the weighted cross entropy loss. Furthermore, we apply post training and fine tuning mechanisms to enhance the domain adaptability of our model and utilize several machine learning techniques to improve its performance. We conduct experiments on two emotion labeled datasets named Friends and EmotionPush. As a result, our model outperforms the previous state of the art model and also shows competitive performance in the EmotionX 2019 challenge. The code will be available in the Github page.


A supersingular coincidence. The fifteen supersingular primes, see https oeis.org A002267, appear in the theory of the moduli of abelian surfaces. This short expository note explains why.


When Segmentation is Not Enough Rectifying Visual Volume Discordance Through Multisensor Depth Refined Semantic Segmentation for Food Intake Tracking in Long Term Care. Malnutrition is a multidomain problem affecting 54 of older adults in long term care (LTC). Monitoring nutritional intake in LTC is laborious and subjective, limiting clinical inference capabilities. Recent advances in automatic image based food estimation have not yet been evaluated in LTC settings. Here, we describe a fully automatic imaging system for quantifying food intake. We propose a novel deep convolutional encoder decoder food network with depth refinement (EDFN D) using an RGB D camera for quantifying a plate's remaining food volume relative to reference portions in whole and modified texture foods. We trained and validated the network on the pre labelled UNIMIB2016 food dataset and tested on our two novel LTC inspired plate datasets (689 plate images, 36 unique foods). EDFN D performed comparably to depth refined graph cut on IOU (0.879 vs. 0.887), with intake errors well below typical 50 (mean percent intake error 4.2 ). We identify how standard segmentation metrics are insufficient due to visual volume discordance, and include volume disparity analysis to facilitate system trust. This system provides improved transparency, approximates human assessors with enhanced objectivity, accuracy, and precision while avoiding hefty semi automatic method time requirements. This may help address short comings currently limiting utility of automated early malnutrition detection in resource constrained LTC and hospital settings.


From periodic sampling to irregular sampling through PNS (Periodic Nonuniform Sampling). Resampling is an operation costly in calculation time and accuracy. It regularizes irregular sampling, replacing N data by N periodic estimations. This stage can be suppressed, using formulas built with incoming data and completed by sequences of elements which influence decreases when the number of data increases. Obviously, some spectral properties (for processes) and some asymptotic properties (for the sampling sequence) have to be fulfilled. In this paper, we explain that it is possible to elaborate a logical theory, starting from the ordinary periodic sampling, and generalized by the PNS (Periodic Nonuniform Sampling), to treat more general irregular samplings. The "baseband spectrum" hypothesis linked to the "Nyquist bound" (or Shannon bound) is generalized to spectra in a finite number of intervals, suited to the "Landau condition".


Systolic length of triangular modular curves. We present a method for computing upper bounds on the systolic length of certain Riemann surfaces uniformized by congruence subgroups of hyperbolic triangle groups, admitting congruence Hurwitz curves as a special case. The uniformizing group is realized as a Fuchsian group and a convenient finite generating set is computed. The upper bound is derived from the traces of the generators. Some explicit computations, including ones for non arithmetic surfaces, are given. We apply a result of Cosac and D ' o ria to show that the systolic length grows logarithmically with respect to the genus.


Investigating Emotion Color Association in Deep Neural Networks. It has been found that representations learned by Deep Neural Networks (DNNs) correlate very well to neural responses measured in primates' brains and psychological representations exhibited by human similarity judgment. On another hand, past studies have shown that particular colors can be associated with specific emotion arousal in humans. Do deep neural networks also learn this behavior? In this study, we investigate if DNNs can learn implicit associations in stimuli, particularly, an emotion color association between image stimuli. Our study was conducted in two parts. First, we collected human responses on a forced choice decision task in which subjects were asked to select a color for a specified emotion inducing image. Next, we modeled this decision task on neural networks using the similarity between deep representation (extracted using DNNs trained on object classification tasks) of the images and images of colors used in the task. We found that our model showed a fuzzy linear relationship between the two decision probabilities. This results in two interesting findings, 1. The representations learned by deep neural networks can indeed show an emotion color association 2. The emotion color association is not just random but involves some cognitive phenomena. Finally, we also show that this method can help us in the emotion classification task, specifically when there are very few examples to train the model. This analysis can be relevant to psychologists studying emotion color associations and artificial intelligence researchers modeling emotional intelligence in machines or studying representations learned by deep neural networks.


SOL Effortless Device Support for AI Frameworks without Source Code Changes. Modern high performance computing clusters heavily rely on accelerators to overcome the limited compute power of CPUs. These supercomputers run various applications from different domains such as simulations, numerical applications or artificial intelligence (AI). As a result, vendors need to be able to efficiently run a wide variety of workloads on their hardware. In the AI domain this is in particular exacerbated by the existence of a number of popular frameworks (e.g, PyTorch, TensorFlow, etc.) that have no common code base, and can vary in functionality. The code of these frameworks evolves quickly, making it expensive to keep up with all changes and potentially forcing developers to go through constant rounds of upstreaming. In this paper we explore how to provide hardware support in AI frameworks without changing the framework's source code in order to minimize maintenance overhead. We introduce SOL, an AI acceleration middleware that provides a hardware abstraction layer that allows us to transparently support heterogeneous hardware. As a proof of concept, we implemented SOL for PyTorch with three backends CPUs, GPUs and vector processors.


Rethinking the competition between detection and ReID in Multi Object Tracking. Due to balanced accuracy and speed, joint learning detection and ReID based one shot models have drawn great attention in multi object tracking(MOT). However, the differences between the above two tasks in the one shot tracking paradigm are unconsciously overlooked, leading to inferior performance than the two stage methods. In this paper, we dissect the reasoning process of the aforementioned two tasks. Our analysis reveals that the competition of them inevitably hurts the learning of task dependent representations, which further impedes the tracking performance. To remedy this issue, we propose a novel cross correlation network that can effectively impel the separate branches to learn task dependent representations. Furthermore, we introduce a scale aware attention network that learns discriminative embeddings to improve the ReID capability. We integrate the delicately designed networks into a one shot online MOT system, dubbed CSTrack. Without bells and whistles, our model achieves new state of the art performances on MOT16 and MOT17. Our code is released at https github.com JudasDie SOTS.


Chabauty Coleman computations on rank 1 Picard curves. We provably compute the full set of rational points on 1403 Picard curves defined over mathbb Q with Jacobians of Mordell Weil rank 1 using the Chabauty Coleman method. To carry out this computation, we extend Magma code of Balakrishnan and Tuitman for Coleman integration. The new code computes p adic (Coleman) integrals on curves to points defined over number fields where the prime p splits completely and implements effective Chabauty for curves whose Jacobians have infinite order points that are not the image of a rational point under the Abel Jacobi map. We discuss several interesting examples of curves where the Chabauty Coleman set contains points defined over number fields.


Conversations with Search Engines SERP based Conversational Response Generation. In this paper, we address the problem of answering complex information needs by conversing conversations with search engines, in the sense that users can express their queries in natural language, and directly receivethe information they need from a short system response in a conversational manner. Recently, there have been some attempts towards a similar goal, e.g., studies on Conversational Agents (CAs) and Conversational Search (CS). However, they either do not address complex information needs, or they are limited to the development of conceptual frameworks and or laboratory based user studies. We pursue two goals in this paper (1) the creation of a suitable dataset, the Search as a Conversation (SaaC) dataset, for the development of pipelines for conversations with search engines, and (2) the development of astate of the art pipeline for conversations with search engines, the Conversations with Search Engines (CaSE), using this dataset. SaaC is built based on a multi turn conversational search dataset, where we further employ workers from a crowdsourcing platform to summarize each relevant passage into a short, conversational response. CaSE enhances the state of the art by introducing a supporting token identification module and aprior aware pointer generator, which enables us to generate more accurate responses. We carry out experiments to show that CaSE is able to outperform strong baselines. We also conduct extensive analyses on the SaaC dataset to show where there is room for further improvement beyond CaSE. Finally, we release the SaaC dataset and the code for CaSE and all models used for comparison to facilitate future research on this topic.


Self supervised Object Tracking with Cycle consistent Siamese Networks. Self supervised learning for visual object tracking possesses valuable advantages compared to supervised learning, such as the non necessity of laborious human annotations and online training. In this work, we exploit an end to end Siamese network in a cycle consistent self supervised framework for object tracking. Self supervision can be performed by taking advantage of the cycle consistency in the forward and backward tracking. To better leverage the end to end learning of deep networks, we propose to integrate a Siamese region proposal and mask regression network in our tracking framework so that a fast and more accurate tracker can be learned without the annotation of each frame. The experiments on the VOT dataset for visual object tracking and on the DAVIS dataset for video object segmentation propagation show that our method outperforms prior approaches on both tasks.


Learning to be Safe Deep RL with a Safety Critic. Safety is an essential component for deploying reinforcement learning (RL) algorithms in real world scenarios, and is critical during the learning process itself. A natural first approach toward safe RL is to manually specify constraints on the policy's behavior. However, just as learning has enabled progress in large scale development of AI systems, learning safety specifications may also be necessary to ensure safety in messy open world environments where manual safety specifications cannot scale. Akin to how humans learn incrementally starting in child safe environments, we propose to learn how to be safe in one set of tasks and environments, and then use that learned intuition to constrain future behaviors when learning new, modified tasks. We empirically study this form of safety constrained transfer learning in three challenging domains simulated navigation, quadruped locomotion, and dexterous in hand manipulation. In comparison to standard deep RL techniques and prior approaches to safe RL, we find that our method enables the learning of new tasks and in new environments with both substantially fewer safety incidents, such as falling or dropping an object, and faster, more stable learning. This suggests a path forward not only for safer RL systems, but also for more effective RL systems.


Crowdsourced Truth Discovery in the Presence of Hierarchies for Knowledge Fusion. Existing works for truth discovery in categorical data usually assume that claimed values are mutually exclusive and only one among them is correct. However, many claimed values are not mutually exclusive even for functional predicates due to their hierarchical structures. Thus, we need to consider the hierarchical structure to effectively estimate the trustworthiness of the sources and infer the truths. We propose a probabilistic model to utilize the hierarchical structures and an inference algorithm to find the truths. In addition, in the knowledge fusion, the step of automatically extracting information from unstructured data (e.g., text) generates a lot of false claims. To take advantages of the human cognitive abilities in understanding unstructured data, we utilize crowdsourcing to refine the result of the truth discovery. We propose a task assignment algorithm to maximize the accuracy of the inferred truths. The performance study with real life datasets confirms the effectiveness of our truth inference and task assignment algorithms.


An Effective Pipeline for a Real world Clothes Retrieval System. In this paper, we propose an effective pipeline for clothes retrieval system which has sturdiness on large scale real world fashion data. Our proposed method consists of three components detection, retrieval, and post processing. We firstly conduct a detection task for precise retrieval on target clothes, then retrieve the corresponding items with the metric learning based model. To improve the retrieval robustness against noise and misleading bounding boxes, we apply post processing methods such as weighted boxes fusion and feature concatenation. With the proposed methodology, we achieved 2nd place in the DeepFashion2 Clothes Retrieval 2020 challenge.


Dichotomizing k vertex critical H free graphs for H of order four. For k geq 3 , we prove (i) there is a finite number of k vertex critical (P 2 ell P 1) free graphs and (ii) k vertex critical (P 3 P 1) free graphs have at most 2k 1 vertices. Together with previous research, these results imply the following characterization where H is a graph of order four There is a finite number of k vertex critical H free graphs for fixed k geq 5 if and only if H is one of overline K 4 , P 4, P 2 2P 1 , or P 3 P 1 . Our results imply the existence of new polynomial time certifying algorithms for deciding the k colorability of (P 2 ell P 1) free graphs for fixed k .


Limits of density constrained optimal transport. We consider the problem of dynamic optimal transport with a density constraint. We derive variational limits in terms of Gamma convergence for two singular phenomena. First, for densities constrained near a hyperplane we recover the optimal flow through an infinitesimal permeable membrane. Second, for rapidly oscillating periodic constraints we obtain the optimal flow through a homogenized porous medium.


Asynchronous Scattering. In this paper, we consider the problem of scattering a swarm of mobile oblivious robots in a continuous space. We consider the fully asynchronous setting where robots may base their computation on past observations, or may be observed by other robots while moving. It turns out that asynchronous scattering is solvable in the most general case when both vision (the ability to see others robots positions) and weak local multiplicity detection are available. In the case of a bidimensional Euclidean space, ASYNC scattering is also solvable with blind robots if moves are rigid. Our approach is constructive and modular, as we present a proof technique for probabilistic robot protocols that is of independent interest and can be reused for other purposes. On the negative side, we show that when robots are both blind and have no multiplicity detection, the problem is unsolvable, and when only one of those is available, the problem remains unsolvable on the line.


physics.flu-dyn math.AP physics.geo-ph physics.plasm-ph

Partition of enstrophy between zonal and turbulent components. The partition of enstrophy between zonal (ordered) and wavy (turbulent) components of vorticity has been studied for the beta plane model of two dimensional barotropic flow. An analytic estimate of the minimum value for the zonal component has been derived. The energy, angular momentum, circulation, as well as the total enstrophy are invoked as constraints for the minimization of the zonal enstrophy. The corresponding variational principle has an unusual mathematical structure (primarily because the target functional is not a coercive form), by which the constraints work out in an interesting way. A discrete set of zonal enstrophy levels is generated by the energy constraint each level is specified by an eigenvalue that represents the lamination period of zonal flow. However, the value itself of the zonal enstrophy level is a function of only angular momentum and circulation, being independent of the energy (and total enstrophy). Instead, the energy works in selecting the "level" (eigenvalue) of the relaxed state. The relaxation occurs by emitting small scale wavy enstrophy, and continues as far as the nonlinear effect, scaled by the energy, can create wavy enstrophy. Comparison with numerical simulations shows that the theory gives a proper estimate of the zonal enstrophy in the relaxed state.


Monoenergetic High energy Ion Source via Femtosecond Laser Incident Parallel to a Microplate. Using fully three dimensional particle in cell simulations, we show that readily available femtosecond laser systems can stably generate proton beams with hundred MeV energy and low spread at sim1 level by parallel irradiation of a tens of micrometers long plasma plate. As the laser pulse sweeps along the plate, it drags out a huge charge ( sim 100 nC) of collimated energetic electrons and accelerates them along the plate surface to superponderomotive energies. When this dense electron current arrives at the rear end of the plate, it induces a strong electrostatic field. Due to the excessive space charge of electrons, the longitudinal field becomes bunching while the transverse field is focusing. Together, this leads to a highly monoenergetic energy spectrum and much higher proton energy as compared to simulation results from typical target normal sheath acceleration and radiation pressure acceleration at the same laser parameters.


Verifying Visibility Based Weak Consistency. Multithreaded programs generally leverage efficient and thread safe concurrent objects like sets, key value maps, and queues. While some concurrent object operations are designed to behave atomically, each witnessing the atomic effects of predecessors in a linearization order, others forego such strong consistency to avoid complex control and synchronization bottlenecks. For example, contains (value) methods of key value maps may iterate through key value entries without blocking concurrent updates, to avoid unwanted performance bottlenecks, and consequently overlook the effects of some linearization order predecessors. While such weakly consistent operations may not be atomic, they still offer guarantees, e.g., only observing values that have been present. In this work we develop a methodology for proving that concurrent object implementations adhere to weak consistency specifications. In particular, we consider (forward) simulation based proofs of implementations against relaxed visibility specifications, which allow designated operations to overlook some of their linearization order predecessors, i.e., behaving as if they never occurred. Besides annotating implementation code to identify linearization points, i.e., points at which operations' logical effects occur, we also annotate code to identify visible operations, i.e., operations whose effects are observed in practice this annotation can be done automatically by tracking the writers to each accessed memory location. We formalize our methodology over a general notion of transition systems, agnostic to any particular programming language or memory model, and demonstrate its application, using automated theorem provers, by verifying models of Java concurrent object implementations.


Implementation of IOAM for IPv6 in the Linux Kernel. In situ Operations, Administration, and Maintenance (IOAM) is currently under standardization at the IETF. It allows for collecting telemetry and operational information along a path, within the data packet, as part of an existing (possibly additional) header. This paper discusses the very first implementation of IOAM for the Linux kernel with IPv6 as encapsulation protocol. We also propose a first preliminary evaluation of our implementation under a controlled environment. Our IOAM implementation is available as open source.


On Empirical Equivalence and Duality. I argue that, on a judicious reading of two existing criteria one syntactic and the other semantic dual theories can be taken to be empirically equivalent. The judicious reading is straightforward, but leads to the surprising conclusion that very different looking theories can have equivalent empirical content. And thus it shows how a widespread scientific practice, of interpreting duals as empirically equivalent, can be understood by a thus far unnoticed feature of existing accounts of empirical equivalence.


On Concept of Petri Nets Receptors and Effectors. New subclasses of Petri nets Petri nets receptors and Petri nets effectors are introduced. The introduction exclusion of such substructures in the main Petri net may be fulfilled in accordance with the Fusion Defusion principles. We propose two pairs of entities position marking receptor (effector) and transition marking receptor (effector), which allow to observe parameters of the main Petri net and, if necessary, to carry out their regulation.


Lissajous scanning magnetic particle imaging as a multifunctional platform for magnetic hyperthermia therapy. The use of engineered nanoscale magnetic materials in healthcare and biomedical technologies is rapidly growing. Two examples which have recently attracted significant attention are magnetic particle imaging (MPI) for biological monitoring, and magnetic field hyperthermia (MFH) for cancer therapy. Here for the first time, the capability of a Lissajous scanning MPI device to act as a standalone platform to support the application of MFH cancer treatment is presented. The platform is shown to offer functionalities for nanoparticle localization, focused hyperthermia therapy application, and non invasive tissue thermometry in one device. Combined, these capabilities have the potential to significantly enhance the accuracy, effectiveness and safety of MFH therapy. Measurements of nanoparticle hyperthermia during protracted exposure to the MPI scanner's 3D imaging field sequence revealed spatially focused heating, with a maximum that is significantly enhanced compared with a simple 1 dimensional sinusoidal excitation. The observed spatial heating behavior is qualitatively described based on a phenomenological model considering torques exerted in the Brownian regime. In vitro cell studies using a human acute monocytic leukemia cell line (THP 1) demonstrated strong suppression of both structural integrity and metabolic activity within 24 h following a 40 min MFH treatment actuated within the Lissajous MPI scanner. Furthermore, reconstructed MPI images of the nanoparticles distributed among the cells, and the temperature sensitivity of the MPI imaging signal obtained during treatment are demonstrated. In summary, combined Lissajous MPI and MFH technologies are presented demonstrating for the first time their potential for cancer treatment with maximum effectiveness, and minimal collateral damage to surrounding tissues.


Time integration of tree tensor networks. Dynamical low rank approximation by tree tensor networks is studied for the data sparse approximation to large time dependent data tensors and unknown solutions of tensor differential equations. A time integration method for tree tensor networks of prescribed tree rank is presented and analyzed. It extends the known projector splitting integrators for dynamical low rank approximation by matrices and Tucker tensors and is shown to inherit their favorable properties. The integrator is based on recursively applying the Tucker tensor integrator. In every time step, the integrator climbs up and down the tree it uses a recursion that passes from the root to the leaves of the tree for the construction of initial value problems on subtree tensor networks using appropriate restrictions and prolongations, and another recursion that passes from the leaves to the root for the update of the factors in the tree tensor network. The integrator reproduces given time dependent tree tensor networks of the specified tree rank exactly and is robust to the typical presence of small singular values in matricizations of the connection tensors, in contrast to standard integrators applied to the differential equations for the factors in the dynamical low rank approximation by tree tensor networks.


Card shuffling and P partitions. In this expository article, we highlight the direct connection between card shuffling and the functions known as P partitions that come from algebraic combinatorics. While many (but not all) of the results we discuss are known, we give a unified treatment. The key idea is this the probability of obtaining a permutation pi from shelf shuffling is the probability that a random P partition is sorted by pi , and the probability of obtaining pi from riffle shuffling is the probability that a random P partition is sorted by pi 1 .


Multimodal Topic Learning for Video Recommendation. Facilitated by deep neural networks, video recommendation systems have made significant advances. Existing video recommendation systems directly exploit features from different modalities (e.g., user personal data, user behavior data, video titles, video tags, and visual contents) to input deep neural networks, while expecting the networks to online mine user preferred topics implicitly from these features. However, the features lacking semantic topic information limits accurate recommendation generation. In addition, feature crosses using visual content features generate high dimensionality features that heavily downgrade the online computational efficiency of networks. In this paper, we explicitly separate topic generation from recommendation generation, propose a multimodal topic learning algorithm to exploit three modalities (i.e., tags, titles, and cover images) for generating video topics offline. The topics generated by the proposed algorithm serve as semantic topic features to facilitate preference scope determination and recommendation generation. Furthermore, we use the semantic topic features instead of visual content features to effectively reduce online computational cost. Our proposed algorithm has been deployed in the Kuaibao information streaming platform. Online and offline evaluation results show that our proposed algorithm performs favorably.


Multitasking collision free motion planning algorithms in Euclidean spaces. We present optimal motion planning algorithms which can be used in designing practical systems controlling objects moving in Euclidean space without collisions. Our algorithms are optimal in a very concrete sense, namely, they have the minimal possible number of local planners. Our algorithms are motivated by those presented by Mas Ku and Torres Giese (as streamlined by Farber), and are developed within the more general context of the multitasking (a.k.a. higher) motion planning problem. In addition, an eventual implementation of our algorithms is expected to work more efficiently than previous ones when applied to systems with a large number of moving objects.


Atomistic modelling of near crack tip plasticity. An atomistic model of near crack tip plasticity on a square lattice under anti plane shear kinematics is formulated and studied. The model is based upon a new geometric and functional framework of a lattice manifold complex, which ensures that the crack surface is fully taken into account, while preserving the crucial notion of duality. As a result, existence of locally stable equilibrium configurations containing both a crack opening and dislocations is established. Notably, with the boundary in the form of a crack surface accounted for, no minimum separation between a dislocation core and the crack surface or the crack tip is required. The work presented here constitutes a foundation for several further studies aiming to put the phenomenon of near crack tip plasticity on a rigorous footing.


Non uniform expansions of real numbers. We introduce and study non uniform expansions of real numbers, given by two non integer bases.


G2MF WA Geometric Multi Model Fitting with Weakly Annotated Data. In this paper we attempt to address the problem of geometric multi model fitting with resorting to a few weakly annotated (WA) data points, which has been sparsely studied so far. In weak annotating, most of the manual annotations are supposed to be correct yet inevitably mixed with incorrect ones. The WA data can be naturally obtained in an interactive way for specific tasks, for example, in the case of homography estimation, one can easily annotate points on the same plane object with a single label by observing the image. Motivated by this, we propose a novel method to make full use of the WA data to boost the multi model fitting performance. Specifically, a graph for model proposal sampling is first constructed using the WA data, given the prior that the WA data annotated with the same weak label has a high probability of being assigned to the same model. By incorporating this prior knowledge into the calculation of edge probabilities, vertices (i.e., data points) lie on near the latent model are likely to connect together and further form a subset cluster for effective proposals generation. With the proposals generated, the alpha expansion is adopted for labeling, and our method in return updates the proposals. This works in an iterative way. Extensive experiments validate our method and show that the proposed method produces noticeably better results than state of the art techniques in most cases.


Linear response theory for Google matrix. We develop the linear response theory for the Google matrix PageRank algorithm with respect to a general weak perturbation and a numerical efficient and accurate algorithm, called LIRGOMAX algorithm, to compute the linear response of the PageRank with respect to this perturbation. We illustrate its efficiency on the example of the English Wikipedia network with more than 5 millions of articles (nodes). For a group of initial nodes (or simply a pair of nodes) this algorithm allows to identify the effective pathway between initial nodes thus selecting a particular subset of nodes which are most sensitive to the weak perturbation applied to them (injection or pumping at one node and absorption of probability at another node). The further application of the reduced Google matrix algorithm (REGOMAX) allows to determine the effective interactions between the nodes of this subset. General linear response theory already found numerous applications in various areas of science including statistical and mesoscopic physics. Based on these grounds we argue that the developed LIRGOMAX algorithm will find broad applications in the analysis of complex directed networks.


Opinion Dynamics with Random Actions and a Stubborn Agent. We study opinion dynamics in a social network with stubborn agents who influence their neighbors but who themselves always stick to their initial opinion. We consider first the well known DeGroot model. While it is known in the literature that this model can lead to consensus even in the presence of a stubborn agent, we show that the same result holds under weaker assumptions than has been previously reported. We then consider a recent extension of the DeGroot model in which the opinion of each agent is a random Bernoulli distributed variable, and by leveraging on the first result we establish that this model also leads to consensus, in the sense of convergence in probability, in the presence of a stubborn agent. Moreover, all agents' opinions converge to that of the stubborn agent.


Belief Grounded Networks for Accelerated Robot Learning under Partial Observability. Many important robotics problems are partially observable in the sense that a single visual or force feedback measurement is insufficient to reconstruct the state. Standard approaches involve learning a policy over beliefs or observation action histories. However, both of these have drawbacks it is expensive to track the belief online, and it is hard to learn policies directly over histories. We propose a method for policy learning under partial observability called the Belief Grounded Network (BGN) in which an auxiliary belief reconstruction loss incentivizes a neural network to concisely summarize its input history. Since the resulting policy is a function of the history rather than the belief, it can be executed easily at runtime. We compare BGN against several baselines on classic benchmark tasks as well as three novel robotic touch sensing tasks. BGN outperforms all other tested methods and its learned policies work well when transferred onto a physical robot.


Learning from Context Exploiting and Interpreting File Path Information for Better Malware Detection. Machine learning (ML) used for static portable executable (PE) malware detection typically employs per file numerical feature vector representations as input with one or more target labels during training. However, there is much orthogonal information that can be gleaned from the textit context in which the file was seen. In this paper, we propose utilizing a static source of contextual information the path of the PE file as an auxiliary input to the classifier. While file paths are not malicious or benign in and of themselves, they do provide valuable context for a malicious benign determination. Unlike dynamic contextual information, file paths are available with little overhead and can seamlessly be integrated into a multi view static ML detector, yielding higher detection rates at very high throughput with minimal infrastructural changes. Here we propose a multi view neural network, which takes feature vectors from PE file content as well as corresponding file paths as inputs and outputs a detection score. To ensure realistic evaluation, we use a dataset of approximately 10 million samples files and file paths from user endpoints of an actual security vendor network. We then conduct an interpretability analysis via LIME modeling to ensure that our classifier has learned a sensible representation and see which parts of the file path most contributed to change in the classifier's score. We find that our model learns useful aspects of the file path for classification, while also learning artifacts from customers testing the vendor's product, e.g., by downloading a directory of malware samples each named as their hash. We prune these artifacts from our test dataset and demonstrate reductions in false negative rate of 32.3 at a 10 3 false positive rate (FPR) and 33.1 at 10 4 FPR, over a similar topology single input PE file content only model.


Einstein on Involutions in Projective Geometry. We discuss Einstein's knowledge of projective geometry. We show that two pages of Einstein's Scratch Notebook from around 1912 with geometrical sketches can directly be associated with similar sketches in manuscript pages dating from his Princeton years. By this correspondence, we show that the sketches are all related to a common theme, the discussion of involution in a projective geometry setting with particular emphasis on the infinite point. We offer a conjecture as to the probable purpose of these geometric considerations.


Gutierrez Sotomayor Flows on Singular Surfaces. In this work we address the realizability of a Lyapunov graph labeled with GS singularities, namely regular, cone, Whitney, double crossing and triple crossing singularities, as continuous flow on a singular closed 2 manifold mathbf M . Furthermore, the Euler characteristic is computed with respect to the types of GS singularities of the flow on mathbf M . Locally, a complete classification theorem for minimal isolating blocks of GS singularities is presented in terms of the branched one manifolds that make up the boundary.


Archimedean Newform Theory for mathrm GL n . We introduce a new invariant, the conductor exponent, of a generic irreducible Casselman Wallach representation of mathrm GL n that quantifies the extent to which this representation may be ramified. We also determine a distinguished vector, the newform, occurring with multiplicity one in this representation, with the complexity of this vector measured in a natural way by the conductor exponent. Finally, we show that the newform is a test vector for mathrm GL n times mathrm GL n and mathrm GL n times mathrm GL n 1 Rankin Selberg integrals when the second representation is unramified. This theory parallels an analogous nonarchimedean theory due to Jacquet, Piatetski Shapiro, and Shalika combined, this completes a global theory of newforms for automorphic representations of mathrm GL n over number fields. By products of the proofs include new proofs of Stade's formulae and a new resolution of the test vector problem for archimedean Godement Jacquet zeta integrals.


Seeing the World in a Bag of Chips. We address the dual problems of novel view synthesis and environment reconstruction from hand held RGBD sensors. Our contributions include 1) modeling highly specular objects, 2) modeling inter reflections and Fresnel effects, and 3) enabling surface light field reconstruction with the same input needed to reconstruct shape alone. In cases where scene surface has a strong mirror like material component, we generate highly detailed environment images, revealing room composition, objects, people, buildings, and trees visible through windows. Our approach yields state of the art view synthesis techniques, operates on low dynamic range imagery, and is robust to geometric and calibration errors.


Auditing News Curation Systems A Case Study Examining Algorithmic and Editorial Logic in Apple News. This work presents an audit study of Apple News as a sociotechnical news curation system that exercises gatekeeping power in the media. We examine the mechanisms behind Apple News as well as the content presented in the app, outlining the social, political, and economic implications of both aspects. We focus on the Trending Stories section, which is algorithmically curated, and the Top Stories section, which is human curated. Results from a crowdsourced audit showed minimal content personalization in the Trending Stories section, and a sock puppet audit showed no location based content adaptation. Finally, we perform an extended two month data collection to compare the human curated Top Stories section with the algorithmically curated Trending Stories section. Within these two sections, human curation outperformed algorithmic curation in several measures of source diversity, concentration, and evenness. Furthermore, algorithmic curation featured more "soft news" about celebrities and entertainment, while editorial curation featured more news about policy and international events. To our knowledge, this study provides the first data backed characterization of Apple News in the United States.


DENet A Universal Network for Counting Crowd with Varying Densities and Scales. Counting people or objects with significantly varying scales and densities has attracted much interest from the research community and yet it remains an open problem. In this paper, we propose a simple but an efficient and effective network, named DENet, which is composed of two components, i.e., a detection network (DNet) and an encoder decoder estimation network (ENet). We first run DNet on an input image to detect and count individuals who can be segmented clearly. Then, ENet is utilized to estimate the density maps of the remaining areas, where the numbers of individuals cannot be detected. We propose a modified Xception as an encoder for feature extraction and a combination of dilated convolution and transposed convolution as a decoder. In the ShanghaiTech Part A, UCF and WorldExpo'10 datasets, our DENet achieves lower Mean Absolute Error (MAE) than those of the state of the art methods.


Structural, optical, and electrical properties of unintentionally doped NiO layers grown on MgO by plasma assisted molecular beam epitaxy. NiO layers were grown on MgO(100), MgO(110), and MgO(111) substrates by plasma assisted molecular beam epitaxy under Ni flux limited growth conditions. Single crystalline growth with a cube on cube epitaxial relationship was confirmed by X ray diffraction measurements for all used growth conditions and substrates except MgO(111). A detailed growth series on MgO(100) was prepared using substrate temperatures ranging from 20 deg C to 900 deg C to investigate the influence on the layer characteristics. Energy dispersive X ray spectroscopy indicated close to stoichiometric layers with an oxygen content of 47 at. and 50 at. grown under low and high O flux, respectively. All NiO layers had a root mean square surface roughness below 1 nm, measured by atomic force microscopy, except for rougher layers grown at 900 deg C or using molecular oxygen. Growth at 900 deg C led to a significant diffusion of Mg from the substrate into the film. The relative intensity of the quasi forbidden one phonon Raman peak is introduced as a gauge of the crystal quality, indicating the highest layer quality for growth at low oxygen flux and high growth temperature, likely due to the resulting high adatom diffusion length during growth. The optical and electrical properties were investigated by spectroscopic ellipsometry and resistance measurements, respectively. All NiO layers were transparent with an optical bandgap around 3.6 eV and semi insulating at room temperature. However, changes upon exposure to reducing or oxidizing gases of the resistance of a representative layer at elevated temperature were able to confirm p type conductivity, highlighting their suitability as a model system for research on oxide based gas sensing.


Degrees of bi embeddable categoricity. We investigate the complexity of embeddings between bi embeddable structures. In analogy with categoricity spectra, we define the bi embeddable categoricity spectrum of a structure mathcal A as the family of Turing degrees that compute embeddings between any computable bi embeddable copies of mathcal A the degree of bi embeddable categoricity of mathcal A is the least degree in this spectrum (if it exists). We extend many known results about categoricity spectra to the case of bi embeddability. In particular, we exhibit structures without degree of bi embeddable categoricity, and we show that every degree d.c.e. above mathbf 0 ( alpha) for alpha a computable successor ordinal and mathbf 0 ( lambda) for lambda a computable limit ordinal is a degree of bi embeddable categoricity. We also give examples of families of degrees that are not bi embeddable categoricity spectra.


Global H s, s 0 Large Data Solutions of 2D Dirac Equation with Hartree Type Interaction. Local and global well posedness of the solution to the two space dimensional Dirac equation with Hartree type nonlinearity is established with the initial datum in the space H s( mathbb R 2, mathbb C 2) with s 0. .


Line Hypergraph Convolution Network Applying Graph Convolution for Hypergraphs. Network representation learning and node classification in graphs got significant attention due to the invent of different types graph neural networks. Graph convolution network (GCN) is a popular semi supervised technique which aggregates attributes within the neighborhood of each node. Conventional GCNs can be applied to simple graphs where each edge connects only two nodes. But many modern days applications need to model high order relationships in a graph. Hypergraphs are effective data types to handle such complex relationships. In this paper, we propose a novel technique to apply graph convolution on hypergraphs with variable hyperedge sizes. We use the classical concept of line graph of a hypergraph for the first time in the hypergraph learning literature. Then we propose to use graph convolution on the line graph of a hypergraph. Experimental analysis on multiple real world network datasets shows the merit of our approach compared to state of the arts.


Flexible retrieval with NMSLIB and FlexNeuART. Our objective is to introduce to the NLP community an existing k NN search library NMSLIB, a new retrieval toolkit FlexNeuART, as well as their integration capabilities. NMSLIB, while being one the fastest k NN search libraries, is quite generic and supports a variety of distance similarity functions. Because the library relies on the distance based structure agnostic algorithms, it can be further extended by adding new distances. FlexNeuART is a modular, extendible and flexible toolkit for candidate generation in IR and QA applications, which supports mixing of classic and neural ranking signals. FlexNeuART can efficiently retrieve mixed dense and sparse representations (with weights learned from training data), which is achieved by extending NMSLIB. In that, other retrieval systems work with purely sparse representations (e.g., Lucene), purely dense representations (e.g., FAISS and Annoy), or only perform mixing at the re ranking stage.


Quick Streaming Algorithms for Maximization of Monotone Submodular Functions in Linear Time. We consider the problem of monotone, submodular maximization over a ground set of size n subject to cardinality constraint k . For this problem, we introduce the first deterministic algorithms with linear time complexity these algorithms are streaming algorithms. Our single pass algorithm obtains a constant ratio in lceil n c rceil c oracle queries, for any c ge 1 . In addition, we propose a deterministic, multi pass streaming algorithm with a constant number of passes that achieves nearly the optimal ratio with linear query and time complexities. We prove a lower bound that implies no constant factor approximation exists using o(n) queries, even if queries to infeasible sets are allowed. An empirical analysis demonstrates that our algorithms require fewer queries (often substantially less than n ) yet still achieve better objective value than the current state of the art algorithms, including single pass, multi pass, and non streaming algorithms.


Multilingual Dialogue Generation with Shared Private Memory. Existing dialog systems are all monolingual, where features shared among different languages are rarely explored. In this paper, we introduce a novel multilingual dialogue system. Specifically, we augment the sequence to sequence framework with improved shared private memory. The shared memory learns common features among different languages and facilitates a cross lingual transfer to boost dialogue systems, while the private memory is owned by each separate language to capture its unique feature. Experiments conducted on Chinese and English conversation corpora of different scales show that our proposed architecture outperforms the individually learned model with the help of the other language, where the improvement is particularly distinct when the training data is limited.


Improving accuracy and speeding up Document Image Classification through parallel systems. This paper presents a study showing the benefits of the EfficientNet models compared with heavier Convolutional Neural Networks (CNNs) in the Document Classification task, essential problem in the digitalization process of institutions. We show in the RVL CDIP dataset that we can improve previous results with a much lighter model and present its transfer learning capabilities on a smaller in domain dataset such as Tobacco3482. Moreover, we present an ensemble pipeline which is able to boost solely image input by combining image model predictions with the ones generated by BERT model on extracted text by OCR. We also show that the batch size can be effectively increased without hindering its accuracy so that the training process can be sped up by parallelizing throughout multiple GPUs, decreasing the computational time needed. Lastly, we expose the training performance differences between PyTorch and Tensorflow Deep Learning frameworks.


MHSA Net Multi Head Self Attention Network for Occluded Person Re Identification. This paper presents a novel person re identification model, named Multi Head Self Attention Network (MHSA Net), to prune unimportant information and capture key local information from person images. MHSA Net contains two main novel components Multi Head Self Attention Branch (MHSAB) and Attention Competition Mechanism (ACM). The MHSAB adaptively captures key local person information, and then produces effective diversity embeddings of an image for the person matching. The ACM further helps filter out attention noise and non key information. Through extensive ablation studies, we verified that the Multi Head Self Attention Branch (MHSAB) and Attention Competition Mechanism (ACM) both contribute to the performance improvement of the MHSA Net. Our MHSA Net achieves competitive performance in the standard and occluded person Re ID tasks.


Intersection Type Distributors. We study a family of distributors induced bicategorical models of lambda calculus, proving that they can be syntactically presented via intersection type systems. We first introduce a class of 2 monads whose algebras are monoidal categories modelling resource management. We lift these monads to distributors and define a parametric Kleisli bicategory, giving a sufficient condition for its cartesian closure. In this framework we define a proof relevant semantics the interpretation of a term associates to it the set of its typing derivations in appropriate systems. We prove that our model characterize solvability, adapting reducibility techniques to our setting. We conclude by describing two examples of our construction.


A Local Descriptor with Physiological Characteristic for Finger Vein Recognition. Local feature descriptors exhibit great superiority in finger vein recognition due to their stability and robustness against local changes in images. However, most of these are methods use general purpose descriptors that do not consider finger vein specific features. In this work, we propose a finger vein specific local feature descriptors based physiological characteristic of finger vein patterns, i.e., histogram of oriented physiological Gabor responses (HOPGR), for finger vein recognition. First, prior of directional characteristic of finger vein patterns is obtained in an unsupervised manner. Then the physiological Gabor filter banks are set up based on the prior information to extract the physiological responses and orientation. Finally, to make feature has robustness against local changes in images, histogram is generated as output by dividing the image into non overlapping cells and overlapping blocks. Extensive experimental results on several databases clearly demonstrate that the proposed method outperforms most current state of the art finger vein recognition methods.


Comparison of counterstreaming suprathermal electron signatures of ICMEs with and without magnetic cloud are all ICMEs flux ropes?. Magnetic clouds (MCs), as large scale interplanetary magnetic flux ropes, are usually still connected to the sun at both ends near 1 AU. Many researchers believe that all non MC interplanetary coronal mass ejections (ICMEs) also have magnetic flux rope structures, which are inconspicuous because the observing spacecraft crosses the flanks of the rope structures. If so, the field lines of non MC ICMEs should also be usually connected to the Sun on both ends. Then we want to know whether the field lines of most non MC ICMEs are still connected to the sun at both ends or not. This study examined the counterstreaming suprathermal electron (CSE) signatures of 266 ICMEs observed by the emph Advanced Composition Explorer ( emph ACE ) spacecraft from 1998 to 2008 and compared the CSE signatures of MCs and non MC ICMEs. Results show that only 10 of the 101 MC events ( 9.9 ) and 75 of the 171 non MC events ( 43.9 ) have no CSEs. Moreover, 21 of the non MC ICMEs have high CSE percentages (more than 70 ) and show relatively stable magnetic field components with slight rotations, which are in line with the expectations that spacecraft passes through the flank of magnetic flux ropes. So the 21 events may be magnetic flux ropes but the emph ACE spacecraft passes through their flanks of magnetic flux ropes. Considering that most other non MC events have disordered magnetic fields, we suggest that some non MC ICMEs inherently have disordered magnetic fields, namely have no magnetic flux rope structures.


From frieze patterns to cluster categories. Motivated by Conway and Coxeter's combinatorial results concerning frieze patterns, we sketch an introduction to the theory of cluster algebras and cluster categories for acyclic quivers. The goal is to show how these more abstract theories provide a conceptual explanation for phenomena concerning friezes, principally integrality and periodicity.


Urbanik type subclasses of the free infinitely divisible transforms. For the class of free infinitely divisible transforms are introduced three families of increasing Urbanik type subclasses of those transforms. They begin with the class of free normal transforms and end up with the whole class of free infinitely divisible transforms. Those subclasses are derived from the ones of classical infinitely divisible measures for which are known their random integral representations. Special functions like Hurwitz Lerch, polygamma and hypergeometric appeared in kernels of the corresponding integral representations.


VizSeq A Visual Analysis Toolkit for Text Generation Tasks. Automatic evaluation of text generation tasks (e.g. machine translation, text summarization, image captioning and video description) usually relies heavily on task specific metrics, such as BLEU and ROUGE. They, however, are abstract numbers and are not perfectly aligned with human assessment. This suggests inspecting detailed examples as a complement to identify system error patterns. In this paper, we present VizSeq, a visual analysis toolkit for instance level and corpus level system evaluation on a wide variety of text generation tasks. It supports multimodal sources and multiple text references, providing visualization in Jupyter notebook or a web app interface. It can be used locally or deployed onto public servers for centralized data hosting and benchmarking. It covers most common n gram based metrics accelerated with multiprocessing, and also provides latest embedding based metrics such as BERTScore.


Object Hider Adversarial Patch Attack Against Object Detectors. Deep neural networks have been widely used in many computer vision tasks. However, it is proved that they are susceptible to small, imperceptible perturbations added to the input. Inputs with elaborately designed perturbations that can fool deep learning models are called adversarial examples, and they have drawn great concerns about the safety of deep neural networks. Object detection algorithms are designed to locate and classify objects in images or videos and they are the core of many computer vision tasks, which have great research value and wide applications. In this paper, we focus on adversarial attack on some state of the art object detection models. As a practical alternative, we use adversarial patches for the attack. Two adversarial patch generation algorithms have been proposed the heatmap based algorithm and the consensus based algorithm. The experiment results have shown that the proposed methods are highly effective, transferable and generic. Additionally, we have applied the proposed methods to competition "Adversarial Challenge on Object Detection" that is organized by Alibaba on the Tianchi platform and won top 7 in 1701 teams. Code is available at https github.com FenHua DetDak


Community Structure aware Embedding of Nodes in a Network. Detecting communities or the modular structure of real life networks (e.g. a social network or a product purchase network) is an important task because the way a network functions is often determined by its communities. Traditional approaches to community detection involve modularity based algorithms, which generally speaking, construct partitions based on heuristics that seek to maximize the ratio of the edges within the partitions to those between them. On the other hand, node embedding approaches represent each node in a graph as a real valued vector and is thereby able to transform the problem of community detection in a graph to that of clustering a set of vectors. Existing node embedding approaches are primarily based on, first, initiating random walks from each node to construct a context of a node, and then make the vector representation of a node close to its context. However, standard node embedding approaches do not directly take into account the community structure of a network while constructing the context around each node. To alleviate this, we explore two different threads of work. First, we investigate the use of maximum entropy based random walks to obtain more centrality preserving embedding of nodes, which may lead to more effective clusters in the embedded space. Second, we propose a community structure aware node embedding approach, where we incorporate modularity based partitioning heuristics into the objective function of node embedding. We demonstrate that our proposed combination of the combinatorial and the embedding approaches for community detection outperforms a number of modularity based baselines and K means clustering on a standard node embedded (node2vec) vector space on a wide range of real life and synthetic networks of different sizes and densities.


The Greatest Teacher, Failure is Using Reinforcement Learning for SFC Placement Based on Availability and Energy Consumption. Software defined networking (SDN) and network functions virtualisation (NFV) are making networks programmable and consequently much more flexible and agile. To meet service level agreements, achieve greater utilisation of legacy networks, faster service deployment, and reduce expenditure, telecommunications operators are deploying increasingly complex service function chains (SFCs). Notwithstanding the benefits of SFCs, increasing heterogeneity and dynamism from the cloud to the edge introduces significant SFC placement challenges, not least adding or removing network functions while maintaining availability, quality of service, and minimising cost. In this paper, an availability and energy aware solution based on reinforcement learning (RL) is proposed for dynamic SFC placement. Two policy aware RL algorithms, Advantage Actor Critic (A2C) and Proximal Policy Optimisation (PPO2), are compared using simulations of a ground truth network topology based on the Rede Nacional de Ensino e Pesquisa (RNP) Network, Brazil's National Teaching and Research Network backbone. The simulation results showed that PPO2 generally outperformed A2C and a greedy approach both in terms of acceptance rate and energy consumption. A2C outperformed PPO2 only in the scenario where network servers had a greater number of computing resources.


Improved Algorithms for Population Recovery from the Deletion Channel. The population recovery problem asks one to recover an unknown distribution over n bit strings given access to independent noisy samples of strings drawn from the distribution. Recently, Ban et al. BCF 19 studied the problem where the noise is induced through the deletion channel. This problem generalizes the famous trace reconstruction problem, where one wishes to learn a single string under the deletion channel. Ban et al. showed how to learn ell sparse distributions over strings using exp big(n 1 2 cdot ( log n) O( ell) big) samples. In this work, we learn the distribution using only exp big( tilde O (n 1 3 ) cdot ell 2 big) samples, by developing a higher moment analog of the algorithms of DOS17, NP17 , which solve trace reconstruction in exp big( tilde O (n 1 3 ) big) samples. We also give the first algorithm with a runtime subexponential in n , solving population recovery in exp big( tilde O (n 1 3 ) cdot ell 3 big) samples and time. Notably, our dependence on n nearly matches the upper bound of DOS17, NP17 when ell O(1) , and we reduce the dependence on ell from doubly to singly exponential. Therefore, we are able to learn large mixtures of strings while Ban et al.'s algorithm can only learn a mixture of O( log n log log n) strings with a subexponential number of samples, we are able to learn a mixture of n o(1) strings in exp big(n 1 3 o(1) big) samples and time.


Towards an RDF Knowledge Graph of Scholars from Early Modern History. The use of Semantic Web Technologies supports research in the field of digital humanities. In this paper we focus on the creation of semantic independent online databases such as those of historical prosopography. These databases contain biographical information of historical persons. We focus on this information with an interest in German professorial career patterns from the 16th to the 18th century. In that respect, we describe the process of building an Early Modern Scholarly Career RDF Knowledge Graph from two existing prosopography online databases the Catalogus Professorum Lipsiensium and the Catalogus Professorum Helmstadiensium. Further, we provide an insight in how to query the information using KBox to answer research questions.


On the stability of systems of two linear first order ordinary differential equations. The Riccati equation method is used to establish some new stability criteria for systems of two linear first order ordinary differential equations. It is shown that two of these criteria in the two dimensional case imply the Routh Hurwitz's criterion.


Design of a dynamic and self adapting system, supported with artificial intelligence, machine learning and real time intelligence for predictive cyber risk analytics in extreme environments, cyber risk in the colonisation of Mars. Multiple governmental agencies and private organisations have made commitments for the colonisation of Mars. Such colonisation requires complex systems and infrastructure that could be very costly to repair or replace in cases of cyber attacks. This paper surveys deep learning algorithms, IoT cyber security and risk models, and established mathematical formulas to identify the best approach for developing a dynamic and self adapting system for predictive cyber risk analytics supported with Artificial Intelligence and Machine Learning and real time intelligence in edge computing. The paper presents a new mathematical approach for integrating concepts for cognition engine design, edge computing and Artificial Intelligence and Machine Learning to automate anomaly detection. This engine instigates a step change by applying Artificial Intelligence and Machine Learning embedded at the edge of IoT networks, to deliver safe and functional real time intelligence for predictive cyber risk analytics. This will enhance capacities for risk analytics and assists in the creation of a comprehensive and systematic understanding of the opportunities and threats that arise when edge computing nodes are deployed, and when Artificial Intelligence and Machine Learning technologies are migrated to the periphery of the internet and into local IoT networks.


Analysis of solution trajectories of linear fractional order systems. The behavior of solution trajectories usually changes if we replace the classical derivative in a system by a fractional one. In this article, we throw a light on the relation between two trajectories X(t) and Y(t) of such a system, where the initial point Y(0) is at some point X(t 1) of trajectory X(t) . In contrast with classical systems, trajectories X and Y do not follow the same path. Further, we provide a Frenet apparatus of both trajectories in various cases and discuss their effect.


Optimizing Information Freshness in Computing enabled IoT Networks. Internet of Things (IoT) has emerged as one of the key features of the next generation wireless networks, where timely delivery of status update packets is essential for many real time IoT applications. To provide users with context aware services and lighten the transmission burden, the raw data usually needs to be preprocessed before being transmitted to the destination. However, the effect of computing on the overall information freshness is not well understood. In this work, we first develop an analytical framework to investigate the information freshness, in terms of peak age of information (PAoI), of a computing enabled IoT system with multiple sensors. Specifically, we model the procedure of computing and transmission as a tandem queue, and derive the analytical expressions of the average PAoI for different sensors. Based on the theoretical results, we formulate a min max optimization problem to minimize the maximum average PAoI of different sensors. We further design a derivative free algorithm to find the optimal updating frequency, with which the complexity for checking the convexity of the formulated problem or obtaining the derivatives of the object function can be largely reduced. The accuracy of our analysis and effectiveness of the proposed algorithm are verified with extensive simulation results.


The axiomatic introduction of arbitrary strain tensors by Hans Richter a commented translation of "Strain tensor, strain deviator and stress tensor for finite deformations". We provide a faithful translation of Hans Richter's important 1949 paper "Verzerrungstensor, Verzerrungsdeviator und Spannungstensor bei endlichen Form "anderungen" from its original German version into English, complemented by an introduction summarizing Richter's achievements.


Global Inverse Design Across Multiple Photonic Structure Classes Using Generative Deep Learning. Understanding how nano or micro scale structures and material properties can be optimally configured to attain specific functionalities remains a fundamental challenge. Photonic metasurfaces, for instance, can be spectrally tuned through material choice and structural geometry to achieve unique optical responses. However, existing numerical design methods require prior identification of specific material structure combinations, or device classes, as the starting point for optimization. As such, a unified solution that simultaneously optimizes across materials and geometries has yet to be realized. To overcome these challenges, we present a global deep learning based inverse design framework, where a conditional deep convolutional generative adversarial network is trained on colored images encoded with a range of material and structural parameters, including refractive index, plasma frequency, and geometric design. We demonstrate that, in response to target absorption spectra, the network can identify an effective metasurface in terms of its class, materials properties, and overall shape. Furthermore, the model can arrive at multiple design variants with distinct materials and structures that present nearly identical absorption spectra. Our proposed framework is thus an important step towards global photonics and materials design strategies that can identify combinations of device categories, material properties, and geometric parameters which algorithmically deliver a sought functionality.


Demystifying the Lagrangian of classical mechanics. The Lagrangian formulation of classical mechanics is widely applicable in solving a vast array of physics problems encountered in the undergraduate and graduate physics curriculum. Unfortunately, many treatments of the topic lack explanations of the most basic details that make Lagrangian mechanics so practical. In this paper, we detail the steps taken to arrive at the principle of stationary action, the Euler Lagrange equations, and the Lagrangian of classical mechanics. These steps are 1) we derive the Lagrange formalism purely mathematically from the problem of the minimal distance between two points in a plane, introducing the variational principle and deriving the Euler Lagrange equation 2) we transform Newton's second law into an Euler Lagrange equation, proving that the Lagrangian is kinetic minus potential energy 3) we explain why it is important to reformulate Newton's law. To do so, we prove that the Euler Lagrange equation is astonishingly the same in any set of coordinates. We demonstrate that because of this feature the role that coordinates play in classical mechanics is much simpler and clearer in the Lagrangian as compared to the Newtonian formulation. This is important because the choice of coordinates is not relevant to physical reality, rather they are arbitrarily chosen to provide a convenient way of analyzing a physical system.


Decay for the Kelvin Voigt damped wave equation Piecewise smooth damping. We study the energy decay rate of the Kelvin Voigt damped wave equation with piecewise smooth damping on the multi dimensional domain. Under suitable geometric assumptions on the support of the damping, we obtain the optimal polynomial decay rate which turns out to be different from the one dimensional case studied in cite LR05 . This optimal decay rate is saturated by high energy quasi modes localised on geometric optics rays which hit the interface along non orthogonal neither tangential directions. The proof uses semi classical analysis of boundary value problems.


Preservation of normality by non oblivious group selection. We give two different proofs of the fact that non oblivious selection via regular group sets preserves normality. Non oblivious here means that whether or not a symbol is selected can depend on the symbol itself. One proof relies on the incompressibility of normal sequences, the other on the use of augmented dynamical systems.


Challenges and guidelines on designing test cases for test bots. Test bots are automated testing tools that autonomously and periodically run a set of test cases that check whether the system under test meets the requirements set forth by the customer. The automation decreases the amount of time a development team spends on testing. As development projects become larger, it is important to focus on improving the test bots by designing more effective test cases because otherwise time and usage costs can increase greatly and misleading conclusions from test results might be drawn, such as false positives in the test execution. However, literature currently lacks insights on how test case design affects the effectiveness of test bots. This paper uses a case study approach to investigate those effects by identifying challenges in designing tests for test bots. Our results include guidelines for test design schema for such bots that support practitioners in overcoming the challenges mentioned by participants during our study.


Effects of a thermal inversion experiment on STEM students learning and application of damped harmonic motion. There are diverse teaching methodologies to promote both collaborative and individual work in undergraduate physics courses. However, few educational studies seek to understand how students learn and apply new knowledge through open ended activities that require mathematical modeling and experimentation focused on environmental problems. In this work, we propose a novel home experiment to simulate the dynamics of a particulate under temperature inversion and model it as damped harmonic motion. Twenty six first year students enrolled in STEM majors answered six qualitative questions after designing and developing the experiment. These questions helped analyze the students epistemological beliefs about their learning process of physics topics and its applications. Results showed that this type of open ended experiments could facilitate the students understanding of physics phenomena. In addition, this experiment showed that it could help physics professors to promote students epistemological development by giving their students the opportunity to search for different sources of knowledge and becoming self learners instead of looking at the professor as the epistemological authority. At the end, students described this activity as a positive experience that helped them realize alternative ways to apply physics topics in different contexts of their environment.


Conditional Generation of Temporally ordered Event Sequences. Models of narrative schema knowledge have proven useful for a range of event related tasks, but they typically do not capture the temporal relationships between events. We propose a single model that addresses both temporal ordering, sorting given events into the order they occurred, and event infilling, predicting new events which fit into an existing temporally ordered sequence. We use a BART based conditional generation model that can capture both temporality and common event co occurrence, meaning it can be flexibly applied to different tasks in this space. Our model is trained as a denoising autoencoder we take temporally ordered event sequences, shuffle them, delete some events, and then attempt to recover the original event sequence. This task teaches the model to make inferences given incomplete knowledge about the events in an underlying scenario. On the temporal ordering task, we show that our model is able to unscramble event sequences from existing datasets without access to explicitly labeled temporal training data, outperforming both a BERT based pairwise model and a BERT based pointer network. On event infilling, human evaluation shows that our model is able to generate events that fit better temporally into the input events when compared to GPT 2 story completion models.


On a nontrivial knot projection under (1, 3) homotopy. In 2001, "Ostlund formulated the question are Reidemeister moves of types 1 and 3 sufficient to describe a homotopy from any generic immersion of a circle in a two dimensional plane to an embedding of the circle? The positive answer to this question was treated as a conjecture ( "Ostlund conjecture). In 2014, Hagge and Yazinski disproved the conjecture by showing the first counterexample with a minimal crossing number of 16. This example is naturally extended to counterexamples with given even minimal crossing numbers more than 14. This paper obtains the first counterexample with a minimal crossing number of 15. This example is naturally extended to counterexamples with given odd minimal crossing numbers more than 13.


Clean, Robust Alkali Sources by Intercalation within Highly Oriented Pyrolytic Graphite. We report the fabrication, characterization, and use of rubidium vapor dispensers based on highly oriented pyrolytic graphite (HOPG) intercalated with metallic rubidium. Compared to commercial chromate salt dispensers, these intercalated HOPG (IHOPG) dispensers hold an order of magnitude more rubidium in a similar volume, require less than one fourth the heating power, and emit less than one half as many impurities. Appropriate processing permits exposure of the IHOPG to atmosphere for over ninety minutes without any adverse effects. Intercalation of cesium and potassium into HOPG have also been demonstrated in the literature, which suggests that IHOPG dispensers may also be be made for those metals.


New Regularity Criteria for the Navier Stokes Equations in Terms of Pressure. In this paper, we generalize the main results of 1 and 31 to Lorentz spaces, using a simple procedure. The main results are the following. Let n geq 3 and let u be a Leray Hopf solution to the n dimensional Navier Stokes equations with viscosity nu and divergence free initial condition u 0 in L 2( mathbb R n) cap L k ( mathbb R n) (where k k(s) is sufficiently large). Then there exists a constant c 0 such that if begin equation p L r, infty (0, infty L s, infty ( mathbb R n)) c hspace 10mm frac n s frac 2 r leq 2, hspace 5mm s frac n 2 end equation or begin equation nabla p L r, infty (0, infty L s, infty ( mathbb R n)) c hspace 10mm frac n s frac 2 r leq 3, hspace 5mm s frac n 3 end equation then u is smooth on (0, infty) times mathbb R n . Partial results in the case n 3 were obtained in 32 , 33 and then recently extended to all appropriate pairs of r,s in 14 . Our results present a unified proof which works for all dimensions n geq 3 and the full range or admissible pairs, (s,r) .