LiveQA A Question Answering Dataset over Sports Live. In this paper, we introduce LiveQA, a new question answering dataset constructed from play by play live broadcast. It contains 117k multiple choice questions written by human commentators for over 1,670 NBA games, which are collected from the Chinese Hupu (https nba.hupu.com games) website. Derived from the characteristics of sports games, LiveQA can potentially test the reasoning ability across timeline based live broadcasts, which is challenging compared to the existing datasets. In LiveQA, the questions require understanding the timeline, tracking events or doing mathematical computations. Our preliminary experiments show that the dataset introduces a challenging problem for question answering models, and a strong baseline model only achieves the accuracy of 53.1 and cannot beat the dominant option rule. We release the code and data of this paper for future research.


The Hartree and Hartree Fock equations in Lebesgue L p and Fourier Lebesgue widehat L p spaces. We establish some local and global well posedness for Hartree Fock equations of N particles (HFP) with Cauchy data in Lebesgue spaces L p cap L 2 for 1 leq p leq infty . Similar results are proven for fractional HFP in Fourier Lebesgue spaces widehat L p cap L 2 (1 leq p leq infty). On the other hand, we show that the Cauchy problem for HFP is ill posed if we simply work in widehat L p (2 p leq infty). Analogue results hold for reduced HFP. In the process, we prove the boundedeness of various trilinear estimates for Hartree type non linearity in these spaces which may be of independent interest. As a consequence, we get natural L p and widehat L p extension of classical well posedness theories of Hartree and Hartree Fock equations with Cauchy data in just L 2 based Sobolev spaces.


hyper.deal An efficient, matrix free finite element library for high dimensional partial differential equations. This work presents the efficient, matrix free finite element library hyper.deal for solving partial differential equations in two to six dimensions with high order discontinuous Galerkin methods. It builds upon the low dimensional finite element library deal.II to create complex low dimensional meshes and to operate on them individually. These meshes are combined via a tensor product on the fly and the library provides new special purpose highly optimized matrix free functions exploiting domain decomposition as well as shared memory via MPI 3.0 features. Both node level performance analyses and strong weak scaling studies on up to 147,456 CPU cores confirm the efficiency of the implementation. Results of the library hyper.deal are reported for high dimensional advection problems and for the solution of the Vlasov Poisson equation in up to 6D phase space.


UAV LiDAR Point Cloud Segmentation of A Stack Interchange with Deep Neural Networks. Stack interchanges are essential components of transportation systems. Mobile laser scanning (MLS) systems have been widely used in road infrastructure mapping, but accurate mapping of complicated multi layer stack interchanges are still challenging. This study examined the point clouds collected by a new Unmanned Aerial Vehicle (UAV) Light Detection and Ranging (LiDAR) system to perform the semantic segmentation task of a stack interchange. An end to end supervised 3D deep learning framework was proposed to classify the point clouds. The proposed method has proven to capture 3D features in complicated interchange scenarios with stacked convolution and the result achieved over 93 classification accuracy. In addition, the new low cost semi solid state LiDAR sensor Livox Mid 40 featuring a incommensurable rosette scanning pattern has demonstrated its potential in high definition urban mapping.


Effective Reduction of Oxygen Debris in Graphene Oxide. Graphene oxide (GO) raised substantial interest in the last two decades thanks to its unique properties beyond those of pristine graphene, including electronic energy band gap, hydrophilic behavior and numerous anchoring sites required for functionalization. In addition, GO was found to be a cheap mass production source for the formation of the pristine graphene. However, the presence of numerous clusters containing oxygen functional groups (called debris) on the GO surface hinders the GO integration in electronic devices. Here, we present a simple method aimed to reduce the density of oxygen debris weakly bonded to the surface. The method consists of minimal treatments, like sonication and or water rinsing processes. Whereas this simple method removed epoxy and hydroxyl oxygen groups weakly attached to the graphene matrix, the double C O bonds are almost not affected by the applied treatment, as demonstrated by X ray photoelectron spectroscopy and Fourier transform infrared spectroscopy. Scanning tunneling microscopy and high resolution transmission electron microscopy measures designated non uniform distribution of the oxidation sites, appearing as clusters concentrated preferentially on GO defected regions, albeit separated by pristine graphene areas. The results should have an impact in the implementation of GO in electronic devices deposited on different substrates.


Generation of Local Symmetry Preserving Operations. We introduce a new practical and more general definition of local symmetry preserving operations on polyhedra. These can be applied to arbitrary plane graphs and result in plane graphs with the same symmetry. With some additional properties we can restrict the connectivity, e.g. when we only want to consider polyhedra. Using some base structures and a list of 10 extensions, we can generate all possible local symmetry preserving operations isomorph free.


Learning to Run with Potential Based Reward Shaping and Demonstrations from Video Data. Learning to produce efficient movement behaviour for humanoid robots from scratch is a hard problem, as has been illustrated by the "Learning to run" competition at NIPS 2017. The goal of this competition was to train a two legged model of a humanoid body to run in a simulated race course with maximum speed. All submissions took a tabula rasa approach to reinforcement learning (RL) and were able to produce relatively fast, but not optimal running behaviour. In this paper, we demonstrate how data from videos of human running (e.g. taken from YouTube) can be used to shape the reward of the humanoid learning agent to speed up the learning and produce a better result. Specifically, we are using the positions of key body parts at regular time intervals to define a potential function for potential based reward shaping (PBRS). Since PBRS does not change the optimal policy, this approach allows the RL agent to overcome sub optimalities in the human movements that are shown in the videos. We present experiments in which we combine selected techniques from the top ten approaches from the NIPS competition with further optimizations to create an high performing agent as a baseline. We then demonstrate how video based reward shaping improves the performance further, resulting in an RL agent that runs twice as fast as the baseline in 12 hours of training. We furthermore show that our approach can overcome sub optimal running behaviour in videos, with the learned policy significantly outperforming that of the running agent from the video.


A Deep Framework for Cross Domain and Cross System Recommendations. Cross Domain Recommendation (CDR) and Cross System Recommendations (CSR) are two of the promising solutions to address the long standing data sparsity problem in recommender systems. They leverage the relatively richer information, e.g., ratings, from the source domain or system to improve the recommendation accuracy in the target domain or system. Therefore, finding an accurate mapping of the latent factors across domains or systems is crucial to enhancing recommendation accuracy. However, this is a very challenging task because of the complex relationships between the latent factors of the source and target domains or systems. To this end, in this paper, we propose a Deep framework for both Cross Domain and Cross System Recommendations, called DCDCSR, based on Matrix Factorization (MF) models and a fully connected Deep Neural Network (DNN). Specifically, DCDCSR first employs the MF models to generate user and item latent factors and then employs the DNN to map the latent factors across domains or systems. More importantly, we take into account the rating sparsity degrees of individual users and items in different domains or systems and use them to guide the DNN training process for utilizing the rating data more effectively. Extensive experiments conducted on three real world datasets demonstrate that DCDCSR framework outperforms the state of the art CDR and CSR approaches in terms of recommendation accuracy.


Validating the Critical Point of Spontaneous Parametric Down Conversion for over 600 Scanning MEMS Micro Mirrors on Wafer Level. Sensors and actuators based on resonant micro electro mechanical systems (MEMS), such as scanning micro mirrors, are well established in automotive and consumer products. As the areas of application broaden, the requirements for the MEMS are increasing. Devices outside of the performance specifications have to be rejected which is costly due to the high processing times of MEMS technologies. In particular, nonlinear system behavior is often found to cause unexpected device failure or performance issues. Thus, accurate simulation or rather system models which account for nonlinear sensor dynamics can not only increase process yield, but more importantly, lead to a comprehensive understanding of the underlying physics and to improved MEMS design. We have studied 1 the possibility of a rather drastic device failure induced by nonlinearities on the example of a resonant scanning MEMS micro mirror. On the level of a few selected chips, we have carefully measured the complex nonlinear system behavior and modeled it by a nonlinear mode coupling phenomenon known as spontaneous parametric down conversion (SPDC). The most intriguing feature of SPDC is the sudden change from a rather linear to a nonlinear system behavior at the critical oscillation amplitude. However, the threshold only lies within the range of the mirror's operational amplitude, if certain frequency resonance conditions regarding the mechanical modes are met. Thus, the critical amplitude strongly depends on the frequency spectrum of the MEMS design which in turn is largely influenced by fabrication imperfections. We validate the dependence of the critical amplitude on the resonance condition by measuring it for over 600 micro mirrors on wafer level. Our work does not only validate the theory of SPDC with measurements on such a large scale, but also demonstrates modeling strategies which are essential for MEMS product design.


Arveson's characterisation of CCR flows the multiparameter case. In this paper, we revisit Arveson's characterisation of CCR flows in terms of decomposibility of the product system in the multiparameter context. We show that a multiparameter E 0 semigroup is a CCR flow if and only if it is decomposable and admits a unit. In contrast to the one parameter situtation, we exhibit uncountably many examples of decomposable E 0 semigroups which do not admit any unit. As applications, we show that for a pure isometric representation V , the associated CCR flow alpha V remembers the unitary equivalence class of V . We also compute the positive contractive local cocycles and projective local cocycles of a CCR flow. A necessary and a sufficient condition for a CCR flow to be prime is obtained.


On the local structure of oriented graphs a case study in flag algebras. Let G be an n vertex oriented graph. Let t(G) (respectively i(G) ) be the probability that a random set of 3 vertices of G spans a transitive triangle (respectively an independent set). We prove that t(G) i(G) geq frac 1 9 o n(1) . Our proof uses the method of flag algebras that we supplement with several steps that make it more easily comprehensible. We also prove a stability result and an exact result. Namely, we describe an extremal construction, prove that it is essentially unique, and prove that if H is sufficiently far from that construction, then t(H) i(H) is significantly larger than frac 1 9 . We go to greater technical detail than is usually done in papers that rely on flag algebras. Our hope is that as a result this text can serve others as a useful introduction to this powerful and beautiful method.


Bounds for list decoding and list recovery of random linear codes. A family of error correcting codes is list decodable from error fraction p if, for every code in the family, the number of codewords in any Hamming ball of fractional radius p is less than some integer L that is independent of the code length. It is said to be list recoverable for input list size ell if for every sufficiently large subset of codewords (of size L or more), there is a coordinate where the codewords take more than ell values. The parameter L is said to be the "list size" in either case. The capacity, i.e., the largest possible rate for these notions as the list size L to infty , is known to be 1 h q(p) for list decoding, and 1 log q ell for list recovery, where q is the alphabet size of the code family. In this work, we study the list size of random linear codes for both list decoding and list recovery as the rate approaches capacity. We show the following claims hold with high probability over the choice of the code (below, epsilon 0 is the gap to capacity). (1) A random linear code of rate 1 log q( ell) epsilon requires list size L ge ell Omega(1 epsilon) for list recovery from input list size ell . This is surprisingly in contrast to completely random codes, where L O( ell epsilon) suffices w.h.p. (2) A random linear code of rate 1 h q(p) epsilon requires list size L ge lfloor h q(p) epsilon 0.99 rfloor for list decoding from error fraction p , when epsilon is sufficiently small. (3) A random binary linear code of rate 1 h 2(p) epsilon is list decodable from average error fraction p with list size with L leq lfloor h 2(p) epsilon rfloor 2 . The second and third results together precisely pin down the list sizes for binary random linear codes for both list decoding and average radius list decoding to three possible values.


Locally resonant metasurfaces for shear waves in granular media. In this article the physics of horizontally polarized shear waves travelling across a locally resonant metasurface in an unconsolidated granular medium is experimentally and numerically explored. The metasurface is comprised of an arrangement of sub wavelength horizontal mechanical resonators embedded in silica microbeads. The metasurface supports a frequency tailorable attenuation zone induced by the translational mode of the resonators. The experimental and numerical findings reveal that the metasurface not only backscatters part of the energy, but also redirects the wavefront underneath the resonators leading to a considerable amplitude attenuation at the surface level, when all the resonators have similar resonant frequency. A more complex picture emerges when using resonators arranged in a so called graded design, e.g., with a resonant frequency increasing decreasing throughout the metasurface. Unlike Love waves propagating in a bi layer medium, shear waves localized at the surface of our metasurface are not converted into bulk waves. Although a detachment from the surface occurs, the depth dependent velocity profile of the granular medium prevents the mode conversion, steering again the horizontally polarized shear waves towards the surface. The outcomes of our experimental and numerical studies allow for understanding the dynamics of wave propagation in resonant metamaterials embedded in vertically inhomogeneous soils and, therefore, are essential for improving the design of engineered devices for ground vibration and seismic wave containment.


A Semiempirical Dynamical Model to Forecast the Propagation of Epidemics The Case of the Sars Cov 2 in Spain. A semiempirical model, based in the logistic map, has been succesfully applied to forecast important quantities along the several phases of the outbreak of the covid 19 for different countries. This paper shows how the model was calibrated and applied to perform predictions of people needing to be hospitalized, needs of ventilators, or the number of deaths which would be produced. It is shown specifically the results obtained in the case of Spain, showing a prediction of diagnosed infected and deaths which will be observed after the ease of the total lockdown produced the 13th of March. Is also shown how this model can provide an insight of what the level of infection in the different regions of Spain is forecasted. The model predicts for Spain for the end of May more than 400,000 diagnosed infected cases, number which will be probably higher due to the change in the possibilities of performing massive number of tests to the general population. The number of forecasted deaths for that date is 46,000 15,000. The model also predicts the level of infection at the different Spanish regions, providing a counterintuitive result in the cases of Madrid and Catalonia as the result shows a higher the level of infection at Catalonia than the level at Madrid, according with this model. All of these results can be used to guide policy makers in order to optimize resources and to avoid future outbreaks of the covid 19.


Travelling wave solutions of the density suppressed motility model. In this paper, we study the traveling wave solutions to the density suppressed motility model describing the self trapping'' mechanism that induces spatio temporal pattern formations observed in the experiment. We establish the existence of traveling wavefronts with a minimal wave speed and discuss the selection of wave profiles supplemented with numerical simulations illustrating the wave patterns which are well consistent with experimental observations.


On the travel time tomography problem in 3D. Numerical issues for the 3D travel time tomography problem with non overdetemined data are considered. Truncated Fourier series with respect to a special orthonormal basis of functions depending on the source position is used. In addition, truncated trigonometric Fourier series with respect to two out of three spatial variables is used. First, the Lipschitz stability estimate is obtained. Next, a globally convergent numerical method is constructed using a Carleman estimate for an integral operator.


Moment Based Ensemble Control. Controlling a large population, in the limit, a continuum, of structurally identical dynamical systems with parametric variations is a pervasive task in diverse applications in science and engineering. However, the severely underactuated nature and the inability to avail comprehensive state feedback information of such ensemble systems raise significant challenges in analysis and design of ensemble systems. In this paper, we propose a moment based ensemble control framework, which incorporates and expands the method of moments in probability theory to control theory. In particular, we establish an equivalence between ensemble systems and their moment systems in terms of control and their controllability properties by extending the Hausdorff moment problem from the perspectives of differential geometry and dynamical systems. The developments enable the design of moment feedback control laws for closing the loop in ensemble systems using the aggregated type of measurements. The feasibility of this closed loop control design procedure is validated both mathematically and numerically.


The energy of muscle contraction. II. Transverse compression and work. In this study we reproduced this compression induced reduction in muscle force through the use of a three dimensional finite element model of contracting muscle. The model used the principle of minimum total energy and allowed for the redistribution of energy through different strain energy densities this allowed us to determine the importance of the strain energy densities to the transverse forces developed by the muscle. Furthermore, we were able to study how external work done on the muscle by transverse compression affects the internal work and strain energy distribution of the muscle.


Riemannian structures and point counting. Suppose (X n) is a sequence of positive dimensional smooth projective complete intersections over mathbb F q with dimensions bounded from above and with characteristic zero lifts ( tilde X n) to smooth projective geometrically connected varieties. Suppose each complex variety tilde X an n has (underlying real manifold equipped with) a Riemannian metric g n of sectional curvature at least kappa n 2 , kappa n geq 0 , and diameter at most D n . In this note, we show that if lim n rightarrow infty min d X n( mathbb F q d ) neq emptyset infty, then kappa nD n rightarrow infty . We deduce this theorem by proving a more general theorem estimating the number of points over finite fields of the above varieties in terms of the sectional curvature and diameter of Riemannian structures on the analytification of characteristic zero lifts. We also prove a version of this estimate for non projective varieties equipped with complete metrics of non negative sectional curvature. Finally, we prove a characteristic zero analogue of the above estimate by relating fixed points of algebraic endomorphisms of smooth projective complex complete intersections to Riemannian structures on them.


Defending Against Universal Attacks Through Selective Feature Regeneration. Deep neural network (DNN) predictions have been shown to be vulnerable to carefully crafted adversarial perturbations. Specifically, image agnostic (universal adversarial) perturbations added to any image can fool a target network into making erroneous predictions. Departing from existing defense strategies that work mostly in the image domain, we present a novel defense which operates in the DNN feature domain and effectively defends against such universal perturbations. Our approach identifies pre trained convolutional features that are most vulnerable to adversarial noise and deploys trainable feature regeneration units which transform these DNN filter activations into resilient features that are robust to universal perturbations. Regenerating only the top 50 adversarially susceptible activations in at most 6 DNN layers and leaving all remaining DNN activations unchanged, we outperform existing defense strategies across different network architectures by more than 10 in restored accuracy. We show that without any additional modification, our defense trained on ImageNet with one type of universal attack examples effectively defends against other types of unseen universal attacks.


Sorting Permutations with Fixed Pinnacle Set. We give a positive answer to a question raised by Davis et al. ( em Discrete Mathematics 341, 2018), concerning permutations with the same pinnacle set. Given pi in S n , a em pinnacle of pi is an element pi i ( i neq 1,n ) such that pi i 1 pi i pi i 1 . The question is given pi, pi' in S n with the same pinnacle set S , is there a sequence of operations that transforms pi into pi' such that all the intermediate permutations have pinnacle set S ? We introduce em balanced reversals , defined as reversals that do not modify the pinnacle set of the permutation to which they are applied. Then we show that pi may be sorted by balanced reversals (i.e. transformed into a standard permutation Id S ), implying that pi may be transformed into pi' using at most 4n 2 min p,3 balanced reversals, where p S geq 1 . In case p 0 , at most 2n 1 balanced reversals are needed.


Further Novel reductions of Kamp 'e de F 'eriet function. In a recent paper, Rathie and Pogany established thirty two novel and general reductions of two and three variables generalized hypergeometric functions. In this paper we provide twenty four further novel and general reduction formulas. The results are established by the application of Beta and Gamma integral methods to the three identities involving products of generalized hypergeometric functions obtained earlier by Kim and Rathie. As special cases, we mention some interesting results.


On the genus two skein algebra. We study the skein algebra of the genus 2 surface and its action on the skein module of the genus 2 handlebody. We compute this action explicitly, and we describe how the module decomposes over certain subalgebras in terms of polynomial representations of double affine Hecke algebras. Finally, we show that this algebra is isomorphic to the t q specialisation of the genus two spherical double affine Hecke algebra recently defined by Arthamonov and Shakirov.


GeoCapsNet Aerial to Ground view Image Geo localization using Capsule Network. The task of cross view image geo localization aims to determine the geo location (GPS coordinates) of a query ground view image by matching it with the GPS tagged aerial (satellite) images in a reference dataset. Due to the dramatic changes of viewpoint, matching the cross view images is challenging. In this paper, we propose the GeoCapsNet based on the capsule network for ground to aerial image geo localization. The network first extracts features from both ground view and aerial images via standard convolution layers and the capsule layers further encode the features to model the spatial feature hierarchies and enhance the representation power. Moreover, we introduce a simple and effective weighted soft margin triplet loss with online batch hard sample mining, which can greatly improve image retrieval accuracy. Experimental results show that our GeoCapsNet significantly outperforms the state of the art approaches on two benchmark datasets.


On backward attractors of interval maps. Special alpha limit sets ( s alpha limit sets) combine together all accumulation points of all backward orbit branches of a point x under a noninvertible map. The most important question about them is whether or not they are closed. We challenge the notion of s alpha limit sets as backward attractors for interval maps by showing that they need not be closed. This disproves a conjecture by Kolyada, Misiurewicz, and Snoha. We give a criterion in terms of Xiong's attracting center that completely characterizes which interval maps have all s alpha limit sets closed, and we show that our criterion is satisfied in the piecewise monotone case. We apply Blokh's models of solenoidal and basic omega limit sets to solve four additional conjectures by Kolyada, Misiurewicz, and Snoha relating topological properties of s alpha limit sets to the dynamics within them. For example, we show that the isolated points in a s alpha limit set of an interval map are always periodic, the non degenerate components are the union of one or two transitive cycles of intervals, and the rest of the s alpha limit set is nowhere dense. Moreover, we show that s alpha limit sets in the interval are always both F sigma and G delta . Finally, since s alpha limit sets need not be closed, we propose a new notion of beta limit sets to serve as backward attractors. The beta limit set of x is the smallest closed set to which all backward orbit branches of x converge, and it coincides with the closure of the s alpha limit set. At the end of the paper we suggest several new problems about backward attractors.


From Zero to Hero On the Limitations of Zero Shot Cross Lingual Transfer with Multilingual Transformers. Massively multilingual transformers pretrained with language modeling objectives (e.g., mBERT, XLM R) have become a de facto default transfer paradigm for zero shot cross lingual transfer in NLP, offering unmatched transfer performance. Current downstream evaluations, however, verify their efficacy predominantly in transfer settings involving languages with sufficient amounts of pretraining data, and with lexically and typologically close languages. In this work, we analyze their limitations and show that cross lingual transfer via massively multilingual transformers, much like transfer via cross lingual word embeddings, is substantially less effective in resource lean scenarios and for distant languages. Our experiments, encompassing three lower level tasks (POS tagging, dependency parsing, NER), as well as two high level semantic tasks (NLI, QA), empirically correlate transfer performance with linguistic similarity between the source and target languages, but also with the size of pretraining corpora of target languages. We also demonstrate a surprising effectiveness of inexpensive few shot transfer (i.e., fine tuning on a few target language instances after fine tuning in the source) across the board. This suggests that additional research efforts should be invested to reach beyond the limiting zero shot conditions.


Combinatorial considerations on the invariant measure of a stochastic matrix. The invariant measure is a fundamental object in the theory of Markov processes. In finite dimensions a Markov process is defined by transition rates of the corresponding stochastic matrix. The Markov tree theorem provides an explicit representation of the invariant measure of a stochastic matrix. In this note, we given a simple and purely combinatorial proof of the Markov tree theorem. In the symmetric case of detailed balance, the statement and the proof simplifies even more.


Balanced truncation model reduction for 3D linear magneto quasistatic field problems. We consider linear magneto quasistatic field equations which arise in simulation of low frequency electromagnetic devices coupled to electrical circuits. A finite element discretization of such equations on 3D domains leads to a singular system of differential algebraic equations. First, we study the structural properties of such a system and present a new regularization approach based on projecting out the singular state components. Furthermore, we present a Lyapunov based balanced truncation model reduction method which preserves stability and passivity. By making use of the underlying structure of the problem, we develop an efficient model reduction algorithm. Numerical experiments demonstrate its performance on a test example.


SS CAM Smoothed Score CAM for Sharper Visual Feature Localization. Interpretation of the underlying mechanisms of Deep Convolutional Neural Networks has become an important aspect of research in the field of deep learning due to their applications in high risk environments. To explain these black box architectures there have been many methods applied so the internal decisions can be analyzed and understood. In this paper, built on the top of Score CAM, we introduce an enhanced visual explanation in terms of visual sharpness called SS CAM, which produces centralized localization of object features within an image through a smooth operation. We evaluate our method on the ILSVRC 2012 Validation dataset, which outperforms Score CAM on both faithfulness and localization tasks.


Blind Image Restoration without Prior Knowledge. Many image restoration techniques are highly dependent on the degradation used during training, and their performance declines significantly when applied to slightly different input. Blind and universal techniques attempt to mitigate this by producing a trained model that can adapt to varying conditions. However, blind techniques to date require prior knowledge of the degradation process, and assumptions regarding its parameter space. In this paper we present the Self Normalization Side Chain (SCNC), a novel approach to blind universal restoration in which no prior knowledge of the degradation is needed. This module can be added to any existing CNN topology, and is trained along with the rest of the network in an end to end manner. The imaging parameters relevant to the task, as well as their dynamics, are deduced from the variety in the training data. We apply our solution to several image restoration tasks, and demonstrate that the SNSC encodes the degradation parameters, improving restoration performance.


Manifold Embedded Knowledge Transfer for Brain Computer Interfaces. Transfer learning makes use of data or knowledge in one problem to help solve a different, yet related, problem. It is particularly useful in brain computer interfaces (BCIs), for coping with variations among different subjects and or tasks. This paper considers offline unsupervised cross subject electroencephalogram (EEG) classification, i.e., we have labeled EEG trials from one or more source subjects, but only unlabeled EEG trials from the target subject. We propose a novel manifold embedded knowledge transfer (MEKT) approach, which first aligns the covariance matrices of the EEG trials in the Riemannian manifold, extracts features in the tangent space, and then performs domain adaptation by minimizing the joint probability distribution shift between the source and the target domains, while preserving their geometric structures. MEKT can cope with one or multiple source domains, and can be computed efficiently. We also propose a domain transferability estimation (DTE) approach to identify the most beneficial source domains, in case there are a large number of source domains. Experiments on four EEG datasets from two different BCI paradigms demonstrated that MEKT outperformed several state of the art transfer learning approaches, and DTE can reduce more than half of the computational cost when the number of source subjects is large, with little sacrifice of classification accuracy.


Enhanced Room Temperature Infrared LEDs using Monolithically Integrated Plasmonic Materials. Remarkable systems have been reported recently using the polylithic integration of semiconductor optoelectronic devices and plasmonic materials exhibiting epsilon near zero (ENZ) and negative permittivity. In traditional noble metals, the ENZ and plasmonic response is achieved near their plasma frequencies, limiting plasmonic optoelectronic device design flexibility. Here, we leverage an all epitaxial approach to monolithically and seamlessly integrate designer plasmonic materials into a quantum dot light emitting diode (LED), leading to a 5.6 x enhancement over an otherwise identical non plasmonic control sample. Devices exhibited optical powers comparable, and temperature performance far superior, to commercially available devices.


Energy relaxation and thermal diffusion in IR pump probe spectroscopy of hydrogen bonded liquids. Infrared pump probe spectroscopy provides detailed information on the dynamics of hydrogen bonded liquids. Due to dissipation of the absorbed pump pulse energy, also thermal equilibration dynamics contributes to the observed signal. Disentangling this contribution from the molecular response remains an open challenge. Performing non equilibrium molecular dynamics simulat ions of liquid deuterated methanol, we show that faster molecular vibrational relaxation and slower heat diffusion are decoupled and occur on different length scale. Transient structures of the hydrogen bonding network influence thermal relaxation by affecting thermal diffusivity over the length scale of several nanometers.


Graph Deep Factors for Forecasting. Deep probabilistic forecasting techniques have recently been proposed for modeling large collections of time series. However, these techniques explicitly assume either complete independence (local model) or complete dependence (global model) between time series in the collection. This corresponds to the two extreme cases where every time series is disconnected from every other time series in the collection or likewise, that every time series is related to every other time series resulting in a completely connected graph. In this work, we propose a deep hybrid probabilistic graph based forecasting framework called Graph Deep Factors (GraphDF) that goes beyond these two extremes by allowing nodes and their time series to be connected to others in an arbitrary fashion. GraphDF is a hybrid forecasting framework that consists of a relational global and relational local model. In particular, we propose a relational global model that learns complex non linear time series patterns globally using the structure of the graph to improve both forecasting accuracy and computational efficiency. Similarly, instead of modeling every time series independently, we learn a relational local model that not only considers its individual time series but also the time series of nodes that are connected in the graph. The experiments demonstrate the effectiveness of the proposed deep hybrid graph based forecasting model compared to the state of the art methods in terms of its forecasting accuracy, runtime, and scalability. Our case study reveals that GraphDF can successfully generate cloud usage forecasts and opportunistically schedule workloads to increase cloud cluster utilization by 47.5 on average.


Deep Serial Number Computational Watermarking for DNN Intellectual Property Protection. In this paper, we introduce DSN (Deep Serial Number), a new watermarking approach that can prevent the stolen model from being deployed by unauthorized parties. Recently, watermarking in DNNs has emerged as a new research direction for owners to claim ownership of DNN models. However, the verification schemes of existing watermarking approaches are vulnerable to various watermark attacks. Different from existing work that embeds identification information into DNNs, we explore a new DNN Intellectual Property Protection mechanism that can prevent adversaries from deploying the stolen deep neural networks. Motivated by the success of serial number in protecting conventional software IP, we introduce the first attempt to embed a serial number into DNNs. Specifically, the proposed DSN is implemented in the knowledge distillation framework, where a private teacher DNN is first trained, then its knowledge is distilled and transferred to a series of customized student DNNs. During the distillation process, each customer DNN is augmented with a unique serial number, i.e., an encrypted 0 1 bit trigger pattern. Customer DNN works properly only when a potential customer enters the valid serial number. The embedded serial number could be used as a strong watermark for ownership verification. Experiments on various applications indicate that DSN is effective in terms of preventing unauthorized application while not sacrificing the original DNN performance. The experimental analysis further shows that DSN is resistant to different categories of attacks.


Exact Penalties for Decomposable Optimization Problems. We consider a general decomposable convex optimization problem. By using right hand side allocation technique, it can be transformed into a collection of small dimensional optimization problems. The master problem is a convex non smooth optimization problem. We propose to apply the exact non smooth penalty method, which gives a solution of the initial problem under some fixed penalty parameter and provides the consistency of lower level problems. The master problem is suggested to be solved by a two speed subgradient projection method, which enhances the step size selection. Preliminary results of computational experiments confirm its efficiency.


Universities through the Eyes of Bibliographic Databases A Retroactive Growth Comparison of Google Scholar, Scopus and Web of Science. The purpose of this study is to ascertain the suitability of GS's url based method as a valid approximation of universities' academic output measures, taking into account three aspects (retroactive growth, correlation, and coverage). To do this, a set of 100 Turkish universities were selected as a case study. The productivity in Web of Science (WoS), Scopus and GS (2000 to 2013) were captured in two different measurement iterations (2014 and 2018). In addition, a total of 18,174 documents published by a subset of 14 research focused universities were retrieved from WoS, verifying their presence in GS within the official university web domain. Findings suggest that the retroactive growth in GS is unpredictable and dependent on each university, making this parameter hard to evaluate at the institutional level. Otherwise, the correlation of productivity between GS (url based method) and WoS and Scopus (selected sources) is moderately positive, even though it varies depending on the university, the year of publication, and the year of measurement. Finally, only 16 out of 18,174 articles analyzed were indexed in the official university website, although up to 84 were indexed in other GS sources. This work proves that the url based method to calculate institutional productivity in GS is not a good proxy for the total number of publications indexed in WoS and Scopus, at least in the national context analyzed. However, the main reason is not directly related to the operation of GS, but with a lack of universities' commitment to open access.


Fujita's conjecture for quasi elliptic surfaces. We show that Fujita's conjecture is true for quasi elliptic surfaces. Explicitly, for any quasi elliptic surface X and an ample line bundle A on X , we have K X tA is base point free for t geq 3 and is very ample for t geq 4 .


Monotonic and nonmonotonic immune responses in viral infection systems. In this paper, we study two dimensional, three dimensional monotonic and nonmonotonic immune responses in viral infection systems. Our results show that the viral infection systems with monotonic immune response has no bistability appear. However, the systems with nonmonotonic immune response has bistability appear under some conditions. For immune intensity, we got two important thresholds, post treatment control threshold and elite control threshold. When immune intensity is less than post treatment control threshold, the virus will be rebound. The virus will be under control when immune intensity is larger than elite control threshold. While between the two thresholds is a bistable interval. When immune intensity is in the bistable interval, the system can have bistability appear. Select the rate of immune cells stimulated by the viruses as a bifurcation parameter for nonmonotonic immune responses, we prove the system exhibits saddle node bifurcation and transcritical bifurcation.


Structural Parameterization for Graph Deletion Problems over Data Streams. The study of parameterized streaming complexity on graph problems was initiated by Fafianie et al. (MFCS'14) and Chitnis et al. (SODA'15 and SODA'16). Simply put, the main goal is to design streaming algorithms for parameterized problems such that O left(f(k) log O(1) n right) space is enough, where f is an arbitrary computable function depending only on the parameter k . However, in the past few years, very few positive results have been established. Most of the graph problems that do have streaming algorithms of the above nature are ones where localized checking is required, like Vertex Cover or Maximum Matching parameterized by the size k of the solution we are seeking. Many important parameterized problems that form the backbone of traditional parameterized complexity are known to require Omega(n) bits for any streaming algorithm e.g., Feedback Vertex Set, Even Odd Cycle Transversal, Triangle Deletion or the more general cal F Subgraph Deletion when parameterized by solution size k . Our main conceptual contribution is to overcome the obstacles to efficient parameterized streaming algorithms by utilizing the power of parameterization. To the best of our knowledge, this is the first work in parameterized streaming complexity that considers structural parameters instead of the solution size as a parameter. We focus on the vertex cover size K as the parameter for the parameterized graph deletion problems we consider. At the same time, most of the previous work in parameterized streaming complexity was restricted to the EA (edge arrival) or DEA (dynamic edge arrival) models. In this work, we consider the above mentioned graph deletion problems in the four most well studied streaming models, i.e., the EA, DEA, VA (vertex arrival) and AL (adjacency list) models.


Enhancing Facial Data Diversity with Style based Face Aging. A significant limiting factor in training fair classifiers relates to the presence of dataset bias. In particular, face datasets are typically biased in terms of attributes such as gender, age, and race. If not mitigated, bias leads to algorithms that exhibit unfair behaviour towards such groups. In this work, we address the problem of increasing the diversity of face datasets with respect to age. Concretely, we propose a novel, generative style based architecture for data augmentation that captures fine grained aging patterns by conditioning on multi resolution age discriminative representations. By evaluating on several age annotated datasets in both single and cross database experiments, we show that the proposed method outperforms state of the art algorithms for age transfer, especially in the case of age groups that lie in the tails of the label distribution. We further show significantly increased diversity in the augmented datasets, outperforming all compared methods according to established metrics.


Elements of given order in Tate Shafarevich groups of abelian varieties in quadratic twist families. Let A be an abelian variety over a number field F and let p be a prime. Cohen Lenstra Delaunay style heuristics predict that the Tate Shafarevich group of A s should contain an element of order p for a positive proportion of quadratic twists A s of A . We give a general method to prove instances of this conjecture by exploiting independent isogenies of A . For each prime p , there is a large class of elliptic curves for which our method shows that a positive proportion of quadratic twists have nontrivial p torsion in their Tate Shafarevich groups. In particular, when the modular curve X 0(3p) has infinitely many F rational points the method applies to most'' elliptic curves E having a cyclic 3p isogeny. It also applies in certain cases when X 0(3p) has only finitely many points. For example, we find an elliptic curve over mathbb Q for which a positive proportion of quadratic twists have an element of order 5 in their Tate Shafarevich groups. The method applies to abelian varieties of arbitrary dimension, at least in principle. As a proof of concept, we give, for each prime p equiv 1 pmod 9 , examples of CM abelian threefolds with a positive proportion of quadratic twists having elements of order p in their Tate Shafarevich groups.


Exponentials of non singular simplicial sets. A simplicial set is non singular if the representing map of each non degenerate simplex is degreewise injective. The simplicial mapping set X K has n simplices given by the simplicial maps Delta n times K to X . We prove that X K is non singular whenever X is non singular. It follows that non singular simplicial sets form a cartesian closed category with all limits and colimits, but it is not a topos.


PHINC A Parallel Hinglish Social Media Code Mixed Corpus for Machine Translation. Code mixing is the phenomenon of using more than one language in a sentence. It is a very frequently observed pattern of communication on social media platforms. Flexibility to use multiple languages in one text message might help to communicate efficiently with the target audience. But, it adds to the challenge of processing and understanding natural language to a much larger extent. This paper presents a parallel corpus of the 13,738 code mixed English Hindi sentences and their corresponding translation in English. The translations of sentences are done manually by the annotators. We are releasing the parallel corpus to facilitate future research opportunities in code mixed machine translation. The annotated corpus is available at https doi.org 10.5281 zenodo.3605597.


Delving into the Imbalance of Positive Proposals in Two stage Object Detection. Imbalance issue is a major yet unsolved bottleneck for the current object detection models. In this work, we observe two crucial yet never discussed imbalance issues. The first imbalance lies in the large number of low quality RPN proposals, which makes the R CNN module (i.e., post classification layers) become highly biased towards the negative proposals in the early training stage. The second imbalance stems from the unbalanced ground truth numbers across different testing images, resulting in the imbalance of the number of potentially existing positive proposals in testing phase. To tackle these two imbalance issues, we incorporates two innovations into Faster R CNN 1) an R CNN Gradient Annealing (RGA) strategy to enhance the impact of positive proposals in the early training stage. 2) a set of Parallel R CNN Modules (PRM) with different positive negative sampling ratios during training on one same backbone. Our RGA and PRM can totally bring 2.0 improvements on AP on COCO minival. Experiments on CrowdHuman further validates the effectiveness of our innovations across various kinds of object detection tasks.


DMCL Distillation Multiple Choice Learning for Multimodal Action Recognition. In this work, we address the problem of learning an ensemble of specialist networks using multimodal data, while considering the realistic and challenging scenario of possible missing modalities at test time. Our goal is to leverage the complementary information of multiple modalities to the benefit of the ensemble and each individual network. We introduce a novel Distillation Multiple Choice Learning framework for multimodal data, where different modality networks learn in a cooperative setting from scratch, strengthening one another. The modality networks learned using our method achieve significantly higher accuracy than if trained separately, due to the guidance of other modalities. We evaluate this approach on three video action recognition benchmark datasets. We obtain state of the art results in comparison to other approaches that work with missing modalities at test time.


TexMesh Reconstructing Detailed Human Texture and Geometry from RGB D Video. We present TexMesh, a novel approach to reconstruct detailed human meshes with high resolution full body texture from RGB D video. TexMesh enables high quality free viewpoint rendering of humans. Given the RGB frames, the captured environment map, and the coarse per frame human mesh from RGB D tracking, our method reconstructs spatiotemporally consistent and detailed per frame meshes along with a high resolution albedo texture. By using the incident illumination we are able to accurately estimate local surface geometry and albedo, which allows us to further use photometric constraints to adapt a synthetically trained model to real world sequences in a self supervised manner for detailed surface geometry and high resolution texture estimation. In practice, we train our models on a short example sequence for self adaptation and the model runs at interactive framerate afterwards. We validate TexMesh on synthetic and real world data, and show it outperforms the state of art quantitatively and qualitatively.


Augmenting Visual Question Answering with Semantic Frame Information in a Multitask Learning Approach. Visual Question Answering (VQA) concerns providing answers to Natural Language questions about images. Several deep neural network approaches have been proposed to model the task in an end to end fashion. Whereas the task is grounded in visual processing, if the question focuses on events described by verbs, the language understanding component becomes crucial. Our hypothesis is that models should be aware of verb semantics, as expressed via semantic role labels, argument types, and or frame elements. Unfortunately, no VQA dataset exists that includes verb semantic information. Our first contribution is a new VQA dataset (imSituVQA) that we built by taking advantage of the imSitu annotations. The imSitu dataset consists of images manually labeled with semantic frame elements, mostly taken from FrameNet. Second, we propose a multitask CNN LSTM VQA model that learns to classify the answers as well as the semantic frame elements. Our experiments show that semantic frame element classification helps the VQA system avoid inconsistent responses and improves performance.


Multi Objective Evolutionary approach for the Performance Improvement of Learners using Ensembling Feature selection and Discretization Technique on Medical data. Biomedical data is filled with continuous real values these values in the feature set tend to create problems like underfitting, the curse of dimensionality and increase in misclassification rate because of higher variance. In response, pre processing techniques on dataset minimizes the side effects and have shown success in maintaining the adequate accuracy. Feature selection and discretization are the two necessary preprocessing steps that were effectively employed to handle the data redundancies in the biomedical data. However, in the previous works, the absence of unified effort by integrating feature selection and discretization together in solving the data redundancy problem leads to the disjoint and fragmented field. This paper proposes a novel multi objective based dimensionality reduction framework, which incorporates both discretization and feature reduction as an ensemble model for performing feature selection and discretization. Selection of optimal features and the categorization of discretized and non discretized features from the feature subset is governed by the multi objective genetic algorithm (NSGA II). The two objective, minimizing the error rate during the feature selection and maximizing the information gain while discretization is considered as fitness criteria.


COVID 19 Emotion Monitoring as a Tool to Increase Preparedness for Disease Outbreaks in Developing Regions. The COVID 19 pandemic brought many challenges, from hospital occupation management to lock down mental health repercussions such as anxiety or depression. In this work, we present a solution for the later problem by developing a Twitter emotion monitor system based on a state of the art natural language processing model. The system monitors six different emotions on accounts in cities, as well as politicians and health authorities Twitter accounts. With an anonymous use of the emotion monitor, health authorities and private health insurance companies can develop strategies to tackle problems such as suicide and clinical depression. The model chosen for such a task is a Bidirectional Encoder Representations from Transformers (BERT) pre trained on a Spanish corpus (BETO). The model performed well on a validation dataset. The system is deployed online as part of a web application for simulation and data analysis of COVID 19, in Colombia, available at https epidemiologia matematica.org.


The weak n inner product space. In this article we study a generalization of the n inner product which we name weak n inner product. As particular case we consider the n iterated 2 inner product and we give its representation in terms of the standard k inner products, k n, using the Dodgson's identity for determinants. Finally, we present several applications, including a brief characterization of a linear regression model for the random variables in discrete case and a generalization of the Chebyshev functional using the n iterated 2 inner product.


Linear independence of rationally slice knots. A knot in S 3 is rationally slice if it bounds a disk in a rational homology ball. We give an infinite family of rationally slice knots that are linearly independent in the knot concordance group. In particular, our examples are all infinite order. All previously known examples of rationally slice knots were order two.


Rainfall Runoff Prediction at Multiple Timescales with a Single Long Short Term Memory Network. Long Short Term Memory Networks (LSTMs) have been applied to daily discharge prediction with remarkable success. Many practical scenarios, however, require predictions at more granular timescales. For instance, accurate prediction of short but extreme flood peaks can make a life saving difference, yet such peaks may escape the coarse temporal resolution of daily predictions. Naively training an LSTM on hourly data, however, entails very long input sequences that make learning hard and computationally expensive. In this study, we propose two Multi Timescale LSTM (MTS LSTM) architectures that jointly predict multiple timescales within one model, as they process long past inputs at a single temporal resolution and branch out into each individual timescale for more recent input steps. We test these models on 516 basins across the continental United States and benchmark against the US National Water Model. Compared to naive prediction with a distinct LSTM per timescale, the multi timescale architectures are computationally more efficient with no loss in accuracy. Beyond prediction quality, the multi timescale LSTM can process different input variables at different timescales, which is especially relevant to operational applications where the lead time of meteorological forcings depends on their temporal resolution.


Numerical equilibria with pressure anisotropy and incompressible plasma rotation parallel to the magnetic field. It is believed that plasma rotation can affect the transitions to the advanced confinement regimes in tokamaks. In addition, in order to achieve fusion temperatures modern tokamaks rely on auxiliary heating methods. These methods generate pressure anisotropy in the plasma. For incompressible rotation with pressure anisotropy the equilibrium is governed by a Generalized Grad Shafranov (GGS) equation and a decoupled Bernoulli type equation for the effective pressure, bar p (p parallel p perp) 2 , where p parallel ( p perp ) is the pressure tensor element parallel (perpendicular) to the magnetic field. In the case of plasma rotation parallel to the magnetic field the GGS equation can be transformed to one equation identical in form with the GS equation. In this study by making use of the aforementioned property of the GGS equation for parallel plasma rotation we have constructed ITER like numerical equilibria by extending HELENA, an equilibrium fixed boundary solver and examined the impact of rotation and anisotropy on certain equilibrium quantities. The main conclusions are that the addition of pressure anisotropy to rotation allows the profile shaping of the equilibrium quantities in much more extent thus favouring the confinement and allows extension of the parametric space of the Mach number corresponding to higher values. Furthermore, the impact of pressure anisotropy in the equilibrium quantities is stronger than that of the rotation, for most of the quantities examined. For the pressure components the impact of the pressure anisotropy is the same regardless of whether the power is deposited parallel or perpendicular to the magnetic surfaces, thus implying that there is no preferable heating direction, while for the current density, the heating parallel to the magnetic surfaces seems to be beneficial for the current gradient driven instabilities.


Critical Sets of PL and Discrete Morse Theory a Correspondence. Piecewise linear (PL) Morse theory and discrete Morse theory are used in shape analysis tasks to investigate the topological features of discretized spaces. In spite of their common origin in smooth Morse theory, various notions of critical points have been given in the literature for the discrete setting, making a clear understanding of the relationships occurring between them not obvious. This paper aims at providing equivalence results about critical points of the two discretized Morse theories. First of all, we prove the equivalence of the existing notions of PL critical points. Next, under an optimality condition called relative perfectness, we show a dimension agnostic correspondence between the set of PL critical points and that of discrete critical simplices of the combinatorial approach. Finally, we show how a relatively perfect discrete gradient vector field can be algorithmically built up to dimension 3. This way, we guarantee a formal and operative connection between critical sets in the PL and discrete theories.


WearID Wearable Assisted Low Effort Authentication to Voice Assistants using Cross Domain Speech Similarity. Due to the open nature of voice input, voice assistant (VA) systems (e.g., Google Home and Amazon Alexa) are under a high risk of sensitive information leakage (e.g., personal schedules and shopping accounts). Though the existing VA systems may employ voice features to identify users, they are still vulnerable to various acoustic attacks (e.g., impersonation, replay and hidden command attacks). In this work, we focus on the security issues of the emerging VA systems and aim to protect the users' highly sensitive information from these attacks. Towards this end, we propose a system, WearID, which uses an off the shelf wearable device (e.g., a smartwatch or bracelet) as a secure token to verify the user's voice commands to the VA system. In particular, WearID exploits the readily available motion sensors from most wearables to describe the command sound in vibration domain and check the received command sound across two domains (i.e., wearable's motion sensor vs. VA device's microphone) to ensure the sound is from the legitimate user.


Domain Adaptive Relational Reasoning for 3D Multi Organ Segmentation. In this paper, we present a novel unsupervised domain adaptation (UDA) method, named Domain Adaptive Relational Reasoning (DARR), to generalize 3D multi organ segmentation models to medical data collected from different scanners and or protocols (domains). Our method is inspired by the fact that the spatial relationship between internal structures in medical images is relatively fixed, e.g., a spleen is always located at the tail of a pancreas, which serves as a latent variable to transfer the knowledge shared across multiple domains. We formulate the spatial relationship by solving a jigsaw puzzle task, i.e., recovering a CT scan from its shuffled patches, and jointly train it with the organ segmentation task. To guarantee the transferability of the learned spatial relationship to multiple domains, we additionally introduce two schemes 1) Employing a super resolution network also jointly trained with the segmentation model to standardize medical images from different domain to a certain spatial resolution 2) Adapting the spatial relationship for a test image by test time jigsaw puzzle training. Experimental results show that our method improves the performance by 29.60 DSC on target datasets on average without using any data from the target domain during training.


A Quantum Invariant of Links in T 2 times I with Volume Conjecture Behavior. We define a polynomial invariant J n T of links in the thickened torus. We call J T n the n th toroidal colored Jones polynomial, and show it satisfies many properties of the original colored Jones polynomial. Most significantly, J n T exhibits volume conjecture behavior. We prove the volume conjecture for the 2 by 2 square weave, and provide computational evidence for other links. We also give two equivalent constructions of J n T , one as a generalized operator invariant we call a pseudo operator invariant, and another using the Kauffman bracket skein module of the torus. Finally, we show J T n produces invariants of biperiodic and virtual links. To our knowledge, J T n gives the first example of volume conjecture behavior in a virtual (non classical) link.


Convex Relaxation of AC Optimal Power Flow with Flexible Transmission Line Impedances. Flexible transmission line impedances on one hand are a promising control resource for facilitating grid flexibility, but on the other hand add much complexity to the concerned optimization problems. This paper develops a convexification method for the AC optimal power flow with flexible line impedances. First, it is discovered that a flexible impedance line is equivalent to a constant impedance line linking a pair of transformers with correlated and continuously adjustable tap ratios. Then, with this circuit equivalent, the original optimization problem is reformulated into a semi definite program under the existing convex relaxation framework, which improves the solution tractability and optimality in an easy to implement manner. The proposed method is verified by numerical tests on the IEEE 118 bus system.


Differentially Large Fields. We introduce the notion of differential largeness for fields equipped with several commuting derivations (as an analogue to largeness of fields). We lay out the foundations of this new class of "tame" differential fields. We state several characterizations and exhibit plenty of examples and applications. Our results strongly indicate that differentially large fields will play a key role in differential field arithmetic. For instance, we characterise differential largeness in terms of being existentially closed in their power series field (furnished with natural derivations), we give explicit constructions of differentially large fields in terms of iterated powers series, we prove that the class of differentially large fields is elementary, and we show that differential largeness is preserved under algebraic extensions, therefore showing that their algebraic closure is differentially closed.


LogiQA A Challenge Dataset for Machine Reading Comprehension with Logical Reasoning. Machine reading is a fundamental task for testing the capability of natural language understanding, which is closely related to human cognition in many aspects. With the rising of deep learning techniques, algorithmic models rival human performances on simple QA, and thus increasingly challenging machine reading datasets have been proposed. Though various challenges such as evidence integration and commonsense knowledge have been integrated, one of the fundamental capabilities in human reading, namely logical reasoning, is not fully investigated. We build a comprehensive dataset, named LogiQA, which is sourced from expert written questions for testing human Logical reasoning. It consists of 8,678 QA instances, covering multiple types of deductive reasoning. Results show that state of the art neural models perform by far worse than human ceiling. Our dataset can also serve as a benchmark for reinvestigating logical AI under the deep learning NLP setting. The dataset is freely available at https github.com lgw863 LogiQA dataset


Multi SQL An extensible multi model data query language. Big data management aims to establish data hubs that support data in multiple models and types in an all around way. Thus, the multi model database system is a promising architecture for building such a multi model data store. For an integrated data hub, a unified and flexible query language is incredibly necessary. In this paper, an extensible and practical query language Multi SQL is proposed to realize the unified management of multi model data considering the co processing of multi model data. To the best of our knowledge, Multi SQL is the first query language based on various data models. Multi SQL can also be expanded to suit more complicated scenarios as it is flexible to support other data models. Moreover, we provide a formal semantic definition of the core features of Multi SQL, including the multi model definition, multi model filters, multi model joins, etc. Furthermore, we propose a two level query implementation method to totally exploit the existing query optimization capabilities of the underlying engines which could largely improve the query excution efficiency.


A Software based NVM Emulator Supporting Read Write Asymmetric Latencies. Non volatile memory (NVM) is a promising technology for low energy and high capacity main memory of computers. The characteristics of NVM devices, however, tend to be fundamentally different from those of DRAM (i.e., the memory device currently used for main memory), because of differences in principles of memory cells. Typically, the write latency of an NVM device such as PCM and ReRAM is much higher than its read latency. The asymmetry in read write latencies likely affects the performance of applications significantly. For analyzing behavior of applications running on NVM based main memory, most researchers use software based emulation tools due to the limited number of commercial NVM products. However, these existing emulation tools are too slow to emulate a large scale, realistic workload or too simplistic to investigate the details of application behavior on NVM with asymmetric read write latencies. This paper therefore proposes a new NVM emulation mechanism that is not only light weight but also aware of a read write latency gap in NVM based main memory. We implemented the prototype of the proposed mechanism for the Intel CPU processors of the Haswell architecture. We also evaluated its accuracy and performed case studies for practical benchmarks. The results showed that our prototype accurately emulated write latencies of NVM based main memory it emulated the NVM write latencies in a range from 200 ns to 1000 ns with negligible errors from 0.2 to 1.1 . We confirmed that the use of our emulator enabled us to successfully estimate performance of practical workloads for NVM based main memory, while an existing light weight emulation model misestimated.


Stable interpolation with isotropic and anisotropic Gaussians using Hermite generating function. Gaussian kernels can be an efficient and accurate tool for multivariate interpolation. In practice, high accuracies are often achieved in the flat limit where the interpolation matrix becomes increasingly ill conditioned. Stable evaluation algorithms for isotropic Gaussians (Gaussian radial basis functions) have been proposed based on a Chebyshev expansion of the Gaussians by Fornberg, Larsson Flyer and based on a Mercer expansion with Hermite polynomials by Fasshauer McCourt. In this paper, we propose a new stabilization algorithm for the multivariate interpolation with isotropic or anisotropic Gaussians derived from the generating function of the Hermite polynomials. We also derive and analyse a new analytic cut off criterion for the generating function expansion that allows to automatically adjust the number of the stabilizing basis functions.


Semi supervised Gated Recurrent Neural Networks for Robotic Terrain Classification. Legged robots are popular candidates for missions in challenging terrains due to the wide variety of locomotion strategies they can employ. Terrain classification is a key enabling technology for autonomous legged robots, as it allows the robot to harness their innate flexibility to adapt their behaviour to the demands of their operating environment. In this paper, we show how highly capable machine learning techniques, namely gated recurrent neural networks, allow our target legged robot to correctly classify the terrain it traverses in both supervised and semi supervised fashions. Tests on a benchmark data set shows that our time domain classifiers are well capable of dealing with raw and variable length data with small amount of labels and perform to a level far exceeding the frequency domain classifiers. The classification results on our own extended data set opens up a range of high performance behaviours that are specific to those environments. Furthermore, we show how raw unlabelled data is used to improve significantly the classification results in a semi supervised model.


Turbulence in a stably stratified fluid Onset of global anisotropy as a function of the Richardson number. It is necessary to introduce an external forcing to induce turbulence in a stably stratified fluid. The Heisenberg eddy viscosity technique should in this case suffice to calculate a space time averaged quantity like the global anisotropy parameter as a function of the Richardson number. We find analytically that the anisotropy increases linearly with the Richardson number, with a small quadratic correction. A numerical simulation of the complete equations shows the linear behaviour.


Antiforensic techniques deployed by custom developed malware in evading anti virus detection. Both malware and antivirus detection tools advance in their capabilities. Malware aim is to evade the detection while antivirus is to detect the malware. Over time, the detection techniques evolved from simple static signature matching over antiheuristic analysis to machine learning assisted algorithms. This thesis describes several layers of anti virus evasion deployed by the malware and conducts the analysis of the evasion success rate. The scientific contribution of this research is in the following techniques the malware used the new algorithm for identifying the Windows operating system functions, a new custom developed obfuscation and de obfuscation routine and the usage of USB and sound devices enumeration in the anti heuristic detection. The new PE mutation engine facilitates the malware static signature variation. In the next stage of the assessment, anti virus engines then test the malware evasion capabilities. The locally installed antivirus applications and the two multi scanner online engines inspect the submitted malware samples. The thesis examines the results and discusses the strengths and weaknesses of each evasion technique.


Generalized max weight policies in stochastic matching. We consider a matching system where items arrive one by one at each node of a compatibility network according to Poisson processes and depart from it as soon as they are matched to a compatible item. The matching policy considered is a generalized max weight policy where decisions can be noisy. Additionally, some of the nodes may have impatience, i.e. leave the system before being matched. Using specific properties of the max weight policy, we construct several Lyapunov functions, including a simple quadratic one. This allows us to establish stability results, to construct bounds for the stationary mean and variances of the total amount of customers in the system, and to prove exponential convergence speed towards the stationary measure. We finally illustrate some of these results using simulations on toy examples.


Disfluencies and Human Speech Transcription Errors. This paper explores contexts associated with errors in transcrip tion of spontaneous speech, shedding light on human perceptionof disfluencies and other conversational speech phenomena. Anew version of the Switchboard corpus is provided with disfluency annotations for careful speech transcripts, together with results showing the impact of transcription errors on evaluation of automatic disfluency detection.


ETTR Bounds and Approximation Solutions of Blind Rendezvous Policies in Cognitive Radio Networks with Random Channel States. In this paper, we consider the multichannel rendezvous problem in cognitive radio networks (CRNs) where the probability that two users hopping on the same channel have a successful rendezvous is a function of channel states. The channel states are modeled by stochastic processes with joint distributions known to users. However, the exact state of a channel at any time is not observable. We first consider two channel models (i) the fast time varying channel model (where the channel states are assumed to be independent and identically distributed in each time slot), and (ii) the slow time varying channel model (where the channel states remain unchanged over time). Among the classes of the blind rendezvous policies that randomly hop on channels according to certain channel selection probabilities, we show the optimal channel selection policy that minimizes the expected time to rendezvous (ETTR) is the single selection policy that hops on the best'' channel all the time in the fast time varying channel model. However, for the slow time varying channel model, it is much more difficult to find the optimal channel selection policy. By using the majorization ordering, we derive a lower bound and an upper bound for the ETTR under the assumption that the channel states are exchangeable random variables. Bases on these bounds, we then prove various approximation solutions. We then extend our results to general channel models where the joint distribution of the channel states is only assumed to be stationary in time.


Reinforcement Learning driven Information Seeking A Quantum Probabilistic Approach. Understanding an information forager's actions during interaction is very important for the study of interactive information retrieval. Although information spread in uncertain information space is substantially complex due to the high entanglement of users interacting with information objects (text, image, etc.). However, an information forager, in general, accompanies a piece of information (information diet) while searching (or foraging) alternative contents, typically subject to decisive uncertainty. Such types of uncertainty are analogous to measurements in quantum mechanics which follow the uncertainty principle. In this paper, we discuss information seeking as a reinforcement learning task. We then present a reinforcement learning based framework to model forager exploration that treats the information forager as an agent to guide their behaviour. Also, our framework incorporates the inherent uncertainty of the foragers' action using the mathematical formalism of quantum mechanics.


Protograph LDPC Code Design for Asynchronous Random Access. This work addresses the physical layer channel code design for an uncoordinated, frame and slot asynchronous random access protocol. Starting from the observation that collisions between two users yield very specific interference patterns, we define a surrogate channel model and propose different protograph low density parity check code designs. The proposed codes are both tested in a setup where the physical layer is abstracted, as well as on a more realistic channel model, where finite length physical layer simulations of the entire asynchronous random access scheme, including decoding are carried out. We find that the abstracted physical layer model overestimates the performance when short blocks are considered. Additionally, the optimized codes show gains in supported channel traffic a measure of the number of terminals that can be concurrently accommodated on the channel of around 17 at a packet loss rate of 10 2 w.r.t. off the shelf codes.


The Design and Implementation of a Real Time Visual Search System on JD E commerce Platform. We present the design and implementation of a visual search system for real time image retrieval on JD.com, the world's third largest and China's largest e commerce site. We demonstrate that our system can support real time visual search with hundreds of billions of product images at sub second timescales and handle frequent image updates through distributed hierarchical architecture and efficient indexing methods. We hope that sharing our practice with our real production system will inspire the middleware community's interest and appreciation for building practical large scale systems for emerging applications, such as ecommerce visual search.


Local Graph Stability in Exponential Family Random Graph Models. Exponential family Random Graph Models (ERGMs) can be viewed as expressing a probability distribution on graphs arising from the action of competing social forces that make ties more or less likely, depending on the state of the rest of the graph. Such forces often lead to a complex pattern of dependence among edges, with non trivial large scale structures emerging from relatively simple local mechanisms. While this provides a powerful tool for probing macro micro connections, much remains to be understood about how local forces shape global outcomes. One simple question of this type is that of the conditions needed for social forces to stabilize a particular structure. We refer to this property as local stability and seek a general means of identifying the set of parameters under which a target graph is locally stable with respect to a set of alternatives. Here, we provide a complete characterization of the region of the parameter space inducing local stability, showing it to be the interior of a convex cone whose faces can be derived from the change scores of the sufficient statistics vis a vis the alternative structures. As we show, local stability is a necessary but not sufficient condition for more general notions of stability, the latter of which can be explored more efficiently by using the stable cone'' within the parameter space as a starting point. In addition, we show how local stability can be used to determine whether a fitted model implies that an observed structure would be expected to arise primarily from the action of social forces, versus by merit of the model permitting a large number of high probability structures, of which the observed structure is one. We also use our approach to identify the dyads within a given structure that are the least stable, and hence predicted to have the highest probability of changing over time.


On the value of non Markovian Dynkin games with partial and asymmetric information. We prove that zero sum Dynkin games in continuous time with partial and asymmetric information admit a value in randomised stopping times when the stopping payoffs of the players are general cadlag measurable processes. As a by product of our method of proof we also obtain existence of optimal strategies for both players. The main novelties are that we do not assume a Markovian nature of the game nor a particular structure of the information available to the players. This allows us to go beyond the variational methods (based on PDEs) developed in the literature on Dynkin games in continuous time with partial asymmetric information. Instead, we focus on a probabilistic and functional analytic approach based on the general theory of stochastic processes and Sion's min max theorem (M. Sion, Pacific J. Math., 8, 1958, pp. 171 176). Our framework encompasses examples found in the literature on continuous time Dynkin games with asymmetric information and we provide counterexamples to show that our assumptions cannot be further relaxed.


The Configuration of the Perivascular System Transporting Macromolecules in the CNS (PREPRINT). Large blood vessels entering the CNS are surrounded by perivascular spaces that communicate with the cerebrospinal fluid and, at their termini, with the interstitial space. Solutes and particles can translocate along these perivascular conduits, reportedly in both directions. Recently, this prompted a renewed interest in the intrathecal therapy delivery route for CNS targeted therapeutics. However, the extent of the CNS coverage by the perivascular system is unknown, making the outcome of drug administration to the CSF uncertain. We traced the translocation of model macromolecules from the CSF into the CNS of rats and non human primates. Conduits transporting macromolecules were found to extend throughout the parenchyma from both external and internal (fissures) CNS boundaries, excluding ventricles, in large numbers, on average ca. 40 channels per mm2 in rats and non human primates. The high density and depth of extension of the perivascular channels suggest that the perivascular route can be suitable for delivery of therapeutics to parenchymal targets throughout the CNS.


Optimally Perturbed Identity Matrices of Rank 2. The problem of optimal antipodal codes can be framed as finding low rank Gram matrices G with G ii 1 and G ij leq epsilon for 1 leq i neq j leq n . In 2018, Bukh and Cox introduced a new bounding technique by removing the condition that G be a gram matrix. In this work, we investigate how tight this relaxation is, and find exact results for real valued matrices of rank 2 .


Extracting Topics from Open Educational Resources. In recent years, Open Educational Resources (OERs) were earmarked as critical when mitigating the increasing need for education globally. Obviously, OERs have high potential to satisfy learners in many different circumstances, as they are available in a wide range of contexts. However, the low quality of OER metadata, in general, is one of the main reasons behind the lack of personalised services such as search and recommendation. As a result, the applicability of OERs remains limited. Nevertheless, OER metadata about covered topics (subjects) is essentially required by learners to build effective learning pathways towards their individual learning objectives. Therefore, in this paper, we report on a work in progress project proposing an OER topic extraction approach, applying text mining techniques, to generate high quality OER metadata about topic distribution. This is done by 1) collecting 123 lectures from Coursera and Khan Academy in the area of data science related skills, 2) applying Latent Dirichlet Allocation (LDA) on the collected resources in order to extract existing topics related to these skills, and 3) defining topic distributions covered by a particular OER. To evaluate our model, we used the data set of educational resources from Youtube, and compared our topic distribution results with their manually defined target topics with the help of 3 experts in the area of data science. As a result, our model extracted topics with 79 of F1 score.


Representation Optimal Multi Robot Motion Planning using Conflict Based Search. Multi Agent Motion Planning (MAMP) is the problem of computing feasible paths for a set of agents given individual start and goal states. Given the hardness of MAMP, most of the research related to multi agent systems has focused on multi agent pathfinding (MAPF), which simplifies the problem by assuming a shared discrete representation of the space for all agents. The Conflict Based Search algorithm (CBS) has proven a tractable means of generating optimal solutions in discrete spaces. However, neither CBS nor other discrete MAPF techniques can be directly applied to solve MAMP problems because of the assumption of the shared discrete representation of the agents' state space. In this work, we solve MAMP problems by adapting the techniques discovered in the MAPF scenario by CBS to the more general problem with heterogeneous agents in a continuous space. We demonstrate the scalability teams of up to 32 agents, demonstrate the ability to handle up to 8 high DOF manipulators, and plan for heterogeneous teams. In all scenarios, our approach plans significantly faster while providing higher quality solutions.


On the Need of Removing Last Releases of Data When Using or Validating Defect Prediction Models. To develop and train defect prediction models, researchers rely on datasets in which a defect is attributed to an artifact, e.g., a class of a given release. However, the creation of such datasets is far from being perfect. It can happen that a defect is discovered several releases after its introduction this phenomenon has been called "dormant defects". This means that, if we observe today the status of a class in its current version, it can be considered as defect free while this is not the case. We call "snoring" the noise consisting of such classes, affected by dormant defects only. We conjecture that the presence of snoring negatively impacts the classifiers' accuracy and their evaluation. Moreover, earlier releases likely contain more snoring classes than older releases, thus, removing the most recent releases from a dataset could reduce the snoring effect and improve the accuracy of classifiers. In this paper we investigate the impact of the snoring noise on classifiers' accuracy and their evaluation, and the effectiveness of a possible countermeasure consisting in removing the last releases of data. We analyze the accuracy of 15 machine learning defect prediction classifiers on data from more than 4,000 bugs and 600 releases of 19 open source projects from the Apache ecosystem. Our results show that, on average across projects (i) the presence of snoring decreases the recall of defect prediction classifiers (ii) evaluations affected by snoring are likely unable to identify the best classifiers, and (iii) removing data from recent releases helps to significantly improve the accuracy of the classifiers. On summary, this paper provides insights on how to create a software defect dataset by mitigating the effect of snoring.


Cognitive State Analysis, Understanding, and Decoding from the Perspective of Brain Connectivity. Cognitive states are involving in our daily life, which motivates us to explore them and understand them by a vast variety of perspectives. Among these perspectives, brain connectivity is increasingly receiving attention in recent years. It is the right time to summarize the past achievements, serving as a cornerstone for the upcoming progress in the field. In this chapter, the definition of the cognitive state is first given and the cognitive states that are frequently investigated are then outlined. The introduction of the methods for estimating connectivity strength and graph theoretical metrics is followed. Subsequently, each cognitive state is separately described and the progress in cognitive state investigation is summarized, including analysis, understanding, and decoding. We concentrate on the literature ascertaining macro scale representations of cognitive states from the perspective of brain connectivity and give an overview of achievements related to cognitive states to date, especially within the past ten years. The discussions and future prospects are stated at the end of the chapter.


Trace mappings on quasi Banach modulation spaces and applications to pseudo differential operators of amplitude type. We deduce trace properties for modulation spaces of Gelfand Shilov distributions. We use these properties to show that pseudo differential operators with amplitudes in suitable modulation spaces, agree with pseudo differential operators of normal type whose symbols belong to (other) modulation spaces.


A framework of constructing placement delivery arrays for centralized coded caching. In caching system, it is desirable to design a coded caching scheme with the transmission load R and subpacketization F as small as possible, in order to improve efficiency of transmission in the peak traffic times and to decrease implementation complexity. Yan et al. reformulated the centralized coded caching scheme as designing a corresponding F times K array called placement delivery array (PDA), where F is the subpacketization and K is the number of users. Motivated by several constructions of PDAs, we introduce a framework for constructing PDAs, where each row is indexed by a row vector of some matrix called row index matrix and each column's index is labelled by an element of a direct product set. Using this framework, a new scheme is obtained, which can be regarded as a generalization of some previously known schemes. When K is equal to m choose t q t for positive integers m , t with t m and q geq 2 , we show that the row index matrix must be an orthogonal array if all the users have the same memory size. Furthermore, the row index matrix must be a covering array if the coded gain is m choose t , which is the maximal coded gain under our framework. Consequently the lower bounds on the transmission load and subpacketization of the schemes are derived under our framework. Finally, using orthogonal arrays as the row index matrix, we obtain two more explicit classes of schemes which have significantly advantages on the subpacketization while the transmission load is equal or close to that of the schemes constructed by Shangguan et al. (IEEE Trans. Inf. Theory, 64, 5755 5766, 2018) for the same number of users and memory size.


Twisted Equivariant Tate K Theory. Starting with a mathbb C valued cocycle on the global quotient orbifold X G , we apply transgression techniques for 2 gerbes, as developed by Lupercio and Uribe, to construct a gerbe on the orbifold loop space mathcal L (X G) . This gives a loop based definition of twisted equivariant Tate K theory for finite groups that conforms to the definition that Luecke provides for compact, connected Lie groups. We relate our construction to Ganter's work on Moonshine and Huan's quasi elliptic cohomology.


Collisional gyrokinetic full f particle in cell simulations on open field lines with PICLS. Applying gyrokinetic simulations for theoretical turbulence and transport studies to the plasma edge and scrape off layer (SOL) presents significant challenges. To in particular account for steep density and temperature gradients in the SOL, the "full f" code PICLS was developed. PICLS is a gyrokinetic particle in cell (PIC) code and is based on an electrostatic model with a linearized field equation and uses kinetic electrons. In previously published results we were applying PICLS to the well studied 1D parallel transport problem during an edge localized mode (ELM) in the SOL without collisions. As an extension to this collision less case and in preparation for 3D simulations, in this work a collisional model will be introduced. The implemented Lenard Bernstein collision operator and its Langevin discretization will be shown. Conservation properties of the collision operator as well as a comparison of the collisional and non collisional case will be discussed.


Classifying Network Vendors at Internet Scale. In this paper, we develop a method to create a large, labeled dataset of visible network device vendors across the Internet by mapping network visible IP addresses to device vendors. We use Internet wide scanning, banner grabs of network visible devices across the IPv4 address space, and clustering techniques to assign labels to more than 160,000 devices. We subsequently probe these devices and use features extracted from the responses to train a classifier that can accurately classify device vendors. Finally, we demonstrate how this method can be used to understand broader trends across the Internet by predicting device vendors in traceroutes from CAIDA's Archipelago measurement system and subsequently examining vendor distributions across these traceroutes.


Equivariant diffusions on Principal bundles. Given a pair of second order diffusion operators, one on the total space of a principle bundle N and the other on the base space M , intertwined by the projection pi N to M , if the operator mathcal A on the base manifold has constant rank, we define a semi connection on the principal bundle which allows to split the diffusion operator mathcal B on the total space into the sum of the horizontal lift of mathcal A and the other vertical. This allow to conclude a disintegration theorem for the law of mathcal B . As an application, a decomposition of stochastic flow is given.


From English to Code Switching Transfer Learning with Strong Morphological Clues. Linguistic Code switching (CS) is still an understudied phenomenon in natural language processing. The NLP community has mostly focused on monolingual and multi lingual scenarios, but little attention has been given to CS in particular. This is partly because of the lack of resources and annotated data, despite its increasing occurrence in social media platforms. In this paper, we aim at adapting monolingual models to code switched text in various tasks. Specifically, we transfer English knowledge from a pre trained ELMo model to different code switched language pairs (i.e., Nepali English, Spanish English, and Hindi English) using the task of language identification. Our method, CS ELMo, is an extension of ELMo with a simple yet effective position aware attention mechanism inside its character convolutions. We show the effectiveness of this transfer learning step by outperforming multilingual BERT and homologous CS unaware ELMo models and establishing a new state of the art in CS tasks, such as NER and POS tagging. Our technique can be expanded to more English paired code switched languages, providing more resources to the CS community.


Stochastic Differential Equations with Discontinuous Diffusions. We study one dimensional stochastic differential equations of form dX t sigma(X t)dY t , where Y is a suitable H "older continuous driver such as the fractional Brownian motion B H with H frac12 . The innovative aspect of the present paper lies in the assumptions on diffusion coefficients sigma for which we assume very mild conditions. In particular, we allow sigma to have discontinuities, and as such our results can be applied to study equations with discontinuous diffusions.


A new elementary proof for M stationarity under MPCC GCQ for mathematical programs with complementarity constraints. It is known in the literature that local minimizers of mathematical programs with complementarity constraints (MPCCs) are so called M stationary points, if a weak MPCC tailored Guignard constraint qualification (called MPCC GCQ) holds. In this paper we present a new elementary proof for this result. Our proof is significantly simpler than existing proofs and does not rely on deeper technical theory such as calculus rules for limiting normal cones. A crucial ingredient is a proof of a (to the best of our knowledge previously open) conjecture, which was formulated in a Diploma thesis by Schinabeck.


Optimal portfolio choice with path dependent benchmarked labor income a mean field model. We consider the life cycle optimal portfolio choice problem faced by an agent receiving labor income and allocating her wealth to risky assets and a riskless bond subject to a borrowing constraint. In this paper, to reflect a realistic economic setting, we propose a model where the dynamics of the labor income has two main features. First, labor income adjust slowly to financial market shocks, a feature already considered in Biffis, E., Gozzi, F. and Prosdocimi, C. (2020) "Optimal portfolio choice with path dependent labor income the infinite horizon case". Second, the labor income y i of an agent i is benchmarked against the labor incomes of a population y n (y 1,y 2, ldots,y n) of n agents with comparable tasks and or ranks. This last feature has not been considered yet in the literature and is faced taking the limit when n to infty so that the problem falls into the family of optimal control of infinite dimensional McKean Vlasov Dynamics, which is a completely new and challenging research field. We study the problem in a simplified case where, adding a suitable new variable, we are able to find explicitly the solution of the associated HJB equation and find the optimal feedback controls.