Towards Empathic Deep Q Learning. As reinforcement learning (RL) scales to solve increasingly complex tasks, interest continues to grow in the fields of AI safety and machine ethics. As a contribution to these fields, this paper introduces an extension to Deep Q Networks (DQNs), called Empathic DQN, that is loosely inspired both by empathy and the golden rule ("Do unto others as you would have them do unto you"). Empathic DQN aims to help mitigate negative side effects to other agents resulting from myopic goal directed behavior. We assume a setting where a learning agent coexists with other independent agents (who receive unknown rewards), where some types of reward (e.g. negative rewards from physical harm) may generalize across agents. Empathic DQN combines the typical (self centered) value with the estimated value of other agents, by imagining (by its own standards) the value of it being in the other's situation (by considering constructed states where both agents are swapped). Proof of concept results in two gridworld environments highlight the approach's potential to decrease collateral harms. While extending Empathic DQN to complex environments is non trivial, we believe that this first step highlights the potential of bridge work between machine ethics and RL to contribute useful priors for norm abiding RL agents.


Very Deep VAEs Generalize Autoregressive Models and Can Outperform Them on Images. We present a hierarchical VAE that, for the first time, generates samples quickly while outperforming the PixelCNN in log likelihood on all natural image benchmarks. We begin by observing that, in theory, VAEs can actually represent autoregressive models, as well as faster, better models if they exist, when made sufficiently deep. Despite this, autoregressive models have historically outperformed VAEs in log likelihood. We test if insufficient depth explains why by scaling a VAE to greater stochastic depth than previously explored and evaluating it CIFAR 10, ImageNet, and FFHQ. In comparison to the PixelCNN, these very deep VAEs achieve higher likelihoods, use fewer parameters, generate samples thousands of times faster, and are more easily applied to high resolution images. Qualitative studies suggest this is because the VAE learns efficient hierarchical visual representations. We release our source code and models at https github.com openai vdvae.


Motional Sideband Asymmetry of a Nanoparticle Optically Levitated in Free Space. The hallmark of quantum physics is Planck's constant h , whose finite value entails the quantization that gave the theory its name. The finite value of h gives rise to inevitable zero point fluctuations even at vanishing temperature. The zero point fluctuation of mechanical motion becomes smaller with growing mass of an object, making it challenging to observe at macroscopic scales. Here, we transition a dielectric particle with a diameter of 136 nm from the classical realm to the regime where its zero point motion emerges as a sizeable contribution to its energy. To this end, we optically trap the particle at ambient temperature in ultrahigh vacuum and apply active feedback cooling to its center of mass motion. We measure an asymmetry between the Stokes and anti Stokes sidebands of photons scattered by the levitated particle, which is a signature of the particle's quantum ground state of motion.


Analyzing Neural Discourse Coherence Models. In this work, we systematically investigate how well current models of coherence can capture aspects of text implicated in discourse organisation. We devise two datasets of various linguistic alterations that undermine coherence and test model sensitivity to changes in syntax and semantics. We furthermore probe discourse embedding space and examine the knowledge that is encoded in representations of coherence. We hope this study shall provide further insight into how to frame the task and improve models of coherence assessment further. Finally, we make our datasets publicly available as a resource for researchers to use to test discourse coherence models.


Successive minimum spanning trees. In a complete graph K n with edge weights drawn independently from a uniform distribution U(0,1) (or alternatively an exponential distribution operatorname Exp (1) ), let T 1 be the MST (the spanning tree of minimum weight) and let T k be the MST after deletion of the edges of all previous trees T i , i k . We show that each tree's weight w(T k) converges in probability to a constant gamma k with 2k 2 sqrt k gamma k 2k 2 sqrt k , and we conjecture that gamma k 2k 1 o(1) . The problem is distinct from that of Frieze and Johansson (2018), finding k MSTs of combined minimum weight, and for k 2 ours has strictly larger cost. Our results also hold (and mostly are derived) in a multigraph model where edge weights for each vertex pair follow a Poisson process here we additionally have mathbb E(w(T k)) to gamma k . Thinking of an edge of weight w as arriving at time t n w , Kruskal's algorithm defines forests F k(t) , each initially empty and eventually equal to T k , with each arriving edge added to the first F k(t) where it does not create a cycle. Using tools of inhomogeneous random graphs we obtain structural results including that C 1(F k(t)) n , the fraction of vertices in the largest component of F k(t) , converges in probability to a function rho k(t) , uniformly for all t , and that a giant component appears in F k(t) at a time t sigma k . We conjecture that the functions rho k tend to time translations of a single function, rho k(2k x) to rho infty(x) as k to infty , uniformly in x in mathbb R . Simulations and numerical computations give estimated values of gamma k for small k , and support the conjectures just stated.


Ready, set, Go! Data race detection and the Go language. Data races are often discussed in the context of lock acquisition and release, with race detection algorithms routinely relying on vector clocks as a means of capturing the relative ordering of events from different threads. In this paper, we present a data race detector for a language with channel communication as its sole synchronization primitive, and provide a semantics directly tied to the happens before relation, thus forging the notion of vector clocks.


First order hyperbolic approach for Anisotropic Diffusion equation. In this paper, we present a high order finite difference solver for anisotropic diffusion problems based on the first order hyperbolic system method. In particular, we demonstrate that the construction of a uniformly accurate fifth order scheme that is independent of the degree of anisotropy is made straightforward by the hyperbolic method with an optimal length scale. We demonstrate that the gradients are computed simultaneously to the same order of accuracy as that of the solution variable by using weight compact finite difference schemes. Furthermore, the approach is extended to improve further the simulation of the magnetized electrons test case previously discussed in Refs. J. Comput. Phys., 284 (2015) 59 69 and 374 (2018) 1120 1151 . Numerical results indicate that these schemes are capable of delivering high accuracy and the proposed approach is expected to allow the hyperbolic method to be successfully applied to a wide variety of linear and nonlinear problems with anisotropic diffusion.


Quantifying consensus of rankings based on q support patterns. Rankings, representing preferences over a set of candidates, are widely used in many information systems, e.g., group decision making and information retrieval. It is of great importance to evaluate the consensus of the obtained rankings from multiple agents. An overall measure of the consensus degree provides an insight into the ranking data. Moreover, it could provide a quantitative indicator for consensus comparison between groups and further improvement of a ranking system. Existing studies are insufficient in assessing the overall consensus of a ranking set. They did not provide an evaluation of the consensus degree of preference patterns in most rankings. In this paper, a novel consensus quantifying approach, without the need for any correlation or distance functions as in existing studies of consensus, is proposed based on a concept of q support patterns of rankings. The q support patterns represent the commonality embedded in a set of rankings. A method for detecting outliers in a set of rankings is naturally derived from the proposed consensus quantifying approach. Experimental studies are conducted to demonstrate the effectiveness of the proposed approach.


Corpora Evaluation and System Bias Detection in Multi document Summarization. Multi document summarization (MDS) is the task of reflecting key points from any set of documents into a concise text paragraph. In the past, it has been used to aggregate news, tweets, product reviews, etc. from various sources. Owing to no standard definition of the task, we encounter a plethora of datasets with varying levels of overlap and conflict between participating documents. There is also no standard regarding what constitutes summary information in MDS. Adding to the challenge is the fact that new systems report results on a set of chosen datasets, which might not correlate with their performance on the other datasets. In this paper, we study this heterogeneous task with the help of a few widely used MDS corpora and a suite of state of the art models. We make an attempt to quantify the quality of summarization corpus and prescribe a list of points to consider while proposing a new MDS corpus. Next, we analyze the reason behind the absence of an MDS system which achieves superior performance across all corpora. We then observe the extent to which system metrics are influenced, and bias is propagated due to corpus properties. The scripts to reproduce the experiments in this work are available at https github.com LCS2 IIITD summarization bias.git.


Roof GAN Learning to Generate Roof Geometry and Relations for Residential Houses. This paper presents Roof GAN, a novel generative adversarial network that generates structured geometry of residential roof structures as a set of roof primitives and their relationships. Given the number of primitives, the generator produces a structured roof model as a graph, which consists of 1) primitive geometry as raster images at each node, encoding facet segmentation and angles 2) inter primitive colinear coplanar relationships at each edge and 3) primitive geometry in a vector format at each node, generated by a novel differentiable vectorizer while enforcing the relationships. The discriminator is trained to assess the primitive raster geometry, the primitive relationships, and the primitive vector geometry in a fully end to end architecture. Qualitative and quantitative evaluations demonstrate the effectiveness of our approach in generating diverse and realistic roof models over the competing methods with a novel metric proposed in this paper for the task of structured geometry generation. Code and data are available at https github.com yi ming qian roofgan .


Deep Reinforcement Learning for Task Offloading in Mobile Edge Computing Systems. In mobile edge computing systems, an edge node may have a high load when a large number of mobile devices offload their tasks to it. Those offloaded tasks may experience large processing delay or even be dropped when their deadlines expire. Due to the uncertain load dynamics at the edge nodes, it is challenging for each device to determine its offloading decision (i.e., whether to offload or not, and which edge node it should offload its task to) in a decentralized manner. In this work, we consider non divisible and delay sensitive tasks as well as edge load dynamics, and formulate a task offloading problem to minimize the expected long term cost. We propose a model free deep reinforcement learning based distributed algorithm, where each device can determine its offloading decision without knowing the task models and offloading decision of other devices. To improve the estimation of the long term cost in the algorithm, we incorporate the long short term memory (LSTM), dueling deep Q network (DQN), and double DQN techniques. Simulation results with 50 mobile devices and five edge nodes show that the proposed algorithm can reduce the ratio of dropped tasks and average task delay by 86.4 95.4 and 18.0 30.1 , respectively, when compared with several existing algorithms.


Towards a consensus on rheological models for shear waves in soft tissues. A rising wave of technologies and instruments are enabling more labs and clinics to make a variety of measurements related to tissue viscoelastic properties. These instruments include elastography imaging scanners, rheological shear viscometers, and a variety of calibrated stress strain analyzers. From these many sources of disparate data, a common step in analyzing results is to fit the measurements of tissue response to some viscoelastic model. In the best scenario, this places the measurements within a theoretical framework and enables meaningful comparisons of the parameters against other types of tissues. However, there is a large set of established rheological models, even within the class of linear, causal, viscoelastic solid models, so which of these should be chosen? Is it simply a matter of best fit to a minimum mean squared error of the model to several data points? We argue that the long history of biomechanics, including the concept of the extended relaxation spectrum, along with data collected from viscoelastic soft tissues over an extended range of times and frequencies, and the theoretical framework of multiple relaxation models which model the multi scale nature of physical tissues, all lead to the conclusion that fractional derivative models represent the most succinct and meaningful models of soft tissue viscoelastic behavior. These arguments are presented with the goal of clarifying some distinctions between, and consequences of, some of the most commonly used models, and with the longer term goal of reaching a consensus among different sub fields in acoustics, biomechanics, and elastography that have common interests in comparing tissue measurements.


Busemann functions and semi infinite O'Connell Yor polymers. We prove that given any fixed asymptotic velocity, the finite length O'Connell Yor polymer has an infinite length limit satisfying the law of large numbers with this velocity. By a Markovian property of the quenched polymer this reduces to showing the existence of Busemann functions almost sure limits of ratios of random point to point partition functions. The key ingredients are the Burke property of the O'Connell Yor polymer and a comparison lemma for the ratios of partition functions. We also show the existence of infinite length limits in the Brownian last passage percolation model.


Molweni A Challenge Multiparty Dialogues based Machine Reading Comprehension Dataset with Discourse Structure. Research into the area of multiparty dialog has grown considerably over recent years. We present the Molweni dataset, a machine reading comprehension (MRC) dataset with discourse structure built over multiparty dialog. Molweni's source samples from the Ubuntu Chat Corpus, including 10,000 dialogs comprising 88,303 utterances. We annotate 30,066 questions on this corpus, including both answerable and unanswerable questions. Molweni also uniquely contributes discourse dependency annotations in a modified Segmented Discourse Representation Theory (SDRT Asher et al., 2016) style for all of its multiparty dialogs, contributing large scale (78,245 annotated discourse relations) data to bear on the task of multiparty dialog discourse parsing. Our experiments show that Molweni is a challenging dataset for current MRC models BERT wwm, a current, strong SQuAD 2.0 performer, achieves only 67.7 F1 on Molweni's questions, a 20 significant drop as compared against its SQuAD 2.0 performance.


New entanglement assisted quantum MDS codes with length n frac q 2 1 5 . The entanglement assisted stabilizer formalism can transform arbitrary classical linear codes into entanglement assisted quantum error correcting codes (EAQECCs). In this work, we construct some new entanglement assisted quantum MDS (EAQMDS) codes with length n frac q 2 1 5 from cyclic codes. Compared with all the previously known parameters with the same length, all of them have flexible parameters and larger minimum distance.


Approximating Pointwise Products of Quasimodes. We obtain approximation bounds for products of quasimodes for the Laplace Beltrami operator, on compact Riemannian manifolds of all dimensions without boundary. We approximate the products of quasimodes uv by a low degree vector space B n , and we prove that the size of the space dim(B n ) is small. In our paper, we first study bilinear quasimode estimates of all dimensions d 2, 3 , d 4,5 and d ge 6 , respectively, to make the highest frequency disappear from the right hand. Furthermore, the result of the case lambda mu of bilinear quasimode estimates improves L 4 quasimodes estimates of Sogge Zelditch in cite sogge6 when d ge 8 . And on this basis, we give approximation bounds in H 1 norm. We also prove approximation bounds for the products of quasimodes in L 2 norm using the results of L p estimates for quasimodes in cite sogge3 . We extend the results of Lu Steinerberger in cite lu to quasimodes.


differint A Python Package for Numerical Fractional Calculus. Fractional calculus has become widely studied and applied to physical problems in recent years. As a result, many methods for the numerical computation of fractional derivatives and integrals have been defined. However, these algorithms are often programmed in an ad hoc manner, requiring researchers to implement and debug their own code. This work introduces the textit differint software package, which offers a single repository for multiple numerical algorithms for the computation of fractional derivatives and integrals. This package is coded in the open source Python programming language. The Gr "unwald Letnikov, improved Gr "unwald Letnikov, and Riemann Liouville algorithms from the fractional calculus are included in this package. The algorithms presented are computed from their descriptions found in 2 . This work concludes with suggestions for the application of the textit differint software package.


Report on the finiteness of silting objects. We discuss the finiteness of (two term) silting objects. First, we investigate new triangulated categories without silting object. Second, one studies two classes of tau tilting finite algebras and give the numbers of their two term silting objects. Finally, we explore when tau tilting finiteness implies representatoin finiteness, and obtain several classes of algebras in which a tau tilting finite algebra is representation finite.


On girth and the parameterized complexity of token sliding and token jumping. In the Token Jumping problem we are given a graph G (V,E) and two independent sets S and T of G , each of size k geq 1 . The goal is to determine whether there exists a sequence of k sized independent sets in G , langle S 0, S 1, ldots, S ell rangle , such that for every i , S i k , S i is an independent set, S S 0 , S ell T , and S i Delta S i 1 2 . In other words, if we view each independent set as a collection of tokens placed on a subset of the vertices of G , then the problem asks for a sequence of independent sets which transforms S to T by individual token jumps which maintain the independence of the sets. This problem is known to be PSPACE complete on very restricted graph classes, e.g., planar bounded degree graphs and graphs of bounded bandwidth. A closely related problem is the Token Sliding problem, where instead of allowing a token to jump to any vertex of the graph we instead require that a token slides along an edge of the graph. Token Sliding is also known to be PSPACE complete on the aforementioned graph classes. We investigate the parameterized complexity of both problems on several graph classes, focusing on the effect of excluding certain cycles from the input graph. In particular, we show that both Token Sliding and Token Jumping are fixed parameter tractable on C 4 free bipartite graphs when parameterized by k . For Token Jumping, we in fact show that the problem admits a polynomial kernel on C 3,C 4 free graphs. In the case of Token Sliding, we also show that the problem admits a polynomial kernel on bipartite graphs of bounded degree. We believe both of these results to be of independent interest. We complement these positive results by showing that, for any constant p geq 4 , both problems are W 1 hard on C 4, dots, C p free graphs and Token Sliding remains W 1 hard even on bipartite graphs.


2 generation of simple Lie algebras and free dense subgroups of algebraic groups. We construct generating pairs of simple Lie algebras in characteristic zero. We apply this construction to exhibit infinite series of 2 generator Zariski dense subgroups that are free of rank 2 of the simple algebraic groups SL(n, C), Sp(n, C), G 2(C).


Dynamics of compact quantum metric spaces. We provide a detailed study of actions of the integers on compact quantum metric spaces, which includes general criteria ensuring that the associated crossed product algebra is again a compact quantum metric space in a natural way. We moreover provide a flexible set of assumptions ensuring that a continuous family of automorphisms of a compact quantum metric space, yields a field of crossed product algebras which varies continuously in Rieffel's quantum Gromov Hausdorff distance. Lastly we show how our results apply to continuous families of Lip isometric actions on compact quantum metric spaces and to families of diffeomorphisms of compact Riemannian manifolds which vary continuously in the Whitney C 1 topology.


Using VERA to explain the impact of social distancing on the spread of COVID 19. COVID 19 continues to spread across the country and around the world. Current strategies for managing the spread of COVID 19 include social distancing. We present VERA, an interactive AI tool, that first enables users to specify conceptual models of the impact of social distancing on the spread of COVID 19. Then, VERA automatically spawns agent based simulations from the conceptual models, and, given a data set, automatically fills in the values of the simulation parameters from the data. Next, the user can view the simulation results, and, if needed, revise the simulation parameters and run another experimental trial, or build an alternative conceptual model. We describe the use VERA to develop a SIR model for the spread of COVID 19 and its relationship with healthcare capacity.


A Generalized Robotic Handwriting Learning System based on Dynamic Movement Primitives (DMPs). Learning from demonstration (LfD) is a powerful learning method to enable a robot to infer how to perform a task given one or more human demonstrations of the desired task. By learning from end user demonstration rather than requiring that a domain expert manually programming each skill, robots can more readily be applied to a wider range of real world applications. Writing robots, as one application of LfD, has become a challenging research topic due to the complexity of human handwriting trajectories. In this paper, we introduce a generalized handwriting learning system for a physical robot to learn from examples of humans' handwriting to draw alphanumeric characters. Our robotic system is able to rewrite letters imitating the way human demonstrators write and create new letters in a similar writing style. For this system, we develop an augmented dynamic movement primitive (DMP) algorithm, DMP , which strengthens the robustness and generalization ability of our robotic system.


Polynomial relations between operators on chains of representation rings. Given a chain of groups G 0 le G 1 le G 2 ... , we may form the corresponding chain of their representation rings, together with induction and restriction operators. We may let textrm Res l denote the operator which restricts down l steps, and similarly for textrm Ind l . Observe then that textrm Ind l textrm Res l is an operator from any particular representation ring to itself. The central question that this paper addresses is "What happens if the textrm Ind l textrm Res l operator is a polynomial in the textrm Ind textrm Res operator?". We show that chains of wreath products H n rtimes S n n in mathbb N have this property, and in particular, the polynomials that appear in the case of symmetric groups are the falling factorial polynomials. An application of this fact gives a remarkable new way to compute characters of wreath products (in particular symmetric groups) using matrix multiplication. We then consider arbitrary chains of groups, and find very rigid constraints that such a chain must satisfy in order for textrm Ind l textrm Res l to be a polynomial in textrm Ind textrm Res . Our rigid constraints justify the intuition that this property is indeed a very rare and special property.


Temporal Self Attention Network for Medical Concept Embedding. In longitudinal electronic health records (EHRs), the event records of a patient are distributed over a long period of time and the temporal relations between the events reflect sufficient domain knowledge to benefit prediction tasks such as the rate of inpatient mortality. Medical concept embedding as a feature extraction method that transforms a set of medical concepts with a specific time stamp into a vector, which will be fed into a supervised learning algorithm. The quality of the embedding significantly determines the learning performance over the medical data. In this paper, we propose a medical concept embedding method based on applying a self attention mechanism to represent each medical concept. We propose a novel attention mechanism which captures the contextual information and temporal relationships between medical concepts. A light weight neural net, "Temporal Self Attention Network (TeSAN)", is then proposed to learn medical concept embedding based solely on the proposed attention mechanism. To test the effectiveness of our proposed methods, we have conducted clustering and prediction tasks on two public EHRs datasets comparing TeSAN against five state of the art embedding methods. The experimental results demonstrate that the proposed TeSAN model is superior to all the compared methods. To the best of our knowledge, this work is the first to exploit temporal self attentive relations between medical events.


Comparing the isomorphism types of equivalence structures and preorders. A general theme of computable structure theory is to investigate when structures have copies of a given complexity Gamma . We discuss such problem for the case of equivalence structures and preorders. We show that there is a Pi 0 1 equivalence structure with no Sigma 0 1 copy, and in fact that the isomorphism types realized by the Pi 0 1 equivalence structures coincide with those realized by the Delta 0 2 equivalence structures. We also construct a Sigma 0 1 preorder with no Pi 0 1 copy.


A Survey on Software Defined Networking Architecture for Next Generation Network. The evolution of software defined networking (SDN) has played a significant role in the development of next generation networks (NGN). SDN as a programmable network having service provisioning on the fly has induced a keen interest both in academic world and industry. In this article, a comprehensive survey is presented on SDN advancement over conventional network. The paper covers historical evolution in relation to SDN, functional architecture of the SDN and its related technologies, and OpenFlow standards protocols, including the basic concept of interfacing of OpenFlow with network elements (NEs) such as optical switches. In addition a selective architecture survey has been conducted. Our proposed architecture on software defined heterogeneous network, points towards new technology enabling the opening of new vistas in the domain of network technology, which will facilitate in handling of huge internet traffic and helps infrastructure and service providers to customize their resources dynamically. Besides, current research projects and various activities as being carried out to standardize SDN as NGN by different standard development organizations (SODs) have been duly elaborated to judge how this technology moves towards standardization.


Effects Without Monads Non determinism Back to the Meta Language. We reflect on programming with complicated effects, recalling an undeservingly forgotten alternative to monadic programming and checking to see how well it can actually work in modern functional languages. We adopt and argue the position of factoring an effectful program into a first order effectful DSL with a rich, higher order 'macro' system. Not all programs can be thus factored. Although the approach is not general purpose, it does admit interesting programs. The effectful DSL is likewise rather problem specific and lacks general purpose monadic composition, or even functions. On the upside, it expresses the problem elegantly, is simple to implement and reason about, and lends itself to non standard interpretations such as code generation (compilation) and abstract interpretation. A specialized DSL is liable to be frequently extended the experience with the tagless final style of DSL embedding shown that the DSL evolution can be made painless, with the maximum code reuse. We illustrate the argument on a simple but representative example of a rather complicated effect non determinism, including committed choice. Unexpectedly, it turns out we can write interesting non deterministic programs in an ML like language just as naturally and elegantly as in the functional logic language Curry and not only run them but also statically analyze, optimize and compile. The richness of the Meta Language does, in reality, compensate for the simplicity of the effectful DSL. The key idea goes back to the origins of ML as the Meta Language for the Edinburgh LCF theorem prover. Instead of using ML to build theorems, we now build (DSL) programs.


Reusing Preconditioners in Projection based Model Order Reduction Algorithms. Dynamical systems are pervasive in almost all engineering and scientific applications. Simulating such systems is computationally very intensive. Hence, Model Order Reduction (MOR) is used to reduce them to a lower dimension. Most of the MOR algorithms require solving large sparse sequences of linear systems. Since using direct methods for solving such systems does not scale well in time with respect to the increase in the input dimension, efficient preconditioned iterative methods are commonly used. In one of our previous works, we have shown substantial improvements by reusing preconditioners for the parametric MOR (Singh et al. 2019). Here, we had proposed techniques for both, the non parametric and the parametric cases, but had applied them only to the latter. We have four main contributions here. First, we demonstrate that preconditioners can be reused more effectively in the non parametric case as compared to the parametric one because of the lack of parameters in the former. Second, we show that reusing preconditioners is an art and it needs to be fine tuned for the underlying MOR algorithm. Third, we describe the pitfalls in the algorithmic implementation of reusing preconditioners. Fourth, and final, we demonstrate this theory on a real life industrial problem (of size 1.2 million), where savings of upto 64 in the total computation time is obtained by reusing preconditioners. In absolute terms, this leads to a saving of 5 days.


Metastability of a random walk with catastrophes. We consider a random walk with catastrophes which was introduced to model population biology. It is known that this Markov chain gets eventually absorbed at 0 for all parameter values. Recently, it has been shown that this chain exhibits a metastable behavior in the sense that it can persist for a very long time before getting absorbed. In this paper we study this metastable phase by making the parameters converge to extreme values. We obtain four different limits that we believe shed light on the metastable phase.


A spectral scaling based extension to the attached eddy model of wall turbulence. Two dimensional (2 D) spectra of the streamwise velocity component, measured at friction Reynolds numbers ranging from 2400 to 26000, are used to refine a model for the logarithmic region of turbulent boundary layers. Here, we focus on the attached eddy model (AEM). The conventional AEM assumes the boundary layer to be populated with hierarchies of self similar wall attached ( Type ,A ) eddies alone. While Type ,A eddies represent the dominant energetic large scale motions at high Reynolds numbers, the scales that are not represented by such eddies are observed to carry a significant proportion of the total kinetic energy. Therefore, in the present study, we propose an extended AEM that incorporates two additional representative eddies. These eddies, named Type ,C A and Type ,SS , represent the self similar but wall incoherent low Reynolds number features, and the non self similar wall coherent superstructures, respectively. The extended AEM is shown to better predict a greater range of energetic length scales and capture the low and high Reynolds number scaling trends in the 2 D spectra of all three velocity components. A discussion on spectral self similarity and the associated k 1 scaling law is also presented.


Seq2Mol Automatic design of de novo molecules conditioned by the target protein sequences through deep neural networks. De novo design of molecules has recently enjoyed the power of generative deep neural networks. Current approaches aim to generate molecules either resembling the properties of the molecules of the training set or molecules that are optimized with respect to specific physicochemical properties. None of the methods generates molecules specific to a target protein. In the approach presented here, we introduce a method which is conditioned on the protein target sequence to generate de novo molecules that are relevant to the target. We use an implementation adapted from Google's "Show and Tell" image caption generation method, to generate SMILES strings of molecules from protein sequence embeddings generated by a deep bi directional language model ELMo. ELMo is used to generate contextualized embedding vectors of the protein sequence. Using reinforcement learning, the trained model is further optimized through augmented episodic likelihood to increase the diversity of the generated compounds compared to the training set. We used the model to generate compounds for two major drug target families, i.e. for GPCRs and Tyrosine Kinase targets. The model generated compounds which are structurally different form the training set, while also being more similar to compounds known to bind to the two families of drug targets compared to a random set of molecules. The compounds further display reasonable synthesizability and drug likeness scores.


Dual Univariate Interpolatory Subdivision of Every Arity Algebraic Characterization and Construction. A new class of univariate stationary interpolatory subdivision schemes of dual type is presented. As opposed to classical primal interpolatory schemes, these new schemes have masks with an even number of elements and are not step wise interpolants. A complete algebraic characterization, which covers every arity, is given in terms of identities of trigonometric polynomials associated to the schemes. This characterization is based on a necessary condition for refinable functions to have prescribed values at the nodes of a uniform lattice, as a consequence of the Poisson summation formula. A strategy for the construction is then showed, alongside meaningful examples for applications that have comparable or even superior properties, in terms of regularity, length of the support and or polynomial reproduction, with respect to the primal counterparts.


Graph Embedding on Biomedical Networks Methods, Applications, and Evaluations. Graph embedding learning that aims to automatically learn low dimensional node representations, has drawn increasing attention in recent years. To date, most recent graph embedding methods are evaluated on social and information networks and are not comprehensively studied on biomedical networks under systematic experiments and analyses. On the other hand, for a variety of biomedical network analysis tasks, traditional techniques such as matrix factorization (which can be seen as a type of graph embedding methods) have shown promising results, and hence there is a need to systematically evaluate the more recent graph embedding methods (e.g. random walk based and neural network based) in terms of their usability and potential to further the state of the art. We select 11 representative graph embedding methods and conduct a systematic comparison on 3 important biomedical link prediction tasks drug disease association (DDA) prediction, drug drug interaction (DDI) prediction, protein protein interaction (PPI) prediction and 2 node classification tasks medical term semantic type classification, protein function prediction. Our experimental results demonstrate that the recent graph embedding methods achieve promising results and deserve more attention in the future biomedical graph analysis. Compared with three state of the art methods for DDAs, DDIs and protein function predictions, the recent graph embedding methods achieve competitive performance without using any biological features and the learned embeddings can be treated as complementary representations for the biological features. By summarizing the experimental results, we provide general guidelines for properly selecting graph embedding methods and setting their hyper parameters for different biomedical tasks.


Discrete Optimization for Unsupervised Sentence Summarization with Word Level Extraction. Automatic sentence summarization produces a shorter version of a sentence, while preserving its most important information. A good summary is characterized by language fluency and high information overlap with the source sentence. We model these two aspects in an unsupervised objective function, consisting of language modeling and semantic similarity metrics. We search for a high scoring summary by discrete optimization. Our proposed method achieves a new state of the art for unsupervised sentence summarization according to ROUGE scores. Additionally, we demonstrate that the commonly reported ROUGE F1 metric is sensitive to summary length. Since this is unwillingly exploited in recent work, we emphasize that future evaluation should explicitly group summarization systems by output length brackets.


Common Cell type Nomenclature for the mammalian brain A systematic, extensible convention. The advancement of single cell RNA sequencing technologies has led to an explosion of cell type definitions across multiple organs and organisms. While standards for data and metadata intake are arising, organization of cell types has largely been left to individual investigators, resulting in widely varying nomenclature and limited alignment between taxonomies. To facilitate cross dataset comparison, the Allen Institute created the Common Cell type Nomenclature (CCN) for matching and tracking cell types across studies that is qualitatively similar to gene transcript management across different genome builds. The CCN can be readily applied to new or established taxonomies and was applied herein to diverse cell type datasets derived from multiple quantifiable modalities. The CCN facilitates assigning accurate yet flexible cell type names in the mammalian cortex as a step towards community wide efforts to organize multi source, data driven information related to cell type taxonomies from any organism.


Orchestrating the Development Lifecycle of Machine Learning Based IoT Applications A Taxonomy and Survey. Machine Learning (ML) and Internet of Things (IoT) are complementary advances ML techniques unlock complete potentials of IoT with intelligence, and IoT applications increasingly feed data collected by sensors into ML models, thereby employing results to improve their business processes and services. Hence, orchestrating ML pipelines that encompasses model training and implication involved in holistic development lifecycle of an IoT application often leads to complex system integration. This paper provides a comprehensive and systematic survey on the development lifecycle of ML based IoT application. We outline core roadmap and taxonomy, and subsequently assess and compare existing standard techniques used in individual stage.


Vindication, Virtue and Vitriol A study of online engagement and abuse toward British MPs during the COVID 19 Pandemic. COVID 19 has given rise to malicious content online, including online abuse and hate toward British MPs. In order to understand and contextualise the level of abuse MPs receive, we consider how ministers use social media to communicate about the crisis, and the citizen engagement that this generates. The focus of the paper is on a large scale, mixed methods study of abusive and antagonistic responses to UK politicians during the pandemic from early February to late May 2020. We find that pressing subjects such as financial concerns attract high levels of engagement, but not necessarily abusive dialogue. Rather, criticising authorities appears to attract higher levels of abuse. In particular, those who carry the flame for subjects like racism and inequality, may be accused of virtue signalling or receive higher abuse levels due to the topics they are required by their role to address. This work contributes to the wider understanding of abusive language online, in particular that which is directed at public officials.


Stochastic Potential Games. Computing the Nash equilibrium (NE) for N player non zerosum stochastic games is a formidable challenge. Currently, algorithmic methods in stochastic game theory are unable to compute NE for stochastic games (SGs) for settings in all but extreme cases in which the players either play as a team or have diametrically opposed objectives in a two player setting. This greatly impedes the application of the SG framework to numerous problems within economics and practical systems of interest. In this paper, we provide a method of computing Nash equilibria in nonzero sum settings and for populations of players more than two. In particular, we identify a subset of SGs known as stochastic potential games (SPGs) for which the (Markov perfect) Nash equilibrium can be computed tractably and in polynomial time. Unlike SGs for which, in general, computing the NE is PSPACE hard, we show that SGs with the potential property are P Complete. We further demonstrate that for each SPG there is a dual Markov decision process whose solution coincides with the MP NE of the SPG. We lastly provide algorithms that tractably compute the MP NE for SGs with more than two players.


Cloud Deployment Tradeoffs for the Analysis of Spatially Distributed Systems of Internet of Things. Internet enabled things and devices operating in the physical world are increasingly integrated in modern distributed systems, supporting functionalities that require assurances that certain critical requirements are satisfied by the overall system. We focus here on spatially distributed Internet of Things systems such as smart environments, where the dynamics of spatial distribution of entities in the system is crucial to requirements satisfaction. Analysis techniques need to be in place while systems operate to ensure that requirements are fulfilled. This may be achieved by keeping a model of the system at runtime, monitoring events that lead to changes in the spatial environment, and performing analysis. This computationally intensive runtime assurance method cannot be supported by resource constrained devices that populate the space and must be offloaded to the cloud. However, challenges arise regarding resource allocation and cost, especially when the workload is unknown at the system's design time. As such, it may be difficult or even impossible to guarantee application service level agreements, e.g., on response times. To this end, we instantiate spatial verification processes, integrating them to the service layer of an IoT cloud architecture based on microservices. We propose several cloud deployments for such an architecture for assurance of spatial requirements based on virtual machines, containers, and the recent Functions as a Service paradigm. Then, we assess deployments' tradeoffs in terms of elasticity, performance and cost by using a workload scenario from a known dataset of taxis roaming in Beijing. We argue that the approach can be replicated in the design process of similar kinds of spatially distributed Internet of Things systems.


ConfNet2Seq Full Length Answer Generation from Spoken Questions. Conversational and task oriented dialogue systems aim to interact with the user using natural responses through multi modal interfaces, such as text or speech. These desired responses are in the form of full length natural answers generated over facts retrieved from a knowledge source. While the task of generating natural answers to questions from an answer span has been widely studied, there has been little research on natural sentence generation over spoken content. We propose a novel system to generate full length natural language answers from spoken questions and factoid answers. The spoken sequence is compactly represented as a confusion network extracted from a pre trained Automatic Speech Recognizer. This is the first attempt towards generating full length natural answers from a graph input(confusion network) to the best of our knowledge. We release a large scale dataset of 259,788 samples of spoken questions, their factoid answers and corresponding full length textual answers. Following our proposed approach, we achieve comparable performance with best ASR hypothesis.


Early indications of anomalous behavior in the 2019 spring ozone hole over Antarctica. The level of quasi stationary planetary wave (QSW) activity in the Antarctic winter stratosphere provides insights into the likely behavior of the ozone hole in the following spring months. Observation of an anomalously large amplitude of the QSW in winter stratospheric temperatures is an indicator that strong disturbances to the polar vortex are likely to occur, and may lead to large reductions in both the area of the Antarctic ozone hole area and the overall amount of stratospheric ozone that is depleted. In the sudden stratospheric warming (SSW) preconditions in 2019, the maximum QSW amplitude over Antarctica in August was approximately 12 K, which was only 2 K less than conditions prior to the unprecedented major Antarctic SSW in 2002. Under these conditions, the Antarctic SSW in 2019 has the potential to become a major SSW. The additional factors disturbing the Antarctic stratosphere in 2019 was anomalously warm sea surface temperatures (SSTs) in the central tropical Pacific Ocean and western Indian Ocean, and the descending easterly phase of the Quasi Biennial Oscillation. The combination of these factors the large amplitude of the QSW, the warm tropical SSTs and transitioning phase of the QBO has the potential to cause the early disruption of the ozone hole and reduce the overall level of ozone depletion in 2019, and may also have important regional consequences for weather conditions in the Southern Hemisphere.


How Do You Want Your Greedy Simultaneous or Repeated?. We present SimultaneousGreedys, a deterministic algorithm for constrained submodular maximization. At a high level, the algorithm maintains ell solutions and greedily updates them in a simultaneous fashion. SimultaneousGreedys achieves the tightest known approximation guarantees for both k extendible systems and the more general k systems, which are (k 1) 2 k k mathcal O (1) and (1 sqrt k 2 ) 2 k mathcal O ( sqrt k ) , respectively. This is in contrast to previous algorithms, which are designed to provide tight approximation guarantees in one setting, but not both. We also improve the analysis of RepeatedGreedy, showing that it achieves an approximation ratio of k mathcal O ( sqrt k ) for k systems when allowed to run for mathcal O ( sqrt k ) iterations, an improvement in both the runtime and approximation over previous analyses. We demonstrate that both algorithms may be modified to run in nearly linear time with an arbitrarily small loss in the approximation. Both SimultaneousGreedys and RepeatedGreedy are flexible enough to incorporate the intersection of m additional knapsack constraints, while retaining similar approximation guarantees both algorithms yield an approximation guarantee of roughly k 2m mathcal O ( sqrt k m ) for k systems and SimultaneousGreedys enjoys an improved approximation guarantee of k 2m mathcal O ( sqrt m ) for k extendible systems. To complement our algorithmic contributions, we provide a hardness result which states that no algorithm making polynomially many oracle queries can achieve an approximation better than k 1 2 varepsilon . We also present SubmodularGreedy.jl, a Julia package which implements these algorithms and may be downloaded at https github.com crharshaw SubmodularGreedy.jl . Finally, we test the effectiveness of these algorithms on real datasets.


Rates of metastability for iterations on the unit interval. We use techniques of proof mining to extract computable and uniform rates of metastability (in the sense of Tao) for iterations of continuous functions on the unit interval, firstly (following earlier work of Gaspar) out of convergence proofs due to Franks, Marzec, Rhoades and Hillam and then out of an argument due to Borwein and Borwein that pertains only to Lipschitz functions.


A4 Evading Learning based Adblockers. Efforts by online ad publishers to circumvent traditional ad blockers towards regaining fiduciary benefits, have been demonstrably successful. As a result, there have recently emerged a set of adblockers that apply machine learning instead of manually curated rules and have been shown to be more robust in blocking ads on websites including social media sites such as Facebook. Among these, AdGraph is arguably the state of the art learning based adblocker. In this paper, we develop A4, a tool that intelligently crafts adversarial samples of ads to evade AdGraph. Unlike the popular research on adversarial samples against images or videos that are considered less to un restricted, the samples that A4 generates preserve application semantics of the web page, or are actionable. Through several experiments we show that A4 can bypass AdGraph about 60 of the time, which surpasses the state of the art attack by a significant margin of 84.3 in addition, changes to the visual layout of the web page due to these perturbations are imperceptible. We envision the algorithmic framework proposed in A4 is also promising in improving adversarial attacks against other learning based web applications with similar requirements.


Iwasawa Theory of Hilbert modular forms for anticyclotomic extension. Following Bertolini and Darmon's method, with "Ihara's lemma" among other conditions Longo and Wang proved one divisibility of Iwasawa main conjecture for Hilbert modular forms of weight 2 and general low parallel weight respectively. In this paper, we remove the "Ihara's lemma" condition in their results.


On the termination of flips for log canonical generalized pairs. We prove the termination of flips for 4 dimensional pseudo effective NQC log canonical generalized pairs. As main ingredients, we verify the termination of flips for 3 dimensional NQC log canonical generalized pairs, and show that the termination of flips for pseudo effective NQC log canonical generalized pairs which admit NQC weak Zariski decompositions follows from the termination of flips in lower dimensions.


Fraisse classes with simply characterized big Ramsey degrees. We formulate a property strengthening the Disjoint Amalgamation Property and prove that every Fraisse structure in a finite relational language with relation symbols of arity at most two having this property has finite big Ramsey degrees which have a simple characterization. It follows that any such Fraisse structure admits a big Ramsey structure. Furthermore, we prove indivisibility for every Fraisse structure in an arbitrary finite relational language satisfying this property. This work offers a streamlined and unifying approach to Ramsey theory on some seemingly disparate classes of Fraisse structures. Novelties include a new formulation of coding trees in terms of 1 types over initial segments of the Fraisse structure, and a direct characterization of the degrees without appeal to the standard method of "envelopes".


Explicit subconvexity savings for sup norms of cusp forms on mathrm PGL n( mathbb R) . Blomer and Maga recently proved that, if F is an L 2 normalized Hecke Maass cusp form for mathrm SL n( mathbb Z) , and Omega is a compact subset of mathrm PGL n( mathbb R) mathrm PO n( mathbb R) , then we have F Omega infty ll Omega lambda F n(n 1) 8 delta n for some delta n 0 , where lambda F is the Laplacian eigenvalue of F . In the present paper, we prove an explicit version of their result.


L p( mathbb R 2) boundedness of Hilbert Transforms and Maximal Functions along Plane Curves with Two variable Coefficients. In this paper, for general plane curves gamma satisfying some suitable smoothness and curvature conditions, we obtain the single annulus L p( mathbb R 2) boundedness of the Hilbert transforms H infty U, gamma along the variable plane curves (t,U(x 1, x 2) gamma(t)) and the L p( mathbb R 2) boundedness of the corresponding maximal functions M infty U, gamma , where p 2 and U is a measurable function. The range on p is sharp. Furthermore, for 1 p leq 2 , under the additional conditions that U is Lipschitz and making a varepsilon 0 truncation with gamma(2 varepsilon 0) leq 1 4 U textrm Lip , we also obtain similar boundedness for these two operators H varepsilon 0 U, gamma and M varepsilon 0 U, gamma .


Learning to design from humans Imitating human designers through deep learning. Humans as designers have quite versatile problem solving strategies. Computer agents on the other hand can access large scale computational resources to solve certain design problems. Hence, if agents can learn from human behavior, a synergetic human agent problem solving team can be created. This paper presents an approach to extract human design strategies and implicit rules, purely from historical human data, and use that for design generation. A two step framework that learns to imitate human design strategies from observation is proposed and implemented. This framework makes use of deep learning constructs to learn to generate designs without any explicit information about objective and performance metrics. The framework is designed to interact with the problem through a visual interface as humans did when solving the problem. It is trained to imitate a set of human designers by observing their design state sequences without inducing problem specific modelling bias or extra information about the problem. Furthermore, an end to end agent is developed that uses this deep learning framework as its core in conjunction with image processing to map pixel to design moves as a mechanism to generate designs. Finally, the designs generated by a computational team of these agents are then compared to actual human data for teams solving a truss design problem. Results demonstrates that these agents are able to create feasible and efficient truss designs without guidance, showing that this methodology allows agents to learn effective design strategies.


Automatic transformation of irreducible representations for efficient contraction of tensors with cyclic group symmetry. Tensor contractions are ubiquitous in computational chemistry and physics, where tensors generally represent states or operators and contractions express the algebra of these quantities. In this context, the states and operators often preserve physical conservation laws, which are manifested as group symmetries in the tensors. These group symmetries imply that each tensor has block sparsity and can be stored in a reduced form. For nontrivial contractions, the memory footprint and cost are lowered, respectively, by a linear and a quadratic factor in the number of symmetry sectors. State of the art tensor contraction software libraries exploit this opportunity by iterating over blocks or using general block sparse tensor representations. Both approaches entail overhead in performance and code complexity. With intuition aided by tensor diagrams, we present a technique, irreducible representation alignment, which enables efficient handling of Abelian group symmetries via only dense tensors, by using contraction specific reduced forms. This technique yields a general algorithm for arbitrary group symmetric contractions, which we implement in Python and apply to a variety of representative contractions from quantum chemistry and tensor network methods. As a consequence of relying on only dense tensor contractions, we can easily make use of efficient batched matrix multiplication via Intel's MKL and distributed tensor contraction via the Cyclops library, achieving good efficiency and parallel scalability on up to 4096 Knights Landing cores of a supercomputer.


Generalized Absorptive Polynomials and Provenance Semantics for Fixed Point Logic. Semiring provenance is a successful approach to provide detailed information on the combinations of atomic facts that are responsible for the result of a query. In particular, interpretations in general provenance semirings of polynomials or formal power series give precise descriptions of the successful evaluation strategies for the query. While provenance analysis in databases has, for a long time, been largely confined to negation free query languages, a recent approach extends this to model checking problems for logics with full negation. Algebraically this relies on new quotient semirings of dual indeterminate polynomials or power series. So far, this approach has been developed mainly for first order logic and for the positive fragment of least fixed point logic. What has remained open is an adequate treatment for fixed point calculi that admit arbitrary interleavings of least and greatest fixed points. We show that an adequate framework for the provenance analysis of full fixed point logics is provided by semirings that are (1) fully continuous, (2) absorptive, and (3) chain positive. Full continuity guarantees that provenance values of least and greatest fixed points are well defined. Absorptive semirings provide a symmetry between least and greatest fixed point computations and make sure that provenance values of greatest fixed points are informative. Finally, chain positivity is responsible for having truth preserving interpretations, which give non zero values to all true formulae. We further identify semirings of generalized absorptive polynomials and prove universal properties that make them the most general appropriate semirings for LFP. We illustrate the power of provenance interpretations in these semirings by relating them to provenance values of plays and strategies in the associated model checking games.


Decay rate of harmonic functions for non symmetric strictly alpha stable L 'evy processes. In this paper we investigate functions that are harmonic with respect to the non symmetric strictly alpha stable L 'evy processes on an open set D in mathbb R d . We obtain the explicit formula for their boundary decay rate at parts of the boudary of D outside of which they vanish.


A simple neural network implementation of generalized solvation free energy for assessment of protein structural models. Rapid and accurate assessment of protein structural models is essential for protein structure prediction and design. Great progress has been made in this regard, especially by recent development of knowledge based'' potentials. Various machine learning based protein structural model quality assessment was also quite successful. However, performance of traditional physics based'' potentials have not been as effective. Based on analysis of computational limitations of present solvation free energy formulation, which partially underlies unsatisfactory performance of physics based'' potentials, we proposed a generalized sovation free energy (GSFE) framework. GSFE is intrinsically flexible for multi scale treatments and is amenable for machine learning implementation. In this framework, each physical comprising unit of a complex molecular system has its own specific solvent environment. One distinctive feature of GSFE is that high order correlations within selected solvent environment might be captured through machine learning, in contrast to present empirical potentials (both knowledge based'' and physics based'') that are mainly based on pairwise interactions. Finally, we implemented a simple example of backbone and side chain orientation based residue level protein GSFE with neural network, which was found to have competitive performance when compared with highly complex latest knowledge based'' atomic potentials in distinguishing native structures from decoys.


Cross sectional Learning of Extremal Dependence among Financial Assets. We propose a novel probabilistic model to facilitate the learning of multivariate tail dependence of multiple financial assets. Our method allows one to construct from known random vectors, e.g., standard normal, sophisticated joint heavy tailed random vectors featuring not only distinct marginal tail heaviness, but also flexible tail dependence structure. The novelty lies in that pairwise tail dependence between any two dimensions is modeled separately from their correlation, and can vary respectively according to its own parameter rather than the correlation parameter, which is an essential advantage over many commonly used methods such as multivariate t or elliptical distribution. It is also intuitive to interpret, easy to track, and simple to sample comparing to the copula approach. We show its flexible tail dependence structure through simulation. Coupled with a GARCH model to eliminate serial dependence of each individual asset return series, we use this novel method to model and forecast multivariate conditional distribution of stock returns, and obtain notable performance improvements in multi dimensional coverage tests. Besides, our empirical finding about the asymmetry of tails of the idiosyncratic component as well as the market component is interesting and worth to be well studied in the future.


On Software Implementation of Gabidulin Decoders. This work compares the performance of software implementations of different Gabidulin decoders. The parameter sets used within the comparison stem from their applications in recently proposed cryptographic schemes. The complexity analysis of the decoders is recalled, counting the occurrence of each operation within the respective decoders. It is shown that knowing the number of operations may be misleading when comparing different algorithms as the run time of the implementation depends on the instruction set of the device on which the algorithm is executed.


Towards Dynamic Algorithm Selection for Numerical Black Box Optimization Investigating BBOB as a Use Case. One of the most challenging problems in evolutionary computation is to select from its family of diverse solvers one that performs well on a given problem. This algorithm selection problem is complicated by the fact that different phases of the optimization process require different search behavior. While this can partly be controlled by the algorithm itself, there exist large differences between algorithm performance. It can therefore be beneficial to swap the configuration or even the entire algorithm during the run. Long deemed impractical, recent advances in Machine Learning and in exploratory landscape analysis give hope that this dynamic algorithm configuration (dynAC) can eventually be solved by automatically trained configuration schedules. With this work we aim at promoting research on dynAC, by introducing a simpler variant that focuses only on switching between different algorithms, not configurations. Using the rich data from the Black Box Optimization Benchmark (BBOB) platform, we show that even single switch dynamic Algorithm selection (dynAS) can potentially result in significant performance gains. We also discuss key challenges in dynAS, and argue that the BBOB framework can become a useful tool in overcoming these.


Fully Learnable Group Convolution for Acceleration of Deep Neural Networks. Benefitted from its great success on many tasks, deep learning is increasingly used on low computational cost devices, e.g. smartphone, embedded devices, etc. To reduce the high computational and memory cost, in this work, we propose a fully learnable group convolution module (FLGC for short) which is quite efficient and can be embedded into any deep neural networks for acceleration. Specifically, our proposed method automatically learns the group structure in the training stage in a fully end to end manner, leading to a better structure than the existing pre defined, two steps, or iterative strategies. Moreover, our method can be further combined with depthwise separable convolution, resulting in 5 times acceleration than the vanilla Resnet50 on single CPU. An additional advantage is that in our FLGC the number of groups can be set as any value, but not necessarily 2 k as in most existing methods, meaning better tradeoff between accuracy and speed. As evaluated in our experiments, our method achieves better performance than existing learnable group convolution and standard group convolution when using the same number of groups.


Finite TYCZ expansions and cscK metrics. Let (M, g) be a Kaehler manifold whose associated Kaehler form omega is integral and let (L, h) rightarrow (M, omega) be a quantization hermitian line bundle. In this paper we study those Kaehler manifolds (M, g) admitting a finite TYCZ expansion. We show that if the TYCZ expansion is finite then T mg is indeed a polynomial in m of degree n , n dim M , and the log term of the Szeg " o kernel of the disc bundle D subset L vanishes (where L is the dual bundle of L ). Moreover, we provide a complete classification of the Kaehler manifolds admitting finite TYCZ expansion either when M is a complex curve or when M is a complex surface with a cscK metric which admits a radial Kaehler potential.


Mimicking Chiral Light Matter Interaction. We demonstrate that electric dipole scatterers can mimic chiral light matter interaction by generating far field circular polarization upon scattering, even though the optical chirality of the incident field as well as that of the scattered light is zero. The presented effect originates from the fact that electric dipole scatterers respond selectively only to the incident electric field, which eventually results in depolarization of the transmitted beam and in generation of far field circular polarization. To experimentally demonstrate this effect we utilize a cylindrical vector beam with spiral polarization and a spherical gold nanoparticle positioned on the optical axis the axis of rotational symmetry of the system. Our experiment and a simple theoretical model address the fundamentals of duality symmetry in optics and chiral light matter interactions, accentuating their richness and ubiquity yet in highly symmetric configurations.


Deep Reinforcement Learning for Stock Portfolio Optimization. Stock portfolio optimization is the process of constant re distribution of money to a pool of various stocks. In this paper, we will formulate the problem such that we can apply Reinforcement Learning for the task properly. To maintain a realistic assumption about the market, we will incorporate transaction cost and risk factor into the state as well. On top of that, we will apply various state of the art Deep Reinforcement Learning algorithms for comparison. Since the action space is continuous, the realistic formulation were tested under a family of state of the art continuous policy gradients algorithms Deep Deterministic Policy Gradient (DDPG), Generalized Deterministic Policy Gradient (GDPG) and Proximal Policy Optimization (PPO), where the former two perform much better than the last one. Next, we will present the end to end solution for the task with Minimum Variance Portfolio Theory for stock subset selection, and Wavelet Transform for extracting multi frequency data pattern. Observations and hypothesis were discussed about the results, as well as possible future research directions.1


CANZSL Cycle Consistent Adversarial Networks for Zero Shot Learning from Natural Language. Existing methods using generative adversarial approaches for Zero Shot Learning (ZSL) aim to generate realistic visual features from class semantics by a single generative network, which is highly under constrained. As a result, the previous methods cannot guarantee that the generated visual features can truthfully reflect the corresponding semantics. To address this issue, we propose a novel method named Cycle consistent Adversarial Networks for Zero Shot Learning (CANZSL). It encourages a visual feature generator to synthesize realistic visual features from semantics, and then inversely translate back synthesized the visual feature to corresponding semantic space by a semantic feature generator. Furthermore, in this paper a more challenging and practical ZSL problem is considered where the original semantics are from natural language with irrelevant words instead of clean semantics that are widely used in previous work. Specifically, a multi modal consistent bidirectional generative adversarial network is trained to handle unseen instances by leveraging noise in the natural language. A forward one to many mapping from one text description to multiple visual features is coupled with an inverse many to one mapping from the visual space to the semantic space. Thus, a multi modal cycle consistency loss between the synthesized semantic representations and the ground truth can be learned and leveraged to enforce the generated semantic features to approximate to the real distribution in semantic space. Extensive experiments are conducted to demonstrate that our method consistently outperforms state of the art approaches on natural language based zero shot learning tasks.


Indecomposability of derived categories in families. Using the moduli space of semiorthogonal decompositions in a smooth projective family introduced by the second, the third and the fourth author, we discuss indecomposability results for derived categories in families. In particular, we prove that given a smooth projective family of varieties, if the derived category of the general fibre does not admit a semiorthogonal decomposition, the same happens for every fibre of the family. As a consequence, we deduce that in a smooth family of complex projective varieties, if there exists a fibre such that the base locus of its canonical linear series is either empty or finite, then any fibre of the family has indecomposable derived category. Then we apply our results to achieve indecomposability of the derived categories of various explicit classes of varieties, as e.g. n fold symmetric products of curves (with 0 n lfloor (g 3) 2 rfloor ), Horikawa surfaces, an interesting class of double covers of the projective plane introduced by Ciliberto, and Hilbert schemes of points on these two classes of surfaces.


Neural Hair Rendering. In this paper, we propose a generic neural based hair rendering pipeline that can synthesize photo realistic images from virtual 3D hair models. Unlike existing supervised translation methods that require model level similarity to preserve consistent structure representation for both real images and fake renderings, our method adopts an unsupervised solution to work on arbitrary hair models. The key component of our method is a shared latent space to encode appearance invariant structure information of both domains, which generates realistic renderings conditioned by extra appearance inputs. This is achieved by domain specific pre disentangled structure representation, partially shared domain encoder layers and a structure discriminator. We also propose a simple yet effective temporal conditioning method to enforce consistency for video sequence generation. We demonstrate the superiority of our method by testing it on a large number of portraits and comparing it with alternative baselines and state of the art unsupervised image translation methods.


Linear extensions of multiple conjugation quandles and MCQ Alexander pairs. A quandle is an algebra whose axioms are motivated from knot theory. A linear extension of a quandle can be described by using a pair of maps called an Alexander pair. In this paper, we show that a linear extension of a multiple conjugation quandle can be described by using a pair of maps called an MCQ Alexander pair, where a multiple conjugation quandle is an algebra whose axioms are motivated from handlebody knot theory.


FLOT Scene Flow on Point Clouds Guided by Optimal Transport. We propose and study a method called FLOT that estimates scene flow on point clouds. We start the design of FLOT by noticing that scene flow estimation on point clouds reduces to estimating a permutation matrix in a perfect world. Inspired by recent works on graph matching, we build a method to find these correspondences by borrowing tools from optimal transport. Then, we relax the transport constraints to take into account real world imperfections. The transport cost between two points is given by the pairwise similarity between deep features extracted by a neural network trained under full supervision using synthetic datasets. Our main finding is that FLOT can perform as well as the best existing methods on synthetic and real world datasets while requiring much less parameters and without using multiscale analysis. Our second finding is that, on the training datasets considered, most of the performance can be explained by the learned transport cost. This yields a simpler method, FLOT 0 , which is obtained using a particular choice of optimal transport parameters and performs nearly as well as FLOT.


Approximate Representer Theorems in Non reflexive Banach Spaces. The representer theorem is one of the most important mathematical foundations for regularised learning and kernel methods. Classical formulations of the theorem state sufficient conditions under which a regularisation problem on a Hilbert space admits a solution in the subspace spanned by the representers of the data points. This turns the problem into an equivalent optimisation problem in a finite dimensional space, making it computationally tractable. Moreover, Banach space methods for learning have been receiving more and more attention. Considering the representer theorem in Banach spaces is hence of increasing importance. Recently the question of the necessary condition for a representer theorem to hold in Hilbert spaces and certain Banach spaces has been considered. It has been shown that a classical representer theorem cannot exist in general in non reflexive Banach spaces. In this paper we propose a notion of approximate solutions and approximate representer theorem to overcome this problem. We show that for these notions we can indeed extend the previous results to obtain a unified theory for the existence of representer theorems in any general Banach spaces, in particular including l 1 type spaces. We give a precise characterisation when a regulariser admits a classical representer theorem and when only an approximate representer theorem is possible.


An Introduction to MMPDElab. This article presents an introduction to MMPDElab, a package written in MATLAB for adaptive mesh movement and adaptive moving mesh P1 finite element solution of second order partial different equations having continuous solutions in one, two, and three spatial dimensions. MMPDElab uses simplicial meshes.


On Embeddings in Relational Databases. We address the problem of learning a distributed representation of entities in a relational database using a low dimensional embedding. Low dimensional embeddings aim to encapsulate a concise vector representation for an underlying dataset with minimum loss of information. Embeddings across entities in a relational database have been less explored due to the intricate data relations and representation complexity involved. Relational databases are an inter weaved collection of relations that not only model relationships between entities but also record complex domain specific quantitative and temporal attributes of data defining complex relationships among entities. Recent methods for learning an embedding constitute of a naive approach to consider complete denormalization of the database by materializing the full join of all tables and representing as a knowledge graph. This popular approach has certain limitations as it fails to capture the inter row relationships and additional semantics encoded in the relational databases. In this paper we demonstrate a better methodology for learning representations by exploiting the underlying semantics of columns in a table while using the relation joins and the latent inter row relationships. Empirical results over a real world database with evaluations on similarity join and table completion tasks support our proposition.


Many cliques with few edges. Recently Cutler and Radcliffe proved that the graph on n vertices with maximum degree at most r having the most cliques is a disjoint union of lfloor n (r 1) rfloor cliques of size r 1 together with a clique on the remainder of the vertices. It is very natural also to consider this question when the limiting resource is edges rather than vertices. In this paper we prove that among graphs with m edges and maximum degree at most r , the graph that has the most cliques of size at least two is the disjoint union of bigl lfloor m bigm binom r 1 2 bigr rfloor cliques of size r 1 together with the colex graph using the remainder of the edges.


A generalization of convergence actions. Let a group G act properly discontinuously and cocompactly on a locally compact space X . A Hausdorff compact space Z that contains X as an open subspace has the perspectivity property if the action G curvearrowright X extends to an action G curvearrowright Z , by homeomorphisms, such that for every compact K subseteq X and every element u of the unique uniform structure compatible with the topology of Z , the set gK g in G has finitely many non u small sets. We describe a correspondence between the compact spaces with the perspectivity property with respect to X (and the fixed action of G on it) and the compact spaces with the perspectivity property with respect to G (and the left multiplication on itself). This generalizes a similar result for convergence group actions.


Search for Smart Evaders with Swarms of Sweeping Agents. Suppose that in a given planar circular region, there are some smart mobile evaders and we would like to find them using sweeping agents. We assume that each agent has a line sensor of length 2r. We propose procedures for designing cooperative sweeping processes that ensure the successful completion of the task, thereby deriving conditions on the sweeping velocity of the agents and their paths. Successful completion of the task means that evaders with a given limit on their velocity cannot escape the sweeping agents. A simpler task for the sweeping swarm is the confinement of the evaders to their initial domain. The feasibility of completing these tasks depends on geometric and dynamic constraints that impose a lower bound on the velocity that the sweeper swarm must have. This critical velocity is derived to ensure the satisfaction of the confinement task. Increasing the velocity above the lower bound enables the agents to complete the search task as well. We present results on the total search time as a function of the sweeping velocity of the swarm's agents given the initial conditions on the size of the search region and the maximal velocity of the evaders.


Investigating the effect of competitiveness power in estimating the average weighted price in electricity market. This paper evaluates the impact of the power extent on price in the electricity market. The competitiveness extent of the electricity market during specific times in a day is considered to achieve this. Then, the effect of competitiveness extent on the forecasting precision of the daily power price is assessed. A price forecasting model based on multi layer perception via back propagation with the Levenberg Marquardt mechanism is used. The Residual Supply Index (RSI) and other variables that affect prices are used as inputs to the model to evaluate the market competitiveness. The results show that using market power indices as inputs helps to increase forecasting accuracy. Thus, the competitiveness extent of the market power in different daily time periods is a notable variable in price formation. Moreover, market players cannot ignore the explanatory power of market power in price forecasting. In this research, the real data of the electricity market from 2013 is used and the main source of data is the Grid Management Company in Iran.


SegVoxelNet Exploring Semantic Context and Depth aware Features for 3D Vehicle Detection from Point Cloud. 3D vehicle detection based on point cloud is a challenging task in real world applications such as autonomous driving. Despite significant progress has been made, we observe two aspects to be further improved. First, the semantic context information in LiDAR is seldom explored in previous works, which may help identify ambiguous vehicles. Second, the distribution of point cloud on vehicles varies continuously with increasing depths, which may not be well modeled by a single model. In this work, we propose a unified model SegVoxelNet to address the above two problems. A semantic context encoder is proposed to leverage the free of charge semantic segmentation masks in the bird's eye view. Suspicious regions could be highlighted while noisy regions are suppressed by this module. To better deal with vehicles at different depths, a novel depth aware head is designed to explicitly model the distribution differences and each part of the depth aware head is made to focus on its own target detection range. Extensive experiments on the KITTI dataset show that the proposed method outperforms the state of the art alternatives in both accuracy and efficiency with point cloud as input only.


Teacher Student Learning Paradigm for Tri training An Efficient Method for Unlabeled Data Exploitation. Given that labeled data is expensive to obtain in real world scenarios, many semi supervised algorithms have explored the task of exploitation of unlabeled data. Traditional tri training algorithm and tri training with disagreement have shown promise in tasks where labeled data is limited. In this work, we introduce a new paradigm for tri training, mimicking the real world teacher student learning process. We show that the adaptive teacher student thresholds used in the proposed method provide more control over the learning process with higher label quality. We perform evaluation on SemEval sentiment analysis task and provide comprehensive comparisons over experimental settings containing varied labeled versus unlabeled data rates. Experimental results show that our method outperforms other strong semi supervised baselines, while requiring less number of labeled training samples.


A reduction approach to silting objects for derived categories of hereditary categories. Let mathcal H be a hereditary abelian category over a field k with finite dimensional operatorname Hom and operatorname Ext spaces. It is proved that the bounded derived category mathcal D b( mathcal H ) has a silting object iff mathcal H has a tilting object iff mathcal D b( mathcal H ) has a simple minded collection with acyclic operatorname Ext quiver. Along the way, we obtain a new proof for the fact that every presilting object of mathcal D b( mathcal H ) is a partial silting object. We also consider the question of complements for pre simple minded collections. In contrast to presilting objects, a pre simple minded collection mathcal R of mathcal D b( mathcal H ) can be completed into a simple minded collection iff the operatorname Ext quiver of mathcal R is acyclic.


Some remarks about the maximal perimeter of convex sets with respect to probability measures. In this note we study the maximal perimeter of a convex set in mathbb R n with respect to various classes of measures. Firstly, we show that for a probability measure mu on mathbb R n , satisfying very mild assumptions, there exists a convex set of mu perimeter at least C frac sqrt n sqrt 4 Var X sqrt mathbb E X . This implies, in particular, that for any isotropic log concave measure mu one may find a convex set of mu perimeter of order n frac 1 8 . Secondly, we derive a general upper bound of Cn f frac 1 n infty on the maximal perimeter of a convex set with respect to any log concave measure with density f in an appropriate position. Our lower bound is attained for a class of distributions including the standard normal distribution. Our upper bound is attained, say, for a uniform measure on the cube. In addition, for isotropic log concave measures we prove an upper bound of order n 2 for the maximal mu perimeter of a convex set.


Strategyproof Facility Location Mechanisms with Richer Action Spaces. We study facility location problems where agents control multiple locations and when reporting their locations can choose to hide some locations (hiding), report some locations more than once (replication) and lie about their locations (manipulation). We fully characterize all facility location mechanisms that are anonymous, efficient, and strategyproof with respect to the richer strategic behavior for this setting. We also provide a characterization with respect to manipulation only. This is the first, to the best of our knowledge, characterization result for the strategyproof facility location mechanisms where each agent controls multiple locations.


Trajectory Prediction for Autonomous Driving based on Multi Head Attention with Joint Agent Map Representation. Predicting the trajectories of surrounding agents is an essential ability for autonomous vehicles navigating through complex traffic scenes. The future trajectories of agents can be inferred using two important cues the locations and past motion of agents, and the static scene structure. Due to the high variability in scene structure and agent configurations, prior work has employed the attention mechanism, applied separately to the scene and agent configuration to learn the most salient parts of both cues. However, the two cues are tightly linked. The agent configuration can inform what part of the scene is most relevant to prediction. The static scene in turn can help determine the relative influence of agents on each other's motion. Moreover, the distribution of future trajectories is multimodal, with modes corresponding to the agent's intent. The agent's intent also informs what part of the scene and agent configuration is relevant to prediction. We thus propose a novel approach applying multi head attention by considering a joint representation of the static scene and surrounding agents. We use each attention head to generate a distinct future trajectory to address multimodality of future trajectories. Our model achieves state of the art results on the nuScenes prediction benchmark and generates diverse future trajectories compliant with scene structure and agent configuration.


Integrated approach for the identification of spatial patterns related to renewable energy potential in European territories. The study presents an effort to classify the territories of a specific area, according to similarities in the estimated potential of their renewable sources, considering also their economic and sociodemographic structure and their geographic features. Specifically, the paper focuses on the area of EU28 and Switzerland and uses as basis for the analysis, data estimating the potential of renewable energy sources collected and elaborated in the framework of the project HotMaps (Horizon 2020). The method used to group the territorial units is cluster analysis, and specifically the k means algorithm. The data present some interesting patterns and the territories of EU28 and Switzerland at NUTS3 level are classified into 17 clusters. The analysis shows the presence of heterogeneity within national borders and among territories comprised in the macro regions target of specific EU programmes, specifically the Adriatic Ionian region, the Alpine region, the Baltic Sea region and the Danube region. The results of this research are meant to be used by European policy makers in developing more focused transnational renewable energy policies and strategies.


Stable Pontryagin Thom construction for proper maps. We will present proofs for two conjectures stated in arXiv 1808.08073. The first one is that for an arbitrary manifold W , the homotopy classes of proper maps W times mathbb R n to mathbb R k n stabilise as n to infty , and the second one is that in a stable range there is a Pontryagin Thom type bijection for proper maps W times mathbb R n to mathbb R k n . The second one actually implies the first one and we shall prove the second one by giving an explicit construction.


Two Player Hidden Pointer Chasing and Multi Pass Lower Bounds in Turnstile Streams. The authors have withdrawn this paper due to an error in the proof of Lemma 3.4. The authors have withdrawn this paper due to an error in the proof of Lemma 3.4z(Assadi, Chen, and Khanna, 2019) define a 4 player hidden pointer chasing ( mathsf HPC 4 ), and using it, give strong multi pass lower bounds for graph problems in the streaming model of computation and a lower bound on the query complexity of sub modular minimization. We present a two player version ( mathsf HPC 2 ) of mathsf HPC 4 that has matching communication complexity to mathsf HPC 4 . Our formulation allows us to lower bound its communication complexity with a simple direct sum argument. Using this lower bound on the communication complexity of mathsf HPC 2 , we retain the streaming and query complexity lower bounds by (Assadi, Chen, and Khanna, 2019). Further, by giving reductions from mathsf HPC 2 , we prove new multi pass space lower bounds for graph problems in turnstile streams. In particular, we show that any algorithm which computes the exact weight of the maximum weighted matching in an n vertex graph requires tilde O (n 2 ) space unless it makes omega( log n) passes over the turnstile stream, and that any algorithm which computes the minimum s text t distance in an n vertex graph requires n 2 o(1) space unless it makes n Omega(1) passes over the turnstile stream. Our reductions can be modified to use mathsf HPC 4 as well.


Unique Asymptotics of Compact Ancient Solutions to three dimensional Ricci flow. We consider compact ancient solutions to the three dimensional Ricci flow which are noncollapsed. We prove that such a solutions is either a family of shrinking round spheres, or it has a unique asymptotic behavior as t to infty which we describe. This analysis applies in particular to the ancient solution constructed by Perelman.


ALIGN A System for Automating Analog Layout. ALIGN ("Analog Layout, Intelligently Generated from Netlists") is an open source automatic layout generation flow for analog circuits. ALIGN translates an input SPICE netlist to an output GDSII layout, specific to a given technology, as specified by a set of design rules. The flow first automatically detects hierarchies in the circuit netlist and translates layout synthesis to a problem of hierarchical block assembly. At the lowest level, parameterized cells are generated using an abstraction of the design rules these blocks are then assembled under geometric and electrical constraints to build the circuit layout. ALIGN has been applied to generate layouts for a diverse set of analog circuit families low frequency analog blocks, wireline circuits, wireless circuits, and power delivery circuits.


Coupling Retrieval and Meta Learning for Context Dependent Semantic Parsing. In this paper, we present an approach to incorporate retrieved datapoints as supporting evidence for context dependent semantic parsing, such as generating source code conditioned on the class environment. Our approach naturally combines a retrieval model and a meta learner, where the former learns to find similar datapoints from the training data, and the latter considers retrieved datapoints as a pseudo task for fast adaptation. Specifically, our retriever is a context aware encoder decoder model with a latent variable which takes context environment into consideration, and our meta learner learns to utilize retrieved datapoints in a model agnostic meta learning paradigm for fast adaptation. We conduct experiments on CONCODE and CSQA datasets, where the context refers to class environment in JAVA codes and conversational history, respectively. We use sequence to action model as the base semantic parser, which performs the state of the art accuracy on both datasets. Results show that both the context aware retriever and the meta learning strategy improve accuracy, and our approach performs better than retrieve and edit baselines.


Polyharmonic hypersurfaces into space forms. In this paper we shall assume that the ambient manifold is a space form N m 1 (c) and we shall consider polyharmonic hypersurfaces of order r (briefly, r harmonic), where r geq 3 is an integer. For this class of hypersurfaces we shall prove that, if c leq 0 , then any r harmonic hypersurface must be minimal provided that the mean curvature function and the squared norm of the shape operator are constant. When the ambient space is mathbb S m 1 , we shall obtain the geometric condition which characterizes the r harmonic hypersurfaces with constant mean curvature and constant squared norm of the shape operator, and we shall establish the bounds for these two constants. In particular, we shall prove the existence of several new examples of proper r harmonic isoparametric hypersurfaces in mathbb S m 1 for suitable values of m and r . Finally, we shall show that all these r harmonic hypersurfaces are also ES r harmonic, i.e., critical points of the Eells Sampson r energy functional.


Sensitivity Local Index to Control Chaoticity or Gradient Globally . Here, we introduce a fully local index named "sensitivity" for each neuron to control chaoticity or gradient globally in a neural network (NN). We also propose a learning method to adjust it named "sensitivity adjustment learning (SAL)". The index is the gradient magnitude of its output with respect to its inputs. By adjusting its time average to 1.0 in each neuron, information transmission in the neuron changes to be moderate without shrinking or expanding for both forward and backward computations. That results in moderate information transmission through a layer of neurons when the weights and inputs are random. Therefore, SAL can control the chaoticity of the network dynamics in a recurrent NN (RNN). It can also solve the vanishing gradient problem in error backpropagation (BP) learning in a deep feedforward NN or an RNN. We demonstrate that when applying SAL to an RNN with small and random initial weights, log sensitivity, which is the logarithm of RMS (root mean square) sensitivity over all the neurons, is equivalent to the maximum Lyapunov exponent until it reaches 0.0. We also show that SAL works with BP or BPTT (BP through time) to avoid the vanishing gradient problem in a 300 layer NN or an RNN that learns a problem with a lag of 300 steps between the first input and the output. Compared with manually fine tuning the spectral radius of the weight matrix before learning, SAL's continuous nonlinear learning nature prevents loss of sensitivities during learning, resulting in a significant improvement in learning performance.


Single shot fourth order auto correlator. The temporal contrast is one of the most important parameters of an ultra high intense laser pulse. Third order auto correlator or cross correlator have been widely used to characterize the temporal contrast of an ultra intense laser pulse in the past decades. Here, a novel and simple single shot fourth order auto correlator to characterize the temporal contrast with higher time resolution and better pulse contrast fidelity in comparison to third order correlators is proposed. The single shot fourth order autocorrelation consists of a frequency degenerate four wave mixing process and a sum frequency mixing process. The proof of principle experiments show that a dynamic range of approximately 10 11 compared with the noise level, a time resolution of approximately 160 fs, and a time window of 65 ps can be successfully obtained using the novel single shot fourth order auto correlator, which is the highest dynamic range with simultaneous high time resolution for single shot temporal contrast measurement so far. Furthermore, the temporal contrast of laser pulse from a PW laser system is successfully measured in single shot with a dynamic range of about 2 10 10 and simultaneous a time resolution of 160 fs.