Nehari manifold for fractional p(.) Laplacian system involving concave convex nonlinearities. In this article using Nehari manifold method we study the multiplicity of solutions of the following nonlocal elliptic system involving variable exponents and concave convex nonlinearities begin equation begin array rl ( Delta) p( cdot) s u lambda a(x) u q(x) 2 u frac alpha(x) alpha(x) beta(x) c(x) u alpha(x) 2 u v beta(x) , hspace 2mm x in Omega ( Delta) p( cdot) s v mu b(x) v q(x) 2 v frac alpha(x) alpha(x) beta(x) c(x) v alpha(x) 2 v u beta(x) , hspace 2.5mm x in Omega u v 0 , hspace 1cm x in Omega c mathbb R N setminus Omega, end array end equation where Omega subset mathbb R N, N geq2 is a smooth bounded domain, lambda, mu 0 are the parameters, s in(0,1), p in C( mathbb R N times mathbb R N,(1, infty)) and q, alpha, beta in C( overline Omega ,(1, infty)) are the variable exponents and a,b,c in C( overline Omega , 0, infty)) are the non negative weight functions. We show that there exists Lambda 0 such that for all lambda mu Lambda , there exist two non trivial and non negative solutions of the above problem under some assumptions on q, alpha, beta .


Optimizing Privacy Preserving Outsourced Convolutional Neural Network Predictions. Convolutional neural network is a machine learning model widely applied in various prediction tasks, such as computer vision and medical image analysis. Their great predictive power requires extensive computation, which encourages model owners to host the prediction service in a cloud platform. Recent researches focus on the privacy of the query and results, but they do not provide model privacy against the model hosting server and may leak partial information about the results. Some of them further require frequent interactions with the querier or heavy computation overheads, which discourages querier from using the prediction service. This paper proposes a new scheme for privacy preserving neural network prediction in the outsourced setting, i.e., the server cannot learn the query, (intermediate) results, and the model. Similar to SecureML (S P'17), a representative work that provides model privacy, we leverage two non colluding servers with secret sharing and triplet generation to minimize the usage of heavyweight cryptography. Further, we adopt asynchronous computation to improve the throughput, and design garbled circuits for the non polynomial activation function to keep the same accuracy as the underlying network (instead of approximating it). Our experiments on MNIST dataset show that our scheme achieves an average of 122x, 14.63x, and 36.69x reduction in latency compared to SecureML, MiniONN (CCS'17), and EzPC (EuroS P'19), respectively. For the communication costs, our scheme outperforms SecureML by 1.09x, MiniONN by 36.69x, and EzPC by 31.32x on average. On the CIFAR dataset, our scheme achieves a lower latency by a factor of 7.14x and 3.48x compared to MiniONN and EzPC, respectively. Our scheme also provides 13.88x and 77.46x lower communication costs than MiniONN and EzPC on the CIFAR dataset.


Solving a group equation of length nine. The Levin conjecture was proposed by Levin in 1962 which conjectures the solvability of any group equation with coefficients in a torsion free group. The Levin conjecture is recently shown to hold for group equations of length seven by weight test and curvature distribution. These methods are applied on a group equation of length nine to explore the validity of Levin conjecture. It is found that the Levin conjecture has an affirmative answer for this equation modulo some exceptional cases.


Revisiting the Polyak step size. This paper revisits the Polyak step size schedule for convex optimization problems, proving that a simple variant of it simultaneously attains near optimal convergence rates for the gradient descent algorithm, for all ranges of strong convexity, smoothness, and Lipschitz parameters, without a priory knowledge of these parameters.


Knot diagrams on a punctured sphere as a model of string figures. A string figure is topologically a trivial knot lying on an imaginary plane orthogonal to the fingers with some crossings. The fingers prevent cancellation of these crossings. As a mathematical model of string figure we consider a knot diagram on the xy plane in xyz space missing some straight lines parallel to the z axis. These straight lines correspond to fingers. We study minimal number of crossings of these knot diagrams under Reidemeister moves missing these lines.


Construction of Rate (n 1) n Non Binary LDPC Convolutional Codes via Difference Triangle Sets. This paper provides a construction of non binary LDPC convolutional codes, which generalizes the work of Robinson and Bernstein. The sets of integers forming an (n 1,w) difference triangle set are used as supports of the columns of rate (n 1) n convolutional codes. If the field size is large enough, the Tanner graph associated to the sliding parity check matrix of the code is free from 4 and 6 cycles not satisfying the full rank condition. This is important for improving the performance of a code and avoiding the presence of low weight codewords and absorbing sets. The parameters of the convolutional code are shown to be determined by the parameters of the underlying difference triangle set. In particular, the free distance of the code is related to w and the degree of the code is linked to the "scope" of the difference triangle set. Hence, the problem of finding families of difference triangle set with minimum scope is equivalent to find convolutional codes with small degree.


Equivariant nonabelian Poincar 'e duality and equivariant factorization homology of Thom spectra. In this paper, we study genuine equivariant factorization homology and its interaction with equivariant Thom spectra, which we construct using the language of parametrized higher category theory. We describe the genuine equivariant factorization homology of Thom spectra, and use this description to compute several examples of interest. A key ingredient for our computations is an equivariant nonabelian Poincar 'e duality theorem, in which we prove that factorization homology with coefficients in a G space is given by a mapping space. We compute the Real topological Hochschild homology ( THR ) of the Real bordism spectrum MU mathbb R and of the equivariant Eilenberg MacLane spectra H underline mathbb F 2 and H underline mathbb Z (2) , as well as factorization homology of the sphere S 2 sigma with coefficients in these Eilenberg MacLane spectra. In the appendix, Jeremy Hahn and Dylan Wilson compute THR(H underline mathbb Z ) .


A simulational study of the indirect geometry neutron spectrometer, BIFROST at the European Spallation Source, from neutron source position to detector position. The European Spallation Source (ESS) is intended to become the most powerful spallation neutron source in the world and the flagship of neutron science in the upcoming decades. The exceptionally high neutron flux will provide unique opportunities for scientific experiments, but also set high requirements for the detectors. One of the most challenging aspects is the rate capability and in particular the peak instantaneous rate capability, i.e. the number of neutrons hitting the detector per channel or cm 2 at the peak of the neutron pulse. The primary purpose of this paper is to estimate the incident rates that are anticipated for the BIFROST instrument planned for ESS, and also to demonstrate the use of powerful simulation tools for the correct interpretation of neutron transport in crystalline materials. A full simulation model of the instrument from source to detector position, implemented with the use of multiple simulation software packages is presented. For a single detector tube instantaneous incident rates with a maximum of 1.7 GHz for a Bragg peak from a single crystal, and 0.3 MHz for a vanadium sample are found. This paper also includes the first application of a new pyrolytic graphite model, and a comparison of different simulation tools to highlight their strengths and weaknesses.


An Efficient Sampling based Method for Online Informative Path Planning in Unknown Environments. The ability to plan informative paths online is essential to robot autonomy. In particular, sampling based approaches are often used as they are capable of using arbitrary information gain formulations. However, they are prone to local minima, resulting in sub optimal trajectories, and sometimes do not reach global coverage. In this paper, we present a new RRT inspired online informative path planning algorithm. Our method continuously expands a single tree of candidate trajectories and rewires segments to maintain the tree and refine intermediate trajectories. This allows the algorithm to achieve global coverage and maximize the utility of a path in a global context, using a single objective function. We demonstrate the algorithm's capabilities in the applications of autonomous indoor exploration as well as accurate Truncated Signed Distance Field (TSDF) based 3D reconstruction on board a Micro Aerial vehicle (MAV). We study the impact of commonly used information gain and cost formulations in these scenarios and propose a novel TSDF based 3D reconstruction gain and cost utility formulation. Detailed evaluation in realistic simulation environments show that our approach outperforms state of the art methods in these tasks. Experiments on a real MAV demonstrate the ability of our method to robustly plan in real time, exploring an indoor environment solely with on board sensing and computation. We make our framework available for future research.


math.NA cs.NA physics.comp-ph physics.flu-dyn

Optimized geometrical metrics satisfying free stream preservation. Computational fluid dynamics and aerodynamics, which complement more expensive empirical approaches, are critical for developing aerospace vehicles. During the past three decades, computational aerodynamics capability has improved remarkably, following advances in computer hardware and algorithm development. However, for complex applications, the demands on computational fluid dynamics continue to increase in a quest to gain a few percent improvements in accuracy. Herein, we numerically demonstrate that optimizing the metric terms which arise from smoothly mapping each cell to a reference element, lead to a solution whose accuracy is practically never worse and often noticeably better than the one obtained using the widely adopted Thomas and Lombard metric terms computation (Geometric conservation law and its application to flow computations on moving grids, AIAA Journal, 1979). Low and high order accurate entropy stable schemes on distorted, high order tensor product elements are used to simulate three dimensional inviscid and viscous compressible test cases for which an analytical solution is known.


A Most Irrational Foraging Algorithm. We present a foraging algorithm, GoldenFA, in which search direction is chosen based on the Golden Ratio. We show both theoretically and empirically that GoldenFA is more efficient for a single searcher than a comparable algorithm where search direction is chosen uniformly at random. Moreover, we give a variant of our algorithm that parallelizes linearly with the number of searchers.


Least Q eigenvalues of nonbipartite 2 connected graphs. Among all simple nonbipartite 2 connected graphs and among all nonbipartite theta graphs, the minimum least Q eigenvalues are completely determined, respectively.


Total Coloring for some classes of Cayley graphs. The Total coloring conjecture states that any simple graph G with maximum degree D can be totally colored with at most D 2 colors. In this paper, we have obtained the total chromatic number for some classes of Cayley graphs.


Impact of Data Quality on Deep Neural Network Training. It is well known that data is critical for training neural networks. Lot have been written about quantities of data required to train networks well. However, there is not much publications on how data quality effects convergence of such networks. There is dearth of information on what is considered good data ( for the task ). This empirical experimental study explores some impacts of data quality. Specific results are shown in the paper how simple changes can have impact on Mean Average Precision (mAP).


Prescribing Ricci curvature on a Product of Spheres. We prove an existence result for the prescribed Ricci curvature equation for certain doubly warped product metrics on mathbb S d 1 1 times mathbb S d 2 , where d i geq 2 . If T is a metric satisfying certain curvature assumptions, we show that T can be scaled independently on the two factors so as to itself be the Ricci tensor of some metric.


Differentially Private Online Submodular Maximization. In this work we consider the problem of online submodular maximization under a cardinality constraint with differential privacy (DP). A stream of T submodular functions over a common finite ground set U arrives online, and at each time step the decision maker must choose at most k elements of U before observing the function. The decision maker obtains a payoff equal to the function evaluated on the chosen set, and aims to learn a sequence of sets that achieves low expected regret. In the full information setting, we develop an ( varepsilon, delta) DP algorithm with expected (1 1 e) regret bound of mathcal O left( frac k 2 log U sqrt T log k delta varepsilon right) . This algorithm contains k ordered experts that learn the best marginal increments for each item over the whole time horizon while maintaining privacy of the functions. In the bandit setting, we provide an ( varepsilon, delta O(e T 1 3 )) DP algorithm with expected (1 1 e) regret bound of mathcal O left( frac sqrt log k delta varepsilon (k ( U log U ) 1 3 ) 2 T 2 3 right) . Our algorithms contains k ordered experts that learn the best marginal item to select given the items chosen her predecessors, while maintaining privacy of the functions. One challenge for privacy in this setting is that the payoff and feedback of expert i depends on the actions taken by her i 1 predecessors. This particular type of information leakage is not covered by post processing, and new analysis is required. Our techniques for maintaining privacy with feedforward may be of independent interest.


HL Pow A Learning Based Power Modeling Framework for High Level Synthesis. High level synthesis (HLS) enables designers to customize hardware designs efficiently. However, it is still challenging to foresee the correlation between power consumption and HLS based applications at an early design stage. To overcome this problem, we introduce HL Pow, a power modeling framework for FPGA HLS based on state of the art machine learning techniques. HL Pow incorporates an automated feature construction flow to efficiently identify and extract features that exert a major influence on power consumption, simply based upon HLS results, and a modeling flow that can build an accurate and generic power model applicable to a variety of designs with HLS. By using HL Pow, the power evaluation process for FPGA designs can be significantly expedited because the power inference of HL Pow is established on HLS instead of the time consuming register transfer level (RTL) implementation flow. Experimental results demonstrate that HL Pow can achieve accurate power modeling that is only 4.67 (24.02 mW) away from onboard power measurement. To further facilitate power oriented optimizations, we describe a novel design space exploration (DSE) algorithm built on top of HL Pow to trade off between latency and power consumption. This algorithm can reach a close approximation of the real Pareto frontier while only requiring running HLS flow for 20 of design points in the entire design space.


Conformal sparse metasurfaces for wavefront manipulation. While flat metasurfaces are intensively studied, theoretical modelling of conformal metasurfaces appears to be exceptionally challenging where it demands accurate analysis of the metasurface geometry. Here, it is shown how numerical calculation of Green's function can be employed to design conformal sparse metasurfaces of arbitrary geometries within the same framework and without any accommodation. Furthermore, following the presented approach, it can be sufficient to realize only electric response to perform an efficient control of wavefronts that might simplify the design and fabrication of conformal metasurfaces.


Resolution Lower Bounds for Refutation Statements. For any unsatisfiable CNF formula we give an exponential lower bound on the size of resolution refutations of a propositional statement that the formula has a resolution refutation. We describe three applications. (1) An open question in (Atserias, M "uller 2019) asks whether a certain natural propositional encoding of the above statement is hard for Resolution. We answer by giving an exponential size lower bound. (2) We show exponential resolution size lower bounds for reflection principles, thereby improving a result in (Atserias, Bonet 2004). (3) We provide new examples of CNFs that exponentially separate Res(2) from Resolution (an exponential separation of these two proof systems was originally proved in (Segerlind, Buss, Impagliazzo 2004)).


Analyzing autoencoder based acoustic word embeddings. Recent studies have introduced methods for learning acoustic word embeddings (AWEs) fixed size vector representations of words which encode their acoustic features. Despite the widespread use of AWEs in speech processing research, they have only been evaluated quantitatively in their ability to discriminate between whole word tokens. To better understand the applications of AWEs in various downstream tasks and in cognitive modeling, we need to analyze the representation spaces of AWEs. Here we analyze basic properties of AWE spaces learned by a sequence to sequence encoder decoder model in six typologically diverse languages. We first show that these AWEs preserve some information about words' absolute duration and speaker. At the same time, the representation space of these AWEs is organized such that the distance between words' embeddings increases with those words' phonetic dissimilarity. Finally, the AWEs exhibit a word onset bias, similar to patterns reported in various studies on human speech processing and lexical access. We argue this is a promising result and encourage further evaluation of AWEs as a potentially useful tool in cognitive science, which could provide a link between speech processing and lexical memory.


On Biased Stochastic Gradient Estimation. We present a uniform analysis of biased stochastic gradient methods for minimizing convex, strongly convex, and non convex composite objectives, and identify settings where bias is useful in stochastic gradient estimation. The framework we present allows us to extend proximal support to biased algorithms, including SAG and SARAH, for the first time in the convex setting. We also use our framework to develop a new algorithm, Stochastic Average Recursive GradiEnt (SARGE), that achieves the oracle complexity lower bound for non convex, finite sum objectives and requires strictly fewer calls to a stochastic gradient oracle per iteration than SVRG and SARAH. We support our theoretical results with numerical experiments that demonstrate the benefits of certain biased gradient estimators.


Improving Scalability and Reward of Utility Driven Self Healing for Large Dynamic Architectures. Self adaptation can be realized in various ways. Rule based approaches prescribe the adaptation to be executed if the system or environment satisfies certain conditions. They result in scalable solutions but often with merely satisfying adaptation decisions. In contrast, utility driven approaches determine optimal decisions by using an often costly optimization, which typically does not scale for large problems. We propose a rule based and utility driven adaptation scheme that achieves the benefits of both directions such that the adaptation decisions are optimal, whereas the computation scales by avoiding an expensive optimization. We use this adaptation scheme for architecture based self healing of large software systems. For this purpose, we define the utility for large dynamic architectures of such systems based on patterns that define issues the self healing must address. Moreover, we use pattern based adaptation rules to resolve these issues. Using a pattern based scheme to define the utility and adaptation rules allows us to compute the impact of each rule application on the overall utility and to realize an incremental and efficient utility driven self healing. In addition to formally analyzing the computational effort and optimality of the proposed scheme, we thoroughly demonstrate its scalability and optimality in terms of reward in comparative experiments with a static rule based approach as a baseline and a utility driven approach using a constraint solver. These experiments are based on different failure profiles derived from real world failure logs. We also investigate the impact of different failure profile characteristics on the scalability and reward to evaluate the robustness of the different approaches.


CodeSwitch Reddit Exploration of Written Multilingual Discourse in Online Discussion Forums. In contrast to many decades of research on oral code switching, the study of written multilingual productions has only recently enjoyed a surge of interest. Many open questions remain regarding the sociolinguistic underpinnings of written code switching, and progress has been limited by a lack of suitable resources. We introduce a novel, large, and diverse dataset of written code switched productions, curated from topical threads of multiple bilingual communities on the Reddit discussion platform, and explore questions that were mainly addressed in the context of spoken language thus far. We investigate whether findings in oral code switching concerning content and style, as well as speaker proficiency, are carried over into written code switching in discussion forums. The released dataset can further facilitate a range of research and practical activities.


Non uniqueness of steady state weak solutions to the surface quasi geostrophic equations. We show the existence of nontrivial stationary weak solutions to the surface quasi geostrophic equations on the two dimensional periodic torus.


Commutators of weighted Hardy operator on weighted lambda central Morrey space. In this paper, the authors prove the boundedness of commutators generated by the weighted Hardy operator on weighted lambda central Morrey space with the weight omega satisfying the doubling condition. Moreover, the authors give the characterization for the weighted lambda central Campanato space by introducing a new kind of operator which is related to the commutator of weighted Hardy operator.


Modeling Contrary to Duty with CP nets. In a ceteris paribus semantics for deontic logic, a state of affairs where a larger set of prescriptions is respected is preferable to a state of affairs where some of them are violated. Conditional preference nets (CP nets) are a compact formalism to express and analyse ceteris paribus preferences, which nice computational properties. This paper shows how deontic concepts can be captured through conditional preference models. A restricted deontic logic will be defined, and mapped into conditional preference nets. We shall also show how to model contrary to duties obligations in CP nets and how to capture in this formalism the distinction between strong and weak permission.


math.AP math.DS physics.ao-ph physics.flu-dyn

Shallow water equations on a fast rotating surface. We prove that for rotating shallow water equations on a surface of revolution with variable Coriolis parameter and vanishing Rossby and Froude numbers, the classical solution satisfies uniform estimates on a fixed time interval with no dependence on the small parameters. Upon a transformation using the solution operator associated with the large operator, the solution converges strongly to a limit for which the governing equation is given. We also characterize the kernel of the large operator and define a projection onto that kernel. With these tools, we are able to show that the time averages of the solution are close to longitude independent zonal flows and height field.


Equilibrium states which are not Gibbs measure on hereditary subshifts. In this paper, we consider which kind of invariant measure on hereditary subshifts is not Gibbs measure. For the hereditary closure of a subshift (X,S) , we prove that in some situation, the invariant measure nu B p,1 p can not be a Gibbs measure where nu is an invariant measure on (X,S) . As an application, we show that for some B free subshifts, the unique equilibrium state nu eta B p,1 p is not Gibbs measure.


AuditShare Sensitive Data Sharing with Reliable Leaker Identification. As Personally Identifiable Information (PII) data sharing among multiple parties becomes increasingly common, so does the potential for data leakage. As required by new data protection regulations and laws, when PII leakage occurs, one must be able to reliably identify the leaking sources. Existing solutions utilize watermark technologies or data object allocation strategies to differentiate the data shared with different parties to identify potential leakers. However, these solutions lose their effectiveness under several attack scenarios, e.g., a data sender may leak the data and a receiver may deny the reception of certain shared data. Worse yet, multiple receivers might collude and apply a set of operations such as intersection, complement, and union to their received datasets before leaking them, making the task of leaker identification even more difficult. In this paper, we propose AuditShare, a PII dataset sharing system with reliable leaking source identification. Firstly, taking advantage of the intrinsic properties of PII data, AuditShare allocates data objects to individual sharing parties by PII attributes. Secondly, AuditShare obliviously transfers data between the sender and each receiver and uses a Merkle Tree as an immutable record of the sharing. Thirdly, a knowledge based identification algorithm is proposed to identify a guilty sender or colluding non colluding receivers. Through our evaluation, we show that (i) With a modest amount of leaked data, AuditShare can accurately (accuracy 99.99 ) and undeniably identify all the guilty parties in different cases (ii) It only takes 0.5 second to share 100,000 data objects in AuditShare, which is practical in real world deployment.


Homogeneous CR submanifolds of complex hyperbolic spaces. We classify homogeneous CR submanifolds in complex hyperbolic spaces arising as orbits of a subgroup of the solvable part of the Iwasawa decomposition of the isometry group of the ambient space.


Rank metric codes over arbitrary Galois extensions and rank analogues of Reed Muller codes. This paper extends the study of rank metric codes in extension fields mathbb L equipped with an arbitrary Galois group G mathrm Gal ( mathbb L mathbb K ) . We propose a framework for studying these codes as subspaces of the group algebra mathbb L G , and we relate this point of view with usual notions of rank metric codes in mathbb L N or in mathbb K N times N , where N mathbb L mathbb K . We then adapt the notion of error correcting pairs to this context, in order to provide a non trivial decoding algorithm for these codes. We then focus on the case where G is abelian, which leads us to see codewords as elements of a multivariate skew polynomial ring. We prove that we can bound the dimension of the vector space of zeroes of these polynomials, depending of their degree. This result can be seen as an analogue of Alon F "uredi theorem and by means, of Schwartz Zippel lemma in the rank metric. Finally, we construct the counterparts of Reed Muller codes in the rank metric, and we give their parameters. We also show the connection between these codes and classical Reed Muller codes in the case where mathbb L is a Kummer extension.


Erratum Quantum Montgomery identity and quantum estimates of Ostrowski type inequalities. We disprove and correct some recently obtained results regarding Montgomery identity for quantum integral operator and Ostrowski type inequalities involving convex functions.


Zero cycles on double EPW sextics. The Chow rings of hyperK "ahler varieties are conjectured to have a particularly rich structure. In this paper, we focus on the locally complete family of double EPW sextics and establish some properties of their Chow rings. First we prove a Beauville Voisin type theorem for zero cycles on double EPW sextics precisely, we show that the codimension 4 part of the subring of the Chow ring of a double EPW sextic generated by divisors, the Chern classes and codimension 2 cycles invariant under the anti symplectic covering involution has rank one. Second, for double EPW sextics birational to the Hilbert square of a K3 surface, we show that the action of the anti symplectic involution on the Chow group of zero cycles commutes with the Fourier decomposition of Shen Vial.


Bounded t structures on the category of perfect complexes over a Noetherian ring of finite Krull dimension. We classify bounded t structures on the category of perfect complexes over a commutative, Noetherian ring of finite Krull dimension, extending a result of Alonso Tarrio, Jeremias Lopez and Saorin which covers the regular case. In particular, we show that there are no bounded t structures in the singular case, verifying the affine version of a conjecture of Antieau, Gepner and Heller, and also that there are no non trivial t structures at all in the singular, irreducible case.


Prefix Block Interchanges on Binary and Ternary Strings. The genome rearrangement problem computes the minimum number of operations that are required to sort all elements of a permutation. A block interchange operation exchanges two blocks of a permutation which are not necessarily adjacent and in a prefix block interchange, one block is always the prefix of that permutation. In this paper, we focus on applying prefix block interchanges on binary and ternary strings. We present upper bounds to group and sort a given binary ternary string. We also provide upper bounds for a different version of the block interchange operation which we refer to as the restricted prefix block interchange'. We observe that our obtained upper bound for restricted prefix block interchange operations on binary strings is better than that of other genome rearrangement operations to group fully normalized binary strings. Consequently, we provide a linear time algorithm to solve the problem of grouping binary normalized strings by restricted prefix block interchanges. We also provide a polynomial time algorithm to group normalized ternary strings by prefix block interchange operations. Finally, we provide a classification for ternary strings based on the required number of prefix block interchange operations.


An a posteriori error analysis for the equations of stationary incompressible magnetohydrodynamics. Magnetohydrodynamics (MHD) is a continuum level model for conducting fluids subject to external magnetic fields, e.g. plasmas and liquid metals. The efficient and robust solution of the MHD system poses many challenges due to it's nonlinear, non self adjoint, and highly coupled nature. In this paper, we develop a robust and accurate a posteriori error estimate for the numerical solution of the MHD equations based on the exact penalty method. The error estimate also isolates particular contributions of error in a quantity of interest (QoI) to inform discretization choices to arrive at accurate solutions. The tools required for these estimates involve duality arguments and computable residuals.


Deep learning for subgrid scale turbulence modeling in large eddy simulations of the atmospheric boundary layer. In large eddy simulations, subgrid scale (SGS) processes are parameterized as a function of filtered grid scale variables. First order, algebraic SGS models are based on the eddy viscosity assumption, which does not always hold for turbulence. Here we apply supervised deep neural networks (DNNs) to learn SGS stresses from a set of neighboring coarse grained velocity from direct numerical simulations (DNSs) of the atmospheric boundary layer at friction Reynolds numbers Re tau up to 1243 without invoking the eddy viscosity assumption. The DNN model was found to produce higher correlation of SGS stresses compared to the Smagorinsky model and the Smagorinsky Bardina mixed model in the surface and mixed layers and can be applied to different grid resolutions and various stability conditions ranging from near neutral to very unstable. The additional information on potential temperature and pressure were found not to be useful for SGS modeling. Deep learning thus demonstrates great potential for LESs of geophysical turbulence.


Balanced Identification as an Intersection of Optimization and Distributed Computing. Technology of formal quantitative estimation of the conformity of the mathematical models to the available dataset is presented. Main purpose of the technology is to make easier the model selection decision making process for the researcher. The technology is a combination of approaches from the areas of data analysis, optimization and distributed computing including cross validation and regularization methods, algebraic modelling in optimization and methods of optimization, automatic discretization of differential and integral equation, optimization REST services. The technology is illustrated by a demo case study. General mathematical formulation of the method is presented. It is followed by description of the main aspects of algorithmic and software implementation. Success story list of the presented approach already is rather long. Nevertheless, domain of applicability and important unresolved issues are discussed.


Moving between weights of weight modules. In Lie theory the partial sum property (PSP) says that for a root system in any Kac Moody algebra, every positive root is an ordered sum of simple roots whose partial sums are all roots. In this paper, we present two generalizations 1) "Parabolic generalization" if I is a subset of simple roots, every root with positive I height is an ordered sum of roots of I height 1, whose partial sums are all roots. In fact we show this on the Lie algebra level, by showing that every root space is spanned by the Lie words formed from root vectors of I height 1. As an application, we provide a "minimal" description for the set of weights of every (non integrable) simple highest weight module over any Kac Moody algebra. This seems to be novel even in finite type. 2) Generalization to weights of weight modules the PSP gives a chain of roots between 0 (fixed) and any positive root. We generalize this to the weights of weight modules to get a chain of weights between any two comparable weights. This was shown by S. Kumar for any finite dimensional simple module over a semisimple Lie algebra. In this paper, we extend this result to (i) a large class of highest weight modules over any Kac Moody algebra mathfrak g , which includes all simple highest weight modules over mathfrak g (ii) more generally, for non highest weight modules such as mathfrak g itself (adjoint representation) and arbitrary submodules of parabolic Verma modules over mathfrak g (iii) arbitrary integrable modules over semisimple mathfrak g . Additionally, we also prove the "parabolic" generalizations of this second generalization to the best possible extent. We also find all the highest weight modules which have their sets of weights same as those of parabolic Verma modules and provide a Minkowski difference formula for weights of arbitrary highest weight modules over Kac Moody mathfrak g .


Don't Explain without Verifying Veracity An Evaluation of Explainable AI with Video Activity Recognition. Explainable machine learning and artificial intelligence models have been used to justify a model's decision making process. This added transparency aims to help improve user performance and understanding of the underlying model. However, in practice, explainable systems face many open questions and challenges. Specifically, designers might reduce the complexity of deep learning models in order to provide interpretability. The explanations generated by these simplified models, however, might not accurately justify and be truthful to the model. This can further add confusion to the users as they might not find the explanations meaningful with respect to the model predictions. Understanding how these explanations affect user behavior is an ongoing challenge. In this paper, we explore how explanation veracity affects user performance and agreement in intelligent systems. Through a controlled user study with an explainable activity recognition system, we compare variations in explanation veracity for a video review and querying task. The results suggest that low veracity explanations significantly decrease user performance and agreement compared to both accurate explanations and a system without explanations. These findings demonstrate the importance of accurate and understandable explanations and caution that poor explanations can sometimes be worse than no explanations with respect to their effect on user performance and reliance on an AI system.


The Role of PDE Based Parameterization Techniques in Gradient Based IGA Shape Optimization Applications. This paper proposes a shape optimization algorithm based on the principles of Isogeometric Analysis (IGA) in which the parameterization of the geometry enters the problem formulation as an additional PDE constraint. Inspired by the isoparametric principle of IGA, the parameterization and the governing state equation are treated using the same numerical technique. This leads to a scheme that is comparatively easy to differentiate, allowing for a fully symbolic derivation of the gradient and subsequent gradient based optimization. To improve the efficiency and robustness of the scheme, the basis is re selected during each optimization iteration and adjusted to the current needs. The scheme is validated in two test cases.


On Supervised Classification of Feature Vectors with Independent and Non Identically Distributed Elements. In this paper, we investigate the problem of classifying feature vectors with mutually independent but non identically distributed elements. First, we show the importance of this problem. Next, we propose a classifier and derive an analytical upper bound on its error probability. We show that the error probability goes to zero as the length of the feature vectors grows, even when there is only one training feature vector per label available. Thereby, we show that for this important problem at least one asymptotically optimal classifier exists. Finally, we provide numerical examples where we show that the performance of the proposed classifier outperforms conventional classification algorithms when the number of training data is small and the length of the feature vectors is sufficiently high.


Self Paced Learning for Neural Machine Translation. Recent studies have proven that the training of neural machine translation (NMT) can be facilitated by mimicking the learning process of humans. Nevertheless, achievements of such kind of curriculum learning rely on the quality of artificial schedule drawn up with the handcrafted features, e.g. sentence length or word rarity. We ameliorate this procedure with a more flexible manner by proposing self paced learning, where NMT model is allowed to 1) automatically quantify the learning confidence over training examples and 2) flexibly govern its learning via regulating the loss in each iteration step. Experimental results over multiple translation tasks demonstrate that the proposed model yields better performance than strong baselines and those models trained with human designed curricula on both translation quality and convergence speed.


Practical Verification of MapReduce Computation Integrity via Partial Re execution. Big data processing is often outsourced to powerful, but untrusted cloud service providers that provide agile and scalable computing resources to weaker clients. However, untrusted cloud services do not ensure the integrity of data and computations while clients have no control over the outsourced computation or no means to check the correctness of the execution. Despite a growing interest and recent progress in verifiable computation, the existing techniques are still not practical enough for big data processing due to high verification overhead. In this paper, we present a solution called V MR (Verifiable MapReduce), which is a framework that verifies the integrity of MapReduce computation outsourced in the untrusted cloud via partial re execution. V MR is practically effective and efficient in that (1) it can detect the violation of MapReduce computation integrity and identify the malicious workers involved in the that produced the incorrect computation. (2) it can reduce the overhead of verification via partial re execution with carefully selected input data and program code using program analysis. The experiment results of a prototype of V MR show that V MR can verify the integrity of MapReduce computation effectively with small overhead for partial re execution.


Codimension one foliations with trivial canonical class on singular spaces II. In this article, we give the structure of codimension one foliations with canonical singularities and numerically trivial canonical class on varieties with klt singularities. Building on recent works of Spicer, Cascini Spicer and Spicer Svaldi, we then describe the birational geometry of rank two foliations with canonical singularities and canonical class of numerical dimension zero on complex projective threefolds.


RankBooster Visual Analysis of Ranking Predictions. Ranking is a natural and ubiquitous way to facilitate decision making in various applications. However, different rankings are often used for the same set of entities, with each ranking method placing emphasis on different factors. These factors can also be multi dimensional in nature, compounding the problem. This complexity can make it challenging for an entity which is being ranked to understand what they can do to improve their rankings, and to analyze the effect of changes in various factors to their overall rank. In this paper, we present RankBooster, a novel visual analytics system to help users conveniently investigate ranking predictions. We take university rankings as an example and focus on helping universities to better explore their rankings, where they can compare themselves to their rivals in key areas as well as overall. Novel visualizations are proposed to enable efficient analysis of rankings, including a Scenario Analysis View to show a high level summary of different ranking scenarios, a Relationship View to visualize the influence of each attribute on different indicators and a Rival View to compare the ranking of a university and those of its rivals. A case study demonstrates the usefulness and effectiveness of RankBooster in facilitating the visual analysis of ranking predictions and helping users better understand their current situation.


Evolutionary dynamics with game transitions. The environment has a strong influence on a population's evolutionary dynamics. Driven by both intrinsic and external factors, the environment is subject to continual change in nature. To capture an ever changing environment, we consider a model of evolutionary dynamics with game transitions, where individuals' behaviors together with the games they play in one time step influence the games to be played next time step. Within this model, we study the evolution of cooperation in structured populations and find a simple rule weak selection favors cooperation over defection if the ratio of the benefit provided by an altruistic behavior, b , to the corresponding cost, c , exceeds k k' , where k is the average number of neighbors of an individual and k' captures the effects of the game transitions. Even if cooperation cannot be favored in each individual game, allowing for a transition to a relatively valuable game after mutual cooperation and to a less valuable game after defection can result in a favorable outcome for cooperation. In particular, small variations in different games being played can promote cooperation markedly. Our results suggest that simple game transitions can serve as a mechanism for supporting prosocial behaviors in highly connected populations.


On ell distance balanced product graphs. A graph G is ell distance balanced if for each pair of vertices x and y at distance ell in G , the number of vertices closer to x than to y is equal to the number of vertices closer to y than to x . A complete characterization of ell distance balanced corona products is given and a characterization of lexicographic products for ell ge 3 , thus complementing known results for ell in 1,2 and correcting an earlier related assertion. A sufficient condition on H which guarantees that K n , square , H is ell distance balanced is given and it is proved that if K n , square , H is ell distance balanced, then H is an ell distance balanced graph. A known characterization of 1 distance balanced graphs is extended to ell distance balanced graphs, again correcting an earlier claimed assertion.


On the construction of tame supercuspidal representations. Let F be a non archimedean local field of odd residual characteristic. Let G be a (connected) reductive group over F that splits over a tamely ramified field extension of F. We revisit Yu's construction of smooth complex representations of G(F) from a slightly different perspective and provide a proof that the resulting representations are supercuspidal. We also provide a counterexample to Proposition 14.1 and Theorem 14.2 in Yu01 , whose proofs relied on a typo in a reference.


Faster Smarter Induction in Isabelle HOL. Proof by induction plays a critical role in formal verification and mathematics at large. However, its automation remains as one of the long standing challenges in Computer Science. To address this problem, we developed sem ind. Given inductive problem, sem ind recommends what arguments to pass to the induct method. To improve the accuracy of sem ind, we introduced definitional quantifiers, a new kind of quantifiers that allow us to investigate not only the syntactic structures of inductive problems but also the definitions of relevant constants in a domain agnostic style. Our evaluation shows that compared to its predecessor sem ind improves the accuracy of recommendation from 20.1 to 38.2 for the most promising candidates within 5.0 seconds of timeout while decreasing the median value of execution time from 2.79 seconds to 1.06 seconds.


Sparse Hierarchical Preconditioners Using Piecewise Smooth Approximations of Eigenvectors. When solving linear systems arising from PDE discretizations, iterative methods (such as Conjugate Gradient, GMRES, or MINRES) are often the only practical choice. To converge in a small number of iterations, however, they have to be coupled with an efficient preconditioner. The efficiency of the preconditioner depends largely on its accuracy on the eigenvectors corresponding to small eigenvalues, and unfortunately, black box methods typically cannot guarantee sufficient accuracy on these eigenvectors. Thus, constructing the preconditioner becomes a problem dependent task. However, for a large class of problems, including many elliptic equations, the eigenvectors corresponding to small eigenvalues are smooth functions of the PDE grid. In this paper, we describe a hierarchical approximate factorization approach which focuses on improving accuracy on the smooth eigenvectors. The improved accuracy is achieved by preserving the action of the factorized matrix on piecewise polynomial functions of the grid. Based on the factorization, we propose a family of sparse preconditioners with O(n) or O(n log n ) construction complexities. Our methods exhibit the optimal O(n) solution times in benchmarks run on large elliptic problems of different types, arising for example in flow or mechanical simulations. In the case of the linear elasticity equation the preconditioners are exact on the near kernel rigid body modes.


Correcting Decalibration of Stereo Cameras in Self Driving Vehicles. We address the problem of optical decalibration in mobile stereo camera setups, especially in context of autonomous vehicles. In real world conditions, an optical system is subject to various sources of anticipated and unanticipated mechanical stress (vibration, rough handling, collisions). Mechanical stress changes the geometry between the cameras that make up the stereo pair, and as a consequence, the pre calculated epipolar geometry is no longer valid. Our method is based on optimization of camera geometry parameters and plugs directly into the output of the stereo matching algorithm. Therefore, it is able to recover calibration parameters on image pairs obtained from a decalibrated stereo system with minimal use of additional computing resources. The number of successfully recovered depth pixels is used as an objective function, which we aim to maximize. Our simulation confirms that the method can run constantly in parallel to stereo estimation and thus help keep the system calibrated in real time. Results confirm that the method is able to recalibrate all the parameters except for the baseline distance, which scales the absolute depth readings. However, that scaling factor could be uniquely determined using any kind of absolute range finding methods (e.g. a single beam time of flight sensor).


Requirements Towards Predictive Simulations of Turbulent Reacting Flows. Significant progress has been made on the model development for simulating turbulent reacting flows. As a consequence, we are currently in a position where key physical aspects of fairly complex combustion processes are well understood at a qualitative and in many cases also at a quantitative level. Examples are the prediction of temperature and major species, statistically stationary flames, gas phase combustion, turbulent transport, and turbulence flame coupling. However, current challenges lie in capturing transient processes and stability boundaries, minor species and emissions, multiphase flows and phase transition, as well as multidimensional flame flow interactions that may involve flame curvature effects, stratification, partially premixing, or flame wall interaction. With this, the question arises what steps need to be taken to elevate the current state of modeling capabilities in order to address these deficiencies? This paper seeks to address this question. We begin by reviewing the current state of combustion model approaches, our quest for improving existing models, the separation of errors arising from numerical discretization and physical models, and ideas on model evaluations. We then proceed by examining concepts on quantitative model evaluations, requirements on predictability, quantities of interest, and cost accuracy trade offs. We close by introducing recent concepts that assimilate time resolved measurements into numerical simulations for state estimation, model evaluation, and parameter determination.


In air microfluidics enables rapid fabrication of emulsions, suspensions, and 3D modular (bio)materials. Microfluidic chips provide unparalleled control over droplets and jets, which have advanced all natural sciences. However, microfluidic applications could be vastly expanded by increasing the per channel throughput and directly exploiting the output of chips for rapid additive manufacturing. We unlock these features with in air microfluidics, a new chip free platform to manipulate microscale liquid streams in the air. By controlling the composition and in air impact of liquid microjets by surface tension driven encapsulation, we fabricate monodisperse emulsions, particles, and fibers with diameters of 20 to 300um at rates that are 10 to 100 times higher than chip based droplet microfluidics. Furthermore, in air microfluidics uniquely enables module based production of three dimensional (3D) multiscale (bio)materials in one step because droplets are partially solidified in flight and can immediately be printed onto a substrate. In air microfluidics is cytocompatible, as demonstrated by additive manufacturing of 3D modular constructs with tailored micro environments for multiple cell types. Its in line control, high throughput and resolution, and cytocompatibility make in air microfluidics a versatile platform technology for science, industry, and health care.


GraphDialog Integrating Graph Knowledge into End to End Task Oriented Dialogue Systems. End to end task oriented dialogue systems aim to generate system responses directly from plain text inputs. There are two challenges for such systems one is how to effectively incorporate external knowledge bases (KBs) into the learning framework the other is how to accurately capture the semantics of dialogue history. In this paper, we address these two challenges by exploiting the graph structural information in the knowledge base and in the dependency parsing tree of the dialogue. To effectively leverage the structural information in dialogue history, we propose a new recurrent cell architecture which allows representation learning on graphs. To exploit the relations between entities in KBs, the model combines multi hop reasoning ability based on the graph structure. Experimental results show that the proposed model achieves consistent improvement over state of the art models on two different task oriented dialogue datasets.


Privacy Aware Recommendation with Private Attribute Protection using Adversarial Learning. Recommendation is one of the critical applications that helps users find information relevant to their interests. However, a malicious attacker can infer users' private information via recommendations. Prior work obfuscates user item data before sharing it with recommendation system. This approach does not explicitly address the quality of recommendation while performing data obfuscation. Moreover, it cannot protect users against private attribute inference attacks based on recommendations. This work is the first attempt to build a Recommendation with Attribute Protection (RAP) model which simultaneously recommends relevant items and counters private attribute inference attacks. The key idea of our approach is to formulate this problem as an adversarial learning problem with two main components the private attribute inference attacker, and the Bayesian personalized recommender. The attacker seeks to infer users' private attribute information according to their items list and recommendations. The recommender aims to extract users' interests while employing the attacker to regularize the recommendation process. Experiments show that the proposed model both preserves the quality of recommendation service and protects users against private attribute inference attacks.


Accurate and Compact Convolutional Neural Networks with Trained Binarization. Although convolutional neural networks (CNNs) are now widely used in various computer vision applications, its huge resource demanding on parameter storage and computation makes the deployment on mobile and embedded devices difficult. Recently, binary convolutional neural networks are explored to help alleviate this issue by quantizing both weights and activations with only 1 single bit. However, there may exist a noticeable accuracy degradation when compared with full precision models. In this paper, we propose an improved training approach towards compact binary CNNs with higher accuracy. Trainable scaling factors for both weights and activations are introduced to increase the value range. These scaling factors will be trained jointly with other parameters via backpropagation. Besides, a specific training algorithm is developed including tight approximation for derivative of discontinuous binarization function and L 2 regularization acting on weight scaling factors. With these improvements, the binary CNN achieves 92.3 accuracy on CIFAR 10 with VGG Small network. On ImageNet, our method also obtains 46.1 top 1 accuracy with AlexNet and 54.2 with Resnet 18 surpassing previous works.


An upper bound and criteria for the Galois group of weighted walks with rational coefficients in the quarter plane. Using Mazur's theorem on torsions of elliptic curves, an upper bound 24 for the order of the finite Galois group mathcal H associated with weighted walks in the quarter plane mathbb Z 2 is obtained. The explicit criterion for mathcal H to have order 4 or 6 is rederived by simple geometric argument. Using division polynomials, a recursive criterion for mathcal H having order 4m or 4m 2 is also obtained. As a corollary, explicit criterion for mathcal H to have order 8 is given and is much simpler than the existing method.


Anomalous dissipation of energy and magnetic helicity for the electron MHD system. Via convex integration, we construct weak solutions to the non resistive electron MHD system which do not conserve energy and magnetic helicity.


Sub Linear Memory How to Make Performers SLiM. The Transformer architecture has revolutionized deep learning on sequential data, becoming ubiquitous in state of the art solutions for a wide variety of applications. Yet vanilla Transformers are notoriously resource expensive, requiring O(L 2) in serial time and memory as functions of input length L . Recent works proposed various linear self attention mechanisms, scaling only as O(L) for serial computation. We perform a thorough analysis of recent Transformer mechanisms with linear self attention, Performers, in terms of overall computational complexity. We observe a remarkable computational flexibility forward and backward propagation can be performed with no approximations using sublinear memory as a function of L (in addition to negligible storage for the input sequence), at a cost of greater time complexity in the parallel setting. In the extreme case, a Performer consumes only O(1) memory during training, and still requires O(L) time. This discovered time memory tradeoff can be used for training or, due to complete backward compatibility, for fine tuning on a low memory device, e.g. a smartphone or an earlier generation GPU, thus contributing towards decentralized and democratized deep learning.


A Theorem of Roe and Strichartz on homogeneous trees. In 1980, J. Roe proved that if f k k in mathbb Z is doubly infinite sequence of functions in mathbb R which is uniformly bounded and satisfies (df k dx) f k 1 for all k in mathbb Z then f 0 (x) a sin(x theta) for some a, theta in mathbb R . Later in 1993 Strichartz suitably extended the above result to mathbb R n . In this article we prove a version of their result for homogeneous trees.


Visibility Polygons and Visibility Graphs among Dynamic Polygonal Obstacles in the Plane. We devise an algorithm for maintaining the visibility polygon of any query point in a dynamic polygonal domain, i.e., as the polygonal domain is modified with vertex insertions and deletions to its obstacles, we update the data structures that store the visibility polygon of the query point. After preprocessing the initial input polygonal domain to build a few data structures, our algorithm takes O(k( lg VP cal P' (q) ) ( lg n' ) 2 h) (resp. O(k( lg n') 2 ( lg VP cal P' (q) ) h)) worst case time to update data structures that store visibility polygon VP cal P' (q) of a query point q when any vertex v is inserted to (resp. deleted from) any obstacle of the current polygonal domain cal P'. Here, n' is the number of vertices in cal P', h is the number of obstacles in cal P', VP cal P' (q) is the visibility polygon of q in cal P' ( VP cal P' (q) is the number of vertices of VP cal P' (q)), and k is the number of combinatorial changes in VP cal P' (q) due to the insertion (resp. deletion) of v. As an application of the above algorithm, we also devise an algorithm for maintaining the visibility graph of a dynamic polygonal domain, i.e., as the polygonal domain is modified with vertex insertions and deletions to its obstacles, we update data structures that store the visibility graph of the polygonal domain. After preprocessing the initial input polygonal domain, our dynamic algorithm takes O(k( lg n' ) 2 h) (resp. O(k( lg n' ) 2 h)) worst case time to update data structures that store the visibility graph when any vertex v is inserted to (resp. deleted from) any obstacle of the current polygonal domain cal P'. Here, n' is the number of vertices in cal P', h is the number of obstacles in cal P', and k is the number of combinatorial changes in the visibility graph of cal P' due to the insertion (resp. deletion) of v.


An approximation to zeros of the Riemann zeta function using fractional calculus. In this document, as far as the authors know, an approximation to the zeros of the Riemann zeta function has been obtained for the first time using only derivatives of constant functions, which was possible only because a fractional iterative method was used. This iterative method, valid for one and several variables, uses the properties of fractional calculus, in particular the fact that the fractional derivatives of constants are not always zero, to find multiple zeros of a function using a single initial condition. This partly solves the intrinsic problem of iterative methods that if we want to find N zeros it is necessary to give N initial conditions. Consequently, the method is suitable for approximating nontrivial zeros of the Riemann zeta function when the absolute value of its imaginary part tends to infinity. The deduction of the iterative method is presented, some examples of its implementation, and finally 53 different values near to the zeros of the Riemann zeta function are shown.


An estimate for spherical functions on mathrm SL (3, mathbb R ) . We prove an estimate for spherical functions phi lambda(a) on mathrm SL (3, mathbb R ) , establishing uniform decay in the spectral parameter lambda when the group parameter a is restricted to a compact subset of the abelian subgroup mathrm A . In the case of mathrm SL (3, mathbb R ) , it improves a result by J.J. Duistermaat, J.A.C. Kolk and V.S. Varadarajan by removing the limitation that a should remain regular. As in their work, we estimate the oscillatory integral that appears in the integral formula for spherical functions by the method of stationary phase. However, the major difference is that we investigate the stability of the singularities arising from the linearized phase function by classifying their local normal forms when the parameters lambda and a vary.


Surface Impedance Modeling of All Dielectric Metasurfaces. We develop a simple and reliable analytical model that allows describing the electromagnetic response of all dielectric metasurfaces consisting of a single layer array of high permittivity spherical particles. By combining Mie theory with a bi dimensional homogenization approach, we derive closed form expressions of the electric and magnetic surface impedances exhibited by the metasurface and, thus, its reflection and transmission coefficients. The effectiveness of the proposed approach is validated through a set of full wave simulations. The availability of the analytical model here developed allows a more in depth understanding of the complex scattering response of these electromagnetic structures and enables the design of innovative devices operating throughout the whole electromagnetic spectrum, including, for example, unconventional reflectors for antennas, broadband optical mirrors, and highly efficient nanoantenna reflectarrays.


Nonlocal Bertrand and Cournot Mean Field Games with General Nonlinear Demand Schedule. In this article we prove the existence of classical solutions to a system of mean field games arising in the study of exhaustible resource production under market competition. Individual trajectories are modeled by a controlled diffusion process with jumps, which adds a nonlocal term to the PDE system. The assumptions on the Hamiltonian are sufficiently general to cover a large class of examples proposed in the literature on Bertrand and Cournot mean field games. Uniqueness also holds under a sufficient restriction on the structure of the Hamiltonian, which in practice amounts to a small upper bound on the substitutability of goods.


Learning to Answer Ambiguous Questions with Knowledge Graph. In the task of factoid question answering over knowledge base, many questions have more than one plausible interpretation. Previous works on SimpleQuestions assume only one interpretation as the ground truth for each question, so they lack the ability to answer ambiguous questions correctly. In this paper, we present a new way to utilize the dataset that takes into account the existence of ambiguous questions. Then we introduce a simple and effective model which combines local knowledge subgraph with attention mechanism. Our experimental results show that our approach achieves outstanding performance in this task.


Hopf Galois structures on finite extensions with quasisimple Galois group. Let L K be a finite Galois extension of fields with Galois group G . It is known that L K admits exactly two Hopf Galois structures when G is non abelian simple. In this paper, we extend this result to the case when G is quasisimple.


Efficient computation of the density matrix with error control on distributed computer systems. The recursive polynomial expansion for construction of a density matrix approximation with rigorous error control J. Chem. Phys. 128, 074106 (2008) is implemented in the quantum chemistry program Ergo SoftwareX 7, 107 (2018) using the Chunks and Tasks matrix library Parallel Comput. 57, 87 (2016) . The expansion is based on second order polynomials and accelerated by the scale and fold technique J. Chem. Theory Comput. 7, 1233 (2011) . We evaluate the performance of the implementation by computing the density matrix from the Fock matrix in the large scale self consistent field calculations. We demonstrate that the amount of communicated data per worker process tends to a constant with increasing system size and number of computer nodes such that the amount of work per worker process is fixed.


Haagerup property for wreath products constructed with Thompson's groups. Using recent techniques introduced by Jones we prove that a large family of discrete groups and groupoids have the Haagerup property. In particular, we show that if G is a discrete group with the Haagerup property, then the wreath product oplus Q 2 G rtimes V obtained from the group G and the usual action of Thompson's group V on the dyadic rational Q 2 of the unit interval has the Haagerup property.


Cuspidal edges with the same first fundamental forms along a knot. Letting C be a compact C omega curve embedded in boldsymbol R 3 ( C omega means real analyticity), we consider a C omega cuspidal edge f along C . When C is non closed, in the authors' previous works, the local existence of three distinct cuspidal edges along C whose first fundamental forms coincide with that of f was shown, under a certain reasonable assumption on f . In this paper, if C is closed, that is, C is a knot, we show that there exist infinitely many cuspidal edges along C having the same first fundamental form as that of f such that their images are non congruent to each other, in general.


Discriminative Cross Domain Feature Learning for Partial Domain Adaptation. Partial domain adaptation aims to adapt knowledge from a larger and more diverse source domain to a smaller target domain with less number of classes, which has attracted appealing attention. Recent practice on domain adaptation manages to extract effective features by incorporating the pseudo labels for the target domain to better fight off the cross domain distribution divergences. However, it is essential to align target data with only a small set of source data. In this paper, we develop a novel Discriminative Cross Domain Feature Learning (DCDF) framework to iteratively optimize target labels with a cross domain graph in a weighted scheme. Specifically, a weighted cross domain center loss and weighted cross domain graph propagation are proposed to couple unlabeled target data to related source samples for discriminative cross domain feature learning, where irrelevant source centers will be ignored, to alleviate the marginal and conditional disparities simultaneously. Experimental evaluations on several popular benchmarks demonstrate the effectiveness of our proposed approach on facilitating the recognition for the unlabeled target domain, through comparing it to the state of the art partial domain adaptation approaches.


Using Metrics Suites to Improve the Measurement of Privacy in Graphs. Social graphs are widely used in research (e.g., epidemiology) and business (e.g., recommender systems). However, sharing these graphs poses privacy risks because they contain sensitive information about individuals. Graph anonymization techniques aim to protect individual users in a graph, while graph de anonymization aims to re identify users. The effectiveness of anonymization and de anonymization algorithms is usually evaluated with privacy metrics. However, it is unclear how strong existing privacy metrics are when they are used in graph privacy. In this paper, we study 26 privacy metrics for graph anonymization and de anonymization and evaluate their strength in terms of three criteria monotonicity indicates whether the metric indicates lower privacy for stronger adversaries for within scenario comparisons, evenness indicates whether metric values are spread evenly and for between scenario comparisons, shared value range indicates whether metrics use a consistent value range across scenarios. Our extensive experiments indicate that no single metric fulfills all three criteria perfectly. We therefore use methods from multi criteria decision analysis to aggregate multiple metrics in a metrics suite, and we show that these metrics suites improve monotonicity compared to the best individual metric. This important result enables more monotonic, and thus more accurate, evaluations of new graph anonymization and de anonymization algorithms.


A model of the cubic connectedness locus. We construct a model of the cubic connectedness locus.


Anomaly Detection in Video Data Based on Probabilistic Latent Space Models. This paper proposes a method for detecting anomalies in video data. A Variational Autoencoder (VAE) is used for reducing the dimensionality of video frames, generating latent space information that is comparable to low dimensional sensory data (e.g., positioning, steering angle), making feasible the development of a consistent multi modal architecture for autonomous vehicles. An Adapted Markov Jump Particle Filter defined by discrete and continuous inference levels is employed to predict the following frames and detecting anomalies in new video sequences. Our method is evaluated on different video scenarios where a semi autonomous vehicle performs a set of tasks in a closed environment.


Do Neural Language Models Show Preferences for Syntactic Formalisms?. Recent work on the interpretability of deep neural language models has concluded that many properties of natural language syntax are encoded in their representational spaces. However, such studies often suffer from limited scope by focusing on a single language and a single linguistic formalism. In this study, we aim to investigate the extent to which the semblance of syntactic structure captured by language models adheres to a surface syntactic or deep syntactic style of analysis, and whether the patterns are consistent across different languages. We apply a probe for extracting directed dependency trees to BERT and ELMo models trained on 13 different languages, probing for two different syntactic annotation styles Universal Dependencies (UD), prioritizing deep syntactic relations, and Surface Syntactic Universal Dependencies (SUD), focusing on surface structure. We find that both models exhibit a preference for UD over SUD with interesting variations across languages and layers and that the strength of this preference is correlated with differences in tree shape.


Effectiveness of Distillation Attack and Countermeasure on Neural Network Watermarking. The rise of machine learning as a service and model sharing platforms has raised the need of traitor tracing the models and proof of authorship. Watermarking technique is the main component of existing methods for protecting copyright of models. In this paper, we show that distillation, a widely used transformation technique, is a quite effective attack to remove watermark embedded by existing algorithms. The fragility is due to the fact that distillation does not retain the watermark embedded in the model that is redundant and independent to the main learning task. We design ingrain in response to the destructive distillation. It regularizes a neural network with an ingrainer model, which contains the watermark, and forces the model to also represent the knowledge of the ingrainer. Our extensive evaluations show that ingrain is more robust to distillation attack and its robustness against other widely used transformation techniques is comparable to existing methods.


Policy focused Agent based Modeling using RL Behavioral Models. Agent based Models (ABMs) are valuable tools for policy analysis. ABMs help analysts explore the emergent consequences of policy interventions in multi agent decision making settings. But the validity of inferences drawn from ABM explorations depends on the quality of the ABM agents' behavioral models. Standard specifications of agent behavioral models rely either on heuristic decision making rules or on regressions trained on past data. Both prior specification modes have limitations. This paper examines the value of reinforcement learning (RL) models as adaptive, high performing, and behaviorally valid models of agent decision making in ABMs. We test the hypothesis that RL agents are effective as utility maximizing agents in policy ABMs. We also address the problem of adapting RL algorithms to handle multi agency in games by adapting and extending methods from recent literature. We evaluate the performance of such RL based ABM agents via experiments on two policy relevant ABMs a minority game ABM, and an ABM of Influenza Transmission. We run some analytic experiments on our AI equipped ABMs e.g. explorations of the effects of behavioral heterogeneity in a population and the emergence of synchronization in a population. The experiments show that RL behavioral models are effective at producing reward seeking or reward maximizing behaviors in ABM agents. Furthermore, RL behavioral models can learn to outperform the default adaptive behavioral models in the two ABMs examined.


Scientific Discourse Tagging for Evidence Extraction. Evidence plays a crucial role in any biomedical research narrative, providing justification for some claims and refutation for others. We seek to build models of scientific argument using information extraction methods from full text papers. We present the capability of automatically extracting text fragments from primary research papers that describe the evidence presented in that paper's figures, which arguably provides the raw material of any scientific argument made within the paper. We apply richly contextualized deep representation learning pre trained on biomedical domain corpus to the analysis of scientific discourse structures and the extraction of "evidence fragments" (i.e., the text in the results section describing data presented in a specified subfigure) from a set of biomedical experimental research articles. We first demonstrate our state of the art scientific discourse tagger on two scientific discourse tagging datasets and its transferability to new datasets. We then show the benefit of leveraging scientific discourse tags for downstream tasks such as claim extraction and evidence fragment detection. Our work demonstrates the potential of using evidence fragments derived from figure spans for improving the quality of scientific claims by cataloging, indexing and reusing evidence fragments as independent documents.


Uncertainty quantification for Multiphase CFD simulations of bubbly flows a machine learning based Bayesian approach supported by high resolution experiments. In this paper, we develop a machine learning based Bayesian approach to inversely quantify and reduce the uncertainties of the two fluid model based multiphase computational fluid dynamics (MCFD) for bubbly flow simulations. The proposed approach is supported by high resolution two phase flow measurement techniques, including double sensor conductivity probes, high speed imaging, and particle image velocimetry. Local distribution of key physical quantities of interest (QoIs), including void fraction and phasic velocities, are obtained to support the modular Bayesian inference. In the process, the epistemic uncertainties of the closure relations are inversely quantified, the aleatory uncertainties from stochastic fluctuation of the system are evaluated based on experimental uncertainty analysis. The combined uncertainties are then propagated through the MCFD solver to obtain uncertainties of QoIs, based on which probability boxes are constructed for validation. The proposed approach relies on three machine learning methods feedforward neural networks and principal component analysis for surrogate modeling, and Gaussian processes for model form uncertainty modeling. The whole process is implemented within the framework of open source deep learning library PyTorch with graphics processing unit (GPU) acceleration, thus ensuring the efficiency of the computation. The results demonstrate that with the support of high resolution data, the uncertainty of MCFD simulations can be significantly reduced.


On the Latency of IEEE 802.11ax WLANs with Parameterized Spatial Reuse. In this article, we evaluate the performance of the parameterized spatial reuse (PSR) framework of IEEE 802.11ax, mainly focusing on its impact on transmission latency. Based on detailed standard compliant system level simulations, we provide a realistic analysis of the effects of PSR considering different scenario densities, traffic loads, and access points (APs) antenna capabilities to quantify its performance gains under various scenarios. Our results show that, in medium density scenarios, PSR can offer up to a 3.8x reduction in the 5 worst case latencies for delay sensitive stations with respect to an 802.11ax system without PSR. Moreover, our study demonstrates that, for low latency communications, providing the network with PSR capabilities may be an appealing alternative to the deployment of more costly multi antenna APs.


The Generic Bipartite Graphs of Diameter 3 Their Ages and their Almost Sure Theories. In an effort to find more examples of amalgamation classes whose almost sure theories are the same as their generic theories as well as amalgamation classes whose almost sure theories are different from their generic theories, we address our attention to two new cases the bipartite diameter 3 metrically homogeneous graphs of generic type. These graphs were identified by Cherlin, and are determined by certain forbidden configurations. In this paper, we explicitly identify and enumerate their ages, for which we then establish both unlabeled and labeled 0 1 laws. Finally, we show that for one of these bipartite graphs the almost sure theory matches its generic theory, and for the other bipartite graph it does not.


Fusion of Range and Stereo Data for High Resolution Scene Modeling. This paper addresses the problem of range stereo fusion, for the construction of high resolution depth maps. In particular, we combine low resolution depth data with high resolution stereo data, in a maximum a posteriori (MAP) formulation. Unlike existing schemes that build on MRF optimizers, we infer the disparity map from a series of local energy minimization problems that are solved hierarchically, by growing sparse initial disparities obtained from the depth data. The accuracy of the method is not compromised, owing to three properties of the data term in the energy function. Firstly, it incorporates a new correlation function that is capable of providing refined correlations and disparities, via subpixel correction. Secondly, the correlation scores rely on an adaptive cost aggregation step, based on the depth data. Thirdly, the stereo and depth likelihoods are adaptively fused, based on the scene texture and camera geometry. These properties lead to a more selective growing process which, unlike previous seed growing methods, avoids the tendency to propagate incorrect disparities. The proposed method gives rise to an intrinsically efficient algorithm, which runs at 3FPS on 2.0MP images on a standard desktop computer. The strong performance of the new method is established both by quantitative comparisons with state of the art methods, and by qualitative comparisons using real depth stereo data sets.


Information Theoretic Limits of Cardinality Estimation Fisher Meets Shannon. Estimating the cardinality (number of distinct elements) of a large multiset is a classic problem in streaming and sketching, dating back to Flajolet and Martin's classic Probabilistic Counting (PCSA) algorithm from 1983. In this paper we study the intrinsic tradeoff between the space complexity of the sketch and its estimation error in the random oracle model. We define a new measure of efficiency for cardinality estimators called the Fisher Shannon (Fish) number mathcal H mathcal I . It captures the tension between the limiting Shannon entropy ( mathcal H ) of the sketch and its normalized Fisher information ( mathcal I ), which characterizes the variance of a statistically efficient, asymptotically unbiased estimator. Our results are as follows. We prove that all base q variants of Flajolet and Martin's PCSA sketch have Fish number H 0 I 0 approx 1.98016 and that every base q variant of (Hyper)LogLog has Fish number worse than H 0 I 0 , but that they tend to H 0 I 0 in the limit as q rightarrow infty . Here H 0,I 0 are precisely defined constants. We describe a sketch called Fishmonger that is based on a smoothed, entropy compressed variant of PCSA with a different estimator function. It is proved that with high probability, Fishmonger processes a multiset of U such that at all times, its space is O( log 2 log U) (1 o(1))(H 0 I 0)b approx 1.98b bits and its standard error is 1 sqrt b . We give circumstantial evidence that H 0 I 0 is the optimum Fish number of mergeable sketches for Cardinality Estimation. We define a class of linearizable sketches and prove that no member of this class can beat H 0 I 0 . The popular mergeable sketches are, in fact, also linearizable.


Positive intertwiners for Bessel functions of type B. Let V k denote Dunkl's intertwining operator for the root sytem B n with multiplicity k (k 1,k 2) with k 1 geq 0, k 2 0 . It was recently shown that the positivity of the operator V k prime !,k V k prime circ V k 1 which intertwines the Dunkl operators associated with k and k prime (k 1 h,k 2) implies that h in k 2(n 1), infty , cup ,( 0,k 2, ldots,k 2(n 1) mathbb Z ) . This is also a necessary condition for the existence of positive Sonine formulas between the associated Bessel functions. In this paper we present two partial converse positive results For k 1 geq 0, ,k 2 in 1 2,1,2 and h k 2(n 1) , the operator V k prime !,k is positive when restricted to functions which are invariant under the Weyl group, and there is an associated positive Sonine formula for the Bessel functions of type B n . Moreover, the same positivity results hold for arbitrary k 1 geq 0, k 2 0 and h in k 2 cdot mathbb Z . The proof is based on a formula of Baker and Forrester on connection coefficients between multivariate Laguerre polynomials and an approximation of Bessel functions by Laguerre polynomials.


Some finiteness results for algebraic groups and unramified cohomology over higher dimensional fields. We formulate and analyze several finiteness conjectures for linear algebraic groups over higher dimensional fields. In fact, we prove all of these conjectures for algebraic tori as well as in some other situations. This work relies in an essential way on several finiteness results for unramified cohomology.


Consistent and Flexible Selectivity Estimation for High Dimensional Data. Selectivity estimation aims at estimating the number of database objects that satisfy a selection criterion. Answering this problem accurately and efficiently is essential to many applications, such as density estimation, outlier detection, query optimization, and data integration. The estimation problem is especially challenging for large scale high dimensional data due to the curse of dimensionality, the large variance of selectivity across different queries, and the need to make the estimator consistent (i.e., the selectivity is non decreasing in the threshold). We propose a new deep learning based model that learns a query dependent piecewise linear function as selectivity estimator, which is flexible to fit the selectivity curve of any distance function and query object, while guaranteeing that the output is non decreasing in the threshold. To improve the accuracy for large datasets, we propose to partition the dataset into multiple disjoint subsets and build a local model on each of them. We perform experiments on real datasets and show that the proposed model consistently outperforms state of the art models in accuracy in an efficient way and is useful for real applications.


IFQ Net Integrated Fixed point Quantization Networks for Embedded Vision. Deploying deep models on embedded devices has been a challenging problem since the great success of deep learning based networks. Fixed point networks, which represent their data with low bits fixed point and thus give remarkable savings on memory usage, are generally preferred. Even though current fixed point networks employ relative low bits (e.g. 8 bits), the memory saving is far from enough for the embedded devices. On the other hand, quantization deep networks, for example XNOR Net and HWGQNet, quantize the data into 1 or 2 bits resulting in more significant memory savings but still contain lots of floatingpoint data. In this paper, we propose a fixed point network for embedded vision tasks through converting the floatingpoint data in a quantization network into fixed point. Furthermore, to overcome the data loss caused by the conversion, we propose to compose floating point data operations across multiple layers (e.g. convolution, batch normalization and quantization layers) and convert them into fixedpoint. We name the fixed point network obtained through such integrated conversion as Integrated Fixed point Quantization Networks (IFQ Net). We demonstrate that our IFQNet gives 2.16x and 18x more savings on model size and runtime feature map memory respectively with similar accuracy on ImageNet. Furthermore, based on YOLOv2, we design IFQ Tinier YOLO face detector which is a fixed point network with 256x reduction in model size (246k Bytes) than Tiny YOLO. We illustrate the promising performance of our face detector in terms of detection rate on Face Detection Data Set and Bencmark (FDDB) and qualitative results of detecting small faces of Wider Face dataset.


Resources A Safe Language Abstraction for Money. Smart contracts are programs that implement potentially sophisticated transactions on modern blockchain platforms. In the rapidly evolving blockchain environment, smart contract programming languages must allow users to write expressive programs that manage and transfer assets, yet provide strong protection against sophisticated attacks. Addressing this need, we present flexible and reliable abstractions for programming with digital currency in the Move language Blackshear et al. 2019 . Move uses novel linear Girard 1987 resource types with semantics drawing on C 11 Stroustrup 2013 and Rust Matsakis and Klock 2014 when a resource value is assigned to a new memory location, the location previously holding it must be invalidated. In addition, a resource type can only be created or destroyed by procedures inside its declaring module. We present an executable bytecode language with resources and prove that it enjoys resource safety, a conservation property for program values that is analogous to conservation of mass in the physical world.


Heterogeneous Verification of an Autonomous Curiosity Rover. The Curiosity rover is one of the most complex systems successfully deployed in a planetary exploration mission to date. It was sent by NASA to explore the surface of Mars and to identify potential signs of life. Even though it has limited autonomy on board, most of its decisions are made by the ground control team. This hinders the speed at which the Curiosity reacts to its environment, due to the communication delays between Earth and Mars. Depending on the orbital position of both planets, it can take 4 24 minutes for a message to be transmitted between Earth and Mars. If the Curiosity were controlled autonomously, it would be able to perform its activities much faster and more flexibly. However, one of the major barriers to increased use of autonomy in such scenarios is the lack of assurances that the autonomous behaviour will work as expected. In this paper, we use a Robot Operating System (ROS) model of the Curiosity that is simulated in Gazebo and add an autonomous agent that is responsible for high level decision making. Then, we use a mixture of formal and non formal techniques to verify the distinct system components (ROS nodes). This use of heterogeneous verification techniques is essential to provide guarantees about the nodes at different abstraction levels, and allows us to bring together relevant verification evidence to provide overall assurance.


On a Lusin theorem for capacities. Let X be a compact metric space and let v be a sub additive capacity defined on X . We show that Lusin's theorem with respect to v holds if and only if v is continuous from above.


A note on invariance of the Cauchy and related distributions. It is known that if f is an analytic self map of the complex upper half plane which also maps mathbb R cup infty to itself, and f(i) i , then f preserves the Cauchy distribution. This note concerns three results related to the above fact.


The Partial Ricci Flow on mathfrak g foliations. In the paper we introduce new metric structures on mathfrak g foliations that are less rigid than the well known structures almost contact and 3 quasi Sasakian structures as well as f structures with parallelizable kernel and almost para phi structures with complemented frames. We discuss the properties of the new structures in order to demonstrate similarities with the corresponding classical structures. Then using the flow of metrics on a mathfrak g foliation, we build deformation retraction of our structures with positive partial Ricci curvature onto the subspace of the aforementioned classical structures.


VerifyThis 2019 A Program Verification Competition (Extended Report). VerifyThis is a series of program verification competitions that emphasize the human aspect participants tackle the verification of detailed behavioral properties something that lies beyond the capabilities of fully automatic verification, and requires instead human expertise to suitably encode programs, specifications, and invariants. This paper describes the 8th edition of VerifyThis, which took place at ETAPS 2019 in Prague. Thirteen teams entered the competition, which consisted of three verification challenges and spanned two days of work. The report analyzes how the participating teams fared on these challenges, reflects on what makes a verification challenge more or less suitable for the typical VerifyThis participants, and outlines the difficulties of comparing the work of teams using wildly different verification approaches in a competition focused on the human aspect.


Stochastic Localization Methods for Convex Discrete Optimization via Simulation. We develop and analyze a set of new sequential simulation optimization algorithms for large scale multi dimensional discrete optimization via simulation problems with a convexity structure. The "large scale" notion refers to that the decision variable has a large number of values to choose from on each dimension. The proposed algorithms are targeted to identify a solution that is close to the optimal solution given any precision level with any given probability. To achieve this target, utilizing the convexity structure, our algorithm design does not need to scan all the choices of the decision variable, but instead sequentially draws a subset of choices of the decision variable and uses them to "localize" potentially near optimal solutions to an adaptively shrinking region. To show the power of the localization operation, we first consider one dimensional large scale problems. We propose the shrinking uniform sampling algorithm, which is proved to achieve the target with an optimal expected simulation cost under an asymptotic criterion. For multi dimensional problems, we combine the idea of localization with subgradient information and propose a framework to design stochastic cutting plane methods and the dimension reduction algorithm, whose expected simulation cost have a low dependence on the scale and the dimension of the problems. The proposed algorithms do not require prior information about the Lipschitz constant of the objective function and the simulation costs are upper bounded by a value that is independent of the Lipschitz constant. Finally, we propose an adaptive algorithm to deal with the unknown noise variance case under the assumption that the randomness of the system is Gaussian. We implement the proposed algorithms on both synthetic and queueing simulation optimization problems, and demonstrate better performances compared to benchmark methods.


Automorphisms, derivations and central extensions of Lie algebras arising from quantum tori. For a Lie algebra mathfrak g related to a quantum torus, we compute its automorphisms, derivations and universal central extension. This Lie algebra mathfrak g is isomorphic to a subalgebra of the Lie algebra of derivations over the quantum torus, and moreover contains a subalgebra isomorphic to the centerless higher rank Virasoro algebra.


SoccerMap A Deep Learning Architecture for Visually Interpretable Analysis in Soccer. We present a fully convolutional neural network architecture that is capable of estimating full probability surfaces of potential passes in soccer, derived from high frequency spatiotemporal data. The network receives layers of low level inputs and learns a feature hierarchy that produces predictions at different sampling levels, capturing both coarse and fine spatial details. By merging these predictions, we can produce visually rich probability surfaces for any game situation that allows coaches to develop a fine grained analysis of players' positioning and decision making, an as yet little explored area in sports. We show the network can perform remarkably well in the estimation of pass success probability, and present how it can be adapted easily to approach two other challenging problems the estimation of pass selection likelihood and the prediction of the expected value of a pass. Our approach provides a novel solution for learning a full prediction surface when there is only a single pixel correspondence between ground truth outcomes and the predicted probability map. The flexibility of this architecture allows its adaptation to a great variety of practical problems in soccer. We also present a set of practical applications, including the evaluation of passing risk at a player level, the identification of the best potential passing options, and the differentiation of passing tendencies between teams.


Graph Signal Processing Part II Processing and Analyzing Signals on Graphs. The focus of Part I of this monograph has been on both the fundamental properties, graph topologies, and spectral representations of graphs. Part II embarks on these concepts to address the algorithmic and practical issues centered round data signal processing on graphs, that is, the focus is on the analysis and estimation of both deterministic and random data on graphs. The fundamental ideas related to graph signals are introduced through a simple and intuitive, yet illustrative and general enough case study of multisensor temperature field estimation. The concept of systems on graph is defined using graph signal shift operators, which generalize the corresponding principles from traditional learning systems. At the core of the spectral domain representation of graph signals and systems is the Graph Discrete Fourier Transform (GDFT). The spectral domain representations are then used as the basis to introduce graph signal filtering concepts and address their design, including Chebyshev polynomial approximation series. Ideas related to the sampling of graph signals are presented and further linked with compressive sensing. Localized graph signal analysis in the joint vertex spectral domain is referred to as the vertex frequency analysis, since it can be considered as an extension of classical time frequency analysis to the graph domain of a signal. Important topics related to the local graph Fourier transform (LGFT) are covered, together with its various forms including the graph spectral and vertex domain windows and the inversion conditions and relations. A link between the LGFT with spectral varying window and the spectral graph wavelet transform (SGWT) is also established. Realizations of the LGFT and SGWT using polynomial (Chebyshev) approximations of the spectral functions are further considered. Finally, energy versions of the vertex frequency representations are introduced.