Improving the Robustness to Data Inconsistency between Training and Testing for Code Completion by Hierarchical Language Model. In the field of software engineering, applying language models to the token sequence of source code is the state of art approach to build a code recommendation system. The syntax tree of source code has hierarchical structures. Ignoring the characteristics of tree structures decreases the model performance. Current LSTM model handles sequential data. The performance of LSTM model will decrease sharply if the noise unseen data is distributed everywhere in the test suite. As code has free naming conventions, it is common for a model trained on one project to encounter many unknown words on another project. If we set many unseen words as UNK just like the solution in natural language processing, the number of UNK will be much greater than the sum of the most frequently appeared words. In an extreme case, just predicting UNK at everywhere may achieve very high prediction accuracy. Thus, such solution cannot reflect the true performance of a model when encountering noise unseen data. In this paper, we only mark a small number of rare words as UNK and show the prediction performance of models under in project and cross project evaluation. We propose a novel Hierarchical Language Model (HLM) to improve the robustness of LSTM model to gain the capacity about dealing with the inconsistency of data distribution between training and testing. The newly proposed HLM takes the hierarchical structure of code tree into consideration to predict code. HLM uses BiLSTM to generate embedding for sub trees according to hierarchies and collects the embedding of sub trees in context to predict next code. The experiments on inner project and cross project data sets indicate that the newly proposed Hierarchical Language Model (HLM) performs better than the state of art LSTM model in dealing with the data inconsistency between training and testing and achieves averagely 11.2 improvement in prediction accuracy.


Bitopological Duality for Algebras of Fittings logic and Natural Duality extension. In this paper, we investigate a bitopological duality for algebras of Fitting's multi valued logic. We also extend the natural duality theory for mathbb ISP I ( mathcal L ) by developing a duality for mathbb ISP ( mathcal L ) , where mathcal L is a finite algebra in which underlying lattice is bounded distributive.


On the inertia index of a mixed graph with the matching number. A mixed graph widetilde G is obtained by orienting some edges of G , where G is the underlying graph of widetilde G . The positive inertia index, denoted by p (G) , and the negative inertia index, denoted by n (G) , of a mixed graph widetilde G are the integers specifying the numbers of positive and negative eigenvalues of the Hermitian adjacent matrix of widetilde G , respectively. In this paper, we study the positive and negative inertia index of the mixed unicyclic graph. Moreover, we give the upper and lower bounds of the positive and negative inertia index of the mixed graph, and characterize the mixed graphs which attain the upper and lower bounds respectively.


Practical Optimal Control of a Wave Energy Converter in Regular Wave Environments. A generic formulation for the optimal control of a single wave energy converter (WEC) is proposed. The formulation involves hard and soft constraints on the motion of the WEC to promote reduced damage and fatigue to the device during operation. Most of the WEC control literature ignores the cost of the control and could therefore result in generating less power than expected, or even negative power. Therefore, to ensure actual power gains in practice, we incorporate a penalty term in the objective function to approximate the cost of applying the control force. A discretization of the resulting optimal control problem is a quadratic optimization problem that can be solved efficiently using state of the art solvers. Using hydrodynamic coefficients estimated by simulations made in WEC Sim, numerical illustrations are provided of the trade off between careful operation of the device and power generated. Finally, a demonstration of the real time use of the approach is provided.


Iterative Decoding of Trellis Constrained Codes inspired by Amplitude Amplification (Preliminary Version). We propose a decoder for Trellis Constrained Codes, a super class of Turbo and LDPC codes. Inspired by amplitude amplification from quantum computing, we attempt to amplify the relative likelihood of the most likely codeword until it stands out from all other codewords.


Attend to the Difference Cross Modality Person Re identification via Contrastive Correlation. The problem of cross modality person re identification has been receiving increasing attention recently, due to its practical significance. Motivated by the fact that human usually attend to the difference when they compare two similar objects, we propose a dual path cross modality feature learning framework which preserves intrinsic spatial strictures and attends to the difference of input cross modality image pairs. Our framework is composed by two main components a Dual path Spatial structure preserving Common Space Network (DSCSN) and a Contrastive Correlation Network (CCN). The former embeds cross modality images into a common 3D tensor space without losing spatial structures, while the latter extracts contrastive features by dynamically comparing input image pairs. Note that the representations generated for the input RGB and Infrared images are mutually dependant to each other. We conduct extensive experiments on two public available RGB IR ReID datasets, SYSU MM01 and RegDB, and our proposed method outperforms state of the art algorithms by a large margin with both full and simplified evaluation modes.


Twitter Watch Leveraging Social Media to Monitor and Predict Collective Efficacy of Neighborhoods. Sociologists associate the spatial variation of crime within an urban setting, with the concept of collective efficacy. The collective efficacy of a neighborhood is defined as social cohesion among neighbors combined with their willingness to intervene on behalf of the common good. Sociologists measure collective efficacy by conducting survey studies designed to measure individuals' perception of their community. In this work, we employ the curated data from a survey study (ground truth) and examine the effectiveness of substituting costly survey questionnaires with proxies derived from social media. We enrich a corpus of tweets mentioning a local venue with several linguistic and topological features. We then propose a pairwise learning to rank model with the goal of identifying a ranking of neighborhoods that is similar to the ranking obtained from the ground truth collective efficacy values. In our experiments, we find that our generated ranking of neighborhoods achieves 0.77 Kendall tau x ranking agreement with the ground truth ranking. Overall, our results are up to 37 better than traditional baselines.


Distributed Machine Learning for Predictive Analytics in Mobile Edge Computing Based IoT Environments. Predictive analytics in Mobile Edge Computing (MEC) based Internet of Things (IoT) is becoming a high demand in many real world applications. A prediction problem in an MEC based IoT environment typically corresponds to a collection of tasks with each task solved in a specific MEC environment based on the data accumulated locally, which can be regarded as a Multi task Learning (MTL) problem. However, the heterogeneity of the data (non IIDness) accumulated across different MEC environments challenges the application of general MTL techniques in such a setting. Federated MTL (FMTL) has recently emerged as an attempt to address this issue. Besides FMTL, there exists another powerful but under exploited distributed machine learning technique, called Network Lasso (NL), which is inherently related to FMTL but has its own unique features. In this paper, we made an in depth evaluation and comparison of these two techniques on three distinct IoT datasets representing real world application scenarios. Experimental results revealed that NL outperformed FMTL in MEC based IoT environments in terms of both accuracy and computational efficiency.


A Practical Blockchain Framework using Image Hashing for Image Authentication. Blockchain is a relatively new technology that can be seen as a decentralised database. Blockchain systems heavily rely on cryptographic hash functions to store their data, which makes it difficult to tamper with any data stored in the system. A topic that was researched along with blockchain is image authentication. Image authentication focuses on investigating and maintaining the integrity of images. As a blockchain system can be useful for maintaining data integrity, image authentication has the potential to be enhanced by blockchain. There are many techniques that can be used to authenticate images the technique investigated by this work is image hashing. Image hashing is a technique used to calculate how similar two different images are. This is done by converting the images into hashes and then comparing them using a distance formula. To investigate the topic, an experiment involving a simulated blockchain was created. The blockchain acted as a database for images. This blockchain was made up of devices which contained their own unique image hashing algorithms. The blockchain was tested by creating modified copies of the images contained in the database, and then submitting them to the blockchain to see if it will return the original image. Through this experiment it was discovered that it is plausible to create an image authentication system using blockchain and image hashing. However, the design proposed by this work requires refinement, as it appears to struggle in some situations. This work shows that blockchain can be a suitable approach for authenticating images, particularly via image hashing. Other observations include that using multiple image hash algorithms at the same time can increase performance in some cases, as well as that each type of test done to the blockchain has its own unique pattern to its data.


Equidistribution of horospheres on moduli spaces of hyperbolic surfaces. Given a simple closed curve gamma on a connected, oriented, closed surface S of negative Euler characteristic, Mirzakhani showed that the set of points in the moduli space of hyperbolic structures on S having a simple closed geodesic of length L of the same topological type as gamma equidistributes with respect to a natural probability measure as L to infty . We prove several generalizations of Mirzakhani's result and discuss some of the technical aspects ommited in her original work. The dynamics of the earthquake flow play a fundamental role in the arguments in this paper.


Cuspidal modules for the derivation Lie algebra over a rational quantum torus. Let mathbb C Q denote a rational quantum torus with d variables, and mathcal Z be the centre of mathbb C Q . In this paper we give a explicit description of the structure of the cuspidal modules for the derivation Lie algebra mathcal D over mathbb C Q , with an extra associative mathcal Z action.


Scattering asymmetry and second Kerker condition. The nearly zero optical forward scattering and anti dual conditions are usually associated to the so called second Kerker condition, at which the electric and magnetic responses are phase shifted by pi . However, as we show, this condition is insufficient to both give rise to the nearly zero optical forward scattering and the anti duality symmetry, in striking contrast to the actual view of the problem. Interestingly, we demonstrate that near the electric and magnetic dipolar resonances, the energy radiation pattern in the far field limit resembles to the one arising from the first Kerker condition, with nearly zero backscattering.


On ( alpha, beta, gamma) metrics. In this paper, a new class of Finsler metrics which are included ( alpha, beta) metrics are introduced. They are defined by a Riemannian metric and two 1 forms beta b i(x)y i and gamma gamma i(x)y i . This class of metrics are a generalization of ( alpha, beta) metrics which are not always ( alpha, beta) metric. We find a necessary and sufficient condition for this metric to be locally projectively flat and then we prove the conditions for this metric to be of Douglas type.


FoodAI Food Image Recognition via Deep Learning for Smart Food Logging. An important aspect of health monitoring is effective logging of food consumption. This can help management of diet related diseases like obesity, diabetes, and even cardiovascular diseases. Moreover, food logging can help fitness enthusiasts, and people who wanting to achieve a target weight. However, food logging is cumbersome, and requires not only taking additional effort to note down the food item consumed regularly, but also sufficient knowledge of the food item consumed (which is difficult due to the availability of a wide variety of cuisines). With increasing reliance on smart devices, we exploit the convenience offered through the use of smart phones and propose a smart food logging system FoodAI, which offers state of the art deep learning based image recognition capabilities. FoodAI has been developed in Singapore and is particularly focused on food items commonly consumed in Singapore. FoodAI models were trained on a corpus of 400,000 food images from 756 different classes. In this paper we present extensive analysis and insights into the development of this system. FoodAI has been deployed as an API service and is one of the components powering Healthy 365, a mobile app developed by Singapore's Heath Promotion Board. We have over 100 registered organizations (universities, companies, start ups) subscribing to this service and actively receive several API requests a day. FoodAI has made food logging convenient, aiding smart consumption and a healthy lifestyle.


Dimension inequality for a definably complete uniformly locally o minimal structure of the second kind. Consider a definably complete uniformly locally o minimal expansion of the second kind of a densely linearly ordered abelian group. Let f X rightarrow R n be a definable map, where X is a definable set and R is the universe of the structure. We demonstrate the inequality dim(f(X)) leq dim(X) in this paper. As a corollary, we get that the set of the points at which f is discontinuous is of dimension smaller than dim(X) . We also show that the structure is defiably Baire in the course of the proof of the inequality.


Three product formulas for ratios of tiling counts of hexagons with collinear holes. Rosengren found an explicit formula for a certain weighted enumeration of lozenge tilings of a hexagon with an arbitrary triangular hole. He pointed out that a certain ratio corresponding to two such regions has a nice product formula. In this paper, we generalize this to hexagons with arbitrary collinear holes. It turns out that, by using same approach, we can also generalize Ciucu's work on the number and the number of centrally symmetric tilings of a hexagon with a fern removed from its center. This proves a recent conjecture of Ciucu.


Quantum Borcherds Bozec algebras and their integrable representations. We investigate the fundamental properties of quantum Borcherds Bozec algebras and their representations. Among others, we prove that the quantum Borcherds Bozec algebras have a triangular decomposition and the category of integrable representations is semi simple.


On Four dimensional Steady gradient Ricci solitons that dimension reduce. In this paper, we will study the asymptotic geometry of 4 dimensional steady gradient Ricci solitons under the condition that they dimension reduce to 3 manifolds. We will show that such 4 dimensional steady gradient Ricci solitons either dimension reduce to a spherical space form mathbb S 3 Gamma or weakly dimension reduce to the 3 dimensional Bryant soliton. We also show that 4 dimensional steady gradient Ricci soliton singularity models with nonnegative Ricci curvature outside a compact set either are Ricci flat ALE 4 manifolds or dimension reduce to 3 dimensional manifolds. As an application, we prove that any steady gradient K " a hler Ricci soliton singularity models on complex surfaces with nonnegative Ricci curvature outside a compact set must be hyperk " a hler ALE Ricc flat 4 manifolds.


Security analysis of a blockchain based protocol for the certification of academic credentials. We consider a blockchain based protocol for the certification of academic credentials named Blockcerts, which is currently used worldwide for validating digital certificates of competence compliant with the Open Badges standard. We study the certification steps that are performed by the Blockcerts protocol to validate a certificate, and find that they are vulnerable to a certain type of impersonation attacks. More in detail, authentication of the issuing institution is performed by retrieving an unauthenticated issuer profile online, and comparing some data reported there with those included in the issued certificate. We show that, by fabricating a fake issuer profile and generating a suitably altered certificate, an attacker is able to impersonate a legitimate issuer and can produce certificates that cannot be distinguished from originals by the Blockcerts validation procedure. We also propose some possible countermeasures against an attack of this type, which require the use of a classic public key infrastructure or a decentralized identity system integrated with the Blockcerts protocol.


On the Boomerang Uniformity of Permutations of Low Carlitz Rank. Finding permutation polynomials with low differential and boomerang uniformityis an important topic in S box designs of many block ciphers. For example, AES chooses the inverse function as its S box, which is differentially 4 uniform and boomerang 6 uniform. Also there has been considerable research on many non quadratic permutations which are obtained by modifying certain set of points from the inverse function. In this paper, we give a novel approach that shows that plenty of existing modifications of the inverse function are in fact affine equivalent to permutations of low Carlitz rank and those modifications cannot be APN (almost perfect nonlinear) unless the Carlitz rank is very large. Using nice properties of the permutations of Carlitz form, we present the complete list of permutations of Carlitz rank 3 having the boomerang uniformity six, and also give the complete classification of the differential uniformity of permutations of Carlitz rank 3. We also provide, up to affine equivalence, all the involutory permutations of Carlitz rank 3 having the boomerang uniformity six.


A General Model of Conversational Dynamics and an Example Application in Serious Illness Communication. Conversation has been a primary means for the exchange of information since ancient times. Understanding patterns of information flow in conversations is a critical step in assessing and improving communication quality. In this paper, we describe COnversational DYnamics Model (CODYM) analysis, a novel approach for studying patterns of information flow in conversations. CODYMs are Markov Models that capture sequential dependencies in the lengths of speaker turns. The proposed method is automated and scalable, and preserves the privacy of the conversational participants. The primary function of CODYM analysis is to quantify and visualize patterns of information flow, concisely summarized over sequential turns from one or more conversations. Our approach is general and complements existing methods, providing a new tool for use in the analysis of any type of conversation. As an important first application, we demonstrate the model on transcribed conversations between palliative care clinicians and seriously ill patients. These conversations are dynamic and complex, taking place amidst heavy emotions, and include difficult topics such as end of life preferences and patient values. We perform a versatile set of CODYM analyses that (a) establish the validity of the model by confirming known patterns of conversational turn taking and word usage, (b) identify normative patterns of information flow in serious illness conversations, and (c) show how these patterns vary across narrative time and differ under expressions of anger, fear and sadness. Potential applications of CODYMs range from assessment and training of effective healthcare communication to comparing conversational dynamics across language and culture, with the prospect of identifying universal similarities and unique "fingerprints" of information flow.


Flip Distance to some Plane Configurations. We study an old geometric optimization problem in the plane. Given a perfect matching M on a set of n points in the plane, we can transform it to a non crossing perfect matching by a finite sequence of flip operations. The flip operation removes two crossing edges from M and adds two non crossing edges. Let f(M) and F(M) denote the minimum and maximum lengths of a flip sequence on M , respectively. It has been proved by Bonnet and Miltzow (2016) that f(M) O(n 2) and by van Leeuwen and Schoone (1980) that F(M) O(n 3) . We prove that f(M) O(n Delta) where Delta is the spread of the point set, which is defined as the ratio between the longest and the shortest pairwise distances. This improves the previous bound if the point set has sublinear spread. For a matching M on n points in convex position we prove that f(M) n 2 1 and F(M) n 2 choose 2 these bounds are tight. Any bound on F( cdot) carries over to the bichromatic setting, while this is not necessarily true for f( cdot) . Let M' be a bichromatic matching. The best known upper bound for f(M') is the same as for F(M') , which is essentially O(n 3) . We prove that f(M') le n 2 for points in convex position, and f(M') O(n 2) for semi collinear points. The flip operation can also be defined on spanning trees. For a spanning tree T on a convex point set we show that f(T) O(n log n) .


Hyperbolic Metamaterials From Dispersion Manipulation to Application. Manipulating the property of iso frequency contour (IFC) will provide a powerful control for the interaction between light and matter. Importantly, hyperbolic metamaterials (HMMs), a class of artificial anisotropic materials with hyperbolic IFC have been intensively investigated. Because of the open dispersion curves, HMMs support propagating high k modes and possess enhanced photonic density of states. As a result, HMMs can be utilized to realize hyper lens breaking the diffraction limit, meta cavity laser with subwavelength scale, high sensitivity sensor, long range energy transfer and so on. In order to make it easier for people who are about to enter this burgeoning and rapidly developing research field, this tutorial article not only introduces the basic physical properties of HMMs, but also discusses the dispersion manipulation of HMMs and HMM based structures such as hypercrystals. The theoretical methods and experimental platforms are given in this tutorial. Finally, some potential applications associated with hyperbolic dispersion are also introduced


Analysis of Automatic Annotation Suggestions for Hard Discourse Level Tasks in Expert Domains. Many complex discourse level tasks can aid domain experts in their work but require costly expert annotations for data creation. To speed up and ease annotations, we investigate the viability of automatically generated annotation suggestions for such tasks. As an example, we choose a task that is particularly hard for both humans and machines the segmentation and classification of epistemic activities in diagnostic reasoning texts. We create and publish a new dataset covering two domains and carefully analyse the suggested annotations. We find that suggestions have positive effects on annotation speed and performance, while not introducing noteworthy biases. Envisioning suggestion models that improve with newly annotated texts, we contrast methods for continuous model adjustment and suggest the most effective setup for suggestions in future expert tasks.


Appearance Invariant 6 DoF Visual Localization using Generative Adversarial Networks. We propose a novel visual localization network when outside environment has changed such as different illumination, weather and season. The visual localization network is composed of a feature extraction network and pose regression network. The feature extraction network is made up of an encoder network based on the Generative Adversarial Network CycleGAN, which can capture intrinsic appearance invariant feature maps from unpaired samples of different weathers and seasons. With such an invariant feature, we use a 6 DoF pose regression network to tackle long term visual localization in the presence of outdoor illumination, weather and season changes. A variety of challenging datasets for place recognition and localization are used to prove our visual localization network, and the results show that our method outperforms state of the art methods in the scenarios with various environment changes.


Rapid Collision Detection for Multicopter Trajectories. We present a continuous time collision detection algorithm for quickly detecting whether certain polynomial trajectories in time intersect with convex obstacles. The algorithm is used in conjunction with an existing multicopter trajectory generation method to achieve rapid, obstacle aware motion planning in environments with both static convex obstacles and dynamic convex obstacles whose boundaries do not rotate. In general, this problem is difficult because the presence of convex obstacles makes the feasible space of trajectories nonconvex. The performance of the algorithm is benchmarked using Monte Carlo simulations, and experimental results are presented that demonstrate the use of the method to plan collision free multicopter trajectories in milliseconds in environments with both static and dynamic obstacles.


Convergence of the Finite Volume Method on Unstructured Meshes for a 3D Phase Field Model of Solidification. We present a convergence result for the finite volume method applied to a particular phase field problem suitable for simulation of pure substance solidification. The model consists of the heat equation and the phase field equation with a general form of the reaction term which encompasses a variety of existing models governing dendrite growth and elementary interface tracking problems. We apply the well known compact embedding techniques in the context of the finite volume method on admissible unstructured polyhedral meshes. We develop the necessary interpolation theory and derive an a priori estimate to obtain boundedness of the key terms. Based on this estimate, we conclude the convergence of all of the terms in the equation system.


Hyperelliptic odd coverings. We investigate a class of odd (ramification) coverings C to mathbb P 1 where C is hyperelliptic, its Weierstrass points maps to one fixed point of mathbb P 1 and the covering map makes the hyperelliptic involution of C commute with an involution of mathbb P 1 . We show that the total number of hyperelliptic odd coverings of minimal degree 4g is 3g choose g 1 2 2g when C is general. Our study is approached from three main perspectives if a fixed effective theta characteristic is fixed they are described as a solution of a certain class of differential equations then they are studied from the monodromy viewpoint and a deformation argument that leads to the final computation.


Adapted Sequence for Polyhedral Realization of Crystal Bases. The polyhedral realization of crystal base has been introduced by A.Zelevinsky and the second author( T.Nakashima, A.Zelevinsky, Adv. Math. 131, no. 1 (1997) ), which describe the crystal base B( infty) as a polyhedral convex cone in the infinite mathbb Z lattice mathbb Z infty . To construct the polyhedral realization, we need to fix an infinite sequence iota from the indices of the simple roots. According to this iota , one has certain set of linear functions defining a polyhedral convex cone and under the positivity condition' on iota , it has been shown that the polyhedral convex cone is isomorphic to the crystal base B( infty) . To confirm the positivity condition for a given iota , we need to obtain the whole feature of the set of linear functions, which requires, in general, a bunch of explicit calculations. In this article, we introduce the notion of the adapted sequence and show that if iota is an adapted sequence then the positivity condition holds for classical Lie algebras. Furthermore, we reveal the explicit forms of the polyhedral realizations associated with arbitrary adapted sequences iota in terms of column tableaux.


Protocol for an Observational Study on the Effects of Social Distancing on Influenza Like Illness and COVID 19. The novel coronavirus disease (COVID 19) is a highly contagious respiratory disease that was first detected in Wuhan, China in December 2019, and has since spread around the globe, claiming more than 69,000 lives by the time this protocol is written. It has been widely acknowledged that the most effective public policy to mitigate the pandemic is emph social and physical distancing keeping at least six feet away from people, working from home, closing non essential businesses, etc. There have been a lot of anecdotal evidences suggesting that social distancing has a causal effect on disease mitigation however, few studies have investigated the effect of social distancing on disease mitigation in a transparent and statistically sound manner. We propose to perform an optimal non bipartite matching to pair counties with similar observed covariates but vastly different average social distancing scores during the first week (March 16th through Match 22nd) of President's emph 15 Days to Slow the Spread campaign. We have produced a total of 302 pairs of two U.S. counties with good covariate balance on a total of 16 important variables. Our primary outcome will be the average observed illness collected by Kinsa Inc. two weeks after the intervention period. Although the observed illness does not directly measure COVID 19, it reflects a real time aspect of the pandemic, and unlike confirmed cases, it is much less confounded by counties' testing capabilities. We also consider observed illness three weeks after the intervention period as a secondary outcome. We will test a proportional treatment effect using a randomization based test with covariance adjustment and conduct a sensitivity analysis.


Compatible actions in semi abelian categories. The concept of a pair of compatible actions was introduced in the case of groups by Brown and Loday and in the case of Lie algebras by Ellis. In this article we extend it to the context of semi abelian categories (that satisfy the Smith is Huq condition). We give a new construction of the Peiffer product, which specialises to the definitions known for groups and Lie algebras. We use it to prove our main result, on the connection between pairs of compatible actions and pairs of crossed modules over a common base object. We also study the Peiffer product in its own right, in terms of its universal properties, and prove its equivalence with existing definitions in specific cases.


A localized version of the basic triangle theorem. In this short note, we give a localized version of the basic triangle theorem, first published in 2011 (see 4 ) in order to prove the independence of hyperlogarithms over various function fields. This version provides direct access to rings of scalars and avoids the recourse to fraction fields as that of meromorphic functions for instance.


Algebraic structure of the range of a trigonometric polynomial. The range of a trigonometric polynomial with complex coefficients can be interpreted as the image of the unit circle under a Laurent polynomial. We show that this range is contained in a real algebraic subset of the complex plane. Although the containment may be proper, the difference between the two sets is finite, except for polynomials with certain symmetry.


VISIR Visual and Semantic Image Label Refinement. The social media explosion has populated the Internet with a wealth of images. There are two existing paradigms for image retrieval 1) content based image retrieval (CBIR), which has traditionally used visual features for similarity search (e.g., SIFT features), and 2) tag based image retrieval (TBIR), which has relied on user tagging (e.g., Flickr tags). CBIR now gains semantic expressiveness by advances in deep learning based detection of visual labels. TBIR benefits from query and click logs to automatically infer more informative labels. However, learning based tagging still yields noisy labels and is restricted to concrete objects, missing out on generalizations and abstractions. Click based tagging is limited to terms that appear in the textual context of an image or in queries that lead to a click. This paper addresses the above limitations by semantically refining and expanding the labels suggested by learning based object detection. We consider the semantic coherence between the labels for different objects, leverage lexical and commonsense knowledge, and cast the label assignment into a constrained optimization problem solved by an integer linear program. Experiments show that our method, called VISIR, improves the quality of the state of the art visual labeling tools like LSDA and YOLO.


Introduction to StarNEig A Task based Library for Solving Nonsymmetric Eigenvalue Problems. In this paper, we present the StarNEig library for solving dense non symmetric (generalized) eigenvalue problems. The library is built on top of the StarPU runtime system and targets both shared and distributed memory machines. Some components of the library support GPUs. The library is currently in an early beta state and only real arithmetic is supported. Support for complex data types is planned for a future release. This paper is aimed for potential users of the library. We describe the design choices and capabilities of the library, and contrast them to existing software such as ScaLAPACK. StarNEig implements a ScaLAPACK compatibility layer that should make it easy for a new user to transition to StarNEig. We demonstrate the performance of the library with a small set of computational experiments.


Automated Topical Component Extraction Using Neural Network Attention Scores from Source based Essay Scoring. While automated essay scoring (AES) can reliably grade essays at scale, automated writing evaluation (AWE) additionally provides formative feedback to guide essay revision. However, a neural AES typically does not provide useful feature representations for supporting AWE. This paper presents a method for linking AWE and neural AES, by extracting Topical Components (TCs) representing evidence from a source text using the intermediate output of attention layers. We evaluate performance using a feature based AES requiring TCs. Results show that performance is comparable whether using automatically or manually constructed TCs for 1) representing essays as rubric based features, 2) grading essays.


The Lockdown Effect Implications of the COVID 19 Pandemic on Internet Traffic. Due to the COVID 19 pandemic, many governments imposed lock downs that forced hundreds of millions of citizens to stay at home. The implementation of confinement measures increased Internet traffic demands of residential users, in particular, for remote working, entertainment, commerce, and education, which, as a result, caused traffic shifts in the Internet core. In this paper, using data from a diverse set of vantage points (one ISP, three IXPs, and one metropolitan educational network), we examine the effect of these lockdowns on traffic shifts. We find that the traffic volume increased by 15 20 almost within a week while overall still modest, this constitutes a large increase within this short time period. However, despite this surge, we observe that the Internet infrastructure is able to handle the new volume, as most traffic shifts occur outside of traditional peak hours. When looking directly at the traffic sources, it turns out that, while hypergiants still contribute a significant fraction of traffic, we see (1) a higher increase in traffic of non hypergiants, and (2) traffic increases in applications that people use when at home, such as Web conferencing, VPN, and gaming. While many networks see increased traffic demands, in particular, those providing services to residential users, academic networks experience major overall decreases. Yet, in these networks, we can observe substantial increases when considering applications associated to remote working and lecturing.


Stationary sets of the mean curvature flow with a forcing term. We consider the flat flow approach for the mean curvature equation with forcing in an Euclidean space mathbb R n of dimension at least 2. Our main results states that tangential balls in mathbb R n under any flat flow with a bounded forcing term will experience fattening, which generalizes the result by Fusco, Julin and Morini from the planar case to higher dimensions. Then, as in the planar case, we are able to characterize stationary sets in mathbb R n for a constant forcing term as finite unions of equisized balls with mutually positive distance.


Perfect Absorption in a Metasurface Programmable Complex Scattering Enclosure. Achieving the very special condition of perfect absorption (PA) in a complex scattering enclosure promises to enable a wealth of applications in secure communication, precision sensing, wireless power transfer, analog signal processing and random lasing. Consequently, a lot of recent research effort was dedicated to proposing wave front shaping protocols to implement coherent PA in a complex scattering environment. Here, instead of shaping the impinging wave front and tuning the system's attenuation, we propose the conceptually different route of solely tweaking the randomness of the complex scattering environment in order to achieve PA. We provide an experimental proof of concept in the microwave domain where we tune the randomness of a three dimensional chaotic cavity with a programmable metasurface. We systematically investigate the achievability and extreme sensitivity of the PA condition. Our technique can impose a PA condition at over hundred distinct frequencies within a small frequency band, which allows us to propose and experimentally demonstrate a concrete practical application receiver powered secure wireless communication in a complex scattering enclosure. Our fundamentally new perspective on PA is applicable to all types of wave phenomena and our results foreshadow the large potential of this novel tool for minute wave control in sensing, communication and energy transfer.


A Co Interactive Transformer for Joint Slot Filling and Intent Detection. Intent detection and slot filling are two main tasks for building a spoken language understanding (SLU) system. The two tasks are closely related and the information of one task can be utilized in the other task. Previous studies either model the two tasks separately or only consider the single information flow from intent to slot. None of the prior approaches model the bidirectional connection between the two tasks simultaneously. In this paper, we propose a Co Interactive Transformer to consider the cross impact between the two tasks. Instead of adopting the self attention mechanism in vanilla Transformer, we propose a co interactive module to consider the cross impact by building a bidirectional connection between the two related tasks. In addition, the proposed co interactive module can be stacked to incrementally enhance each other with mutual features. The experimental results on two public datasets (SNIPS and ATIS) show that our model achieves the state of the art performance with considerable improvements ( 3.4 and 0.9 on overall acc). Extensive experiments empirically verify that our model successfully captures the mutual interaction knowledge.


On the heat transfer coefficient jump in tilted single phase natural circulation systems. The present study investigates the effect of inclination on the buoyancy driven systems. A cavity, Natural Circulation Loop (NCL) and Coupled Natural Circulation Loop (CNCL) have been used to represent the possible classes of buoyancy driven systems. There are extensive studies on the cavity systems which exhibit a heat transfer coefficient jump upon the change in the inclination as the system moves from one steady state to another. The primary objective of the present study is to investigate if a similar behavior occurs in natural circulation systems such as an NCL and a CNCL, using a 2 D CFD study. The study identifies a combination of flow pattern rearrangement and flow direction reversal as the phenomena responsible for the jump in the heat transfer coefficient. A 3 D CFD study is also conducted to demonstrate the universality of the phenomena. The CFD study is validated thoroughly with the numerical and experimental data available in the literature. A parametric study is also conducted to examine the effects of the aspect ratio, Rayleigh number, Prandtl number and the inclination with the plane of the NCL system.


ANOVA Gaussian process modeling for high dimensional stochastic computational models. In this paper we present a novel analysis of variance Gaussian process (ANOVA GP) emulator for models governed by partial differential equations (PDEs) with high dimensional random inputs. Gaussian process (GP) is a widely used surrogate modeling strategy, but it can become invalid when the inputs are high dimensional. In this new ANOVA GP strategy, high dimensional inputs are decomposed into unions of local low dimensional inputs, and principal component analysis (PCA) is applied to provide dimension reduction for each ANOVA term. We then systematically build local GP models for PCA coefficients based on ANOVA decomposition to provide an emulator for the overall high dimensional problem. We present a general mathematical framework of ANOVA GP, validate its accuracy and demonstrate its efficiency with numerical experiments.


Efficient Compactions Between Storage Tiers with PrismDB. In recent years, emerging storage hardware technologies have focused on divergent goals better performance or lower cost per bit. Correspondingly, data systems that employ these technologies are typically optimized either to be fast (but expensive) or cheap (but slow). We take a different approach by architecting a storage engine to natively utilize two tiers of fast and low cost storage technologies, we can achieve a Pareto efficient balance between performance and cost per bit. This paper presents the design and implementation of PrismDB, a novel key value store that exploits two extreme ends of the spectrum of modern NVMe storage technologies (3D XPoint and QLC NAND) simultaneously. Our key contribution is how to efficiently migrate and compact data between two different storage tiers. Inspired by the classic cost benefit analysis of log cleaning, we develop a new algorithm for multi tiered storage compaction that balances the benefit of reclaiming space for hot objects in fast storage with the cost of compaction I O in slow storage. Compared to the standard use of RocksDB on flash in datacenters today, PrismDB's average throughput on tiered storage is 3.3 times faster and its read tail latency is 2 times better, using equivalently priced hardware.


All in One Image Grounded Conversational Agents. As single task accuracy on individual language and image tasks has improved substantially in the last few years, the long term goal of a generally skilled agent that can both see and talk becomes more feasible to explore. In this work, we focus on leveraging individual language and image tasks, along with resources that incorporate both vision and language towards that objective. We design an architecture that combines state of the art Transformer and ResNeXt modules fed into a novel attentive multimodal module to produce a combined model trained on many tasks. We provide a thorough analysis of the components of the model, and transfer performance when training on one, some, or all of the tasks. Our final models provide a single system that obtains good results on all vision and language tasks considered, and improves the state of the art in image grounded conversational applications.


A Cheeger Cut for Uniform Hypergraphs. The graph Cheeger constant and Cheeger inequalities are generalized to the case of hypergraphs whose edges have the same cardinality. In particular, it is shown that the second largest eigenvalue of the generalized normalized Laplacian is bounded both above and below by the generalized Cheeger constant, and the corresponding eigenfunctions can be used to approximate the Cheeger cut.


OER Recommendations to Support Career Development. This Work in Progress Research paper departs from the recent, turbulent changes in global societies, forcing many citizens to re skill themselves to (re)gain employment. Learners therefore need to be equipped with skills to be autonomous and strategic about their own skill development. Subsequently, high quality, on line, personalized educational content and services are also essential to serve this high demand for learning content. Open Educational Resources (OERs) have high potential to contribute to the mitigation of these problems, as they are available in a wide range of learning and occupational contexts globally. However, their applicability has been limited, due to low metadata quality and complex quality control. These issues resulted in a lack of personalised OER functions, like recommendation and search. Therefore, we suggest a novel, personalised OER recommendation method to match skill development targets with open learning content. This is done by 1) using an OER quality prediction model based on metadata, OER properties, and content 2) supporting learners to set individual skill targets based on actual labour market information, and 3) building a personalized OER recommender to help learners to master their skill targets. Accordingly, we built a prototype focusing on Data Science related jobs, and evaluated this prototype with 23 data scientists in different expertise levels. Pilot participants used our prototype for at least 30 minutes and commented on each of the recommended OERs. As a result, more than 400 recommendations were generated and 80.9 of the recommendations were reported as useful.


Automated Unit Test Generation for Python. Automated unit test generation is an established research field, and mature test generation tools exist for statically typed programming languages such as Java. It is, however, substantially more difficult to automatically generate supportive tests for dynamically typed programming languages such as Python, due to the lack of type information and the dynamic nature of the language. In this paper, we describe a foray into the problem of unit test generation for dynamically typed languages. We introduce Pynguin, an automated unit test generation framework for Python. Using Pynguin, we aim to empirically shed light on two central questions (1) Do well established search based test generation methods, previously evaluated only on statically typed languages, generalise to dynamically typed languages? (2) What is the influence of incomplete type information and dynamic typing on the problem of automated test generation? Our experiments confirm that evolutionary algorithms can outperform random test generation also in the context of Python, and can even alleviate the problem of absent type information to some degree. However, our results demonstrate that dynamic typing nevertheless poses a fundamental issue for test generation, suggesting future work on integrating type inference.


Constructions and necessities of some permutation polynomials. Permutation polynomials over finite fields have important applications in many areas of science and engineering such as coding theory, cryptography, combinatorial design, etc. In this paper, we construct several new classes of permutation polynomials, and the necessities of some permutation polynomials are studied.


Genes Preferring Non AUG Start Codons in Bacteria. Here we investigate translational regulation in bacteria by analyzing the distribution of start codons in fully assembled genomes. We report 36 genes (infC, rpoC, rnpA, etc.) showing a preference for non AUG start codons in evolutionarily diverse phyla ("non AUG genes"). Most of the non AUG genes are functionally associated with translation, transcription or replication. In E. coli, the percentage of essential genes among these 36 is significantly higher than among all genes. Furthermore, the functional distribution of these genes suggests that non AUG start codons may be used to reduce gene expression during starvation conditions, possibly through translational autoregulation or IF3 mediated regulation.


Algorithmic and geometric aspects of data depth with focus on beta skeleton depth. The statistical rank tests play important roles in univariate non parametric data analysis. If one attempts to generalize the rank tests to a multivariate case, the problem of defining a multivariate order will occur. It is not clear how to define a multivariate order or statistical rank in a meaningful way. One approach to overcome this problem is to use the notion of data depth which measures the centrality of a point with respect to a given data set. In other words, a data depth can be applied to indicate how deep a point is located with respect to a given data set. Using data depth, a multivariate order can be defined by ordering the data points according to their depth values. Various notions of data depth have been introduced over the last decades. In this thesis, we discuss three depth functions two well known depth functions halfspace depth and simplicial depth, and one recently defined depth function named as beta skeleton depth, beta geq 1 . The beta skeleton depth is equivalent to the previously defined spherical depth and lens depth when beta 1 and beta 2 , respectively. Our main focus in this thesis is to explore the geometric and algorithmic aspects of beta skeleton depth.


Harmonic equiangular tight frames comprised of regular simplices. An equiangular tight frame (ETF) is a sequence of unit norm vectors in a Euclidean space whose coherence achieves equality in the Welch bound, and thus yields an optimal packing in a projective space. A regular simplex is a simple type of ETF in which the number of vectors is one more than the dimension of the underlying space. More sophisticated examples include harmonic ETFs which equate to difference sets in finite abelian groups. Recently, it was shown that some harmonic ETFs are comprised of regular simplices. In this paper, we continue the investigation into these special harmonic ETFs. We begin by characterizing when the subspaces that are spanned by the ETF's regular simplices form an equi isoclinic tight fusion frame (EITFF), which is a type of optimal packing in a Grassmannian space. We shall see that every difference set that produces an EITFF in this way also yields a complex circulant conference matrix. Next, we consider a subclass of these difference sets that can be factored in terms of a smaller difference set and a relative difference set. It turns out that these relative difference sets lend themselves to a second, related and yet distinct, construction of complex circulant conference matrices. Finally, we provide explicit infinite families of ETFs to which this theory applies.


Predicting Online Video Advertising Effects with Multimodal Deep Learning. With expansion of the video advertising market, research to predict the effects of video advertising is getting more attention. Although effect prediction of image advertising has been explored a lot, prediction for video advertising is still challenging with seldom research. In this research, we propose a method for predicting the click through rate (CTR) of video advertisements and analyzing the factors that determine the CTR. In this paper, we demonstrate an optimized framework for accurately predicting the effects by taking advantage of the multimodal nature of online video advertisements including video, text, and metadata features. In particular, the two types of metadata, i.e., categorical and continuous, are properly separated and normalized. To avoid overfitting, which is crucial in our task because the training data are not very rich, additional regularization layers are inserted. Experimental results show that our approach can achieve a correlation coefficient as high as 0.695, which is a significant improvement from the baseline (0.487).


Bounded Model Checking of Software Using Interval Methods via Contractors. Bounded model checking (BMC) is a vital technique to find property violations in programs. BMC can quickly find an execution path starting from an initial state to the bad state that refutes a given property. However, BMC techniques struggle to falsify programs that contain loops. BMC needs to unfold the program loops up to the bound k, which sometimes leads to a considerable state space to be explored. Here, we develop an innovative software verification approach that exploits interval methods via contractors to prune the state space exploration of programs that contain loops. In particular, this is the first work that exploits interval methods via contractors to analyze the loop variables search space and identify where the property is guaranteed to hold and prune the domain where it holds. Experimental results show a performance boost in terms of space and time as contractors removed 99 of the search space in some examples and made them substantially faster to verify with BMC.


Three dimensional advective diffusive boundary layers in open channels with parallel and inclined walls. We study the steady laminar advective transport of a diffusive passive scalar released at the base of narrow three dimensional longitudinal open channels with non absorbing side walls and rectangular or truncated wedge shaped cross sections. The scalar field in the advective diffusive boundary layer at the base of the channels is fundamentally three dimensional in the general case, owing to a three dimensional velocity field and differing boundary conditions at the side walls. We utilise three dimensional numerical simulations and asymptotic analysis to understand how this inherent three dimensionality influences the advective diffusive transport as described by the normalised average flux, the Sherwood Sh or Nusselt numbers for mass or heat transfer, respectively. We show that Sh is well approximated by an appropriately formulated two dimensional calculation, even when the boundary layer structure is itself far from two dimensional. This important result can significantly simplify the modelling of many laminar advection diffusion scalar transfer problems the cleaning or decontamination of confined channels, or transport processes in chemical or biological microfluidic devices.


Weakly Supervised Semantic Segmentation by Iterative Affinity Learning. Weakly supervised semantic segmentation is a challenging task as no pixel wise label information is provided for training. Recent methods have exploited classification networks to localize objects by selecting regions with strong response. While such response map provides sparse information, however, there exist strong pairwise relations between pixels in natural images, which can be utilized to propagate the sparse map to a much denser one. In this paper, we propose an iterative algorithm to learn such pairwise relations, which consists of two branches, a unary segmentation network which learns the label probabilities for each pixel, and a pairwise affinity network which learns affinity matrix and refines the probability map generated from the unary network. The refined results by the pairwise network are then used as supervision to train the unary network, and the procedures are conducted iteratively to obtain better segmentation progressively. To learn reliable pixel affinity without accurate annotation, we also propose to mine confident regions. We show that iteratively training this framework is equivalent to optimizing an energy function with convergence to a local minimum. Experimental results on the PASCAL VOC 2012 and COCO datasets demonstrate that the proposed algorithm performs favorably against the state of the art methods.


A superposition principle for the inhomogeneous continuity equation with Hellinger Kantorovich regular coefficients. We study measure valued solutions of the inhomogeneous continuity equation partial t rho t rm div (v rho t) g rho t where the coefficients v and g are of low regularity. A new superposition principle is proven for positive measure solutions and coefficients for which the recently introduced dynamic Hellinger Kantorovich energy is finite. This principle gives a decomposition of the solution into curves t mapsto h(t) delta gamma(t) that satisfy the characteristic system dot gamma(t) v(t, gamma(t)) , dot h(t) g(t, gamma(t)) h(t) in an appropriate sense. In particular, it provides a generalization of existing superposition principles to the low regularity case of g where characteristics are not unique with respect to h . Two applications of this principle are presented. First, uniqueness of minimal total variation solutions for the inhomogeneous continuity equation is obtained if characteristics are unique up to their possible vanishing time. Second, the extremal points of dynamic Hellinger Kantorovich type regularizers are characterized. Such regularizers arise, e.g., in the context of dynamic inverse problems and dynamic optimal transport.


Cyclicity preserving operators on spaces of analytic functions in mathbb C n . For spaces of analytic functions defined on an open set in mathbb C n that satisfy certain nice properties, we show that operators that preserve shift cyclic functions are necessarily weighted composition operators. Examples of spaces for which this result holds true consist of the Hardy space H p( mathbb D n) , (0 p infty) , the Drury Arveson space mathcal H 2 n , and the Dirichlet type space mathcal D alpha , ( alpha in mathbb R ) . We focus on the Hardy spaces and show that when 1 leq p infty , the converse is also true. The techniques used to prove the main result also enable us to prove a version of the Gleason Kahane .Zelazko theorem for partially multiplicative linear functionals on spaces of analytic functions in more than one variable.


Time Window Group Correlation Support vs. Individual Features A Detection of Abnormal Users. Autoencoder based anomaly detection methods have been used in identifying anomalous users from large scale enterprise logs with the assumption that adversarial activities do not follow past habitual patterns. Most existing approaches typically build models by reconstructing single day and individual user behaviors. However, without capturing long term signals and group correlation signals, the models cannot identify low signal yet long lasting threats, and will wrongly report many normal users as anomalies on busy days, which, in turn, lead to high false positive rate. In this paper, we propose ACOBE, an Anomaly detection method based on COmpound BEhavior, which takes into consideration long term patterns and group behaviors. ACOBE leverages a novel behavior representation and an ensemble of deep autoencoders and produces an ordered investigation list. Our evaluation shows that ACOBE outperforms prior work by a large margin in terms of precision and recall, and our case study demonstrates that ACOBE is applicable in practice for cyberattack detection.


Transfer of Manure as Fertilizer from Livestock Farms to Crop Fields The Case of Catalonia. Intensive livestock production might have a negative environmental impact, by producing large amounts of animal manure, which, if not properly managed, can contaminate nearby water bodies with nutrient excess. However, if animal manure is exported to nearby crop fields, to be used as organic fertilizer, pollution can be mitigated. It is a single objective optimization problem, in regards to finding the best solution for the logistics process of satisfying nutrient needs of crops by means of livestock manure. This paper proposes three different approaches to solve the problem a centralized optimal algorithm (COA), a decentralized nature inspired cooperative technique, based on the foraging behaviour of ants (AIA), as well as a naive neighbour based method (NBS), which constitutes the existing practice used today in an ad hoc, uncoordinated manner in Catalonia. Results show that the COA approach is 8.5 more efficient than the AIA. However, the AIA approach is fairer to the farmers and more balanced in terms of average transportation distances that need to be covered by each livestock farmer, while it is 1.07 times more eefficient than the NBS. Our work constitutes the first application of a decentralized AIA to this interesting real world problem, in a domain where swarm intelligence methods are still under exploited.


Listing Conflicting Triples in Optimal Time. Different sources of information might tell different stories about the evolutionary history of a given set of species. This leads to (rooted) phylogenetic trees that "disagree" on triples of species, which we call "conflict triples". An important subtask of computing consensus trees which is interesting in its own regard is the enumeration of all conflicts exhibited by a pair of phylogenetic trees (on the same set of n taxa). As it is possible that a significant part of the n 3 triples are in conflict, the trivial Theta (n 3) time algorithm that checks for each triple whether it constitutes a conflict, was considered optimal. It turns out, however, that we can do way better in the case that there are only few conflicts. In particular, we show that we can enumerate all d conflict triples between a pair of phylogenetic trees in O(n d) time. Since any deterministic algorithm has to spend Theta (n) time reading the input and Theta (d) time writing the output, no deterministic algorithm can solve this task faster than we do (up to constant factors).


Physics Letters B publications from 1967 to 2020. An analysis of the WEB page content of PLB. Having been an editor for Physics Letters B (PLB) for many years I became interested in the history of publishing, especially in particle physics (HEP). Since PLB goes back to 1967 and an index of all PLB publications is available online, this information was used to look at the history of PLB publications over time. It should be noted that PLB publishes new results in particle physics or high energy physics, nuclear physics and also in astrophysics and cosmology. This is the start of an effort to look at all publishers that publish research from HEP.


Proper resolutions and Gorensteinness in extriangulated categories. Let ( mathcal C , mathbb E , mathfrak s ) be an extriangulated category with a proper class xi of mathbb E triangles, and mathcal W an additive full subcategory of mathcal C . We provide a method for constructing a proper mathcal W ( xi) resolution (respectively, coproper mathcal W ( xi) coresolution) of one term in an mathbb E triangle in xi from that of the other two terms. By using this way, we establish the stability of the Gorenstein category mathcal GW ( xi) in extriangulated categories. These results generalise their work by Huang and Yang Wang, but the proof is not too far from their case. Finally, we give some applications about our main results.


A multiscale scheme accurately simulates macroscale shocks in an equation free framework. Scientists and engineers often create accurate, trustworthy, computational simulation schemes but all too often these are too computationally expensive to execute over the time or spatial domain of interest. The equation free approach is to marry such trusted simulations to a framework for numerical macroscale reduction the patch dynamics scheme. This article extends the patch scheme to scenarios in which the trusted simulation resolves abrupt state changes on the microscale that appear as shocks on the macroscale. Accurate simulation for problems in these scenarios requires extending the patch scheme by capturing the shock within a novel patch, and also modifying the patch coupling rules in the vicinity in order to maintain accuracy. With these two extensions to the patch scheme, straightforward arguments derive consistency conditions that match the usual order of accuracy for patch schemes. The new scheme is successfully tested on four archetypal problems. This technique will empower scientists and engineers to accurately and efficiently simulate, over large spatial domains, multiscale multiphysics systems that have rapid transition layers on the microscale.


Query based Interactive Recommendation by Meta Path and Adapted Attention GRU. Recently, interactive recommender systems are becoming increasingly popular. The insight is that, with the interaction between users and the system, (1) users can actively intervene the recommendation results rather than passively receive them, and (2) the system learns more about users so as to provide better recommendation. We focus on the single round interaction, i.e. the system asks the user a question (Step 1), and exploits his feedback to generate better recommendation (Step 2). A novel query based interactive recommender system is proposed in this paper, where textbf personalized questions are accurately generated from millions of automatically constructed questions in Step 1, and textbf the recommendation is ensured to be closely related to users' feedback in Step 2. We achieve this by transforming Step 1 into a query recommendation task and Step 2 into a retrieval task. The former task is our key challenge. We firstly propose a model based on Meta Path to efficiently retrieve hundreds of query candidates from the large query pool. Then an adapted Attention GRU model is developed to effectively rank these candidates for recommendation. Offline and online experiments on Taobao, a large scale e commerce platform in China, verify the effectiveness of our interactive system. The system has already gone into production in the homepage of Taobao App since Nov. 11, 2018 (see https v.qq.com x page s0833tkp1uo.html on how it works online). Our code and dataset are public in https github.com zyody QueryQR.


Context Prior for Scene Segmentation. Recent works have widely explored the contextual dependencies to achieve more accurate segmentation results. However, most approaches rarely distinguish different types of contextual dependencies, which may pollute the scene understanding. In this work, we directly supervise the feature aggregation to distinguish the intra class and inter class context clearly. Specifically, we develop a Context Prior with the supervision of the Affinity Loss. Given an input image and corresponding ground truth, Affinity Loss constructs an ideal affinity map to supervise the learning of Context Prior. The learned Context Prior extracts the pixels belonging to the same category, while the reversed prior focuses on the pixels of different classes. Embedded into a conventional deep CNN, the proposed Context Prior Layer can selectively capture the intra class and inter class contextual dependencies, leading to robust feature representation. To validate the effectiveness, we design an effective Context Prior Network (CPNet). Extensive quantitative and qualitative evaluations demonstrate that the proposed model performs favorably against state of the art semantic segmentation approaches. More specifically, our algorithm achieves 46.3 mIoU on ADE20K, 53.9 mIoU on PASCAL Context, and 81.3 mIoU on Cityscapes. Code is available at https git.io ContextPrior.


Discrete convolution operators and Riesz systems generated by actions of abelian groups. We study the bounded endomorphisms of ell N 2(G) ell 2(G) times dots times ell 2(G) that commute with translations, where G is a discrete abelian group. It is shown that they form a C algebra isomorphic to the C algebra of N times N matrices with entries in L infty( widehat G ) , where widehat G is the dual space of G . Characterizations of when these endomorphisms are invertible, and expressions for their norms and for the norms of their inverses, are given. These results allow us to study Riesz systems that arise from the action of G on a finite set of elements of a Hilbert space.


Sustainable and resilient strategies for touristic cities against COVID 19 an agent based approach. Touristic cities will suffer from COVID 19 emergency because of its economic impact on their communities. The first emergency phases involved a wide closure of such areas to support "social distancing" measures (i.e. travels limitation lockdown of (over)crowd prone activities). In the second phase, individual's risk mitigation strategies (facial masks) could be properly linked to "social distancing" to ensure re opening touristic cities to visitors. Simulation tools could support the effectiveness evaluation of risk mitigation measures to look for an economic and social optimum for activities restarting. This work modifies an existing Agent Based Model to estimate the virus spreading in touristic areas, including tourists and residents' behaviours, movement and virus effects on them according to a probabilistic approach. Consolidated proximity based and exposure time based contagion spreading rules are included according to international health organizations and previous calibration through experimental data. Effects of tourists' capacity (as "social distancing" based measure) and other strategies (i.e. facial mask implementation) are evaluated depending on virus related conditions (i.e. initial infector percentages). An idealized scenario representing a significant case study has been analysed to demonstrate the tool capabilities and compare the effectiveness of those solutions. Results show that "social distancing" seems to be more effective at the highest infectors' rates, although represents an extreme measure with important economic effects. This measure loses its full effectiveness (on the community) as the infectors' rate decreases and individuals' protection measures become predominant (facial masks). The model could be integrated to consider other recurring issues on tourist related fruition and schedule of urban spaces and facilities (e.g. cultural leisure buildings).


Desingularization of vortex rings in 3 dimensional Euler flows with swirl. We study desingularization of steady vortex rings in three dimensional axisymmetric incompressible Euler fluids with swirl. Using the variational method, we construct a two parameter family of steady vortex rings, which constitute a desingularization of the classical circular vortex filament, in several kinds of domains. The precise localization of the asymptotic singular vortex filament is shown to depend on the circulation and the velocity at far fields of the vortex ring and the geometry of the domains. We also discuss other qualitative and asymptotic properties of these vortices.


Feature Space Augmentation for Long Tailed Data. Real world data often follow a long tailed distribution as the frequency of each class is typically different. For example, a dataset can have a large number of under represented classes and a few classes with more than sufficient data. However, a model to represent the dataset is usually expected to have reasonably homogeneous performances across classes. Introducing class balanced loss and advanced methods on data re sampling and augmentation are among the best practices to alleviate the data imbalance problem. However, the other part of the problem about the under represented classes will have to rely on additional knowledge to recover the missing information. In this work, we present a novel approach to address the long tailed problem by augmenting the under represented classes in the feature space with the features learned from the classes with ample samples. In particular, we decompose the features of each class into a class generic component and a class specific component using class activation maps. Novel samples of under represented classes are then generated on the fly during training stages by fusing the class specific features from the under represented classes with the class generic features from confusing classes. Our results on different datasets such as iNaturalist, ImageNet LT, Places LT and a long tailed version of CIFAR have shown the state of the art performances.


Holistic and Comprehensive Annotation of Clinically Significant Findings on Diverse CT Images Learning from Radiology Reports and Label Ontology. In radiologists' routine work, one major task is to read a medical image, e.g., a CT scan, find significant lesions, and describe them in the radiology report. In this paper, we study the lesion description or annotation problem. Given a lesion image, our aim is to predict a comprehensive set of relevant labels, such as the lesion's body part, type, and attributes, which may assist downstream fine grained diagnosis. To address this task, we first design a deep learning module to extract relevant semantic labels from the radiology reports associated with the lesion images. With the images and text mined labels, we propose a lesion annotation network (LesaNet) based on a multilabel convolutional neural network (CNN) to learn all labels holistically. Hierarchical relations and mutually exclusive relations between the labels are leveraged to improve the label prediction accuracy. The relations are utilized in a label expansion strategy and a relational hard example mining algorithm. We also attach a simple score propagation layer on LesaNet to enhance recall and explore implicit relation between labels. Multilabel metric learning is combined with classification to enable interpretable prediction. We evaluated LesaNet on the public DeepLesion dataset, which contains over 32K diverse lesion images. Experiments show that LesaNet can precisely annotate the lesions using an ontology of 171 fine grained labels with an average AUC of 0.9344.


Thermomagnetic instability of plasma composition gradients. We show that, under Braginskii magneto hydrodynamics, anti parallel gradients in average ion charge state and electron temperature can be unstable to the growth of self generated magnetic fields. The instability is analogous to the field generating thermomagnetic instability, although it is driven by the collisional thermal force magnetic source term rather than the Biermann battery term. The gradient in ion charge state causes a gradient in collisionality, which couples with temperature perturbations to create a self generated magnetic field. This magnetic field deflects the electron heat flux in a way that reinforces the temperature perturbation. The derived linearized growth rate, typically on hydrodynamic timescales, includes the resistive and thermal smoothing. It increases with large ion composition gradients and electron heat flux, conditions typical of the hohlraum walls or contaminant mix jets in inertial confinement fusion implosions. However, extended magneto hydrodynamic simulations indicate that the instability is usually dominated and stabilized by the nonlinear Nernst advection, in a similar manner to the standard thermomagnetic instability.


Demand Private Coded Caching and the Exact Trade off for N K 2. The distributed coded caching problem has been studied extensively in the recent past. While the known coded caching schemes achieve an improved transmission rate, they violate the privacy of the users since in these schemes the demand of one user is revealed to others in the delivery phase. In this paper, we consider the coded caching problem under the constraint that the demands of the other users remain information theoretically secret from each user. We first show that the memory rate pair (M, min N,K (1 M N)) is achievable under information theoretic demand privacy, while using broadcast transmissions. We then show that a demand private scheme for N files and K users can be obtained from a non private scheme that satisfies only a restricted subset of demands of NK users for N files. We then focus on the demand private coded caching problem for K 2 users, N 2 files. We characterize the exact memory rate trade off for this case. To show the achievability, we use our first result to construct a demand private scheme from a non private scheme satisfying a restricted demand subset that is known from an earlier work by Tian. Further, by giving a converse based on the extra requirement of privacy, we show that the obtained achievable region is the exact memory rate trade off.


Compositional Generalization via Semantic Tagging. Although neural sequence to sequence models have been successfully applied to semantic parsing, they fail at compositional generalization, i.e., they are unable to systematically generalize to unseen compositions of seen components. Motivated by traditional semantic parsing where compositionality is explicitly accounted for by symbolic grammars, we propose a new decoding framework that preserves the expressivity and generality of sequence to sequence models while featuring lexicon style alignments and disentangled information processing. Specifically, we decompose decoding into two phases where an input utterance is first tagged with semantic symbols representing the meaning of individual words, and then a sequence to sequence model is used to predict the final meaning representation conditioning on the utterance and the predicted tag sequence. Experimental results on three semantic parsing datasets show that the proposed approach consistently improves compositional generalization across model architectures, domains, and semantic formalisms.


The A fibered Burnside ring as A fibered biset functor in characteristic zero. Let A be an abelian group such that mathrm Hom (G,A) is finite for all finite groups G , and let mathbb K be a field of characteristic zero containing roots of unity of all orders equal to finite element orders in A . In this paper we prove foundational properties of the A fibered Burnside ring functor B mathbb K A as an A fibered biset functor over mathbb K . This includes the determination of the lattice of subfunctors of B mathbb K A and the determination of the composition factors of B mathbb K A . The results of the paper extend results of Co c s kun and Y i lmaz for the A fibered Burnside ring functor restricted to p groups and results of Bouc in the case that A is trivial, i.e., the case of the Burnside ring functor over fields of characteristic zero.


Quantifying Uncertainty in Risk Assessment using Fuzzy Theory. Risk specialists are trying to understand risk better and use complex models for risk assessment, while many risks are not yet well understood. The lack of empirical data and complex causal and outcome relationships make it difficult to estimate the degree to which certain risk types are exposed. Traditional risk models are based on classical set theory. In comparison, fuzzy logic models are built on fuzzy set theory and are useful for analyzing risks with insufficient knowledge or inaccurate data. Fuzzy logic systems help to make large scale risk management frameworks more simple. For risks that do not have an appropriate probability model, a fuzzy logic system can help model the cause and effect relationships, assess the level of risk exposure, rank key risks in a consistent way, and consider available data and experts'opinions. Besides, in fuzzy logic systems, some rules explicitly explain the connection, dependence, and relationships between model factors. This can help identify risk mitigation solutions. Resources can be used to mitigate risks with very high levels of exposure and relatively low hedging costs. Fuzzy set and fuzzy logic models can be used with Bayesian and other types of method recognition and decision models, including artificial neural networks and decision tree models. These developed models have the potential to solve difficult risk assessment problems. This research paper explores areas in which fuzzy logic models can be used to improve risk assessment and risk decision making. We will discuss the methodology, framework, and process of using fuzzy logic systems in risk assessment.


Traveling vortex pairs for 2D incompressible Euler equations. In this paper, we study desingularization of vortices for the two dimensional incompressible Euler equations in the full plane. We construct a family of steady vortex pairs for the Euler equations with a general vorticity function, which constitutes a desingularization of a pair of point vortices with equal magnitude and opposite signs. The results are obtained by using an improved vorticity method.


Multi View Fusion of Sensor Data for Improved Perception and Prediction in Autonomous Driving. We present an end to end method for object detection and trajectory prediction utilizing multi view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view representations, and we propose an efficient and generic fusing method that aggregates benefits from all views. Our model builds on a state of the art Bird's Eye View (BEV) network that fuses voxelized features from a sequence of historical LiDAR data as well as rasterized high definition map to perform detection and prediction tasks. We extend this model with additional LiDAR Range View (RV) features that use the raw LiDAR information in its native, non quantized representation. The RV feature map is projected into BEV and fused with the BEV features computed from LiDAR and high definition map. The fused features are then further processed to output the final detections and trajectories, within a single end to end trainable network. In addition, the RV fusion of LiDAR and camera is performed in a straightforward and computationally efficient manner using this framework. The proposed multi view fusion approach improves the state of the art on proprietary large scale real world data collected by a fleet of self driving vehicles, as well as on the public nuScenes data set with minimal increases on the computational cost.


Resource Constrained Federated Learning with Heterogeneous Labels and Models. Various IoT applications demand resource constrained machine learning mechanisms for different applications such as pervasive healthcare, activity monitoring, speech recognition, real time computer vision, etc. This necessitates us to leverage information from multiple devices with few communication overheads. Federated Learning proves to be an extremely viable option for distributed and collaborative machine learning. Particularly, on device federated learning is an active area of research, however, there are a variety of challenges in addressing statistical (non IID data) and model heterogeneities. In addition, in this paper we explore a new challenge of interest to handle label heterogeneities in federated learning. To this end, we propose a framework with simple alpha weighted federated aggregation of scores which leverages overlapping information gain across labels, while saving bandwidth costs in the process. Empirical evaluation on Animals 10 dataset (with 4 labels for effective elucidation of results) indicates an average deterministic accuracy increase of at least 16.7 . We also demonstrate the on device capabilities of our proposed framework by experimenting with federated learning and inference across different iterations on a Raspberry Pi 2, a single board computing platform.


Navier Stokes equations in a curved thin domain, Part II global existence of a strong solution. We consider the Navier Stokes equations in a three dimensional curved thin domain around a given closed surface under Navier's slip boundary conditions. When the thickness of the thin domain is sufficiently small, we establish the global existence of a strong solution for large data. We also show several estimates for the strong solution with constants explicitly depending on the thickness of the thin domain. The proofs of these results are based on a standard energy method and a good product estimate for the convection and viscous terms following from a detailed study of average operators in the thin direction. We use the average operators to decompose a three dimensional vector field on the thin domain into the almost two dimensional average part and the residual part, and derive good estimates for them which play an important role in the proof of the product estimate.


Joint Reliability aware and Cost Efficient Path Allocation and VNF Placement using Sharing Scheme. Network Function Virtualization (NFV) is a vital player of modern networks providing different types of services such as traffic optimization, content filtering, and load balancing. More precisely, NFV is a provisioning technology aims at reducing the large Capital Expenditure (CAPEX) of network providers by moving services from dedicated hardware to commodity servers using Virtualized Network Functions (VNF). A sequence of VNFs services following a logical goal is referred to as a Service Function Chain (SFC). The movement toward SFC introduces new challenges to those network services which require high reliability. To address this challenge, redundancy schemes are introduced. Existing redundancy schemes using dedicated protection enhance the reliability of services, however, they do not consider the cost of redundant VNFs. In this paper, we propose a novel reliability enhancement method using a shared protection scheme to reduce the cost of redundant VNFs. To this end, We mathematically formulate the problem as a Mixed Integer Linear Programming (MILP). The objective is to determine optimal reliability that could be achieved with minimum cost. Although the corresponding optimization problem can be solved using existing MILP solvers, the computational complexity is not rational for realistic scenarios. Thereafter, we propose a Reliability aware and minimum Cost based Genetic (RCG) algorithm to solve this problem with low computational complexity. In order to evaluate the proposed solution, We have compared it with four different solutions. Simulation results show that RCG achieves near optimal performance at a much lower complexity compared with the optimal solution.


An analysis of the superiorization method via the principle of concentration of measure. The superiorization methodology is intended to work with input data of constrained minimization problems, i.e., a target function and a constraints set. However, it is based on an antipodal way of thinking to the thinking that leads constrained minimization methods. Instead of adapting unconstrained minimization algorithms to handling constraints, it adapts feasibility seeking algorithms to reduce (not necessarily minimize) target function values. This is done while retaining the feasibility seeking nature of the algorithm and without paying a high computational price. A guarantee that the local target function reduction steps properly accumulate to a global target function value reduction is still missing in spite of an ever growing body of publications that supply evidence of the success of the superiorization method in various problems. We propose an analysis based on the principle of concentration of measure that attempts to alleviate the guarantee question of the superiorization method.


Multitape automata and finite state transducers with lexicographic weights. Finite state transducers, multitape automata and weighted automata have a lot in common. By studying their universal foundations, one can discover some new insights into all of them. The main result presented here is the introduction of lexicographic finite state transducers, that could be seen as intermediate model between multitape automata and weighted transducers. Their most significant advantage is being equivalent, but often exponentially smaller than even smallest nondeterministic automata without weights. Lexicographic transducers were discovered by taking inspiration from Eilenberg's algebraic approach to automata and Solomonoff's treatment of a priori probability. Therefore, a quick and concise survey of those topics is presented, prior to introducing lexicographic transducers.


Petr4 Formal Foundations for P4 Data Planes. P4 is a domain specific language for programming and specifying packet processing systems. It is based on an elegant design with high level abstractions like parsers and match action pipelines that can be compiled to efficient implementations in software or hardware. Unfortunately, like many industrial languages, P4 has developed without a formal foundation. The P4 Language Specification is a 160 page document with a mixture of informal prose, graphical diagrams, and pseudocode. The P4 reference implementation is a complex system, running to over 40KLoC of C code. Clearly neither of these artifacts is suitable for formal reasoning. This paper presents a new framework, called Petr4, that puts P4 on a solid foundation. Petr4 consists of a clean slate definitional interpreter and a calculus that models the semantics of a core fragment of P4. Throughout the specification, some aspects of program behavior are left up to targets. Our interpreter is parameterized over a target interface which collects all the target specific behavior in the specification in a single interface. The specification makes ad hoc restrictions on the nesting of certain program constructs in order to simplify compilation and avoid the possibility of nonterminating programs. We captured the latter intention in our core calculus by stratifying its type system, rather than imposing unnatural syntactic restrictions, and we proved that all programs in this core calculus terminate. We have validated the interpreter against a suite of over 750 tests from the P4 reference implementation, exercising our target interface with tests for different targets. We established termination for the core calculus by induction on the stratified type system. While developing Petr4, we reported dozens of bugs in the language specification and the reference implementation, many of which have been fixed.


On the Shortest Separating Cycle. According to a result of Arkin etal (2016), given n point pairs in the plane, there exists a simple polygonal cycle that separates the two points in each pair to different sides moreover, a O( sqrt n ) factor approximation with respect to the minimum length can be computed in polynomial time. Here the following results are obtained (I) We extend the problem to geometric hypergraphs and obtain the following characterization of feasibility. Given a geometric hypergraph on points in the plane with hyperedges of size at least 2 , there exists a simple polygonal cycle that separates each hyperedge if and only if the hypergraph is 2 colorable. (II) We extend the O( sqrt n ) factor approximation in the length measure as follows Given a geometric graph G (V,E) , a separating cycle (if it exists) can be computed in O(m n log n ) time, where V n , E m . Moreover, a O( sqrt n ) approximation of the shortest separating cycle can be found in polynomial time. Given a geometric graph G (V,E) in mathbb R 3 , a separating polyhedron (if it exists) can be found in O(m n log n ) time, where V n , E m . Moreover, a O(n 2 3 ) approximation of a separating polyhedron of minimum perimeter can be found in polynomial time. (III) Given a set of n point pairs in convex position in the plane, we show that a (1 varepsilon) approximation of a shortest separating cycle can be computed in time n O( varepsilon 1 2 ) . In this regard, we prove a lemma on convex polygon approximation that is of independent interest.


Using colorization as a tool for automatic makeup suggestion. Colorization is the method of converting an image in grayscale to a fully color image. There are multiple methods to do the same. Old school methods used machine learning algorithms and optimization techniques to suggest possible colors to use. With advances in the field of deep learning, colorization results have improved consistently with improvements in deep learning architectures. The latest development in the field of deep learning is the emergence of generative adversarial networks (GANs) which is used to generate information and not just predict or classify. As part of this report, 2 architectures of recent papers are reproduced along with a novel architecture being suggested for general colorization. Following this, we propose the use of colorization by generating makeup suggestions automatically on a face. To do this, a dataset consisting of 1000 images has been created. When an image of a person without makeup is sent to the model, the model first converts the image to grayscale and then passes it through the suggested GAN model. The output is a generated makeup suggestion. To develop this model, we need to tweak the general colorization model to deal only with faces of people.


Graph convolution neural network based flexible docking utilizing coarse grained distance matrix. Prediction of protein ligand complexes for flexible proteins remains still a challenging problem in computational structural biology and drug design. Here we present two novel deep neural network approaches with significant improvement in efficiency and accuracy of binding mode prediction on a large and diverse set of protein systems compared to standard docking. Whereas the first graph convolutional network is used for re ranking poses the second approach aims to generate and rank poses independent of standard docking approaches. This novel approach relies on the prediction of distance matrices between ligand atoms and protein C alpha atoms thus incorporating side chain flexibility implicitly.


Co degrees resilience for perfect matchings in random hypergraphs. In this paper we prove an optimal co degrees resilience property for the binomial k uniform hypergraph model H n,p k with respect to perfect matchings. That is, for a sufficiently large n which is divisible by k , and p geq C k log n n , we prove that with high probability every subgraph H subseteq H k n,p with minimum co degree (meaning, the number of supersets every set of size k 1 is contained in) at least (1 2 o(1))np contains a perfect matching.


The Impact of COVID 19 on Flight Networks. As COVID 19 transmissions spread worldwide, governments have announced and enforced travel restrictions to prevent further infections. Such restrictions have a direct effect on the volume of international flights among these countries, resulting in extensive social and economic costs. To better understand the situation in a quantitative manner, we used the Opensky network data to clarify flight patterns and flight densities around the world and observe relationships between flight numbers with new infections, and with the economy (unemployment rate) in Barcelona. We found that the number of daily flights gradually decreased and suddenly dropped 64 during the second half of March in 2020 after the US and Europe enacted travel restrictions. We also observed a 51 decrease in the global flight network density decreased during this period. Regarding new COVID 19 cases, the world had an unexpected surge regardless of travel restrictions. Finally, the layoffs for temporary workers in the tourism and airplane business increased by 4.3 fold in the weeks following Spain's decision to close its borders.


Exact Sparse Signal Recovery via Orthogonal Matching Pursuit with Prior Information. The orthogonal matching pursuit (OMP) algorithm is a commonly used algorithm for recovering K sparse signals x in mathbb R n from linear model y A x , where A in mathbb R m times n is a sensing matrix. A fundamental question in the performance analysis of OMP is the characterization of the probability that it can exactly recover x for random matrix A . Although in many practical applications, in addition to the sparsity, x usually also has some additional property (for example, the nonzero entries of x independently and identically follow the Gaussian distribution), none of existing analysis uses these properties to answer the above question. In this paper, we first show that the prior distribution information of x can be used to provide an upper bound on x 1 2 x 2 2 , and then explore the bound to develop a better lower bound on the probability of exact recovery with OMP in K iterations. Simulation tests are presented to illustrate the superiority of the new bound.


Optimal Tolling for Multitype Mixed Autonomous Traffic Networks. When selfish users share a road network and minimize their individual travel costs, the equilibrium they reach can be worse than the socially optimal routing. Tolls are often used to mitigate this effect in traditional congestion games, where all vehicle contribute identically to congestion. However, with the proliferation of autonomous vehicles and driver assistance technology, vehicles become heterogeneous in how they contribute to road latency. This magnifies the potential inefficiencies due to selfish routing and invalidates traditional tolling methods. To address this, we consider a network of parallel roads where the latency on each road is an affine function of the quantity of flow of each vehicle type. We provide tolls (which differentiate between vehicle types) which are guaranteed to minimize social cost at equilibrium. The tolls are a function of a calculated optimal routing to enable this tolling, we prove that some element in the set of optimal routings has a lack of cycles in a graph representing the way vehicles types share roads. We then show that unless a planner can differentiate between vehicle types in the tolls given, the resulting equilibrium can be unboundedly worse than the optimal routing, and that marginal cost tolling fails in our setting.


Sums of random polynomials with independent roots. We consider the zeros of the sum of independent random polynomials as their degrees tend to infinity. Namely, let p and q be two independent random polynomials of degree n , whose roots are chosen independently from the probability measures mu and nu in the complex plane, respectively. We compute the limiting distribution for the zeros of the sum p q as n tends to infinity. The limiting distribution can be described by its logarithmic potential, which we show is the pointwise maximum of the logarithmic potentials of mu and nu . More generally, we consider the sum of m independent degree n random polynomials when m is fixed and n tends to infinity. Our results can be viewed as describing a version of the free additive convolution from free probability theory for zeros of polynomials.