New numerical algorithm for deflation of infinite and zero eigenvalues and full solution of quadratic eigenvalue problems. This paper presents a new method for computing all eigenvalues and eigenvectors of quadratic matrix pencil. It is an upgrade of the quadeig algorithm by Hammarling, Munro and Tisseur, which attempts to reveal and remove by deflation certain number of zero and infinite eigenvalues before QZ iterations. Proposed modifications of the quadeig framework are designed to enhance backward stability and to make the process of deflating infinite and zero eigenvalues more numerically robust. In particular, careful preprocessing allows scaling invariant component wise backward error and thus better condition number. Further, using an upper triangular version of the Kronecker canonical form enables deflating additional infinite eigenvalues, in addition to those inferred from the rank of leading coefficient matrix. Theoretical analysis and empirical evidence from thorough testing of the software implementation confirm superior numerical performances of the proposed method.


TStarBot X An Open Sourced and Comprehensive Study for Efficient League Training in StarCraft II Full Game. StarCraft, one of the most difficult esport games with long standing history of professional tournaments, has attracted generations of players and fans, and also, intense attentions in artificial intelligence research. Recently, Google's DeepMind announced AlphaStar, a grandmaster level AI in StarCraft II that can play with humans using comparable action space and operations. In this paper, we introduce a new AI agent, named TStarBot X, that is trained under orders of less computations and can play competitively with expert human players. TStarBot X takes advantage of important techniques introduced in AlphaStar, and also benefits from substantial innovations including new league training methods, novel multi agent roles, rule guided policy search, stabilized policy improvement, lightweight neural network architecture, and importance sampling in imitation learning, etc. We show that with orders of less computation scale, a faithful reimplementation of AlphaStar's methods can not succeed and the proposed techniques are necessary to ensure TStarBot X's competitive performance. We reveal all technical details that are complementary to those mentioned in AlphaStar, showing the most sensitive parts in league training, reinforcement learning and imitation learning that affect the performance of the agents. Most importantly, this is an open sourced study that all codes and resources (including the trained model parameters) are publicly accessible via url https github.com tencent ailab tleague projpage . We expect this study could be beneficial for both academic and industrial future research in solving complex problems like StarCraft, and also, might provide a sparring partner for all StarCraft II players and other AI agents.


On Linear Programming for Constrained and Unconstrained Average Cost Markov Decision Processes with Countable Action Spaces and Strictly Unbounded Costs. We consider the linear programming approach for constrained and unconstrained Markov decision processes (MDPs) under the long run average cost criterion, where the class of MDPs in our study have Borel state spaces and discrete countable action spaces. Under a strict unboundedness condition on the one stage costs and a recently introduced majorization condition on the state transition stochastic kernel, we study infinite dimensional linear programs for the average cost MDPs and prove the absence of a duality gap and other optimality results. Our results do not require a lower semicontinuous MDP model. Thus, they can be applied to countable action space MDPs where the dynamics and one stage costs are discontinuous in the state variable. Our proofs make use of the continuity property of Borel measurable functions asserted by Lusin's theorem.


Eigenfunctions and minimum 1 perfect bitrades in the Hamming graph. The Hamming graph H(n,q) is the graph whose vertices are the words of length n over the alphabet 0,1, ldots,q 1 , where two vertices are adjacent if they differ in exactly one coordinate. The adjacency matrix of H(n,q) has n 1 distinct eigenvalues n(q 1) q cdot i with corresponding eigenspaces U i (n,q) for 0 leq i leq n . In this work we study functions belonging to a direct sum U i(n,q) oplus U i 1 (n,q) oplus ldots oplus U j(n,q) for 0 leq i leq j leq n . We find the minimum cardinality of the support of such functions for q 2 and for q 3 , i j n . In particular, we find the minimum cardinality of the support of eigenfunctions from the eigenspace U i (n,3) for i frac n 2 . Using the correspondence between 1 perfect bitrades and eigenfunctions with eigenvalue 1 , we find the minimum size of a 1 perfect bitrade in the Hamming graph H(n,3) .


A Novel Multi Agent System for Complex Scheduling Problems. Complex scheduling problems require a large amount computation power and innovative solution methods. The objective of this paper is the conception and implementation of a multi agent system that is applicable in various problem domains. Independent specialized agents handle small tasks, to reach a superordinate target. Effective coordination is therefore required to achieve productive cooperation. Role models and distributed artificial intelligence are employed to tackle the resulting challenges. We simulate a NP hard scheduling problem to demonstrate the validity of our approach. In addition to the general agent based framework we propose new simulation based optimization heuristics to given scheduling problems. Two of the described optimization algorithms are implemented using agents. This paper highlights the advantages of the agent based approach, like the reduction in layout complexity, improved control of complicated systems, and extendability.


Learning Texture Invariant Representation for Domain Adaptation of Semantic Segmentation. Since annotating pixel level labels for semantic segmentation is laborious, leveraging synthetic data is an attractive solution. However, due to the domain gap between synthetic domain and real domain, it is challenging for a model trained with synthetic data to generalize to real data. In this paper, considering the fundamental difference between the two domains as the texture, we propose a method to adapt to the texture of the target domain. First, we diversity the texture of synthetic images using a style transfer algorithm. The various textures of generated images prevent a segmentation model from overfitting to one specific (synthetic) texture. Then, we fine tune the model with self training to get direct supervision of the target texture. Our results achieve state of the art performance and we analyze the properties of the model trained on the stylized dataset with extensive experiments.


Spaces of knotted circles and exotic smooth structures. Suppose that N 1 and N 2 are closed smooth manifolds of dimension n that are homeomorphic. We prove that the spaces of smooth knots Emb(S 1, N 1) and Emb(S 1, N 2) have the same homotopy (2n 7) type. In the 4 dimensional case this means that the spaces of smooth knots in homeomorphic 4 manifolds have sets pi 0 of components that are in bijection, and the corresponding path components have the same fundamental groups pi 1 . The result about pi 0 is well known and elementary, but the result about pi 1 appears to be new. The result gives a negative partial answer to a question of Oleg Viro. Our proof uses the Goodwillie Weiss embedding tower. We give a new model for the quadratic stage of the Goodwillie Weiss tower, and prove that the homotopy type of the quadratic approximation of the space of knots in N does not depend on the smooth structure on N . Our results also give a lower bound on pi 2 Emb(S 1, N) . We use our model to show that for every choice of basepoint, each of the homotopy groups pi 1 and pi 2 of Emb(S 1, S 1 times S 3) contains an infinitely generated free abelian group.


Remarks on the recurrence and transience of non backtracking random walks. A short proof of the equivalence of the recurrence of non backtracking random walk and that of simple random walk on regular infinite graphs is given. It is then shown how this proof can be extended in certain cases where the graph in question is not regular.


Elliptic quintics on cubic fourfolds, O'Grady 10, and Lagrangian fibrations. For a smooth cubic fourfold Y, we study the moduli space M of semistable objects of Mukai vector 2 lambda 1 2 lambda 2 in the Kuznetsov component of Y. We show that with a certain choice of stability conditions, M admits a symplectic resolution tilde M , which is a smooth projective hyperk "ahler manifold, deformation equivalent to the 10 dimensional examples constructed by O'Grady. As applications, we show that a birational model of tilde M provides a hyperk "ahler compactification of the twisted family of intermediate Jacobians associated to Y. This generalizes the previous result of Voisin arXiv 1611.06679 in the very general case. We also prove that tilde M is the MRC quotient of the main component of the Hilbert scheme of elliptic quintic curves in Y, confirming a conjecture of Castravet.


Breaking the Barrier of 2 for the Storage Allocation Problem. Packing problems are an important class of optimization problems. The probably most well known problem if this type is knapsack and many generalizations of it have been studied in the literature like Two dimensional Geometric Knapsack (2DKP) and Unsplittable Flow on a Path (UFP). For the latter two problems, recently the first polynomial time approximation algorithms with better approximation ratios than 2 were presented G 'alvez et al., FOCS 2017 Grandoni et al., STOC 2018 . In this paper we break the barrier of 2 for the Storage Allocation Problem (SAP) which is a natural intermediate problem between 2DKP and UFP. We are given a path with capacitated edges and a set of tasks where each task has a start vertex, an end vertex, a size, and a profit. We seek to select the most profitable set of tasks that we can draw as non overlapping rectangles underneath the capacity profile of the edges where the height of each rectangle equals the size of the corresponding task. This problem is motivated by settings of allocation resources like memory, bandwidths, etc. where each request needs a contiguous portion of the resource. The best known polynomial time approximation algorithm for SAP has an approximation ratio of 2 epsilon M "omke and Wiese, ICALP 2015 and no better quasi polynomial time algorithm is known. We present a polynomial time (63 32) 1.969 approximation algorithm for the case of uniform edge capacities and a quasi polynomial time (1.997) approximation algorithm for non uniform quasi polynomially bounded edge capacities. Finally, we show that under slight resource augmentation we can obtain approximation ratios of 3 2 epsilon in polynomial time and 1 epsilon in quasi polynomial time, both for arbitrary edge capacities.


Cubic surfaces as Pfaffians. We prove that every cubic surface in mathbb C x,y,z,t is Pfaffian. A constructive proof is given.


Semantic Indexes for Machine Learning based Queries over Unstructured Data. Unstructured data (e.g., video or text) is now commonly queried by using computationally expensive deep neural networks or human labelers to produce structured information, e.g., object types and positions in video. To accelerate queries, many recent systems (e.g., BlazeIt, NoScope, Tahoma, SUPG, etc.) train a query specific proxy model to approximate a large target labelers (i.e., these expensive neural networks or human labelers). These models return proxy scores that are then used in query processing algorithms. Unfortunately, proxy models usually have to be trained per query and require large amounts of annotations from the target labelers. In this work, we develop an index (trainable semantic index, TASTI) that simultaneously removes the need for per query proxies and is more efficient to construct than prior indexes. TASTI accomplishes this by leveraging semantic similarity across records in a given dataset. Specifically, it produces embeddings for each record such that records with close embeddings have similar target labeler outputs. TASTI then generates high quality proxy scores via embeddings without needing to train a per query proxy. These scores can be used in existing proxy based query processing algorithms (e.g., for aggregation, selection, etc.). We theoretically analyze TASTI and show that a low embedding training error guarantees downstream query accuracy for a natural class of queries. We evaluate TASTI on five video, text, and speech datasets, and three query types. We show that TASTI's indexes can be 10 times less expensive to construct than generating annotations for current proxy based methods, and accelerate queries by up to 24 times .


A new method of brain stimulation at ultra high frequency. Nerve stimulation via micro electrode implants is one of the neurostimulation approaches which is used frequently in the medical treatment of some brain disorders, neural prosthetics, brain machine interfaces and also in the cyborg. In this method, the electrical stimulation signal can be categorized by the frequency band low frequency, high frequency, and ultra high frequency. The stimulation should be less destructive, more smooth, and controllable. In this article, we present a brief description of the mechanism underlying the ultra high frequency stimulation. In the flowing, from an informatics perspective, we propose a state of the art, low destructive, and highly efficient stimulation method at the low amplitude ultra high frequency signal. In this method, we have tried to reduce the adaptation of the nerve system by modulating the stimulation signal via a low frequency rectangular random wave. By this method, we could reach the "almost zero discharge" with minimum destructive effect in the experimental test on the fish nervous system.


Semantic Sentiment Analysis Based on Probabilistic Graphical Models and Recurrent Neural Network. Sentiment Analysis is the task of classifying documents based on the sentiments expressed in textual form, this can be achieved by using lexical and semantic methods. The purpose of this study is to investigate the use of semantics to perform sentiment analysis based on probabilistic graphical models and recurrent neural networks. In the empirical evaluation, the classification performance of the graphical models was compared with some traditional machine learning classifiers and a recurrent neural network. The datasets used for the experiments were IMDB movie reviews, Amazon Consumer Product reviews, and Twitter Review datasets. After this empirical study, we conclude that the inclusion of semantics for sentiment analysis tasks can greatly improve the performance of a classifier, as the semantic feature extraction methods reduce uncertainties in classification resulting in more accurate predictions.


A Number Theoretic Approach for Fast Discovery of Single Hop Wireless Networks. Interference management has become a key factor in regulating transmissions in wireless communication networks. To support effective interference management schemes, it can be essential to have prior knowledge about the network topology. In this paper, we build on existing results in the literature on the simulation of the message passing model, and present an efficient strategy for fast discovery of the network topology during a pilot communication phase. More precisely, we investigate the minimum number of communication rounds that is needed to discover an arbitrary network topology with a maximum number of links per receiver, while assuming a single hop network that is restricted to interference avoidance based schemes in its pilot phase. We first ignore any interference cancellation strategy such that no receiver can recognize, and cancel transmissions of, previously discovered transmitters, and then capture the gains obtained through interference cancellation during the pilot phase. Our results evince how the required number of rounds scale in an approximately logarithmic fashion with practical values of the total number of users in the network, having a slope proportional to the number of interfering transmitters per receiver.


Flow electrification of corona charged polyethylene terephthalate film. Corona charging a free standing polymer film can produce a quasi permanent potential difference across the film thickness, while the absolute amplitude of surface voltage may be highly sensitive to the free charges. To precisely control the voltage distribution, we investigated the flow electrification technology, by exposing corona charged polyethylene terephthalate films to a variety of sodium salt solutions. The surface voltage and the free charge density were adjusted by the salt concentration, the anion size, and the flow rate. The dipolar component of electric potential remained unchanged. This result has significant scientific interest and technological importance to surface treatment, filtration, energy harvesting, bio actuation and bio sensing, among others.


Domain segmentation and adjustment for generalized zero shot learning. In the generalized zero shot learning, synthesizing unseen data with generative models has been the most popular method to address the imbalance of training data between seen and unseen classes. However, this method requires that the unseen semantic information is available during the training stage, and training generative models is not trivial. Given that the generator of these models can only be trained with seen classes, we argue that synthesizing unseen data may not be an ideal approach for addressing the domain shift caused by the imbalance of the training data. In this paper, we propose to realize the generalized zero shot recognition in different domains. Thus, unseen (seen) classes can avoid the effect of the seen (unseen) classes. In practice, we propose a threshold and probabilistic distribution joint method to segment the testing instances into seen, unseen and uncertain domains. Moreover, the uncertain domain is further adjusted to alleviate the domain shift. Extensive experiments on five benchmark datasets show that the proposed method exhibits competitive performance compared with that based on generative models.


Evaluating Efficient Performance Estimators of Neural Architectures. Conducting efficient performance estimations of neural architectures is a major challenge in neural architecture search (NAS). To reduce the architecture training costs in NAS, one shot estimators (OSEs) amortize the architecture training costs by sharing the parameters of one "supernet" between all architectures. Recently, zero shot estimators (ZSEs) that involve no training are proposed to further reduce the architecture evaluation cost. Despite the high efficiency of these estimators, the quality of such estimations has not been thoroughly studied. In this paper, we conduct an extensive and organized assessment of OSEs and ZSEs on five NAS benchmarks NAS Bench 101 201 301, and NDS ResNet ResNeXt A. Specifically, we employ a set of NAS oriented criteria to study the behavior of OSEs and ZSEs and reveal that they have certain biases and variances. After analyzing how and why the OSE estimations are unsatisfying, we explore how to mitigate the correlation gap of OSEs from several perspectives. Through our analysis, we give out suggestions for future application and development of efficient architecture performance estimators. Furthermore, the analysis framework proposed in our work could be utilized in future research to give a more comprehensive understanding of newly designed architecture performance estimators. All codes are available at https github.com walkerning aw nas.


Approximate Model Counting, Sparse XOR Constraints and Minimum Distance. The problem of counting the number of models of a given Boolean formula has numerous applications, including computing the leakage of deterministic programs in Quantitative Information Flow. Model counting is a hard, P complete problem. For this reason, many approximate counters have been developed in the last decade, offering formal guarantees of confidence and accuracy. A popular approach is based on the idea of using random XOR constraints to, roughly, successively halving the solution set until no model is left this is checked by invocations to a SAT solver. The effectiveness of this procedure hinges on the ability of the SAT solver to deal with XOR constraints, which in turn crucially depends on the length of such constraints. We study to what extent one can employ sparse, hence short, constraints, keeping guarantees of correctness. We show that the resulting bounds are closely related to the geometry of the set of models, in particular to the minimum Hamming distance between models. We evaluate our theoretical results on a few concrete formulae. Based on our findings, we finally discuss possible directions for improvements of the current state of the art in approximate model counting.


Geometric Convergence of Distributed Gradient Play in Games with Unconstrained Action Sets. We provide a distributed algorithm to learn a Nash equilibrium in a class of non cooperative games with strongly monotone mappings and unconstrained action sets. Each player has access to her own smooth local cost function and can communicate to her neighbors in some undirected graph. We consider a distributed communication based gradient algorithm. For this procedure, we prove geometric convergence to a Nash equilibrium. In contrast to our previous works 15 , 16 , where the proposed algorithms required two parameters to be set up and the analysis was based on a so called augmented game mapping, the procedure in this work corresponds to a standard distributed gradient play and, thus, only one constant step size parameter needs to be chosen appropriately to guarantee fast convergence to a game solution. Moreover, we provide a rigorous comparison between the convergence rate of the proposed distributed gradient play and the rate of the GRANE algorithm presented in 15 . It allows us to demonstrate that the distributed gradient play outperforms the GRANE in terms of convergence speed.


A Stack Propagation Framework with Token Level Intent Detection for Spoken Language Understanding. Intent detection and slot filling are two main tasks for building a spoken language understanding (SLU) system. The two tasks are closely tied and the slots often highly depend on the intent. In this paper, we propose a novel framework for SLU to better incorporate the intent information, which further guides the slot filling. In our framework, we adopt a joint model with Stack Propagation which can directly use the intent information as input for slot filling, thus to capture the intent semantic knowledge. In addition, to further alleviate the error propagation, we perform the token level intent detection for the Stack Propagation framework. Experiments on two publicly datasets show that our model achieves the state of the art performance and outperforms other previous methods by a large margin. Finally, we use the Bidirectional Encoder Representation from Transformer (BERT) model in our framework, which further boost our performance in SLU task.


Extracting Cellular Location of Human Proteins Using Deep Learning. Understanding and extracting the patterns of microscopy images has been a major challenge in the biomedical field. Although trained scientists can locate the proteins of interest within a human cell, this procedure is not efficient and accurate enough to process a large amount of data and it often leads to bias. To resolve this problem, we attempted to create an automatic image classifier using Machine Learning to locate human proteins with higher speed and accuracy than human beings. We implemented a Convolution Neural Network with Residue and Squeeze Excitation layers classifier to locate given proteins of any type in a subcellular structure. After training the model using a series of techniques, it can locate thousands of proteins in 27 different human cell types into 28 subcellular locations, way significant than historical approaches. The model can classify 4,500 images per minute with an accuracy of 63.07 , surpassing human performance in accuracy (by 35 ) and speed. Because our system can be implemented on different cell types, it opens a new vision of understanding in the biomedical field. From the locational information of the human proteins, doctors can easily detect cell's abnormal behaviors including viral infection, pathogen invasion, and malignant tumor development. Given the amount of data generalized by experiments are greater than that human can analyze, the model cut down the human resources and time needed to analyze data. Moreover, this locational information can be used in different scenarios like subcellular engineering, medical care, and etiology inspection.


Vertical quasi isometries and branched quasisymmetries. We introduce a class of mappings called vertical quasi isometries and show that branched quasisymmetries X to Y of Guo and Williams between compact, bounded turning metric doubling spaces admit natural vertically quasi isometric extensions widehat X to widehat Y between hyperbolic fillings widehat X and widehat Y of X and Y , respectively. We also give a converse for this result by showing that a finite multiplicity vertical quasi isometry widehat X to widehat Y between hyperbolic fillings induces a branched quasisymmetry X to Y .


Application Component Placement in NFV based Hybrid Cloud Fog Systems with Mobile Fog Nodes. Fog computing reduces the latency induced by distant clouds by enabling the deployment of some application components at the edge of the network, on fog nodes, while keeping others in the cloud. Application components can be implemented as Virtual Network Functions (VNFs) and their execution sequences can be modeled by a combination of sub structures like sequence, parallel, selection, and loops. Efficient placement algorithms are required to map the application components onto the infrastructure nodes. Current solutions do not consider the mobility of fog nodes, a phenomenon which may happen in real systems. In this paper, we use the random waypoint mobility model for fog nodes to calculate the expected makespan and application execution cost. We then model the problem as an Integer Linear Programming (ILP) formulation which minimizes an aggregated weighted function of the makespan and cost. We propose a Tabu Search based Component Placement (TSCP) algorithm to find sub optimal placements. The results show that the proposed algorithm improves the makespan and the application execution cost.


Resolvent analysis of an airfoil laminar separation bubble at Re 500,000. We perform resolvent analysis to examine the perturbation dynamics over the laminar separation bubble (LSB) that forms near the leading edge of a NACA 0012 airfoil at a chord based Reynolds number of 500,000 and an angle of attack of 8 degrees. Randomized SVD is adopted in the present analysis to relieve the computational cost associated with the high Re global base flow. To examine the local physics over the LSB, we consider the use of exponential discounting to limit the time horizon that allows for the instability to develop with respect to the base flow. With discounting, the gain distribution over frequency accurately captures the spectral content over the LSB obtained from flow simulation. The peak gain frequency also agrees with previous flow control results on suppressing dynamic stall over a pitching airfoil. According to the gain distribution and the modal structures, we conclude that the dominant energy amplification mechanism is the Kelvin Helmholtz instability. In addition to discounting, we also examine the use of spatial windows for both the forcing and response. From the response windowed analysis, we find that the LSB serves the main role of energy amplifier, with the amplification saturating at the reattachment point. The input window imposes the constraint of surface forcing, and the results show that the optimal actuator location is slightly upstream of the separation point. The surface forcing mode also suggest the optimal momentum forcing in the surface tangent direction, with strong uni directionality that is ideal for synthetic jet type actuators. This study demonstrates the strength of randomized resolvent analysis in tackling high Reynolds number base flows and calls attention to the care needed for base flow instabilities.


An Upper Bound for Wiretap Multi way Channels. A general model for wiretap multi way channels is introduced that includes several previously studied models in information theoretic security as special cases. A new upper bound is developed that generalizes and unifies previous bounds. We also introduce a multivariate dependence balance bound which is of independent interest.


Measuring Massive Multitask Language Understanding. We propose a new test to measure a text model's multitask accuracy. The test covers 57 tasks including elementary mathematics, US history, computer science, law, and more. To attain high accuracy on this test, models must possess extensive world knowledge and problem solving ability. We find that while most recent models have near random chance accuracy, the very largest GPT 3 model improves over random chance by almost 20 percentage points on average. However, on every one of the 57 tasks, the best models still need substantial improvements before they can reach expert level accuracy. Models also have lopsided performance and frequently do not know when they are wrong. Worse, they still have near random accuracy on some socially important subjects such as morality and law. By comprehensively evaluating the breadth and depth of a model's academic and professional understanding, our test can be used to analyze models across many tasks and to identify important shortcomings.


Improving cluster recovery with feature rescaling factors. The data preprocessing stage is crucial in clustering. Features may describe entities using different scales. To rectify this, one usually applies feature normalisation aiming at rescaling features so that none of them overpowers the others in the objective function of the selected clustering algorithm. In this paper, we argue that the rescaling procedure should not treat all features identically. Instead, it should favour the features that are more meaningful for clustering. With this in mind, we introduce a feature rescaling method that takes into account the within cluster degree of relevance of each feature. Our comprehensive simulation study, carried out on real and synthetic data, with and without noise features, clearly demonstrates that clustering methods that use the proposed data normalization strategy clearly outperform those that use traditional data normalization.


An Empirical Study into the Success of Listed Smart Contracts in Ethereum. Since it takes time and effort to put a new product or service on the market, one would like to predict whether it will be a success. In general this is not possible, but it is possible to follow best practices in order to maximise the chance of success. A smart contract is intended to encode business logic and is therefore at the heart of every new business on the Ethereum blockchain. We have investigated how to measure the success of smart contracts, and whether successful smart contracts have characteristics that less successful smart contracts lack. The appearance of a smart contract on a listing website such as Etherscan or StateoftheDapps is such a characteristic. In this paper, we present a three pronged analysis of the relative success of listed smart contracts. First, we have used statistical analysis on the publicly visible transaction history of the Ethereum blockchain to determine that listed contracts are significantly more successful than their unlisted counterparts. Next, we have conducted a survey among more than 200 developers via an anonymous online survey about their experience with the listing process. A significant majority of respondents do not believe that listing a contract itself contributes to its success, but they believe that the extra attention that is typically paid in tandem with the listing process does contribute. Finally, based on the respondents' answers, we have drafted 10 recommendations for developers and validated them by submitting them to an international panel of experts.


Constant periodic data and rigidity. In this work we lead with expanding maps of the circle and Anosov diffeomorphisms on mathbb T d, d geq 2. We prove that, for these maps, textit constant periodic data imply textit same periodic data of these maps and their linearizations , so in particular we have smooth conjugacy. For expanding maps of the circle and Anosov diffeomorphism on mathbb T d, d 2, 3, we have global rigidity. In higher dimensions, d geq 4, we can establish a result of local rigidity, in several cases. The main tools of this work are celebrated results of rigidity involving same periodic data with linearization and results involving topological entropy of a diffeomorphism along an expanding invariant foliation.


Cost Sensitive Machine Learning Classification for Mass Tuberculosis Verbal Screening. Score based algorithms for tuberculosis (TB) verbal screening perform poorly, causing misclassification that leads to missed cases and unnecessary costly laboratory tests for false positives. We compared score based classification defined by clinicians to machine learning classification such as SVM RBF, logistic regression, and XGBoost. We restricted our analyses to data from adults, the population most affected by TB, and investigated the difference between untuned and unweighted classifiers to the cost sensitive ones. Predictions were compared with the corresponding GeneXpert MTB Rif results. After adjusting the weight of the positive class to 40 for XGBoost, we achieved 96.64 sensitivity and 35.06 specificity. As such, the sensitivity of our identifier increased by 1.26 while specificity increased by 13.19 in absolute value compared to the traditional score based method defined by our clinicians. Our approach further demonstrated that only 2000 data points were sufficient to enable the model to converge. The results indicate that even with limited data we can actually devise a better method to identify TB suspects from verbal screening.


TASE Reducing latency of symbolic execution with transactional memory. We present the design and implementation of a tool called TASE that uses transactional memory to reduce the latency of symbolic execution applications with small amounts of symbolic state. Execution paths are executed natively while operating on concrete values, and only when execution encounters symbolic values (or modeled functions) is native execution suspended and interpretation begun. Execution then returns to its native mode when symbolic values are no longer encountered. The key innovations in the design of TASE are a technique for amortizing the cost of checking whether values are symbolic over few instructions, and the use of hardware supported transactional memory (TSX) to implement native execution that rolls back with no effect when use of a symbolic value is detected (perhaps belatedly). We show that TASE has the potential to dramatically improve some latency sensitive applications of symbolic execution, such as methods to verify the behavior of a client in a client server application.


A bibliometric study of research topics, collaboration and centrality in the Iterated Prisoner's Dilemma. This manuscript explores the research topics and collaborative behaviour of authors in the field of the Prisoner's Dilemma using topic modeling and a graph theoretic analysis of the co authorship network. The analysis identified five research topics in the Prisoner's Dilemma which have been relevant over the course of time. These are human subject research, biological studies, strategies, evolutionary dynamics on networks and modeling problems as a Prisoner's Dilemma game. Moreover, the results demonstrated the Prisoner's Dilemma is a field of continued interest, and that it is a collaborative field compared to other game theoretic fields. The co authorship network suggests that authors are focused on their communities and that not many connections across the communities are made. The most central authors of the network are the authors connected to the main cluster. Through examining the networks of topics, it was uncovered that the main cluster is characterised by the collaboration of authors in a single topic. These findings add to the bibliometrics study in another field and present new questions and avenues of research to understand the reasons for the measured behaviours.


Neural Reasoning, Fast and Slow, for Video Question Answering. What does it take to design a machine that learns to answer natural questions about a video? A Video QA system must simultaneously understand language, represent visual content over space time, and iteratively transform these representations in response to lingual content in the query, and finally arriving at a sensible answer. While recent advances in lingual and visual question answering have enabled sophisticated representations and neural reasoning mechanisms, major challenges in Video QA remain on dynamic grounding of concepts, relations and actions to support the reasoning process. Inspired by the dual process account of human reasoning, we design a dual process neural architecture, which is composed of a question guided video processing module (System 1, fast and reactive) followed by a generic reasoning module (System 2, slow and deliberative). System 1 is a hierarchical model that encodes visual patterns about objects, actions and relations in space time given the textual cues from the question. The encoded representation is a set of high level visual features, which are then passed to System 2. Here multi step inference follows to iteratively chain visual elements as instructed by the textual elements. The system is evaluated on the SVQA (synthetic) and TGIF QA datasets (real), demonstrating competitive results, with a large margin in the case of multi step reasoning.


Cascaded Context Pyramid for Full Resolution 3D Semantic Scene Completion. Semantic Scene Completion (SSC) aims to simultaneously predict the volumetric occupancy and semantic category of a 3D scene. It helps intelligent devices to understand and interact with the surrounding scenes. Due to the high memory requirement, current methods only produce low resolution completion predictions, and generally lose the object details. Furthermore, they also ignore the multi scale spatial contexts, which play a vital role for the 3D inference. To address these issues, in this work we propose a novel deep learning framework, named Cascaded Context Pyramid Network (CCPNet), to jointly infer the occupancy and semantic labels of a volumetric 3D scene from a single depth image. The proposed CCPNet improves the labeling coherence with a cascaded context pyramid. Meanwhile, based on the low level features, it progressively restores the fine structures of objects with Guided Residual Refinement (GRR) modules. Our proposed framework has three outstanding advantages (1) it explicitly models the 3D spatial context for performance improvement (2) full resolution 3D volumes are produced with structure preserving details (3) light weight models with low memory requirements are captured with a good extensibility. Extensive experiments demonstrate that in spite of taking a single view depth map, our proposed framework can generate high quality SSC results, and outperforms state of the art approaches on both the synthetic SUNCG and real NYU datasets.


Duality for Knizhnik Zamolodchikov and Dynamical Operators. We consider the Knizhnik Zamolodchikov and dynamical operators, both differential and difference, in the context of the ( mathfrak gl k , mathfrak gl n ) duality for the space of polynomials in kn anticommuting variables. We show that the Knizhnik Zamolodchikov and dynamical operators naturally exchange under the duality.


Structured Attention for Unsupervised Dialogue Structure Induction. Inducing a meaningful structural representation from one or a set of dialogues is a crucial but challenging task in computational linguistics. Advancement made in this area is critical for dialogue system design and discourse analysis. It can also be extended to solve grammatical inference. In this work, we propose to incorporate structured attention layers into a Variational Recurrent Neural Network (VRNN) model with discrete latent states to learn dialogue structure in an unsupervised fashion. Compared to a vanilla VRNN, structured attention enables a model to focus on different parts of the source sentence embeddings while enforcing a structural inductive bias. Experiments show that on two party dialogue datasets, VRNN with structured attention learns semantic structures that are similar to templates used to generate this dialogue corpus. While on multi party dialogue datasets, our model learns an interactive structure demonstrating its capability of distinguishing speakers or addresses, automatically disentangling dialogues without explicit human annotation.


Compensation for undefined behaviors during robot task execution by switching controllers depending on embedded dynamics in RNN. Robotic applications require both correct task performance and compensation for undefined behaviors. Although deep learning is a promising approach to perform complex tasks, the response to undefined behaviors that are not reflected in the training dataset remains challenging. In a human robot collaborative task, the robot may adopt an unexpected posture due to collisions and other unexpected events. Therefore, robots should be able to recover from disturbances for completing the execution of the intended task. We propose a compensation method for undefined behaviors by switching between two controllers. Specifically, the proposed method switches between learning based and model based controllers depending on the internal representation of a recurrent neural network that learns task dynamics. We applied the proposed method to a pick and place task and evaluated the compensation for undefined behaviors. Experimental results from simulations and on a real robot demonstrate the effectiveness and high performance of the proposed method.


Anisotropic bootstrap percolation in three dimensions. Consider a p random subset A of initially infected vertices in the discrete cube L 3 , and assume that the neighbourhood of each vertex consists of the a i nearest neighbours in the pm e i directions for each i in 1,2,3 , where a 1 le a 2 le a 3 . Suppose we infect any healthy vertex x in L 3 already having a 3 1 infected neighbours, and that infected sites remain infected forever. In this paper we determine the critical length for percolation up to a constant factor in the exponent, for all triples (a 1,a 2,a 3) . To do so, we introduce a new algorithm called the beams process and prove an exponential decay property for a family of subcritical two dimensional bootstrap processes.


A Linear Transportation mathrm L p Distance for Pattern Recognition. The transportation mathrm L p distance, denoted mathrm TL p , has been proposed as a generalisation of Wasserstein mathrm W p distances motivated by the property that it can be applied directly to colour or multi channelled images, as well as multivariate time series without normalisation or mass constraints. These distances, as with mathrm W p , are powerful tools in modelling data with spatial or temporal perturbations. However, their computational cost can make them infeasible to apply to even moderate pattern recognition tasks. We propose linear versions of these distances and show that the linear mathrm TL p distance significantly improves over the linear mathrm W p distance on signal processing tasks, whilst being several orders of magnitude faster to compute than the mathrm TL p distance.


On the structure of the Nehari set associated to a Schr "odinger Poisson system with prescribed mass old and new results. In this paper we apply the fibering method of Pohozaev to a Schr "odinger Poisson system, with prescribed L 2 norm of the unknown, in the whole mathbb R 3 . The method makes clear the role played by the exponents p 3, p 8 3, p 10 3 . Beside to show as old results can be obtained in a unified way, we exhibit also new ones.


Neural Pruning via Growing Regularization. Regularization has long been utilized to learn sparsity in deep neural network pruning. However, its role is mainly explored in the small penalty strength regime. In this work, we extend its application to a new scenario where the regularization grows large gradually to tackle two central problems of pruning pruning schedule and weight importance scoring. (1) The former topic is newly brought up in this work, which we find critical to the pruning performance while receives little research attention. Specifically, we propose an L2 regularization variant with rising penalty factors and show it can bring significant accuracy gains compared with its one shot counterpart, even when the same weights are removed. (2) The growing penalty scheme also brings us an approach to exploit the Hessian information for more accurate pruning without knowing their specific values, thus not bothered by the common Hessian approximation problems. Empirically, the proposed algorithms are easy to implement and scalable to large datasets and networks in both structured and unstructured pruning. Their effectiveness is demonstrated with modern deep neural networks on the CIFAR and ImageNet datasets, achieving competitive results compared to many state of the art algorithms. Our code and trained models are publicly available at https github.com mingsuntse regularization pruning.


A Dichotomy for the Weierstrass type functions. For a real analytic periodic function phi mathbb R to mathbb R , an integer b ge 2 and lambda in (1 b,1) , we prove the following dichotomy for the Weierstrass type function W(x) sum limits n ge 0 lambda n phi(b nx) Either W(x) is real analytic, or the Hausdorff dimension of its graph is equal to 2 log b lambda . Furthermore, given b and phi , the former alternative only happens for finitely many lambda unless phi is constant.


The Generalisation of the DMCA Coefficient to Serve Distinguishing Between Hedge and Safe Haven Capabilities of the Gold. This paper aims to investigate the role of gold as a hedge and or safe haven against oil price and currency market movements for medium (calm period) and large (extreme movement) fluctuations. In revisiting the role of gold, our study proposes new insights into the literature. First, our empirical design relaxes the assumption of homogeneous investors in favour of agents with different horizons. Second, we develop a new measure of correlation based on the fractal approach, called the q detrending moving average cross correlation coefficient. This allows us to measure the dependence for calm and extreme movements. The proposed measure is both time varying and time scale varying, taking into account the complex pattern of commodities and financial time series (chaotic, non stationary, etc.). Using intraday data from May 2017 to March 2019, including 35608 observations for each variable, our results are as follows. First, we show a negative and significant average and tail dependence for all time scales between gold and USD exchange rates that is consistent with the gold's role as an effective hedge and safe haven asset. Second, this study puts out average independence and positive and significant tail independence between gold and oil indicating that gold can be used by investors as a weak hedge but cannot be used as an effective safe haven asset under exceptional market circumstances for all time scales. Third, we examine the hedging and stabilising benefits of gold over calm and turmoil periods for gold oil futures and gold currency portfolios by estimation of the optimal portfolio weights and the optimal hedge ratio. We confirm the usefulness of gold for hedging and safe havens at different investment horizons, which favors the inclusion of gold futures in oil futures and currency portfolios for risk management purposes.


On the validity of complex Langevin method for path integral computations. The complex Langevin (CL) method is a classical numerical strategy to alleviate the numerical sign problem in the computation of lattice field theories. Mathematically, it is a simple numerical tool to compute a wide class of high dimensional and oscillatory integrals. However, it is often observed that the CL method converges but the limiting result is incorrect. The literature has several unclear or even conflicting statements, making the method look mysterious. By an in depth analysis of a model problem, we reveal the mechanism of how the CL result turns biased as the parameter changes, and it is demonstrated that such a transition is difficult to capture. Our analysis also shows that the method works for any observables only if the probability density function generated by the CL process is localized. To generalize such observations to lattice field theories, we formulate the CL method on general groups using rigorous mathematical languages for the first time, and we demonstrate that such localized probability density function does not exist in the simulation of lattice field theories for general compact groups, which explains the unstable behavior of the CL method. Fortunately, we also find that the gauge cooling technique creates additional velocity that helps confine the samples, so that we can still see localized probability density functions in certain cases, as significantly broadens the application of the CL method. The limitations of gauge cooling are also discussed. In particular, we prove that gauge cooling has no effect for Abelian groups, and we provide an example showing that biased results still exist when gauge cooling is insufficient to confine the probability density function.


Learning Source Phrase Representations for Neural Machine Translation. The Transformer translation model (Vaswani et al., 2017) based on a multi head attention mechanism can be computed effectively in parallel and has significantly pushed forward the performance of Neural Machine Translation (NMT). Though intuitively the attentional network can connect distant words via shorter network paths than RNNs, empirical analysis demonstrates that it still has difficulty in fully capturing long distance dependencies (Tang et al., 2018). Considering that modeling phrases instead of words has significantly improved the Statistical Machine Translation (SMT) approach through the use of larger translation blocks ("phrases") and its reordering ability, modeling NMT at phrase level is an intuitive proposal to help the model capture long distance relationships. In this paper, we first propose an attentive phrase representation generation mechanism which is able to generate phrase representations from corresponding token representations. In addition, we incorporate the generated phrase representations into the Transformer translation model to enhance its ability to capture long distance relationships. In our experiments, we obtain significant improvements on the WMT 14 English German and English French tasks on top of the strong Transformer baseline, which shows the effectiveness of our approach. Our approach helps Transformer Base models perform at the level of Transformer Big models, and even significantly better for long sentences, but with substantially fewer parameters and training steps. The fact that phrase representations help even in the big setting further supports our conjecture that they make a valuable contribution to long distance relations.


LANNS A Web Scale Approximate Nearest Neighbor Lookup System. Nearest neighbor search (NNS) has a wide range of applications in information retrieval, computer vision, machine learning, databases, and other areas. Existing state of the art algorithm for nearest neighbor search, Hierarchical Navigable Small World Networks(HNSW), is unable to scale to large datasets of 100M records in high dimensions. In this paper, we propose LANNS, an end to end platform for Approximate Nearest Neighbor Search, which scales for web scale datasets. Library for Large Scale Approximate Nearest Neighbor Search (LANNS) is deployed in multiple production systems for identifying topK ( 100 leq topK leq 200 ) approximate nearest neighbors with a latency of a few milliseconds per query, high throughput of 2.5k Queries Per Second (QPS) on a single node, on large ( sim 180M data points) high dimensional (50 2048 dimensional) datasets.


Deep Learning Under the Microscope Improving the Interpretability of Medical Imaging Neural Networks. In this paper, we propose a novel interpretation method tailored to histological Whole Slide Image (WSI) processing. A Deep Neural Network (DNN), inspired by Bag of Features models is equipped with a Multiple Instance Learning (MIL) branch and trained with weak supervision for WSI classification. MIL avoids label ambiguity and enhances our model's expressive power without guiding its attention. We utilize a fine grained logit heatmap of the models activations to interpret its decision making process. The proposed method is quantitatively and qualitatively evaluated on two challenging histology datasets, outperforming a variety of baselines. In addition, two expert pathologists were consulted regarding the interpretability provided by our method and acknowledged its potential for integration into several clinical applications.


Hyperparameter Optimization for Forecasting Stock Returns. In recent years, hyperparameter optimization (HPO) has become an increasingly important issue in the field of machine learning for the development of more accurate forecasting models. In this study, we explore the potential of HPO in modeling stock returns using a deep neural network (DNN). The potential of this approach was evaluated using technical indicators and fundamentals examined based on the effect the regularization of dropouts and batch normalization for all input data. We found that the model using technical indicators and dropout regularization significantly outperforms three other models, showing a positive predictability of 0.53 in sample and 1.11 out of sample, thereby indicating the possibility of beating the historical average. We also demonstrate the stability of the model in terms of the changes in its feature importance over time.


BAASH Enabling Blockchain as a Service on High Performance Computing Systems. The state of the art approach to manage blockchains is to process blocks of transactions in a shared nothing environment. Although blockchains have the potential to provide various services for high performance computing (HPC) systems, HPC will not be able to embrace blockchains before the following two missing pieces become available (i) new consensus protocols being aware of the shared storage architecture in HPC, and (ii) new fault tolerant mechanisms compensating for HPC's programming model the message passing interface (MPI) that is vulnerable for blockchain like workloads. To this end, we design a new set of consensus protocols crafted for the HPC platforms and a new fault tolerance subsystem compensating for the failures caused by faulty MPI processes. Built on top of the new protocols and fault tolerance mechanism, a prototype system is implemented and evaluated with two million transactions on a 500 core HPC cluster, showing 6 times , 12 times , and 75 times higher throughput than Hyperldeger, Ethereum, and Parity, respectively.


Minority report detection in refugee authored community driven journalism using RBMs. Our work seeks to gather and distribute sensitive information from refugee settlements to stakeholders to help shape policy and help guide action networks. In this paper, we propose the following 1) a method of data collection through stakeholder organizations experienced in working with displaced and refugee communities, 2) a method of topic modeling based on Deep Boltzmann Machines that identifies topics and issues of interest within the population, to help enable mapping of human rights violations, and 3) a secondary analysis component that will use the probability of fit to isolate minority reports within these stories using anomaly detection techniques.


Drug induced activation of integrin alpha IIb beta 3 leads to minor localized structural changes. Integrins are transmembrane proteins involved in hemostasis, wound healing, immunity and cancer. In response to intracellular signals and ligand binding, integrins adopt different conformations the bent (resting) form the intermediate extended form and the ligand occupied active form. An integrin undergoing such conformational dynamics is the heterodimeric platelet receptor alphaIIbbeta3. Although the dramatic rearrangement of the overall structure of alphaIIbbeta3 during the activation process is potentially related to changes in the protein secondary structure, this has not been investigated so far in a membrane environment. Here we examine the Mn2 and drug induced activation of alphaIIbbeta3 and the impact on the structure of this protein reconstituted into liposomes. By quartz crystal microbalance with dissipation monitoring and activation assays we show that Mn2 induces binding of the conformation specific antibody PAC 1, which only recognizes the extended, active integrin. Circular dichroism spectroscopy reveals, however, that Mn2 treatment does not induce major secondary structural changes of alphaIIbbeta3. Similarly, we found that treatment with clinically relevant drugs (e.g. quinine) led to the activation of alphaIIbbeta3 without significant changes in protein secondary structure. Molecular dynamics simulation studies revealed minor local changes in the beta sheet probability of several extracellular domains of the integrin. Our experimental setup represents a new approach to study transmembrane proteins, especially integrins, in a membrane environment and opens a new way for testing drug binding to integrins under clinically relevant conditions.


Diverse Video Captioning Through Latent Variable Expansion. Automatically describing video content with text description is challenging but important task, which has been attracting a lot of attention in computer vision community. Previous works mainly strive for the accuracy of the generated sentences, while ignoring the sentences diversity, which is inconsistent with human behavior. In this paper, we aim to caption each video with multiple descriptions and propose a novel framework. Concretely, for a given video, the intermediate latent variables of conventional encode decode process are utilized as input to the conditional generative adversarial network (CGAN) with the purpose of generating diverse sentences. We adopt different Convolutional Neural Networks (CNNs) as our generator that produces descriptions conditioned on latent variables and discriminator that assesses the quality of generated sentences. Simultaneously, a novel DCE metric is designed to assess the diverse captions. We evaluate our method on the benchmark datasets, where it demonstrates its ability to generate diverse descriptions and achieves superior results against other state of the art methods.


Goal Reasoning by Selecting Subgoals with Deep Q Learning. In this work we propose a goal reasoning method which learns to select subgoals with Deep Q Learning in order to decrease the load of a planner when faced with scenarios with tight time restrictions, such as online execution systems. We have designed a CNN based goal selection module and trained it on a standard video game environment, testing it on different games (planning domains) and levels (planning problems) to measure its generalization abilities. When comparing its performance with a satisfying planner, the results obtained show both approaches are able to find plans of good quality, but our method greatly decreases planning time. We conclude our approach can be successfully applied to different types of domains (games), and shows good generalization properties when evaluated on new levels (problems) of the same game (domain).


UP DETR Unsupervised Pre training for Object Detection with Transformers. Object detection with transformers (DETR) reaches competitive performance with Faster R CNN via a transformer encoder decoder architecture. Inspired by the great success of pre training transformers in natural language processing, we propose a pretext task named random query patch detection to Unsupervisedly Pre train DETR (UP DETR) for object detection. Specifically, we randomly crop patches from the given image and then feed them as queries to the decoder. The model is pre trained to detect these query patches from the original image. During the pre training, we address two critical issues multi task learning and multi query localization. (1) To trade off classification and localization preferences in the pretext task, we freeze the CNN backbone and propose a patch feature reconstruction branch which is jointly optimized with patch detection. (2) To perform multi query localization, we introduce UP DETR from single query patch and extend it to multi query patches with object query shuffle and attention mask. In our experiments, UP DETR significantly boosts the performance of DETR with faster convergence and higher average precision on object detection, one shot detection and panoptic segmentation. Code and pre training models https github.com dddzg up detr.


ALONE A Dataset for Toxic Behavior among Adolescents on Twitter. The convenience of social media has also enabled its misuse, potentially resulting in toxic behavior. Nearly 66 of internet users have observed online harassment, and 41 claim personal experience, with 18 facing severe forms of online harassment. This toxic communication has a significant impact on the well being of young individuals, affecting mental health and, in some cases, resulting in suicide. These communications exhibit complex linguistic and contextual characteristics, making recognition of such narratives challenging. In this paper, we provide a multimodal dataset of toxic social media interactions between confirmed high school students, called ALONE (AdoLescents ON twittEr), along with descriptive explanation. Each instance of interaction includes tweets, images, emoji and related metadata. Our observations show that individual tweets do not provide sufficient evidence for toxic behavior, and meaningful use of context in interactions can enable highlighting or exonerating tweets with purported toxicity.


Hitting the High Notes Subset Selection for Maximizing Expected Order Statistics. We consider the fundamental problem of selecting k out of n random variables in a way that the expected highest or second highest value is maximized. This question captures several applications where we have uncertainty about the quality of candidates (e.g. auction bids, search results) and have the capacity to explore only a small subset due to an exogenous constraint. For example, consider a second price auction where system constraints (e.g., costly retrieval or model computation) allow the participation of only k out of n bidders, and the goal is to optimize the expected efficiency (highest bid) or expected revenue (second highest bid). We study the case where we are given an explicit description of each random variable. We give a PTAS for the problem of maximizing the expected highest value. For the second highest value, we prove a hardness result assuming the Planted Clique Hypothesis, there is no constant factor approximation algorithm that runs in polynomial time. Surprisingly, under the assumption that each random variable has monotone hazard rate (MHR), a simple score based algorithm, namely picking the k random variables with the largest 1 sqrt k top quantile value, is a constant approximation to the expected highest and second highest value, emph simultaneously .


Vertical 3 manifolds in simplified (2, 0) trisections of 4 manifolds. We classify the 3 manifolds obtained as the preimages of arcs on the plane for simplified (2, 0) trisection maps, which we call vertical 3 manifolds. Such a 3 manifold is a connected sum of a 6 tuple of vertical 3 manifolds over specific 6 arcs. Consequently, we show that each of the 6 tuples determines the source 4 manifold uniquely up to orientation reversing diffeomorphisms. We also show that, in contrast to the fact that summands of vertical 3 manifolds of simplified (2, 0) trisection maps are lens spaces, there exist infinitely many simplified (2, 0) 4 section maps that admit hyperbolic vertical 3 manifolds.


PoisHygiene Detecting and Mitigating Poisoning Attacks in Neural Networks. The black box nature of deep neural networks (DNNs) facilitates attackers to manipulate the behavior of DNN through data poisoning. Being able to detect and mitigate poisoning attacks, typically categorized into backdoor and adversarial poisoning (AP), is critical in enabling safe adoption of DNNs in many application domains. Although recent works demonstrate encouraging results on detection of certain backdoor attacks, they exhibit inherent limitations which may significantly constrain the applicability. Indeed, no technique exists for detecting AP attacks, which represents a harder challenge given that such attacks exhibit no common and explicit rules while backdoor attacks do (i.e., embedding backdoor triggers into poisoned data). We believe the key to detect and mitigate AP attacks is the capability of observing and leveraging essential poisoning induced properties within an infected DNN model. In this paper, we present PoisHygiene, the first effective and robust detection and mitigation framework against AP attacks. PoisHygiene is fundamentally motivated by Dr. Ernest Rutherford's story (i.e., the 1908 Nobel Prize winner), on observing the structure of atom through random electron sampling.


Multi level Head wise Match and Aggregation in Transformer for Textual Sequence Matching. Transformer has been successfully applied to many natural language processing tasks. However, for textual sequence matching, simple matching between the representation of a pair of sequences might bring in unnecessary noise. In this paper, we propose a new approach to sequence pair matching with Transformer, by learning head wise matching representations on multiple levels. Experiments show that our proposed approach can achieve new state of the art performance on multiple tasks that rely only on pre computed sequence vector representation, such as SNLI, MNLI match, MNLI mismatch, QQP, and SQuAD binary.


RMITB at TREC COVID 2020. Search engine users rarely express an information need using the same query, and small differences in queries can lead to very different result sets. These user query variations have been exploited in past TREC CORE tracks to contribute diverse, highly effective runs in offline evaluation campaigns with the goal of producing reusable test collections. In this paper, we document the query fusion runs submitted to the first and second round of TREC COVID, using ten queries per topic created by the first author. In our analysis, we focus primarily on the effects of having our second priority run omitted from the judgment pool. This run is of particular interest, as it surfaced a number of relevant documents that were not judged until later rounds of the task. If the additional judgments were included in the first round, the performance of this run increased by 35 rank positions when using RBP p 0.5, highlighting the importance of judgment depth and coverage in assessment tasks.


Impact of consensus on appendable block blockchain for IoT. The Internet of Things (IoT) is transforming our physical world into a complex and dynamic system of connected devices on an unprecedented scale. Connecting everyday physical objects is creating new business models, improving processes and reducing costs and risks. Recently, blockchain technology has received a lot of attention from the community as a possible solution to overcome security issues in IoT. However, traditional blockchains (such as the ones used in Bitcoin and Ethereum) are not well suited to the resource constrained nature of IoT devices and also with the large volume of information that is expected to be generated from typical IoT deployments. To overcome these issues, several researchers have presented lightweight instances of blockchains tailored for IoT. For example, proposing novel data structures based on blocks with decoupled and appendable data. However, these researchers did not discuss how the consensus algorithm would impact their solutions, i.e., the decision of which consensus algorithm would be better suited was left as an open issue. In this paper, we improved an appendable block blockchain framework to support different consensus algorithms through a modular design. We evaluated the performance of this improved version in different emulated scenarios and studied the impact of varying the number of devices and transactions and employing different consensus algorithms. Even adopting different consensus algorithms, results indicate that the latency to append a new block is less than 161ms (in the more demanding scenario) and the delay for processing a new transaction is less than 7ms, suggesting that our improved version of the appendable block blockchain is efficient and scalable, and thus well suited for IoT scenarios.


Rovibronic spectra of molecules dressed by light fields. The theory of rovibronic spectroscopy of light dressed molecules is presented within the framework of quantum mechanically treated molecules interacting with classical light fields. Numerical applications are demonstrated for the homonuclear diatomic molecule Na 2 , for which the general formulae can be simplified considerably and the physical processes leading to the light dressed spectra can be understood straightforwardly. The physical origin of different peaks in the light dressed spectrum of Na 2 is given and the light dressed spectrum is investigated in terms of its dependence on the dressing field's intensity and wavelength, the turn on time of the dressing field, and the temperature. The important implications of light dressed spectroscopy on deriving field free spectroscopic quantities are also discussed.


Jump processes as Generalized Gradient Flows. We have created a functional framework for a class of non metric gradient systems. The state space is a space of nonnegative measures, and the class of systems includes the Forward Kolmogorov equations for the laws of Markov jump processes on Polish spaces. This framework comprises a definition of a notion of solutions, a method to prove existence, and an archetype uniqueness result. We do this by using only the structure that is provided directly by the dissipation functional, which need not be homogeneous, and we do not appeal to any metric structure.


Deep Learning Based Decoding of Constrained Sequence Codes. Constrained sequence (CS) codes, including fixed length CS codes and variable length CS codes, have been widely used in modern wireless communication and data storage systems. Sequences encoded with constrained sequence codes satisfy constraints imposed by the physical channel to enable efficient and reliable transmission of coded symbols. In this paper, we propose using deep learning approaches to decode fixed length and variable length CS codes. Traditional encoding and decoding of fixed length CS codes rely on look up tables (LUTs), which is prone to errors that occur during transmission. We introduce fixed length constrained sequence decoding based on multiple layer perception (MLP) networks and convolutional neural networks (CNNs), and demonstrate that we are able to achieve low bit error rates that are close to maximum a posteriori probability (MAP) decoding as well as improve the system throughput. Further, implementation of capacity achieving fixed length codes, where the complexity is prohibitively high with LUT decoding, becomes practical with deep learning based decoding. We then consider CNN aided decoding of variable length CS codes. Different from conventional decoding where the received sequence is processed bit by bit, we propose using CNNs to perform one shot batch processing of variable length CS codes such that an entire batch is decoded at once, which improves the system throughput. Moreover, since the CNNs can exploit global information with batch processing instead of only making use of local information as in conventional bit by bit processing, the error rates can be reduced. We present simulation results that show excellent performance with both fixed length and variable length CS codes that are used in the frontiers of wireless communication systems.


IPOD An Industrial and Professional Occupations Dataset and its Applications to Occupational Data Mining and Analysis. Occupational data mining and analysis is an important task in understanding today's industry and job market. Various machine learning techniques are proposed and gradually deployed to improve companies' operations for upstream tasks, such as employee churn prediction, career trajectory modelling and automated interview. Job titles analysis and embedding, as the fundamental building blocks, are crucial upstream tasks to address these occupational data mining and analysis problems. In this work, we present the Industrial and Professional Occupations Dataset (IPOD), which consists of over 190,000 job titles crawled from over 56,000 profiles from Linkedin. We also illustrate the usefulness of IPOD by addressing two challenging upstream tasks, including (i) proposing Title2vec, a contextual job title vector representation using a bidirectional Language Model (biLM) approach and (ii) addressing the important occupational Named Entity Recognition problem using Conditional Random Fields (CRF) and bidirectional Long Short Term Memory with CRF (LSTM CRF). Both CRF and LSTM CRF outperform human and baselines in both exact match accuracy and F1 scores. The dataset and pre trained embeddings are available at https www.github.com junhua ipod.


Sequential Local Mesh Refinement Solver with Separate Temporal and Spatial Adaptivity for Non linear Two phase Flow Problems. Convergence failure and slow convergence rates are among the biggest challenges with solving the system of non linear equations numerically. Although mitigated, such issues still linger when using strictly small time steps and unconditionally stable fully implicit schemes. The price that comes with restricting time steps to small scales is the enormous computational load, especially in large scale models. To address this problem, we introduce a sequential local mesh refinement framework to optimize convergence rate and prevent convergence failure, while not restricting the whole system to small time steps, thus improving computational efficiency. We test the algorithm with the non linear two phase flow model. Starting by solving the problem on the coarsest space time mesh, the algorithm refines the domain in time at water saturation front to prevent convergence failure. It then deploys fine spatial grid in regions with large saturation variation to assure solution accuracy. After each refinement, the solution from the previous mesh is used to estimate the initial guess of unknowns on the current mesh for faster convergence. Numerical results are presented to confirm accuracy of our algorithm as compared to the uniformly fine time step and fine spatial discretization solution. We observe approximately 25 times speedup in the solution time by using our algorithm.


Audio and Gaze driven Facial Animation of Codec Avatars. Codec Avatars are a recent class of learned, photorealistic face models that accurately represent the geometry and texture of a person in 3D (i.e., for virtual reality), and are almost indistinguishable from video. In this paper we describe the first approach to animate these parametric models in real time which could be deployed on commodity virtual reality hardware using audio and or eye tracking. Our goal is to display expressive conversations between individuals that exhibit important social signals such as laughter and excitement solely from latent cues in our lossy input signals. To this end we collected over 5 hours of high frame rate 3D face scans across three participants including traditional neutral speech as well as expressive and conversational speech. We investigate a multimodal fusion approach that dynamically identifies which sensor encoding should animate which parts of the face at any time. See the supplemental video which demonstrates our ability to generate full face motion far beyond the typically neutral lip articulations seen in competing work https research.fb.com videos audio and gaze driven facial animation of codec avatars


Vessels Cybersecurity Issues, Challenges, and the Road Ahead. Vessels cybersecurity is recently gaining momentum, as a result of a few recent attacks to vessels at sea. These recent attacks have shacked the maritime domain, which was thought to be relatively immune to cyber threats. The cited belief is now over, as proved by recent mandates issued by the International Maritime Organization (IMO). According to these regulations, all vessels should be the subject of a cybersecurity risk analysis, and technical controls should be adopted to mitigate the resulting risks. This initiative is laudable since, despite the recent incidents, the vulnerabilities and threats affecting modern vessels are still unclear to operating entities, leaving the potential for dreadful consequences of further attacks just a matter of "when", not "if". In this contribution, we investigate and systematize the major security weaknesses affecting systems and communication technologies adopted in modern vessels. Specifically, we describe the architecture and main features of the different systems, pointing out their main security issues, and specifying how they were exploited by attackers to cause service disruption and relevant financial losses. We also identify a few countermeasures to the introduced attacks. Finally, we highlight a few research challenges to be addressed by industry and academia to strengthen vessels security.


Privacy preserving Neural Network Inference on Encrypted Data with GPUs. Machine Learning as a Service (MLaaS) has become a growing trend in recent years and several such services are currently offered. MLaaS is essentially a set of services that provides machine learning tools and capabilities as part of cloud computing services. In these settings, the cloud has pre trained models that are deployed and large computing capacity whereas the clients can use these models to make predictions without having to worry about maintaining the models and the service. However, the main concern with MLaaS is the privacy of the client's data. Although there have been several proposed approaches in the literature to run machine learning models on encrypted data, the performance is still far from being satisfactory for practical use. In this paper, we aim to accelerate the performance of running machine learning on encrypted data using combination of Fully Homomorphic Encryption (FHE), Convolutional Neural Networks (CNNs) and Graphics Processing Units (GPUs). We use a number of optimization techniques, and efficient GPU based implementation to achieve high performance. We evaluate a CNN whose architecture is similar to AlexNet to classify homomorphically encrypted samples from the Cars Overhead With Context (COWC) dataset. To the best of our knowledge, it is the first time such a complex network and large dataset is evaluated on encrypted data. Our approach achieved reasonable classification accuracy of 95 for the COWC dataset. In terms of performance, our results show that we could achieve several thousands times speed up when we implement GPU accelerated FHE operations on encrypted floating point numbers.


Balanced Crown Decomposition for Connectivity Constraints. We introduce the balanced crown decomposition that captures the structure imposed on graphs by their connected induced subgraphs of a given size. Such subgraphs are a popular modeling tool in various application areas, where the non local nature of the connectivity condition usually results in very challenging algorithmic tasks. The balanced crown decomposition is a combination of a crown decomposition and a balanced partition which makes it applicable to graph editing as well as graph packing and partitioning problems. We illustrate this by deriving improved kernelization and approximation algorithms for a variety of such problems. In particular, through this structure, we obtain the first constant factor approximation for the Balanced Connected Partition (BCP) problem, where the task is to partition a vertex weighted graph into k connected components of approximately equal weight. We derive a 3 approximation for the two most commonly used objectives of maximizing the weight of the lightest component or minimizing the weight of the heaviest component.


Greedy Sparse Signal Recovery Algorithm Based on Bit wise MAP detection. We propose a novel greedy algorithm for the support recovery of a sparse signal from a small number of noisy measurements. In the proposed method, a new support index is identified for each iteration based on bit wise maximum a posteriori (B MAP) detection. This is optimal in the sense of detecting one of the remaining support indices, provided that all the detected indices in the previous iterations are correct. Despite its optimality, it requires an expensive complexity for computing the maximization metric (i.e., a posteriori probability of each remaining support) due to the marginalization of high dimensional sparse vector. We address this problem by presenting a good proxy (named B MAP proxy) on the maximization metric which is accurate enough to find the maximum index, rather than an exact probability, Moreover, it is easily evaluated only using vector correlations as in orthogonal matching pursuit (OMP), but the use completely different proxy matrices for maximization. We demonstrate that the proposed B MAP detection provides a significant gain compared with the existing methods as OMP and MAP OMP, having the same complexity. Subsequently, we construct the advanced greedy algorithms, based on B MAP proxy, by leveraging the idea of compressive sampling matching pursuit (CoSaMP) and subspace pursuit (SP). Via simulations, we show that the proposed method outperforms also OMP and MAP OMP under the frameworks of the advanced greedy algorithms.


A harmonic sum over nontrivial zeros of the Riemann zeta function. We consider the sum sum 1 gamma , where gamma ranges over the ordinates of nontrivial zeros of the Riemann zeta function in an interval (0,T , and consider the behaviour of the sum as T to infty . We show that, after subtracting a smooth approximation frac 1 4 pi log 2(T 2 pi), the sum tends to a limit H approx 0.0171594 which can be expressed as an integral. We calculate H to high accuracy, using a method which has error O(( log T) T 2) . Our results improve on earlier results by Hassani and other authors.


Eigenmode analysis of membrane stability in inviscid flow. We study the instability of a thin membrane (of zero bending rigidity) to out of plane deflections, when the membrane is immersed in an inviscid fluid flow and sheds a trailing vortex sheet wake. We solve the nonlinear eigenvalue problem iteratively with large ensembles of initial guesses, for three canonical boundary conditions both ends fixed, one end fixed and one free, and both free. Over several orders of magnitude of membrane mass density, we find instability by divergence or flutter (particularly at large mass density, or with one or both ends free). The most unstable eigenmodes generally become "wavier" at smaller mass density and smaller tension, but with regions of nonmonotonic behavior. We find good quantitative agreement with unsteady time stepping simulations at small amplitude, but only qualitative similarities with the eventual steady state large amplitude motions.


Hochschild cohomology and deformations of mathbb P functors. Given a split mathbb P functor F mathcal D b(X) to mathcal D b(Y) between smooth projective varieties, we provide necessary and sufficient conditions, in terms of the Hochschild cohomology of X , for it to become spherical on the total space of a deformation of Y , and explain how the spherical twist becomes the mathbb P twist on the special fibre. These results generalise the object case, that is when X is a point, which was studied previously by Huybrechts and Thomas, and we show how they apply to the mathbb P functor associated to the Hilbert scheme of points on a K3 surface. In the appendix we review and reorganise some technical results due to Toda, relating to the interaction of Atiyah classes, the HKR isomorphism, and the characteristic morphism.


Focusing and Diffusion Bidirectional Attentive Graph Convolutional Networks for Skeleton based Action Recognition. A collection of approaches based on graph convolutional networks have proven success in skeleton based action recognition by exploring neighborhood information and dense dependencies between intra frame joints. However, these approaches usually ignore the spatial temporal global context as well as the local relation between inter frame and intra frame. In this paper, we propose a focusing and diffusion mechanism to enhance graph convolutional networks by paying attention to the kinematic dependence of articulated human pose in a frame and their implicit dependencies over frames. In the focusing process, we introduce an attention module to learn a latent node over the intra frame joints to convey spatial contextual information. In this way, the sparse connections between joints in a frame can be well captured, while the global context over the entire sequence is further captured by these hidden nodes with a bidirectional LSTM. In the diffusing process, the learned spatial temporal contextual information is passed back to the spatial joints, leading to a bidirectional attentive graph convolutional network (BAGCN) that can facilitate skeleton based action recognition. Extensive experiments on the challenging NTU RGB D and Skeleton Kinetics benchmarks demonstrate the efficacy of our approach.


MVB A Large Scale Dataset for Baggage Re Identification and Merged Siamese Networks. In this paper, we present a novel dataset named MVB (Multi View Baggage) for baggage ReID task which has some essential differences from person ReID. The features of MVB are three fold. First, MVB is the first publicly released large scale dataset that contains 4519 baggage identities and 22660 annotated baggage images as well as its surface material labels. Second, all baggage images are captured by specially designed multi view camera system to handle pose variation and occlusion, in order to obtain the 3D information of baggage surface as complete as possible. Third, MVB has remarkable inter class similarity and intra class dissimilarity, considering the fact that baggage might have very similar appearance while the data is collected in two real airport environments, where imaging factors varies significantly from each other. Moreover, we proposed a merged Siamese network as baseline model and evaluated its performance. Experiments and case study are conducted on MVB.


DeFeat Net General Monocular Depth via Simultaneous Unsupervised Representation Learning. In the current monocular depth research, the dominant approach is to employ unsupervised training on large datasets, driven by warped photometric consistency. Such approaches lack robustness and are unable to generalize to challenging domains such as nighttime scenes or adverse weather conditions where assumptions about photometric consistency break down. We propose DeFeat Net (Depth Feature network), an approach to simultaneously learn a cross domain dense feature representation, alongside a robust depth estimation framework based on warped feature consistency. The resulting feature representation is learned in an unsupervised manner with no explicit ground truth correspondences required. We show that within a single domain, our technique is comparable to both the current state of the art in monocular depth estimation and supervised feature representation learning. However, by simultaneously learning features, depth and motion, our technique is able to generalize to challenging domains, allowing DeFeat Net to outperform the current state of the art with around 10 reduction in all error measures on more challenging sequences such as nighttime driving.


Rethinking Loss Design for Large scale 3D Shape Retrieval. Learning discriminative shape representations is a crucial issue for large scale 3D shape retrieval. In this paper, we propose the Collaborative Inner Product Loss (CIP Loss) to obtain ideal shape embedding that discriminative among different categories and clustered within the same class. Utilizing simple inner product operation, CIP loss explicitly enforces the features of the same class to be clustered in a linear subspace, while inter class subspaces are constrained to be at least orthogonal. Compared to previous metric loss functions, CIP loss could provide more clear geometric interpretation for the embedding than Euclidean margin, and is easy to implement without normalization operation referring to cosine margin. Moreover, our proposed loss term can combine with other commonly used loss functions and can be easily plugged into existing off the shelf architectures. Extensive experiments conducted on the two public 3D object retrieval datasets, ModelNet and ShapeNetCore 55, demonstrate the effectiveness of our proposal, and our method has achieved state of the art results on both datasets.


Offsite Autotuning Approach Performance Model Driven Autotuning Applied to Parallel Explicit ODE Methods. Autotuning techniques are a promising approach to minimize the otherwise tedious manual effort of optimizing scientific applications for a specific target platform. Ideally, an autotuning approach is capable of reliably identifying the most efficient implementation variant(s) for a new target system or new characteristics of the input by applying suitable program transformations and analytic models. In this work, we introduce Offsite, an offline autotuning approach which automates this selection process at installation time by rating implementation variants based on an analytic performance model without requiring time consuming runtime experiments. From abstract multilevel YAML description languages, Offsite automatically derives optimized, platform specific and problem specific code of possible implementation variants and applies the performance model to these implementation variants. We apply Offsite to parallel numerical methods for ordinary differential equations (ODEs). In particular, we investigate tuning a specific class of explicit ODE solvers (PIRK methods) for various initial value problems (IVPs) on shared memory systems. Our experiments demonstrate that Offsite is able to reliably identify a set of the most efficient implementation variants for given test configurations (ODE solver, IVP, platform) and is capable of effectively handling important autotuning scenarios.


On a subset sums problem of Chen and Wu. For a set A , let P(A) be the set of all finite subset sums of A . We prove that if a sequence B 11 leq b 1 b 2 cdots satisfies b 2 3b 1 5 , b 3 3b 2 2 and b n 1 3b n 4b n 1 for all n geq 3 , then there is a sequence of positive integers A a 1 a 2 cdots such that P(A) mathbb N setminus B . This result shows that the answer to the problem of Chen and Wu The inverse problem on subset sums', European. J. Combin. 34(2013), 841 845 is negative.


Graded torsion free mathfrak sl 2( mathbb C ) modules of rank 2. In this paper we explore the possibility of endowing simple infinite dimensional mathfrak sl 2( mathbb C ) modules by the structure of the graded module. The gradings on finite dimensional simple module over simple Lie algebras has been studied in arXiv 1308.6089 and arXiv 1601.03008 .


Multi Modal Summary Generation using Multi Objective Optimization. Significant development of communication technology over the past few years has motivated research in multi modal summarization techniques. A majority of the previous works on multi modal summarization focus on text and images. In this paper, we propose a novel extractive multi objective optimization based model to produce a multi modal summary containing text, images, and videos. Important objectives such as intra modality salience, cross modal redundancy and cross modal similarity are optimized simultaneously in a multi objective optimization framework to produce effective multi modal output. The proposed model has been evaluated separately for different modalities, and has been found to perform better than state of the art approaches.


CompLex A New Corpus for Lexical Complexity Prediction from Likert Scale Data. Predicting which words are considered hard to understand for a given target population is a vital step in many NLP applications such as text simplification. This task is commonly referred to as Complex Word Identification (CWI). With a few exceptions, previous studies have approached the task as a binary classification task in which systems predict a complexity value (complex vs. non complex) for a set of target words in a text. This choice is motivated by the fact that all CWI datasets compiled so far have been annotated using a binary annotation scheme. Our paper addresses this limitation by presenting the first English dataset for continuous lexical complexity prediction. We use a 5 point Likert scale scheme to annotate complex words in texts from three sources domains the Bible, Europarl, and biomedical texts. This resulted in a corpus of 9,476 sentences each annotated by around 7 annotators.


Business and Information Technology Alignment Measurement a recent Literature Review. Since technology has been involved in the business context, Business and Information Technology Alignment (BITA) has been one of the main concerns of IT and Business executives and directors due to its importance to overall company performance, especially today in the age of digital transformation. Several models and frameworks have been developed for BITA implementation and for measuring their level of success, each one with a different approach to this desired state. The BITA measurement is one of the main decision making tools in the strategic domain of companies. In general, the classical internal alignment is the most measured domain and the external environment evolution alignment is the least measured. This literature review aims to characterize and analyze current research on BITA measurement with a comprehensive view of the works published over the last 15 years to identify potential gaps and future areas of research in the field.


A variation of q Wolstenholme's theorem. We investigate a variation of q Wolstenholme's theorem, which extends the q analogue of Wolstenholme's theorem due to Shi and Pan Amer. Math. Monthly 114 (2007), 529 531 . The proof makes use of the Ramanujan sum and higher order logarithmic derivatives of cyclotomic polynomials.


Geometric description of C vectors and real L "osungen. We introduce real Loesungen as an analogue of real roots. For each mutation sequence of an arbitrary skew symmetrizable matrix, we define a family of reflections along with associated vectors which are real Loesungen and a set of curves on a Riemann surface. The matrix consisting of these vectors is called L matrix. We explain how the L matrix naturally arises in connection with the C matrix. Then we conjecture that the L matrix depends (up to signs of row vectors) only on the seed, and that the curves can be drawn without self intersections, providing a new combinatorial geometric description of c vectors.


Wireless Network Slicing Generalized Kelly Mechanism Based Resource Allocation. Wireless network slicing (i.e., network virtualization) is one of the potential technologies for addressing the issue of rapidly growing demand in mobile data services related to 5G cellular networks. It logically decouples the current cellular networks into two entities infrastructure providers (InPs) and mobile virtual network operators (MVNOs). The resources of base stations (e.g., resource blocks, transmission power, antennas) which are owned by the InP are shared to multiple MVNOs who need resources for their mobile users. Specifically, the physical resources of an InP are abstracted into multiple isolated network slices, which are then allocated to MVNO's mobile users. In this paper, two level allocation problem in network slicing is examined, whilst enabling efficient resource utilization, inter slice isolation (i.e., no interference amongst slices), and intra slice isolation (i.e., no interference between users in the same slice). A generalized Kelly mechanism (GKM) is also designed, based on which the upper level of the resource allocation issue (i.e., between the InP and MVNOs) is addressed. The benefit of using such a resource bidding and allocation framework is that the seller (InP) does not need to know the true valuation of the bidders (MVNOs). For solving the lower level of resource allocation issue (i.e., between MVNOs and their mobile users), the optimal resource allocation is derived from each MVNO to its mobile users by using KKT conditions. Then, bandwidth resources are allocated to the users of MVNOs. Finally, the results of simulation are presented to verify the theoretical analysis of our proposed two level resource allocation problem in wireless network slicing.