mathbb X Resolution Correspondence Networks. In this paper, we aim at establishing accurate dense correspondences between a pair of images with overlapping field of view under challenging illumination variation, viewpoint changes, and style differences. Through an extensive ablation study of the state of the art correspondence networks, we surprisingly discovered that the widely adopted 4D correlation tensor and its related learning and processing modules could be de parameterised and removed from training with merely a minor impact over the final matching accuracy. Disabling these computational expensive modules dramatically speeds up the training procedure and allows to use 4 times bigger batch size, which in turn compensates for the accuracy drop. Together with a multi GPU inference stage, our method facilitates the systematic investigation of the relationship between matching accuracy and up sampling resolution of the native testing images from 1280 to 4K. This leads to discovery of the existence of an optimal resolution mathbb X that produces accurate matching performance surpassing the state of the art methods particularly over the lower error band on public benchmarks for the proposed network.


Use cases of Blockchain Technology for Humanitarian Engineering. Humanitarian Engineers need innovative methods to make technological interventions for solving societal problems. The emerging blockchain technology has the enormous potential to provide effective interventions in various developmental sectors, including Agriculture, Education, Health, and Transportation. In these sectors, mediators have been considered as one of the impediments for developmental work. Blockchain technology facilitates peer to peer business transactions, thus eliminating the role of mediators. Hence, the blockchain technology is emerging as an alternative to conventional mediator centred solutions adopting client server based Internet technologies. A combination of blockchain technology with other technologies can be used to address domain specific challenges. For example, the combination of blockchain technology and Internet of Thing (IoT) has the potential to monitor the usage of scarce resources such as the level of ground water and amount of energy consumption. The aims of this chapter are twofold. Firstly, it describes the primary building blocks of blockchain technology. Secondly, it illustrates various use case scenarios of blockchain technology in the fields of Agriculture, Energy Health and others.


Computational Model of Motion Sickness Describing the Effects of Learning Exogenous Motion Dynamics. The existing computational models used to estimate motion sickness are incapable of describing the fact that the predictability of motion patterns affects motion sickness. Therefore, the present study proposes a computational model to describe the effect of the predictability of dynamics or the pattern of motion stimuli on motion sickness. In the proposed model, a submodel, in which a recursive Gaussian process regression is used to represent human features of online learning and future prediction of motion dynamics, is combined with a conventional model of motion sickness based on an observer theory. A simulation experiment was conducted in which the proposed model predicted motion sickness caused by a 900 s horizontal movement. The movement was composed of a 9 m repetitive back and forth movement pattern with a pause. Regarding the motion condition, the direction and timing of the motion were varied as follows a) Predictable motion (M P) the direction of the motion and duration of the pause were set to 8 s b) Motion with unpredicted direction (M dU) the pause duration was fixed as in (P), but the motion direction was randomly determined c) Motion with unpredicted timing (M tU) the motion direction was fixed as in (M P), but the pause duration was randomly selected from 4 to 12 s. The results obtained using the proposed model demonstrated that the predicted motion sickness incidence for (M P) was smaller than those for (M dU) and (M tU). This tendency agrees with the sickness patterns observed in a previous experimental study in which the human participants were subject to motion conditions similar to those used in our simulations. Moreover, no significant differences were found in the predicted motion sickness incidences at different conditions when the conventional model was used.


Extensions of some matrix inequalities related to trace and partial traces. We first present a determinant inequality related to partial traces for positive semidefinite block matrices. Our result extends a result of Lin Czech. Math. J. 66 (2016) and improves a result of Kuai Linear Multilinear Algebra 66 (2018) . Moreover, we provide a unified treatment of a result of Ando ILAS Conference (2014) and a recent result of Li, Liu and Huang Operators and Matrices 15 (2021) . Furthermore, we also extend some determinant inequalities involving partial traces to a larger class of matrices whose numerical ranges are contained in a sector. In addition, some extensions on trace inequalities for positive semidefinite 2 times 2 block matrices are also included.


DeepAlign Alignment based Process Anomaly Correction using Recurrent Neural Networks. In this paper, we propose DeepAlign, a novel approach to multi perspective process anomaly correction, based on recurrent neural networks and bidirectional beam search. At the core of the DeepAlign algorithm are two recurrent neural networks trained to predict the next event. One is reading sequences of process executions from left to right, while the other is reading the sequences from right to left. By combining the predictive capabilities of both neural networks, we show that it is possible to calculate sequence alignments, which are used to detect and correct anomalies. DeepAlign utilizes the case level and event level attributes to closely model the decisions within a process. We evaluate the performance of our approach on an elaborate data corpus of 252 realistic synthetic event logs and compare it to three state of the art conformance checking methods. DeepAlign produces better corrections than the rest of the field reaching an overall F 1 score of 0.9572 across all datasets, whereas the best comparable state of the art method reaches 0.6411 .


Let's be Humorous Knowledge Enhanced Humor Generation. The generation of humor is an under explored and challenging problem. Previous works mainly utilize templates or replace phrases to generate humor. However, few works focus on freer forms and the background knowledge of humor. The linguistic theory of humor defines the structure of a humor sentence as set up and punchline. In this paper, we explore how to generate a punchline given the set up with the relevant knowledge. We propose a framework that can fuse the knowledge to end to end models. To our knowledge, this is the first attempt to generate punchlines with knowledge enhanced model. Furthermore, we create the first humor knowledge dataset. The experimental results demonstrate that our method can make use of knowledge to generate fluent, funny punchlines, which outperforms several baselines.


Conspiracy vs science A large scale analysis of online discussion cascades. With the emergence and rapid proliferation of social media platforms and social networking sites, recent years have witnessed a surge of misinformation spreading in our daily life. Drawing on a large scale dataset which covers more than 1.4M posts and 18M comments, we investigate the propagation of two distinct narratives (i) conspiracy information, whose claims are generally unsubstantiated and thus referred as misinformation to some extent, and (ii) scientific information, whose origins are generally readily identifiable and verifiable in an online social media platform. We find that conspiracy cascades tend to propagate in a multigenerational branching process while science cascades are more likely to grow in a breadth first manner. Specifically, conspiracy information triggers larger cascades, involves more users and generations, persists longer, is more viral and bursty than science information. Content analysis reveals that conspiracy cascades contain more negative words and emotional words which convey anger, fear, disgust, surprise and trust. We also find that conspiracy cascades are more concerned with political and controversial topics. After applying machine learning models, we achieve an AUC score of nearly 90 in discriminating conspiracy from science narratives. We find that conspiracy cascades are more likely to be controlled by a broader set of users than science cascades, imposing new challenges on the management of misinformation. Although political affinity is thought to affect the consumption of misinformation, there is very little evidence that political orientation of the information source plays a role during the propagation of conspiracy information. Our study provides complementing evidence to current misinformation research and has practical policy implications to stem the propagation and mitigate the influence of misinformation online.


Rank n swapping algebra for Grassmannian. The rank n swapping algebra is the Poisson algebra defined on the ordered pairs of points on a circle using the linking numbers, where a subspace of ( mathbb K n times mathbb K n ) r operatorname GL (n, mathbb K ) is its geometric mode. In this paper, we find an injective Poisson homomorphism from the Poisson algebra on Grassmannian G n,r arising from boundary measurement map to the rank n swapping fraction algebra.


Example Based Named Entity Recognition. We present a novel approach to named entity recognition (NER) in the presence of scarce data that we call example based NER. Our train free few shot learning approach takes inspiration from question answering to identify entity spans in a new and unseen domain. In comparison with the current state of the art, the proposed method performs significantly better, especially when using a low number of support examples.


Bibliometric Analysis of Agile Software Development. Agile methodologies are currently considered one of the main paradigms of software development. Its study, from a scientific point of view, has deserved prominence in recent years by the scientific community related to the area of software engineering. This study intends to perform a bibliometric analysis of the quantity, characteristics and scope of the most relevant studies published in this area of knowledge. The findings indicate that the number of studies published from 2010 to 2016 significantly increased, having reached a peak in 2015. The study identifies the main journals and conferences in the field and we also concluded that the majority of published studies are literature reviews of agile software development, and qualitative and quantitative research methods have identical number of publications.


Self improving Inequalities for bounded weak solutions to nonlocal double phase equations. We prove higher Sobolev regularity for bounded weak solutions to a class of nonlinear nonlocal integro differential equations. The leading operator exhibits nonuniform growth, switching between two different fractional elliptic phases" that are determined by the zero set of a modulating coefficient. Solutions are shown to improve both in integrability and differentiability. These results apply to operators with rough kernels and modulating coefficients. To obtain these results we adapt a particular fractional version of the Gehring lemma developed by Kuusi, Mingione, and Sire in their work Nonlocal self improving properties" Anal. PDE, 8(1) 57 114 for the specific nonlinear setting under investigation in this manuscript.


Stokes theory of thin film rupture. The structure of the flow induced by the van der Waals destabilization of a non wetting liquid film placed on a solid substrate is unraveled by means of theory and numerical simulations of the Stokes equations. Our analysis reveals that lubrication theory, which yields h text min propto tau 1 5 where h text min is the minimum film thickness and tau is the time until breakup, cannot be used to describe the local flow close to rupture. Instead, the slender lubrication solution is shown to experience a crossover to a universal self similar solution of the Stokes equations that yields h text min propto tau 1 3 , with an opening angle of 37 circ off the solid.


A Soft Computing Approach for Selecting and Combining Spectral Bands. We introduce a soft computing approach for automatically selecting and combining indices from remote sensing multispectral images that can be used for classification tasks. The proposed approach is based on a Genetic Programming (GP) framework, a technique successfully used in a wide variety of optimization problems. Through GP, it is possible to learn indices that maximize the separability of samples from two different classes. Once the indices specialized for all the pairs of classes are obtained, they are used in pixelwise classification tasks. We used the GP based solution to evaluate complex classification problems, such as those that are related to the discrimination of vegetation types within and between tropical biomes. Using time series defined in terms of the learned spectral indices, we show that the GP framework leads to superior results than other indices that are used to discriminate and classify tropical biomes.


Towards Equivalent Transformation of User Preferences in Cross Domain Recommendation. Cross domain recommendation (CDR) is one popular research topic in recommender systems. This paper focuses on a popular scenario for CDR where different domains share the same set of users but no overlapping items. The majority of recent methods have explored the shared user representation to transfer knowledge across domains. However, the idea of shared user representation resorts to learn the overlapped features of user preferences and suppresses the domain specific features. Other works try to capture the domain specific features by an MLP mapping but require heuristic human knowledge of choosing samples to train the mapping. In this paper, we attempt to learn both features of user preferences in a more principled way. We assume that each user's preferences in one domain can be expressed by the other one, and these preferences can be mutually converted to each other with the so called equivalent transformation. Based on this assumption, we propose an equivalent transformation learner (ETL) which models the joint distribution of user behaviors across domains. The equivalent transformation in ETL relaxes the idea of shared user representation and allows the learned preferences in different domains to preserve the domain specific features as well as the overlapped features. Extensive experiments on three public benchmarks demonstrate the effectiveness of ETL compared with recent state of the art methods. Codes and data are available online url https github.com xuChenSJTU ETL master


Block preconditioning of stochastic Galerkin problems New two sided guaranteed spectral bounds. The paper focuses on numerical solution of parametrized diffusion equations with scalar parameter dependent coefficient function by the stochastic (spectral) Galerkin method. We study preconditioning of the related discretized problems using preconditioners obtained by modifying the stochastic part of the partial differential equation. We present a simple but general approach for obtaining two sided bounds to the spectrum of the resulting matrices, based on a particular splitting of the discretized operator. Using this tool and considering the stochastic approximation space formed by classical orthogonal polynomials, we obtain new spectral bounds depending solely on the properties of the coefficient function and the type of the approximation polynomials for several classes of block diagonal preconditioners. These bounds are guaranteed and applicable to various distributions of parameters. Moreover, the conditions on the parameter dependent coefficient function are only local, and therefore less restrictive than those usually assumed in the literature.


Privacy Preserving Distributed Learning Framework for 6G Telecom Ecosystems. We present a privacy preserving distributed learning framework for telecom ecosystems in the 6G era that enables the vision of shared ownership and governance of ML models, while protecting the privacy of the data owners. We demonstrate its benefits by applying it to the use case of Quality of Transmission (QoT) estimation in multi domain multi vendor optical networks, where no data of individual domains is shared with the network management system (NMS).


Efficient Document Exchange and Error Correcting Codes with Asymmetric Information. We study two fundamental problems in communication, Document Exchange (DE) and Error Correcting Code (ECC). In the first problem, two parties hold two strings, and one party tries to learn the other party's string through communication. In the second problem, one party tries to send a message to another party through a noisy channel, by adding some redundant information to protect the message. Two important goals in both problems are to minimize the communication complexity or redundancy, and to design efficient protocols or codes. Both problems have been studied extensively. In this paper we study whether asymmetric partial information can help in these two problems. We focus on the case of Hamming distance errors, and the asymmetric partial information is modeled by one party having a vector of disjoint subsets vec S (S 1, cdots, S t) of indices and a vector of integers vec k (k 1, cdots, k t) , such that in each S i the Hamming distance errors is at most k i . We establish both lower bounds and upper bounds in this model, and provide efficient randomized constructions that achieve a min lbrace O(t 2), O left(( log log n) 2 right) rbrace factor within the optimum, with almost linear running time. We further show a connection between the above document exchange problem and the problem of document exchange under edit distance, and use our techniques to give an efficient randomized protocol with optimal communication complexity and emph exponentially small error for the latter. This improves the previous result by Haeupler cite haeupler2018optimal (FOCS'19) and that by Belazzougui and Zhang cite BelazzouguiZ16 (FOCS'16). Our techniques are based on a generalization of the celebrated expander codes by Sipser and Spielman cite sipser1996expander , which may be of independent interests.


The distribution of the maximum of partial sums of Kloosterman sums and other trace functions. In this paper, we investigate the distribution of the maximum of partial sums of families of m periodic complex valued functions satisfying certain conditions. We obtain precise uniform estimates for the distribution function of this maximum in a near optimal range. Our results apply to partial sums of Kloosterman sums and other families of ell adic trace functions, and are as strong as those obtained by Bober, Goldmakher, Granville and Koukoulopoulos for character sums. In particular, we improve on the recent work of the third author for Birch sums. However, unlike character sums, we are able to construct families of m periodic complex valued functions which satisfy our conditions, but for which the P 'olya Vinogradov inequality is sharp.


Improving Chinese Segmentation free Word Embedding With Unsupervised Association Measure. Recent work on segmentation free word embedding(sembei) developed a new pipeline of word embedding for unsegmentated language while avoiding segmentation as a preprocessing step. However, too many noisy n grams existing in the embedding vocabulary that do not have strong association strength between characters would limit the quality of learned word embedding. To deal with this problem, a new version of segmentation free word embedding model is proposed by collecting n grams vocabulary via a novel unsupervised association measure called pointwise association with times information(PATI). Comparing with the commonly used n gram filtering method like frequency used in sembei and pointwise mutual information(PMI), the proposed method leverages more latent information from the corpus and thus is able to collect more valid n grams that have stronger cohesion as embedding targets in unsegmented language data, such as Chinese texts. Further experiments on Chinese SNS data show that the proposed model improves performance of word embedding in downstream tasks.


Accessibility of derived from Anosov systems. This paper shows any non Anosov partially hyperbolic diffeomorphism on the 3 torus which is homotopic to Anosov must be accessible.


A remark on varepsilon maps in dimension 1. Let f colon mathbb S 1 rightarrow G be a surjective map from the standard unit circle to a graph G such that the pre image of each point has diameter less than varepsilon . If varepsilon is small enough, does f split as a free factor in pi 1(G) ?


On the Physical Meaning of Time Domain Constitutive Models with Complex Parameters. This paper revisits the physical meaning of linear, time domain constitutive models with complex parameters that have been presented in the literature and concludes that such models are not physically realizable. While complex parameter phenomenological models (including those with complex order time derivatives) may be efficient in capturing in the frequency domain the frequency dependent behavior of viscoelastic materials over a finite frequency band, they do not possess physically acceptable time response functions. The paper first reviews the intimate relation between the causality of a physically realizable constitutive model and the analyticity of its frequency response function and explains that in theory it is sufficient to conduct a nonlinear regression analysis for estimating the model parameters either on only the real part or on only the imaginary part of its frequency response function, given that they are related with the Hilbert transform. Consequently, the resulting model parameters are real valued therefore, there is no theoretical justification to conduct the nonlinear regression analysis for estimating the model parameters in the complex space. The paper concludes with an example by showing that the relaxation modulus of the complex coefficient Maxwell model is a divergent function at all positive times therefore it is not a physically realizable constitutive model.


On non commutative Euler systems. Let p be a prime, T a p adic representation over a number field K and mathcal K an arbitrary Galois extension of K . Then for each non negative integer r we define a natural notion of a non commutative Euler system of rank r ' for T relative to the extension mathcal K K . We prove that if p is odd and T and mathcal K K satisfy certain mild hypotheses, then there exist non commutative Euler systems that control the Galois structure of cohomology groups of T over intermediate fields of mathcal K K and have rank that depends explicitly on T . As a first concrete application of this approach, we (unconditionally) extend the classical Euler system of cyclotomic units to the setting of arbitrary totally real Galois extensions of mathbb Q and describe explicit links between this extended cyclotomic Euler system, the values at zero of derivatives of Artin L series and the Galois structures of ideal class groups. As an important preliminary to the formulation and proof of these results, we introduce natural non commutative generalizations of several standard constructions in commutative algebra including higher Fitting invariants, higher exterior powers and the Grothendieck Knudsen Mumford determinant functor on perfect complexes that are of independent interest.


Strong Backward uniqueness for sublinear parabolic equations. In this paper, we establish strong backward uniqueness for solutions to sublinear parabolic equations of the type (1.1). The proof of our main result Theorem 1.1 is achieved by means of a new Carleman estimate and a Weiss type monotonicity that are tailored for such parabolic sublinear operators.


Arithmetic Chern Simons theory with real places. The goal of this paper is two folds we generalize the arithmetic Chern Simons theory over totally imaginary number fields to arbitrary number fields (with real places) and provide new examples of non trivial arithmetic Chern Simons invariant with coefficient mathbb Z n mathbb Z (n geq 2) associated to a non abelian gauge group. The main idea for the generalization is to use cohomology with compact support to deal with real places. So far, the non trivial examples are limited to some non abelian gauge group with coefficient mathbb Z 2 mathbb Z and the abelian cyclic gauge group with coefficient mathbb Z n mathbb Z . Our non trivial examples with non abelian gauge group and general coefficient mathbb Z n mathbb Z will be given by a simple twisting argument. In the appendix, we explain alternative method of generalization based on the work of Zink and Conrad Masullo.


Sentence level estimation of psycholinguistic norms using joint multidimensional annotations. Psycholinguistic normatives represent various affective and mental constructs using numeric scores and are used in a variety of applications in natural language processing. They are commonly used at the sentence level, the scores of which are estimated by extrapolating word level scores using simple aggregation strategies, which may not always be optimal. In this work, we present a novel approach to estimate the psycholinguistic norms at sentence level. We apply a multidimensional annotation fusion model on annotations at the word level to estimate a parameter which captures relationships between different norms. We then use this parameter at sentence level to estimate the norms. We evaluate our approach by predicting sentence level scores for various normative dimensions and compare with standard word aggregation schemes.


Virtual Mixup Training for Unsupervised Domain Adaptation. We study the problem of unsupervised domain adaptation which aims to adapt models trained on a labeled source domain to a completely unlabeled target domain. Recently, the cluster assumption has been applied to unsupervised domain adaptation and achieved strong performance. One critical factor in successful training of the cluster assumption is to impose the locally Lipschitz constraint to the model. Existing methods only impose the locally Lipschitz constraint around the training points while miss the other areas, such as the points in between training data. In this paper, we address this issue by encouraging the model to behave linearly in between training points. We propose a new regularization method called Virtual Mixup Training (VMT), which is able to incorporate the locally Lipschitz constraint to the areas in between training data. Unlike the traditional mixup model, our method constructs the combination samples without using the label information, allowing it to apply to unsupervised domain adaptation. The proposed method is generic and can be combined with most existing models such as the recent state of the art model called VADA. Extensive experiments demonstrate that VMT significantly improves the performance of VADA on six domain adaptation benchmark datasets. For the challenging task of adapting MNIST to SVHN, VMT can improve the accuracy of VADA by over 30 . Code is available at url https github.com xudonmao VMT .


Lie bracket derivation derivations in Banach algebras. In this paper, we introduce and solve the following additive additive (s,t) functional inequality begin eqnarray label 0.1 g left(x y right) g(x) g(y) h(x y) h(x y) 2 h(x) le left s left( 2 g left( frac x y 2 right) g(x) g(y) right) right left t left( 2h left( frac x y 2 right) 2h left( frac x y 2 right) 2h (x) right) right , nonumber end eqnarray where s and t are fixed nonzero complex numbers with s 1 and t 1 . Using the direct method and the fixed point method, we prove the Hyers Ulam stability of Lie bracket derivation derivations in complex Banach algebras, associated to the additive additive (s,t) functional inequality ( ref 0.1 ) and the following functional inequality begin eqnarray label 0.2 g, h (xy) g,h (x) y x g,h (y) h(xy) h(x) y x h(y) le varphi(x,y). end eqnarray


Low rank tensor methods for Markov chains with applications to tumor progression models. Continuous time Markov chains describing interacting processes exhibit a state space that grows exponentially in the number of processes. This state space explosion renders the computation or storage of the time marginal distribution, which is defined as the solution of a certain linear system, infeasible using classical methods. We consider Markov chains whose transition rates are separable functions, which allows for an efficient low rank tensor representation of the operator of this linear system. Typically, the right hand side also has low rank structure, and thus we can reduce the cost for computation and storage from exponential to linear. Previously known iterative methods also allow for low rank approximations of the solution but are unable to guarantee that its entries sum up to one as required for a probability distribution. We derive a convergent iterative method using low rank formats satisfying this condition. We also perform numerical experiments illustrating that the marginal distribution is well approximated with low rank.


Weak Supervision Enhanced Generative Network for Question Generation. Automatic question generation according to an answer within the given passage is useful for many applications, such as question answering system, dialogue system, etc. Current neural based methods mostly take two steps which extract several important sentences based on the candidate answer through manual rules or supervised neural networks and then use an encoder decoder framework to generate questions about these sentences. These approaches neglect the semantic relations between the answer and the context of the whole passage which is sometimes necessary for answering the question. To address this problem, we propose the Weak Supervision Enhanced Generative Network (WeGen) which automatically discovers relevant features of the passage given the answer span in a weakly supervised manner to improve the quality of generated questions. More specifically, we devise a discriminator, Relation Guider, to capture the relations between the whole passage and the associated answer and then the Multi Interaction mechanism is deployed to transfer the knowledge dynamically for our question generation system. Experiments show the effectiveness of our method in both automatic evaluations and human evaluations.


Systematic literature review protocol Identification and classification of feature modeling errors. Context The importance of feature modeling languages for software product lines and the planning stage for a systematic literature review. Objective A protocol for carrying out a systematic literature review about the evidence for identifying and classifying the errors in feature modeling languages. Method The definition of a protocol to conduct a systematic literature review according to the guidelines of B. Kitchenham. Results A validated protocol to conduct a systematic literature review. Conclusions A proposal for the protocol definition of a systematic literature review about the identification and classification of errors in feature modeling was built. Initial results show that the effects and results for solving these errors should be carried out.


Imaginary shift in CASPT2 nuclear gradient and derivative coupling theory. We report the analytical nuclear gradient theory for complete active space second order perturbation theory (CASPT2) with imaginary shift, which is commonly used to avoid divergence of the perturbation expression. Our formulation is based on the Lagrangian approach and is an extension of the algorithm for CASPT2 nuclear gradients with real shift. The working equations are derived and implemented into an efficient parallel program. Numerical examples are presented for the ground and excited state geometries and conical intersections of a green fluorescent protein model chromophore, p HBDI . We also report timing benchmarks with adenine, p HBDI , and iron porphyrin. It is demonstrated that the energies and geometries obtained with the imaginary shift improve accuracy at a minor additional cost which is mainly associated with evaluating the effective density matrix elements for the imaginary shift term.


Tree Builder Random Walk recurrence, transience and ballisticity. The Tree Builder Random Walk is a special random walk that evolves on trees whose size increases with time, randomly and depending upon the walker. After every s steps of the walker, a random number of vertices are added to the tree and attached to the current position of the walker. These processes share similarities with other important classes of markovian and non markovian random walks presenting a large variety of behaviors according to parameters specifications. We show that for a large and most significant class of tree builder random walks, the process is either null recurrent or transient. If s is odd, the walker is ballistic and thus transient. If s is even, the walker's behavior can be explained from local properties of the growing tree and it can be either null recurrent or it gets trapped on some limited part of the growing tree.


Deform GAN An Unsupervised Learning Model for Deformable Registration. Deformable registration is one of the most challenging task in the field of medical image analysis, especially for the alignment between different sequences and modalities. In this paper, a non rigid registration method is proposed for 3D medical images leveraging unsupervised learning. To the best of our knowledge, this is the first attempt to introduce gradient loss into deep learning based registration. The proposed gradient loss is robust across sequences and modals for large deformation. Besides, adversarial learning approach is used to transfer multi modal similarity to mono modal similarity and improve the precision. Neither ground truth nor manual labeling is required during training. We evaluated our network on a 3D brain registration task comprehensively. The experiments demonstrate that the proposed method can cope with the data which has non functional intensity relations, noise and blur. Our approach outperforms other methods especially in accuracy and speed.


Quick and (not so) Dirty Unsupervised Selection of Justification Sentences for Multi hop Question Answering. We propose an unsupervised strategy for the selection of justification sentences for multi hop question answering (QA) that (a) maximizes the relevance of the selected sentences, (b) minimizes the overlap between the selected facts, and (c) maximizes the coverage of both question and answer. This unsupervised sentence selection method can be coupled with any supervised QA approach. We show that the sentences selected by our method improve the performance of a state of the art supervised QA model on two multi hop QA datasets AI2's Reasoning Challenge (ARC) and Multi Sentence Reading Comprehension (MultiRC). We obtain new state of the art performance on both datasets among approaches that do not use external resources for training the QA system 56.82 F1 on ARC (41.24 on Challenge and 64.49 on Easy) and 26.1 EM0 on MultiRC. Our justification sentences have higher quality than the justifications selected by a strong information retrieval baseline, e.g., by 5.4 F1 in MultiRC. We also show that our unsupervised selection of justification sentences is more stable across domains than a state of the art supervised sentence selection method.


Information Extraction based on Named Entity for Tourism Corpus. Tourism information is scattered around nowadays. To search for the information, it is usually time consuming to browse through the results from search engine, select and view the details of each accommodation. In this paper, we present a methodology to extract particular information from full text returned from the search engine to facilitate the users. Then, the users can specifically look to the desired relevant information. The approach can be used for the same task in other domains. The main steps are 1) building training data and 2) building recognition model. First, the tourism data is gathered and the vocabularies are built. The raw corpus is used to train for creating vocabulary embedding. Also, it is used for creating annotated data. The process of creating named entity annotation is presented. Then, the recognition model of a given entity type can be built. From the experiments, given hotel description, the model can extract the desired entity,i.e, name, location, facility. The extracted data can further be stored as a structured information, e.g., in the ontology format, for future querying and inference. The model for automatic named entity identification, based on machine learning, yields the error ranging 8 25 .


Forming Local Intersections of Projections for Classifying and Searching Histopathology Images. In this paper, we propose a novel image descriptor called Forming Local Intersections of Projections (FLIP) and its multi resolution version (mFLIP) for representing histopathology images. The descriptor is based on the Radon transform wherein we apply parallel projections in small local neighborhoods of gray level images. Using equidistant projection directions in each window, we extract unique and invariant characteristics of the neighborhood by taking the intersection of adjacent projections. Thereafter, we construct a histogram for each image, which we call the FLIP histogram. Various resolutions provide different FLIP histograms which are then concatenated to form the mFLIP descriptor. Our experiments included training common networks from scratch and fine tuning pre trained networks to benchmark our proposed descriptor. Experiments are conducted on the publicly available dataset KIMIA Path24 and KIMIA Path960. For both of these datasets, FLIP and mFLIP descriptors show promising results in all experiments.Using KIMIA Path24 data, FLIP outperformed non fine tuned Inception v3 and fine tuned VGG16 and mFLIP outperformed fine tuned Inception v3 in feature extracting.


Multi View Dynamic Heterogeneous Information Network Embedding. Most existing Heterogeneous Information Network (HIN) embedding methods focus on static environments while neglecting the evolving characteristic of realworld networks. Although several dynamic embedding methods have been proposed, they are merely designed for homogeneous networks and cannot be directly applied in heterogeneous environment. To tackle above challenges, we propose a novel framework for incorporating temporal information into HIN embedding, denoted as Multi View Dynamic HIN Embedding (MDHNE), which can efficiently preserve evolution patterns of implicit relationships from different views in updating node representations over time. We first transform HIN to a series of homogeneous networks corresponding to different views. Then our proposed MDHNE applies Recurrent Neural Network (RNN) to incorporate evolving pattern of complex network structure and semantic relationships between nodes into latent embedding spaces, and thus the node representations from multiple views can be learned and updated when HIN evolves over time. Moreover, we come up with an attention based fusion mechanism, which can automatically infer weights of latent representations corresponding to different views by minimizing the objective function specific for different mining tasks. Extensive experiments clearly demonstrate that our MDHNE model outperforms state of the art baselines on three real world dynamic datasets for different network mining tasks.


Focus Your Attention A Bidirectional Focal Attention Network for Image Text Matching. Learning semantic correspondence between image and text is significant as it bridges the semantic gap between vision and language. The key challenge is to accurately find and correlate shared semantics in image and text. Most existing methods achieve this goal by representing the shared semantic as a weighted combination of all the fragments (image regions or text words), where fragments relevant to the shared semantic obtain more attention, otherwise less. However, despite relevant ones contribute more to the shared semantic, irrelevant ones will more or less disturb it, and thus will lead to semantic misalignment in the correlation phase. To address this issue, we present a novel Bidirectional Focal Attention Network (BFAN), which not only allows to attend to relevant fragments but also diverts all the attention into these relevant fragments to concentrate on them. The main difference with existing works is they mostly focus on learning attention weight while our BFAN focus on eliminating irrelevant fragments from the shared semantic. The focal attention is achieved by pre assigning attention based on inter modality relation, identifying relevant fragments based on intra modality relation and reassigning attention. Furthermore, the focal attention is jointly applied in both image to text and text to image directions, which enables to avoid preference to long text or complex image. Experiments show our simple but effective framework significantly outperforms state of the art, with relative Recall 1 gains of 2.2 on both Flicr30K and MSCOCO benchmarks.


Tilings with the Minimal Tile Property. A square tiling of the unit square is said to have the minimal tile property if the smallest tile can tile all the other tiles. We show that in such a tiling, the smallest tile cannot be too small.


Learning Dense Representations of Phrases at Scale. Open domain question answering can be reformulated as a phrase retrieval problem, without the need for processing documents on demand during inference (Seo et al., 2019). However, current phrase retrieval models heavily depend on sparse representations and still underperform retriever reader approaches. In this work, we show for the first time that we can learn dense representations of phrases alone that achieve much stronger performance in open domain QA. We present an effective method to learn phrase representations from the supervision of reading comprehension tasks, coupled with novel negative sampling methods. We also propose a query side fine tuning strategy, which can support transfer learning and reduce the discrepancy between training and inference. On five popular open domain QA datasets, our model DensePhrases improves over previous phrase retrieval models by 15 25 absolute accuracy and matches the performance of state of the art retriever reader models. Our model is easy to parallelize due to pure dense representations and processes more than 10 questions per second on CPUs. Finally, we directly use our pre indexed dense phrase representations for two slot filling tasks, showing the promise of utilizing DensePhrases as a dense knowledge base for downstream tasks.


Scene Compliant Trajectory Forecast with Agent Centric Spatio Temporal Grids. Forecasting long term human motion is a challenging task due to the non linearity, multi modality and inherent uncertainty in future trajectories. The underlying scene and past motion of agents can provide useful cues to predict their future motion. However, the heterogeneity of the two inputs poses a challenge for learning a joint representation of the scene and past trajectories. To address this challenge, we propose a model based on grid representations to forecast agent trajectories. We represent the past trajectories of agents using binary 2 D grids, and the underlying scene as a RGB birds eye view (BEV) image, with an agent centric frame of reference. We encode the scene and past trajectories using convolutional layers and generate trajectory forecasts using a Convolutional LSTM (ConvLSTM) decoder. Results on the publicly available Stanford Drone Dataset (SDD) show that our model outperforms prior approaches and outputs realistic future trajectories that comply with scene structure and past motion.


DualLip A System for Joint Lip Reading and Generation. Lip reading aims to recognize text from talking lip, while lip generation aims to synthesize talking lip according to text, which is a key component in talking face generation and is a dual task of lip reading. In this paper, we develop DualLip, a system that jointly improves lip reading and generation by leveraging the task duality and using unlabeled text and lip video data. The key ideas of the DualLip include 1) Generate lip video from unlabeled text with a lip generation model, and use the pseudo pairs to improve lip reading 2) Generate text from unlabeled lip video with a lip reading model, and use the pseudo pairs to improve lip generation. We further extend DualLip to talking face generation with two additionally introduced components lip to face generation and text to speech generation. Experiments on GRID and TCD TIMIT demonstrate the effectiveness of DualLip on improving lip reading, lip generation, and talking face generation by utilizing unlabeled data. Specifically, the lip generation model in our DualLip system trained with only10 paired data surpasses the performance of that trained with the whole paired data. And on the GRID benchmark of lip reading, we achieve 1.16 character error rate and 2.71 word error rate, outperforming the state of the art models using the same amount of paired data.


Multilayer Modularity Belief Propagation To Assess Detectability Of Community Structure. Modularity based community detection encompasses a number of widely used, efficient heuristics for identification of structure in networks. Recently, a belief propagation approach to modularity optimization provided a useful guide for identifying non trivial structure in single layer networks in a way that other optimization heuristics have not. In this paper, we extend modularity belief propagation to multilayer networks. As part of this development, we also directly incorporate a resolution parameter. We show that adjusting the resolution parameter affects the convergence properties of the algorithm and yields different community structures than the baseline. We compare our approach with a widely used community detection tool, GenLouvain, across a range of synthetic, multilayer benchmark networks, demonstrating that our method performs comparably to the state of the art. Finally, we demonstrate the practical advantages of the additional information provided by our tool by way of two real world network examples. We show how the convergence properties of the algorithm can be used in selecting the appropriate resolution and coupling parameters and how the node level marginals provide an interpretation for the strength of attachment to the identified communities. We have released our tool as a Python package for convenient use.


Ablate, Variate, and Contemplate Visual Analytics for Discovering Neural Architectures. Deep learning models require the configuration of many layers and parameters in order to get good results. However, there are currently few systematic guidelines for how to configure a successful model. This means model builders often have to experiment with different configurations by manually programming different architectures (which is tedious and time consuming) or rely on purely automated approaches to generate and train the architectures (which is expensive). In this paper, we present Rapid Exploration of Model Architectures and Parameters, or REMAP, a visual analytics tool that allows a model builder to discover a deep learning model quickly via exploration and rapid experimentation of neural network architectures. In REMAP, the user explores the large and complex parameter space for neural network architectures using a combination of global inspection and local experimentation. Through a visual overview of a set of models, the user identifies interesting clusters of architectures. Based on their findings, the user can run ablation and variation experiments to identify the effects of adding, removing, or replacing layers in a given architecture and generate new models accordingly. They can also handcraft new models using a simple graphical interface. As a result, a model builder can build deep learning models quickly, efficiently, and without manual programming. We inform the design of REMAP through a design study with four deep learning model builders. Through a use case, we demonstrate that REMAP allows users to discover performant neural network architectures efficiently using visual exploration and user defined semi automated searches through the model space.


Transitive bounded degree 2 expanders from regular 2 expanders. A two dimensional simplicial complex is called d em regular if every edge of it is contained in exactly d distinct triangles. It is called epsilon expanding if its up down two dimensional random walk has a normalized maximal eigenvalue which is at most 1 epsilon . In this work, we present a class of bounded degree 2 dimensional expanders, which is the result of a small 2 complex action on a vertex set. The resulted complexes are fully transitive, meaning the automorphism group acts transitively on their faces. Such two dimensional expanders are rare! Known constructions of such bounded degree two dimensional expander families are obtained from deep algebraic reasonings (e.g. coset geometries). We show that given a small d regular two dimensional epsilon expander, there exists an epsilon' epsilon'( epsilon) and a family of bounded degree two dimensional simplicial complexes with a number of vertices goes to infinity, such that each complex in the family satisfies the following properties It is 4d regular. The link of each vertex in the complex is the same regular graph (up to isomorphism). It is epsilon' expanding. It is transitive. The family of expanders that we get is explicit if the one skeleton of the small complex is a complete multipartite graph, and it is random in the case of (almost) general d regular complex. For the randomized construction, we use results on expanding generators in a product of simple Lie groups. This construction is inspired by ideas that occur in the zig zag product for graphs. It can be seen as a loose two dimensional analog of the replacement product.


The Ghost Measures of Affine Regular Sequences. The k regular sequences exhibit a self similar behaviour between powers of k. One way to study this self similarity is to attempt to describe the limiting shape of the sequence using measures, which results in an object which we call the ghost measure. The aim of this paper is to explicitly calculate this measure and some of its properties, including its Lebesgue decomposition, for the general family of affine 2 regular sequences.


Importance of Copying Mechanism for News Headline Generation. News headline generation is an essential problem of text summarization because it is constrained, well defined, and is still hard to solve. Models with a limited vocabulary can not solve it well, as new named entities can appear regularly in the news and these entities often should be in the headline. News articles in morphologically rich languages such as Russian require model modifications due to a large number of possible word forms. This study aims to validate that models with a possibility of copying words from the original article performs better than models without such an option. The proposed model achieves a mean ROUGE score of 23 on the provided test dataset, which is 8 points greater than the result of a similar model without a copying mechanism. Moreover, the resulting model performs better than any known model on the new dataset of Russian news.


Sequential Attacks on Kalman Filter based Forward Collision Warning Systems. Kalman Filter (KF) is widely used in various domains to perform sequential learning or variable estimation. In the context of autonomous vehicles, KF constitutes the core component of many Advanced Driver Assistance Systems (ADAS), such as Forward Collision Warning (FCW). It tracks the states (distance, velocity etc.) of relevant traffic objects based on sensor measurements. The tracking output of KF is often fed into downstream logic to produce alerts, which will then be used by human drivers to make driving decisions in near collision scenarios. In this paper, we study adversarial attacks on KF as part of the more complex machine human hybrid system of Forward Collision Warning. Our attack goal is to negatively affect human braking decisions by causing KF to output incorrect state estimations that lead to false or delayed alerts. We accomplish this by sequentially manipulating measure ments fed into the KF, and propose a novel Model Predictive Control (MPC) approach to compute the optimal manipulation. Via experiments conducted in a simulated driving environment, we show that the attacker is able to successfully change FCW alert signals through planned manipulation over measurements prior to the desired target time. These results demonstrate that our attack can stealthily mislead a distracted human driver and cause vehicle collisions.


Homotopy Covers of Graphs. We develop conditions for a graph to be a times homotopy cover, satisfying a times homotopy lifting property analogous to the homotopy lifting property of covers of topological spaces. We define a universal homotopy cover for graphs which satisfies the appropriate universal properties, and a theory of deck transformations that can be used to define homotopy covers as quotients of the universal cover. Finally, we consider double homotopy covers, showing that the number of these depends only on the homotopy type of the graph, and explicitly count the double covers of cycles and complete graphs.


Central limit theorem for a critical multi type branching process in random environment. Let (Z n) n ge 0 with Z n (Z n (i, j)) 1 le i,j le p be a p multi type critical branching process in random environment, and let M n be the expectation of Z n given a fixed environment. We prove theorems on convergence in distribution of sequences of branching processes Zn Mn Z n 0 and ln Zn sqrt n Z n 0. These theorems extend similar results for single type critical branching process in random environment.


A Secure and Smart Framework for Preventing Ransomware Attack. Nowadays security is major concern for any user connected to the internet. Various types of attacks are to be performed by intruders to obtaining user information as manin middle attack, denial of service, malware attacks etc. Malware attacks specifically ransomware attack become very famous recently. Ransomware attack threaten the users by encrypting their most valuable data, lock the user screen, play some random videos and by various more means. Finally attacker take benefits by users through paid ransom. In this paper, we propose a framework which prevent the ransomware attack more appropriately using various techniques as blockchain, honeypot, cloud edge computing. This framework is analysed mainly through the IoT devices and generalized to the any malware attack.


Eigenmode beam optimisation for optical micro manipulation. Optical micro manipulation and trapping of micro particles delivers a mechanical system in direct interaction with a beam of light. In this interaction, the optical properties such as polarisation, beam profile and wavelength of the trapping beam are important. Different beams are associated with different momentum transfer, trap stiffness and stabilisation properties, for example. One method to determine the best beam profile is through the use of the optical eigenmode approach. To use this method, we employ Mie scattering theory which enables the exact determination of the scattered field as a function of the incident field. More precisely, this approach allows us to calculate the Hermitian relationship between the incident field and the optical forces acting on the scattering objects. This Hermitian relationship defines also a set of orthogonal optical eigenmodes which deliver a natural basis to describe momentum transfer in light matter interactions. This relationship defines also a set of orthogonal optical eigenmodes. Using these modes it is possible to define, for each numerical aperture, particle size or geometry, the optimal trapping beam.


Distribution function of the blow up time of the solution of an anticipating random fatigue equation. In this paper, we study the distribution function of the time of explosion of a stochastic differential equation modeling the length of the dominant crack due to fatigue. The main novelty is that initial condition is regarded as an anticipating random variable and the stochastic integral is in the forward sense. Under suitable conditions, we use the substitution formula from Russo and Vallois to find the local solution of this equation. Then, we find the law of blow up time by proving some results on barrier crossing probabilities of Brownian bridge.


Strongly graded groupoid and directed graph algebras. We show the reduced C algebra of a graded ample groupoid is a strongly graded C algebra if and only if the corresponding Steinberg algebra is a strongly graded ring. We apply this result to get a theorem about the Leavitt path algebra and C algebra of an arbitrary graph.


A Weyl law for the p Laplacian. We show that a Weyl law holds for the variational spectrum of the p Laplacian. More precisely, let ( lambda i) i 1 infty be the variational spectrum of Delta p on a closed Riemannian manifold (X,g) and let N( lambda) i , lambda i lambda be the associated counting function. Then we have a Weyl law N( lambda) sim c operatorname vol (X) lambda n p . This confirms a conjecture of Friedlander. The proof is based on ideas of Gromov and Liokumovich, Marques, Neves.


Bounded Degree Spanners in the Presence of Polygonal Obstacles. Let V be a finite set of vertices in the plane and S be a finite set of polygonal obstacles, where the vertices of S are in V . We show how to construct a plane 2 spanner of the visibility graph of V with respect to S . As this graph can have unbounded degree, we modify it in three easy to follow steps, in order to bound the degree to 7 at the cost of slightly increasing the spanning ratio to 6.


Three Filters to Normal An Accurate and Ultrafast Surface Normal Estimator. This paper proposes three filters to normal (3F2N), an accurate and ultrafast surface normal estimator (SNE), which is designed for structured range sensor data, e.g., depth disparity images. 3F2N SNE computes surface normals by simply performing three filtering operations (two image gradient filters in horizontal and vertical directions, respectively, and a mean median filter) on an inverse depth image or a disparity image. Despite the simplicity of 3F2N SNE, no similar method already exists in the literature. To evaluate the performance of our proposed SNE, we created three large scale synthetic datasets (easy, medium and hard) using 24 3D mesh models, each of which is used to generate 1800 2500 pairs of depth images (resolution 480X640 pixels) and the corresponding ground truth surface normal maps from different views. 3F2N SNE demonstrates the state of the art performance, outperforming all other existing geometry based SNEs, where the average angular errors with respect to the easy, medium and hard datasets are 1.66 degrees, 5.69 degrees and 15.31 degrees, respectively. Furthermore, our C and CUDA implementations achieve a processing speed of over 260 Hz and 21 kHz, respectively. Our datasets and source code are publicly available at sites.google.com view 3f2n.


Bent walls for random groups in the square and hexagonal model. We consider two random group models the hexagonal model and the square model, defined as the quotient of a free group by a random set of reduced words of length four and six respectively. Our first main result is that in this model there exists a sharp density threshold for Kazhdan's Property (T) and it equals 1 3. Our second main result is that for densities 3 8 a random group in the square model with overwhelming probability does not have Property (T). Moreover, we provide a new version of the Isoperimetric Inequality that concerns non planar diagrams and we introduce new geometrical tools to investigate random groups trees of loops, diagrams collared by a tree of loops and specific codimension one structures in the Cayley complex, called bent hypergraphs.


Analysis of Distributed Congestion Control in Cellular Vehicle to everything Networks. Cellular Vehicle to everything (C V2X) communication has been proposed in the 3rd Generation Partnership Project release 14 standard to address the latency and reliability requirements of cooperative safety applications. Such applications can involve highly congested vehicular scenarios where the network experiences high data loads. Thus, a sophisticated congestion control solution is vital in order to maintain the network performance required for safety related applications. With the aid of our high fidelity link level network simulator, we investigate the feasibility of implementing the distributed congestion control algorithm specified in SAE J2945 1 standard on top of the C V2X stack. We describe our implementation and evaluate the performance of transmission rate and range control mechanisms using relevant metrics. Additionally, we identify areas for potential design enhancements and further investigation.


Recent rigidity results for graphs with prescribed mean curvature. This survey describes some recent rigidity results obtained by the authors for the prescribed mean curvature problem on graphs u M rightarrow mathbb R . Emphasis is put on minimal, CMC and capillary graphs, as well as on graphical solitons for the mean curvature flow, in warped product ambient spaces. A detailed analysis of the mean curvature operator is given, focusing on maximum principles at infinity, Liouville properties, gradient estimates. Among the geometric applications, we mention the Bernstein theorem for positive entire minimal graphs on manifolds with non negative Ricci curvature, and a splitting theorem for capillary graphs over an unbounded domain Omega subset M , namely, for CMC graphs satisfying an overdetermined boundary condition.


Incorporating Pragmatic Reasoning Communication into Emergent Language. Emergentism and pragmatics are two research fields that study the dynamics of linguistic communication along substantially different timescales and intelligence levels. From the perspective of multi agent reinforcement learning, they correspond to stochastic games with reinforcement training and stage games with opponent awareness. Given that their combination has been explored in linguistics, we propose computational models that combine short term mutual reasoning based pragmatics with long term language emergentism. We explore this for agent communication referential games as well as in Starcraft II, assessing the relative merits of different kinds of mutual reasoning pragmatics models both empirically and theoretically. Our results shed light on their importance for making inroads towards getting more natural, accurate, robust, fine grained, and succinct utterances.


A Multi View Discriminant Learning Approach for Indoor Localization Using Bimodal Features of CSI. With the growth of location based services, indoor localization is attracting great interests as it facilitates further ubiquitous environments. Specifically, device free localization using wireless signals is getting increased attention as human location is estimated using its impact on the surrounding wireless signals without any active device tagged with subject. In this paper, we propose MuDLoc, the first multi view discriminant learning approach for device free indoor localization using both amplitude and phase features of Channel State Information (CSI) from multiple APs. Multi view learning is an emerging technique in machine learning which improve performance by utilizing diversity from different view data. In MuDLoc, the localization is modeled as a pattern matching problem, where the target location is predicted based on similarity measure of CSI features of an unknown location with those of the training locations. MuDLoc implements Generalized Inter view and Intra view Discriminant Correlation Analysis (GI 2 DCA), a discriminative feature extraction approach using multi view CSIs. It incorporates inter view and intra view class associations while maximizing pairwise correlations across multi view data sets. A similarity measure is performed to find the best match to localize a subject. Experimental results from two cluttered environments show that MuDLoc can estimate location with high accuracy which outperforms other benchmark approaches.


Leveraging Graph to Improve Abstractive Multi Document Summarization. Graphs that capture relations between textual units have great benefits for detecting salient information from multiple documents and generating overall coherent summaries. In this paper, we develop a neural abstractive multi document summarization (MDS) model which can leverage well known graph representations of documents such as similarity graph and discourse graph, to more effectively process multiple input documents and produce abstractive summaries. Our model utilizes graphs to encode documents in order to capture cross document relations, which is crucial to summarizing long documents. Our model can also take advantage of graphs to guide the summary generation process, which is beneficial for generating coherent and concise summaries. Furthermore, pre trained language models can be easily combined with our model, which further improve the summarization performance significantly. Empirical results on the WikiSum and MultiNews dataset show that the proposed architecture brings substantial improvements over several strong baselines.


PlotMachines Outline Conditioned Generation with Dynamic Plot State Tracking. We propose the task of outline conditioned story generation given an outline as a set of phrases that describe key characters and events to appear in a story, the task is to generate a coherent narrative that is consistent with the provided outline. This task is challenging as the input only provides a rough sketch of the plot, and thus, models need to generate a story by interweaving the key points provided in the outline. This requires the model to keep track of the dynamic states of the latent plot, conditioning on the input outline while generating the full story. We present PlotMachines, a neural narrative model that learns to transform an outline into a coherent story by tracking the dynamic plot states. In addition, we enrich PlotMachines with high level discourse structure so that the model can learn different writing styles corresponding to different parts of the narrative. Comprehensive experiments over three fiction and non fiction datasets demonstrate that large scale language models, such as GPT 2 and Grover, despite their impressive generation performance, are not sufficient in generating coherent narratives for the given outline, and dynamic plot state tracking is important for composing narratives with tighter, more consistent plots.


Frustratingly Easy Person Re Identification Generalizing Person Re ID in Practice. Contemporary person re identification ( reid) methods usually require access to data from the deployment camera network during training in order to perform well. This is because contemporary reid models trained on one dataset do not generalise to other camera networks due to the domain shift between datasets. This requirement is often the bottleneck for deploying reid systems in practical security or commercial applications, as it may be impossible to collect this data in advance or prohibitively costly to annotate it. This paper alleviates this issue by proposing a simple baseline for domain generalizable (DG) person re identification. That is, to learn a reid model from a set of source domains that is suitable for application to unseen datasets out of the box, without any model updating. Specifically, we observe that the domain discrepancy in reid is due to style and content variance across datasets and demonstrate appropriate Instance and Feature Normalization alleviates much of the resulting domain shift in Deep reid models. Instance Normalization (IN) in early layers filters out style statistic variations and Feature Normalization (FN) in deep layers is able to further eliminate disparity in content statistics. Compared to contemporary alternatives, this approach is extremely simple to implement, while being faster to train and test, thus making it an extremely valuable baseline for implementing reid in practice. With a few lines of code, it increases the rank 1 reid accuracy by 11.8 , 33.2 , 12.8 and 8.5 on the VIPeR, PRID, GRID, and i LIDS benchmarks respectively. Source codes are available at url https github.com BJTUJia person reID DualNorm .


Optimizing fire allocation in a NCW type model. In this paper, we introduce a non linear Lanchester model of NCW type and investigate an optimization problem for this model, where only the Red force is supplied by several supply agents. Optimal fire allocation of the Blue force is sought in the form of a piece wise constant function of time. A threatening rate is computed for the Red force and each of its supply agents at the beginning of each stage of the combat. These rates can be used to derive the optimal decision for the Blue force to focus its firepower to the Red force itself or one of its supply agents. This optimal fire allocation is derived and proved by considering an optimization problem of number of Blue force troops. Numerical experiments are included to demonstrate the theoretical results.


Survey on Parameterized Verification with Threshold Automata and the Byzantine Model Checker. Threshold guards are a basic primitive of many fault tolerant algorithms that solve classical problems of distributed computing, such as reliable broadcast, two phase commit, and consensus. Moreover, threshold guards can be found in recent blockchain algorithms such as Tendermint consensus. In this article, we give an overview of the techniques implemented in Byzantine Model Checker (ByMC). ByMC implements several techniques for automatic verification of threshold guarded distributed algorithms. These algorithms have the following features (1) up to t of processes may crash or behave Byzantine (2) the correct processes count messages and make progress when they receive sufficiently many messages, e.g., at least t 1 (3) the number n of processes in the system is a parameter, as well as t (4) and the parameters are restricted by a resilience condition, e.g., n 3t . Traditionally, these algorithms were implemented in distributed systems with up to ten participating processes. Nowadays, they are implemented in distributed systems that involve hundreds or thousands of processes. To make sure that these algorithms are still correct for that scale, it is imperative to verify them for all possible values of the parameters.


Deep Visual Domain Adaptation. Domain adaptation (DA) aims at improving the performance of a model on target domains by transferring the knowledge contained in different but related source domains. With recent advances in deep learning models which are extremely data hungry, the interest for visual DA has significantly increased in the last decade and the number of related work in the field exploded. The aim of this paper, therefore, is to give a comprehensive overview of deep domain adaptation methods for computer vision applications. First, we detail and compared different possible ways of exploiting deep architectures for domain adaptation. Then, we propose an overview of recent trends in deep visual DA. Finally, we mention a few improvement strategies, orthogonal to these methods, that can be applied to these models. While we mainly focus on image classification, we give pointers to papers that extend these ideas for other applications such as semantic segmentation, object detection, person re identifications, and others.


Invariant Representation Learning for Infant Pose Estimation with Small Data. Infant motion analysis is a topic with critical importance in early childhood development studies. However, while the applications of human pose estimation have become more and more broad, models trained on large scale adult pose datasets are barely successful in estimating infant poses due to the significant differences in their body ratio and the versatility of their poses. Moreover, the privacy and security considerations hinder the availability of adequate infant pose data required for training of a robust model from scratch. To address this problem, this paper presents (1) building and publicly releasing a hybrid synthetic and real infant pose (SyRIP) dataset with small yet diverse real infant images as well as generated synthetic infant poses and (2) a multi stage invariant representation learning strategy that could transfer the knowledge from the adjacent domains of adult poses and synthetic infant images into our fine tuned domain adapted infant pose (FiDIP) estimation model. In our ablation study, with identical network structure, models trained on SyRIP dataset show noticeable improvement over the ones trained on the only other public infant pose datasets. Integrated with pose estimation backbone networks with varying complexity, FiDIP performs consistently better than the fine tuned versions of those models. One of our best infant pose estimation performers on the state of the art DarkPose model shows mean average precision (mAP) of 93.6.


Using Neural Networks and Diversifying Differential Evolution for Dynamic Optimisation. Dynamic optimisation occurs in a variety of real world problems. To tackle these problems, evolutionary algorithms have been extensively used due to their effectiveness and minimum design effort. However, for dynamic problems, extra mechanisms are required on top of standard evolutionary algorithms. Among them, diversity mechanisms have proven to be competitive in handling dynamism, and recently, the use of neural networks have become popular for this purpose. Considering the complexity of using neural networks in the process compared to simple diversity mechanisms, we investigate whether they are competitive and the possibility of integrating them to improve the results. However, for a fair comparison, we need to consider the same time budget for each algorithm. Thus, instead of the usual number of fitness evaluations as the measure for the available time between changes, we use wall clock timing. The results show the significance of the improvement when integrating the neural network and diversity mechanisms depends on the type and the frequency of changes. Moreover, we observe that for differential evolution, having a proper diversity in population when using neural networks plays a key role in the neural network's ability to improve the results.


Energy balance for the incompressible Euler equations with stochastic forcing. We establish energy balance for weak solutions of the stochastically forced incompressible Euler equations, enjoying H "older regularity C alpha , alpha 1 3 . It is well known as the Onsager's conjecture for the deterministic incompressible Euler equations, which describes the energy conservation of weak solutions having H "older regularity C alpha , alpha 1 3 . Additionally, we obtain energy balance for the inhomogeneous incompressible Euler system driven by a cylindrical Wiener process.


VAIS Hate Speech Detection System A Deep Learning based Approach for System Combination. Nowadays, Social network sites (SNSs) such as Facebook, Twitter are common places where people show their opinions, sentiments and share information with others. However, some people use SNSs to post abuse and harassment threats in order to prevent other SNSs users from expressing themselves as well as seeking different opinions. To deal with this problem, SNSs have to use a lot of resources including people to clean the aforementioned content. In this paper, we propose a supervised learning model based on the ensemble method to solve the problem of detecting hate content on SNSs in order to make conversations on SNSs more effective. Our proposed model got the first place for public dashboard with 0.730 F1 macro score and the third place with 0.584 F1 macro score for private dashboard at the sixth international workshop on Vietnamese Language and Speech Processing 2019.


Deep Learning Brasil NLP at SemEval 2020 Task 9 Overview of Sentiment Analysis of Code Mixed Tweets. In this paper, we describe a methodology to predict sentiment in code mixed tweets (hindi english). Our team called verissimo.manoel in CodaLab developed an approach based on an ensemble of four models (MultiFiT, BERT, ALBERT, and XLNET). The final classification algorithm was an ensemble of some predictions of all softmax values from these four models. This architecture was used and evaluated in the context of the SemEval 2020 challenge (task 9), and our system got 72.7 on the F1 score.


Zeros of a table of polynomials satisfying a four term contiguous relation. For any A(z),B(z),C(z) in mathbb C z , we study the zero distribution of a table of polynomials left P m,n (z) right m,n in mathbb N 0 satisfying the recurrence relation P m,n (z) A(z)P m 1,n (z) B(z)P m,n 1 (z) C(z)P m 1,n 1 (z) with the initial condition P 0,0 (z) 1 and P m, n (z) 0 forall m,n in mathbb N . We show that the zeros of P m,n (z) lie on a curve whose equation is given explicitly in terms of A(z),B(z) , and C(z) . We also study the zero distribution of a case with a general initial condition.


Graded persistence diagrams and persistence landscapes. We introduce a refinement of the persistence diagram, the graded persistence diagram. It is the Mobius inversion of the graded rank function, which is obtained from the rank function using the unary numeral system. Both persistence diagrams and graded persistence diagrams are integer valued functions on the Cartesian plane. Whereas the persistence diagram takes non negative values, the graded persistence diagram takes values of 0, 1, or 1. The sum of the graded persistence diagrams is the persistence diagram. We show that the positive and negative points in the k th graded persistence diagram correspond to the local maxima and minima, respectively, of the k th persistence landscape. We prove a stability theorem for graded persistence diagrams the 1 Wasserstein distance between k th graded persistence diagrams is bounded by twice the 1 Wasserstein distance between the corresponding persistence diagrams, and this bound is attained. In the other direction, the 1 Wasserstein distance is a lower bound for the sum of the 1 Wasserstein distances between the k th graded persistence diagrams. In fact, the 1 Wasserstein distance for graded persistence diagrams is more discriminative than the 1 Wasserstein distance for the corresponding persistence diagrams.


Existence analysis of a stationary compressible fluid model for heat conducting and chemically reacting mixtures. The existence of large data weak solutions to a steady compressible Navier Stokes Fourier system for chemically reacting fluid mixtures is proved. General free energies are considered satisfying some structural assumptions, with a pressure containing a gamma power law. The model is thermodynamically consistent and contains the Maxwell Stefan cross diffusion equations in the Fick Onsager form as a special case. Compared to previous works, a very general model class is analyzed, including cross diffusion effects, temperature gradients, compressible fluids, and different molar masses. A priori estimates are derived from the entropy balance and the total energy balance. The compactness for the total mass density follows from an estimate for the pressure in L p with p 1 , the effective viscous flux identity, and uniform bounds related to Feireisl's oscillations defect measure. These bounds rely heavily on the convexity of the free energy and the strong convergence of the relative chemical potentials.


Mobile Cloud Computing in Healthcare Using Dynamic Cloudlets for Energy Aware Consumption. Mobile cloud computing (MCC) has increasingly been adopted in healthcare industry by healthcare professionals (HCPs) which has resulted in the growth of medical software applications for these platforms. There are different applications which help HCPs with many important tasks. Mobile cloud computing has helped HCPs in better decision making and improved patient care. MCC enables users to acquire the benefit of cloud computing services to meet the healthcare demands. However, the restrictions posed by network bandwidth and mobile device capacity has brought challenges with respect to energy consumption and latency delays. In this paper we propose dynamic energy consumption mobile cloud computing model (DEMCCM) which addresses the energy consumption issue by healthcare mobile devices using dynamic cloudlets.


Rethinking 3D LiDAR Point Cloud Segmentation. Many point based semantic segmentation methods have been designed for indoor scenarios, but they struggle if they are applied to point clouds that are captured by a LiDAR sensor in an outdoor environment. In order to make these methods more efficient and robust such that they can handle LiDAR data, we introduce the general concept of reformulating 3D point based operations such that they can operate in the projection space. While we show by means of three point based methods that the reformulated versions are between 300 and 400 times faster and achieve a higher accuracy, we furthermore demonstrate that the concept of reformulating 3D point based operations allows to design new architectures that unify the benefits of point based and image based methods. As an example, we introduce a network that integrates reformulated 3D point based operations into a 2D encoder decoder architecture that fuses the information from different 2D scales. We evaluate the approach on four challenging datasets for semantic LiDAR point cloud segmentation and show that leveraging reformulated 3D point based operations with 2D image based operations achieves very good results for all four datasets.


Triangles in randomly perturbed graphs. We study the problem of finding pairwise vertex disjoint triangles in the randomly perturbed graph model, which is the union of any n vertex graph G with linear minimum degree and the binomial random graph G(n,p) . We prove that asymptotically almost surely G cup G(n,p) contains min delta(G), lfloor n 3 rfloor pairwise vertex disjoint triangles, provided p ge C log n n , where C is a large enough constant. This is a perturbed version of an old result of Dirac. Our result is asymptotically optimal and answers a question of Han, Morris, and Treglown RSA, to appear in the case of triangle factors. Together with a result of Balogh, Treglown, and Wagner CPC, 2019, no. 2, 159 176 this fully resolves the existence of triangle factors in randomly perturbed graphs. We also prove a stability version of our result. Finally, we discuss further generalisations to larger clique factors, larger cycle factors, and 2 universality.


Efficient EUD Parsing. We present the system submission from the FASTPARSE team for the EUD Shared Task at IWPT 2020. We engaged with the task by focusing on efficiency. For this we considered training costs and inference efficiency. Our models are a combination of distilled neural dependency parsers and a rule based system that projects UD trees into EUD graphs. We obtained an average ELAS of 74.04 for our official submission, ranking 4th overall.


scGNN scRNA seq Dropout Imputation via Induced Hierarchical Cell Similarity Graph. Single cell RNA sequencing provides tremendous insights to understand biological systems. However, the noise from dropout can corrupt the downstream biological analysis. Hence, it is desirable to impute the dropouts accurately. In this work, we propose a simple and powerful dropout imputation method (scGNN) by applying a bottlenecked Graph Convolutional Neural Network on an induced hierarchical cell similarity graph. We show scGNN has competitive performance against state of the art baselines across three datasets and can improve downstream analysis.


Stochastic reaction networks in dynamic compartment populations. Compartmentalization of biochemical processes underlies all biological systems, from the organelle to the tissue scale. Theoretical models to study the interplay between noisy reaction dynamics and compartmentalization are sparse, and typically very challenging to analyze computationally. Recent studies have made progress towards addressing this problem in the context of concrete biological systems but general approaches remain lacking. In this work we propose a mathematical framework based on counting processes that allows us to study compartment populations with arbitrary interactions and internal biochemistry. We provide an efficient description of the population dynamics in terms of differential equations which capture moments of the population and their variability. We demonstrate the relevance of our approach using several case studies inspired by biological systems at different scales.


Gradient waveform design for tensor valued encoding in diffusion MRI. Diffusion encoding along multiple spatial directions per signal acquisition can be described in terms of a b tensor. The benefit of tensor valued diffusion encoding is that it unlocks the "shape of the b tensor" as a new encoding dimension. By modulating the b tensor shape, we can control the sensitivity to microscopic diffusion anisotropy which can be used as a contrast mechanism a feature that is inaccessible by conventional diffusion encoding. Since imaging methods based on tensor valued diffusion encoding are finding an increasing number of applications we are prompted to highlight the challenge of designing the optimal gradient waveforms for any given application. In this review, we first establish the basic design objectives in creating field gradient waveforms for tensor valued diffusion MRI. We also survey additional design considerations related to limitations imposed by hardware and physiology, potential confounding effects that cannot be captured by the b tensor, and artifacts related to the diffusion encoding waveform. Throughout, we discuss the expected compromises and tradeoffs with an aim to establish a more complete understanding of gradient waveform design and its impact on accurate measurements and interpretations of data.


Alpha Discovery Neural Network based on Prior Knowledge. Genetic programming (GP) is the state of the art in financial automated feature construction task. It employs reverse polish expression to represent features and then conducts the evolution process. However, with the development of deep learning, more powerful feature extraction tools are available. This paper proposes Alpha Discovery Neural Network (ADNN), a tailored neural network structure which can automatically construct diversified financial technical indicators based on prior knowledge. We mainly made three contributions. First, we use domain knowledge in quantitative trading to design the sampling rules and object function. Second, pre training and model pruning has been used to replace genetic programming, because it can conduct more efficient evolution process. Third, the feature extractors in ADNN can be replaced by different feature extractors and produce different functions. The experiment results show that ADNN can construct more informative and diversified features than GP, which can effectively enriches the current factor pool. The fully connected network and recurrent network are better at extracting information from the financial time series than the convolution neural network. In real practice, features constructed by ADNN can always improve multi factor strategies' revenue, sharpe ratio, and max draw down, compared with the investment strategies without these factors.


On the decomposition theorem for intersection de Rham complexes. We establish a positive characteristic analogue of intersection cohomology for polarized variations of Hodge structure. This includes a) the decomposition theorem for the intersection de Rham complex b) the E 1 degeneration theorem for the intersection de Rham complex of a periodic de Rham bundle c) the Kodaira vanishing theorem for the intersection cohomology groups of a periodic Higgs bundle.


Alexander's Wholeness as the Scientific Foundation of Sustainable Urban Design and Planning. As Christopher Alexander conceived and defined through his life's work The Nature of Order wholeness is a recursive structure that recurs in space and matter and is reflected in human minds and cognition. Based on the definition of wholeness, a mathematical model of wholeness, together with its topological representation, has been developed, and it is able to address not only why a structure is beautiful, but also how much beauty the structure has. Given the circumstance, this paper is attempted to argue for the wholeness as the scientific foundation of sustainable urban design and planning, with the help of the mathematical model and topological representation. We start by introducing the wholeness as a mathematical structure of physical space that pervasively exists in our surroundings, along with two fundamental laws scaling law and Tobler's law that underlie the 15 properties for characterizing and making living structures. We argue that urban design and planning can be considered to be wholeness extending processes, guided by two design principles of differentiation and adaptation, to transform a space in a piecemeal fashion into a living or more living structure. We further discuss several other urban design theories and how they can be justified by and placed within the theory of wholeness. With the wholeness as the scientific foundation, urban design can turn into a rigorous science with creation of living structures as the primary aim. Keywords Beauty, life, scaling law, adaptation, differentiation, and organic world view


Competition Between Intermodal Modulation Instability and Kerr Beam Self cleaning in Graded index Multimode Fiber. We report the suppression of intermodal modulation instability peaks as a consequence of Kerr induced self beam cleaning in a 90m long graded index multimode optical fiber under various specific launching conditions. The output spectrum and the modal beam profiles for three modes (LP01, LP11, and LP21) have been recorded for several values of pump pulse energy. Experimental findings establish that the nonlinear coupling among the guided modes leads to reshaping the output speckle pattern into a bell shape or higher order spatially clean beam profile as the pump peak power increases, whereas in spectral domain intermodal modulation instability peaks are observed whose amplitude increases gradually to its maximum value and beyond certain threshold power, the intermodal modulation instability peaks diminish. This suggests the possibility to generate intermodal modulation instability free broadband spectra at high pump peak powers.


Parametric Amplification of Broadband Vibrational Energy Harvesters for Energy Autonomous Sensors Enabled by Field Induced Striction. We investigate the influence of parametric excitation on MEMS vibration energy harvesters for energy autonomous sensor systems. In Industry 4.0 (or Industrial IoT) applications, interconnected sensors provide a means of data acquisition for automated control of the manufacturing process. Ensuring a continuous energy supply to the sensors is essential for their reliable operation. Manufacturing machines usually display a wide spectrum of vibration frequencies which needs to be covered by an array of harvester substructures in order to maintain the desired output level. We show that mechanical structures designed to implement a Helmholtz Duffing oscillator have an increased bandwidth by exploiting several orders of parametric resonances. In contrast to concepts implementing parametric amplification in a multi mode scenario, our concept is based on a single mechanical mode. Therefore, it is more robust against fabrication tolerances as the relevant multi mode resonance conditions do not need to be matched on the level of single chips. Using exact transient simulations and semi analytic models to showcase the relation of the Helmholtz Duffing oscillator to the damped and driven Mathieu equation, we show that parametric resonances highly increase the bandwidth of the output power whenever high Helmholtz nonlinearities are present. To achieve the required nonlinearities, we suggest nonlinear stress strain curves and we propose to achieve such nonlinearities through field induced striction by magneto or electrostriction. Thus, we are able to propose a novel energy harvester concept incorporating strictive materials that exploits the effects of parametric excitation to achieve broadband vibrational energy harvesting.


A Maturity Assessment Framework for Conversational AI Development Platforms. Conversational Artificial Intelligence (AI) systems have recently sky rocketed in popularity and are now used in many applications, from car assistants to customer support. The development of conversational AI systems is supported by a large variety of software platforms, all with similar goals, but different focus points and functionalities. A systematic foundation for classifying conversational AI platforms is currently lacking. We propose a framework for assessing the maturity level of conversational AI development platforms. Our framework is based on a systematic literature review, in which we extracted common and distinguishing features of various open source and commercial (or in house) platforms. Inspired by language reference frameworks, we identify different maturity levels that a conversational AI development platform may exhibit in understanding and responding to user inputs. Our framework can guide organizations in selecting a conversational AI development platform according to their needs, as well as helping researchers and platform developers improving the maturity of their platforms.


On the threshold of spread out contact process percolation. We study the stationary distribution of the (spread out) d dimensional contact process from the point of view of site percolation. In this process, vertices of mathbb Z d can be healthy (state 0) or infected (state 1). With rate one infected sites recover, and with rate lambda they transmit the infection to some other vertex chosen uniformly within a ball of radius R . The classical phase transition result for this process states that there is a critical value lambda c(R) such that the process has a non trivial stationary distribution if and only if lambda lambda c(R) . In configurations sampled from this stationary distribution, we study nearest neighbor site percolation of the set of infected sites the associated percolation threshold is denoted lambda p(R) . We prove that lambda p(R) converges to 1 (1 p c) as R tends to infinity, where p c is the threshold for Bernoulli site percolation on mathbb Z d . As a consequence, we prove that lambda p(R) lambda c(R) for large enough R , answering an open question of Liggett and Steif in the spread out case.


Conversational Response Re ranking Based on Event Causality and Role Factored Tensor Event Embedding. We propose a novel method for selecting coherent and diverse responses for a given dialogue context. The proposed method re ranks response candidates generated from conversational models by using event causality relations between events in a dialogue history and response candidates (e.g., be stressed out'' precedes relieve stress''). We use distributed event representation based on the Role Factored Tensor Model for a robust matching of event causality relations due to limited event causality knowledge of the system. Experimental results showed that the proposed method improved coherency and dialogue continuity of system responses.


Detecting Affective Flow States of Knowledge Workers Using Physiological Sensors. Flow like experiences at work are important for productivity and worker well being. However, it is difficult to objectively detect when workers are experiencing flow in their work. In this paper, we investigate how to predict a worker's focus state based on physiological signals. We conducted a lab study to collect physiological data from knowledge workers experienced different levels of flow while performing work tasks. We used the nine characteristics of flow to design tasks that would induce different focus states. A manipulation check using the Flow Short Scale verified that participants experienced three distinct flow states, one overly challenging non flow state, and two types of flow states, balanced flow, and automatic flow. We built machine learning classifiers that can distinguish between non flow and flow states with 0.889 average AUC and rest states from working states with 0.98 average AUC. The results show that physiological sensing can detect focused flow states of knowledge workers and can enable ways to for individuals and organizations to improve both productivity and worker satisfaction.