Optimal Control for a Nonlinear Stochastic Parabolic Model of Language Competition. In this investigation, an optimal control problem for a stochastic mathematical model of language competition is studied. We have considered the stochastic model of language competition by adding the stochastic terms to the deterministic model to take into account the random perturbations and uncertainties caused by the environment to have more reliable model. The model has formulated the population densities of the speakers of two languages, which are competing against each other to be saved from destruction, attract more speakers and so on, using two nonlinear stochastic parabolic equations. Four factors including the status of the languages and the growth rates of the populations are considered as the control variables (which can be controlled by the speakers of the populations or policy makers who make decisions for the populations for particular purposes) to control the evolution of the population densities. Then, the optimal control problem for the stochastic model of language competition is studied. Employing the tangent normal cone techniques, the Ekeland variational principle and other theorems proved throughout the paper, we have shown there exists unique stochastic optimal control. We have also presented the exact form of the optimal control in terms of stochastic adjoint states.


On a coupled time dependent SIR models fitting with New York and New Jersey states COVID 19 data. This article describes a simple Susceptible Infected Recovered (SIR) model fitting with COVID 19 data for the month of march 2020 in New York (NY) state. The model is a classical SIR, but is non autonomous the rate of susceptible people becoming infected is adjusted over time in order to fit the available data. The death rate is also secondarily adjusted. Our fitting is made under the assumption that due to limiting number of tests, a large part of the infected population has not been tested positive. In the last part, we extend the model to take into account the daily fluxes between New Jersey (NJ) and NY states and fit the data for both states. Our simple model fits the available data, and illustrates typical dynamics of the disease exponential increase, apex and decrease. The model highlights a decrease in the transmission rate over the period which gives a quantitative illustration about how lockdown policies reduce the spread of the pandemic. The coupled model with NY and NJ states shows a wave in NJ following the NY wave, illustrating the mechanism of spread from one attractive hot spot to its neighbor.


The isomorphism types of parabolic subgroups in Kac Moody groups. In this paper we discuss the isomorphism types of parabolic subgroups in Kac Moody groups. The results have applications in the study of topology of Kac Moody groups and their classifying spaces.


Phase retrieval by random binary questions Which complementary subspace is closer?. Phase retrieval in real or complex Hilbert spaces is the task of recovering a vector, up to an overall unimodular multiplicative constant, from magnitudes of linear measurements. In this paper, we assume that the vector is normalized, but retain only qualitative, binary information about the measured magnitudes by comparing them with a threshold. In more specific, geometric terms, we choose a sequence of subspaces in a real or complex Hilbert space and only record whether a given vector is closer to the subspace than to the complementary subspace. The subspaces have half the dimension of the Hilbert space and are independent, uniformly distributed with respect to the action of the orthogonal or unitary groups. The main goal of this paper is to find a feasible algorithm for approximate recovery based on the information gained about the vector from these binary questions and to establish error bounds for its approximate recovery. We provide a pointwise bound for fixed input vectors and a uniform bound that controls the worst case scenario among all inputs. Both bounds hold with high probability with respect to the choice of the subspaces. For real or complex vectors of dimension n , the pointwise bound requires m ge C delta 2 n log(n) and the uniform bound m ge C delta 2 n 2 log( delta 1 n) binary questions in order to achieve an accuracy of delta . The accuracy delta is measured by the operator norm of the difference between the rank one orthogonal projections corresponding to the normalized input vector and its approximate recovery.


On a Generalization of Strongly eta Convex Functions via Fractal Sets. The purpose of this paper is to study a generalization of strongly eta convex functions using the fractal calculus developed by Yang cite Yang , namely generalized strongly eta convex function. Among other results, we obtain some Hermite Hadamard and Fej 'er type inequalities for this class of functions.


An adjacent Hindman theorem for uncountable groups. Results of Hindman, Leader and Strauss and of the second author and Rinot showed that some natural analogs of Hindman's theorem fail for all uncountable cardinals. Results in the positive direction were obtained by Komj 'ath, the first author, and the second author and Lee, who showed that there are arbitrarily large abelian groups satisfying some Hindman type property. Inspired by an analog result studied by the first author in the countable setting, in this note we prove a new variant of Hindman's theorem for uncountable cardinals, called Adjacent Hindman Theorem For every kappa there is a lambda such that whenever a group G of cardinality lambda is coloured in kappa colours there exists a lambda sized injective sequence of elements of G such that all the finite products of adjacent terms of the sequence have the same colour. We prove optimal bounds on lambda as a function of kappa . This is the first example of a Hindman type result for uncountable cardinals that holds also in the non abelian setting and, furthermore, it is also the first such example where monochromatic products (or sums) of arbitrary length are guaranteed.


The Moore Complex of a Simplicial Cocommutative Hopf Algebra. We study the Moore complex of a simplicial cocommutative Hopf algebra through Hopf kernels. The most striking result to emerge from this construction is the coherent definition of 2 crossed modules of cocommutative Hopf algebras. This unifies the 2 crossed module theory of groups and of Lie algebras when we take the group like and primitive functors into consideration.


Evolutionary Algorithms and Efficient Data Analytics for Image Processing. Steganography algorithms facilitate communication between a source and a destination in a secret manner. This is done by embedding messages text data into images without impacting the appearance of the resultant images videos. Steganalysis is the science of determining if an image has secret messages embedded hidden in it. Because there are numerous steganography algorithms, and since each one of them requires a different type of steganalysis, the steganalysis process is extremely challenging. Thus, researchers aim to develop one universal steganalysis to detect all known and unknown steganography algorithms, ideally in real time. Universal steganalysis extracts a large number of features to distinguish stego images from cover images. However, the increase in features leads to the problem of the curse of dimensionality (CoD), which is considered to be an NP hard problem. This COD problem additionally makes real time steganalysis hard. A large number of features generates large datasets for which machine learning cannot generate an optimal model. Generating a machine learning based model also takes a long time which makes real time processing appear impossible in any optimization for time intensive fields such as visual computing. Possible solutions for CoD are deep learning and evolutionary algorithms that overcome the machine learning limitations. In this study, we investigate previously developed evolutionary algorithms for boosting real time image processing and argue that they provide the most promising solutions for the CoD problem.


Interaction of near inertial waves with an anticyclonic vortex. Anticyclonic vortices focus and trap near inertial waves so that near inertial energy levels are elevated within the vortex core. Some aspects of this process, including the nonlinear modification of the vortex by the wave, are explained by the existence of trapped near inertial eigenmodes. These vortex eigenmodes are easily excited by an initial wave with horizontal scale much larger than that of the vortex radius. We study this process using a wave averaged model of near inertial dynamics and compare its theoretical predictions with numerical solutions of the three dimensional Boussinesq equations. In the linear approximation, the model predicts the eigenmode frequencies and spatial structures, and a near inertial wave energy signature that is characterized by an approximately time periodic, azimuthally invariant pattern. The wave averaged model represents the nonlinear feedback of the waves on the vortex via a wave induced contribution to the potential vorticity that is proportional to the Laplacian of the kinetic energy density of the waves. When this is taken into account, the modal frequency is predicted to increase linearly with the energy of the initial excitation. Both linear and nonlinear predictions agree convincingly with the Boussinesq results.


Reward Machines for Cooperative Multi Agent Reinforcement Learning. In cooperative multi agent reinforcement learning, a collection of agents learns to interact in a shared environment to achieve a common goal. We propose the use of reward machines (RM) Mealy machines used as structured representations of reward functions to encode the team's task. The proposed novel interpretation of RMs in the multi agent setting explicitly encodes required teammate interdependencies, allowing the team level task to be decomposed into sub tasks for individual agents. We define such a notion of RM decomposition and present algorithmically verifiable conditions guaranteeing that distributed completion of the sub tasks leads to team behavior accomplishing the original task. This framework for task decomposition provides a natural approach to decentralized learning agents may learn to accomplish their sub tasks while observing only their local state and abstracted representations of their teammates. We accordingly propose a decentralized q learning algorithm. Furthermore, in the case of undiscounted rewards, we use local value functions to derive lower and upper bounds for the global value function corresponding to the team task. Experimental results in three discrete settings exemplify the effectiveness of the proposed RM decomposition approach, which converges to a successful team policy an order of magnitude faster than a centralized learner and significantly outperforms hierarchical and independent q learning approaches.


Exploring the Design Space of Static and Incremental Graph Connectivity Algorithms on GPUs. Connected components and spanning forest are fundamental graph algorithms due to their use in many important applications, such as graph clustering and image segmentation. GPUs are an ideal platform for graph algorithms due to their high peak performance and memory bandwidth. While there exist several GPU connectivity algorithms in the literature, many design choices have not yet been explored. In this paper, we explore various design choices in GPU connectivity algorithms, including sampling, linking, and tree compression, for both the static as well as the incremental setting. Our various design choices lead to over 300 new GPU implementations of connectivity, many of which outperform state of the art. We present an experimental evaluation, and show that we achieve an average speedup of 2.47x speedup over existing static algorithms. In the incremental setting, we achieve a throughput of up to 48.23 billion edges per second. Compared to state of the art CPU implementations on a 72 core machine, we achieve a speedup of 8.26 14.51x for static connectivity and 1.85 13.36x for incremental connectivity using a Tesla V100 GPU.


A Review of Reduced Order Models for Microgrids Simplifications vs Accuracy. Inverter based microgrids are an important technology for sustainable electrical power systems and typically use droop controlled grid forming inverters to interface distributed energy resources to the network and control the voltage and frequency. Ensuring stability of such microgrids is a key issue, which requires the use of appropriate models for analysis and control system design. Full order detailed models can be more difficult to analyze and increase computational complexity, hence a number of reduced order models have been proposed in the literature which present various trade offs between accuracy and complexity. However, these simplifications present the risk of failing to adequately capture important dynamics of the microgrid. Therefore, there is a need for a comprehensive review and assessment of their relative quality, which is something that has not been systematically carried out thus far in the literature and we aim to address in this paper. In particular, we review various inverter based microgrid reduced order models and investigate the accuracy of their predictions for stability via a comparison with a corresponding detailed average model. Our study shows that the simplifications reduced order models rely upon can affect their accuracy in various regimes of the line R X ratios, and that inappropriate model choices can result in substantially inaccurate stability results. Finally, we present recommendations on the use of reduced order models for the stability analysis of microgrids.


Rewriting Meaningful Sentences via Conditional BERT Sampling and an application on fooling text classifiers. Most adversarial attack methods that are designed to deceive a text classifier change the text classifier's prediction by modifying a few words or characters. Few try to attack classifiers by rewriting a whole sentence, due to the difficulties inherent in sentence level rephrasing as well as the problem of setting the criteria for legitimate rewriting. In this paper, we explore the problem of creating adversarial examples with sentence level rewriting. We design a new sampling method, named ParaphraseSampler, to efficiently rewrite the original sentence in multiple ways. Then we propose a new criteria for modification, called a sentence level threaten model. This criteria allows for both word and sentence level changes, and can be adjusted independently in two dimensions semantic similarity and grammatical quality. Experimental results show that many of these rewritten sentences are misclassified by the classifier. On all 6 datasets, our ParaphraseSampler achieves a better attack success rate than our baseline.


Strategy Stealing in Triangle Avoidance Games. In the game of n Sim , two players take it in turn to claim unclaimed edges from a complete graph on n vertices, with the first person to create a triangle in his own edges being the loser. We present some strategy stealing arguments that show that certain positions are wins for the second player. These are among the only strategy stealing arguments that are known for mis ere games.


Looking Fast and Slow Memory Guided Mobile Video Object Detection. With a single eye fixation lasting a fraction of a second, the human visual system is capable of forming a rich representation of a complex environment, reaching a holistic understanding which facilitates object recognition and detection. This phenomenon is known as recognizing the "gist" of the scene and is accomplished by relying on relevant prior knowledge. This paper addresses the analogous question of whether using memory in computer vision systems can not only improve the accuracy of object detection in video streams, but also reduce the computation time. By interleaving conventional feature extractors with extremely lightweight ones which only need to recognize the gist of the scene, we show that minimal computation is required to produce accurate detections when temporal memory is present. In addition, we show that the memory contains enough information for deploying reinforcement learning algorithms to learn an adaptive inference policy. Our model achieves state of the art performance among mobile methods on the Imagenet VID 2015 dataset, while running at speeds of up to 70 FPS on a Pixel 3 phone.


An extended Flaherty Keller formula for an elastic composite with densely packed convex inclusions. In this paper, we are concerned with the effective elastic property of a two phase high contrast periodic composite with densely packed inclusions. The equations of linear elasticity are assumed. We first give a novel proof of the Flaherty Keller formula for elliptic inclusions, which improves a recent result of Kang and Yu (Calc.Var.Partial Differential Equations, 2020). We construct an auxiliary function consisting of the Keller function and an additional corrected function depending on the coefficients of Lam 'e system and the geometry of inclusions, to capture the full singular term of the gradient. On the other hand, this method allows us to deal with the inclusions of arbitrary shape, even with zero curvature. An extended Flaherty Keller formula is proved for m convex inclusions, m 2, curvilinear squares with round off angles, which minimize the elastic modulus under the same volume fraction of hard inclusions.


A New Solution to the Rhoades' Open Problem with an Application. We give a new solution to the Rhoades' open problem on the discontinuity at fixed point via the notion of an S metric. To do this, we inspire with the notion of a Zamfirescu mapping. Also, we consider a recent problem called the "fixed circle problem" and propose a new solution to this problem as an application of our technique.


Crossed chiral band approximation for wideband self collimation of light. We propose a perspective to the evaluation of the wide bandwidth phenomenon, by introducing the band tailoring and chiral band approximation on the self collimation effect for low symmetric photonic structures. In the case of the crossing of the bands, we claim the excitation of the lower mode can provide the utilization of the entire bandwidth by suppressing the intersection regions where the frequencies tend to mix. Thereby, we design broadband self collimation capable, defect free photonic structures and examine their performances. A fractional bandwidth of 0.35 ( a backslash lambda 0.429 0.607 ) and 0.37 ( a backslash lambda 0.481 0.701 ) are achieved for radii of r 0.25 a and r 0.23 a , respectively. We explore the full range collimation using transmission and E field intensity analysis in addition to band diagrams and group velocity dispersions. Moreover, we indicate all angle collimation validity even for highly tilted sources up to an angle of 80 circ .


Boundedness in a chemotaxis system with consumed chemoattractant and produced chemorepellent. We study this zero flux attraction repulsion chemotaxis model, with linear and superlinear production g for the chemorepellent and sublinear rate f for the chemoattractant begin equation label problem abstract tag Diamond begin cases u t Delta u chi nabla cdot (u nabla v) xi nabla cdot (u nabla w) text in Omega times (0,T max ), v t Delta v f(u)v text in Omega times (0,T max ), 0 Delta w delta w g(u) text in Omega times (0,T max ). u(x,0) u 0(x), v(x,0) v 0(x) x in bar Omega. end cases end equation In this problem, Omega is a bounded and smooth domain of R n , for n geq 1 , chi, xi, delta 0 , f(u) and g(u) reasonably regular functions generalizing the prototypes f(u) K u alpha and g(u) gamma u l , with K, gamma 0 and proper alpha, l 0 . Once it is indicated that any sufficiently smooth u(x,0) u 0(x) geq 0 and v(x,0) v 0(x) geq 0 produce a unique classical and nonnegative solution (u,v,w) to eqref problem abstract , which is defined in Omega times (0,T max ) , we establish that for any such (u 0,v 0) , the life span TM infty and u, v and w are uniformly bounded in Omega times (0, infty) , (i) for l 1 , n in 1,2 , alpha in (0, frac 1 2 frac 1 n ) cap (0,1) and any xi 0 , (ii) for l 1 , n geq 3 , alpha in (0, frac 1 2 frac 1 n ) and xi larger than a quantity depending on chi lVert v 0 rVert L infty( Omega) , (iii) for l 1 any xi 0 , and in any dimensional settings. Finally, an indicative analysis about the effect by logistic and repulsive actions on chemotactic phenomena is proposed by comparing the results herein derived for the linear production case with those in cite LankeitWangConsumptLogistic .


Sparse identification of multiphase turbulence closures for coupled fluid particle flows. In this work, model closures of the multiphase Reynolds Average Navier Stokes (RANS) equations are developed for homogeneous, fully developed gas particle flows. To date, the majority of RANS closures are based on extensions of single phase turbulence models, which fail to capture complex two phase flow dynamics across dilute and dense regimes, especially when two way coupling between the phases is important. In the present study, particles settle under gravity in an unbounded viscous fluid. At sufficient mass loadings, interphase momentum exchange between the phases results in the spontaneous generation of particle clusters that sustain velocity fluctuations in the fluid. Data generated from Eulerian Lagrangian simulations are used in a sparse regression method for model closure that ensures form invariance. Particular attention is paid to modelling the unclosed terms unique to the multiphase RANS equations (drag production, drag exchange, pressure strain and viscous dissipation). A minimal set of tensors is presented that serve as the basis for modelling. It is found that sparse regression identifies compact, algebraic models that are accurate across flow conditions and robust to sparse training data.


Balsam Automated Scheduling and Execution of Dynamic, Data Intensive HPC Workflows. We introduce the Balsam service to manage high throughput task scheduling and execution on supercomputing systems. Balsam allows users to populate a task database with a variety of tasks ranging from simple independent tasks to dynamic multi task workflows. With abstractions for the local resource scheduler and MPI environment, Balsam dynamically packages tasks into ensemble jobs and manages their scheduling lifecycle. The ensembles execute in a pilot "launcher" which (i) ensures concurrent, load balanced execution of arbitrary serial and parallel programs with heterogeneous processor requirements, (ii) requires no modification of user applications, (iii) is tolerant of task level faults and provides several options for error recovery, (iv) stores provenance data (e.g task history, error logs) in the database, (v) supports dynamic workflows, in which tasks are created or killed at runtime. Here, we present the design and Python implementation of the Balsam service and launcher. The efficacy of this system is illustrated using two case studies hyperparameter optimization of deep neural networks, and high throughput single point quantum chemistry calculations. We find that the unique combination of flexible job packing and automated scheduling with dynamic (pilot managed) execution facilitates excellent resource utilization. The scripting overheads typically needed to manage resources and launch workflows on supercomputers are substantially reduced, accelerating workflow development and execution.


Sybil proof Answer Querying Mechanism. We study a question answering problem on a social network, where a requester is seeking an answer from the agents on the network. The goal is to design reward mechanisms to incentivize the agents to propagate the requester's query to their neighbours if they don't have the answer. Existing mechanisms are vulnerable to Sybil attacks, i.e., an agent may get more reward by creating fake identities. Hence, we combat this problem by first proving some impossibility results to resolve Sybil attacks and then characterizing a class of mechanisms which satisfy Sybil proofness (prevents Sybil attacks) as well as other desirable properties. Except for Sybil proofness, we also consider cost minimization for the requester and agents' collusions.


Assessing Refugees' Integration via Spatio temporal Similarities of Mobility and Calling Behaviors. In Turkey the increasing tension, due to the presence of 3.4 million Syrian refugees, demands the formulation of effective integration policies. Moreover, their design requires tools aimed at understanding the integration of refugees despite the complexity of this phenomenon. In this work, we propose a set of metrics aimed at providing insights and assessing the integration of Syrians refugees, by analyzing a real world Call Details Records (CDRs) dataset including calls from refugees and locals in Turkey throughout 2017. Specifically, we exploit the similarity between refugees' and locals' spatial and temporal behaviors, in terms of communication and mobility in order to assess integration dynamics. Together with the already known methods for data analysis, we use a novel computational approach to analyze spatiotemporal patterns Computational Stigmergy, a bio inspired scalar and temporal aggregation of samples. Computational Stigmergy associates each sample to a virtual pheromone deposit (mark). Marks in spatiotemporal proximity are aggregated into functional structures called trails, which summarize the spatiotemporal patterns in data and allows computing the similarity between different patterns. According to our results, collective mobility and behavioral similarity with locals have great potential as measures of integration, since they are (i) correlated with the amount of interaction with locals (ii) an effective proxy for refugee's economic capacity, thus refugee's potential employment and (iii) able to capture events that may disrupt the integration phenomena, such as social tensions.


MEBOW Monocular Estimation of Body Orientation In the Wild. Body orientation estimation provides crucial visual cues in many applications, including robotics and autonomous driving. It is particularly desirable when 3 D pose estimation is difficult to infer due to poor image resolution, occlusion or indistinguishable body parts. We present COCO MEBOW (Monocular Estimation of Body Orientation in the Wild), a new large scale dataset for orientation estimation from a single in the wild image. The body orientation labels for around 130K human bodies within 55K images from the COCO dataset have been collected using an efficient and high precision annotation pipeline. We also validated the benefits of the dataset. First, we show that our dataset can substantially improve the performance and the robustness of a human body orientation estimation model, the development of which was previously limited by the scale and diversity of the available training data. Additionally, we present a novel triple source solution for 3 D human pose estimation, where 3 D pose labels, 2 D pose labels, and our body orientation labels are all used in joint training. Our model significantly outperforms state of the art dual source solutions for monocular 3 D human pose estimation, where training only uses 3 D pose labels and 2 D pose labels. This substantiates an important advantage of MEBOW for 3 D human pose estimation, which is particularly appealing because the per instance labeling cost for body orientations is far less than that for 3 D poses. The work demonstrates high potential of MEBOW in addressing real world challenges involving understanding human behaviors. Further information of this work is available at https chenyanwu.github.io MEBOW .


The human behavioural immune system is a product of cultural evolution. Disgust is a basic emotion that serves to avoid contaminants, and is central to the behavioural immune system. While disgust motivated avoidance occurs in bonobos and chimpanzees, humans show uniquely high levels of contamination sensitivity. Current theory postulates that human disgust is primarily a genetic adaptation, side lining social transmission and denying parental modelling. Here, we test whether this strong view is warranted by simulating 100000 years of cultural and biological evolution in various scenarios. We modelled disgust as a trait that governed the extent to which individuals forewent potentially contaminated nutrition. This lowered their risk of gastrointestinal illness, at the cost of increasing starvation risk and birth interval. As environmental levels and costs of contamination rose, so did relative fitness of high disgust individuals. Evolutionary shifts in disgust as polygenic trait occurred as a consequence of germ cell mutations, but were most prominent in populations with high initial genetic variance. Crucially, cultural transmission between generations operated at a higher rate, even if parental modelling was eliminated. This study serves not only as evidence of cultural evolution shaping the behavioural immune system, but also as an illustration of emerging theories that paint affective and cognitive mechanisms as socially transmitted rather than biologically determined functions.


Complete K "ahler Einstein metric on Stein manifolds with negative curvature. We show the existence of complete negative K "ahler Einstein metric on Stein manifolds with negatively pinched holomorphic sectional curvature. We prove that any K "ahler metrics on such manifolds can be deformed to the complete negative K "ahler Einstein metric using the normalized K "ahler Ricci flow.


Generalization of proximate order and applications. We introduce a concept of a quasi proximate order which is a generalization of a proximate order and allows us to study efficiently analytic functions whose order and lower order of growth are different. We prove an existence theorem of a quasi proximate order, i.e. a counterpart of Valiron's theorem for a proximate order. As applications, we generalize and complement some results of M. Cartwright and C. N. Lin den on asymptotic behavior of analytic functions in the unit disc.


Excluding a ladder. A ladder is a 2 times k grid graph. When does a graph class mathcal C exclude some ladder as a minor? We show that this is the case if and only if all graphs G in mathcal C admit a proper vertex coloring with a bounded number of colors such that for every 2 connected subgraph H of G , there is a color that appears exactly once in H . This type of vertex coloring is a relaxation of the notion of centered coloring, where for every connected subgraph H of G , there must be a color that appears exactly once in H . The minimum number of colors in a centered coloring of G is the treedepth of G , and it is known that classes of graphs with bounded treedepth are exactly those that exclude a fixed path as a subgraph, or equivalently, as a minor. In this sense, the structure of graphs excluding a fixed ladder as a minor resembles the structure of graphs without long paths. Another similarity is as follows It is an easy observation that every connected graph with two vertex disjoint paths of length k has a path of length k 1 . We show that every 3 connected graph which contains as a minor a union of sufficiently many vertex disjoint copies of a 2 times k grid has a 2 times (k 1) grid minor. Our structural results have applications to poset dimension. We show that posets whose cover graphs exclude a fixed ladder as a minor have bounded dimension. This is a new step towards the goal of understanding which graphs are unavoidable as minors in cover graphs of posets with large dimension.


On the Grothendieck Serre Conjecture for Classical Groups. We prove some new cases of the Grothendieck Serre conjecture for classical groups. This is based on a new construction of the Gersten Witt complex for Witt groups of Azumaya algebras with involution on regular semilocal rings, with explicit second residue maps the complex is shown to be exact when the ring is of dimension le 2 (or le 4 , with additional hypotheses on the algebra with involution). Note that we do not assume that the ring contains a field.


A Secure and Robust Scheme for Sharing Confidential Information in IoT Systems. In Internet of Things (IoT) systems with security demands, there is often a need to distribute sensitive information (such as encryption keys, digital signatures, or login credentials, etc.) among the devices, so that it can be retrieved for confidential purposes at a later moment. However, this information cannot be entrusted to any one device, since the failure of that device or an attack on it will jeopardize the security of the entire network. Even if the information is divided among devices, there is still the danger that an attacker can compromise a group of devices and expose the sensitive information. In this work, we design and implement a secure and robust scheme to enable the distribution of sensitive information in IoT networks. The proposed approach has two important properties (1) it uses Threshold Secret Sharing (TSS) to split the information into pieces distributed among all devices in the system and so the information can only be retrieved collaboratively by groups of devices and (2) it ensures the privacy and integrity of the information, even when attackers hijack a large number of devices and use them in concert specifically, all the compromised devices can be identified, the confidentiality of information is kept, and authenticity of the secret can be guaranteed.


On the application of the semismooth Newton method to variational inequalities of the second kind. The paper starts with a concise description of the recently developed semismooth Newton method for the solution of general inclusions. This method is then applied to a class of variational inequalities of the second kind. As a result, one obtains an implementable algorithm exhibiting a local superlinear convergence. Thereafter we suggest several globally convergent hybrid algorithms in which one combines the semismooth Newton method with selected splitting algorithms for the solution of monotone variational inequalities. Their efficiency is documented by extensive numerical experiments.


Linear Time LexDFS on Chordal Graphs. Lexicographic Depth First Search (LexDFS) is a special variant of a Depth First Search (DFS), which was introduced by Corneil and Krueger in 2008. While this search has been used in various applications, in contrast to other graph searches, no general linear time implementation is known to date. In 2014, K "ohler and Mouatadid achieved linear running time to compute some special LexDFS orders for cocomparability graphs. In this paper, we present a linear time implementation of LexDFS for chordal graphs. Our algorithm is able to find any LexDFS order for this graph class. To the best of our knowledge this is the first unrestricted linear time implementation of LexDFS on a non trivial graph class. In the algorithm we use a search tree computed by Lexicographic Breadth First Search (LexBFS).


Improved Veron Identification and Signature Schemes in the Rank Metric. It is notably challenging to design an efficient and secure signature scheme based on error correcting codes. An approach to build such signature schemes is to derive it from an identification protocol through the Fiat Shamir transform. All such protocols based on codes must be run several rounds, since each run of the protocol allows a cheating probability of either 2 3 or 1 2. The resulting signature size is proportional to the number of rounds, thus making the 1 2 cheating probability version more attractive. We present a signature scheme based on double circulant codes in the rank metric, derived from an identification protocol with cheating probability of 2 3. We reduced this probability to 1 2 to obtain the smallest signature among signature schemes based on the Fiat Shamir paradigm, around 22 KBytes for 128 bit security level. Furthermore, among all code based signature schemes, our proposal has the lowest value of signature plus public key size, and the smallest secret and public key sizes. We provide a security proof in the Random Oracle Model, implementation performances, and a comparison with the parameters of the most important code based signature schemes.


Exploring Spatial Temporal Multi Frequency Analysis for High Fidelity and Temporal Consistency Video Prediction. Video prediction is a pixel wise dense prediction task to infer future frames based on past frames. Missing appearance details and motion blur are still two major problems for current predictive models, which lead to image distortion and temporal inconsistency. In this paper, we point out the necessity of exploring multi frequency analysis to deal with the two problems. Inspired by the frequency band decomposition characteristic of Human Vision System (HVS), we propose a video prediction network based on multi level wavelet analysis to deal with spatial and temporal information in a unified manner. Specifically, the multi level spatial discrete wavelet transform decomposes each video frame into anisotropic sub bands with multiple frequencies, helping to enrich structural information and reserve fine details. On the other hand, multi level temporal discrete wavelet transform which operates on time axis decomposes the frame sequence into sub band groups of different frequencies to accurately capture multi frequency motions under a fixed frame rate. Extensive experiments on diverse datasets demonstrate that our model shows significant improvements on fidelity and temporal consistency over state of the art works.


Phase space manipulation of free electron pulses from metal nanotips using combined THz near fields and external biasing. We present a comprehensive experimental and numerical study of photoelectron streaking at metallic nanotips using single cycle Terahertz (THz) transients and a static bias voltage as an external control parameter. Analyzing bias voltage dependent streaking spectrograms, we explore the THz induced reshaping of photoelectron energy spectra, governed by the superimposed static field. Numerical simulations are employed to determine the local field strengths and spatial decay lengths of the field contributions, demonstrating electron trajectory control and the manipulation of the phase space distributions in confined fields with both dynamic and static components.


How Twitter Data Sampling Biases U.S. Voter Behavior Characterizations. Online social media are key platforms for the public to discuss political issues. As a result, researchers have used data from these platforms to analyze public opinions and forecast election results. Recent studies reveal the existence of inauthentic actors such as malicious social bots and trolls, suggesting that not every message is a genuine expression from a legitimate user. However, the prevalence of inauthentic activities in social data streams is still unclear, making it difficult to gauge biases of analyses based on such data. In this paper, we aim to close this gap using Twitter data from the 2018 U.S. midterm elections. Hyperactive accounts are over represented in volume samples. We compare their characteristics with those of randomly sampled accounts and self identified voters using a fast and low cost heuristic. We show that hyperactive accounts are more likely to exhibit various suspicious behaviors and share low credibility information compared to likely voters. Random accounts are more similar to likely voters, although they have slightly higher chances to display suspicious behaviors. Our work provides insights into biased voter characterizations when using online observations, underlining the importance of accounting for inauthentic actors in studies of political issues based on social media data.


IITP at MEDIQA 2019 Systems Report for Natural Language Inference, Question Entailment and Question Answering. This paper presents the experiments accomplished as a part of our participation in the MEDIQA challenge, an (Abacha et al., 2019) shared task. We participated in all the three tasks defined in this particular shared task. The tasks are viz. i. Natural Language Inference (NLI) ii. Recognizing Question Entailment(RQE) and their application in medical Question Answering (QA). We submitted runs using multiple deep learning based systems (runs) for each of these three tasks. We submitted five system results in each of the NLI and RQE tasks, and four system results for the QA task. The systems yield encouraging results in all three tasks. The highest performance obtained in NLI, RQE and QA tasks are 81.8 , 53.2 , and 71.7 , respectively.


Collaborative City Digital Twin For Covid 19 Pandemic A Federated Learning Solution. In this work, we propose a collaborative city digital twin based on FL, a novel paradigm that allowing multiple city DT to share the local strategy and status in a timely manner. In particular, an FL central server manages the local updates of multiple collaborators (city DT), provides a global model which is trained in multiple iterations at different city DT systems, until the model gains the correlations between various response plan and infection trend. That means, a collaborative city DT paradigm based on FL techniques can obtain knowledge and patterns from multiple DTs, and eventually establish a global view' for city crisis management. Meanwhile, it also helps to improve each city digital twin selves by consolidating other DT's respective data without violating privacy rules. To validate the proposed solution, we take COVID 19 pandemic as a case study. The experimental results on the real dataset with various response plan validate our proposed solution and demonstrate the superior performance.


On the computation of the slow dynamics of nonlinear modes of mechanical systems. A novel method for the numerical prediction of the slowly varying dynamics of nonlinear mechanical systems has been developed. The method is restricted to the regime of an isolated nonlinear mode and consists of a two step procedure In the first step, a multiharmonic analysis of the autonomous system is performed to directly compute the amplitude dependent characteristics of the considered nonlinear mode. In the second step, these modal properties are used to construct a two dimensional reduced order model (ROM) that facilitates the efficient computation of steady state and unsteady dynamics provided that nonlinear modal interactions are absent. The proposed methodology is applied to several nonlinear mechanical systems ranging form single degree of freedom to Finite Element models. Unsteady vibration phenomena such as approaching behavior towards an equilibrium point or limit cycles, and resonance passages are studied regarding the effect of various nonlinearities such as cubic springs, unilateral contact and friction. It is found that the proposed ROM facilitates very fast and accurate analysis of the slow dynamics of nonlinear systems. Moreover, the ROM concept offers a huge parameter space including additional linear damping, stiffness and near resonant forcing.


Fine grained complexity of the list homomorphism problem feedback vertex set and cutwidth. For graphs G,H , a homomorphism from G to H is an edge preserving mapping from V(G) to V(H) . In the list homomorphism problem, denoted by textsc LHom ( H ), we are given a graph G and lists L V(G) to 2 V(H) , and we ask for a homomorphism from G to H which additionally respects the lists L . Very recently Okrasa, Piecyk, and Rz k a .zewski ESA 2020 defined an invariant i (H) and proved that under the SETH mathcal O left (i (H) textrm tw (G) right) is the tight complexity bound for textsc LHom ( H ), parameterized by the treewidth textrm tw (G) of the instance graph G . We study the complexity of the problem under dirretent parameterizations. As the first result, we show that i (H) is also the right complexity base if the parameter is the size of a minimum feedback vertex set of G . Then we turn our attention to a parameterization by the cutwidth textrm ctw (G) of G . Jansen and Nederlof ESA 2018 showed that textsc List k Coloring (i.e., textsc LHom ( K k )) can be solved in time mathcal O left (c textrm ctw (G) right) where c does not depend on k . Jansen asked if this behavior extends to graph homomorphisms. As the main result of the paper, we answer the question in the negative. We define a new graph invariant mim (H) and prove that textsc LHom ( H ) problem cannot be solved in time mathcal O left ((mim (H) varepsilon) textrm ctw (G) right) for any varepsilon 0 , unless the SETH fails. This implies that there is no c , such that for every odd cycle the non list version of the problem can be solved in time mathcal O left (c textrm ctw (G) right) . Finally, we generalize the algorithm of Jansen and Nederlof, so that it can be used to solve textsc LHom ( H ) for every graph H its complexity depends on textrm ctw (G) and another invariant of H , which is constant for cliques.


L series and homomorphisms of number fields. While the zeta function does not determine a number field uniquely, the L series of a well chosen Dirichlet character does. Moreover, isomorphisms between two number fields are in natural bijection with L series preserving isomorphisms of l torsion subgroups of the Dirichlet character groups. We extend this by showing that homomorphisms between number fields are in natural bijection with group homomorphisms between l torsion subgroups of the Dirichlet character groups abiding a divisibility condition on the L series when l is sufficiently large.


Exploring Image Enhancement for Salient Object Detection in Low Light Images. Low light images captured in a non uniform illumination environment usually are degraded with the scene depth and the corresponding environment lights. This degradation results in severe object information loss in the degraded image modality, which makes the salient object detection more challenging due to low contrast property and artificial light influence. However, existing salient object detection models are developed based on the assumption that the images are captured under a sufficient brightness environment, which is impractical in real world scenarios. In this work, we propose an image enhancement approach to facilitate the salient object detection in low light images. The proposed model directly embeds the physical lighting model into the deep neural network to describe the degradation of low light images, in which the environment light is treated as a point wise variate and changes with local content. Moreover, a Non Local Block Layer is utilized to capture the difference of local content of an object against its local neighborhood favoring regions. To quantitative evaluation, we construct a low light Images dataset with pixel level human labeled ground truth annotations and report promising results on four public datasets and our benchmark dataset.


On the Impact of Partial Sums on Interconnect Bandwidth and Memory Accesses in a DNN Accelerator. Dedicated accelerators are being designed to address the huge resource requirement of the deep neural network (DNN) applications. The power, performance and area (PPA) constraints limit the number of MACs available in these accelerators. The convolution layers which require huge number of MACs are often partitioned into multiple iterative sub tasks. This puts huge pressure on the available system resources such as interconnect and memory bandwidth. The optimal partitioning of the feature maps for these sub tasks can reduce the bandwidth requirement substantially. Some accelerators avoid off chip or interconnect transfers by implementing local memories however, the memory accesses are still performed and a reduced bandwidth can help in saving power in such architectures. In this paper, we propose a first order analytical method to partition the feature maps for optimal bandwidth and evaluate the impact of such partitioning on the bandwidth. This bandwidth can be saved by designing an active memory controller which can perform basic arithmetic operations. It is shown that the optimal partitioning and active memory controller can achieve up to 40 bandwidth reduction.


Simultaneous Translation Policies From Fixed to Adaptive. Adaptive policies are better than fixed policies for simultaneous translation, since they can flexibly balance the tradeoff between translation quality and latency based on the current context information. But previous methods on obtaining adaptive policies either rely on complicated training process, or underperform simple fixed policies. We design an algorithm to achieve adaptive policies via a simple heuristic composition of a set of fixed policies. Experiments on Chinese English and German English show that our adaptive policies can outperform fixed ones by up to 4 BLEU points for the same latency, and more surprisingly, it even surpasses the BLEU score of full sentence translation in the greedy mode (and very close to beam mode), but with much lower latency.


Incremental Data driven Optimization of Complex Systems in Nonstationary Environments. Existing work on data driven optimization focuses on problems in static environments, but little attention has been paid to problems in dynamic environments. This paper proposes a data driven optimization algorithm to deal with the challenges presented by the dynamic environments. First, a data stream ensemble learning method is adopted to train the surrogates so that each base learner of the ensemble learns the time varying objective function in the previous environments. After that, a multi task evolutionary algorithm is employed to simultaneously optimize the problems in the past environments assisted by the ensemble surrogate. This way, the optimization tasks in the previous environments can be used to accelerate the tracking of the optimum in the current environment. Since the real fitness function is not available for verifying the surrogates in offline data driven optimization, a support vector domain description that was designed for outlier detection is introduced to select a reliable solution. Empirical results on six dynamic optimization benchmark problems demonstrate the effectiveness of the proposed algorithm compared with four state of the art data driven optimization algorithms.


Periodic Hamiltonian systems in shape optimization problems with Neumann boundary conditions. The recent approach based on Hamiltonian systems and the implicit parametri za tion theorem, provides a general fixed domain approximation method in shape optimization problems, using optimal control theory. In previous works, we have examined Dirichlet boundary conditions with distributed or boundary observation. Here, we discuss the case of Neumann boundary conditions, with a combined cost functional, including both distributed and boundary observation. Extensions to nonlinear state systems are possible. This new technique allows simultaneous boundary and topological variations and we also report numerical experiments confirming the theoretical results.


Generating wandering subspaces for doubly commuting covariant representations. We obtain a Halmos Richter type wandering subspace theorem for covariant representations of C correspondences. Further the notion of Cauchy dual and a version of Shimorin's Wold type decomposition for covariant representations of C correspondences is explored and as an application a wandering subspace theorem for doubly commuting covariant representations is derived. Using this wandering subspace theorem generating wandering subspaces are characterized for covariant representations of product systems in terms of the doubly commutativity condition.


Optimal Consumption with Reference to Past Spending Maximum. This paper studies the infinite horizon optimal consumption with a path dependent reference under exponential utility. The performance is measured by the difference between the nonnegative consumption rate and a fraction of the historical consumption maximum. The consumption running maximum process is chosen as an auxiliary state process, and hence the value function depends on two state variables. The Hamilton Jacobi Bellman (HJB) equation can be heuristically expressed in a piecewise manner across different regions to take into account all constraints. By employing the dual transform and smooth fit principle, some thresholds of the wealth variable are derived such that a classical solution to the HJB equation and the feedback optimal investment and consumption strategies can be obtained in closed form in each region. A complete proof of the verification theorem is provided, and numerical examples are presented to illustrate some financial implications.


Signless Laplacian spectral radius and matching in graphs. The signless Laplacian matrix of a graph G is given by Q(G) D(G) A(G) , where D(G) is a diagonal matrix of vertex degrees and A(G) is the adjacency matrix. The largest eigenvalue of Q(G) is called the signless Laplacian spectral radius, denoted by q 1 q 1(G) . In this paper, some properties between the signless Laplacian spectral radius and perfect matching in graphs are establish. Let r(n) be the largest root of equation x 3 (3n 7)x 2 n(2n 7)x 2(n 2 7n 12) 0 . We show that G has a perfect matching for n 4 or n geq10 , if q 1(G) r(n) , and for n 6 or n 8 , if q 1(G) 4 2 sqrt 3 or q 1(G) 6 2 sqrt 6 respectively, where n is a positive even integer number. Moreover, there exists graphs K n 3 vee K 1 vee overline K 2 such that q 1(K n 3 vee K 1 vee overline K 2 ) r(n) if n geq4 , a graph K 2 vee overline K 4 such that q 1(K 2 vee overline K 4 ) 4 2 sqrt 3 and a graph K 3 vee overline K 5 such that q 1(K 3 vee overline K 5 ) 6 2 sqrt 6 . These graphs all have no prefect matching.


Rational Equivalences on Products of Elliptic Curves in a Family. Given a pair of elliptic curves E 1,E 2 over a field k , we have a natural map text CH 1(E 1) 0 otimes text CH 1(E 2) 0 to text CH 2(E 1 times E 2) , and a conjecture due to Beilinson predicts that the image of this map is finite when k is a number field. We construct a 2 parameter family of elliptic curves that can be used to produce examples of pairs E 1,E 2 where this image is finite. The family is constructed to guarantee the existence of a rational curve passing through a specified point in the Kummer surface of E 1 times E 2 .


Exploring and Analyzing Machine Commonsense Benchmarks. Commonsense question answering (QA) tasks, in the form of benchmarks, are constantly being introduced for challenging and comparing commonsense QA systems. The benchmarks provide question sets that systems' developers can use to train and test new models before submitting their implementations to official leaderboards. Although these tasks are created to evaluate systems in identified dimensions (e.g. topic, reasoning type), this metadata is limited and largely presented in an unstructured format or completely not present. Because machine common sense is a fast paced field, the problem of fully assessing current benchmarks and systems with regards to these evaluation dimensions is aggravated. We argue that the lack of a common vocabulary for aligning these approaches' metadata limits researchers in their efforts to understand systems' deficiencies and in making effective choices for future tasks. In this paper, we first discuss this MCS ecosystem in terms of its elements and their metadata. Then, we present how we are supporting the assessment of approaches by initially focusing on commonsense benchmarks. We describe our initial MCS Benchmark Ontology, an extensible common vocabulary that formalizes benchmark metadata, and showcase how it is supporting the development of a Benchmark tool that enables benchmark exploration and analysis.


Cyclicality, Periodicity and the Topology of Time Series. Periodic and semi periodic patterns are very common in nature. In this paper we introduce a topological toolbox aiming in detecting and quantifying periodicity. The presented technique is of a general nature and may be employed wherever there is suspected cyclic behaviour in a time series with no trend. The approach is tested on a number of real world examples enabling us to consistently demonstrate an ability to recognise periodic behaviour where conventional techniques fail to do so. Quicker to react to changes in time series behaviour, and with a high robustness to noise, the toolbox offers a powerful way to deeper understanding of time series dynamics.


Extending perfect matchings to Hamiltonian cycles in line graphs. A graph admitting a perfect matching has the Perfect Matching Hamiltonian property (for short the PMH property) if each of its perfect matchings can be extended to a Hamiltonian cycle. In this paper we establish some sufficient conditions for a graph G in order to guarantee that its line graph L(G) has the PMH property. In particular, we prove that this happens when G is (i) a Hamiltonian graph with maximum degree at most 3 , (ii) a complete graph, or (iii) an arbitrarily traceable graph. Further related questions and open problems are proposed along the paper.


Constant Delay Enumeration for Nondeterministic Document Spanners. We consider the information extraction framework known as document spanners, and study the problem of efficiently computing the results of the extraction from an input document, where the extraction task is described as a sequential variable set automaton (VA). We pose this problem in the setting of enumeration algorithms, where we can first run a preprocessing phase and must then produce the results with a small delay between any two consecutive results. Our goal is to have an algorithm which is tractable in combined complexity, i.e., in the sizes of the input document and the VA while ensuring the best possible data complexity bounds in the input document size, i.e., constant delay in the document size. Several recent works at PODS'18 proposed such algorithms but with linear delay in the document size or with an exponential dependency in size of the (generally nondeterministic) input VA. In particular, Florenzano et al. suggest that our desired runtime guarantees cannot be met for general sequential VAs. We refute this and show that, given a nondeterministic sequential VA and an input document, we can enumerate the mappings of the VA on the document with the following bounds the preprocessing is linear in the document size and polynomial in the size of the VA, and the delay is independent of the document and polynomial in the size of the VA. The resulting algorithm thus achieves tractability in combined complexity and the best possible data complexity bounds. Moreover, it is rather easy to describe, in particular for the restricted case of so called extended VAs. Finally, we evaluate our algorithm empirically using a prototype implementation.


Optimal Scheduling of Frequency Services Considering a Variable Largest Power Infeed Loss. Low levels of inertia due to increasing renewable penetration bring several challenges, such as the higher need for Primary Frequency Response (PFR). A potential solution to mitigate this problem consists on reducing the largest possible power loss in the grid. This paper develops a novel modelling framework to analyse the benefits of such approach. A new frequency constrained Stochastic Unit Commitment (SUC) is proposed here, which allows to dynamically reduce the largest possible loss in the optimisation problem. Furthermore, the effect of load damping is included by means of an approximation, while its effect is typically neglected in previous frequency secured UC studies. Through several case studies, we demonstrate that reducing the largest loss could significantly decrease operational cost and carbon emissions in the future Great Britain's grid.


Explore, Propose, and Assemble An Interpretable Model for Multi Hop Reading Comprehension. Multi hop reading comprehension requires the model to explore and connect relevant information from multiple sentences documents in order to answer the question about the context. To achieve this, we propose an interpretable 3 module system called Explore Propose Assemble reader (EPAr). First, the Document Explorer iteratively selects relevant documents and represents divergent reasoning chains in a tree structure so as to allow assimilating information from all chains. The Answer Proposer then proposes an answer from every root to leaf path in the reasoning tree. Finally, the Evidence Assembler extracts a key sentence containing the proposed answer from every path and combines them to predict the final answer. Intuitively, EPAr approximates the coarse to fine grained comprehension behavior of human readers when facing multiple long documents. We jointly optimize our 3 modules by minimizing the sum of losses from each stage conditioned on the previous stage's output. On two multi hop reading comprehension datasets WikiHop and MedHop, our EPAr model achieves significant improvements over the baseline and competitive results compared to the state of the art model. We also present multiple reasoning chain recovery tests and ablation studies to demonstrate our system's ability to perform interpretable and accurate reasoning.


A protocol for information driven antibody antigen modelling with the HADDOCK2.4 webserver. In the recent years, therapeutic use of antibodies has seen a huge growth, due to their inherent proprieties and technological advances in the methods used to study and characterize them. Effective design and engineering of antibodies for therapeutic purposes are heavily dependent on knowledge of the structural principles that regulate antibody antigen interactions. Several experimental techniques such as X ray crystallography, cryo electron microscopy, NMR or mutagenesis analysis can be applied, but these are usually expensive and time consuming. Therefore computational approaches like molecular docking may offer a valuable alternative for the characterisation of antibody antigen complexes. Here we describe a protocol for the prediction of the 3D structure of antibody antigen complexes using the integrative modelling platform HADDOCK. The protocol consists of 1) The identification of the antibody residues belonging to the hyper variable loops which are known to be crucial for the binding and can be used to guide the docking 2) The detailed steps to perform docking with the HADDOCK 2.4 webserver following different strategies depending on the availability of information about epitope residues.


Symmetry and multiplicity of solutions in a two dimensional Landau de Gennes model for liquid crystals. We consider a variational two dimensional Landau de Gennes model in the theory of nematic liquid crystals in a disk of radius R . We prove that under a symmetric boundary condition carrying a topological defect of degree frac k 2 for some given bf even non zero integer k , there are exactly two minimizers for all large enough R . We show that the minimizers do not inherit the full symmetry structure of the energy functional and the boundary data. We further show that there are at least five symmetric critical points.


Moderately ramified actions in positive characteristic. In characteristic two and dimension two, wild Z 2Z actions on k u,v ramified precisely at the origin were classified by Artin, who showed in particular that they induce hypersurface singularities. We introduce in this article a new class of wild quotient singularities in any characteristic p 0 arising from certain non linear actions of Z pZ on the formal power series ring in n variables. These actions are ramified precisely at the origin, and their rings of invariants in dimension n 2 are hypersurface singularities, with an equation of a form similar to the form found by Artin when p 2. In higher dimension, the rings of invariants are not local complete intersection in general, but remain quasi Gorenstein. We establish several structure results for such actions and their corresponding rings of invariants.


An Empirical Study on Learning Fairness Metrics for COMPAS Data with Human Supervision. The notion of individual fairness requires that similar people receive similar treatment. However, this is hard to achieve in practice since it is difficult to specify the appropriate similarity metric. In this work, we attempt to learn such similarity metric from human annotated data. We gather a new dataset of human judgments on a criminal recidivism prediction (COMPAS) task. By assuming the human supervision obeys the principle of individual fairness, we leverage prior work on metric learning, evaluate the performance of several metric learning methods on our dataset, and show that the learned metrics outperform the Euclidean and Precision metric under various criteria. We do not provide a way to directly learn a similarity metric satisfying the individual fairness, but to provide an empirical study on how to derive the similarity metric from human supervisors, then future work can use this as a tool to understand human supervision.


Stylized Text Generation Using Wasserstein Autoencoders with a Mixture of Gaussian Prior. Wasserstein autoencoders are effective for text generation. They do not however provide any control over the style and topic of the generated sentences if the dataset has multiple classes and includes different topics. In this work, we present a semi supervised approach for generating stylized sentences. Our model is trained on a multi class dataset and learns the latent representation of the sentences using a mixture of Gaussian prior without any adversarial losses. This allows us to generate sentences in the style of a specified class or multiple classes by sampling from their corresponding prior distributions. Moreover, we can train our model on relatively small datasets and learn the latent representation of a specified class by adding external data with other styles classes to our dataset. While a simple WAE or VAE cannot generate diverse sentences in this case, generated sentences with our approach are diverse, fluent, and preserve the style and the content of the desired classes.


Decidable Fragment of Theories in Field Arithmetic. In this paper, we show that the exists 1 forall 1 theories of Hilbertian fields with charateristic 0 and perfect Hilbertian fields are both decidable. We also prove that the forall 1 exists 1 theories of Hilbertian fields with charateristic 0, Hilbertian fields, PAC fields with characteristic 0, and PAC fields are all decidable.


A kinetic traffic network model and its macroscopic limit merging lanes. In this paper we propose coupling conditions for a kinetic two velocity model for vehicular traffic on networks. These conditions are based on the consideration of the free space on the respective roads. The macroscopic limit of the kinetic relaxation system is a classical scalar conservation law for traffic flow. Similar to the asymptotic limit of boundary value problems for kinetic models, we consider here the limit of the full network problem including the coupling conditions at the nodes. An asymptotic analysis of the interface layers at the nodes and a matching procedure using half Riemann problems for the limit conservation law are used to derive coupling conditions for classical macroscopic traffic models on the network from the kinetic ones.


A strongly irreducible affine iterated function system with two invariant measures of maximal dimension. A classical theorem of Hutchinson asserts that if an iterated function system acts on mathbb R d by similitudes and satisfies the open set condition then it admits a unique self similar measure with Hausdorff dimension equal to the dimension of the attractor. In the class of measures on the attractor which arise as the projections of shift invariant measures on the coding space, this self similar measure is the unique measure of maximal dimension. In the context of affine iterated function systems it is known that there may be multiple shift invariant measures of maximal dimension if the linear parts of the affinities share a common invariant subspace, or more generally if they preserve a finite union of proper subspaces of mathbb R d . In this note we construct examples where multiple invariant measures of maximal dimension exist even though the linear parts of the affinities do not preserve a finite union of proper subspaces.


Budget Constrained Interactive Search for Multiple Targets. Interactive graph search leverages human intelligence to categorize target labels in a hierarchy, which are useful for image classification, product categorization, and database search. However, many existing studies of interactive graph search aim at identifying a single target optimally, and suffer from the limitations of asking too many questions and not being able to handle multiple targets. To address these two limitations, in this paper, we study a new problem of budget constrained interactive graph search for multiple targets called kBM IGS problem. Specifically, given a set of multiple targets T in a hierarchy, and two parameters k and b, the goal is to identify a k sized set of selections S such that the closeness between selections S and targets T is as small as possible, by asking at most a budget of b questions. We theoretically analyze the updating rules and design a penalty function to capture the closeness between selections and targets. To tackle the kBM IGS problem, we develop a novel framework to ask questions using the best vertex with the largest expected gain, which makes a balanced trade off between target probability and benefit gain. Based on the kBM IGS framework, we first propose an efficient algorithm STBIS to handle the SingleTarget problem, which is a special case of kBM IGS. Then, we propose a dynamic programming based method kBM DP to tackle the MultipleTargets problem. To further improve efficiency, we propose two heuristic but efficient algorithms kBM Topk and kBM DP . kBM Topk develops a variant gain function and selects the top k vertices independently. kBM DP uses an upper bound of gains and prunes disqualified vertices to save computations. Experiments on large real world datasets with ground truth targets verify both the effectiveness and efficiency of our proposed algorithms.


Motion Generation Using Bilateral Control Based Imitation Learning with Autoregressive Learning. Robots that can execute various tasks automatically on behalf of humans are becoming an increasingly important focus of research in the field of robotics. Imitation learning has been studied as an efficient and high performance method, and imitation learning based on bilateral control has been proposed as a method that can realize fast motion. However, because this method cannot implement autoregressive learning, this method may not generate desirable long term behavior. Therefore, in this paper, we propose a method of autoregressive learning for bilateral control based imitation learning. A new neural network model for implementing autoregressive learning is proposed. In this study, three types of experiments are conducted to verify the effectiveness of the proposed method. The performance is improved compared to conventional approaches the proposed method has the highest rate of success. Owing to the structure and autoregressive learning of the proposed model, the proposed method can generate the desirable motion for successful tasks and have a high generalization ability for environmental changes.


Accelerating Multiscale Simulation of Complex Geomodels by Use of Dynamically Adapted Basis Functions. A number of different multiscale methods have been developed as a robust alternative to upscaling and as a means for accelerated reservoir simulation of high resolution geomodels. In their basic setup, multiscale methods use a restriction operator to construct a reduced system of flow equations on a coarser grid, and a prolongation operator to map pressure unknowns from the coarse grid back to the original simulation grid. The prolongation operator consists of basis functions computed numerically by solving localized flow problems. One can use the resulting multiscale solver both as a CPR preconditioner in fully implicit simulators or as an efficient approximate iterative linear solver in a sequential setting. The latter approach has been successful implemented in a commercial simulator. Recently, we have shown that you can obtain significantly faster convergence if you instead of using a single pair of prolongation restriction operators apply a sequence of such operators, where some of the operators adapt to faults, fractures, facies, or other geobodies. Herein, we present how you can accelerate the convergence even further, if you also include additional basis functions that capture local changes in the pressure.


Estimation and control of oscillators through short range noisy proximity measurements. In this paper, we present a novel estimation and control strategy to balance a formation of discrete time oscillators on a circle. We consider the case in which each oscillator only gathers noisy proximity measurements, whose range is lower than the desired spacing along the circle, implying total disconnectedness of the balanced formation. These restrictions pose relevant challenges that are overcome through the symbiotic combination of an estimator that borrows tools from interval analysis and a three level bang bang controller. We prove that the formation can be balanced, with an accuracy that can be regulated by tuning a controller parameter. The effectiveness of the proposed strategy is further illustrated through a set of numerical simulations.


Learning Sequences of Manipulation Primitives for Robotic Assembly. This paper explores the idea that skillful assembly is best represented as dynamic sequences of Manipulation Primitives, and that such sequences can be automatically discovered by Reinforcement Learning. Manipulation Primitives, such as "Move down until contact", "Slide along x while maintaining contact with the surface", have enough complexity to keep the search tree shallow, yet are generic enough to generalize across a wide range of assembly tasks. Moreover, the additional "semantics" of the Manipulation Primitives make them more robust in sim2real and against model environment variations and uncertainties, as compared to more elementary actions. Policies are learned in simulation, and then transferred onto a physical platform. Direct sim2real transfer (without retraining in real) achieves excellent success rates on challenging assembly tasks, such as round peg insertion with 0.04 mm clearance or square peg insertion with large hole position orientation estimation errors.


A Study on the Prevalence of Human Values in Software Engineering Publications, 2015 2018. Failure to account for human values in software (e.g., equality and fairness) can result in user dissatisfaction and negative socio economic impact. Engineering these values in software, however, requires technical and methodological support throughout the development life cycle. This paper investigates to what extent software engineering (SE) research has considered human values. We investigate the prevalence of human values in recent (2015 2018) publications at some of the top tier SE conferences and journals. We classify SE publications, based on their relevance to different values, against a widely used value structure adopted from social sciences. Our results show that (a) only a small proportion of the publications directly consider values, classified as relevant publications (b) for the majority of the values, very few or no relevant publications were found and (c) the prevalence of the relevant publications was higher in SE conferences compared to SE journals. This paper shares these and other insights that motivate research on human values in software engineering.


Unleashing the Tiger Inference Attacks on Split Learning. We investigate the security of Split Learning a novel collaborative machine learning framework that enables peak performance by requiring minimal resources consumption. In the present paper, we expose vulnerabilities of the protocol and demonstrate its inherent insecurity by introducing general attack strategies targeting the reconstruction of clients' private training sets. More prominently, we show that a malicious server can actively hijack the learning process of the distributed model and bring it into an insecure state that enables inference attacks on clients' data. We implement different adaptations of the attack and test them on various datasets as well as within realistic threat scenarios. We demonstrate that our attack is able to overcome recently proposed defensive techniques aimed at enhancing the security of the split learning protocol. Finally, we also illustrate the protocol's insecurity against malicious clients by extending previously devised attacks for Federated Learning. To make our results reproducible, we made our code available at https github.com pasquini dario SplitNN FSHA.


2 systems of arcs on spheres with prescribed endpoints. Let S be an n punctured sphere, with n geq 3 . We prove that binom n 3 is the maximum size of a family of pairwise non homotopic simple arcs on S joining a fixed pair of distinct punctures of S and pairwise intersecting at most twice. On the way, we show that a square annular diagram A has a corner on each of its boundary paths if A contains at least one square and the dual curves of A are simple arcs joining the boundary paths of A and pairwise intersecting at most once.


Learning to Collaborate from Simulation for Robot Assisted Dressing. We investigated the application of haptic feedback control and deep reinforcement learning (DRL) to robot assisted dressing. Our method uses DRL to simultaneously train human and robot control policies as separate neural networks using physics simulations. In addition, we modeled variations in human impairments relevant to dressing, including unilateral muscle weakness, involuntary arm motion, and limited range of motion. Our approach resulted in control policies that successfully collaborate in a variety of simulated dressing tasks involving a hospital gown and a T shirt. In addition, our approach resulted in policies trained in simulation that enabled a real PR2 robot to dress the arm of a humanoid robot with a hospital gown. We found that training policies for specific impairments dramatically improved performance that controller execution speed could be scaled after training to reduce the robot's speed without steep reductions in performance that curriculum learning could be used to lower applied forces and that multi modal sensing, including a simulated capacitive sensor, improved performance.


The potential for complex computational models of aging. The gradual accumulation of damage and dysregulation during the aging of living organisms can be quantified. Even so, the aging process is complex and has multiple interacting physiological scales from the molecular to cellular to whole tissues. In the face of this complexity, we can significantly advance our understanding of aging with the use of computational models that simulate realistic individual trajectories of health as well as mortality. To do so, they must be systems level models that incorporate interactions between measurable aspects of age associated changes. To incorporate individual variability in the aging process, models must be stochastic. To be useful they should also be predictive, and so must be fit or parameterized by data from large populations of aging individuals. In this perspective, we outline where we have been, where we are, and where we hope to go with such computational models of aging. Our focus is on data driven systems level models, and on their great potential in aging research.


Geodesic stretch, pressure metric and marked length spectrum rigidity. We refine the recent local rigidity result for the marked length spectrum obtained by the first and third author in cite Guillarmou Lefeuvre 18 and give an alternative proof using the geodesic stretch between two Anosov flows and some uniform estimate on the variance appearing in the central limit theorem for Anosov geodesic flows. In turn, we also introduce a new pressure metric on the space of isometry classes, that reduces to the Weil Peterson metric in the case of Teichm "uller space and is related to the works of cite McMullen,Bridgeman Canary Labourie Sambarino 15 .


A comparison of the Almgren Pitts and the Allen Cahn min max theory. Min max theory for the Allen Cahn equation was developed by Guaraco and Gaspar Guaraco. They showed that the Allen Cahn widths are greater than or equal to the Almgren Pitts widths. In this article we will prove that the reverse inequalities also hold i.e. the Allen Cahn widths are less than or equal to the Almgren Pitts widths. Hence, the Almgren Pitts widths and the Allen Cahn widths coincide. We will also show that all the closed minimal hypersurfaces (with optimal regularity) which are obtained from the Allen Cahn min max theory are also produced by the Almgren Pitts min max theory. As a consequence, we will point out that the index upper bound in the Almgren Pitts setting, proved by Marques Neves and Li, can also be obtained from the index upper bound in the Allen Cahn setting, proved by Gaspar and Hiesmayr.


Scattering diagrams, sheaves, and curves. We review the recent proof of the N.Takahashi's conjecture on genus 0 Gromov Witten invariants of ( mathbb P 2, E) , where E is a smooth cubic curve in the complex projective plane mathbb P 2 . The main idea is the use of the algebraic notion of scattering diagram as a bridge between the world of Gromov Witten invariants of ( mathbb P 2, E) and the world of moduli spaces of coherent sheaves on mathbb P 2 . Using this bridge, the N.Takahashi's conjecture can be translated into a manageable question about moduli spaces of coherent sheaves on mathbb P 2 . This survey is based on a three hours lecture series given as part of the Beijing Zurich moduli workshop in Beijing, 9 12 September 2019.


Benchmarking database performance for genomic data. Genomic regions represent features such as gene annotations, transcription factor binding sites and epigenetic modifications. Performing various genomic operations such as identifying overlapping non overlapping regions or nearest gene annotations are common research needs. The data can be saved in a database system for easy management, however, there is no comprehensive database built in algorithm at present to identify overlapping regions. Therefore I have developed a region mapping (RegMap) SQL based algorithm to perform genomic operations and have benchmarked the performance of different databases. Benchmarking identified that PostgreSQL extracts overlapping regions much faster than MySQL. Insertion and data uploads in PostgreSQL were also better, although general searching capability of both databases was almost equivalent. In addition, using the algorithm pair wise, overlaps of 1000 datasets of transcription factor binding sites and histone marks, collected from previous publications, were reported and it was found that HNF4G significantly co locates with cohesin subunit STAG1 (SA1).


q-fin.CP cs.CE cs.NA math.NA q-fin.MF q-fin.PR

Explicit RKF Compact Scheme for Pricing Regime Switching American Options with Varying Time Step. In this research work, an explicit Runge Kutta Fehlberg (RKF) time integration with a fourth order compact finite difference scheme in space and a high order analytical approximation of the optimal exercise boundary is employed for solving the regime switching pricing model. In detail, we recast the free boundary problem into a system of nonlinear partial differential equations with a multi fixed domain. We then introduce a transformation based on the square root function with a Lipschitz character from which a high order analytical approximation is obtained to compute the derivative of the optimal exercise boundary in each regime. We further compute the boundary values, asset option, and the option Greeks for each regime using fourth order spatial discretization and adaptive time integration. In particular, the coupled assets options and option Greeks are estimated using Hermite interpolation with Newton basis. Finally, a numerical experiment is carried out with two and four regimes examples and results are compared with the existing methods. The results obtained from the numerical experiment show that the present method provides better performance in terms of computational speed and more accurate solutions with a large step size.


Low pass filter based shock response spectrum and the evaluation method of transmissibility between equipment and sensitive components interfaces. According to the features of the sources of pyroshock and ballistic shock, this study considers the pyroshock and ballistic shock generated by their respective impulsive sources as damped harmonic waves with different frequencies. According to the linear superposition assumption of damped harmonic waves in a linear elastic structure, a shock analysis method based on low pass filtered shock signals and their corresponding shock response spectrum (SRS), termed as low pass filter based shock response spectrum (LPSRS), is proposed. LPSRS contains rich information of the frequency distribution of the shock excitation signal. A method to calculate shock transmissibility is proposed based on LPSRS and basic modal information of the equipment structure. LPSRS and SRS curves can be predicted at any given position of the equipment structure. The prediction method is validated by finite element method (FEM) simulation.


Incorporating Visual Semantics into Sentence Representations within a Grounded Space. Language grounding is an active field aiming at enriching textual representations with visual information. Generally, textual and visual elements are embedded in the same representation space, which implicitly assumes a one to one correspondence between modalities. This hypothesis does not hold when representing words, and becomes problematic when used to learn sentence representations the focus of this paper as a visual scene can be described by a wide variety of sentences. To overcome this limitation, we propose to transfer visual information to textual representations by learning an intermediate representation space the grounded space. We further propose two new complementary objectives ensuring that (1) sentences associated with the same visual content are close in the grounded space and (2) similarities between related elements are preserved across modalities. We show that this model outperforms the previous state of the art on classification and semantic relatedness tasks.


Pressure metrics and Manhattan curves for Teichm "uller spaces of punctured surfaces. In this paper, we extend the construction of pressure metrics to Teichm "uller spaces of surfaces with punctures. This construction recovers Thurston's Riemannian metric on Teichm "uller spaces. Moreover, we prove the real analyticity and the convexity of Manhattan curves of the finite area type preserving Fuchsian representations, and thus we obtain several related entropy rigidity results. Lastly, relating the two topics mentioned above, we show that one can derive the pressure metric by varying Manhattan curves.


United for Change Deliberative Coalition Formation to Change the Status Quo. We study a setting in which a community wishes to identify a strongly supported proposal from a large space of alternatives, in order to change the status quo. We describe a process called deliberation in which agents dynamically form coalitions around proposals they prefer over the status quo. We formulate conditions (on the space of proposals and on the ways in which coalitions are formed) that guarantee deliberation to succeed, that is, to terminate by identifying a majority supported proposal with largest possible support, as long as such a proposal exists. Our results provide theoretical foundations for the analysis of deliberative processes in systems for democratic deliberation support, such as, e.g., LiquidFeedback.


A Prognostic, One Equation Model of Meso Scale Eddy Momentum Fluxes. We present a prognostic, one equation model for eddy mean flow interactions to parameterize the divergence of the Eliassen Palm flux tensor (EPFT) that arises from thickness weighted averaging (TWA) the hydrostatic Boussinesq equations. The TWA system of equations does not invoke approximations beyond those for which the hydrostatic Boussinesq equations are valid, constituting a mathematically consistent framework with clear physical interpretations. This model is intended for the adiabatic interior of zonally symmetric flows, in the absence of topographic features, where terms corresponding to eddy interfacial form drag in the EPFT dominate forces. We model eddy interfacial form drag terms for vertical flux of horizontal momentum using the gradient hypothesis, as the product of an eddy viscosity and the vertical gradient of horizontal momentum. We use mixing length theory to relate viscosity to an eddy length scale and an eddy velocity, which is proportional to the eddy energy in the TWA system. The eddy length scale is modeled as the first Rossby radius of deformation, which we calculate as a function of the mean flow. We use a prognostic equation for vertically integrated eddy energy at each horizontal location, which we derive from the TWA framework, and then simplify to the flows of interest by ignoring transport, redistribution and diabatic terms. The prognostic vertically integrated eddy energy is projected onto the water column using the eigenvalue of the first baroclinic mode to obtain the eddy energy at each vertical position. The eddy viscosity has horizontal as well as vertical structure. We diagnosed the model equations in an eddy resolving numerical simulation of a zonally re entrant channel representative of the Southern Ocean. We have implemented the model parameterization in an ocean model and tested it to simulate a parameterized simulation of this flow.


Online Gaussian Process State Space Model Learning and Planning for Partially Observable Dynamical Systems. This paper proposes an online learning method of Gaussian process state space model (GP SSM). GP SSM is a probabilistic representation learning scheme that represents unknown state transition and or measurement models as Gaussian processes (GPs). While the majority of prior literature on learning of GP SSM are focused on processing a given set of time series data, data may arrive and accumulate sequentially over time in most dynamical systems. Storing all such sequential data and updating the model over entire data incur large amount of computational resources in space and time. To overcome this difficulty, we propose a practical method, termed textit onlineGPSSM , that incorporates stochastic variational inference (VI) and online VI with novel formulation. The proposed method mitigates the computational complexity without catastrophic forgetting and also support adaptation to changes in a system and or a real environments. Furthermore, we present application of onlineGPSSM into the reinforcement learning (RL) of partially observable dynamical systems by integrating onlineGPSSM with Bayesian filtering and trajectory optimization algorithms. Numerical examples are presented to demonstrate applicability of the proposed method.


Computing Garsia Entropy for Bernoulli Convolutions with Algebraic Parameters. We introduce a parameter space containing all algebraic integers beta in(1,2 that are not Pisot or Salem numbers, and a sequence of increasing piecewise continuous function on this parameter space which gives a lower bound for the Garsia entropy of the Bernoulli convolution nu beta . This allows us to show that mathrm dim mathrm H ( nu beta ) 1 for all beta with representations in certain open regions of the parameter space.


Straggler Mitigation through Unequal Error Protection for Distributed Matrix Multiplication. Large scale machine learning and data mining methods routinely distribute computations across multiple agents to parallelize processing. The time required for computation at the agents is affected by the availability of local resources giving rise to the "straggler problem" in which the computation results are held back by unresponsive agents. For this problem, linear coding of the matrix sub blocks can be used to introduce resilience toward straggling. The Parameter Server (PS) utilizes a channel code and distributes the matrices to the workers for multiplication. It then produces an approximation to the desired matrix multiplication using the results of the computations received at a given deadline. In this paper, we propose to employ Unequal Error Protection (UEP) codes to alleviate the straggler problem. The resiliency level of each sub block is chosen according to its norm as blocks with larger norms have higher effects on the result of the matrix multiplication. We validate the effectiveness of our scheme both theoretically and through numerical evaluations. We derive a theoretical characterization of the performance of UEP using random linear codes, and compare it the case of equal error protection. We also apply the proposed coding strategy to the computation of the back propagation step in the training of a Deep Neural Network (DNN), for which we investigate the fundamental trade off between precision and the time required for the computations.


Area minimizing currents mod 2Q linear regularity theory. We establish a theory of Q valued functions minimizing a suitable generalization of the Dirichlet integral. In a second paper the theory will be used to approximate efficiently area minimizing currents mathrm mod (p) when p 2Q , and to establish a first general partial regularity theorem for every p in any dimension and codimension.


Discrete and Fast Fourier Transform Made Clear. Fast Fourier transform was included in the Top 10 Algorithms of 20th Century by Computing in Science Engineering. In this paper, we provide a new simple derivation of both the discrete Fourier transform and fast Fourier transform by means of elementary linear algebra. We start the exposition by introducing the convolution product of vectors, represented by a circulant matrix, and derive the discrete Fourier transform as the change of basis matrix that diagonalizes the circulant matrix. We also generalize our approach to derive the Fourier transform on any finite abelian group, where the case of Fourier transform on the Boolean cube is especially important for many applications in theoretical computer science.


Fusion of Object Tracking and Dynamic Occupancy Grid Map. Environment modeling in autonomous driving is realized by two fundamental approaches, grid based and feature based approach. Both methods interpret the environment differently and show some situation dependent beneficial realizations. In order to use the advantages of both methods, a combination makes sense. This work presents a fusion, which establishes an association between the representations of environment modeling and then decoupled from this performs a fusion of the information. Thus, there is no need to adapt the environment models. The developed fusion generates new hypotheses, which are closer to reality than a representation alone. This algorithm itself does not use object model assumptions, in effect this fusion can be applied to different object hypotheses. In addition, this combination allows the objects to be tracked over a longer period of time. This is evaluated with a quantitative evaluation on real sequences in real time.


DOOR SLAM Distributed, Online, and Outlier Resilient SLAM for Robotic Teams. To achieve collaborative tasks, robots in a team need to have a shared understanding of the environment and their location within it. Distributed Simultaneous Localization and Mapping (SLAM) offers a practical solution to localize the robots without relying on an external positioning system (e.g. GPS) and with minimal information exchange. Unfortunately, current distributed SLAM systems are vulnerable to perception outliers and therefore tend to use very conservative parameters for inter robot place recognition. However, being too conservative comes at the cost of rejecting many valid loop closure candidates, which results in less accurate trajectory estimates. This paper introduces DOOR SLAM, a fully distributed SLAM system with an outlier rejection mechanism that can work with less conservative parameters. DOOR SLAM is based on peer to peer communication and does not require full connectivity among the robots. DOOR SLAM includes two key modules a pose graph optimizer combined with a distributed pairwise consistent measurement set maximization algorithm to reject spurious inter robot loop closures and a distributed SLAM front end that detects inter robot loop closures without exchanging raw sensor data. The system has been evaluated in simulations, benchmarking datasets, and field experiments, including tests in GPS denied subterranean environments. DOOR SLAM produces more inter robot loop closures, successfully rejects outliers, and results in accurate trajectory estimates, while requiring low communication bandwidth. Full source code is available at https github.com MISTLab DOOR SLAM.git.


Combination of Multiple Global Descriptors for Image Retrieval. Recent studies in image retrieval task have shown that ensembling different models and combining multiple global descriptors lead to performance improvement. However, training different models for the ensemble is not only difficult but also inefficient with respect to time and memory. In this paper, we propose a novel framework that exploits multiple global descriptors to get an ensemble effect while it can be trained in an end to end manner. The proposed framework is flexible and expandable by the global descriptor, CNN backbone, loss, and dataset. Moreover, we investigate the effectiveness of combining multiple global descriptors with quantitative and qualitative analysis. Our extensive experiments show that the combined descriptor outperforms a single global descriptor, as it can utilize different types of feature properties. In the benchmark evaluation, the proposed framework achieves the state of the art performance on the CARS196, CUB200 2011, In shop Clothes, and Stanford Online Products on image retrieval tasks. Our model implementations and pretrained models are publicly available.