Circulation Control for Faster Minimum Cost Flow in Unit Capacity Graphs. We present an m 4 3 o(1) log W time algorithm for solving the minimum cost flow problem in graphs with unit capacity, where W is the maximum absolute value of any edge weight. For sparse graphs, this improves over the best known running time for this problem and, by well known reductions, also implies improved running times for the shortest path problem with negative weights, minimum cost bipartite boldsymbol mathit b matching when boldsymbol mathit b 1 O(m) , and recovers the running time of the currently fastest algorithm for maximum flow in graphs with unit capacities (Liu Sidford, 2020). Our algorithm relies on developing an interior point method based framework which acts on the space of circulations in the underlying graph. From the combinatorial point of view, this framework can be viewed as iteratively improving the cost of a suboptimal solution by pushing flow around circulations. These circulations are derived by computing a regularized version of the standard Newton step, which is partially inspired by previous work on the unit capacity maximum flow problem (Liu Sidford, 2019), and subsequently refined based on the very recent progress on this problem (Liu Sidford, 2020). The resulting step problem can then be computed efficiently using the recent work on ell p norm minimizing flows (Kyng Peng Sachdeva Wang, 2019). We obtain our faster algorithm by combining this new step primitive with a customized preconditioning method, which aims to ensure that the graph on which these circulations are computed has sufficiently large conductance.


Halpern iteration for a finite family of quasinonexpansive mappings on a complete geodesic space with curvature bounded above by one. In this paper, we consider the Halpern iteration scheme for a finite family of quasinonexpansive mappings and then prove a strong convergence theorem to their common fixed point in a complete geodesic space with curvature bounded above by one.


A Resource Aware Approach to Collaborative Loop Closure Detection with Provable Performance Guarantees. This paper presents resource aware algorithms for distributed inter robot loop closure detection for applications such as collaborative simultaneous localization and mapping (CSLAM) and distributed image retrieval. In real world scenarios, this process is resource intensive as it involves exchanging many observations and geometrically verifying a large number of potential matches. This poses severe challenges for small size and low cost robots with various operational and resource constraints that limit, e.g., energy consumption, communication bandwidth, and computation capacity. This paper proposes a framework in which robots first exchange compact queries to identify a set of potential loop closures. We then seek to select a subset of potential inter robot loop closures for geometric verification that maximizes a monotone submodular performance metric without exceeding budgets on computation (number of geometric verifications) and communication (amount of exchanged data for geometric verification). We demonstrate that this problem is in general NP hard, and present efficient approximation algorithms with provable performance guarantees. The proposed framework is extensively evaluated on real and synthetic datasets. A natural convex relaxation scheme is also presented to certify the near optimal performance of the proposed framework in practice.


Parameter robust preconditioning for multi compartmental Darcy equations. In this paper, we propose a new finite element solution approach to the multi compartmental Darcy equations describing flow and interactions in a porous medium with multiple fluid compartments. We introduce a new numerical formulation and a block diagonal preconditioner. The robustness with respect to variations in material parameters is demonstrated by theoretical considerations and numerical examples.


Reconfigurable Intelligent Surfaces Aided Multi Cell NOMA Networks A Stochastic Geometry Model. By activating blocked users and altering successive interference cancellation (SIC) sequences, reconfigurable intelligent surfaces (RISs) become promising for enhancing non orthogonal multiple access (NOMA) systems. The downlink RIS aided NOMA networks are investigated via stochastic geometry. We first introduce the unique path loss model for RIS reflecting channels. Then, we evaluate the angle distributions based on a Poisson cluster process (PCP) model, which theoretically demonstrates that the angles of incidence and reflection are uniformly distributed. Additionally, we derive closed form analytical and asymptotic expressions for coverage probabilities of the paired NOMA users. Lastly, we derive the analytical expressions of the ergodic rate for both of the paired NOMA users and calculate the asymptotic expressions for the typical user. The analytical results indicate that 1) the achievable rates reach an upper limit when the length of RIS increases 2) exploiting RISs can enhance the path loss intercept to improve the performance without influencing the bandwidth. Our results show that 1) RIS aided NOMA networks have superior performance than the conventional NOMA networks, and 2) the SIC order in NOMA systems can be altered since RISs are able to change the channel quality of NOMA users.


Does AlphaGo actually play Go? Concerning the State Space of Artificial Intelligence. The overarching goal of this paper is to develop a general model of the state space of AI. Given the breathtaking progress in AI research and technologies in recent years, such conceptual work is of substantial theoretical interest. The present AI hype is mainly driven by the triumph of deep learning neural networks. As the distinguishing feature of such networks is the ability to self learn, self learning is identified as one important dimension of the AI state space. Another main dimension lies in the possibility to go over from specific to more general types of problems. The third main dimension is provided by semantic grounding. Since this is a philosophically complex and controversial dimension, a larger part of the paper is devoted to it. We take a fresh look at known foundational arguments in the philosophy of mind and cognition that are gaining new relevance in view of the recent AI developments including the blockhead objection, the Turing test, the symbol grounding problem, the Chinese room argument, and general use theoretic considerations of meaning. Finally, the AI state space, spanned by the main dimensions generalization, grounding and "selfx ness", possessing self x properties such as self learning, is outlined.


Pseudo Random Number Generation a Reinforcement Learning approach. Pseudo Random Numbers Generators (PRNGs) are algorithms produced to generate long sequences of statistically uncorrelated numbers, i.e. Pseudo Random Numbers (PRNs). These numbers are widely employed in mid level cryptography and in software applications. Test suites are used to evaluate PRNGs quality by checking statistical properties of the generated sequences. Machine learning techniques are often used to break these generators, for instance approximating a certain generator or a certain sequence using a neural network. But what about using machine learning to generate PRNs generators? This paper proposes a Reinforcement Learning (RL) approach to the task of generating PRNGs from scratch by learning a policy to solve an N dimensional navigation problem. In this context, N is the length of the period of the generated sequence, and the policy is iteratively improved using the average value of an appropriate test suite run over that period. Aim of this work is to demonstrate the feasibility of the proposed approach, to compare it with classical methods, and to lay the foundation of a research path which combines RL and PRNGs.


Persistent Buffer Management with Optimistic Consistency. Finding the best way to leverage non volatile memory (NVM) on modern database systems is still an open problem. The answer is far from trivial since the clear boundary between memory and storage present in most systems seems to be incompatible with the intrinsic memory storage duality of NVM. Rather than treating NVM either solely as memory or solely as storage, in this work we propose how NVM can be simultaneously used as both in the context of modern database systems. We design a persistent buffer pool on NVM, enabling pages to be directly read written by the CPU (like memory) while recovering corrupted pages after a failure (like storage). The main benefits of our approach are an easy integration in the existing database architectures, reduced costs (by replacing DRAM with NVM), and faster peak performance recovery.


Finiteness classes arising from Ramsey theoretic statements in set theory without choice. We investigate infinite sets that witness the failure of certain Ramsey theoretic statements, such as Ramsey's or (appropriately phrased) Hindman's theorem such sets may exist if one does not assume the Axiom of Choice. We obtain very precise information as to where such sets are located within the hierarchy of infinite Dedekind finite sets.


DiResNet Direction aware Residual Network for Road Extraction in VHR Remote Sensing Images. The binary segmentation of roads in very high resolution (VHR) remote sensing images (RSIs) has always been a challenging task due to factors such as occlusions (caused by shadows, trees, buildings, etc.) and the intra class variances of road surfaces. The wide use of convolutional neural networks (CNNs) has greatly improved the segmentation accuracy and made the task end to end trainable. However, there are still margins to improve in terms of the completeness and connectivity of the results. In this paper, we consider the specific context of road extraction and present a direction aware residual network (DiResNet) that includes three main contributions 1) An asymmetric residual segmentation network with deconvolutional layers and a structural supervision to enhance the learning of road topology (DiResSeg) 2) A pixel level supervision of local directions to enhance the embedding of linear features 3) A refinement network to optimize the segmentation results (DiResRef). Ablation studies on two benchmark datasets (the Massachusetts dataset and the DeepGlobe dataset) have confirmed the effectiveness of the presented designs. Comparative experiments with other approaches show that the proposed method has advantages in both overall accuracy and F1 score. The code is available at https github.com ggsDing DiResNet.


Key to understanding supersonic radiative Marshak waves using simple models and advanced simulations. This article studies the propagation of supersonic radiative Marshak waves. These waves are radiation dominated, and play an important role in inertial confinement fusion and in astrophysical and laboratory systems. For that reason, this phenomenon has attracted considerable experimental attention in recent decades in several different facilities. The present study integrates the various experimental results published in the literature, demonstrating a common physical base. A new simple semi analytic model is derived and presented along with advanced radiative hydrodynamic implicit Monte Carlo direct numerical simulations, which explain the experimental results. This study identifies the main physical effects dominating the experiments, notwithstanding their different apparatuses and different physical regimes.


The realization and classification of topologically transitive group actions on 1 manifolds. In this report, we first recall the Poincar 'e's classification theorem for minimal orientation preserving homeomorphisms on the circle and the Ghys' classification theorem for minimal orientation preserving group actions on the circle. Then we introduce a classification theorem for a specified class of topologically transitive orientation preserving group actions on the circle by mathbb Z d . Also, some groups that admit admit no topologically transitive actions on the line are determined.


Upgrading the Newsroom An Automated Image Selection System for News Articles. We propose an automated image selection system to assist photo editors in selecting suitable images for news articles. The system fuses multiple textual sources extracted from news articles and accepts multilingual inputs. It is equipped with char level word embeddings to help both modeling morphologically rich languages, e.g. German, and transferring knowledge across nearby languages. The text encoder adopts a hierarchical self attention mechanism to attend more to both keywords within a piece of text and informative components of a news article. We extensively experiment with our system on a large scale text image database containing multimodal multilingual news articles collected from Swiss local news media websites. The system is compared with multiple baselines with ablation studies and is shown to beat existing text image retrieval methods in a weakly supervised learning setting. Besides, we also offer insights on the advantage of using multiple textual sources and multilingual data.


InfoScrub Towards Attribute Privacy by Targeted Obfuscation. Personal photos of individuals when shared online, apart from exhibiting a myriad of memorable details, also reveals a wide range of private information and potentially entails privacy risks (e.g., online harassment, tracking). To mitigate such risks, it is crucial to study techniques that allow individuals to limit the private information leaked in visual data. We tackle this problem in a novel image obfuscation framework to maximize entropy on inferences over targeted privacy attributes, while retaining image fidelity. We approach the problem based on an encoder decoder style architecture, with two key novelties (a) introducing a discriminator to perform bi directional translation simultaneously from multiple unpaired domains (b) predicting an image interpolation which maximizes uncertainty over a target set of attributes. We find our approach generates obfuscated images faithful to the original input images, and additionally increase uncertainty by 6.2 times (or up to 0.85 bits) over the non obfuscated counterparts.


Safety related Tasks within the Set Based Task Priority Inverse Kinematics Framework. In this paper we present a framework that allows the motion control of a robotic arm automatically handling different kinds of safety related tasks. The developed controller is based on a Task Priority Inverse Kinematics algorithm that allows the manipulator's motion while respecting constraints defined either in the joint or in the operational space in the form of equality based or set based tasks. This gives the possibility to define, among the others, tasks as joint limits, obstacle avoidance or limiting the workspace in the operational space. Additionally, an algorithm for the real time computation of the minimum distance between the manipulator and other objects in the environment using depth measurements has been implemented, effectively allowing obstacle avoidance tasks. Experiments with a Jaco 2 manipulator, operating in an environment where an RGB D sensor is used for the obstacles detection, show the effectiveness of the developed system.


Approximating the packedness of polygonal curves. In 2012 Driemel et al. cite DBLP journals dcg DriemelHW12 introduced the concept of c packed curves as a realistic input model. In the case when c is a constant they gave a near linear time (1 varepsilon) approximation algorithm for computing the Fr 'echet distance between two c packed polygonal curves. Since then a number of papers have used the model. In this paper we consider the problem of computing the smallest c for which a given polygonal curve in mathbb R d is c packed. We present two approximation algorithms. The first algorithm is a 2 approximation algorithm and runs in O(dn 2 log n) time. In the case d 2 we develop a faster algorithm that returns a (6 varepsilon) approximation and runs in O((n varepsilon 3) 4 3 polylog (n varepsilon))) time. We also implemented the first algorithm and computed the approximate packedness value for 16 sets of real world trajectories. The experiments indicate that the notion of c packedness is a useful realistic input model for many curves and trajectories.


Contour Integral Methods for Nonlinear Eigenvalue Problems A Systems Theoretic Approach. Contour integral methods for nonlinear eigenvalue problems seek to compute a subset of the spectrum in a bounded region of the complex plane. We briefly survey this class of algorithms, establishing a relationship to system realization techniques in control theory. This connection motivates a new general framework for contour integral methods (for linear and nonlinear eigenvalue problems), building on recent developments in multi point rational interpolation of dynamical systems. These new techniques, which replace the usual Hankel matrices with Loewner matrix pencils, incorporate general interpolation schemes and permit ready recovery of eigenvectors. Because the main computations (the solution of linear systems associated with contour integration) are identical for these Loewner methods and the traditional Hankel approach, a variety of new eigenvalue approximations can be explored with modest additional work. Numerical examples illustrate the potential of this approach. We also discuss how the concept of filter functions can be employed in this new framework, and show how contour methods enable a data driven modal truncation method for model reduction.


Evaluating Models' Local Decision Boundaries via Contrast Sets. Standard test sets for supervised learning evaluate in distribution generalization. Unfortunately, when a dataset has systematic gaps (e.g., annotation artifacts), these evaluations are misleading a model can learn simple decision rules that perform well on the test set but do not capture a dataset's intended capabilities. We propose a new annotation paradigm for NLP that helps to close systematic gaps in the test data. In particular, after a dataset is constructed, we recommend that the dataset authors manually perturb the test instances in small but meaningful ways that (typically) change the gold label, creating contrast sets. Contrast sets provide a local view of a model's decision boundary, which can be used to more accurately evaluate a model's true linguistic capabilities. We demonstrate the efficacy of contrast sets by creating them for 10 diverse NLP datasets (e.g., DROP reading comprehension, UD parsing, IMDb sentiment analysis). Although our contrast sets are not explicitly adversarial, model performance is significantly lower on them than on the original test sets up to 25 in some cases. We release our contrast sets as new evaluation benchmarks and encourage future dataset construction efforts to follow similar annotation processes.


2 theta burster for rhythm generating circuits. We propose and demonstrate the use of a minimal 2 theta model for endogenous bursters coupled in 3 cell neural circuits. This 2 theta model offers the benefit of simplicity of designing larger neural networks along with an acute reduction on the computation cost.


Solving Linear Systems over Idempotent Semifields through LU factorization. In this paper, we introduce and analyze a new LU factorization technique for square matrices over idempotent semifields. In particular, more emphasis is put on "max plus" algebra here, but the work is extended to other idempotent semifields as well. We first determine the conditions under which a square matrix has LU factors. Next, using this technique, we propose a method for solving square linear systems of equations whose system matrices are LU factorizable. We also give conditions for an LU factorizable system to have solutions. This work is an extension of similar techniques over fields. Maple procedures for this LU factorization are also included.


IIIT AR 13K A New Dataset for Graphical Object Detection in Documents. We introduce a new dataset for graphical object detection in business documents, more specifically annual reports. This dataset, IIIT AR 13k, is created by manually annotating the bounding boxes of graphical or page objects in publicly available annual reports. This dataset contains a total of 13k annotated page images with objects in five different popular categories table, figure, natural image, logo, and signature. It is the largest manually annotated dataset for graphical object detection. Annual reports created in multiple languages for several years from various companies bring high diversity into this dataset. We benchmark IIIT AR 13K dataset with two state of the art graphical object detection techniques using Faster R CNN 20 and Mask R CNN 11 and establish high baselines for further research. Our dataset is highly effective as training data for developing practical solutions for graphical object detection in both business documents and technical articles. By training with IIIT AR 13K, we demonstrate the feasibility of a single solution that can report superior performance compared to the equivalent ones trained with a much larger amount of data, for table detection. We hope that our dataset helps in advancing the research for detecting various types of graphical objects in business documents.


Angles of Random Simplices and Face Numbers of Random Polytopes. Pick d 1 points uniformly at random on the unit sphere in mathbb R d . What is the expected value of the angle sum of the simplex spanned by these points? Choose n points uniformly at random in the d dimensional ball. What is the expected number of faces of their convex hull? We answer these and some related questions of stochastic geometry. To this end, we compute expected internal angles of random simplices whose vertices are independent random points sampled from one of the following d dimensional distributions (i) the beta distribution with the density proportional to (1 x 2) beta , where x is belongs to the unit ball in mathbb R d (ii) the beta' distribution with the density proportional to (1 x 2) beta , where x in mathbb R d . These results imply explicit formulae for the expected face numbers of the following random polytopes (a) the typical Poisson Voronoi cell (b) the zero cell of the Poisson hyperplane tessellation (c) beta and beta' polytopes defined as convex hulls of i.i.d. samples from the corresponding distributions.


Lens spaces which are realizable as closures of homology cobordisms over planar surfaces. We determine the condition on a given lens space having a realization as a closure of homology cobordism over a planar surface with a given number of boundary components. As a corollary, we see that every lens space is represented as a closure of homology cobordism over a planar surface with three boundary components. In the proof of this corollary, we use Chebotarev density theorem.


Regularized Flexible Activation Function Combinations for Deep Neural Networks. Activation in deep neural networks is fundamental to achieving non linear mappings. Traditional studies mainly focus on finding fixed activations for a particular set of learning tasks or model architectures. The research on flexible activation is quite limited in both designing philosophy and application scenarios. In this study, three principles of choosing flexible activation components are proposed and a general combined form of flexible activation functions is implemented. Based on this, a novel family of flexible activation functions that can replace sigmoid or tanh in LSTM cells are implemented, as well as a new family by combining ReLU and ELUs. Also, two new regularisation terms based on assumptions as prior knowledge are introduced. It has been shown that LSTM models with proposed flexible activations P Sig Ramp provide significant improvements in time series forecasting, while the proposed P E2 ReLU achieves better and more stable performance on lossy image compression tasks with convolutional auto encoders. In addition, the proposed regularization terms improve the convergence, performance and stability of the models with flexible activation functions.


White Noise Analysis of Neural Networks. A white noise analysis of modern deep neural networks is presented to unveil their biases at the whole network level or the single neuron level. Our analysis is based on two popular and related methods in psychophysics and neurophysiology namely classification images and spike triggered analysis. These methods have been widely used to understand the underlying mechanisms of sensory systems in humans and monkeys. We leverage them to investigate the inherent biases of deep neural networks and to obtain a first order approximation of their functionality. We emphasize on CNNs since they are currently the state of the art methods in computer vision and are a decent model of human visual processing. In addition, we study multi layer perceptrons, logistic regression, and recurrent neural networks. Experiments over four classic datasets, MNIST, Fashion MNIST, CIFAR 10, and ImageNet, show that the computed bias maps resemble the target classes and when used for classification lead to an over twofold performance than the chance level. Further, we show that classification images can be used to attack a black box classifier and to detect adversarial patch attacks. Finally, we utilize spike triggered averaging to derive the filters of CNNs and explore how the behavior of a network changes when neurons in different layers are modulated. Our effort illustrates a successful example of borrowing from neurosciences to study ANNs and highlights the importance of cross fertilization and synergy across machine learning, deep learning, and computational neuroscience.


i6mA CNN a convolution based computational approach towards identification of DNA N6 methyladenine sites in rice genome. DNA N6 methylation (6mA) in Adenine nucleotide is a post replication modification and is responsible for many biological functions. Experimental methods for genome wide 6mA site detection is an expensive and manual labour intensive process. Automated and accurate computational methods can help to identify 6mA sites in long genomes saving significant time and money. Our study develops a convolutional neural network based tool i6mA CNN capable of identifying 6mA sites in the rice genome. Our model coordinates among multiple types of features such as PseAAC inspired customized feature vector, multiple one hot representations and dinucleotide physicochemical properties. It achieves area under the receiver operating characteristic curve of 0.98 with an overall accuracy of 0.94 using 5 fold cross validation on benchmark dataset. Finally, we evaluate our model on two other plant genome 6mA site identification datasets besides rice. Results suggest that our proposed tool is able to generalize its ability of 6mA site identification on plant genomes irrespective of plant species. Web tool for this research can be found at https cutt.ly Co6KuWG. Supplementary data (benchmark dataset, independent test dataset, comparison purpose dataset, trained model, physicochemical property values, attention mechanism details for motif finding) are available at https cutt.ly PpDdeDH.


Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks. Spiking Neural Networks (SNNs) have attracted enormous research interest due to temporal information processing capability, low power consumption, and high biological plausibility. However, the formulation of efficient and high performance learning algorithms for SNNs is still challenging. Most existing learning methods learn weights only, and require manual tuning of the membrane related parameters that determine the dynamics of a single spiking neuron. These parameters are typically chosen to be the same for all neurons, which limits the diversity of neurons and thus the expressiveness of the resulting SNNs. In this paper, we take inspiration from the observation that membrane related parameters are different across brain regions, and propose a training algorithm that is capable of learning not only the synaptic weights but also the membrane time constants of SNNs. We show that incorporating learnable membrane time constants can make the network less sensitive to initial values and can speed up learning. In addition, we reevaluate the pooling methods in SNNs and find that max pooling will not lead to significant information loss and have the advantage of low computation cost and binary compatibility. We evaluate the proposed method for image classification tasks on both traditional static MNIST, Fashion MNIST, CIFAR 10 datasets, and neuromorphic N MNIST, CIFAR10 DVS, DVS128 Gesture datasets. The experiment results show that the proposed method outperforms the state of the art accuracy on nearly all datasets, using fewer time steps. Our codes are available at https github.com fangwei123456 Parametric Leaky Integrate and Fire Spiking Neuron.


Von Neumann equivalence and properly proximal groups. We introduce a new equivalence relation on groups, which we call von Neumann equivalence, that is coarser than both measure equivalence and W equivalence. We introduce a general procedure for inducing actions in this setting and use this to show that many analytic properties, such as amenability, property (T), and the Haagerup property, are preserved under von Neumann equivalence. We also show that proper proximality, which was defined recently by Boutonnet, Ioana, and the second author using dynamics, is also preserved under von Neumann equivalence. In particular, proper proximality is preserved under both measure equivalence and W equivalence, and from this we obtain examples of non inner amenable groups that are not properly proximal.


Simultaneous nonvanishing of the Products of L functions associated to elliptic cusp forms. A generalized Riemann hypothesis states that all zeros of the completed Hecke L function L (f,s) of a normalized Hecke eigenform f on the full modular group should lie on the vertical line Re(s) frac k 2 . It was shown by Kohnen that there exists a Hecke eigenform f of weight k such that L (f,s) neq 0 for sufficiently large k and any point on the line segments Im(s) t 0, frac k 1 2 Re(s) frac k 2 epsilon, frac k 2 epsilon Re(s) frac k 1 2 , for any given real number t 0 and a positive real number epsilon. This paper concerns the non vanishing of the product L (f,s)L (f,w) (s,w in mathbb C ) on average.


A conservative difference scheme with optimal pointwise error estimates for two dimensional space fractional nonlinear Schr " o dinger equations. In this paper, a linearized semi implicit finite difference scheme is proposed for solving the two dimensional (2D) space fractional nonlinear Schr " o dinger equation (SFNSE).The scheme has the property of mass and energy conservation on the discrete level, with an unconditional stability and a second order accuracy for both time and spatial variables. The main contribution of this paper is an optimal pointwise error estimate for the 2D SFNSE, which is rigorously established and proved for the first time. Moreover, a novel technique is proposed for dealing with the nonlinear term in the equation, which plays an essential role in the error estimation. Finally, the numerical results confirm well with the theoretical findings.


Non linear and Selective Fusion of Cross Modal Images. The human visual perception system has strong robustness in image fusion. This robustness is based on human visual perception system's characteristics of feature selection and non linear fusion of different features. In order to simulate the human visual perception mechanism in image fusion tasks, we propose a multi source image fusion framework that combines illuminance factors and attention mechanisms. The framework effectively combines traditional image features and modern deep learning features. First, we perform multi scale decomposition of multi source images. Then, the visual saliency map and the deep feature map are combined with the illuminance fusion factor to perform high low frequency nonlinear fusion. Secondly, the characteristics of high and low frequency fusion are selected through the channel attention network to obtain the final fusion map. By simulating the nonlinear characteristics and selection characteristics of the human visual perception system in image fusion, the fused image is more in line with the human visual perception mechanism. Finally, we validate our fusion framework on public datasets of infrared and visible images, medical images and multi focus images. The experimental results demonstrate the superiority of our fusion framework over state of arts in visual quality, objective fusion metrics and robustness.


Fractional 0 1 programming and submodularity. In this note we study multiple ratio fractional 0 1 programs, a broad class of NP hard combinatorial optimization problems. In particular, under some relatively mild assumptions we provide a complete characterization of the conditions, which ensure that a single ratio function is submodular. Then we illustrate our theoretical results with the assortment optimization and facility location problems, and discuss practical situations that guarantee submodularity in the considered application settings. In such cases, near optimal solutions for multiple ratio fractional 0 1 programs can be found via simple greedy algorithms.


Evaluating Single Image Dehazing Methods Under Realistic Sunlight Haze. Haze can degrade the visibility and the image quality drastically, thus degrading the performance of computer vision tasks such as object detection. Single image dehazing is a challenging and ill posed problem, despite being widely studied. Most existing methods assume that haze has a uniform homogeneous distribution and haze can have a single color, i.e. grayish white color similar to smoke, while in reality haze can be distributed non uniformly with different patterns and colors. In this paper, we focus on haze created by sunlight as it is one of the most prevalent type of haze in the wild. Sunlight can generate non uniformly distributed haze with drastic density changes due to sun rays and also a spectrum of haze color due to sunlight color changes during the day. This presents a new challenge to image dehazing methods. For these methods to be practical, this problem needs to be addressed. To quantify the challenges and assess the performance of these methods, we present a sunlight haze benchmark dataset, Sun Haze, containing 107 hazy images with different types of haze created by sunlight having a variety of intensity and color. We evaluate a representative set of state of the art image dehazing methods on this benchmark dataset in terms of standard metrics such as PSNR, SSIM, CIEDE2000, PI and NIQE. This uncovers the limitation of the current methods, and questions their underlying assumptions as well as their practicality.


Spatiotemporal evolutions of similariton pulses in multimode fibers with Raman amplification. This letter is to pave the way towards the demonstration of spatiotemporal similariton pulses evolution in passive multimode fibers with Raman amplification. We present numerically these issues in a graded index and step index multimode fibers and provide a first look at the complex spatiotemporal dynamics of similariton pulses. The results showed that the similariton pulses can be generated in both multimode fibers. The temporal and the spectral evolution of the pulses can be characterized as parabolic shapes with linear chirp and kW peak power. By compressed these, high energy femtoseconds pulses can be obtained starting initial picoseconds pulses. Spatial beam profile could be preserved in both multimode fibers under the predominantly excitation of the fundamental mode. Specifically, Raman amplification and similariton pulses generation in graded index multimode fiber improves the spatial beam cleaning process under the different initial condition.


Ladder Loss for Coherent Visual Semantic Embedding. For visual semantic embedding, the existing methods normally treat the relevance between queries and candidates in a bipolar way relevant or irrelevant, and all "irrelevant" candidates are uniformly pushed away from the query by an equal margin in the embedding space, regardless of their various proximity to the query. This practice disregards relatively discriminative information and could lead to suboptimal ranking in the retrieval results and poorer user experience, especially in the long tail query scenario where a matching candidate may not necessarily exist. In this paper, we introduce a continuous variable to model the relevance degree between queries and multiple candidates, and propose to learn a coherent embedding space, where candidates with higher relevance degrees are mapped closer to the query than those with lower relevance degrees. In particular, the new ladder loss is proposed by extending the triplet loss inequality to a more general inequality chain, which implements variable push away margins according to respective relevance degrees. In addition, a proper Coherent Score metric is proposed to better measure the ranking results including those "irrelevant" candidates. Extensive experiments on multiple datasets validate the efficacy of our proposed method, which achieves significant improvement over existing state of the art methods.


Multi Ontology Refined Embeddings (MORE) A Hybrid Multi Ontology and Corpus based Semantic Representation for Biomedical Concepts. Objective Currently, a major limitation for natural language processing (NLP) analyses in clinical applications is that a concept can be referenced in various forms across different texts. This paper introduces Multi Ontology Refined Embeddings (MORE), a novel hybrid framework for incorporating domain knowledge from multiple ontologies into a distributional semantic model, learned from a corpus of clinical text. Materials and Methods We use the RadCore and MIMIC III free text datasets for the corpus based component of MORE. For the ontology based part, we use the Medical Subject Headings (MeSH) ontology and three state of the art ontology based similarity measures. In our approach, we propose a new learning objective, modified from the Sigmoid cross entropy objective function. Results and Discussion We evaluate the quality of the generated word embeddings using two established datasets of semantic similarities among biomedical concept pairs. On the first dataset with 29 concept pairs, with the similarity scores established by physicians and medical coders, MORE's similarity scores have the highest combined correlation (0.633), which is 5.0 higher than that of the baseline model and 12.4 higher than that of the best ontology based similarity measure.On the second dataset with 449 concept pairs, MORE's similarity scores have a correlation of 0.481, with the average of four medical residents' similarity ratings, and that outperforms the skip gram model by 8.1 and the best ontology measure by 6.9 .


Deeper Text Understanding for IR with Contextual Neural Language Modeling. Neural networks provide new possibilities to automatically learn complex language patterns and query document relations. Neural IR models have achieved promising results in learning query document relevance patterns, but few explorations have been done on understanding the text content of a query or a document. This paper studies leveraging a recently proposed contextual neural language model, BERT, to provide deeper text understanding for IR. Experimental results demonstrate that the contextual text representations from BERT are more effective than traditional word embeddings. Compared to bag of words retrieval models, the contextual language model can better leverage language structures, bringing large improvements on queries written in natural languages. Combining the text understanding ability with search knowledge leads to an enhanced pre trained BERT model that can benefit related search tasks where training data are limited.


On the nilpotency index of the radical of a module category. Let A be a finite dimensional representation finite algebra over an algebraically closed field. The aim of this work is to determine which vertices of Q A are suficient to be consider in order to compute the nilpotency index of the radical of the module category of A . In many cases, we give a formula to compute such index taking into account the ordinary quiver of the given algebra.


Global linear and nonlinear gyrokinetic modelling of Alfv 'en eigenmodes in ITER. Linear and nonlinear modelling of Alfv 'enic instabilities, most notably toroidal Alfv 'en eigenmodes (TAEs), obtained by using the global nonlinear electromagnetic gyrokinetic model of the code ORB5 are presented for the 15 MA scenario of the ITER tokamak. Linear simulations show that elliptic Alfv 'en eigenmodes and odd parity TAEs are only weakly damped but not excited by alpha particles, whose drive favours even parity TAEs. Low mode number TAEs are found to be global, requiring global treatment. Nonlinearly, even with double the nominal EP density, single mode simulations lead to saturation with negligible EP transport however multi mode simulations predict that with double the nominal EP density, enhanced saturation and significant EP redistribution will occur.


Smoothness of Schubert varieties indexed by involutions in finite simply laced types. We prove that in finite, simply laced types, every Schubert variety indexed by an involution which is not the longest element of some parabolic subgroup is singular.


On binomial order avalanches. This paper introduces a discrete limit order book model where new orders are placed with a fixed displacement from the mid price. Further, the trade event occurs whenever the mid price hits the price level on which there is some volume. Therefore, the dynamics of the limit order book model leads to two trading mechanisms, namely Type I trade and Type II trade. A Type I trade takes place whenever the price maximum increases, while a Type II trade occurs if the price drops by mu or more and then increases by mu again. Our focus is mainly on the distribution of order avalanches length, and by an avalanche length we consider a series of order executions where the length of periods with no trade event cannot exceed varepsilon .


Relative singularity categories III Cluster resolutions. We build foundations of an approach to study canonical forms of 2 Calabi Yau triangulated categories with cluster tilting objects, using dg algebras and relative singularity categories. This is motivated by cluster theory, singularity categories, Wemyss's Homological Minimal Model Program and the relations between these topics.


Nanosecond pulsed proton beam upgrade of the accelerator based neutron facility HiSPANOS at CNA (Spain). The 3 MV Tandem Pelletron accelerator at the Spanish Accelerator Laboratory (CNA) has been recently upgraded to produce pulsed ion beams for neutron Time Of Flight (TOF) measurements. The upgrade has consisted of two actions a pulsing system installed at the low energy part of the Tandem accelerator and a new line fully equipped. The pulsing system provides approximately one nanosecond pulse width of protons with variable repetition rates from kHz down to MHz. The new line is equipped with conventional devices and a pick up for timing measurements with high resolution. The properties of the whole system have been tested under various working conditions and they are described in some detail.


Reinforcement Learning Based Dynamic Function Splitting in Disaggregated Green Open RANs. With the growing momentum around Open RAN (O RAN) initiatives, performing dynamic Function Splitting (FS) in disaggregated and virtualized Radio Access Networks (vRANs), in an efficient way, is becoming highly important. An equally important efficiency demand is emerging from the energy consumption dimension of the RAN hardware and software. Supplying the RAN with Renewable Energy Sources (RESs) promises to boost the energy efficiency. Yet, FS in such a dynamic setting, calls for intelligent mechanisms that can adapt to the varying conditions of the RES supply and the traffic load on the mobile network. In this paper, we propose a reinforcement learning (RL) based dynamic function splitting (RLDFS) technique that decides on the function splits in an O RAN to make the best use of RES supply and minimize operator costs. We also formulate an operational expenditure minimization problem. We evaluate the performance of the proposed approach on a real data set of solar irradiation and traffic rate variations. Our results show that the proposed RLDFS method makes effective use of RES and reduces the cost of an MNO. We also investigate the impact of the size of solar panels and batteries which may guide MNOs to decide on proper RES and battery sizing for their networks.


Photonic Crystal Optical Parametric Oscillator. Miniaturization of devices has been a primary objective in microelectronics and photonics for decades, aiming at denser integration, enhanced functionalities and drastic reduction of power consumption. Headway in nanophotonics is currently linked to the progress in concepts and technologies necessary for applications in information and communication, brain inspired computing, medicine and sensing and quantum information. Amongst all nanostructures, semiconductor photonic crystals (PhCs) occupy a prominent position as they enable the fabrication of quasi ultimate optical cavities. Low threshold laser diodes or Raman lasers , low power consuming optical memories , efficient single photon sources or single photon quantum gates are impressive examples of their capabilities. We report the demonstration of about 20 micron long PhC semiconductor optical parametric oscillator (OPO) at telecom wavelength exploiting nearly diffraction limited optical modes. The pump power threshold is measured below 0.2 mW. Parametric oscillation was reached through the drastic enhancement of Kerr optical Four Wave Mixing by thermally tuning the high Q modes of a nanocavity into a triply resonant configuration. Miniaturization of this paradigmatic source of coherent light paves the way for quantum optical circuits, dense integration of highly efficient nonlinear sources of squeezed light or entangled photons pairs.


High Dimensional Uncertainty Quantification via Active and Rank Adaptive Tensor Regression. Uncertainty quantification based on stochastic spectral methods suffers from the curse of dimensionality. This issue was mitigated recently by low rank tensor methods. However, there exist two fundamental challenges in low rank tensor based uncertainty quantification how to automatically determine the tensor rank and how to pick the simulation samples. This paper proposes a novel tensor regression method to address these two challenges. Our method uses an ell q ell 2 norm regularization to determine the tensor rank and an estimated Voronoi diagram to pick informative samples for simulation. The proposed framework is verified by a 19 dim phonics bandpass filter and a 57 dim CMOS ring oscillator, capturing the high dimensional uncertainty well with only 90 and 290 samples respectively.


Simultaneously Linking Entities and Extracting Relations from Biomedical Text Without Mention level Supervision. Understanding the meaning of text often involves reasoning about entities and their relationships. This requires identifying textual mentions of entities, linking them to a canonical concept, and discerning their relationships. These tasks are nearly always viewed as separate components within a pipeline, each requiring a distinct model and training data. While relation extraction can often be trained with readily available weak or distant supervision, entity linkers typically require expensive mention level supervision which is not available in many domains. Instead, we propose a model which is trained to simultaneously produce entity linking and relation decisions while requiring no mention level annotations. This approach avoids cascading errors that arise from pipelined methods and more accurately predicts entity relationships from text. We show that our model outperforms a state of the art entity linking and relation extraction pipeline on two biomedical datasets and can drastically improve the overall recall of the system.


SRQA Synthetic Reader for Factoid Question Answering. The question answering system can answer questions from various fields and forms with deep neural networks, but it still lacks effective ways when facing multiple evidences. We introduce a new model called SRQA, which means Synthetic Reader for Factoid Question Answering. This model enhances the question answering system in the multi document scenario from three aspects model structure, optimization goal, and training method, corresponding to Multilayer Attention (MA), Cross Evidence (CE), and Adversarial Training (AT) respectively. First, we propose a multilayer attention network to obtain a better representation of the evidences. The multilayer attention mechanism conducts interaction between the question and the passage within each layer, making the token representation of evidences in each layer takes the requirement of the question into account. Second, we design a cross evidence strategy to choose the answer span within more evidences. We improve the optimization goal, considering all the answers' locations in multiple evidences as training targets, which leads the model to reason among multiple evidences. Third, adversarial training is employed to high level variables besides the word embedding in our model. A new normalization method is also proposed for adversarial perturbations so that we can jointly add perturbations to several target variables. As an effective regularization method, adversarial training enhances the model's ability to process noisy data. Combining these three strategies, we enhance the contextual representation and locating ability of our model, which could synthetically extract the answer span from several evidences. We perform SRQA on the WebQA dataset, and experiments show that our model outperforms the state of the art models (the best fuzzy score of our model is up to 78.56 , with an improvement of about 2 ).


Scalable High Performance SDN Switch Architecture on FPGA for Core Networks. Due to the increasing heterogeneity in network user requirements, dynamically varying day to day network traffic patterns and delay in network service deployment, there is a huge demand for scalability and flexibility in modern networking infrastructure, which in return has paved way for the introduction of Software Defined Networking (SDN) in core networks. In this paper, we present an FPGA based switch that is fully compliant with OpenFlow the pioneering protocol for southbound interface of SDN. The switch architecture is completely implemented on hardware. The design consists of an OpenFlow Southbound agent which can process OpenFlow packets at a rate of 10Gbps. The proposed architecture speed scales up to 400Gbps while it consumes only 60 of resources on a Xilinx Virtex 7 featuring XC7VX485T FPGA.


Encoding labelled p Riordan graphs by words and pattern avoiding permutations. The notion of a p Riordan graph generalizes that of a Riordan graph, which, in turn, generalizes the notions of a Pascal graph and a Toeplitz graph. In this paper we introduce the notion of a p Riordan word, and show how to encode p Riordan graphs by p Riordan words. For special important cases of Riordan graphs (the case p 2 ) and oriented Riordan graphs (the case p 3 ) we provide alternative encodings in terms of pattern avoiding permutations and certain balanced words, respectively. As a bi product of our studies, we provide an alternative proof of a known enumerative result on closed walks in the cube.


Kinematic Modeling and Compliance Modulation of Redundant Manipulators Under Bracing Constraints. Collaborative robots should ideally use low torque actuators for passive safety reasons. However, some applications require these collaborative robots to reach deep into confined spaces while assisting a human operator in physically demanding tasks. In this paper, we consider the use of in situ collaborative robots (ISCRs) that balance the conflicting demands of passive safety dictating low torque actuation and the need to reach into deep confined spaces. We consider the judicious use of bracing as a possible solution to these conflicting demands and present a modeling framework that takes into account the constrained kinematics and the effect of bracing on the end effector compliance. We then define a redundancy resolution framework that minimizes the directional compliance of the end effector while maximizing end effector dexterity. Kinematic simulation results show that the redundancy resolution strategy successfully decreases compliance and improves kinematic conditioning while satisfying the constraints imposed by the bracing task. Applications of this modeling framework can support future research on the choice of bracing locations and support the formation of an admittance control framework for collaborative control of ISCRs under bracing constraints. Such robots can benefit workers in the future by reducing the physiological burdens that contribute to musculoskeletal injury.


Idempotent solutions of the Yang Baxter equation and twisted group division. Idempotent left nondegenerate solutions of the Yang Baxter equation are in one to one correspondence with twisted Ward left quasigroups, which are left quasigroups satisfying the identity (x y) (x z) (y y) (y z) . Using combinatorial properties of the Cayley kernel and the squaring mapping, we prove that a twisted Ward left quasigroup of prime order is either permutational or a quasigroup. Up to isomorphism, all twisted Ward quasigroups (X, ) are obtained by twisting the left division operation in groups (that is, they are of the form x y psi(x 1 y) for a group (X, cdot) and its automorphism psi ), and they correspond to idempotent latin solutions. We solve the isomorphism problem for idempotent latin solutions.


Structural Plan of Indoor Scenes with Personalized Preferences. In this paper, we propose an assistive model that supports professional interior designers to produce industrial interior decoration solutions and to meet the personalized preferences of the property owners. The proposed model is able to automatically produce the layout of objects of a particular indoor scene according to property owners' preferences. In particular, the model consists of the extraction of abstract graph, conditional graph generation, and conditional scene instantiation. We provide an interior layout dataset that contains real world 11000 designs from professional designers. Our numerical results on the dataset demonstrate the effectiveness of the proposed model compared with the state of art methods.


Timely Synchronization with Sporadic Status Changes. In this paper, we consider a status updating system where the transmitter sends status updates of the signal it monitors to the destination through a rate limited link. We consider the scenario where the status of the monitored signal only changes at discrete time points. The objective is to let the destination be synchronized with the source in a timely manner once a status change happens. What complicates the problem is that the transmission takes multiple time slots due to the link rate constraint. Thus, the transmitter has to decide to switch or to skip a new update when the status of the monitored signal changes and it has not completed the transmission of the previous one yet. We adopt a metric called "Age of Synchronization" (AoS) to measure the "dissatisfaction" of the destination when it is desynchronized with the source. Then, the objective of this paper is to minimize the time average AoS by designing optimal transmission policies for the transmitter. We formulate the problem as a Markov decision process (MDP) and prove the multi threshold structure of the optimal policy. Based on that, we propose a low computational complexity algorithm for the MDP value iteration. We then evaluate the performance of the multi threshold policy through simulations and compare it with two baseline policies and the AoI optimal policy.


Deep Robust Clustering by Contrastive Learning. Recently, many unsupervised deep learning methods have been proposed to learn clustering with unlabelled data. By introducing data augmentation, most of the latest methods look into deep clustering from the perspective that the original image and its transformation should share similar semantic clustering assignment. However, the representation features could be quite different even they are assigned to the same cluster since softmax function is only sensitive to the maximum value. This may result in high intra class diversities in the representation feature space, which will lead to unstable local optimal and thus harm the clustering performance. To address this drawback, we proposed Deep Robust Clustering (DRC). Different from existing methods, DRC looks into deep clustering from two perspectives of both semantic clustering assignment and representation feature, which can increase inter class diversities and decrease intra class diversities simultaneously. Furthermore, we summarized a general framework that can turn any maximizing mutual information into minimizing contrastive loss by investigating the internal relationship between mutual information and contrastive learning. And we successfully applied it in DRC to learn invariant features and robust clusters. Extensive experiments on six widely adopted deep clustering benchmarks demonstrate the superiority of DRC in both stability and accuracy. e.g., attaining 71.6 mean accuracy on CIFAR 10, which is 7.1 higher than state of the art results.


Tiny Video Networks. Video understanding is a challenging problem with great impact on the abilities of autonomous agents working in the real world. Yet, solutions so far have been computationally intensive, with the fastest algorithms running for more than half a second per video snippet on powerful GPUs. We propose a novel idea on video architecture learning Tiny Video Networks which automatically designs highly efficient models for video understanding. The tiny video models run with competitive performance for as low as 37 milliseconds per video on a CPU and 10 milliseconds on a standard GPU.


Energy Efficient Power and Channel Allocation in Underlay Device to Multi Device Communications. In this paper, we optimize the energy efficiency (bits s Hz J) of device to multi device (D2MD) wireless communications. While the device to device scenario has been extensively studied to improve the spectral efficiency in cellular networks, the use of multicast communications opens the possibility of reusing the spectrum resources also inside the groups. The optimization problem is formulated as a mixed integer non linear joint optimization for the power control and allocation of resource blocks (RBs) to each group. Our model explicitly considers resource sharing by letting co channel transmission over a RB (up to a maximum of r transmitters) and or transmission through s different channels in each group. We use an iterative decomposition approach, using first matching theory to find a stable even if sub optimal channel allocation, to then optimize the transmission power vectors in each group via fractional programming. Additionally, within this framework, both the network energy efficiency and the max min individual energy efficiency are investigated. We characterize numerically the energy efficient capacity region, and our results show that the normalized energy efficiency is nearly optimal (above 90 percent of the network capacity) for a wide range of minimum rate constraints. This performance is better than that of other matching based techniques previously proposed.


Learning to Purify Noisy Labels via Meta Soft Label Corrector. Recent deep neural networks (DNNs) can easily overfit to biased training data with noisy labels. Label correction strategy is commonly used to alleviate this issue by designing a method to identity suspected noisy labels and then correct them. Current approaches to correcting corrupted labels usually need certain pre defined label correction rules or manually preset hyper parameters. These fixed settings make it hard to apply in practice since the accurate label correction usually related with the concrete problem, training data and the temporal information hidden in dynamic iterations of training process. To address this issue, we propose a meta learning model which could estimate soft labels through meta gradient descent step under the guidance of noise free meta data. By viewing the label correction procedure as a meta process and using a meta learner to automatically correct labels, we could adaptively obtain rectified soft labels iteratively according to current training problems without manually preset hyper parameters. Besides, our method is model agnostic and we can combine it with any other existing model with ease. Comprehensive experiments substantiate the superiority of our method in both synthetic and real world problems with noisy labels compared with current SOTA label correction strategies.


Learning with less data via Weakly Labeled Patch Classification in Digital Pathology. In Digital Pathology (DP), labeled data is generally very scarce due to the requirement that medical experts provide annotations. We address this issue by learning transferable features from weakly labeled data, which are collected from various parts of the body and are organized by non medical experts. In this paper, we show that features learned from such weakly labeled datasets are indeed transferable and allow us to achieve highly competitive patch classification results on the colorectal cancer (CRC) dataset 1 and the PatchCamelyon (PCam) dataset 2 while using an order of magnitude less labeled data.


Majority dynamics and the median process connections, convergence and some new conjectures. We consider the median dynamics process in general graphs. In this model, each vertex has an independent initial opinion uniformly distributed in the interval 0,1 and, with rate one, updates its opinion to coincide with the median of its neighbors. This process provides a continuous analog of majority dynamics. We deduce properties of median dynamics through this connection and raise new conjectures regarding the behavior of majority dynamics on general graphs. We also prove these conjectures on some graphs where majority dynamics has a simple description.


Visual stream connectivity predicts assessments of image quality. Some biological mechanisms of early vision are comparatively well understood, but they have yet to be evaluated for their ability to accurately predict and explain human judgments of image similarity. From well studied simple connectivity patterns in early vision, we derive a novel formalization of the psychophysics of similarity, showing the differential geometry that provides accurate and explanatory accounts of perceptual similarity judgments. These predictions then are further improved via simple regression on human behavioral reports, which in turn are used to construct more elaborate hypothesized neural connectivity patterns. Both approaches outperform standard successful measures of perceived image fidelity from the literature, as well as providing explanatory principles of similarity perception.


On robust expansiveness for sectional hyperbolic attracting sets. We prove that sectional hyperbolic attracting sets for C 1 vector fields are robustly expansive (under an open technical condition of strong dissipative for higher codimensional cases). This extends known results of expansiveness for singular hyperbolic attractors in 3 flows even in this low dimensional setting. We deduce some converse results taking advantage of recent progress in the study of star vector fields a robustly transitive attractor is sectional hyperbolic if, and only if, it is robustly expansive. In a low dimensional setting, we show that an attracting set of a 3 flow is singular hyperbolic if, and only if, it is robustly chaotic (robustly sensitive to initial conditions).


OODT Obstacle Aware Opportunistic Data Transmission for Cognitive Radio Ad Hoc Networks. In recent years, a large number of smart devices will be connected in Internet of Things (IoT) using an ad hoc network, which needs more frequency spectra. The cognitive radio (CR) technology can improve spectrum utilization in an opportunistic communication manner for IoT, forming a promising paradigm known as cognitive radio ad hoc networks,CRAHNs. However, dynamic spectrum availability and mobile devices persons make it difficult to develop an efficient data transmission scheme for CRAHNs under an obstacle environment. Opportunistic routing can leverage the broadcast nature of wireless channels to enhance network performance. Inspired by this, in this paper, we propose an Obstacle aware Opportunistic Data Transmission scheme (OODT) in CRAHNs from a computational geometry perspective, considering energy efficiency and social features. In the proposed scheme, we exploit a new routing metric, which is based on an obstacle avoiding algorithm using a polygon boundary 1 searcher technology, and an auction model for selecting forwarding candidates. In addition, we prove that the candidate selection problem is NP hard and propose a heuristic algorithm for candidate selection. The simulation results show that the proposed scheme can achieve better performance than existing schemes.


A Survey on Recent Progress in the Theory of Evolutionary Algorithms for Discrete Optimization. The theory of evolutionary computation for discrete search spaces has made significant progress in the last ten years. This survey summarizes some of the most important recent results in this research area. It discusses fine grained models of runtime analysis of evolutionary algorithms, highlights recent theoretical insights on parameter tuning and parameter control, and summarizes the latest advances for stochastic and dynamic problems. We regard how evolutionary algorithms optimize submodular functions and we give an overview over the large body of recent results on estimation of distribution algorithms. Finally, we present the state of the art of drift analysis, one of the most powerful analysis technique developed in this field.


Product throttling for power domination. The product power throttling number of a graph is defined to study product throttling for power domination. The domination number of a graph is an upper bound for its product power throttling number. It is established that the two parameters are equal for certain families including paths, cycles, complete graphs, unit interval graphs, and grid graphs (on the plane, cylinder, and torus). Families of graphs for which the product power throttling number is less than the domination number are also exhibited. Graphs with extremely high or low product power throttling number are characterized and bounds on the product power throttling number are established.


The current state of automated negotiation theory a literature review. Automated negotiation can be an efficient method for resolving conflict and redistributing resources in a coalition setting. Automated negotiation has already seen increased usage in fields such as e commerce and power distribution in smart girds, and recent advancements in opponent modelling have proven to deliver better outcomes. However, significant barriers to more widespread adoption remain, such as lack of predictable outcome over time and user trust. Additionally, there have been many recent advancements in the field of reasoning about uncertainty, which could help alleviate both those problems. As there is no recent survey on these two fields, and specifically not on their possible intersection we aim to provide such a survey here.


On Planar Polynomial Geometric Interpolation. In the paper, the planar polynomial geometric interpolation of data points is revisited. Simple sufficient geometric conditions that imply the existence of the interpolant are derived in general. They require data points to be convex in a certain discrete sense. This way the H "ollig Koch conjecture on the existence and the approximation order is confirmed in the planar case for parametric polynomial curves of any degree.


Kolmogoroff's Strong Law of Large Numbers holds for pairwise uncorrelated random variables. Using the approach of N. Etemadi for the Strong Law of Large Numbers (SLLN) from 1981 and the elaboration of this approach by S. Cs "org H o , K. Tandori and V. Totik from 1983, I give weak conditions under which the SLLN still holds for pairwise uncorrelated (and also "quasi uncorrelated") random variables. I am focusing in particular on random variables which are not identically distributed. The approach also delivers a simple proof for the classical SLLN.


MAD X An Adapter Based Framework for Multi Task Cross Lingual Transfer. The main goal behind state of the art pre trained multilingual models such as multilingual BERT and XLM R is enabling and bootstrapping NLP applications in low resource languages through zero shot or few shot cross lingual transfer. However, due to limited model capacity, their transfer performance is the weakest exactly on such low resource languages and languages unseen during pre training. We propose MAD X, an adapter based framework that enables high portability and parameter efficient transfer to arbitrary tasks and languages by learning modular language and task representations. In addition, we introduce a novel invertible adapter architecture and a strong baseline method for adapting a pre trained multilingual model to a new language. MAD X outperforms the state of the art in cross lingual transfer across a representative set of typologically diverse languages on named entity recognition and causal commonsense reasoning, and achieves competitive results on question answering. Our code and adapters are available at AdapterHub.ml


ReLeaSER A Reinforcement Learning Strategy for Optimizing Utilization Of Ephemeral Cloud Resources. Cloud data center capacities are over provisioned to handle demand peaks and hardware failures which leads to low resources' utilization. One way to improve resource utilization and thus reduce the total cost of ownership is to offer unused resources (referred to as ephemeral resources) at a lower price. However, reselling resources needs to meet the expectations of its customers in terms of Quality of Service. The goal is so to maximize the amount of reclaimed resources while avoiding SLA penalties. To achieve that, cloud providers have to estimate their future utilization to provide availability guarantees. The prediction should consider a safety margin for resources to react to unpredictable workloads. The challenge is to find the safety margin that provides the best trade off between the amount of resources to reclaim and the risk of SLA violations. Most state of the art solutions consider a fixed safety margin for all types of metrics (e.g., CPU, RAM). However, a unique fixed margin does not consider various workloads variations over time which may lead to SLA violations or and poor utilization. In order to tackle these challenges, we propose ReLeaSER, a Reinforcement Learning strategy for optimizing the ephemeral resources' utilization in the cloud. ReLeaSER dynamically tunes the safety margin at the host level for each resource metric. The strategy learns from past prediction errors (that caused SLA violations). Our solution reduces significantly the SLA violation penalties on average by 2.7x and up to 3.4x. It also improves considerably the CPs' potential savings by 27.6 on average and up to 43.6 .


Complexity of limit cycle problems in Boolean networks. Boolean networks are a general model of interacting entities, with applications to biological phenomena such as gene regulation. Attractors play a central role, and the schedule of entities update is a priori unknown. This article presents results on the computational complexity of problems related to the existence of update schedules such that some limit cycle lengths are possible or not. We first prove that given a Boolean network updated in parallel, knowing whether it has at least one limit cycle of length k is text NP complete. Adding an existential quantification on the block sequential update schedule does not change the complexity class of the problem, but the following alternation brings us one level above in the polynomial hierarchy given a Boolean network, knowing whether there exists a block sequential update schedule such that it has no limit cycle of length k is Sigma 2 text P complete.


Similarity Between Points in Metric Measure Spaces. This paper is about similarity between objects that can be represented as points in metric measure spaces. A metric measure space is a metric space that is also equipped with a measure. For example, a network with distances between its nodes and weights assigned to its nodes is a metric measure space. Given points x and y in different metric measure spaces or in the same space, how similar are they? A well known approach is to consider x and y similar if their neighborhoods are similar. For metric measure spaces, similarity between neighborhoods is well captured by the Gromov Hausdorff Prokhorov distance, but it is NP hard to compute this distance even in quite simple cases. We propose a tractable alternative the radial distribution distance between the neighborhoods of x and y. The similarity measure based on the radial distribution distance is coarser than the similarity based on the Gromov Hausdorff Prokhorov distance but much easier to compute.


Language2Pose Natural Language Grounded Pose Forecasting. Generating animations from natural language sentences finds its applications in a a number of domains such as movie script visualization, virtual human animation and, robot motion planning. These sentences can describe different kinds of actions, speeds and direction of these actions, and possibly a target destination. The core modeling challenge in this language to pose application is how to map linguistic concepts to motion animations. In this paper, we address this multimodal problem by introducing a neural architecture called Joint Language to Pose (or JL2P), which learns a joint embedding of language and pose. This joint embedding space is learned end to end using a curriculum learning approach which emphasizes shorter and easier sequences first before moving to longer and harder ones. We evaluate our proposed model on a publicly available corpus of 3D pose data and human annotated sentences. Both objective metrics and human judgment evaluation confirm that our proposed approach is able to generate more accurate animations and are deemed visually more representative by humans than other data driven approaches.


Real Submanifolds in mathcal BSD Models. There are obtained few non equidimensional analogues of the well known Theorem of Moser.


Generalized Constructions of Complementary Sets of Sequences of Lengths Non Power of Two. The construction of complementary sets (CSs) of sequences with different set size and sequence length become important due to its practical application for OFDM systems. Most of the constructions of CSs, based on generalized Boolean functions (GBFs), are of length 2 alpha ( alpha is a natural number). Recently some works have been reported on construction of CSs having lengths non power of two, i.e., in the form of 2 m 1 2 v ( m is natural number, 0 leq v m ), N 1 and N 2 , where N is a length for which q ary complementary pairs exist. In this paper, we propose a construction of CSs of lengths M N for set size 4n , using concatenation of CSs of lengths M and N , and set size 4n , where M and N are lengths for which q ary complementary pairs exists. Also, we construct CSs of length M P for set size 8n by concatenating CSs of lengths M and P , and set size 8n , where M and P are lengths for which q ary complementary pairs and complementary sets of size 4 exists, respectively. The proposed constructions cover all the previous constructions as special cases in terms of lengths and lead to more CSs of new sequence lengths which have not been reported before.


Surface lattice resonance based magneto plasmonic switch in NiFe patterned nano structure. In this work, a 2D magneto plasmonic grating structure combining materials with ferromagnetic and plasmonic properties is demonstrated. NiFe composite ferromagnetic material, as an active medium with tunable physical properties, and Au metal, as a plasmonic excitation layer, were the materials of choice. Here, we have experimentally investigated the active control of the plasmonic characteristics in Au NiFe bilayer by the action of an external magnetic field, as well as the switching effect of the system. The active plasmonic control, can be achieved by the magnetization switching of the ferromagnetic material, opening a new path in the development of active plasmonic devices. To our best knowledge, this is the first demonstration of such a magneto optical plasmonic switch based on the coupling of plasmons with magneto optical active materials, in which the response time was estimated to be in the range of microseconds.


Statistical Characteristics and Community analysis of Urban Road Networks. Urban road networks are typical complex systems, which are crucial to our society and economy. In this study, topological characteristics of a number of urban road networks based on purely physical roads rather than routes of vehicles or buses are investigated in order to discover underlying unique structural features, particularly compared to other types of transport networks. Based on these topological indices, correlations between topological indices and small worldness of urban road networks are also explored. The finding shows that there is no significant small worldness for urban road networks, which is apparently different from other transport networks. Following this, community detection of urban road networks is conducted. The results reveal that communities and hierarchy of urban road networks tend to follow a general nature rule.


Multi Agent Path Finding with Awareness for Spatially Extended Agents. Path finding problems involve identification of a plan for conflict free movement of agents over a common road network. Most approaches to this problem handle the agents as point objects, wherein the size of the agent is significantly smaller than the road on which it travels. In this paper, we consider spatially extended agents which have a size comparable to the length of the road on which they travel. An optimal multi agent path finding approach for spatially extended agents was proposed in the eXtended Conflict Based Search (XCBS) algorithm. As XCBS resolves only a pair of conflicts at a time, it results in deeper search trees in case of cascading or multiple (more than two agent) conflicts at a given location. This issue is addressed in eXtended Conflict Based Search with Awareness (XCBS A) in which an agent uses awareness of other agents' plans to make its own plan. In this paper, we explore XCBS A in greater detail, we theoretically prove its completeness and empirically demonstrate its performance with other algorithms in terms of variances in road characteristics, agent characteristics and plan characteristics. We demonstrate the distributive nature of the algorithm by evaluating its performance when distributed over multiple machines. XCBS A generates a huge search space impacting its efficiency in terms of memory to address this we propose an approach for memory efficiency and empirically demonstrate the performance of the algorithm. The nature of XCBS A is such that it may lead to suboptimal solutions, hence the final contribution of this paper is an enhanced approach, XCBS Local Awareness (XCBS LA) which we prove will be optimal and complete.


TextAttack Lessons learned in designing Python frameworks for NLP. TextAttack is an open source Python toolkit for adversarial attacks, adversarial training, and data augmentation in NLP. TextAttack unites 15 papers from the NLP adversarial attack literature into a single framework, with many components reused across attacks. This framework allows both researchers and developers to test and study the weaknesses of their NLP models. To build such an open source NLP toolkit requires solving some common problems How do we enable users to supply models from different deep learning frameworks? How can we build tools to support as many different datasets as possible? We share our insights into developing a well written, well documented NLP Python framework in hope that they can aid future development of similar packages.


Learning Colour Representations of Search Queries. Image search engines rely on appropriately designed ranking features that capture various aspects of the content semantics as well as the historic popularity. In this work, we consider the role of colour in this relevance matching process. Our work is motivated by the observation that a significant fraction of user queries have an inherent colour associated with them. While some queries contain explicit colour mentions (such as 'black car' and 'yellow daisies'), other queries have implicit notions of colour (such as 'sky' and 'grass'). Furthermore, grounding queries in colour is not a mapping to a single colour, but a distribution in colour space. For instance, a search for 'trees' tends to have a bimodal distribution around the colours green and brown. We leverage historical clickthrough data to produce a colour representation for search queries and propose a recurrent neural network architecture to encode unseen queries into colour space. We also show how this embedding can be learnt alongside a cross modal relevance ranker from impression logs where a subset of the result images were clicked. We demonstrate that the use of a query image colour distance feature leads to an improvement in the ranker performance as measured by users' preferences of clicked versus skipped images.


The relatively perfect Greenberg transform and cycle class maps. Given a scheme over a complete discrete valuation ring of mixed characteristic with perfect residue field, the Greenberg transform produces a new scheme over the residue field thicker than the special fiber. In this paper, we will generalize this transform to the case of imperfect residue field. We will then construct a certain kind of cycle class map defined on this generalized Greenberg transform applied to the N 'eron model of a semi abelian variety, which takes values in the relatively perfect nearby cycle functor defined by Kato and the second author.


Zero divisors of support size 3 in group algebras and trinomials divided by irreducible polynomials over GF(2) . A famous conjecture about group algebras of torsion free groups states that there is no zero divisor in such group algebras. A recent approach to settle the conjecture is to show the non existence of zero divisors with respect to the length of possible ones, where by the length we mean the size of the support of an element of the group algebra. The case length 2 cannot be happen. The first unsettled case is the existence of zero divisors of length 3 . Here we study possible length 3 zero divisors in rational group algebras and in the group algebras over the field with p elements for some prime p .


My tweets bring all the traits to the yard Predicting personality and relational traits in Online Social Networks. Users in Online Social Networks (OSN) leaves traces that reflect their personality characteristics. The study of these traces is important for a number of fields, such as a social science, psychology, OSN, marketing, and others. Despite a marked increase on research in personality prediction on based on online behavior the focus has been heavily on individual personality traits largely neglecting relational facets of personality. This study aims to address this gap by providing a prediction model for a holistic personality profiling in OSNs that included socio relational traits (attachment orientations) in combination with standard personality traits. Specifically, we first designed a feature engineering methodology that extracts a wide range of features (accounting for behavior, language, and emotions) from OSN accounts of users. Then, we designed a machine learning model that predicts scores for the psychological traits of the users based on the extracted features. The proposed model architecture is inspired by characteristics embedded in psychological theory, i.e, utilizing interrelations among personality facets, and leads to increased accuracy in comparison with the state of the art approaches. To demonstrate the usefulness of this approach, we applied our model to two datasets, one of random OSN users and one of organizational leaders, and compared their psychological profiles. Our findings demonstrate that the two groups can be clearly separated by only using their psychological profiles, which opens a promising direction for future research on OSN user characterization and classification.


Optimal Decentralized Control with Asymmetric Partial Information Sharing. This paper considers the optimal decentralized control for networked control systems (NCSs) with asymmetric partial information sharing between two controllers. In this NCSs model, the controller 2 (C2) shares its observations and part of its historical control inputs with the controller 1 (C1), whereas C2 cannot obtain the information of C1 due to network constraints. We present the optimal estimators for C1 and C2 respectively based on asymmetric observations. Since the information for C1 and C2 are asymmetric, the estimation error covariance (EEC) is coupled with the controller which means that the classical separation principle fails. By applying the Pontryagin's maximum principle, we obtain a solution to the forward and backward stochastic difference equations. Based on this solution, we derive the optimal controllers to minimize a quadratic cost function. Combining the optimal controllers with the EEC, the controller C1 is decoupled from the ECC. It should be emphasized that the control gain is dependent on the estimation gain. What's more, the estimation gain satisfies the forward Riccati equation and the control gain satisfies the backward Riccati equation which makes the problem more challenging. We propose iterative solutions to the Riccati equations and give a suboptimal solution to the optimal decentralized control problem.


Population pharmacokinetics and dosing regimen optimization of tacrolimus in Chinese lung transplant recipients. We aimed to develop a population pharmacokinetic model of tacrolimus in Chinese lung transplant recipients, and propose model based dosing regimens for individualized treatment. We obtained 807 tacrolimus whole blood concentrations from 52 lung transplant patients and genotyped CYP3A5 3. Population pharmacokinetic analysis was performed using nonlinear mixed effects modeling. Monte Carlo simulations were employed to design initial dosing regimens. Tacrolimus pharmacokinetics was described by a one compartment model with first order absorption and elimination process. The mean estimated apparent clearance was 13.1 l h with 20.1 inter subject variability in CYP3A5 3 3 70kg patients with 30 hematocrit and voriconazole free therapy, which is lower than that in Caucasian(17.5 to 36.5 l h). Hematocrit, postoperative days, tacrolimus daily dose, voriconazole cotherapy, and CYP3A5 3 genotype were identified as significant covariates for tacrolimus clearance. To achieve the target trough concentration (10 to 15 ng ml) on the 8th day after transplantation, CYP3A5 1 3 patients with voriconazole free cotherapy, a higher initial dosage than the current regimen of 0.04 mg kg q12h should be recommened. Given the nonlinear kinetics of tacrolimus and large variability, population pharmacokinetic model should be combined with therapeutic drug monitoring to optimize individualized therapy.


Solving natural conic formulations with Hypatia.jl. Many convex optimization problems can be represented through conic extended formulations with auxiliary variables and constraints using only the small number of standard cones recognized by advanced conic solvers such as MOSEK 9. Such extended formulations are often significantly larger and more complex than equivalent conic natural formulations, which can use a much broader class of exotic cones. We define an exotic cone as a proper cone for which we can implement tractable logarithmically homogeneous self concordant barrier oracles for either the cone or its dual cone. In this paper we introduce Hypatia, a highly configurable open source conic primal dual interior point solver with a generic interface for exotic cones. Hypatia is written in Julia and accessible through JuMP, and currently implements around two dozen useful predefined cones (some with multiple variants). We define some of Hypatia's exotic cones, and for conic constraints over these cones, we analyze techniques for constructing equivalent representations using the standard cones. For optimization problems from a variety of applications, we introduce natural formulations using these exotic cones, and we show that the natural formulations are simpler and lower dimensional than the equivalent extended formulations. Our computational experiments demonstrate the potential advantages, especially in terms of solve time and memory usage, of solving the natural formulations with Hypatia compared to solving the extended formulations with either Hypatia or MOSEK 9.


Measuring the Biases and Effectiveness of Content Style Disentanglement. A recent spate of state of the art semi and un supervised solutions disentangle and encode image "content" into a spatial tensor and image appearance or "style" into a vector, to achieve good performance in spatially equivariant tasks (e.g. image to image translation). To achieve this, they employ different model design, learning objective, and data biases. While considerable effort has been made to measure disentanglement in vector representations, and assess its impact on task performance, such analysis for (spatial) content style disentanglement is lacking. In this paper, we conduct an empirical study to investigate the role of different biases in content style disentanglement settings and unveil the relationship between the degree of disentanglement and task performance. In particular, we consider the setting where we (i) identify key design choices and learning constraints for three popular content style disentanglement models (ii) relax or remove such constraints in an ablation fashion and (iii) use two metrics to measure the degree of disentanglement and assess its effect on each task performance. Our experiments reveal that there is a "sweet spot" between disentanglement, task performance and surprisingly content interpretability, suggesting that blindly forcing for higher disentanglement can hurt model performance and content factors semanticness. Our findings, as well as the used task independent metrics, can be used to guide the design and selection of new models for tasks where content style representations are useful.


On a discrete elliptic problem with a weight. Using the variational approach and the critical point theory, we established several criteria for the existence of at least one nontrivial solution for a discrete elliptic boundary value problem with a weight p( cdot, cdot) and depending on a real parameter lambda .


The One dimensional Martingale Hardy Spaces and Partial Sums and Fej 'er Means with respect to Walsh system. In this paper we prove and discuss some new left( H p,L p right) type inequalities for partial Sums and Fej 'er means with respect to Walsh system. It is also proved that these results are the best possible in a special sense. As applications, both some well known and new results are pointed out.


Optimizing Deep Learning Inference on Embedded Systems Through Adaptive Model Selection. Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on device inference on battery powered, resource constrained embedding systems is often infeasible due to prohibitively long inferencing time and resource requirements of many DNNs. Offloading computation into the cloud is often unacceptable due to privacy concerns, high latency, or the lack of connectivity. While compression algorithms often succeed in reducing inferencing times, they come at the cost of reduced accuracy. This paper presents a new, alternative approach to enable efficient execution of DNNs on embedded devices. Our approach dynamically determines which DNN to use for a given input, by considering the desired accuracy and inference time. It employs machine learning to develop a low cost predictive model to quickly select a pre trained DNN to use for a given input and the optimization constraint. We achieve this by first off line training a predictive model, and then using the learned model to select a DNN model to use for new, unseen inputs. We apply our approach to two representative DNN domains image classification and machine translation. We evaluate our approach on a Jetson TX2 embedded deep learning platform and consider a range of influential DNN models including convolutional and recurrent neural networks. For image classification, we achieve a 1.8x reduction in inference time with a 7.52 improvement in accuracy, over the most capable single DNN model. For machine translation, we achieve a 1.34x reduction in inference time over the most capable single model, with little impact on the quality of translation.


Non discriminative data or weak model? On the relative importance of data and model resolution. We explore the question of how the resolution of the input image ("input resolution") affects the performance of a neural network when compared to the resolution of the hidden layers ("internal resolution"). Adjusting these characteristics is frequently used as a hyperparameter providing a trade off between model performance and accuracy. An intuitive interpretation is that the reduced information content in the low resolution input causes decay in the accuracy. In this paper, we show that up to a point, the input resolution alone plays little role in the network performance, and it is the internal resolution that is the critical driver of model quality. We then build on these insights to develop novel neural network architectures that we call emph Isometric Neural Networks . These models maintain a fixed internal resolution throughout their entire depth. We demonstrate that they lead to high accuracy models with low activation footprint and parameter count.


BiSET Bi directional Selective Encoding with Template for Abstractive Summarization. The success of neural summarization models stems from the meticulous encodings of source articles. To overcome the impediments of limited and sometimes noisy training data, one promising direction is to make better use of the available training data by applying filters during summarization. In this paper, we propose a novel Bi directional Selective Encoding with Template (BiSET) model, which leverages template discovered from training data to softly select key information from each source article to guide its summarization process. Extensive experiments on a standard summarization dataset were conducted and the results show that the template equipped BiSET model manages to improve the summarization performance significantly with a new state of the art.


Lower bounds for the number of limit cycles in a generalized Rayleigh Li 'enard oscillator. In this paper a generalized Rayleigh Li 'enard oscillator is consider and lower bounds for the number of limit cycles bifurcating from weak focus equilibria and saddle connections are provided. By assuming some open conditions on the parameters of the considered system the existence of up to twelve limit cycles is provided. More precisely, the approach consists in perform suitable changes in the sign of some specific parameters and apply Poincar 'e Bendixson Theorem for assure the existence of limit cycles. In particular, the method for obtaining the limit cycles through the referred approach is explicitly exhibited. The main techniques applied in this study are the Lyapunov constants and the Melnikov method.


Lightweight Inter transaction Caching with Precise Clocks and Dynamic Self invalidation. Distributed, transactional storage systems scale by sharding data across servers. However, workload induced hotspots result in contention, leading to higher abort rates and performance degradation. We present KAIROS, a transactional key value storage system that leverages client side inter transaction caching and sharded transaction validation to balance the dynamic load and alleviate workload induced hotspots in the system. KAIROS utilizes precise synchronized clocks to implement self invalidating leases for cache consistency and avoids the overhead and potential hotspots due to maintaining sharing lists or sending invalidations. Experiments show that inter transaction caching alone provides 2.35x the throughput of a baseline system with only intra transaction caching adding sharded validation further improves the throughput by a factor of 3.1 over baseline. We also show that lease based caching can operate at a 30 higher scale while providing 1.46x the throughput of the state of the art explicit invalidation based caching.