Edge Temperature Ring Oscillation Modulated by Turbulence Transition for Sustaining Stationary Improved Energy Confinement Plasmas. A reproducible stationary improved confinement mode (I mode) has been achieved recently in the Experimental Advanced Superconducting Tokamak, featuring good confinement without particle transport barrier, which could be beneficial to solving the heat flux problem caused by edge localized modes (ELM) and the helium ash problem for future fusion reactors. The microscopic mechanism of sustaining stationary I mode, based on the coupling between turbulence transition and the edge temperature oscillation, has been discovered for the first time. A radially localized edge temperature ring oscillation (ETRO) with azimuthally symmetric structure ( n 0 , m 0 ) has been identified and it is caused by alternative turbulence transitions between ion temperature gradient modes (ITG) and trapped electron modes (TEM). The ITG TEM transition is controlled by local electron temperature gradient and consistent with the gyrokinetic simulations. The self organizing system consisting with ETRO, turbulence and transport transitions plays the key role in sustaining the I mode confinement. These results provide a novel physics basis for accessing, maintaining and controlling stationary I mode in the future.


A SLAM Map Restoration Algorithm Based on Submaps and an Undirected Connected Graph. Many visual simultaneous localization and mapping (SLAM) systems have been shown to be accurate and robust, and have real time performance capabilities on both indoor and ground datasets. However, these methods can be problematic when dealing with aerial frames captured by a camera mounted on an unmanned aerial vehicle (UAV) because the flight height of the UAV can be difficult to control and is easily affected by the environment.To cope with the case of lost tracking, many visual SLAM systems employ a relocalization strategy. This involves the tracking thread continuing the online working by inspecting the connections between the subsequent new frames and the generated map before the tracking was lost. To solve the missing map problem, which is an issue in many applications , after the tracking is lost, based on monocular visual SLAM, we present a method of reconstructing a complete global map of UAV datasets by sequentially merging the submaps via the corresponding undirected connected graph. Specifically, submaps are repeatedly generated, from the initialization process to the place where the tracking is lost, and a corresponding undirected connected graph is built by considering these submaps as nodes and the common map points within two submaps as edges. The common map points are then determined by the bag of words (BoW) method, and the submaps are merged if they are found to be connected with the online map in the undirect connected graph. To demonstrate the performance of the proposed method, we first investigated the performance on a UAV dataset, and the experimental results showed that, in the case of several tracking failures, the integrity of the mapping was significantly better than that of the current mainstream SLAM method.


The Role of Positive and Negative Citations in Scientific Evaluation. Quantifying the impact of scientific papers objectively is crucial for research output assessment, which subsequently affects institution and country rankings, research funding allocations, academic recruitment and national international scientific priorities. While most of the assessment schemes based on publication citations may potentially be manipulated through negative citations, in this study, we explore Conflict of Interest (COI) relationships and discover negative citations and subsequently weaken the associated citation strength. PANDORA (Positive And Negative COI Distinguished Objective Rank Algorithm) has been developed, which captures the positive and negative COI, together with the positive and negative suspected COI relationships. In order to alleviate the influence caused by negative COI relationship, collaboration times, collaboration time span, citation times and citation time span are employed to determine the citing strength while for positive COI relationship, we regard it as normal citation relationship. Furthermore, we calculate the impact of scholarly papers by PageRank and HITS algorithms, based on a credit allocation algorithm which is utilized to assess the impact of institutions fairly and objectively. Experiments are conducted on the publication dataset from American Physical Society (APS) dataset, and the results demonstrate that our method significantly outperforms the current solutions in Recommendation Intensity of list R at top K and Spearman's rank correlation coefficient at top K.


Quantitative absolute continuity of planar measures with two independent Alberti representations. We study measures mu on the plane with two independent Alberti representations. It is known, due to Alberti, Cs "ornyei, and Preiss, that such measures are absolutely continuous with respect to Lebesgue measure. The purpose of this paper is to quantify the result of A C P. Assuming that the representations of mu are bounded from above, in a natural way to be defined in the introduction, we prove that mu in L 2 . If the representations are also bounded from below, we show that mu satisfies a reverse H "older inequality with exponent 2 , and is consequently in L 2 epsilon by Gehring's lemma. A substantial part of the paper is also devoted to showing that both results stated above are optimal.


Urban Bike Lane Planning with Bike Trajectories Models, Algorithms, and a Real World Case Study. We study an urban bike lane planning problem based on the fine grained bike trajectory data, which is made available by smart city infrastructure such as bike sharing systems. The key decision is where to build bike lanes in the existing road network. As bike sharing systems become widespread in the metropolitan areas over the world, bike lanes are being planned and constructed by many municipal governments to promote cycling and protect cyclists. Traditional bike lane planning approaches often rely on surveys and heuristics. We develop a general and novel optimization framework to guide the bike lane planning from bike trajectories. We formalize the bike lane planning problem in view of the cyclists' utility functions and derive an integer optimization model to maximize the utility. To capture cyclists' route choices, we develop a bilevel program based on the Multinomial Logit model. We derive structural properties about the base model and prove that the Lagrangian dual of the bike lane planning model is polynomial time solvable. Furthermore, we reformulate the route choice based planning model as a mixed integer linear program using a linear approximation scheme. We develop tractable formulations and efficient algorithms to solve the large scale optimization problem. Via a real world case study with a city government, we demonstrate the efficiency of the proposed algorithms and quantify the trade off between the coverage of bike trips and continuity of bike lanes. We show how the network topology evolves according to the utility functions and highlight the importance of understanding cyclists' route choices. The proposed framework drives the data driven urban planning scheme in smart city operations management.


MeshSDF Differentiable Iso Surface Extraction. Geometric Deep Learning has recently made striking progress with the advent of continuous Deep Implicit Fields. They allow for detailed modeling of watertight surfaces of arbitrary topology while not relying on a 3D Euclidean grid, resulting in a learnable parameterization that is not limited in resolution. Unfortunately, these methods are often not suitable for applications that require an explicit mesh based surface representation because converting an implicit field to such a representation relies on the Marching Cubes algorithm, which cannot be differentiated with respect to the underlying implicit field. In this work, we remove this limitation and introduce a differentiable way to produce explicit surface mesh representations from Deep Signed Distance Functions. Our key insight is that by reasoning on how implicit field perturbations impact local surface geometry, one can ultimately differentiate the 3D location of surface samples with respect to the underlying deep implicit field. We exploit this to define MeshSDF, an end to end differentiable mesh representation which can vary its topology. We use two different applications to validate our theoretical insight Single View Reconstruction via Differentiable Rendering and Physically Driven Shape Optimization. In both cases our differentiable parameterization gives us an edge over state of the art algorithms.


HDMI Walk Attacking HDMI Distribution Networks via Consumer Electronic Control Protocol. The High Definition Multimedia Interface (HDMI) is the de facto standard for Audio Video interfacing between video enabled devices. Today, almost tens of billions of HDMI devices exist worldwide and are widely used to distribute A V signals in smart homes, offices, concert halls, and sporting events making HDMI one of the most highly deployed systems in the world. An important component in HDMI is the Consumer Electronics Control (CEC) protocol, which allows for the interaction between devices within an HDMI distribution network. Nonetheless, existing network security mechanisms only protect traditional networking components, leaving CEC outside of their scope. In this work, we identify and tap into CEC protocol vulnerabilities, using them to implement realistic proof of work attacks on HDMI distribution networks. We study, how current insecure CEC protocol practices and HDMI distributions may grant an adversary a novel attack surface for HDMI devices otherwise thought to be unreachable. To introduce this novel attack surface, we present HDMI Walk, which opens a realm of remote and local CEC attacks to HDMI devices. Specifically, with HDMI Walk, an attacker can perform malicious analysis of devices, eavesdropping, Denial of Service attacks, targeted device attacks, and even facilitate well known existing attacks through HDMI. With HDMI Walk, we prove it is feasible for an attacker to gain arbitrary control of HDMI devices. We demonstrate the implementations of both local and remote attacks with commodity HDMI devices. Finally, we discuss security mechanisms to provide impactful and comprehensive security evaluation to these real world systems while guaranteeing deployability and providing minimal overhead considering the current limitations of the CEC protocol. To the best of our knowledge, this is the first work solely investigating the security of HDMI device distribution networks.


Few shot Object Grounding and Mapping for Natural Language Robot Instruction Following. We study the problem of learning a robot policy to follow natural language instructions that can be easily extended to reason about new objects. We introduce a few shot language conditioned object grounding method trained from augmented reality data that uses exemplars to identify objects and align them to their mentions in instructions. We present a learned map representation that encodes object locations and their instructed use, and construct it from our few shot grounding output. We integrate this mapping approach into an instruction following policy, thereby allowing it to reason about previously unseen objects at test time by simply adding exemplars. We evaluate on the task of learning to map raw observations and instructions to continuous control of a physical quadcopter. Our approach significantly outperforms the prior state of the art in the presence of new objects, even when the prior approach observes all objects during training.


TMEM240 mutations cause spinocerebellar ataxia 21 with mental retardation and severe cognitive impairment. Autosomal dominant cerebellar ataxia corresponds to a clinically and genetically heterogeneous group of neurodegenerative disorders that primarily affect the cerebellum. Here, we report the identification of the causative gene in spinocerebellar ataxia 21, an autosomal dominant disorder previously mapped to chromosome 7p21.3 p15.1. This ataxia was firstly characterized in a large French family with slowly progressive cerebellar ataxia, accompanied by severe cognitive impairment and mental retardation in two young children. Following the recruitment of 12 additional young family members, linkage analysis enabled us to definitively map the disease locus to chromosome 1p36.33 p36.32. The causative mutation, (c.509C4T p.P170L) in the transmembrane protein gene TMEM240, was identified by whole exome sequencing and then was confirmed by Sanger sequencing and co segregation analyses. Index cases from 368 French families with autosomal dominant cerebellar ataxia were also screened for mutations. In seven cases, we identified a range of missense mutations (c.509C4T p.P170L, c.239C4T p.T80M, c.346C4T p.R116C, c.445G4A p.E149K, c.511C4T p.R171W), and a stop mutation (c.489C4G p.Y163 ) in the same gene. TMEM240 is a small, strongly conserved transmembrane protein of unknown function present in cerebellum and brain. Spinocerebellar ataxia 21 may be a particular early onset disease associated with severe cognitive impairment.


Ford Multi AV Seasonal Dataset. This paper presents a challenging multi agent seasonal dataset collected by a fleet of Ford autonomous vehicles at different days and times during 2017 18. The vehicles traversed an average route of 66 km in Michigan that included a mix of driving scenarios such as the Detroit Airport, freeways, city centers, university campus and suburban neighbourhoods, etc. Each vehicle used in this data collection is a Ford Fusion outfitted with an Applanix POS LV GNSS system, four HDL 32E Velodyne 3D lidar scanners, 6 Point Grey 1.3 MP Cameras arranged on the rooftop for 360 degree coverage and 1 Pointgrey 5 MP camera mounted behind the windshield for the forward field of view. We present the seasonal variation in weather, lighting, construction and traffic conditions experienced in dynamic urban environments. This dataset can help design robust algorithms for autonomous vehicles and multi agent systems. Each log in the dataset is time stamped and contains raw data from all the sensors, calibration values, pose trajectory, ground truth pose, and 3D maps. All data is available in Rosbag format that can be visualized, modified and applied using the open source Robot Operating System (ROS). We also provide the output of state of the art reflectivity based localization for bench marking purposes. The dataset can be freely downloaded at our website.


A right inverse of Cauchy Riemann operator bar partial k a in weighted Hilbert space L 2( mathbb C ,e z 2 ) . Using H " o rmander L 2 method for Cauchy Riemann equations from complex analysis, we study a simple differential operator bar partial k a of any order (densely defined and closed) in weighted Hilbert space L 2( mathbb C ,e z 2 ) and prove the existence of a right inverse that is bounded.


Mobile Robot Path Planning in Static Environments using Particle Swarm Optimization. Motion planning is a key element of robotics since it empowers a robot to navigate autonomously. Particle Swarm Optimization is a simple, yet a very powerful optimization technique which has been effectively used in many complex multi dimensional optimization problems. This paper proposes a path planning algorithm based on particle swarm optimization for computing a shortest collision free path for a mobile robot in environments populated with static convex obstacles. The proposed algorithm finds the optimal path by performing random sampling on grid lines generated between the robot start and goal positions. Functionality of the proposed algorithm is illustrated via simulation results for different scenarios.


Abelian Theory. This exposition begins with a systematic account of the theory of group schemes, ultimately specializing to algebraic tori.


Deep Multi Modal Sets. Many vision related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning based methods rely on a late fusion technique whereby multiple feature types are encoded and concatenated and then a multi layer perceptron (MLP) combines the fused embedding to make predictions. This has several limitations, such as an unnatural enforcement that all features be present at all times as well as constraining only a constant number of occurrences of a feature modality at any given time. Furthermore, as more modalities are added, the concatenated embedding grows. To mitigate this, we propose Deep Multi Modal Sets a technique that represents a collection of features as an unordered set rather than one long ever growing fixed size vector. The set is constructed so that we have invariance both to permutations of the feature modalities as well as to the cardinality of the set. We will also show that with particular choices in our model architecture, we can yield interpretable feature performance such that during inference time we can observe which modalities are most contributing to the prediction.With this in mind, we demonstrate a scalable, multi modal framework that reasons over different modalities to learn various types of tasks. We demonstrate new state of the art performance on two multi modal datasets (Ads Parallelity 34 and MM IMDb 1 ).


On stochastic Langevin and Fokker Planck equations the two dimensional case. We prove existence, regularity in H "older classes and estimates from above and below of the fundamental solution of the stochastic Langevin equation. This degenerate SPDE satisfies the weak H "ormander condition. We use a Wentzell's transform to reduce the SPDE to a PDE with random coefficients then we apply a new method, based on the parametrix technique, to construct a fundamental solution. This approach avoids the use of the Duhamel's principle for the SPDE and the related measurability issues that appear in the stochastic framework. Our results are new even for the deterministic equation.


Decentralization in Digital Societies A Design Paradox. Digital societies come with a design paradox On the one hand, technologies, such as Internet of Things, pervasive and ubiquitous systems, allow a distributed local intelligence in interconnected devices of our everyday life such as smart phones, smart thermostats, self driving cars, etc. On the other hand, Big Data collection and storage is managed in a highly centralized fashion, resulting in privacy intrusion, surveillance actions, discriminatory and segregation social phenomena. What is the difference between a distributed and a decentralized system design? How "decentralized" is the processing of our data nowadays? Does centralized design undermine autonomy? Can the level of decentralization in the implemented technologies influence ethical and social dimensions, such as social justice? Can decentralization convey sustainability? Are there parallelisms between the decentralization of digital technology and the decentralization of urban development?


Sarkisov links for index 1 Fano 3 folds in codimension 4. We classify Sarkisov links from index 1 Fano 3 folds anticanonically embedded in codimension 4 that start from so called Type I Tom centres. We apply this to compute the Picard rank of many such Fano 3 folds.


Features of Magnetically induced atomic transitions of Rb D 1 line studied by Doppler free method based on the second derivative of the absorption spectra. We show that the Second Derivative (SD) technique of the absorption spectra of Rb atomic vapours confined in a nanocell with a thickness ell lambda 2 398 nm allows to achieve close to Doppler free spectroscopy. Narrow linewidth and linearity of the SD signal response with respect to transition probabilities allow us to study separately, in an external transverse magnetic field (0.6 to 4 kG), a big number of the atomic transitions of 85 Rb and 87 Rb atoms. Atomic transitions F g,0 rangle rightarrow F e F g,0' rangle , for which the dipole moment is null at zero magnetic field (so called magnetically induced transitions), show a gigantic increase in probability with increasing magnetic field. When a magnetic field is applied on the vapour, we show the possibility of forming a dark resonance on these transitions by adding a coupling laser. We hence demonstrate a five fold increase in the transmission of the probe radiation when the coupling laser is on. Theoretical calculations are in a very good agreement with experimental results.


Explainable CNN attention Networks (C Attention Network) for Automated Detection of Alzheimer's Disease. In this work, we propose three explainable deep learning architectures to automatically detect patients with Alzheimer s disease based on their language abilities. The architectures use (1) only the part of speech features (2) only language embedding features and (3) both of these feature classes via a unified architecture. We use self attention mechanisms and interpretable 1 dimensional ConvolutionalNeural Network (CNN) to generate two types of explanations of the model s action intra class explanation and inter class explanation. The inter class explanation captures the relative importance of each of the different features in that class, while the inter class explanation captures the relative importance between the classes. Note that although we have considered two classes of features in this paper, the architecture is easily expandable to more classes because of its modularity. Extensive experimentation and comparison with several recent models show that our method outperforms these methods with an accuracy of 92.2 and F1 score of 0.952on the DementiaBank dataset while being able to generate explanations. We show by examples, how to generate these explanations using attention values.


SuperMix Supervising the Mixing Data Augmentation. This paper presents a supervised mixing augmentation method termed SuperMix, which exploits the salient regions within input images to construct mixed training samples. SuperMix is designed to obtain mixed images rich in visual features and complying with realistic image priors. To enhance the efficiency of the algorithm, we develop a variant of the Newton iterative method, 65 times faster than gradient descent on this problem. We validate the effectiveness of SuperMix through extensive evaluations and ablation studies on two tasks of object classification and knowledge distillation. On the classification task, SuperMix provides comparable performance to the advanced augmentation methods, such as AutoAugment and RandAugment. In particular, combining SuperMix with RandAugment achieves 78.2 top 1 accuracy on ImageNet with ResNet50. On the distillation task, solely classifying images mixed using the teacher's knowledge achieves comparable performance to the state of the art distillation methods. Furthermore, on average, incorporating mixed images into the distillation objective improves the performance by 3.4 and 3.1 on CIFAR 100 and ImageNet, respectively. it The code is available at https github.com alldbi SuperMix .


Learning Which Features Matter RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually). One reason pretraining on self supervised linguistic tasks is effective is that it teaches models features that are helpful for language understanding. However, we want pretrained models to learn not only to represent linguistic features, but also to use those features preferentially during fine turning. With this goal in mind, we introduce a new English language diagnostic set called MSGS (the Mixed Signals Generalization Set), which consists of 20 ambiguous binary classification tasks that we use to test whether a pretrained model prefers linguistic or surface generalizations during fine tuning. We pretrain RoBERTa models from scratch on quantities of data ranging from 1M to 1B words and compare their performance on MSGS to the publicly available RoBERTa base. We find that models can learn to represent linguistic features with little pretraining data, but require far more data to learn to prefer linguistic generalizations over surface ones. Eventually, with about 30B words of pretraining data, RoBERTa base does demonstrate a linguistic bias with some regularity. We conclude that while self supervised pretraining is an effective way to learn helpful inductive biases, there is likely room to improve the rate at which models learn which features matter.


Relative hyperbolicity of hyperbolic by cyclic groups. Let G be a torsion free hyperbolic group and alpha an automorphism of G . We show that there exists a canonical collection of subgroups that are polynomially growing under alpha , and that the mapping torus of G by alpha is hyperbolic relative to the suspensions of the maximal polynomially growing subgroups under alpha .


Lessons from reinforcement learning for biological representations of space. Neuroscientists postulate 3D representations in the brain in a variety of different coordinate frames (e.g. 'head centred', 'hand centred' and 'world based'). Recent advances in reinforcement learning demonstrate a quite different approach that may provide a more promising model for biological representations underlying spatial perception and navigation. In this paper, we focus on reinforcement learning methods that reward an agent for arriving at a target image without any attempt to build up a 3D 'map'. We test the ability of this type of representation to support geometrically consistent spatial tasks such as interpolating between learned locations using decoding of feature vectors. We introduce a hand crafted representation that has, by design, a high degree of geometric consistency and demonstrate that, in this case, information about the persistence of features as the camera translates (e.g. distant features persist) can improve performance on the geometric tasks. These examples avoid Cartesian (in this case, 2D) representations of space. Non Cartesian, learned representations provide an important stimulus in neuroscience to the search for alternatives to a 'cognitive map'.


Boundary behaviour of some conformal invariants on planar domains. The purpose of this note is to use the scaling principle to study the boundary behaviour of some conformal invariants on planar domains. The focus is on the Aumann Carath ' e odory rigidity constant, the higher order curvatures of the Carath ' e odory metric and two conformal metrics that have been recently defined.


Monte Carlo Siamese Policy on Actor for Satellite Image Super Resolution. In the past few years supervised and adversarial learning have been widely adopted in various complex computer vision tasks. It seems natural to wonder whether another branch of artificial intelligence, commonly known as Reinforcement Learning (RL) can benefit such complex vision tasks. In this study, we explore the plausible usage of RL in super resolution of remote sensing imagery. Guided by recent advances in super resolution, we propose a theoretical framework that leverages the benefits of supervised and reinforcement learning. We argue that a straightforward implementation of RL is not adequate to address ill posed super resolution as the action variables are not fully known. To tackle this issue, we propose to parameterize action variables by matrices, and train our policy network using Monte Carlo sampling. We study the implications of parametric action space in a model free environment from theoretical and empirical perspective. Furthermore, we analyze the quantitative and qualitative results on both remote sensing and non remote sensing datasets. Based on our experiments, we report considerable improvement over state of the art methods by encapsulating supervised models in a reinforcement learning framework.


F purity deforms in mathbb Q Gorenstein rings. We show that F purity deforms in local mathbb Q Gorenstein rings of prime characteristic p 0 . Furthermore, we show that F purity is mathfrak m adically stable in local Cohen Macaulay mathbb Q Gorenstein rings.


Semi discrete optimal transport methods for the semi geostrophic equations. We give a new and constructive proof of the existence of global in time weak solutions of the 3 dimensional incompressible semi geostrophic equations (SG) in geostrophic coordinates, for arbitrary initial measures with compact support. This new proof, based on semi discrete optimal transport techniques, works by characterising discrete solutions of SG in geostrophic coordinates in terms of trajectories satisfying an ordinary differential equation. It is advantageous in its simplicity and its explicit relation to Eulerian coordinates through the use of Laguerre tessellations. Using our method, we obtain improved time regularity for a large class of discrete initial measures, and we compute explicitly two discrete solutions. The method naturally gives rise to an efficient numerical method, which we illustrate by presenting simulations of a 2 dimensional semi geostrophic flow in geostrophic coordinates generated using a numerical solver for the semi discrete optimal transport problem coupled with an ordinary differential equation solver.


Literature Review and Implementation Overview High Performance Computing with Graphics Processing Units for Classroom and Research Use. In this report, I discuss the history and current state of GPU HPC systems. Although high power GPUs have only existed a short time, they have found rapid adoption in deep learning applications. I also discuss an implementation of a commodity hardware NVIDIA GPU HPC cluster for deep learning research and academic teaching use.


Providing early indication of regional anomalies in COVID19 case counts in England using search engine queries. COVID19 was first reported in England at the end of January 2020, and by mid June over 150,000 cases were reported. We assume that, similarly to influenza like illnesses, people who suffer from COVID19 may query for their symptoms prior to accessing the medical system (or in lieu of it). Therefore, we analyzed searches to Bing from users in England, identifying cases where unexpected rises in relevant symptom searches occurred at specific areas of the country. Our analysis shows that searches for "fever" and "cough" were the most correlated with future case counts, with searches preceding case counts by 16 17 days. Unexpected rises in search patterns were predictive of future case counts multiplying by 2.5 or more within a week, reaching an Area Under Curve (AUC) of 0.64. Similar rises in mortality were predicted with an AUC of approximately 0.61 at a lead time of 3 weeks. Thus, our metric provided Public Health England with an indication which could be used to plan the response to COVID19 and could possibly be utilized to detect regional anomalies of other pathogens.


GraphCrop Subgraph Cropping for Graph Classification. We present a new method to regularize graph neural networks (GNNs) for better generalization in graph classification. Observing that the omission of sub structures does not necessarily change the class label of the whole graph, we develop the textbf GraphCrop (Subgraph Cropping) data augmentation method to simulate the real world noise of sub structure omission. In principle, GraphCrop utilizes a node centric strategy to crop a contiguous subgraph from the original graph while maintaining its connectivity. By preserving the valid structure contexts for graph classification, we encourage GNNs to understand the content of graph structures in a global sense, rather than rely on a few key nodes or edges, which may not always be present. GraphCrop is parameter learning free and easy to implement within existing GNN based graph classifiers. Qualitatively, GraphCrop expands the existing training set by generating novel and informative augmented graphs, which retain the original graph labels in most cases. Quantitatively, GraphCrop yields significant and consistent gains on multiple standard datasets, and thus enhances the popular GNNs to outperform the baseline methods.


Yosys nextpnr an Open Source Framework from Verilog to Bitstream for Commercial FPGAs. This paper introduces a fully free and open source software (FOSS) architecture neutral FPGA framework comprising of Yosys for Verilog synthesis, and nextpnr for placement, routing, and bitstream generation. Currently, this flow supports two commercially available FPGA families, Lattice iCE40 (up to 8K logic elements) and Lattice ECP5 (up to 85K elements) and has been hardware proven for custom computing machines including a low power neural network accelerator and an OpenRISC system on chip capable of booting Linux. Both Yosys and nextpnr have been engineered in a highly flexible manner to support many of the features present in modern FPGAs by separating architecture specific details from the common mapping algorithms. This framework is demonstrated on a longest path case study to find an atypical single source sink path occupying up to 45 of all on chip wiring.


Tunable Isolated Attosecond X ray Pulses with Gigawatt Peak Power from a Free Electron Laser. The quantum mechanical motion of electrons in molecules and solids occurs on the sub femtosecond timescale. Consequently, the study of ultrafast electronic phenomena requires the generation of laser pulses shorter than 1 fs and of sufficient intensity to interact with their target with high probability. Probing these dynamics with atomic site specificity requires the extension of sub femtosecond pulses to the soft X ray spectral region. Here we report the generation of isolated GW scale soft X ray attosecond pulses with an X ray free electron laser. Our source has a pulse energy that is six orders of magnitude larger than any other source of isolated attosecond pulses in the soft X ray spectral region, with a peak power in the tens of gigawatts. This unique combination of high intensity, high photon energy and short pulse duration enables the investigation of electron dynamics with X ray non linear spectroscopy and single particle imaging.


Improved Code Summarization via a Graph Neural Network. Automatic source code summarization is the task of generating natural language descriptions for source code. Automatic code summarization is a rapidly expanding research area, especially as the community has taken greater advantage of advances in neural network and AI technologies. In general, source code summarization techniques use the source code as input and outputs a natural language description. Yet a strong consensus is developing that using structural information as input leads to improved performance. The first approaches to use structural information flattened the AST into a sequence. Recently, more complex approaches based on random AST paths or graph neural networks have improved on the models using flattened ASTs. However, the literature still does not describe the using a graph neural network together with source code sequence as separate inputs to a model. Therefore, in this paper, we present an approach that uses a graph based neural architecture that better matches the default structure of the AST to generate these summaries. We evaluate our technique using a data set of 2.1 million Java method comment pairs and show improvement over four baseline techniques, two from the software engineering literature, and two from machine learning literature.


Deep Models and Shortwave Infrared Information to Detect Face Presentation Attacks. This paper addresses the problem of face presentation attack detection using different image modalities. In particular, the usage of short wave infrared (SWIR) imaging is considered. Face presentation attack detection is performed using recent models based on Convolutional Neural Networks using only carefully selected SWIR image differences as input. Conducted experiments show superior performance over similar models acting on either color images or on a combination of different modalities (visible, NIR, thermal and depth), as well as on a SVM based classifier acting on SWIR image differences. Experiments have been carried on a new public and freely available database, containing a wide variety of attacks. Video sequences have been recorded thanks to several sensors resulting in 14 different streams in the visible, NIR, SWIR and thermal spectra, as well as depth data. The best proposed approach is able to almost perfectly detect all impersonation attacks while ensuring low bonafide classification errors. On the other hand, obtained results show that obfuscation attacks are more difficult to detect. We hope that the proposed database will foster research on this challenging problem. Finally, all the code and instructions to reproduce presented experiments is made available to the research community.


Elastic Anisotropy Governs the Decay of Cell induced Displacements. The unique nonlinear mechanics of the fibrous extracellular matrix (ECM) facilitates long range cell cell mechanical communications that would be impossible on linear elastic substrates. Past research has described the contribution of two separated effects on the range of force transmission, including ECM elastic non linearity and fiber alignment. However, the relation between these different effects is unclear, and how they combine to dictate force transmission range is still elusive. Here, we combine discrete fiber simulations with continuum modeling to study the decay of displacements induced by a contractile cell in fibrous networks. We demonstrate that fiber non linearity and fiber reorientation both contribute to the strain induced anisotropy of the elastic moduli of the cell local environment. This elastic anisotropy is a parameter that governs the slow decay of the displacements, and it depends on the magnitude of applied strain, either an external tension or an internal contraction as a model of the cell. Furthermore, we show that accounting for artificially prescribed elastic anisotropy dictates the displacement decay induced by a contracting cell. Our findings unify previous single effects into a mechanical theory that explains force transmission in fibrous networks. This work provides important insights into biological processes that involve the coordinated action of distant cells mediated by the ECM, such that occur in morphogenesis, wound healing, angiogenesis, and cancer metastasis. It may also provide design parameters for biomaterials to control force transmission between cells, as a way to guide morphogenesis in tissue engineering.


Transforming Facial Weight of Real Images by Editing Latent Space of StyleGAN. We present an invert and edit framework to automatically transform facial weight of an input face image to look thinner or heavier by leveraging semantic facial attributes encoded in the latent space of Generative Adversarial Networks (GANs). Using a pre trained StyleGAN as the underlying generator, we first employ an optimization based embedding method to invert the input image into the StyleGAN latent space. Then, we identify the facial weight attribute direction in the latent space via supervised learning and edit the inverted latent code by moving it positively or negatively along the extracted feature axis. Our framework is empirically shown to produce high quality and realistic facial weight transformations without requiring training GANs with a large amount of labeled face images from scratch. Ultimately, our framework can be utilized as part of an intervention to motivate individuals to make healthier food choices by visualizing the future impacts of their behavior on appearance.


Efficient Ladder style DenseNets for Semantic Segmentation of Large Images. Recent progress of deep image classification models has provided great potential to improve state of the art performance in related computer vision tasks. However, the transition to semantic segmentation is hampered by strict memory limitations of contemporary GPUs. The extent of feature map caching required by convolutional backprop poses significant challenges even for moderately sized Pascal images, while requiring careful architectural considerations when the source resolution is in the megapixel range. To address these concerns, we propose a novel DenseNet based ladder style architecture which features high modelling power and a very lean upsampling datapath. We also propose to substantially reduce the extent of feature map caching by exploiting inherent spatial efficiency of the DenseNet feature extractor. The resulting models deliver high performance with fewer parameters than competitive approaches, and allow training at megapixel resolution on commodity hardware. The presented experimental results outperform the state of the art in terms of prediction accuracy and execution speed on Cityscapes, Pascal VOC 2012, CamVid and ROB 2018 datasets. Source code will be released upon publication.


Poisson Dixmier Moeglin equivalence from a topological point of view. In this paper, we provide some topological criteria for the Poisson Dixmier Moeglin equivalence for A in terms of the poset ( rm P. spec A , subseteq) and the symplectic leaf or core stratification on its maximal spectrum. In particular, we prove that the Zariski topology of the Poisson prime spectrum and of each symplectic leaf or core can detect the Poisson Dixmier Moeglin equivalence for any complex affine Poisson algebra. Moreover, we generalize the weaker version of the Poisson Dixmier Moeglin equivalence for a complex affine Poisson algebra proved in J. Bell, S. Launois, O.L. S 'anchez, and B. Moosa, Poisson algebras via model theory and differential algebraic geometry, J. Eur. Math. Soc. (JEMS), 19(2017), no. 7, 2019 2049 to the general context of a commutative differential algebra.


Reinforcement Learning Evaluation and Solution for the Feedback Capacity of the Ising Channel with Large Alphabet. We propose a new method to compute the feedback capacity of unifilar finite state channels (FSCs) with memory using reinforcement learning (RL). The feedback capacity was previously estimated using its formulation as a Markov decision process (MDP) with dynamic programming (DP) algorithms. However, their computational complexity grows exponentially with the channel alphabet size. Therefore, we use RL, and specifically its ability to parameterize value functions and policies with neural networks, to evaluate numerically the feedback capacity of channels with a large alphabet size. The outcome of the RL algorithm is a numerical lower bound on the feedback capacity, which is used to reveal the structure of the optimal solution. The structure is modeled by a graph based auxiliary random variable that is utilized to derive an analytic upper bound on the feedback capacity with the duality bound. The capacity computation is concluded by verifying the tightness of the upper bound by testing whether it is BCJR invariant. We demonstrate this method on the Ising channel with an arbitrary alphabet size. For an alphabet size smaller than or equal to 8, we derive the analytic solution of the capacity. Next, the structure of the numerical solution is used to deduce a simple coding scheme that achieves the feedback capacity and serves as a lower bound for larger alphabets. For an alphabet size greater than 8, we present an upper bound on the feedback capacity. For an asymptotically large alphabet size, we present an asymptotic optimal coding scheme.


Conjugacy in the Cantor Set Automorphism Group. We survey, and extend, results on the adjoint action of the homeomorphism group H(X) on the space of surjective continuous maps, C s(X) , where X is a Cantor set. We look also at the restriction of the action to various dynamically defined subsets of C s(X) , e. g. the sets of topologically transitive maps, chain transitive maps, chain mixing maps, etc. In each case, we consider whether there exist elements with a dense conjugacy class and if so, what the generic elements look like.


Twins BFT Systems Made Robust. This paper presents Twins, an automated unit test generator of Byzantine attacks. Twins implements three types of Byzantine behaviors (i) leader equivocation, (ii) double voting, and (iii) losing internal state such as forgetting 'locks' guarding voted values. To emulate interesting attacks by a Byzantine node, it instantiates twin copies of the node instead of one, giving both twins the same identities and network credentials. To the rest of the system, the twins appear indistinguishable from a single node behaving in a 'questionable' manner. Twins can systematically generate Byzantine attack scenarios at scale, execute them in a controlled manner, and examine their behavior. Twins scenarios iterate over protocol rounds and vary the communication patterns among nodes. Twins runs in a production setting within DiemBFT where it can execute 44M Twins generated scenarios daily. Whereas the system at hand did not manifest errors, subtle safety bugs that were deliberately injected for the purpose of validating the implementation of Twins itself were exposed within minutes. Twins can prevent developers from regressing correctness when updating the codebase, introducing new features, or performing routine maintenance tasks. Twins only requires a thin wrapper over DiemBFT, we thus envision other systems using it. Building on this idea, one new attack and several known attacks against other BFT protocols were materialized as Twins scenarios. In all cases, the target protocols break within fewer than a dozen protocol rounds, hence it is realistic for the Twins approach to expose the problems.


Domain Transfer in Dialogue Systems without Turn Level Supervision. Task oriented dialogue systems rely heavily on specialized dialogue state tracking (DST) modules for dynamically predicting user intent throughout the conversation. State of the art DST models are typically trained in a supervised manner from manual annotations at the turn level. However, these annotations are costly to obtain, which makes it difficult to create accurate dialogue systems for new domains. To address these limitations, we propose a method, based on reinforcement learning, for transferring DST models to new domains without turn level supervision. Across several domains, our experiments show that this method quickly adapts off the shelf models to new domains and performs on par with models trained with turn level supervision. We also show our method can improve models trained using turn level supervision by subsequent fine tuning optimization toward dialog level rewards.


CARVE Practical Security Focused Software Debloating Using Simple Feature Set Mappings. Software debloating is an emerging field of study aimed at improving the security and performance of software by removing excess library code and features that are not needed by the end user (called bloat). Software bloat is pervasive, and several debloating techniques have been proposed to address this problem. While these techniques are effective at reducing bloat, they are not practical for the average user, risk creating unsound programs and introducing vulnerabilities, and are not well suited for debloating complex software such as network protocol implementations. In this paper, we propose CARVE, a simple yet effective security focused debloating technique that overcomes these limitations. CARVE employs static source code annotation to map software features source code, eliminating the need for advanced software analysis during debloating and reducing the overall level of technical sophistication required by the user. CARVE surpasses existing techniques by introducing debloating with replacement, a technique capable of preserving software interoperability and mitigating the risk of creating an unsound program or introducing a vulnerability. We evaluate CARVE in 12 debloating scenarios and demonstrate security and performance improvements that meet or exceed those of existing techniques.


Crawler for Image Acquisition from World Wide Web. Due to the advancement in computer communication and storage technologies, large amount of image data is available on World Wide Web (WWW). In order to locate a particular set of images the available search engines may be used with the help of keywords. Here, the filtering of unwanted data is not done. For the purpose of retrieving relevant images with appropriate keyword(s) an image crawler is designed and implemented. Here, keyword(s) are submitted as query and with the help of sender engine, images are downloaded along with metadata like URL, filename, file size, file access date and time etc.,. Later, with the help of URL, images already present in repository and newly downloaded are compared for uniqueness. Only unique URLs are in turn considered and stored in repository. The images in the repository are used to build novel Content Based Image Retrieval (CBIR) system in future. This repository may be used for various purposes. This image crawler tool is useful in building image datasets which can be used by any CBIR system for training and testing purposes.


Unsupervised Image Classification for Deep Representation Learning. Deep clustering against self supervised learning is a very important and promising direction for unsupervised visual representation learning since it requires little domain knowledge to design pretext tasks. However, the key component, embedding clustering, limits its extension to the extremely large scale dataset due to its prerequisite to save the global latent embedding of the entire dataset. In this work, we aim to make this framework more simple and elegant without performance decline. We propose an unsupervised image classification framework without using embedding clustering, which is very similar to standard supervised training manner. For detailed interpretation, we further analyze its relation with deep clustering and contrastive learning. Extensive experiments on ImageNet dataset have been conducted to prove the effectiveness of our method. Furthermore, the experiments on transfer learning benchmarks have verified its generalization to other downstream tasks, including multi label image classification, object detection, semantic segmentation and few shot image classification.


Topological bounds for graph representations over any field. Haviv ( em European Journal of Combinatorics , 2019) has recently proved that some topological lower bounds on the chromatic number of graphs are also lower bounds on their orthogonality dimension over mathbb R . We show that this holds actually for all known topological lower bounds and all fields. We also improve the topological bound he obtained for the minrank parameter over mathbb R an important graph invariant from coding theory and show that this bound is actually valid for all fields as well. The notion of independent representation over a matroid is introduced and used in a general theorem having these results as corollaries. Related complexity results are also discussed.


Interpretable Goal based Prediction and Planning for Autonomous Driving. We propose an integrated prediction and planning system for autonomous driving which uses rational inverse planning to recognise the goals of other vehicles. Goal recognition informs a Monte Carlo Tree Search (MCTS) algorithm to plan optimal maneuvers for the ego vehicle. Inverse planning and MCTS utilise a shared set of defined maneuvers and macro actions to construct plans which are explainable by means of rationality principles. Evaluation in simulations of urban driving scenarios demonstrate the system's ability to robustly recognise the goals of other vehicles, enabling our vehicle to exploit non trivial opportunities to significantly reduce driving times. In each scenario, we extract intuitive explanations for the predictions which justify the system's decisions.


Turbulence Obstacle Interactions in the Lagrangian Framework Applications for Stochastic Modeling in Canopy Flows. Lagrangian stochastic models are widely used to predict and analyze turbulent dispersion in complex environments, such as in various terrestrial and marine canopy flows. However, due to a lack of empirical data, it is still not understood how particular features of highly inhomogeneous canopy flows affect the Lagrangian statistics. In this work, we study Lagrangian short time statistics by analyzing empirical Lagrangian trajectories in sub volumes of space that are small in comparison with the canopy height. For the analysis we used 3D Lagrangian trajectories measured in a dense canopy flow model in a wind tunnel, using an extended version of real time 3D particle tracking velocimetry (3D PTV). One of our key results is that the random turbulent fluctuations due to the intense dissipation were more dominant than the flow's inhomogeneity in affecting the short time Lagrangian statistics. This amounts to a so called quasi homogeneous regime of Lagrangian statistics at small scales. Using the Lagrangian dataset we calculate the Lagrangian autocorrelation function and the second order Lagrangian structure function, and extract associated parameters, namely a Lagrangian velocity decorrelation timescale, T i , and the Kolmogorov constant, C 0 . We demonstrate that in the quasi homogeneous regime, both these functions are well represented using a second order Lagrangian stochastic model that was designed for homogeneous flows. Furthermore, we show that the spatial variations of the Lagrangian separation of scales, T i tau eta , and the Kolmogorov constant, C 0 , cannot be explained by the variation of the Reynolds number, Re lambda , in space, and that T i tau eta was small as compared with homogeneous turbulence predictions at similar Re lambda . We thus hypothesize that this occurred due to the so called "wake production", and show empirical results supporting our hypothesis.


Symbol Message Passing Decoding of Nonbinary Low Density Parity Check Codes. We present a novel decoding algorithm for q ary low density parity check codes, termed symbol message passing. The proposed algorithm can be seen as a generalization of Gallager B and the binary message passing algorithm by Lechner et al. to q ary codes. We derive density evolution equations for the q ary symmetric channel, compute thresholds for a number of regular low density parity check code ensembles, and verify those by Monte Carlo simulations of long channel codes. The proposed algorithm shows performance advantages with respect to an algorithm of comparable complexity from the literature.


"Reduction of Monetary Cost in Cloud Storage System by Using Extended Strict Timed Causal Consistency". Cloud storage systems have been introduced to provide a scalable, secure, reliable, and highly available data storage environment for the organizations and end users. Therefore, the service provider should grow in a geographical extent. Consequently, extensive storage service provision requires a replication mechanism. Replication imposes many costs on the cloud storage, including the synchronization, communications, storage, etc., costs among the replicas. Moreover, the synchronization process among replicas is a major challenge in cloud storage. Therefore, consistency can be defined as the coordination among the replicas. In this paper, we propose an extension to the strict timed causal consistency by adding the considerations for the monetary costs and the number of violations in the cloud storage systems and call it the extended strict timed causal consistency. Our proposed supports monotonic read, read your write, monotonic write, and write follow read, models by taking into account the causal relations between users' operations, at the client side. Besides, it supports timed causal at the server side. We employed the Cassandra cloud database that supports various consistencies such as all, one, quorum, etc. Our method performs better in reducing staleness rate, the severity of violations, and monetary cost in comparison with all, one, quorum, and causal.


Uniqueness of Dissipative Solution for Camassa Holm Equation with Peakon Antipeakon Initial Data. We give a proof for the uniqueness of dissipative solution for the Camassa Holm equation with some peakon antipeakon initial data following Dafermos' earlier resut in 5 on the Hunter Saxton equation. Our result shows that two existing global existence frameworks, through the vanishing viscosity method by Xin Zhang in 11 and the transformation of coordinate method for dissipative solutions by Bressan Constantin in 3 , give the same solution, for a special but typical initial data forming finite time gradient blowup.


A decentralized approach towards secure firmware updates and testing over commercial IoT Devices. Internet technologies have made a paradigm shift in the fields of computing and data science and one such paradigm defining change is the Internet of Things or IoT. Nowadays, thousands of household appliances use integrated smart devices which allow remote monitoring and control and also allow intensive computational work such as high end AI integrated smart security systems with sustained alerts for the user. The update process of these IoT devices usually lack the ability of checking the security of centralized servers, which may be compromised and host malicious firmware files as it is presumed that the servers are secure during deployment. The solution for this problem can be solved using a decentralized database to hold the hashes and the firmware. This paper discusses the possible implications of insecure servers used to host the firmwares of commercial IoT products, and aims to provide a blockchain based decentralized solution to host firmware files with the property of immutability, and controlled access to the firmware upload functions so as to stop unauthorized use. The paper sheds light over possible hardware implementations and the use of cryptographically secure components in such secure architecture models.


Label free microscopy of mitotic chromosomes using the polarization Orthogonality Breaking technique. The vast majority of the microscopy methods currently available to study biological samples require staining prior to imaging. Nevertheless, the ability to reveal specific cell structures or organelles in a label free manner remains desirable in different contexts. Polarization microscopy has long been considered as an interesting alternative to fluorescence based methods in order to gain specificity on the imaged biological samples. In this work, we show how an original polarization imaging technique, implementing micro wave photonics and referred to as orthogonality breaking (OB) microscopy, can provide informative polarization images from a single scan of the cell sample in a fast and sensitive way. For OB imaging, the sample is probed with a laser setup simultaneously generating two orthogonal polarizations shifted in frequency by a few tens of MHz. If the imaged samples display some polarimetric properties, the orthogonality between the two polarizations is broken, leading to a beatnote interference signal that can be detected with a fast detector. The comparison of the images of various cell lines at different cell cycle stages obtained by OB polarization microscopy and fluorescence confocal images shows that an endogenous polarimetric contrast arizes on compacted chromosomes during cell division. This technique paves the way to label free real time polarization imaging of mitotic chromosomes with further potential applications in histology and cancer diagnosis.


Equations and multidegrees for inverse symmetric matrix pairs. We compute the equations and multidegrees of the biprojective variety that parametrizes pairs of symmetric matrices that are inverse to each other. As a consequence of our work, we provide an alternative proof for a result of Manivel, Michalek, Monin, Seynnaeve and Vodi v c ka that settles a previous conjecture of Sturmfels and Uhler regarding the polynomiality of maximum likelihood degree.


Particle Filter on Episode. Differently from animals, robots can record its experience correctly for long time. We propose a novel algorithm that runs a particle filter on the time sequence of the experience. It can be applied to some teach and replay tasks. In a task, the trainer controls a robot, and the robot records its sensor readings and its actions. We name the sequence of the record an episode, which is derived from the episodic memory of animals. After that, the robot executes the particle filter so as to find a similar situation with the current one from the episode. If the robot chooses the action taken in the similar situation, it can replay the taught behavior. We name this algorithm the particle filter on episode (PFoE). The robot with PFoE shows not only a simple replay of a behavior but also recovery motion from skids and interruption. In this paper, we evaluate the properties of PFoE with a small mobile robot.


Backward shift and nearly invariant subspaces of Fock type spaces. We study the structure of the backward shift invariant and nearly invariant subspaces in weighted Fock type spaces mathcal F W p , whose weight W is not necessarily radial. We show that in the spaces mathcal F W p which contain the polynomials as a dense subspace (in particular, in the radial case) all nontrivial backward shift invariant subspaces are of the form mathcal P n , i.e., finite dimensional subspaces consisting of polynomials of degree at most n . In general, the structure of the nearly invariant subspaces is more complicated. In the case of spaces of slow growth (up to zero exponential type) we establish an analogue of de Branges' Ordering Theorem. We then construct examples which show that the result fails for general Fock type spaces of larger growth.


Semantically Aligned Universal Tree Structured Solver for Math Word Problems. A practical automatic textual math word problems (MWPs) solver should be able to solve various textual MWPs while most existing works only focused on one unknown linear MWPs. Herein, we propose a simple but efficient method called Universal Expression Tree (UET) to make the first attempt to represent the equations of various MWPs uniformly. Then a semantically aligned universal tree structured solver (SAU Solver) based on an encoder decoder framework is proposed to resolve multiple types of MWPs in a unified model, benefiting from our UET representation. Our SAU Solver generates a universal expression tree explicitly by deciding which symbol to generate according to the generated symbols' semantic meanings like human solving MWPs. Besides, our SAU Solver also includes a novel subtree level semanticallyaligned regularization to further enforce the semantic constraints and rationality of the generated expression tree by aligning with the contextual information. Finally, to validate the universality of our solver and extend the research boundary of MWPs, we introduce a new challenging Hybrid Math Word Problems dataset (HMWP), consisting of three types of MWPs. Experimental results on several MWPs datasets show that our model can solve universal types of MWPs and outperforms several state of the art models.


Status of the Laser Spectroscopy and Merged beam Experiments at RICE. Recently, we reported the commissioning of the new cryogenic ion storage ring RICE, which demonstrated potential capabilities for the precise studies of molecular structures and reaction dynamics. In the present article, we describe the status of experimental programs ongoing at RICE with a focus on the laser spectroscopy and merged beam collision experiments.


From Finite Valued Nondeterministic Transducers to Deterministic Two Tape Automata. The question whether P equals NP revolves around the discrepancy between active production and mere verification by Turing machines. In this paper, we examine the analogous problem for finite transducers and automata. Every nondeterministic finite transducer defines a binary relation associating each input word with all output words that the transducer can successfully produce on the given input. Finite valued transducers are those for which there is a finite upper bound on the number of output words that the relation associates with every input word. We characterize finite valued, functional, and unambiguous nondeterministic transducers whose relations can be verified by a deterministic two tape automaton, show how to construct such an automaton if one exists, and prove the undecidability of the criterion.


CycleGT Unsupervised Graph to Text and Text to Graph Generation via Cycle Training. Two important tasks at the intersection of knowledge graphs and natural language processing are graph to text (G2T) and text to graph (T2G) conversion. Due to the difficulty and high cost of data collection, the supervised data available in the two fields are usually on the magnitude of tens of thousands, for example, 18K in the WebNLG 2017 dataset after preprocessing, which is far fewer than the millions of data for other tasks such as machine translation. Consequently, deep learning models for G2T and T2G suffer largely from scarce training data. We present CycleGT, an unsupervised training method that can bootstrap from fully non parallel graph and text data, and iteratively back translate between the two forms. Experiments on WebNLG datasets show that our unsupervised model trained on the same number of data achieves performance on par with several fully supervised models. Further experiments on the non parallel GenWiki dataset verify that our method performs the best among unsupervised baselines. This validates our framework as an effective approach to overcome the data scarcity problem in the fields of G2T and T2G. Our code is available at https github.com QipengGuo CycleGT.


On the spectral type of rank one flows and Banach problem with calculus of generalized Riesz products on the real line. It is shown that a certain class of Riesz product type measures on mathbb R is realized a spectral type of rank one flows. As a consequence, we will establish that some class of rank one flows has a singular spectrum. Some of the results presented here are even new for the mathbb Z action. Our method is based, on one hand, on the extension of Bourgain Klemes Reinhold Peyri ere method, and on the other hand, on the extension of the Central Limit Theorem approach to the real line which gives a new extension of Salem Zygmund Central Limit Theorem. We extended also a formula for Radon Nikodym derivative between two generalized Riesz products obtained by el Abdalaoui Nadkarni and a formula of Mahler measure of the spectral type of rank one flow but in the weak form. We further present an affirmative answer to the flow version of the Banach problem, and we discuss some issues related to flat trigonometric polynomials on the real line in connection with the famous Banach Rhoklin problem in the spectral theory of dynamical systems.


Pool based sequential active learning with multi kernels. We study a pool based sequential active learning (AL), in which one sample is queried at each time from a large pool of unlabeled data according to a selection criterion. For this framework, we propose two selection criteria, named expected kernel discrepancy (EKD) and expected kernel loss (EKL), by leveraging the particular structure of multiple kernel learning (MKL). Also, it is identified that the proposed EKD and EKL successfully generalize the concepts of popular query by committee (QBC) and expected model change (EMC), respectively. Via experimental results with real data sets, we verify the effectiveness of the proposed criteria compared with the existing methods.


On Explicit Branching Programs for the Rectangular Determinant and Permanent Polynomials. We study the arithmetic circuit complexity of some well known family of polynomials through the lens of parameterized complexity. Our main focus is on the construction of explicit algebraic branching programs (ABP) for determinant and permanent polynomials of the emph rectangular symbolic matrix in both commutative and noncommutative settings. The main results are 1. We show an explicit O ( n choose downarrow k 2 ) size ABP construction for noncommutative permanent polynomial of k times n symbolic matrix. We obtain this via an explicit ABP construction of size O ( n choose downarrow k 2 ) for S n,k , noncommutative symmetrized version of the elementary symmetric polynomial S n,k . 2. We obtain an explicit O (2 k) size ABP construction for the commutative rectangular determinant polynomial of the k times n symbolic matrix. 3. In contrast, we show that evaluating the rectangular noncommutative determinant over rational matrices is W 1 hard.


WT5?! Training Text to Text Models to Explain their Predictions. Neural networks have recently achieved human level performance on various challenging natural language processing (NLP) tasks, but it is notoriously difficult to understand why a neural network produced a particular prediction. In this paper, we leverage the text to text framework proposed by Raffel et al.(2019) to train language models to output a natural text explanation alongside their prediction. Crucially, this requires no modifications to the loss function or training and decoding procedures we simply train the model to output the explanation after generating the (natural text) prediction. We show that this approach not only obtains state of the art results on explainability benchmarks, but also permits learning from a limited set of labeled explanations and transferring rationalization abilities across datasets. To facilitate reproducibility and future work, we release our code use to train the models.


Adversarial Alignment of Multilingual Models for Extracting Temporal Expressions from Text. Although temporal tagging is still dominated by rule based systems, there have been recent attempts at neural temporal taggers. However, all of them focus on monolingual settings. In this paper, we explore multilingual methods for the extraction of temporal expressions from text and investigate adversarial training for aligning embedding spaces to one common space. With this, we create a single multilingual model that can also be transferred to unseen languages and set the new state of the art in those cross lingual transfer experiments.


Transfer Learning with intelligent training data selection for prediction of Alzheimer's Disease. Detection of Alzheimer's Disease (AD) from neuroimaging data such as MRI through machine learning has been a subject of intense research in recent years. Recent success of deep learning in computer vision has progressed such research further. However, common limitations with such algorithms are reliance on a large number of training images, and requirement of careful optimization of the architecture of deep networks. In this paper, we attempt solving these issues with transfer learning, where the state of the art VGG architecture is initialized with pre trained weights from large benchmark datasets consisting of natural images. The network is then fine tuned with layer wise tuning, where only a pre defined group of layers are trained on MRI images. To shrink the training data size, we employ image entropy to select the most informative slices. Through experimentation on the ADNI dataset, we show that with training size of 10 to 20 times smaller than the other contemporary methods, we reach state of the art performance in AD vs. NC, AD vs. MCI, and MCI vs. NC classification problems, with a 4 and a 7 increase in accuracy over the state of the art for AD vs. MCI and MCI vs. NC, respectively. We also provide detailed analysis of the effect of the intelligent training data selection method, changing the training size, and changing the number of layers to be fine tuned. Finally, we provide Class Activation Maps (CAM) that demonstrate how the proposed model focuses on discriminative image regions that are neuropathologically relevant, and can help the healthcare practitioner in interpreting the model's decision making process.


RaKUn Rank based Keyword extraction via Unsupervised learning and Meta vertex aggregation. Keyword extraction is used for summarizing the content of a document and supports efficient document retrieval, and is as such an indispensable part of modern text based systems. We explore how load centrality, a graph theoretic measure applied to graphs derived from a given text can be used to efficiently identify and rank keywords. Introducing meta vertices (aggregates of existing vertices) and systematic redundancy filters, the proposed method performs on par with state of the art for the keyword extraction task on 14 diverse datasets. The proposed method is unsupervised, interpretable and can also be used for document visualization.


Karamardian Matrices A Generalization of Q Matrices. A real square matrix A is called a Q matrix if the linear complementarity problem LCP(A,q) has a solution for all q in mathbb R n . This means that for every vector q there exists a vector x such that x geq 0, y Ax q geq 0 and x Ty 0 . A well known result of Karamardian states that if the problems LCP(A,0) and LCP(A,d) for some d in mathbb R n, d 0 have only the zero solution, then A is a Q matrix. By relaxing the condition on d and imposing a condition on the solution vector x in the two problems as above, the authors introduce a new class of matrices called Karamardian matrices, requiring that these two modified problems have only zero as a solution. In this article, a systematic treatment of Karamardian matrices is undertaken. Among other things, it is shown how Karamardian matrices have properties that are analogous to those of Q matrices. A subclass of a recently introduced notion of P matrices is shown to possess the Karamardian property, and for this reason we undertake a thorough study of P matrices and make some fundamental contributions.


Perfect extensions of de Morgan algebras. An algebra mathbb A is called a perfect extension of its subalgebra mathbb B if every congruence of mathbb B has a unique extension to mathbb A . This terminology was used by Blyth and Varlet 1994 . In the case of lattices, this concept was described by Gr "atzer and Wehrung 1999 by saying that mathbb A is a congruence preserving extension of mathbb B . Not many investigations of this concept have been carried out so far. The present authors in another recent study faced the question of when a de Morgan algebra mathbb M is perfect extension of its Boolean subalgebra B( mathbb M) , the so called skeleton of mathbb M . In this note a full solution to this interesting problem is given. The theory of natural dualities in the sense of Davey and Werner 1983 and Clark and Davey 1998 , as well as Boolean product representations, are used as the main tools to obtain the solution.


On enhanced reductive groups (I) Parabolic Schur algebras and the dualities related to degenerate double Hecke algebras. An enhanced algebraic group uG of G GL(V) over bbc is a product variety GL(V) times V , endowed with an enhanced cross product. Associated with a natural tensor representation of uG , there are naturally Levi and parabolic Schur algebras mathcal L and mathcal P respectively. We precisely investigate their structures, and study the dualities on the enhanced tensor representations for variant groups and algebras. In this course, an algebraic model of so called degenerate double Hecke algebras (DDHA) is produced, and becomes a powerful implement. The connection between mathcal L and DDHA gives rise to two results for the classical representations of GL(V) (i) A duality between GL(V) times Gm and DDHA where Gm is the one dimensional multiplicative group (ii) A branching duality formula. With aid of the above discussion, we further obtain a parabolic Schur Weyl duality for uG rtimes Gm . What is more, the parabolic Schur subalgebra turns out to have only one block. The Cartan invariants for this algebra are precisely determined.


Seagull An Infrastructure for Load Prediction and Optimized Resource Allocation. Microsoft Azure is dedicated to guarantee high quality of service to its customers, in particular, during periods of high customer activity, while controlling cost. We employ a Data Science (DS) driven solution to predict user load and leverage these predictions to optimize resource allocation. To this end, we built the Seagull infrastructure that processes per server telemetry, validates the data, trains and deploys ML models. The models are used to predict customer load per server (24h into the future), and optimize service operations. Seagull continually re evaluates accuracy of predictions, fallback to previously known good models and triggers alerts as appropriate. We deployed this infrastructure in production for PostgreSQL and MySQL servers across all Azure regions, and applied it to the problem of scheduling server backups during low load time. This minimizes interference with user induced load and improves customer experience.


A large class of dendrite maps for which M " o bius disjointness property of Sarnak is fulfilled. We prove that any dendrite map for which the set of endpoints is closed and countable fulfilled Sarnak M " o bius disjointness. This extended a result by el Abdalaoui Askri and Marzougui cite ela GH . We further notice that the Smital Ruelle property can be extended to the class of dendrites with closed and countable endpoints.


Monotonic lagrangian tori of standard and non standard types in toric and pseudotoric manifolds. In recent papers, summarized in survey 1 , we construct a number of examples of non standard lagrangian tori on compact toric varieties and as well on certain non toric varieties which admit pseudotoric structures. Using this pseudotoric technique we explain how non standard lagrangian tori of Chekanov type can be constructed and what is the topological difference between standard Liouville tori and the non standard ones. However we have not discussed the natural question about the periods of the constructed twist tori in particular the monotonicity problem for the monotonic case was not studied there. In the paper we present several remarks on these questions, in particular we show for the monotonic case how to construct non standard lagrangian tori which satisify the monotonicity condition. First of all we study non standard tori which are Bohr Sommerfeld with respect to the anticanonical class. This notion was introduced in 2 , where one defines certain universal Maslov class for the rm BS can lagrangian submanifolds in compact simply connected monotonic symplectic manifolds. Then we show how monotonic non standard lagrangian tori of Chekanov type can be constructed. Furthemore we extend the consideration to pseudotoric setup and construct examples of monotonic lagrangian tori in non toric monotonic manifolds complex 4 dimensional quadric and full flag variety F 3 .


Generation of digital patients for the simulation of tuberculosis with UISS TB. EC funded STriTuVaD project aims to test, through a phase IIb clinical trial, two of the most advanced therapeutic vaccines against tuberculosis. In parallel, we have extended the Universal Immune System Simulator to include all relevant determinants of such clinical trial, to establish its predictive accuracy against the individual patients recruited in the trial, to use it to generate digital patients and predict their response to the HRT being tested, and to combine them to the observations made on physical patients using a new in silico augmented clinical trial approach that uses a Bayesian adaptive design. This approach, where found effective could drastically reduce the cost of innovation in this critical sector of public healthcare. One of the most challenging task is to develop a methodology to reproduce biological diversity of the subjects that have to be simulated, i.e., provide an appropriate strategy for the generation of libraries of digital patients. This has been achieved through the the creation of the initial immune system repertoire in a stochastic way, and though the identification of a "vector of features" that combines both biological and pathophysiological parameters that personalize the digital patient to reproduce the physiology and the pathophysiology of the subject.


Expected resurgence of ideals defining Gorenstein rings. Building on previous work by the same authors, we show that certain ideals defining Gorenstein rings have expected resurgence, and thus satisfy the stable Harbourne Conjecture. In prime characteristic, we can take any radical ideal defining a Gorenstein ring in a regular ring, provided its symbolic powers are given by saturations with the maximal ideal. While this property is not suitable for reduction to characteristic p , we show that a similar result holds in equicharacteristic 0 under the additional hypothesis that the symbolic Rees algebra of I is noetherian.


Planning, Learning and Reasoning Framework for Robot Truck Unloading. We consider the task of autonomously unloading boxes from trucks using an industrial manipulator robot. There are multiple challenges that arise (1) real time motion planning for a complex robotic system carrying two articulated mechanisms, an arm and a scooper, (2) decision making in terms of what action to execute next given imperfect information about boxes such as their masses, (3) accounting for the sequential nature of the problem where current actions affect future state of the boxes, and (4) real time execution that interleaves high level decision making with lower level motion planning. In this work, we propose a planning, learning, and reasoning framework to tackle these challenges, and describe its components including motion planning, belief space planning for offline learning, online decision making based on offline learning, and an execution module to combine decision making with motion planning. We analyze the performance of the framework on real world scenarios. In particular, motion planning and execution modules are evaluated in simulation and on a real robot, while offline learning and online decision making are evaluated in simulated real world scenarios.


Empirical Measure and Small Noise Asymptotics under Large Deviation Scaling for Interacting Diffusions. Consider a collection of particles whose state evolution is described through a system of interacting diffusions in which each particle is driven by an independent individual source of noise and also by a small amount of noise that is common to all particles. The interaction between the particles is due to the common noise and also through the drift and diffusion coefficients that depend on the state empirical measure. We study large deviation behavior of the empirical measure process which is governed by two types of scaling, one corresponding to mean field asymptotics and the other to the Freidlin Wentzell small noise asymptotics. Different levels of intensity of the small common noise lead to different types of large deviation behavior, and we provide a precise characterization of the various regimes. We also study large deviation behavior of interacting particle systems approximating various types of Feynman Kac functionals. Proofs are based on stochastic control representations for exponential functionals of Brownian motions and on uniqueness results for weak solutions of stochastic differential equations associated with controlled nonlinear Markov processes.


Polynomial Time Exact MAP Inference on Discrete Models with Global Dependencies. Considering the worst case scenario, junction tree algorithm remains the most general solution for exact MAP inference with polynomial run time guarantees. Unfortunately, its main tractability assumption requires the treewidth of a corresponding MRF to be bounded strongly limiting the range of admissible applications. In fact, many practical problems in the area of structured prediction require modelling of global dependencies by either directly introducing global factors or enforcing global constraints on the prediction variables. That, however, always results in a fully connected graph making exact inference by means of this algorithm intractable. Previous work 1 4 focusing on the problem of loss augmented inference has demonstrated how efficient inference can be performed on models with specific global factors representing non decomposable loss functions within the training regime of SSVMs. In this paper, we extend the framework for an efficient exact inference proposed in in 3 by allowing much finer interactions between the energy of the core model and the sufficient statistics of the global terms with no additional computation costs. We demonstrate the usefulness of our method in several use cases, including one that cannot be handled by any of the previous approaches. Finally, we propose a new graph transformation technique via node cloning which ensures a polynomial run time for solving our target problem independently of the form of a corresponding clique tree. This is important for the efficiency of the main algorithm and greatly improves upon the theoretical guarantees of the previous works.


Classification of limit varieties of J trivial monoids. A variety of algebras is called limit if it is non finitely based but all its proper subvarieties are finitely based. We present a new pair of limit varieties of monoids and show that together with the five limit varieties of monoids previously discovered by Jackson, Zhang and Luo and the first named author, there are exactly seven limit varieties of J trivial monoids.


The tensor embedding for a grothendieck cosmos. While the Yoneda embedding and its generalizations have been studied extensively in the literature, the so called tensor embedding has only received little attention. In this paper, we study the tensor embedding for closed symmetric monoidal categories and show how it is connected to the notion of geometrically purity, which has recently been investigated in works of Enochs, Estrada, Gillespie, and Odaba c s i . More precisely, for a Gro thendieck cosmos that is, a bicomplete Grothendick category mathcal V with a closed symmetric monoidal structure we prove that the geometrically pure exact category ( mathcal V , mathscr E otimes) has enough relative injectives in fact, every object has a geometrically pure injective envelope. We also show that for some regular cardinal lambda , the tensor embedding yields an exact equivalence between ( mathcal V , mathscr E otimes) and the category of lambda cocontinuous mathcal V functors from mbox Pres ( mathcal V ) to mathcal V , where the former is the full mathcal V subcategory of lambda presentable objects in mathcal V . In many cases of interest, lambda can be chosen to be aleph 0 and the tensor embedding identifies the geometrically pure injective objects in mathcal V with the (categorically) injective objects in the abelian category of mathcal V functors from mathrm fp ( mathcal V ) to mathcal V . As we explain, the developed theory applies e.g. to the category mathsf Ch (R) of chain complexes of modules over a commutative ring R and to the category mathsf Qcoh (X) of quasi coherent sheaves over a (suitably nice) scheme X .


EDUQA Educational Domain Question Answering System using Conceptual Network Mapping. Most of the existing question answering models can be largely compiled into two categories i) open domain question answering models that answer generic questions and use large scale knowledge base along with the targeted web corpus retrieval and ii) closed domain question answering models that address focused questioning area and use complex deep learning models. Both the above models derive answers through textual comprehension methods. Due to their inability to capture the pedagogical meaning of textual content, these models are not appropriately suited to the educational field for pedagogy. In this paper, we propose an on the fly conceptual network model that incorporates educational semantics. The proposed model preserves correlations between conceptual entities by applying intelligent indexing algorithms on the concept network so as to improve answer generation. This model can be utilized for building interactive conversational agents for aiding classroom learning.


Self supervised Representation Learning for Evolutionary Neural Architecture Search. Recently proposed neural architecture search (NAS) algorithms adopt neural predictors to accelerate the architecture search. The capability of neural predictors to accurately predict the performance metrics of neural architecture is critical to NAS, and the acquisition of training datasets for neural predictors is time consuming. How to obtain a neural predictor with high prediction accuracy using a small amount of training data is a central problem to neural predictor based NAS. Here, we firstly design a new architecture encoding scheme that overcomes the drawbacks of existing vector based architecture encoding schemes to calculate the graph edit distance of neural architectures. To enhance the predictive performance of neural predictors, we devise two self supervised learning methods from different perspectives to pre train the architecture embedding part of neural predictors to generate a meaningful representation of neural architectures. The first one is to train a carefully designed two branch graph neural network model to predict the graph edit distance of two input neural architectures. The second method is inspired by the prevalently contrastive learning, and we present a new contrastive learning algorithm that utilizes a central feature vector as a proxy to contrast positive pairs against negative pairs. Experimental results illustrate that the pre trained neural predictors can achieve comparable or superior performance compared with their supervised counterparts with several times less training samples. We achieve state of the art performance on the NASBench 101 and NASBench201 benchmarks when integrating the pre trained neural predictors with an evolutionary NAS algorithm.


Hyperparameter Optimization in Binary Communication Networks for Neuromorphic Deployment. Training neural networks for neuromorphic deployment is non trivial. There have been a variety of approaches proposed to adapt back propagation or back propagation like algorithms appropriate for training. Considering that these networks often have very different performance characteristics than traditional neural networks, it is often unclear how to set either the network topology or the hyperparameters to achieve optimal performance. In this work, we introduce a Bayesian approach for optimizing the hyperparameters of an algorithm for training binary communication networks that can be deployed to neuromorphic hardware. We show that by optimizing the hyperparameters on this algorithm for each dataset, we can achieve improvements in accuracy over the previous state of the art for this algorithm on each dataset (by up to 15 percent). This jump in performance continues to emphasize the potential when converting traditional neural networks to binary communication applicable to neuromorphic hardware.


SoK Why Johnny Can't Fix PGP Standardization. Pretty Good Privacy (PGP) has long been the primary IETF standard for encrypting email, but suffers from widespread usability and security problems that have limited its adoption. As time has marched on, the underlying cryptographic protocol has fallen out of date insofar as PGP is unauthenticated on a per message basis and compresses before encryption. There have been an increasing number of attacks on the increasingly outdated primitives and complex clients used by the PGP eco system. However, attempts to update the OpenPGP standard have failed at the IETF except for adding modern cryptographic primitives. Outside of official standardization, Autocrypt is a "bottom up" community attempt to fix PGP, but still falls victim to attacks on PGP involving authentication. The core reason for the inability to "fix" PGP is the lack of a simple AEAD interface which in turn requires a decentralized public key infrastructure to work with email. Yet even if standards like MLS replace PGP, the deployment of a decentralized PKI remains an open issue.


Some Observations on Lambert series, vanishing coefficients and dissections of infinite products and series. Andrews and Bressoud, Alladi and Gordon, and others, have proven, in a number of papers, that the coefficients in various arithmetic progressions in the series expansions of certain infinite q products vanish. In the present paper it is shown that these results follow automatically (simply by specializing parameters) in an identity derived from a special case of Ramanujan's 1 psi 1 identity. Likewise, a number of authors have proven results about the m dissections of certain infinite q products using various methods. It is shown that many of these m dissections also follow automatically (again simply by specializing parameters) from this same identity alluded to above. Two identities that mat be considered as extensions of two Identities of Ramanujan are also derived. It is also shown how applying similar ideas to certain other Lambert series gives rise to some rather curious q series identities, such as, for any positive integer m , begin multline displaystyle frac left(q,q,a, frac q a , frac b q d , frac dq b , frac aq b d , frac b d q a q right) infty left(b, frac q b ,d, frac q d , frac a b , frac bq a , frac a d , frac dq a q right) infty sum r 0 m 1 q r frac left(q m,q m,a q 2 r , frac q m 2 r a , frac b q m d , frac d q m b , frac a q m b d , frac b dq m a q m right) infty left(b q r, frac q m r b ,d q r, frac q m r d , frac a q r b , frac b q m r a , frac a q r d , frac dq m r a q m right) infty end multline and begin equation (aq q) infty sum n 1 infty frac n a n q n (q q) n sum r 1 m (aq r q m) infty sum n 1 infty frac na n q n r (q m q m) n . end equation Applications to the Fine function F(a,b t) are also considered.


Improved bounds for anti Ramsey numbers of matchings in outerplanar graphs. Let mathcal O n be the set of all maximal outerplanar graphs of order n . Let ar( mathcal O n,F) denote the maximum positive integer k such that T in mathcal O n has no rainbow subgraph F under a k edge coloring of T . Denote by M k a matching of size k . In this paper, we prove that ar( mathcal O n,M k) le n 4k 9 for n ge3k 3 , which expressively improves the existing upper bound for ar( mathcal O n,M k) . We also prove that ar( mathcal O n,M 5) n 4 for all n ge 15 .


Average reward model free reinforcement learning a systematic review and literature mapping. Reinforcement learning is important part of artificial intelligence. In this paper, we review model free reinforcement learning that utilizes the average reward optimality criterion in the infinite horizon setting. Motivated by the solo survey by Mahadevan (1996a), we provide an updated review of work in this area and extend it to cover policy iteration and function approximation methods (in addition to the value iteration and tabular counterparts). We present a comprehensive literature mapping. We also identify and discuss opportunities for future work.


Strichartz Estimates with Broken Symmetries. In this note we study the eigenvalue problem for a quadratic form associated with Strichartz estimates for the Schr " o dinger equation, proving in particular a sharp Strichartz inequality for the case of odd initial data. We also describe an alternative method that is applicable to a wider class of matrix problems.


Lorden's inequality and the polynomial rate of convergence of some extended Erlang Sevastyanov queuing system. It is more important to estimate the rate of convergence to a stationary distribution rather than only to prove the existence one in many applied problems of reliability and queuing theory. This can be done via standard methods, but only under assumptions about an exponential distribution of service time, independent intervals between recovery times, etc. Results for such simplest cases are well known. Rejection of these assumptions results to rather complex stochastic processes that cannot be studied using standard algorithms. A more sophisticated approach is needed for such processes. That requires generalizations and proofs of some classical results for a more general case. One of them is the generalized Lorden's inequality proved in this paper. We propose the generalized version of this inequality for the case of dependent and arbitrarily distributed intervals between recovery times. This generalization allows to find upper bounds for the rate of convergence for a wide class of complicated processes arising in the theory of reliability. The rate of convergence for a two component process has been obtained via the generalized Lorden's inequality in this paper.


Generating Representative Headlines for News Stories. Millions of news articles are published online every day, which can be overwhelming for readers to follow. Grouping articles that are reporting the same event into news stories is a common way of assisting readers in their news consumption. However, it remains a challenging research problem to efficiently and effectively generate a representative headline for each story. Automatic summarization of a document set has been studied for decades, while few studies have focused on generating representative headlines for a set of articles. Unlike summaries, which aim to capture most information with least redundancy, headlines aim to capture information jointly shared by the story articles in short length, and exclude information that is too specific to each individual article. In this work, we study the problem of generating representative headlines for news stories. We develop a distant supervision approach to train large scale generation models without any human annotation. This approach centers on two technical components. First, we propose a multi level pre training framework that incorporates massive unlabeled corpus with different quality vs. quantity balance at different levels. We show that models trained within this framework outperform those trained with pure human curated corpus. Second, we propose a novel self voting based article attention layer to extract salient information shared by multiple articles. We show that models that incorporate this layer are robust to potential noises in news stories and outperform existing baselines with or without noises. We can further enhance our model by incorporating human labels, and we show our distant supervision approach significantly reduces the demand on labeled data.