Learning Strategy Aware Linear Classifiers. We address the question of repeatedly learning linear classifiers against agents who are strategically trying to game the deployed classifiers, and we use the Stackelberg regret to measure the performance of our algorithms. First, we show that Stackelberg and external regret for the problem of strategic classification are strongly incompatible i.e., there exist worst case scenarios, where any sequence of actions providing sublinear external regret might result in linear Stackelberg regret and vice versa. Second, we present a strategy aware algorithm for minimizing the Stackelberg regret for which we prove nearly matching upper and lower regret bounds. Finally, we provide simulations to complement our theoretical analysis. Our results advance the growing literature of learning from revealed preferences, which has so far focused on "smoother" assumptions from the perspective of the learner and the agents respectively.


Hardy Spaces for a Class of Singular Domains. We set a framework for the study of Hardy spaces inherited by complements of analytic hypersurfaces in domains with a prior Hardy space structure. The inherited structure is a filtration, various aspects of which are studied in specific settings. For punctured planar domains, we prove a generalization of a famous rigidity lemma of Kerzman and Stein. A stabilization phenomenon is observed for egg domains. Finally, using proper holomorphic maps, we derive a filtration of Hardy spaces for certain power generalized Hartogs triangles, although these domains fall outside the scope of the original framework.


Multimodal Material Classification for Robots using Spectroscopy and High Resolution Texture Imaging. Material recognition can help inform robots about how to properly interact with and manipulate real world objects. In this paper, we present a multimodal sensing technique, leveraging near infrared spectroscopy and close range high resolution texture imaging, that enables robots to estimate the materials of household objects. We release a dataset of high resolution texture images and spectral measurements collected from a mobile manipulator that interacted with 144 household objects. We then present a neural network architecture that learns a compact multimodal representation of spectral measurements and texture images. When generalizing material classification to new objects, we show that this multimodal representation enables a robot to recognize materials with greater performance as compared to prior state of the art approaches. Finally, we present how a robot can combine this high resolution local sensing with images from the robot's head mounted camera to achieve accurate material classification over a scene of objects on a table.


Dr.Quad at MEDIQA 2019 Towards Textual Inference and Question Entailment using contextualized representations. This paper presents the submissions by Team Dr.Quad to the ACL BioNLP 2019 shared task on Textual Inference and Question Entailment in the Medical Domain. Our system is based on the prior work Liu et al. (2019) which uses a multi task objective function for textual entailment. In this work, we explore different strategies for generalizing state of the art language understanding models to the specialized medical domain. Our results on the shared task demonstrate that incorporating domain knowledge through data augmentation is a powerful strategy for addressing challenges posed by specialized domains such as medicine.


Hypergraph Motifs Concepts, Algorithms, and Discoveries. Hypergraphs naturally represent group interactions, which are omnipresent in many domains collaborations of researchers, co purchases of items, joint interactions of proteins, to name a few. In this work, we propose tools for answering the following questions in a systematic manner (Q1) what are structural design principles of real world hypergraphs? (Q2) how can we compare local structures of hypergraphs of different sizes? (Q3) how can we identify domains which hypergraphs are from? We first define hypergraph motifs (h motifs), which describe the connectivity patterns of three connected hyperedges. Then, we define the significance of each h motif in a hypergraph as its occurrences relative to those in properly randomized hypergraphs. Lastly, we define the characteristic profile (CP) as the vector of the normalized significance of every h motif. Regarding Q1, we find that h motifs' occurrences in 11 real world hypergraphs from 5 domains are clearly distinguished from those of randomized hypergraphs. In addition, we demonstrate that CPs capture local structural patterns unique to each domain, and thus comparing CPs of hypergraphs addresses Q2 and Q3. Our algorithmic contribution is to propose MoCHy, a family of parallel algorithms for counting h motifs' occurrences in a hypergraph. We theoretically analyze their speed and accuracy, and we show empirically that the advanced approximate version MoCHy A is up to 25X more accurate and 32X faster than the basic approximate and exact versions, respectively.


The Penalty in Scaling Exponent for Polar Codes is Analytically Approximated by the Golden Ratio. The polarization process of conventional polar codes in binary erasure channel (BEC) is recast to the Domany Kinzel cellular automaton model of directed percolation in a tilted square lattice. Consequently, the former's scaling exponent, mu , can be analogously expressed as the inverse of the percolation critical exponent, beta . Relying on the vast percolation theory literature and the best known numerical estimate for beta , the scaling exponent can be easily estimated as mu text num text perc simeq1 0.276486(8) simeq3.617 , which is only about 0.25 away from the known exponent computation from coding theory literature based on numerical approximation, mu text num simeq3.627 . Remarkably, this numerical result for the critical exponent, beta , can be analytically approximated (within only 0.028 ) leading to the closed form expression for the scaling exponent mu simeq2 varphi 2 1.618 ldots simeq3.618 , where varphi triangleq(1 sqrt 5 ) 2 is the ubiquitous golden ratio. As the ultimate achievable scaling exponent is quadratic, this implies that the penalty for polar codes in BEC, in terms of the scaling exponent, can be very well estimated by the golden ratio, varphi , itself.


High sensitivity, levitated microsphere apparatus for short distance force measurements. A high sensitivity force sensor based on dielectric microspheres in vacuum, optically trapped by a single, upward propagating laser beam, is described. Off axis parabolic mirrors are used both to focus the 1064 nm trapping beam and to recollimate it to provide information on the horizontal position of the microsphere. The vertical degree of freedom is readout by forming an interferometer between the light retroreflected by the microsphere and a reference beam, hence eliminating the need for auxiliary beams. The focus of the trapping beam has a 1 e 2 radius of 3.2 mu m and small non Gaussian tails, suitable for bringing devices close to the trapped microsphere without disturbing the optical field. Electrodes surrounding the trapping region provide excellent control of the electric field, which can be used to drive the translational degrees of freedom of a charged microsphere and the rotational degrees of freedom of a neutral microsphere, coupling to its electric dipole moment. With this control, the charge state can be determined with single electron precision, the mass of individual microspheres can be measured, and empirical calibrations of the force sensitivity can be made for each microsphere. A force noise of 1 times10 17 N sqrt rm Hz , which is comparable to previous reports, is measured on all three degrees of freedom for 4.7 mu m diameter, 84 pg silica microspheres. Various devices have been brought within 1.6 mu m of the surface of a trapped microsphere. Metrology in the trapping region is provided by two custom designed microscopes providing views in the horizontal and one of the vertical planes. The apparatus opens the way to performing high sensitivity three dimensional force measurements at short distance.


Stratified Space Learning Reconstructing Embedded Graphs. Many data rich industries are interested in the efficient discovery and modelling of structures underlying large data sets, as it allows for the fast triage and dimension reduction of large volumes of data embedded in high dimensional spaces. The modelling of these underlying structures is also beneficial for the creation of simulated data that better represents real data. In particular, for systems testing in cases where the use of real data streams might prove impractical or otherwise undesirable. We seek to discover and model the structure by combining methods from topological data analysis with numerical modelling. As a first step in combining these two areas, we examine the recovery of the abstract graph G structure, and model a linear embedding G given only a noisy point cloud sample X of G .


A Frobenius group analog for Camina triples. Frobenius groups are an object of fundamental importance in finite group theory. As such, several generalizations of these groups have been considered. Some examples include A Frobenius Wielandt group is a triple (G,H,L) where H L is it almost a Frobenius complement for G A Camina pair is a pair (G,N) where N is it almost a Frobenius kernel for G A Camina triple is a triple (G,N,M) where (G,N) and (G,M) are it almost Camina pairs. In this paper we study triples (G,N,M) where (G,N) and (G,M) are it almost Frobenius groups.


Hybrid Multicast Unicast Design in NOMA based Vehicular Caching System with Supplementary Material. In this paper, we investigate a hybrid multicast unicast scheme for a multiple input single output cache aided non orthogonal multiple access (NOMA) vehicular scenario in the face of rapidly fluctuating vehicular wireless channels. Considering a more practical situation, imperfect channel state information is taking into account. In this paper, we formulate an optimization problem to maximize the unicast sum rate under the constraints of the peak power, the peak backhaul, the minimum unicast rate, and the maximum multicast outage probability. To solve the formulated non convex problem, a lower bound relaxation method is proposed, which enables a division of the original problem into two convex sub problems. Computer simulations show that the proposed caching aided NOMA is superior to the orthogonal multiple access counterpart.


LRG at SemEval 2020 Task 7 Assessing the Ability of BERT and Derivative Models to Perform Short Edits based Humor Grading. In this paper, we assess the ability of BERT and its derivative models (RoBERTa, DistilBERT, and ALBERT) for short edits based humor grading. We test these models for humor grading and classification tasks on the Humicroedit and the FunLines dataset. We perform extensive experiments with these models to test their language modeling and generalization abilities via zero shot inference and cross dataset inference based approaches. Further, we also inspect the role of self attention layers in humor grading by performing a qualitative analysis over the self attention weights from the final layer of the trained BERT model. Our experiments show that all the pre trained BERT derivative models show significant generalization capabilities for humor grading related tasks.


TrustSAS A Trustworthy Spectrum Access System for the 3.5 GHz CBRS Band. As part of its ongoing efforts to meet the increased spectrum demand, the Federal Communications Commission (FCC) has recently opened up 150 MHz in the 3.5 GHz band for shared wireless broadband use. Access and operations in this band, aka Citizens Broadband Radio Service (CBRS), will be managed by a dynamic spectrum access system (SAS) to enable seamless spectrum sharing between secondary users (SUs) and incumbent users. Despite its benefits, SAS's design requirements, as set by FCC, present privacy risks to SUs, merely because SUs are required to share sensitive operational information (e.g., location, identity, spectrum usage) with SAS to be able to learn about spectrum availability in their vicinity. In this paper, we propose TrustSAS , a trustworthy framework for SAS that synergizes state of the art cryptographic techniques with blockchain technology in an innovative way to address these privacy issues while complying with FCC's regulatory design requirements. We analyze the security of our framework and evaluate its performance through analysis, simulation and experimentation. We show that TrustSAS can offer high security guarantees with reasonable overhead, making it an ideal solution for addressing SUs' privacy issues in an operational SAS environment.


Stochastic Weight Matrix based Regularization Methods for Deep Neural Networks. The aim of this paper is to introduce two widely applicable regularization methods based on the direct modification of weight matrices. The first method, Weight Reinitialization, utilizes a simplified Bayesian assumption with partially resetting a sparse subset of the parameters. The second one, Weight Shuffling, introduces an entropy and weight distribution invariant non white noise to the parameters. The latter can also be interpreted as an ensemble approach. The proposed methods are evaluated on benchmark datasets, such as MNIST, CIFAR 10 or the JSB Chorales database, and also on time series modeling tasks. We report gains both regarding performance and entropy of the analyzed networks. We also made our code available as a GitHub repository (https github.com rpatrik96 lod wmm 2019).


Braid group action on projective quantum mathfrak sl (2) modules. We define a family of the braid group representations via the action of the R matrix (of the quasitriangular extension) of the restricted quantum mathfrak sl (2) on a tensor power of a simple projective module. This family is an extension of the Lawrence representation specialized at roots of unity. Although the center of the braid group has finite order on the specialized Laurence representations, this action is faithful for our extension.


Fluorescence Resonance Energy Transfer (FRET) as Biomarkers. Applications of Fluorescence Resonance Energy Transfer (FRET) in biology have expanded tremendously in the last 25 years. This technique has become a staple technique in many biological and biophysical fields. FRET based chemical sensors and biosensors can play an important role as biomarkers. Development of new and effective FRET based assay for biological application is an emerging area of research needing multidisciplinary approach from biologists, chemists and physicists. Here we have discussed the use of FRET technique as biomarker.


Heisenberg uniqueness pairs for the hyperbola. Let Gamma be the hyperbola (x,y) in mathbb R 2 xy 1 and Lambda beta be the lattice cross defined by Lambda beta left( mathbb Z times 0 right) cup left( 0 times beta mathbb Z right) in mathbb R 2, where beta is a positive real. A result of Hedenmalm and Montes Rodr 'iguez says that left( Gamma, Lambda beta right) is a Heisenberg uniqueness pair if and only if beta leq1. In this paper, we show that for a rational perturbation of Lambda beta, namely Lambda beta theta left(( mathbb Z theta ) times 0 right) cup left( 0 times beta mathbb Z right), where theta 1 p , text for some p in mathbb N and beta is a positive real, the pair left( Gamma, Lambda beta theta right) is a Heisenberg uniqueness pair if and only if beta leq p .


IoT Network Behavioral Fingerprint Inference with Limited Network Trace for Cyber Investigation A Meta Learning Approach. The development and adoption of Internet of Things (IoT) devices will grow significantly in the coming years to enable Industry 4.0. Many forms of IoT devices will be developed and used across industry verticals. However, the euphoria of this technology adoption is shadowed by the solemn presence of cyber threats that will follow its growth trajectory. Cyber threats would either embed their malicious code or attack vulnerabilities in IoT that could induce significant consequences in cyber and physical realms. In order to manage such destructive effects, incident responders and cyber investigators require the capabilities to find these rogue IoT and contain them quickly. Such online devices may only leave network activity traces. A collection of relevant traces could be used to infer the IoT's network behaviorial fingerprints and in turn could facilitate investigative find of these IoT. However, the challenge is how to infer these fingerprints when there is limited network activity traces. This research proposes the novel model construct that learns to infer the network behaviorial fingerprint of specific IoT based on limited network activity traces using a One Card Time Series Meta Learner called DeepNetPrint. Our research also demonstrates the application of DeepNetPrint to identify IoT devices that performs comparatively well against leading supervised learning models. Our solution would enable cyber investigator to identify specific IoT of interest while overcoming the constraints of having only limited network traces of the IoT.


Fluctuation moments induced by conjugation with asymptotically liberating random matrix ensembles. G. Anderson and B. Farrel showed that conjugation of constant matrices by asymptotically liberating random unitary matrices give rise to asymptotic free independence. Independent Haar unitary random matrices and independent Haar orthogonal random matrices are examples of asymptotically liberating ensembles. In this paper, we investigate the fluctuation moments, and higher order moments, induced on constant matrices by conjugation with asymptotically liberating ensembles. In particular, we determine fluctuation moments induced by an ensembles related to the Discrete Fourier Transform matrix.


Dynamics of Social Interactions and Agent Spreading in Social Insects Colonies Effects of Environmental Events and Spatial Heterogeneity. The relationship between division of labor and individuals' spatial behavior in social insect colonies provides a useful context to study how social interactions influence the spreading of agent (which could be information or virus) across distributed agent systems. In social insect colonies, spatial heterogeneity associated with variations of individual task roles, affects social contacts, and thus the way in which agent moves through social contact networks. We used an Agent Based Model (ABM) to mimic three realistic scenarios of agent spreading in social insect colonies. Our model suggests that individuals within a specific task interact more with consequences that agent could potentially spread rapidly within that group, while agent spreads slower between task groups. Our simulations show a strong linear relationship between the degree of spatial heterogeneity and social contact rates, and that the spreading dynamics of agents follow a modified nonlinear logistic growth model with varied transmission rates for different scenarios. Our work provides an important insights on the dual functionality of physical contacts. This dual functionality is often driven via variations of individual spatial behavior, and can have both inhibiting and facilitating effects on agent transmission rates depending on environment. The results from our proposed model not only provide important insights on mechanisms that generate spatial heterogeneity, but also deepen our understanding of how social insect colonies balance the benefit and cost of physical contacts on the agents' transmission under varied environmental conditions.


Enhancing Parameter Free Frank Wolfe with an Extra Subproblem. Aiming at convex optimization under structural constraints, this work introduces and analyzes a variant of the Frank Wolfe (FW) algorithm termed ExtraFW. The distinct feature of ExtraFW is the pair of gradients leveraged per iteration, thanks to which the decision variable is updated in a prediction correction (PC) format. Relying on no problem dependent parameters in the step sizes, the convergence rate of ExtraFW for general convex problems is shown to be cal O ( frac 1 k ) , which is optimal in the sense of matching the lower bound on the number of solved FW subproblems. However, the merit of ExtraFW is its faster rate cal O big( frac 1 k 2 big) on a class of machine learning problems. Compared with other parameter free FW variants that have faster rates on the same problems, ExtraFW has improved rates and fine grained analysis thanks to its PC update. Numerical tests on binary classification with different sparsity promoting constraints demonstrate that the empirical performance of ExtraFW is significantly better than FW, and even faster than Nesterov's accelerated gradient on certain datasets. For matrix completion, ExtraFW enjoys smaller optimality gap, and lower rank than FW.


Enhanced Self Perception in Mixed Reality Egocentric Arm Segmentation and Database with Automatic Labelling. In this study, we focus on the egocentric segmentation of arms to improve self perception in Augmented Virtuality (AV). The main contributions of this work are i) a comprehensive survey of segmentation algorithms for AV ii) an Egocentric Arm Segmentation Dataset, composed of more than 10, 000 images, comprising variations of skin color, and gender, among others. We provide all details required for the automated generation of groundtruth and semi synthetic images iii) the use of deep learning for the first time for segmenting arms in AV iv) to showcase the usefulness of this database, we report results on different real egocentric hand datasets, including GTEA Gaze , EDSH, EgoHands, Ego Youtube Hands, THU Read, TEgO, FPAB, and Ego Gesture, which allow for direct comparisons with existing approaches utilizing color or depth. Results confirm the suitability of the EgoArm dataset for this task, achieving improvement up to 40 with respect to the original network, depending on the particular dataset. Results also suggest that, while approaches based on color or depth can work in controlled conditions (lack of occlusion, uniform lighting, only objects of interest in the near range, controlled background, etc.), egocentric segmentation based on deep learning is more robust in real AV applications.


Oscillatory orbits in the Restricted Planar 4 Body Problem. The restricted planar four body problem describes the motion of a massless body under the Newtonian gravitational force of other three bodies (the primaries), of which the motion gives us general solutions of the three body problem. A trajectory is called it oscillatory if it goes arbitrarily faraway but returns infinitely many times to the same bounded region. We prove the existence of such type of trajectories provided the primaries evolve in suitable periodic orbits.


Efficient Approximation Schemes for Stochastic Probing and Prophet Problems. Our main contribution is a general framework to design efficient polynomial time approximation schemes (EPTAS) for fundamental classes of stochastic combinatorial optimization problems. Given an error parameter epsilon 0 , such algorithmic schemes attain a (1 epsilon) approximation in only t( epsilon) cdot poly(n) time, where t( cdot) is some function that depends only on epsilon . Technically speaking, our approach relies on presenting tailor made reductions to a newly introduced multi dimensional extension of the Santa Claus problem Bansal Sviridenko, STOC'06 . Even though the single dimensional problem is already known to be APX Hard, we prove that an EPTAS can be designed under certain structural assumptions, which hold for our applications. To demonstrate the versatility of our framework, we obtain an EPTAS for the adaptive ProbeMax problem as well as for its non adaptive counterpart in both cases, state of the art approximability results have been inefficient polynomial time approximation schemes (PTAS) Chen et al., NIPS'16 Fu et al., ICALP'18 . Turning our attention to selection stopping settings, we further derive an EPTAS for the Free Order Prophets problem Agrawal et al., EC'20 and for its cost driven generalization, Pandora's Box with Commitment Fu et al., ICALP'18 . These results improve on known PTASes for their adaptive variants, and constitute the first non trivial approximations in the non adaptive setting.


The Microstructure of Stochastic Volatility Models with Self Exciting Jump Dynamics. We provide a general probabilistic framework within which we establish scaling limits for a class of continuous time stochastic volatility models with self exciting jump dynamics. In the scaling limit, the joint dynamics of asset returns and volatility is driven by independent Gaussian white noises and two independent Poisson random measures that capture the arrival of exogenous shocks and the arrival of self excited shocks, respectively. Various well studied stochastic volatility models with and without self exciting price volatility co jumps are obtained as special cases under different scaling regimes. We analyze the impact of external shocks on the market dynamics, especially their impact on jump cascades and show in a mathematically rigorous manner that many small external shocks may tigger endogenous jump cascades in asset returns and stock price volatility.


Superconvergence of high order finite difference schemes based on variational formulation for elliptic equations. The classical continuous finite element method with Lagrangian Q k basis reduces to a finite difference scheme when all the integrals are replaced by the (k 1) times (k 1) Gauss Lobatto quadrature. We prove that this finite difference scheme is (k 2) th order accurate in the discrete 2 norm for an elliptic equation with Dirichlet boundary conditions, which is a superconvergence result of function values.


Feedback control for transition suppression in direct numerical simulations of channel flow. For channel flow at subcritical Reynolds numbers ( Re 5772 ), a laminar to turbulent transition can emerge due to a large transient amplification in the kinetic energy of small perturbations, resulting in an increase in drag at the walls. The objectives of the present study are three fold (1) to study the nonlinear effects on transient energy growth, (2) to design a feedback control strategy to prevent this subcritical transition, and (3) to examine the control mechanisms that enable transition suppression. We investigate transient energy growth of linear optimal disturbance in plane Poiseuille flow at a subcritical Reynolds number of Re 3000 using linear analysis and nonlinear simulation. We find that the amplification of the given initial perturbation is reduced when the nonlinear effect is substantial, with larger perturbations being less amplified in general. Moreover, we design linear quadratic optimal controllers to delay transition via wall normal blowing and suction actuation at the channel walls. We demonstrate that these feedback controllers are capable of reducing transient energy growth in the linear setting. The performance of the same controllers is evaluated for nonlinear flows where a laminar to turbulent transition emerges without control. Nonlinear simulations reveal that the controllers can reduce transient energy growth and suppress transition. Further, we identify and characterize the underlying physical mechanisms that enable feedback control to suppress and delay laminar to turbulent transition.


Effective reconstruction of generic genus 5 curves from their theta hyperplanes. We effectively reconstruct the set of enveloping quadrics of a generic curve C of genus 5 from its theta hyperplanes for a generic genus 5 curve C this data suffices to effectively reconstruct C. As a consequence we get a complete description of the Schottky locus in genus 5 in terms of theta hyperplanes. The computational part of the proof is a certified numerical argument.


Side Aware Boundary Localization for More Precise Object Detection. Current object detection frameworks mainly rely on bounding box regression to localize objects. Despite the remarkable progress in recent years, the precision of bounding box regression remains unsatisfactory, hence limiting performance in object detection. We observe that precise localization requires careful placement of each side of the bounding box. However, the mainstream approach, which focuses on predicting centers and sizes, is not the most effective way to accomplish this task, especially when there exists displacements with large variance between the anchors and the targets. In this paper, we propose an alternative approach, named as Side Aware Boundary Localization (SABL), where each side of the bounding box is respectively localized with a dedicated network branch. To tackle the difficulty of precise localization in the presence of displacements with large variance, we further propose a two step localization scheme, which first predicts a range of movement through bucket prediction and then pinpoints the precise position within the predicted bucket. We test the proposed method on both two stage and single stage detection frameworks. Replacing the standard bounding box regression branch with the proposed design leads to significant improvements on Faster R CNN, RetinaNet, and Cascade R CNN, by 3.0 , 1.7 , and 0.9 , respectively. Code is available at https github.com open mmlab mmdetection.


Global continuity and higher integrability of a minimizer of an obstacle problem under generalized Orlicz growth conditions. We prove continuity up to the boundary of the minimizer of an obstacle problem and higher integrability of its gradient under generalized Orlicz growth. The result recovers similar results obtained in the special cases of polynomial growth, variable exponent growth and produces new results for Orlicz and double phase growth.


A Virtual Reality Game as a Tool to Assess Physiological Correlations of Stress. The objective of this study is to develop and use a virtual reality game as a tool to assess the effects of realistic stress on the behavioral and physiological responses of participants. The game is based on a popular Steam game called Keep Talking Nobody Explodes, where the player collaborates with another person to defuse a bomb. Varying levels of difficulties in solving a puzzle and time pressures will result in different stress levels that can be measured in terms of errors, response time lengths, and other physiological measurements. The game was developed using 3D programming tools including Blender and virtual reality development kit (VRTK). To measure response times accurately, we added LSL (Lab Stream Layer) Markers to collect and synchronize physiological signals, behavioral data, and the timing of game events. We recorded Electrocardiogram (ECG) data during gameplay to assess heart rate and heart rate variability (HRV) that have been shown as reliable indicators of stress. Our empirical results showed that heart rate increased significantly while HRV reduced significantly when the participants under high stress, which are consistent with the prior mainstream stress research. We further experimented with other tools to enhance communication between two players under adverse conditions and found that an automatic speech recognition software effectively enhanced the communication between the players by displaying keywords into the player's headset that lead to the facilitation of finding the solution of the puzzles or modules. This VR game framework is publicly available in Github and allows researchers to measure and synchronize other physiological signals such as electroencephalogram, electromyogram, and pupillometry.


Reconfigurable fractional microwave signal processor based on a microcomb. We propose and demonstrate reconfigurable fractional microwave signal processing based on an integrated Kerr optical microcomb. We achieve two forms of microwave signal processing functions, a fractional Hilbert transform as well as a fractional differentiator. For the Hilbert transform we demonstrate a phase shift of 45 degrees, half that of a full Hilbert transform, while for the differentiator we achieve square root differentiation. For both, we achieve high resolution over a broad bandwidth of 17 GHz with a phase deviation of less than 5 per degree within the achieved passband. This performance in both the frequency and time domains demonstrates the versatility and power of micro combs as a basis for high performance microwave signal processing.


LPaintB Learning to Paint from Self Supervision. We present a novel reinforcement learning based natural media painting algorithm. Our goal is to reproduce a reference image using brush strokes and we encode the objective through observations. Our formulation takes into account that the distribution of the reward in the action space is sparse and training a reinforcement learning algorithm from scratch can be difficult. We present an approach that combines self supervised learning and reinforcement learning to effectively transfer negative samples into positive ones and change the reward distribution. We demonstrate the benefits of our painting agent to reproduce reference images with brush strokes. The training phase takes about one hour and the runtime algorithm takes about 30 seconds on a GTX1080 GPU reproducing a 1000x800 image with 20,000 strokes.


The effect of colored noise on heteroclinic orbits. The dynamics of a weakly dissipative Hamiltonian system submitted to stochastic perturbations has been investigated by means of asymptotic methods. The probability of noise induced separatrix crossing, which drastically changes the fate of the system, is derived analytically in the case where noise is an additive Kubo Anderson process. This theory shows how the geometry of the separatrix, as well as the noise intensity and correlation time, affect the statistics of crossing. Results can be applied to a wide variety of systems, and are valid in the limit where the noise correlation time scale is much smaller than the time scale of the undisturbed Hamiltonian dynamics.


Compiling a Higher Order Smart Contract Language to LLVM. Scilla is a higher order polymorphic typed intermediate level language for implementing smart contracts. In this talk, we describe a Scilla compiler targeting LLVM, with a focus on mapping Scilla types, values, and its functional language constructs to LLVM IR. The compiled LLVM IR, when executed with LLVM's JIT framework, achieves a speedup of about 10x over the reference interpreter on a typical Scilla contract. This reduced latency is crucial in the setting of blockchains, where smart contracts are executed as parts of transactions, to achieve peak transactions processed per second. Experiments on the Ackermann function achieved a speedup of more than 45x. This talk abstract is aimed at both programming language researchers looking to implement an LLVM based compiler for their functional language, as well as at LLVM practitioners.


Remarks on Ornstein's non inequality in mathbb R 2 times 2 . We give a very concise proof of Ornstein's L 1 non inequality for first and second order operators in two dimensions. The proof just needs a two dimensional laminate supported on three points.


Anchor Diffusion for Unsupervised Video Object Segmentation. Unsupervised video object segmentation has often been tackled by methods based on recurrent neural networks and optical flow. Despite their complexity, these kinds of approaches tend to favour short term temporal dependencies and are thus prone to accumulating inaccuracies, which cause drift over time. Moreover, simple (static) image segmentation models, alone, can perform competitively against these methods, which further suggests that the way temporal dependencies are modelled should be reconsidered. Motivated by these observations, in this paper we explore simple yet effective strategies to model long term temporal dependencies. Inspired by the non local operators of 70 , we introduce a technique to establish dense correspondences between pixel embeddings of a reference "anchor" frame and the current one. This allows the learning of pairwise dependencies at arbitrarily long distances without conditioning on intermediate frames. Without online supervision, our approach can suppress the background and precisely segment the foreground object even in challenging scenarios, while maintaining consistent performance over time. With a mean IoU of 81.7 , our method ranks first on the DAVIS 2016 leaderboard of unsupervised methods, while still being competitive against state of the art online semi supervised approaches. We further evaluate our method on the FBMS dataset and the ViSal video saliency dataset, showing results competitive with the state of the art.


Breaking the Communities Characterizing community changing users using text mining and graph machine learning on Twitter. Even though the Internet and social media have increased the amount of news and information people can consume, most users are only exposed to content that reinforces their positions and isolates them from other ideological communities. This environment has real consequences with great impact on our lives like severe political polarization, easy spread of fake news, political extremism, hate groups and the lack of enriching debates, among others. Therefore, encouraging conversations between different groups of users and breaking the closed community is of importance for healthy societies. In this paper, we characterize and study users who break their community on Twitter using natural language processing techniques and graph machine learning algorithms. In particular, we collected 9 million Twitter messages from 1.5 million users and constructed the retweet networks. We identified their communities and topics of discussion associated to them. With this data, we present a machine learning framework for social media users classification which detects "community breakers", i.e. users that swing from their closed community to another one. A feature importance analysis in three Twitter polarized political datasets showed that these users have low values of PageRank, suggesting that changes are driven because their messages have no response in their communities. This methodology also allowed us to identify their specific topics of interest, providing a fully characterization of this kind of users.


Numerical Continuation and Bifurcation Analysis in a Harvested Predator Prey Model with Time Delay using DDE Biftool. Time delay has been incorporated in models to reflect certain physical or biological meaning. The theory of delay differential equations (DDEs), which has seen extensive growth in the last seventy years or so, can be used to examine the effects of time delay in the dynamical behavior of systems being considered. Numerical tools to study DDEs have played a significant role not only in illustrating theoretical results but also in discovering interesting dynamics of the model. DDE Biftool, which is a Matlab package for numerical continuation and numerical bifurcation analysis of DDEs, is one of the most utilized and popular numerical tools for DDEs. In this paper, we present a guide to using the latest version of DDE Biftool targeted to researchers who are new to the study of time delay systems. A short discussion of an example application, which is a harvested predator prey model with a single discrete time delay, will be presented first. We then implement this example model in DDE Biftool, pointing out features where beginners need to be cautious. We end with a comparison of our theoretical and numerical results.


Computing all s t bridges and articulation points simplified. Given a directed graph G and a pair of nodes s and t , an s t bridge of G is an edge whose removal breaks all s t paths of G . Similarly, an s t articulation point of G is a node whose removal breaks all s t paths of G . Computing the sequence of all s t bridges of G (as well as the s t articulation points) is a basic graph problem, solvable in linear time using the classical min cut algorithm. When dealing with cuts of unit size ( s t bridges) this algorithm can be simplified to a single graph traversal from s to t avoiding an arbitrary s t path, which is interrupted at the s t bridges. Further, the corresponding proof is also simplified making it independent of the theory of network flows.


Downlink transceiver beamforming and admission control for massive MIMO cognitive radio networks. In this paper, an optimization framework is proposed for joint transceiver beamforming and admission control in massive MIMO cognitive radio networks. The objective of the optimization problem is to support maximum number of secondary users in downlink transmission with constraints on the total power allocated to users, the rate achieved at secondary users and the interference at the primary nodes. The proposed framework takes into account the imperfect knowledge of the channels between the secondary and the primary nodes and also mitigates the interference caused by the primary users at secondary receivers. In order to solve the underlying NP hard problem, we propose a three step algorithm with two alternative schemes for power allocation, namely equal power and equal rate. In addition, we provide a solution by reducing the problem to an Integer Linear Program (ILP). The performances of equal rate, equal power, and ILP methods are studied in under different constraints.


Byzantine Lattice Agreement in Synchronous Systems. In this paper, we study the Byzantine lattice agreement problem in synchronous systems. The lattice agreement problem in crash failure model has been studied both in synchronous and asynchronous systems, which leads to the current best upper bound of O( log f) rounds in both systems. However, very few algorithmic results are known for the lattice agreement problem in Byzantine failure model. The paper Nowak et al., DISC, 2019 first gives an algorithm for a variant of the lattice agreement problem on cycle free lattices that tolerates up to f n (h(X) 1) Byzantine faults, where n is the number of processes and h(X) is the height of the input lattice X . The recent preprint by Di et al. studies this problem with a slightly modified validity condition in asynchronous systems. They present a O(f) rounds algorithm by using the reliable broadcast primitive as a first step and following the similar algorithmic framework as the algorithms in crash failure model. In this paper, we propose three algorithms for the Byzantine lattice agreement problem in synchronous systems. The first algorithm takes min 3h(X) 6,6 sqrt f 6 ) rounds and O(n 2 min h(X), sqrt f ) messages, where h(X) is the height of the input lattice X , n is the total number of processes. The second algorithm runs in 3 log n 3 rounds and takes O(n 2 log n) messages. The third algorithm takes 4 log f 3 rounds and takes O(n 2 log f) messages. All algorithms can tolerate up to f frac n 3 Byzantine failures.


Improvement of A numerical radius inequalities of semi Hilbertian space operators. Let mathcal H be a complex Hilbert space and let A be a positive operator on mathcal H . We obtain new bounds for the A numerical radius of operators in semi Hilbertian space mathcal B A( mathcal H ) that generalize and improve on the existing ones. Further, we estimate bounds for the B operator seminorm and B numerical radius of 2 times 2 operator matrices, where B mbox diag (A,A) . The bounds obtained here improve on the existing ones.


Hamiltonian Neural Networks. Even though neural networks enjoy widespread use, they still struggle to learn the basic laws of physics. How might we endow them with better inductive biases? In this paper, we draw inspiration from Hamiltonian mechanics to train models that learn and respect exact conservation laws in an unsupervised manner. We evaluate our models on problems where conservation of energy is important, including the two body problem and pixel observations of a pendulum. Our model trains faster and generalizes better than a regular neural network. An interesting side effect is that our model is perfectly reversible in time.


Increasing paths in countable graphs. In this paper we study variations of an old result by M " u ller, Reiterman, and the last author stating that a countable graph has a subgraph with infinite degrees if and only if in any labeling of the vertices (or edges) of this graph by positive integers we can always find an infinite increasing path. We study corresponding questions for hypergraphs and directed graphs. For example we show that the condition that a hypergraph contains a subhypergraph with infinite degrees is equivalent to the condition that any vertex labeling contains an infinite increasing loose path. We also find an equivalent condition for a graph to have a property that any vertex labeling with positive integers contains a path of arbitrary finite length, and we study related problems for oriented graphs and labelings with mathbb Z (instead of mathbb N ). For example, we show that for every simple hypergraph, there is a labelling of its edges by mathbb Z that forbids one way infinite increasing paths.


A Cohomological Bundle Theory for Khovanov's Cube Construction. The construction of the Khovanov homology of links motivates an interest in decorated Boolean lattices. Placing this work in the context of a bundle theory of presheaves on small categories, we produce, for a certain set of naturally occurring cases, a Leray Serre type spectral sequence relating the bundle to the cohomology of the total sheaf.


A probabilistic way to discover the rainbow. "No two rainbows are the same. Neither are two packs of Skittles. Enjoy an odd mix!". Using an interpretation via spatial random walks, we quantify the probability that two randomly selected packs of Skittles candy are identical and determine the expected number of packs one has to purchase until the first match. We believe this problem to be appealing for middle and high school students as well as undergraduate students at University.


Benchmarking Discrete Optimization Heuristics with IOHprofiler. Automated benchmarking environments aim to support researchers in understanding how different algorithms perform on different types of optimization problems. Such comparisons provide insights into the strengths and weaknesses of different approaches, which can be leveraged into designing new algorithms and into the automation of algorithm selection and configuration. With the ultimate goal to create a meaningful benchmark set for iterative optimization heuristics, we have recently released IOHprofiler, a software built to create detailed performance comparisons between iterative optimization heuristics. With this present work we demonstrate that IOHprofiler provides a suitable environment for automated benchmarking. We compile and assess a selection of 23 discrete optimization problems that subscribe to different types of fitness landscapes. For each selected problem we compare performances of twelve different heuristics, which are as of now available as baseline algorithms in IOHprofiler. We also provide a new module for IOHprofiler which extents the fixed target and fixed budget results for the individual problems by ECDF results, which allows one to derive aggregated performance statistics for groups of problems.


From Ants to Fishing Vessels A Simple Model for Herding and Exploitation of Finite Resources. We analyse the dynamics of fishing vessels with different home ports in an area where these vessels, in choosing where to fish, are influenced by their own experience in the past and by their current observation of the locations of other vessels in the fleet. Empirical data from the boats near Ancona and Pescara shows stylized statistical properties that are reminiscent of Kirman and F "ollmer's ant recruitment model, although with two ant colonies represented by the two ports. From the point of view of a fisherman, the two fishing areas are not equally attractive, and he tends to prefer the one closer to where he is based. This piece of evidence led us to extend the original ants model to a situation with two asymmetric zones and finite resources. We show that, in the mean field regime, our model exhibits the same properties as the empirical data. We obtain a phase diagram that separates high and low herding regimes, but also fish population extinction. Our analysis has interesting policy implications for the ecology of fishing areas. It also suggests that herding behaviour here, just as in financial markets, will lead to significant fluctuations in the amount of fish landed, as the boat concentration on one area at a given point in time will diminish the overall catch, such loss not being compensated by the reproduction of fish in the other area. In other terms, individually rational behaviour will not lead to collectively optimal results.


Reconstruction of weak bialgebra maps and its applications. In this note we give a precise statement and a detailed proof for reconstruction problem of weak bialgebra maps. As an application we characterize indecomposability of weak algebras in categorical setting.


Bernoulli Randomness and Biased Normality. One can consider mu Martin L "of randomness for a probability measure mu on 2 omega , such as the Bernoulli measure mu p given p in (0, 1) . We study Bernoulli randomness of sequences in n omega with parameters p 0, p 1, dotsc, p n 1 , and we introduce a biased version of normality. We prove that every Bernoulli random real is normal in the biased sense, and this has the corollary that the set of biased normal reals has full Bernoulli measure in n omega . We give an algorithm for computing biased normal sequences from normal sequences, so that we can give explicit examples of biased normal reals. We investigate an application of randomness to iterated function systems. Finally, we list a few further questions relating to Bernoulli randomness and biased normality.


A block inertial Bregman proximal algorithm for nonsmooth nonconvex problems with application to symmetric nonnegative matrix tri factorization. We propose BIBPA, a block inertial Bregman proximal algorithm for minimizing the sum of a block relatively smooth function (that is, relatively smooth concerning each block) and block separable nonsmooth nonconvex functions. We prove that the sequence generated by BIBPA subsequentially converges to critical points of the objective under standard assumptions, and globally converges when the objective function is additionally assumed to satisfy the Kurdyka L ojasiewicz (K L ) property. We also provide the convergence rate when the objective satisfies the L ojasiewicz inequality. We apply BIBPA to the symmetric nonnegative matrix tri factorization (SymTriNMF) problem, where we propose kernel functions for SymTriNMF and provide closed form solutions for subproblems of BIBPA.


Pre trained Language Model Representations for Language Generation. Pre trained language model representations have been successful in a wide range of language understanding tasks. In this paper, we examine different strategies to integrate pre trained representations into sequence to sequence models and apply it to neural machine translation and abstractive summarization. We find that pre trained representations are most effective when added to the encoder network which slows inference by only 14 . Our experiments in machine translation show gains of up to 5.3 BLEU in a simulated resource poor setup. While returns diminish with more labeled data, we still observe improvements when millions of sentence pairs are available. Finally, on abstractive summarization we achieve a new state of the art on the full text version of CNN DailyMail.


Look Around You Sequence based Radar Place Recognition with Learned Rotational Invariance. This paper details an application which yields significant improvements to the adeptness of place recognition with Frequency Modulated Continuous Wave radar a commercially promising sensor poised for exploitation in mobile autonomy. We show how a rotationally invariant metric embedding for radar scans can be integrated into sequence based trajectory matching systems typically applied to videos taken by visual sensors. Due to the complete horizontal field of view inherent to the radar scan formation process, we show how this off the shelf sequence based trajectory matching system can be manipulated to detect place matches when the vehicle is travelling down a previously visited stretch of road in the opposite direction. We demonstrate the efficacy of the approach on 26 km of challenging urban driving taken from the largest radar focused urban autonomy dataset released to date showing a boost of 30 in recall at high levels of precision over a nearest neighbour approach.


General Confidentiality and Utility Metrics for Privacy Preserving Data Publishing Based on the Permutation Model. Anonymization for privacy preserving data publishing, also known as statistical disclosure control (SDC), can be viewed under the lens of the permutation model. According to this model, any SDC method for individual data records is functionally equivalent to a permutation step plus a noise addition step, where the noise added is marginal, in the sense that it does not alter ranks. Here, we propose metrics to quantify the data confidentiality and utility achieved by SDC methods based on the permutation model. We distinguish two privacy notions in our work, anonymity refers to subjects and hence mainly to protection against record re identification, whereas confidentiality refers to the protection afforded to attribute values against attribute disclosure. Thus, our confidentiality metrics are useful even if using a privacy model ensuring an anonymity level ex ante. The utility metric is a general purpose metric that can be conveniently traded off against the confidentiality metrics, because all of them are bounded between 0 and 1. As an application, we compare the utility confidentiality trade offs achieved by several anonymization approaches, including privacy models (k anonymity and epsilon differential privacy) as well as SDC methods (additive noise, multiplicative noise and synthetic data) used without privacy models.


The aftermath of Big Deal cancellations and their impact on interlibrary loans. A "Big Deal" is a bundle of journals that is offered to libraries by publishers as a "one price, one size fits all package" (Frazier, 2001). There have been several accounts of Big Deals cancellations by academic libraries in the scientific literature. This paper presents the finding of a literature review aimed at documenting the aftermath of Big Deal cancellation in University Libraries, particularly their impacts on interlibrary loan services. We find that many academic libraries have successfully cancelled their Big Deals, realizing budget savings while limiting negative effects on library users. In particular, existing literature reveals that cancellations have a surprisingly small effect on interlibrary loan requests. The reviewed studies further highlight the importance of access to proper usage data and inclusion of community members of the community (staff, faculty members, students, etc.) in the decision making process.


Adapting Persistent Data Structures for Concurrency and Speculation. This work unifies insights from the systems and functional programming communities, in order to enable compositional reasoning about software which is nonetheless efficiently realizable in hardware. It exploits a correspondence between design goals for efficient concurrent data structures and efficient immutable persistent data structures, to produce novel implementations of mutable concurrent trees with low contention and an efficient snapshot operation to support speculative execution models. It also exploits commutativity to characterize a design space for integrating traditional high performance concurrent data structures into Software Transactional Memory (STM) runtimes, and extends this technique to yield a novel algorithm for concurrent execution of so called smart contracts'' (specialized programs which manipulate the state of blockchain ledgers).


A Hierarchical Model for Fast Distributed Consensus in Dynamic Networks. We present two new consensus algorithms for dynamic networks. The first, Fast Raft, is a variation on the Raft consensus algorithm that reduces the number of message rounds in typical operation. Fast Raft is ideal for fast paced distributed systems where membership changes over time and where sites must reach consensus quickly. The second, C Raft, is targeted for distributed systems where sites are grouped into clusters, with fast communication within clusters and slower communication between clusters. C Raft uses Fast Raft as a building block and defines a hierarchical model of consensus to improve upon throughput in globally distributed systems. We prove the safety and liveness properties of each algorithm. Finally, we present an experimental evaluation of both algorithms in AWS.


Domain Adaptive Dialog Generation via Meta Learning. Domain adaptation is an essential task in dialog system building because there are so many new dialog tasks created for different needs every day. Collecting and annotating training data for these new tasks is costly since it involves real user interactions. We propose a domain adaptive dialog generation method based on meta learning (DAML). DAML is an end to end trainable dialog system model that learns from multiple rich resource tasks and then adapts to new domains with minimal training samples. We train a dialog system model using multiple rich resource single domain dialog data by applying the model agnostic meta learning algorithm to dialog domain. The model is capable of learning a competitive dialog system on a new domain with only a few training examples in an efficient manner. The two step gradient updates in DAML enable the model to learn general features across multiple tasks. We evaluate our method on a simulated dialog dataset and achieve state of the art performance, which is generalizable to new tasks.


Towards infrared toroidal photodevices A Review. Plasmon excitations in metallic nanostructures can decay directly into dynamic electron hole pairs (EHPs), exploitable for photocurrent generation. This approach has extensively been employed to develop nanoplasmonic light sensing devices with significant responsivity and quantum efficiency. Of particular interest is infrared plasmonic photodetectors with a wide range of technological applications, including spectroscopy, biosensing, and surveillance. This Review discusses fundamentals, recent advances, and trending mechanisms in the understanding and applications of plasmon enhanced photocurrent generation in nanostructures across the infrared spectrum. By highlighting and comparing the developed techniques, we demonstrate the newly introduced directions toward achieving high photon yield infrared plasmonic photodetection tools. As a promising concept in modern photonics, we represent the emergence of toroidal meta atoms as plasmon induced carrier generators with unconventionally exquisite properties for designing advanced, rapid, and next generation plasmonic photodetectors with significantly high responsivity and photocurrent.


Counterexample scale free networked graphs with invariable diameter and density feature. Here, we propose a class of scale free networks G(t m) with some intriguing properties, which can not be simultaneously held by all the theoretical models with power law degree distribution in the existing literature, including (i) average degrees langle k rangle of all the generated networks are no longer a constant in the limit of large graph size, implying that they are not sparse but dense, (ii) power law parameters gamma of these networks are precisely calculated equal to 2 , as well (iii) their diameters D are all an invariant in the growth process of models. While our models have deterministic structure with clustering coefficients equivalent to zero, we might be able to obtain various candidates with nonzero clustering coefficient based on original networks using some reasonable approaches, for instance, randomly adding some new edges under the premise of keeping the three important properties above unchanged. In addition, we study trapping problem on networks G(t m) and then obtain closed form solution to mean hitting time langle mathcal H rangle t . As opposed to other previous models, our results show an unexpected phenomenon that the analytic value for langle mathcal H rangle t is approximately close to the logarithm of vertex number of networks G(t m) . From the theoretical point of view, these networked models considered here can be thought of as counterexamples for most of the published models obeying power law distribution in current study.


The Power of Two Choices for Random Walks. We apply the power of two choices paradigm to a random walk on a graph rather than moving to a uniform random neighbour at each step, a controller is allowed to choose from two independent uniform random neighbours. We prove that this allows the controller to significantly accelerate the hitting and cover times in several natural graph classes. In particular, we show that the cover time becomes linear in the number n of vertices on discrete tori and bounded degree trees, of order mathcal O (n log log n) on bounded degree expanders, and of order mathcal O (n ( log log n) 2) on the Erd H o s R ' e nyi random graph in a certain sparsely connected regime. We also consider the algorithmic question of computing an optimal strategy, and prove a dichotomy in efficiency between computing strategies for hitting and cover times.


CAGNet Content Aware Guidance for Salient Object Detection. Beneficial from Fully Convolutional Neural Networks (FCNs), saliency detection methods have achieved promising results. However, it is still challenging to learn effective features for detecting salient objects in complicated scenarios, in which i) non salient regions may have "salient like" appearance ii) the salient objects may have different looking regions. To handle these complex scenarios, we propose a Feature Guide Network which exploits the nature of low level and high level features to i) make foreground and background regions more distinct and suppress the non salient regions which have "salient like" appearance ii) assign foreground label to different looking salient regions. Furthermore, we utilize a Multi scale Feature Extraction Module (MFEM) for each level of abstraction to obtain multi scale contextual information. Finally, we design a loss function which outperforms the widely used Cross entropy loss. By adopting four different pre trained models as the backbone, we prove that our method is very general with respect to the choice of the backbone model. Experiments on five challenging datasets demonstrate that our method achieves the state of the art performance in terms of different evaluation metrics. Additionally, our approach contains fewer parameters than the existing ones, does not need any post processing, and runs fast at a real time speed of 28 FPS when processing a 480 x 480 image.


Immersed curves in Khovanov homology. We give a geometric interpretation of Bar Natan's universal invariant for the class of tangles in the 3 ball with four ends we associate with such 4 ended tangles T multicurves widetilde operatorname BN (T) , that is, collections of immersed curves with local systems in the 4 punctured sphere. These multicurves are tangle invariants up to homotopy of the underlying curves and equivalence of the local systems. They satisfy a gluing theorem which recovers the reduced Bar Natan homology of links in terms of wrapped Lagrangian Floer theory. Furthermore, we use widetilde operatorname BN (T) to define two immersed curve invariants widetilde operatorname Kh (T) and operatorname Kh (T) , which satisfy similar gluing theorems that recover reduced and unreduced Khovanov homology of links, respectively. As a first application, we prove that Conway mutation preserves reduced Bar Natan homology over the field with two elements and Rasmussen's s invariant over any field. As a second application, we give a geometric interpretation of Rozansky's categorification of the two stranded Jones Wenzl projector. This allows us to define a module structure on reduced Bar Natan and Khovanov homologies of infinitely twisted knots, generalizing a result by Benheddi.


Extenders under ZF and constructibility of rank to rank embeddings. Assume ZF (without the Axiom of Choice). Let j V varepsilon to V delta be a non trivial in cofinal Sigma 1 elementary embedding, where varepsilon, delta are limit ordinals. We prove some restrictions on the constructibility of j from V delta , mostly focusing on the case varepsilon delta . In particular, if varepsilon delta and j in L(V delta) then delta has cofinality omega . However, assuming ZFC I 3 , with the appropriate varepsilon delta , one can force to get such j in L(V V G delta) . Assuming Dependent Choice and that delta has cofinality omega (but not assuming V L(V delta) ), and j V delta to V delta is Sigma 1 elementary, we show that there are "perfectly many" such j , with none being "isolated". Assuming a proper class of weak Lowenheim Skolem cardinals, we also give a first order characterization of critical points of embeddings j V to M with M transitive. The main results rely on a development of extenders under ZF (which is most useful given such wLS cardinals).


Differential forms on log canonical spaces in positive characteristic. Given a logarithmic 1 form on the snc locus of a log canonical surface pair (X, D) over a perfect field of characteristic p ge 7 , we show that it extends with at worst logarithmic poles to any resolution of singularities. We also prove the analogous statement for regular differential forms, under an additional tameness hypothesis. In addition, residue and restriction sequences for tamely dlt pairs are established. We give a number of examples showing that our results are sharp in the surface case, and that they fail in higher dimensions. On the other hand, our techniques yield a new proof of the characteristic zero Logarithmic Extension Theorem in any dimension.


An energetically balanced, quasi Newton integrator for non hydrostatic vertical atmospheric dynamics. An energetically balanced, implicit integrator for non hydrostatic vertical atmospheric dynamics on the sphere is presented. The integrator allows for the exact balance of energy exchanges in space and time for vertical atmospheric motions by preserving the skew symmetry of the non canonical Hamiltonian formulation of the compressible Euler equations. The performance of the integrator is accelerated by a preconditioning strategy that reduces the dimensionality of the inner linear system. Here we reduce the four component velocity, density, density weighted potential temperature and Exner pressure system into a single equation for the density weighted potential temperature via repeated Schur complement decomposition and the careful selection of coupling terms. As currently formulated, the integrator is based on a horizontal vertical spatial splitting that does not permit bottom topography. The integrator is validated for standard test cases for baroclinic instability and a non hydrostatic gravity wave on the sphere and a rising bubble in a high resolution planar geometry, and shows robust convergence across all of these regimes.


Neural Machine Translation with Noisy Lexical Constraints. Lexically constrained decoding for machine translation has shown to be beneficial in previous studies. Unfortunately, constraints provided by users may contain mistakes in real world situations. It is still an open question that how to manipulate these noisy constraints in such practical scenarios. We present a novel framework that treats constraints as external memories. In this soft manner, a mistaken constraint can be corrected. Experiments demonstrate that our approach can achieve substantial BLEU gains in handling noisy constraints. These results motivate us to apply the proposed approach on a new scenario where constraints are generated without the help of users. Experiments show that our approach can indeed improve the translation quality with the automatically generated constraints.


A high quality and phonetic balanced speech corpus for Vietnamese. This paper presents a high quality Vietnamese speech corpus that can be used for analyzing Vietnamese speech characteristic as well as building speech synthesis models. The corpus consists of 5400 clean speech utterances spoken by 12 speakers including 6 males and 6 females. The corpus is designed with phonetic balanced in mind so that it can be used for speech synthesis, especially, speech adaptation approaches. Specifically, all speakers utter a common dataset contains 250 phonetic balanced sentences. To increase the variety of speech context, each speaker also utters another 200 non shared, phonetic balanced sentences. The speakers are selected to cover a wide range of age and come from different regions of the North of Vietnam. The audios are recorded in a soundproof studio room, they are sampling at 48 kHz, 16 bits PCM, mono channel.


Automatic Compilation of Resources for Academic Writing and Evaluating with Informal Word Identification and Paraphrasing System. We present the first approach to automatically building resources for academic writing. The aim is to build a writing aid system that automatically edits a text so that it better adheres to the academic style of writing. On top of existing academic resources, such as the Corpus of Contemporary American English (COCA) academic Word List, the New Academic Word List, and the Academic Collocation List, we also explore how to dynamically build such resources that would be used to automatically identify informal or non academic words or phrases. The resources are compiled using different generic approaches that can be extended for different domains and languages. We describe the evaluation of resources with a system implementation. The system consists of an informal word identification (IWI), academic candidate paraphrase generation, and paraphrase ranking components. To generate candidates and rank them in context, we have used the PPDB and WordNet paraphrase resources. We use the Concepts in Context (CoInCO) "All Words" lexical substitution dataset both for the informal word identification and paraphrase generation experiments. Our informal word identification component achieves an F 1 score of 82 , significantly outperforming a stratified classifier baseline. The main contribution of this work is a domain independent methodology to build targeted resources for writing aids.


Stability of the Albanese fibration on the Cartwright Steger surface. We verify that the Albanese fibration of the Cartwright Steger surface is stable, answering a problem left open in CKY .


Simultaneous observation of concurrent two dimensional carbon and chlorine bromine isotope fractionations of halogenated organic compounds on gas chromatography. It has been reported that isotope fractionation can occur on gas chromatography (GC), yet little is known about concurrent dual elements isotope fractionations on GC. Revelation of concurrent two dimensional carbon and chlorine bromine isotope fractionations of halogenated organic compounds (HOCs) on GC may be of important significance for compound specific isotope analysis (CSIA). This study presents an in depth investigation of the two dimensional C and Cl Br isotope fractionations of HOCs on GC using GC double focus magnetic sector high resolution mass spectrometry (GC DFS HRMS). The two dimensional C and Cl Br isotope fractionations of four organochlorines and four bromobenzenes on GC were simultaneously measured by GC DFS HRMS. The isotope fractionations were evaluated with isotope ratios, relative variations of isotope ratios and isotope fractionation extents. All the HOCs exhibited significant inverse C and Cl Br isotope fractionations. The isotope fractionations were significant in both ends of chromatographic peaks, while the isotope ratios in center retention time segments were the closest to comprehensive isotope ratios in the whole peaks. Significant correlations between C isotope fractionation and Cl Br isotope fractionation were observed, indicating that the isotope fractionations might have strong relationships and or be dominated by similar factors. Relevant mechanisms for the two dimensional C and Cl Br isotope fractionations were tentatively proposed on basis of a modified two film model and the theories related to zero point energy. The results of this study gains new insights into concurrent two dimensional isotope fractionation behaviors of HOCs during physical processes, and are conducive to CSIA studies involving C, Cl and Br for obtaining high quality data, particularly to dual elements CSIA of C and Cl Br.


Remarks on an interpolation between Wilson's theorem and Giuga's conjecture. A family of congruences interpolating between those of Wilson and Giuga is constructed. Several elementary results are established, in order to present a possible approach to establishing Giuga's conjecture.


THz amplification via a Raman scattering. A THz light amplifier and the corresponding methods are proposed, based on the Raman interaction between a THz light and visible light lasers. Two lasers, with their frequencies differing by that of a Langmuir wave, counter propagate inside a background plasma, exciting a rather strong Langmuir wave. The THz light amplification occurs through the non resonant Raman scattering between the THz light and one of the lasers in the presence of the mentioned Langmuir wave. It is normally the case that the non resonant scattering does not exchange the energy between E M fields but the author demonstrates that it is possible under the pre exciting Langmuir wave. In the presence of a pre existing Langmuir wave, the ponderomotive density perturbation between the THz light and the visible light laser is induced with the phase suitable for transferring the energy from the visible light laser to the THz light. The condition for achieving the favorable phase and the amplification strength, when the condition is met, is estimated as an mathematical formula. The gain is as high as or even higher than 100 per centimeter.


Several new product identities in relation to two variable Rogers Ramanujan type sums and mock theta functions. Product identities in two variables x, q expand infinite products as infinite sums, which are linear combinations of theta functions famous examples include Jacobi's triple product identity, Watson's quintuple identity, and Hirschhorn's septuple identity. We view these series expansions as representations in canonical bases of certain vector spaces of quasiperiodic meromorphic functions (related to sections of line and vector bundles), and find new identities for two nonuple products, an undecuple product, and several two variable Rogers Ramanujan type sums. Our main theorem explains a correspondence between the septuple product identity and the two original Rogers Ramanujan identities, involving two variable analogues of fifth order mock theta functions. We also prove a similar correspondence between an octuple product identity of Ewell and two simpler variations of the Rogers Ramanujan identities, which is related to third order mock theta functions, and conjecture other occurrences of this phenomenon. As applications, we specialize our results to obtain identities for quotients of generalized Dedekind eta functions and mock theta functions.


Understanding scholarly Natural Language Processing system diagrams through application of the Richards Engelhardt framework. We utilise Richards Engelhardt framework as a tool for understanding Natural Language Processing systems diagrams. Through four examples from scholarly proceedings, we find that the application of the framework to this ecological and complex domain is effective for reflecting on these diagrams. We argue for vocabulary to describe multiple codings, semiotic variability, and inconsistency or misuse of visual encoding principles in diagrams. Further, for application to scholarly Natural Language Processing systems, and perhaps systems diagrams more broadly, we propose the addition of "Grouping by Object" as a new visual encoding principle, and "Emphasising" as a new visual encoding type.


Cross lingual Entity Alignment with Incidental Supervision. Much research effort has been put to multilingual knowledge graph (KG) embedding methods to address the entity alignment task, which seeks to match entities in different languagespecific KGs that refer to the same real world object. Such methods are often hindered by the insufficiency of seed alignment provided between KGs. Therefore, we propose an incidentally supervised model, JEANS , which jointly represents multilingual KGs and text corpora in a shared embedding scheme, and seeks to improve entity alignment with incidental supervision signals from text. JEANS first deploys an entity grounding process to combine each KG with the monolingual text corpus. Then, two learning processes are conducted (i) an embedding learning process to encode the KG and text of each language in one embedding space, and (ii) a selflearning based alignment learning process to iteratively induce the matching of entities and that of lexemes between embeddings. Experiments on benchmark datasets show that JEANS leads to promising improvement on entity alignment with incidental supervision, and significantly outperforms state of the art methods that solely rely on internal information of KGs.


Discovering novel cancer bio markers in acquired lapatinib resistance using Bayesian methods. Genes Proteins do not work alone within our body, rather as a group they perform certain activities indicated as pathways. Signalling transduction pathways (STPs) are some of the important pathways that transmit biological signals from protein to protein controlling several cellular activities. However, many diseases such as cancer target some of these signalling pathways for their growth and malignance, but demystifying their underlying mechanisms are a very complicated tasks. In this study, we use a fully Bayesian approach to develop methodologies in discovering novel driver bio markers in aberrant STPs given two conditional high throughput gene expression data. This project, namely PathTurbEr (Pathway Perturbation Driver), is applied on a global gene expression dataset derived from the lapatinib (an EGFR HER dual inhibitor) sensitive and resistant samples from breast cancer cell lines (SKBR3). Differential expression analysis revealed 512 differentially expressed genes (DEGs) and their signalling pathway enrichment analysis revealed 22 singalling pathways as aberrated including PI3K AKT, Hippo, Chemokine, and TGF beta singalling pathway as highly dysregulated in lapatinib resistance. Next, we model the aberrant activities in TGF beta STP as a causal Bayesian network (BN) from given observational datasets using three Markov Chain Monte Carlo (MCMC) sampling methods, i.e. Neighbourhood sampler (NS) and Hit and Run (HAR) sampler, which has already proven to have more robust inference with lower chances of getting stuck at local optima and faster convergence compared to other state of art methods. Next, we examined the structural features of the optimal BN as a statistical process that generates the global structure using, p 1 model, a special class of Exponential Random Graph Models (ERGMs) and MCMC methods for their hyper parameter sampling....


RandAugment Practical automated data augmentation with a reduced search space. Recent work has shown that data augmentation has the potential to significantly improve the generalization of deep learning models. Recently, automated augmentation strategies have led to state of the art results in image classification and object detection. While these strategies were optimized for improving validation accuracy, they also led to state of the art results in semi supervised learning and improved robustness to common corruptions of images. An obstacle to a large scale adoption of these methods is a separate search phase which increases the training complexity and may substantially increase the computational cost. Additionally, due to the separate search phase, these approaches are unable to adjust the regularization strength based on model or dataset size. Automated augmentation policies are often found by training small models on small datasets and subsequently applied to train larger models. In this work, we remove both of these obstacles. RandAugment has a significantly reduced search space which allows it to be trained on the target task with no need for a separate proxy task. Furthermore, due to the parameterization, the regularization strength may be tailored to different model and dataset sizes. RandAugment can be used uniformly across different tasks and datasets and works out of the box, matching or surpassing all previous automated augmentation approaches on CIFAR 10 100, SVHN, and ImageNet. On the ImageNet dataset we achieve 85.0 accuracy, a 0.6 increase over the previous state of the art and 1.0 increase over baseline augmentation. On object detection, RandAugment leads to 1.0 1.3 improvement over baseline augmentation, and is within 0.3 mAP of AutoAugment on COCO. Finally, due to its interpretable hyperparameter, RandAugment may be used to investigate the role of data augmentation with varying model and dataset size. Code is available online.


On a problem of Erd H o s about graphs whose size is the Tur ' a n number plus one. We consider finite simple graphs. Given a graph H and a positive integer n, the Tur ' a n number of H for the order n, denoted rm ex (n,H), is the maximum size of a graph of order n not containing H as a subgraph. Erd H o s posed the following problem in 1990 "For which graphs H is it true that every graph on n vertices and rm ex (n,H) 1 edges contains at least two H s? Perhaps this is always true." We solve the second part of this problem in the negative by proving that for every integer k ge 4, there exists a graph H of order k and at least two orders n such that there exists a graph of order n and size rm ex (n,H) 1 which contains exactly one copy of H. Denote by C 4 the 4 cycle. We also prove that for every integer n with 6 le n le 11, there exists a graph of order n and size rm ex (n,C 4) 1 which contains exactly one copy of C 4, but for n 12 or n 13, the minimum number of copies of C 4 in a graph of order n and size rm ex (n,C 4) 1 is 2.


Large scale weakly supervised pre training for video action recognition. Current fully supervised video datasets consist of only a few hundred thousand videos and fewer than a thousand domain specific labels. This hinders the progress towards advanced video architectures. This paper presents an in depth study of using large volumes of web videos for pre training video models for the task of action recognition. Our primary empirical finding is that pre training at a very large scale (over 65 million videos), despite on noisy social media videos and hashtags, substantially improves the state of the art on three challenging public action recognition datasets. Further, we examine three questions in the construction of weakly supervised video action datasets. First, given that actions involve interactions with objects, how should one construct a verb object pre training label space to benefit transfer learning the most? Second, frame based models perform quite well on action recognition is pre training for good image features sufficient or is pre training for spatio temporal features valuable for optimal transfer learning? Finally, actions are generally less well localized in long videos vs. short videos since action labels are provided at a video level, how should one choose video clips for best performance, given some fixed budget of number or minutes of videos?


Compositional truth with propositional tautologies and quantifier free correctness. Cie 'sli 'nski asked whether compositional truth theory with the additional axiom that all propositional tautologies are true is conservative over Peano Arithmetic. We provide a partial answer to this question, showing that if we additionally assume that truth predicate agrees with arithmetical truth on quantifier free sentences, the resulting theory is as strong as Delta 0 induction for the compositional truth predicate, hence non conservative. On the other hand, it can be shown with a routine argument that the principle of quantifier free correctness is itself conservative.


Stability for the Training of Deep Neural Networks and Other Classifiers. We examine the stability of loss minimizing training processes that are used for deep neural networks (DNN) and other classifiers. While a classifier is optimized during training through a so called loss function, the performance of classifiers is usually evaluated by some measure of accuracy, such as the overall accuracy which quantifies the proportion of objects that are well classified. This leads to the guiding question of stability does decreasing loss through training always result in increased accuracy? We formalize the notion of stability, and provide examples of instability. Our main result consists of two novel conditions on the classifier which, if either is satisfied, ensure stability of training, that is we derive tight bounds on accuracy as loss decreases. We also derive a sufficient condition for stability on the training set alone, identifying flat portions of the data manifold as potential sources of instability. The latter condition is explicitly verifiable on the training dataset. Our results do not depend on the algorithm used for training, as long as loss decreases with training.


Towards evaluating and eliciting high quality documentation for intelligent systems. A vital component of trust and transparency in intelligent systems built on machine learning and artificial intelligence is the development of clear, understandable documentation. However, such systems are notorious for their complexity and opaqueness making quality documentation a non trivial task. Furthermore, little is known about what makes such documentation "good." In this paper, we propose and evaluate a set of quality dimensions to identify in what ways this type of documentation falls short. Then, using those dimensions, we evaluate three different approaches for eliciting intelligent system documentation. We show how the dimensions identify shortcomings in such documentation and posit how such dimensions can be use to further enable users to provide documentation that is suitable to a given persona or use case.


Vision based Robot Manipulation Learning via Human Demonstrations. Vision based learning methods provide promise for robots to learn complex manipulation tasks. However, how to generalize the learned manipulation skills to real world interactions remains an open question. In this work, we study robotic manipulation skill learning from a single third person view demonstration by using activity recognition and object detection in computer vision. To facilitate generalization across objects and environments, we propose to use a prior knowledge base in the form of a text corpus to infer the object to be interacted with in the context of a robot. We evaluate our approach in a real world robot, using several simple and complex manipulation tasks commonly performed in daily life. The experimental results show that our approach achieves good generalization performance even from small amounts of training data.


A Deep Reinforcement Learning Framework for Continuous Intraday Market Bidding. The large integration of variable energy resources is expected to shift a large part of the energy exchanges closer to real time, where more accurate forecasts are available. In this context, the short term electricity markets and in particular the intraday market are considered a suitable trading floor for these exchanges to occur. A key component for the successful renewable energy sources integration is the usage of energy storage. In this paper, we propose a novel modelling framework for the strategic participation of energy storage in the European continuous intraday market where exchanges occur through a centralized order book. The goal of the storage device operator is the maximization of the profits received over the entire trading horizon, while taking into account the operational constraints of the unit. The sequential decision making problem of trading in the intraday market is modelled as a Markov Decision Process. An asynchronous distributed version of the fitted Q iteration algorithm is chosen for solving this problem due to its sample efficiency. The large and variable number of the existing orders in the order book motivates the use of high level actions and an alternative state representation. Historical data are used for the generation of a large number of artificial trajectories in order to address exploration issues during the learning process. The resulting policy is back tested and compared against a benchmark strategy that is the current industrial standard. Results indicate that the agent converges to a policy that achieves in average higher total revenues than the benchmark strategy.


Fighting seizures with seizures diffusion and stability in neural systems. Seizure activity is a ubiquitous and pernicious pathophysiology that, in principle, should yield to mathematical treatments of (neuronal) ensemble dynamics and therefore interventions on stochastic chaos. A seizure can be characterised as a deviation of neural activity from a stable dynamical regime, i.e. one in which signals fluctuate only within a limited range. In silico treatments of neural activity are an important tool for understanding how the brain can achieve stability, as well as how pathology can lead to seizures and potential strategies for mitigating instabilities, e.g. via external stimulation. Here, we demonstrate that the (neuronal) state equation used in Dynamic Causal Modelling generalises to a Fokker Planck formalism when propagation of neuronal activity along structural connections is considered. Using the Jacobian of this generalised state equation, we show that an initially unstable system can be rendered stable via a reduction in diffusivity (i.e., connectivity that disperses neuronal fluctuations). We show, for neural systems prone to epileptic seizures, that such a reduction can be achieved via external stimulation. Specifically, we show that this stimulation should be applied in such a way as to temporarily mirror epileptic activity in the areas adjoining an affected brain region thus 'fighting seizures with seizures'. We offer proof of principle using simulations based on functional neuroimaging data collected from patients with idiopathic generalised epilepsy, in which we successfully suppress pathological activity in a distinct sub network. Our hope is that this technique can form the basis for real time monitoring and intervention devices that are capable of suppressing or even preventing seizures in a non invasive manner.


Stable characters from permutation patterns. For a fixed permutation sigma in S k , let N sigma denote the function which counts occurrences of sigma as a pattern in permutations from S n . We study the expected value (and d th moments) of N sigma on conjugacy classes of S n and prove that the irreducible character support of these class functions stabilizes as n grows. This says that there is a single polynomial in the variables n, m 1, ldots, m dk which computes these moments on any conjugacy class (of cycle type 1 m 1 2 m 2 cdots ) of any symmetric group. This result generalizes results of Hultman and of Gill, who proved the cases (d,k) (1,2) and (1,3) using ad hoc methods. Our proof is, to our knowledge, the first application of partition algebras to the study of permutation patterns.


Area Estimates for High genus Lawson surfaces via DPW. Starting at a saddle tower surface, we give a new existence proof of the Lawson surfaces xi m,k of high genus by deforming the corresponding DPW potential. As a byproduct, we obtain for fixed m estimates on the area of xi m,k in terms of their genus g m k gg1 .


Fashion Recommendation and Compatibility Prediction Using Relational Network. Fashion is an inherently visual concept and computer vision and artificial intelligence (AI) are playing an increasingly important role in shaping the future of this domain. Many research has been done on recommending fashion products based on the learned user preferences. However, in addition to recommending single items, AI can also help users create stylish outfits from items they already have, or purchase additional items that go well with their current wardrobe. Compatibility is the key factor in creating stylish outfits from single items. Previous studies have mostly focused on modeling pair wise compatibility. There are a few approaches that consider an entire outfit, but these approaches have limitations such as requiring rich semantic information, category labels, and fixed order of items. Thus, they fail to effectively determine compatibility when such information is not available. In this work, we adopt a Relation Network (RN) to develop new compatibility learning models, Fashion RN and FashionRN VSE, that addresses the limitations of existing approaches. FashionRN learns the compatibility of an entire outfit, with an arbitrary number of items, in an arbitrary order. We evaluated our model using a large dataset of 49,740 outfits that we collected from Polyvore website. Quantitatively, our experimental results demonstrate state of the art performance compared with alternative methods in the literature in both compatibility prediction and fill in the blank test. Qualitatively, we also show that the item embedding learned by FashionRN indicate the compatibility among fashion items.


The geometry of groups containing almost normal subgroups. A subgroup H leq G is said to be almost normal if every conjugate of H is commensurable to H . If H is almost normal, there is a well defined quotient space G H . We show that if a group G has type F n 1 and contains an almost normal coarse PD n subgroup H with e(G H) infty , then whenever G' is quasi isometric to G , it contains an almost normal subgroup H' that is quasi isometric to H . Moreover, the quotient spaces G H and G' H' are quasi isometric. This generalises a theorem of Mosher Sageev Whyte, who prove the case in which G H is quasi isometric to a finite valence bushy tree. Using work of Mosher, we generalise a result of Farb Mosher to show that for many surface group extensions Gamma L , any group quasi isometric to Gamma L is virtually isomorphic to Gamma L . We also prove quasi isometric rigidity for the class of finitely presented mathbb Z by ( infty ended) groups.


Euler Lagrange equations for multiobjective calculus of variations problems via set optimization. The problem of minimizing an integral functional of a vector valued Lagrangian on a set of admissible arcs with given endpoints is considered. The problem is tackled by embedding it into a set optimization problem such that the image space becomes a complete lattice. This procedure allows to define the concepts of minimizer and of infimizer, as two completely different notions. An infimizer is proved to contain minimizers or at least minimizing sequences for the linearly scalarized problems, with the scalarizing parameters being elements in the dual of the ordering cone. In this way set valued Euler Lagrange equations are obtained and weak solutions are defined for these equations. Following the guidelines of the classical results, under suitable convexity and coercivity hypotheses an existence result for an infimizer is proved. In addition to the unconstrained problem, Euler Lagrange equations are provided for the case with isoperimetric constraints. Finally, the results are applied to the optimization of the shape of energy saving buildings.


The Minimal Model Program for threefolds in characteristic five. We show the validity of the Minimal Model Program for threefolds in characteristic five.


FreeAnchor Learning to Match Anchors for Visual Object Detection. Modern CNN based object detectors assign anchors for ground truth objects under the restriction of object anchor Intersection over Unit (IoU). In this study, we propose a learning to match approach to break IoU restriction, allowing objects to match anchors in a flexible manner. Our approach, referred to as FreeAnchor, updates hand crafted anchor assignment to "free" anchor matching by formulating detector training as a maximum likelihood estimation (MLE) procedure. FreeAnchor targets at learning features which best explain a class of objects in terms of both classification and localization. FreeAnchor is implemented by optimizing detection customized likelihood and can be fused with CNN based detectors in a plug and play manner. Experiments on COCO demonstrate that FreeAnchor consistently outperforms their counterparts with significant margins.


Vertical Industries Requirements Analysis Targeted KPIs for Advanced 5G Trials. Just before the commercial roll out of European 5G networks, 5G trials in realistic environments have been recently initiated all around Europe, as pat of the Phase 3 projects of 5GPPP H2020 program 1 . The goal is to showcase 5G's capabilities and to convince stakeholders about its value adding business potential. The approach is to offer advanced 5G connectivity to real vertical industries and showcase how it enables them to overcome existing 4G network limitations and other long standing issues. The 5G EVE H2020 5GPPP project 2 offers cutting edge 5G end to end facilities (in 4 countries) to diversified vertical industry experimenters. The objective is to understand the needs of prominent industries across Europe and to offer tailor made 5G experience to each and every one of them. This paper contributes to the understanding of vertical services' needs, by offering a thorough and concise vertical requirements analysis methodology, including an examination of the 4G limitations. It also provides real life values for the targeted KPIs of three vertical sectors namely, Smart Industry (4.0), Smart Cities Health and Smart Energy, while assisting market roll out by prioritizing their connectivity needs.