On new existence of a unique common solution to a pair of non linear matrix equations. The main goal of this article is to study the existence of a unique positive definite common solution to a pair of matrix equations of the form begin eqnarray X r Q 1 displaystyle sum i 1 m A i F(X)A i mbox and X s Q 2 displaystyle sum i 1 m A i G(X)A i end eqnarray where Q 1,Q 2 in P(n) , A i in M(n) and F,G P(n) to P(n) are certain functions and r,s 1 . In order to achieve our target, we take the help of elegant properties of Thompson metric on the set of all n times n Hermitian positive definite matrices. To proceed this, we first derive a common fixed point result for a pair of mappings utilizing a certain class of control functions in a metric space. Then, we obtain some sufficient conditions to assure a unique positive definite common solution to the said equations. Finally, to validate our results, we provide a couple of numerical examples with diagrammatic representations of the convergence behaviour of iterative sequences.


Kissing number in non Euclidean spaces of constant sectional curvature. This paper provides upper and lower bounds on the kissing number of congruent radius r 0 spheres in hyperbolic mathbb H n and spherical mathbb S n spaces, for n geq 2 . For that purpose, the kissing number is replaced by the kissing function kappa H(n, r) , resp. kappa S(n, r) , which depends on the dimension n and the radius r . After we obtain some theoretical upper and lower bounds for kappa H(n, r) , we study their asymptotic behaviour and show, in particular, that kappa H(n,r) sim (n 1) cdot d n 1 cdot B( frac n 1 2 , frac 1 2 ) cdot e (n 1) r , where d n is the sphere packing density in mathbb R n , and B is the beta function. Then we produce numeric upper bounds by solving a suitable semidefinite program, as well as lower bounds coming from concrete spherical codes. A similar approach allows us to locate the values of kappa S(n, r) , for n 3, , 4 , over subintervals in 0, pi with relatively high accuracy.


Second harmonic generation of spatiotemporal optical vortices and conservation of orbital angular momentum. Spatiotemporal optical vortices (STOVs) are a new type of intrinsic optical orbital angular momentum (OAM) structure in which the OAM vector is orthogonal to the propagation direction Optica 6, 1547, (2019) and the optical phase circulates in space time. Here, we experimentally and theoretically demonstrate, for the first time, the generation of the second harmonic of a STOV carrying pulse along with the conservation of STOV based OAM. Our experiments verify that individual photons can have intrinsic orbital angular momentum perpendicular to their propagation direction.


Model based process design of a ternary protein separation using multi step gradient ion exchange SMB chromatography. Model based process design of ion exchange simulated moving bed (IEX SMB) chromatography for center cut separation of proteins is studied. Use of nonlinear binding models that describe more accurate adsorption behaviours of macro molecules could make it impossible to utilize triangle theory to obtain operating parameters. Moreover, triangle theory provides no rules to design salt profiles in IEX SMB. In the modelling study here, proteins (i.e., ribonuclease, cytochrome and lysozyme) on the chromatographic columns packed with strong cation exchanger SP Sepharose FF is used as an example system. The general rate model with steric mass action kinetics was used two closed loop IEX SMB network schemes were investigated (i.e., cascade and eight zone schemes). Performance of the IEX SMB schemes was examined with respect to multi objective indicators (i.e., purity and yield) and productivity, and compared to a single column batch system with the same amount of resin utilized. A multi objective sampling algorithm, Markov Chain Monte Carlo (MCMC), was used to generate samples for constructing the Pareto optimal fronts. MCMC serves on the sampling purpose, which is interested in sampling the Pareto optimal points as well as those near Pareto optimal. Pareto fronts of the three schemes provide the full information of trade off between the conflicting indicators of purity and yield. The results indicate the cascade IEX SMB scheme and the integrated eight zone IEX SMB scheme have the similar performance that both outperforms the single column batch system.


A PAC Bayesian Approach to Generalization Bounds for Graph Neural Networks. In this paper, we derive generalization bounds for the two primary classes of graph neural networks (GNNs), namely graph convolutional networks (GCNs) and message passing GNNs (MPGNNs), via a PAC Bayesian approach. Our result reveals that the maximum node degree and spectral norm of the weights govern the generalization bounds of both models. We also show that our bound for GCNs is a natural generalization of the results developed in arXiv 1707.09564v2 cs.LG for fully connected and convolutional neural networks. For message passing GNNs, our PAC Bayes bound improves over the Rademacher complexity based bound in arXiv 2002.06157v1 cs.LG , showing a tighter dependency on the maximum node degree and the maximum hidden dimension. The key ingredients of our proofs are a perturbation analysis of GNNs and the generalization of PAC Bayes analysis to non homogeneous GNNs. We perform an empirical study on several real world graph datasets and verify that our PAC Bayes bound is tighter than others.


Approximating the Determinant of Well Conditioned Matrices by Shallow Circuits. The determinant can be computed by classical circuits of depth O( log 2 n) , and therefore it can also be computed in classical space O( log 2 n) . Recent progress by Ta Shma Ta13 implies a method to approximate the determinant of Hermitian matrices with condition number kappa in quantum space O( log n log kappa) . However, it is not known how to perform the task in less than O( log 2 n) space using classical resources only. In this work, we show that the condition number of a matrix implies an upper bound on the depth complexity (and therefore also on the space complexity) for this task the determinant of Hermitian matrices with condition number kappa can be approximated to inverse polynomial relative error with classical circuits of depth tilde O( log n cdot log kappa) , and in particular one can approximate the determinant for sufficiently well conditioned matrices in depth tilde O ( log n) . Our algorithm combines Barvinok's recent complex analytic approach for approximating combinatorial counting problems Bar16 with the Valiant Berkowitz Skyum Rackoff depth reduction theorem for low degree arithmetic circuits Val83 .


An Infinite Dimensional SIS Model. In this article, we introduce an infinite dimensional deterministic SIS model which takes into account the heterogeneity of the infections and the social network among a large population. We study the long time behavior of the dynamic. We identify the basic reproduction number R 0 which determines whether there exists a stable endemic steady state (super critical case R 0 1 ) or if the only equilibrium is disease free (critical and sub critical case R 0 leq1 ). As an application of this general study, we prove that the so called leaky'' and all or nothing'' vaccination mechanism have the same effect on R 0 . This framework is also very natural and intuitive to model lockdown policies and study their impact.


Diverse Agents for Ad Hoc Cooperation in Hanabi. In complex scenarios where a model of other actors is necessary to predict and interpret their actions, it is often desirable that the model works well with a wide variety of previously unknown actors. Hanabi is a card game that brings the problem of modeling other players to the forefront, but there is no agreement on how to best generate a pool of agents to use as partners in ad hoc cooperation evaluation. This paper proposes Quality Diversity algorithms as a promising class of algorithms to generate populations for this purpose and shows an initial implementation of an agent generator based on this idea. We also discuss what metrics can be used to compare such generators, and how the proposed generator could be leveraged to help build adaptive agents for the game.


Inductor coil of the highest possible Q. The geometry of an inductor made of a long thin wire and having the highest possible Q factor is found by numerical optimization. As frequency increases, the Q factor first grows linearly and then according to a square root law, while the cross section of the optimal coil evolves from near circular to sickle shaped.


On the Joint Distribution of the Roots of Pairs of Polynomial Congruences. Let f(x) be a primitive irreducible polynomial with integer coefficients of degree greater than one. In 1964, Hooley showed that the sequence of normalized roots u n, where f(u) 0(n), ordered in the obvious way, is uniformly distributed modulo one. It is the goal of this paper to show that if f(x) and g(x) are a pair of primitive irreducible polynomials of degree greater than one, not necessarily distinct, then the sequence (u n,v n), with f(u) 0(n) and g(v) 0(n), ordered in the obvious way, is uniformly distributed modulo one in the unit torus.


An Analysis of Quality Indicators Using Approximated Optimal Distributions in a Three dimensional Objective Space. Although quality indicators play a crucial role in benchmarking evolutionary multi objective optimization algorithms, their properties are still unclear. One promising approach for understanding quality indicators is the use of the optimal distribution of objective vectors that optimizes each quality indicator. However, it is difficult to obtain the optimal distribution for each quality indicator, especially when its theoretical property is unknown. Thus, optimal distributions for most quality indicators have not been well investigated. To address these issues, first, we propose a problem formulation of finding the optimal distribution for each quality indicator on an arbitrary Pareto front. Then, we approximate the optimal distributions for nine quality indicators using the proposed problem formulation. We analyze the nine quality indicators using their approximated optimal distributions on eight types of Pareto fronts of three objective problems. Our analysis demonstrates that uniformly distributed objective vectors over the entire Pareto front are not optimal in many cases. Each quality indicator has its own optimal distribution for each Pareto front. We also examine the consistency among the nine quality indicators.


Models from the 19th Century used for Visualizing Optical Phenomena and Line Geometry. The main focus of this paper is on models of quartic surfaces, especially so called complex surfaces. These are special fourth degree surfaces that Julius Pl "ucker introduced in the 1860s for visualizing the local structure of a quadratic line complex. Pl "ucker's complex surfaces turned out to be closely related to Kummer surfaces and both of these types of quartics are examples of caustic surfaces, which arise in geometrical optics. Indeed, Kummer surfaces represent a natural generalization of the wave surface, first introduced by Augustin Fresnel to explain double refraction in biaxial crystals.


Computational analysis of laminar structure of the human cortex based on local neuron features. In this paper, we present a novel method for analysis and segmentation of laminar structure of the cortex based on tissue characteristics whose change across the gray matter underlies distinctive between cortical layers. We develop and analyze features of individual neurons to investigate changes in cytoarchitectonic differentiation and present a novel high performance, automated framework for neuron level histological image analysis. Local tissue and cell descriptors such as density, neuron size and other measures are used for development of more complex neuron features used in machine learning model trained on data manually labeled by three human experts. Final neuron layer classifications were obtained by training a separate model for each expert and combining their probability outputs. Importances of developed neuron features on both global model level and individual prediction level are presented and discussed.


Impact force reduction by consecutive water entry of spheres. Free falling objects impacting onto water pools experience a very high initial impact force, greatest at the moment when breaking through the free surface. Many have intuitively wondered whether throwing another object in front of an important object (like oneself) before impacting the water surface may reduce this high impact force. Here, we test this idea experimentally by allowing two spheres to consecutively enter the water and measuring the forces on the trailing sphere. We find that the impact acceleration reduction on the trailing sphere depends on the dynamics of the cavity created by the first sphere and the relative timing of the second sphere impact. These combined effects are captured by the non dimensional Matryoshka' number, which classifies the observed phenomena into four major regimes. In three of these regimes, we find that the impact acceleration on the second sphere is reduced by up to 78 relative to impact on a quiescent water surface. Surprisingly, in one of the regimes, the force on the trailing sphere is dramatically increased by more than 400 in the worst case observed. We explain how the various stages of cavity evolution result in the observed alterations in impact force in this multi body water entry problem.


Cost Sensitive Feature Selection by Optimizing F Measures. Feature selection is beneficial for improving the performance of general machine learning tasks by extracting an informative subset from the high dimensional features. Conventional feature selection methods usually ignore the class imbalance problem, thus the selected features will be biased towards the majority class. Considering that F measure is a more reasonable performance measure than accuracy for imbalanced data, this paper presents an effective feature selection algorithm that explores the class imbalance issue by optimizing F measures. Since F measure optimization can be decomposed into a series of cost sensitive classification problems, we investigate the cost sensitive feature selection by generating and assigning different costs to each class with rigorous theory guidance. After solving a series of cost sensitive feature selection problems, features corresponding to the best F measure will be selected. In this way, the selected features will fully represent the properties of all classes. Experimental results on popular benchmarks and challenging real world data sets demonstrate the significance of cost sensitive feature selection for the imbalanced data setting and validate the effectiveness of the proposed method.


Robustness of Accuracy Metric and its Inspirations in Learning with Noisy Labels. For multi class classification under class conditional label noise, we prove that the accuracy metric itself can be robust. We concretize this finding's inspiration in two essential aspects training and validation, with which we address critical issues in learning with noisy labels. For training, we show that maximizing training accuracy on sufficiently many noisy samples yields an approximately optimal classifier. For validation, we prove that a noisy validation set is reliable, addressing the critical demand of model selection in scenarios like hyperparameter tuning and early stopping. Previously, model selection using noisy validation samples has not been theoretically justified. We verify our theoretical results and additional claims with extensive experiments. We show characterizations of models trained with noisy labels, motivated by our theoretical results, and verify the utility of a noisy validation set by showing the impressive performance of a framework termed noisy best teacher and student (NTS). Our code is released.


On Free Boundary Minimal Annuli Embedded in the Unit Ball. We prove that an embedded free boundary minimal annulus in the unit three ball which is invariant under the antipodal map is the critical catenoid. Our proof combines a boundary nodal domain argument with the two piece property to show that the first Steklov eigenspace of the annulus is the space of linear functions by a result of Fraser Schoen, we conclude the annulus is rotationally invariant.


Note on the number of zeros of zeta (k) (s) . Assuming the Riemann hypothesis, we prove that N k(T) frac T 2 pi log frac T 4 pi e O k left( frac log T log log T right), where N k(T) is the number of zeros of zeta (k) (s) in the region 0 Im s le T . We further apply our method and obtain a zero counting formula for the derivative of Selberg zeta functions, improving earlier work of Luo.


PROFIT A Novel Training Method for sub 4 bit MobileNet Models. 4 bit and lower precision mobile models are required due to the ever increasing demand for better energy efficiency in mobile devices. In this work, we report that the activation instability induced by weight quantization (AIWQ) is the key obstacle to sub 4 bit quantization of mobile networks. To alleviate the AIWQ problem, we propose a novel training method called PROgressive Freezing Iterative Training (PROFIT), which attempts to freeze layers whose weights are affected by the instability problem stronger than the other layers. We also propose a differentiable and unified quantization method (DuQ) and a negative padding idea to support asymmetric activation functions such as h swish. We evaluate the proposed methods by quantizing MobileNet v1, v2, and v3 on ImageNet and report that 4 bit quantization offers comparable (within 1.48 top 1 accuracy) accuracy to full precision baseline. In the ablation study of the 3 bit quantization of MobileNet v3, our proposed method outperforms the state of the art method by a large margin, 12.86 of top 1 accuracy.


Normalized Diversification. Generating diverse yet specific data is the goal of the generative adversarial network (GAN), but it suffers from the problem of mode collapse. We introduce the concept of normalized diversity which force the model to preserve the normalized pairwise distance between the sparse samples from a latent parametric distribution and their corresponding high dimensional outputs. The normalized diversification aims to unfold the manifold of unknown topology and non uniform distribution, which leads to safe interpolation between valid latent variables. By alternating the maximization over the pairwise distance and updating the total distance (normalizer), we encourage the model to actively explore in the high dimensional output space. We demonstrate that by combining the normalized diversity loss and the adversarial loss, we generate diverse data without suffering from mode collapsing. Experimental results show that our method achieves consistent improvement on unsupervised image generation, conditional image generation and hand pose estimation over strong baselines.


Stable Phase Retrieval from Locally Stable and Conditionally Connected Measurements. This paper is concerned with stable phase retrieval for a family of phase retrieval models we name "locally stable and conditionally connected" (LSCC) measurement schemes. For every signal f , we associate a corresponding weighted graph G f , defined by the LSCC measurement scheme, and show that the phase retrievability of the signal f is determined by the connectivity of G f . We then characterize the phase retrieval stability of the signal f by two measures that are commonly used in graph theory to quantify graph connectivity the Cheeger constant of G f for real valued signals, and the algebraic connectivity of G f for complex valued signals. We use our results to study the stability of two phase retrieval models that can be cast as LSCC measurement schemes, and focus on understanding for which signals the "curse of dimensionality" can be avoided. The first model we discuss is a finite dimensional model for locally supported measurements such as the windowed Fourier transform. For signals "without large holes", we show the stability constant exhibits only a mild polynomial growth in the dimension, in stark contrast with the exponential growth which uniform stability constants tend to suffer from more precisely, in R d the constant grows proportionally to d 1 2 , while in C d it grows proportionally to d . We also show the growth of the constant in the complex case cannot be reduced, suggesting that complex phase retrieval is substantially more difficult than real phase retrieval. The second model we consider is an infinite dimensional phase retrieval problem in a principal shift invariant space. We show that despite the infinite dimensionality of this model, signals with monotone exponential decay will have a finite stability constant. In contrast, the stability bound provided by our results will be infinite if the signal's decay is polynomial.


On decidability of hyperbolicity. We prove that a wide range of coloring problems in graphs on surfaces can be resolved by inspecting a finite number of configurations.


X ray Writing of Fiber Bragg Gratings (FBGs). Fabrication of nanoscale optical Fiber Bragg Gratings (FBGs) is one of the key manufacturing processes for fiber optics, which has many important applications in data communication and distributed remote sensing at a distance up to hundreds of kms. However, the fabrication of the FBGs is challenging. To meet such need, we propose a novel method to write the FBGs using high flux synchrotron x ray with a nanoscale gold Si gratings to modulate the x ray flux and thus change the refractive index contrast of the optical fiber to form the FBGs. The nanoscale gold Si with high aspect ratio has been fabricated at the Center for Nanoscale Materials (CNM) at Argonne National Laboratory (ANL) and the preliminary experiment of x ray writing of the optical fiber FBGs has been carried out at the Advanced Photon Source (APS) of ANL. The preliminary experiment shows promising result of the x ray writing method of the optical fiber FBGs.


CAWA An Attention Network for Credit Attribution. Credit attribution is the task of associating individual parts in a document with their most appropriate class labels. It is an important task with applications to information retrieval and text summarization. When labeled training data is available, traditional approaches for sequence tagging can be used for credit attribution. However, generating such labeled datasets is expensive and time consuming. In this paper, we present "Credit Attribution With Attention (CAWA)", a neural network based approach, that instead of using sentence level labeled data, uses the set of class labels that are associated with an entire document as a source of distant supervision. CAWA combines an attention mechanism with a multilabel classifier into an end to end learning framework to perform credit attribution. CAWA labels the individual sentences from the input document using the resultant attention weights. CAWA improves upon the state of the art credit attribution approach by not constraining a sentence to belong to just one class, but modeling each sentence as a distribution over all classes, leading to better modeling of semantically similar classes. Experiments on the credit attribution task on a variety of datasets show that the sentence class labels generated by CAWA outperform the competing approaches. Additionally, on the multilabel text classification task, CAWA performs better than the competing credit attribution approaches.


Non linear input output analysis application to boundary layer transition. We extend linear input output (resolvent) analysis to take into account nonlinear triadic interactions by considering a finite number of harmonics in the frequency domain using the harmonic balance method. Forcing mechanisms that maximize the drag are calculated using a gradient based ascent algorithm. By including nonlinearity in the analysis, the proposed frequency domain framework identifies the worst case disturbances for laminar turbulent transition. We demonstrate the framework on a flat plate boundary layer by considering three dimensional spanwise periodic perturbations triggered by a few optimal forcing modes of finite amplitude. Two types of volumetric forcing are considered, one corresponding to a single frequency spanwise wavenumber pair, and a multi harmonic where a harmonic frequency and wavenumber are also added. Depending on the forcing strategy, we recover a range of transition scenarios associated with K type and H type mechanisms, including oblique and Tollmien Schlichting waves, streaks and their breakdown. We show that nonlinearity plays a critical role in optimizing growth by combining and redistributing energy between the linear mechanisms and the higher perturbation harmonics. With a very limited range of frequencies and wavenumbers, the calculations appear to reach the early stages of the turbulent regime through the generation and breakdown of hairpin and quasi streamwise staggered vortices.


A proof of the contractibility of the 2 operad defined via the twisted tensor product. In our recent papers Sh1,2 , we introduced a it twisted tensor product of dg categories, and provided, in terms of it, it a contractible 2 operad mathcal O , acting on the category of small dg categories, in which the "natural transformations" are derived. We made use of some homotopy theory developed in To to prove the contractibility of the 2 operad mathcal O . The contractibility is an important issue, in vein of the theory of Batanin Ba1,2 , according to which an action of a contractible n operad on C makes C a weak n category. In this short note, we provide a new elementary proof of the contractibility of the 2 operad mathcal O . The proof is based on a direct computation, and is independent from the homotopy theory of dg categories (in particular, it is independent from To and from Theorem 2.4 of Sh1 ).


Improved Algorithm for Permutation Testing. A sequence f 1,2, cdots, n rightarrow mathbb R contains a pi pattern of size k , if there is a sequence of indices (i 1, i 2, cdots, i k) ( i 1 i 2 cdots i k ), satisfying that f(i a) f(i b) if pi(a) pi(b) , for a,b in k . Otherwise, f is referred to as pi free. cite newman2017testing initiated the study of testing pi freeness with one sided error. They focused on two special cases, the monotone permutations and the (1,3,2) permutation. cite ben2019finding improved the ( log n) O(k 2) non adaptive query complexity of cite newman2017testing to O(( log n) lfloor log 2 k rfloor ) . Further, cite ben2019optimal proposed an adaptive algorithm with O( log n) query complexity. However, no progress has yet been made on the problem of testing (1,3,2) pattern. In this work, we present an adaptive algorithm for testing (1,3,2) pattern. The query complexity of our algorithm is O( epsilon 2 log 4 n) , which significantly improves over the O( epsilon 7 log 26 n) query adaptive algorithm of cite newman2017testing . This improvement is mainly achieved by the proposal of a new structure embedded in the patterns.


A Scaling Algorithm for Weighted f Factors in General Graphs. We study the maximum weight perfect f factor problem on any general simple graph G (V,E,w) with positive integral edge weights w , and n V , m E . When we have a function f V rightarrow mathbb N on vertices, a perfect f factor is a generalized matching so that every vertex u is matched to f(u) different edges. The previous best algorithms on this problem have running time O(m f(V)) Gabow 2018 or tilde O (W(f(V)) 2.373 )) Gabow and Sankowski 2013 , where W is the maximum edge weight, and f(V) sum u in V f(u) . In this paper, we present a scaling algorithm for this problem with running time tilde O (mn 2 3 log W) . Previously this bound is only known for bipartite graphs Gabow and Tarjan 1989 . The running time of our algorithm is independent of f(V) , and consequently it first breaks the Omega(mn) barrier for large f(V) even for the unweighted f factor problem in general graphs.


On the degree sequences of dual graphs on surfaces. Given two graphs G and G with a one to one correspondence between their edges, when do G and G form a pair of dual graphs realizing the vertices and countries of a map embedded in a surface? A criterion was obtained by Jack Edmonds in 1965. Furthermore, let boldsymbol d (d 1, ldots,d n) and boldsymbol t (t 1, ldots,t m) be their degree sequences. Then, clearly, sum i 1 n d i sum j 1 m t j 2 ell , where ell is the number of edges in each of the two graphs, and chi n ell m is the Euler characteristic of the surface. Which sequences boldsymbol d and boldsymbol t satisfying these conditions still cannot be realized as the degree sequences? We make use of Edmonds' criterion to obtain several infinite series of exceptions for the sphere, chi 2 , and projective plane, chi 1 . We conjecture that there exist no exceptions for chi leq 0 .


Reasoning About Human Object Interactions Through Dual Attention Networks. Objects are entities we act upon, where the functionality of an object is determined by how we interact with it. In this work we propose a Dual Attention Network model which reasons about human object interactions. The dual attentional framework weights the important features for objects and actions respectively. As a result, the recognition of objects and actions mutually benefit each other. The proposed model shows competitive classification performance on the human object interaction dataset Something Something. Besides, it can perform weak spatiotemporal localization and affordance segmentation, despite being trained only with video level labels. The model not only finds when an action is happening and which object is being manipulated, but also identifies which part of the object is being interacted with. Project page url https dual attention network.github.io .


Topological representations of motion groups and mapping class groups a unified functorial construction. Groups of a topological origin, such as braid groups and mapping class groups, often have "wild" representation theory. One would therefore like to construct representations of these groups topologically, in order to use topological tools to study them. A key example is Bigelow and Krammer's proof of the linearity of the braid groups, which uses topologically defined representations due to Lawrence and Bigelow. We give a unified construction of such topological representations a large family of representations of a category containing all mapping class groups and motion groups in a fixed dimension. This unifies many previously known constructions, including those of Lawrence Bigelow, together with many new families of representations. Varying one parameter of the construction also produces pro nilpotent towers of representations, of which we give several non trivial low dimensional examples. Moreover, the rich structure of this category helps to clarify the representation theory of these families of groups.


Smell Pittsburgh Engaging Community Citizen Science for Air Quality. Urban air pollution has been linked to various human health concerns, including cardiopulmonary diseases. Communities who suffer from poor air quality often rely on experts to identify pollution sources due to the lack of accessible tools. Taking this into account, we developed Smell Pittsburgh, a system that enables community members to report odors and track where these odors are frequently concentrated. All smell report data are publicly accessible online. These reports are also sent to the local health department and visualized on a map along with air quality data from monitoring stations. This visualization provides a comprehensive overview of the local pollution landscape. Additionally, with these reports and air quality data, we developed a model to predict upcoming smell events and send push notifications to inform communities. We also applied regression analysis to identify statistically significant effects of push notifications on user engagement. Our evaluation of this system demonstrates that engaging residents in documenting their experiences with pollution odors can help identify local air pollution patterns, and can empower communities to advocate for better air quality. All citizen contributed smell data are publicly accessible and can be downloaded from https smellpgh.org.


Conformal transformations of the pseudo Riemannian metric of a homogeneous pair. We introduce a new notion of a homogeneous pair for a pseudo Riemannian metric g and a positive function f on a manifold M admitting a free mathbb R 0 action. There are many examples admitting this structure. For example, (a) a class of pseudo Hessian manifolds admitting a free mathbb R 0 action and a homogeneous potential function such as the moduli space of torsion free G 2 structures, (b) the space of Riemannian metrics on a compact manifold, and (c) many moduli spaces of geometric structures such as torsion free rm Spin (7) structures admit this structure. Hence we provide the unified method for the study of these geometric structures. We consider conformal transformations of the pseudo Riemannian metric g of a homogeneous pair (g, f) . Showing that the pseudo Riemannian manifold (M, (v circ f) g) , where v mathbb R 0 rightarrow mathbb R 0 is a smooth function, has the structure of a warped product, we study the geometric structures such as the sectional curvature, geodesics and the metric completion (if g is positive definite) w.r.t. (v circ f) g in terms of those on the level set of f . In particular, (1) we can generalize the result of Clarke and Rubinstein about the metric completion of the space of Riemannian metrics w.r.t. the conformal transformations of the Ebin metric, and (2) two canonical Riemannian metrics on the G 2 moduli space have different metric completions.


Sapphire A Configurable Crypto Processor for Post Quantum Lattice based Protocols. Public key cryptography protocols, such as RSA and elliptic curve cryptography, will be rendered insecure by Shor's algorithm when large scale quantum computers are built. Cryptographers are working on quantum resistant algorithms, and lattice based cryptography has emerged as a prime candidate. However, high computational complexity of these algorithms makes it challenging to implement lattice based protocols on low power embedded devices. To address this challenge, we present Sapphire a lattice cryptography processor with configurable parameters. Efficient sampling, with a SHA 3 based PRNG, provides two orders of magnitude energy savings a single port RAM based number theoretic transform memory architecture is proposed, which provides 124k gate area savings while a low power modular arithmetic unit accelerates polynomial computations. Our test chip was fabricated in TSMC 40nm low power CMOS process, with the Sapphire cryptographic core occupying 0.28 mm2 area consisting of 106k logic gates and 40.25 KB SRAM. Sapphire can be programmed with custom instructions for polynomial arithmetic and sampling, and it is coupled with a low power RISC V micro processor to demonstrate NIST Round 2 lattice based CCA secure key encapsulation and signature protocols Frodo, NewHope, qTESLA, CRYSTALS Kyber and CRYSTALS Dilithium, achieving up to an order of magnitude improvement in performance and energy efficiency compared to state of the art hardware implementations. All key building blocks of Sapphire are constant time and secure against timing and simple power analysis side channel attacks. We also discuss how masking based DPA countermeasures can be implemented on the Sapphire core without any changes to the hardware.


Mitigation of carrier induced optical bistability in silicon ring resonators. We present a detailed study of electrical and optical generated free carrier on the spectral characteristics of a silicon microring modulator. The spectral distortion generated due to thermal and free carriers is presented, and the mechanism for mitigation is also presented. We observed that two photon induced nonlinearity could be addressed by operating the modulator at suitable bias points. Furthermore, by applying small signal drive the spectral distortion can be restored. We also present the effect of optical power and drive signal limit on the spectral characteristics. The study allows one to identify suitable device performance and operating conditions to utilize silicon ring modulator for optical signal processing.


Coherently refreshed acoustic phonons for extended light storage. Acoustic waves can serve as memory for optical information, however, acoustic phonons in the GHz regime decay on the nanosecond timescale. Usually this is dominated by intrinsic acoustic loss due to inelastic scattering of the acoustic waves and thermal phonons. Here we show a way to counteract the intrinsic acoustic decay of the phonons in a waveguide by resonantly reinforcing the acoustic wave via synchronized optical pulses. This scheme overcomes the previous constraints of phonon based optical signal processing for light storage and memory. We experimentally demonstrate on chip storage up to 40 ns, four times the intrinsic acoustic lifetime in the waveguide. We confirm the coherence of the scheme by detecting the phase of the delayed optical signal after 40 ns using homodyne detection. Through theoretical considerations we anticipate that this concept allows for storage times up to microseconds within realistic experimental limitations while maintaining a GHz bandwidth of the optical signal. The refreshed phonon based light storage removes the usual bandwidth delay product limitations of e.g. slow light schemes.


Weakly Supervised Learning of Nuanced Frames for Analyzing Polarization in News Media. In this paper we suggest a minimally supervised approach for identifying nuanced frames in news article coverage of politically divisive topics. We suggest to break the broad policy frames suggested by Boydstun et al., 2014 into fine grained subframes which can capture differences in political ideology in a better way. We evaluate the suggested subframes and their embedding, learned using minimal supervision, over three topics, namely, immigration, gun control and abortion. We demonstrate the ability of the subframes to capture ideological differences and analyze political discourse in news media.


Conservation AI Live Stream Analysis for the Detection of Endangered Species Using Convolutional Neural Networks and Drone Technology. Many different species are adversely affected by poaching. In response to this escalating crisis, efforts to stop poaching using hidden cameras, drones and DNA tracking have been implemented with varying degrees of success. Limited resources, costs and logistical limitations are often the cause of most unsuccessful poaching interventions. The study presented in this paper outlines a flexible and interoperable framework for the automatic detection of animals and poaching activity to facilitate early intervention practices. Using a robust deep learning pipeline, a convolutional neural network is trained and implemented to detect rhinos and cars (considered an important tool in poaching for fast access and artefact transportation in natural habitats) in the study, that are found within live video streamed from drones Transfer learning with the Faster RCNN Resnet 101 is performed to train a custom model with 350 images of rhinos and 350 images of cars. Inference is performed using a frame sampling technique to address the required trade off control precision and processing speed and maintain synchronisation with the live feed. Inference models are hosted on a web platform using flask web serving, OpenCV and TensorFlow 1.13. Video streams are transmitted from a DJI Mavic Pro 2 drone using the Real Time Messaging Protocol (RMTP). The best trained Faster RCNN model achieved a mAP of 0.83 IOU 0.50 and 0.69 IOU 0.75 respectively. In comparison an SSD mobilenetmodel trained under the same experimental conditions achieved a mAP of 0.55 IOU .50 and 0.27 IOU 0.75.The results demonstrate that using a FRCNN and off the shelf drones is a promising and scalable option for a range of conservation projects.


Cohomological Methods in Intersection Theory. These notes are an account of a series of lectures I gave at the LMS CMI Research School Homotopy Theory and Arithmetic Geometry Motivic and Diophantine Aspects', in July 2018, at the Imperial College London. The goal of these notes is to see how motives may be used to enhance cohomological methods, giving natural ways to prove independence of ell results for traces and zeta functions, and constructions of characteristic classes (as 0 cycles). This leads to the Grothendieck Lefschetz formula, of which we give a new motivic proof. There are also a few additions to what have been told in the lectures a proof of Grothendieck Verdier duality of 'etale motives on schemes of finite type over a regular quasi excellent scheme (which slightly improves the level of generality in the existing literature) a proof that mathbf Q linear motivic sheaves are virtually integral a proof of the motivic generic base change formula.


A New Preconditioner for the EFIE Based on Primal and Dual Graph Laplacian Spectral Filters. The Electric Field Integral Equation (EFIE) is notorious for its ill conditioning both in frequency and h refinement. Several techniques exist for fixing the equation conditioning problems based on hierarchical strategies, Calderon techniques, and related technologies. This work leverages on a new approach, based on the construction of tailored spectral filters for the EFIE components which allow the block renormalization of the EFIE spectrum resulting in a provably constant condition number for the equation. This is achieved without the need for a barycentric refinement and with low computational overhead compared with other schemes. In particular, only sparse matrices are required in addition to the EFIE original matrix. Numerical results will show the robustness of our scheme and its application to the solution of realistic problems.


Minimax Adaptive Control for a Finite Set of Linear Systems. An adaptive controller with bounded l2 gain from disturbances to errors is derived for linear time invariant systems with uncertain parameters restricted to a finite set. The gain bound refers to the closed loop system, including the non linear learning procedure. As a result, robustness to unmodelled dynamics (possibly nonlinear and infinite dimensional) follows from the small gain theorem. The approach is based on a new zero sum dynamic game formulation, which optimizes the trade off between exploration and exploitation. An explicit upper bound on the optimal value function is stated in terms of semi definite programming and a corresponding simple formula for an adaptive controller achieving the upper bound is given. Once the uncertain parameters have been sufficiently estimated, the controller behaves like standard H infinity optimal control.


From closed to open access A case study of flipped journals. In recent years, increased stakeholder pressure to transition research to Open Access has led to many journals "flipping" from a toll access to an open access publishing model. Changing the publishing model can influence the decision of authors to submit their papers to a journal, and increased article accessibility may influence citation behaviour. The aim of this paper is to show changes in the number of published articles and citations after the flipping of a journal. We analysed a set of 171 journals in the Web of Science (WoS) which flipped to open access. In addition to comparing the number of articles, average relative citation (ARC) and normalized impact factor (IF) are applied, respectively, as bibliometric indicators at the article and journal level, to trace the transformation of flipped journals covered. Our results show that flipping mostly has had positive effects on journal's IF. But it has had no obvious citation advantage for the articles. We also see a decline in the number of published articles after flipping. We can conclude that flipping to open access can improve the performance of journals, despite decreasing the tendency of authors to submit their articles and no better citation advantages for articles.


Hierarchies for Relatively Hyperbolic Virtually Special Groups. Wise's Quasiconvex Hierarchy Theorem classifying hyperbolic virtually compact special groups in terms of quasiconvex hierarchies played an essential role in Agol's proof of the Virtual Haken Conjecture. Answering a question of Wise, we construct a new virtual quasiconvex hierarchy for relatively hyperbolic virtually compact special groups. We use this hierarchy to prove a generalization of Wise's Malnormal Special Quotient Theorem for relatively hyperbolic virtually compact special groups with arbitrary peripheral subgroups.


FinBERT A Pretrained Language Model for Financial Communications. Contextual pretrained language models, such as BERT (Devlin et al., 2019), have made significant breakthrough in various NLP tasks by training on large scale of unlabeled text re sources.Financial sector also accumulates large amount of financial communication text.However, there is no pretrained finance specific language models available. In this work,we address the need by pretraining a financial domain specific BERT models, FinBERT, using a large scale of financial communication corpora. Experiments on three financial sentiment classification tasks confirm the advantage of FinBERT over generic domain BERT model. The code and pretrained models are available at https github.com yya518 FinBERT. We hope this will be useful for practitioners and researchers working on financial NLP tasks.


Learn to Augment Joint Data Augmentation and Network Optimization for Text Recognition. Handwritten text and scene text suffer from various shapes and distorted patterns. Thus training a robust recognition model requires a large amount of data to cover diversity as much as possible. In contrast to data collection and annotation, data augmentation is a low cost way. In this paper, we propose a new method for text image augmentation. Different from traditional augmentation methods such as rotation, scaling and perspective transformation, our proposed augmentation method is designed to learn proper and efficient data augmentation which is more effective and specific for training a robust recognizer. By using a set of custom fiducial points, the proposed augmentation method is flexible and controllable. Furthermore, we bridge the gap between the isolated processes of data augmentation and network optimization by joint learning. An agent network learns from the output of the recognition network and controls the fiducial points to generate more proper training samples for the recognition network. Extensive experiments on various benchmarks, including regular scene text, irregular scene text and handwritten text, show that the proposed augmentation and the joint learning methods significantly boost the performance of the recognition networks. A general toolkit for geometric augmentation is available.


SAM The Sensitivity of Attribution Methods to Hyperparameters. Attribution methods can provide powerful insights into the reasons for a classifier's decision. We argue that a key desideratum of an explanation method is its robustness to input hyperparameters which are often randomly set or empirically tuned. High sensitivity to arbitrary hyperparameter choices does not only impede reproducibility but also questions the correctness of an explanation and impairs the trust of end users. In this paper, we provide a thorough empirical study on the sensitivity of existing attribution methods. We found an alarming trend that many methods are highly sensitive to changes in their common hyperparameters e.g. even changing a random seed can yield a different explanation! Interestingly, such sensitivity is not reflected in the average explanation accuracy scores over the dataset as commonly reported in the literature. In addition, explanations generated for robust classifiers (i.e. which are trained to be invariant to pixel wise perturbations) are surprisingly more robust than those generated for regular classifiers.


On Sum of Squares Representation of Convex Forms and Generalized Cauchy Schwarz Inequalities. A convex form of degree larger than one is always nonnegative since it vanishes together with its gradient at the origin. In 2007, Parrilo asked if convex forms are always sums of squares. A few years later, Blekherman answered the question in the negative by showing through volume arguments that for high enough number of variables, there must be convex forms of degree as low as 4 that are not sums of squares. Remarkably, no examples are known to date. In this paper, we show that all convex forms in 4 variables and of degree 4 are sums of squares. We also show that if a conjecture of Blekherman related to the so called Cayley Bacharach relations is true, then the same statement holds for convex forms in 3 variables and of degree 6. These are the two minimal cases where one would have any hope of seeing convex forms that are not sums of squares (due to known obstructions). A main ingredient of the proof is the derivation of certain "generalized Cauchy Schwarz inequalities" which could be of independent interest.


A unified representation network for segmentation with missing modalities. Over the last few years machine learning has demonstrated groundbreaking results in many areas of medical image analysis, including segmentation. A key assumption, however, is that the train and test distributions match. We study a realistic scenario where this assumption is clearly violated, namely segmentation with missing input modalities. We describe two neural network approaches that can handle a variable number of input modalities. The first is modality dropout a simple but surprisingly effective modification of the training. The second is the unified representation network a network architecture that maps a variable number of input modalities into a unified representation that can be used for downstream tasks such as segmentation. We demonstrate that modality dropout makes a standard segmentation network reasonably robust to missing modalities, but that the same network works even better if trained on the unified representation.


Non realizability of the Torelli group as area preserving homeomorphisms. Nielsen realization problem for the mapping class group text Mod (S g) asks whether the natural projection p g text Homeo (S g) to text Mod (S g) has a section. While all the previous results use torsion elements in an essential way, in this paper, we focus on the much more difficult problem of realization of torsion free subgroups of text Mod (S g) . The main result of this paper is that the Torelli group has no realization inside the area preserving homeomorphisms.


Isomorphism Problem For Uniserial Modules Over An Arbitrary Ring. Firstly, we give a partial solution to the isomorphism problem for uniserial modules of finite length with the help of the morphisms between these modules over an arbitrary ring. Later, under suitable assumptions on the lattice of the submodules, we give a method to partially solve the isomorphism problem for uniserial modules over an arbitrary ring. Particular attention is given to the natural class of uniserial modules defined over algebras given by quivers.


ICMSC Intra and Cross modality Semantic Consistency for Unsupervised Domain Adaptation on Hip Joint Bone Segmentation. Unsupervised domain adaptation (UDA) for cross modality medical image segmentation has shown great progress by domain invariant feature learning or image appearance translation. Adapted feature learning usually cannot detect domain shifts at the pixel level and is not able to achieve good results in dense semantic segmentation tasks. Image appearance translation, e.g. CycleGAN, translates images into different styles with good appearance, despite its population, its semantic consistency is hardly to maintain and results in poor cross modality segmentation. In this paper, we propose intra and cross modality semantic consistency (ICMSC) for UDA and our key insight is that the segmentation of synthesised images in different styles should be consistent. Specifically, our model consists of an image translation module and a domain specific segmentation module. The image translation module is a standard CycleGAN, while the segmentation module contains two domain specific segmentation networks. The intra modality semantic consistency (IMSC) forces the reconstructed image after a cycle to be segmented in the same way as the original input image, while the cross modality semantic consistency (CMSC) encourages the synthesized images after translation to be segmented exactly the same as before translation. Comprehensive experimental results on cross modality hip joint bone segmentation show the effectiveness of our proposed method, which achieves an average DICE of 81.61 on the acetabulum and 88.16 on the proximal femur, outperforming other state of the art methods. It is worth to note that without UDA, a model trained on CT for hip joint bone segmentation is non transferable to MRI and has almost zero DICE segmentation.


The Connected Domination Number of Grids. Closed form expressions for the domination number of an n times m grid have attracted significant attention, and an exact expression has been obtained in 2011 by Gon c c alves et al. In this paper, we present our results on obtaining new lower bounds on the connected domination number of an n times m grid. The problem has been solved for grids with up to 4 rows and with 6 rows by Tolouse et al and the best currently known lower bound for arbitrary m,n is lceil frac mn 3 rceil . Fujie came up with a general construction for a connected dominating set of an n times m grid of size min left 2n (m 4) lfloor frac m 4 3 rfloor(n 2), 2m (n 4) lfloor frac n 4 3 rfloor(m 2) right . In this paper, we investigate whether this construction is indeed optimum. We prove a new lower bound of left lceil frac mn 2 lceil frac min m,n 3 rceil 3 right rceil for arbitrary m,n geq 4 .


Intrusion detection systems using classical machine learning techniques versus integrated unsupervised feature learning and deep neural network. Security analysts and administrators face a lot of challenges to detect and prevent network intrusions in their organizations, and to prevent network breaches, detecting the breach on time is crucial. Challenges arise while detecting unforeseen attacks. This work includes a performance comparison of classical machine learning approaches that require vast feature engineering, versus integrated unsupervised feature learning and deep neural networks on the NSL KDD dataset. Various trials of experiments were run to identify suitable hyper parameters and network configurations of machine learning models. The DNN using 15 features extracted using Principal Component analysis was the most effective modeling method. The further analysis using the Software Defined Networking features also presented a good accuracy using Deep Neural network.


Leveraging Deep Learning to Improve the Performance Predictability of Cloud Microservices. Performance unpredictability is a major roadblock towards cloud adoption, and has performance, cost, and revenue ramifications. Predictable performance is even more critical as cloud services transition from monolithic designs to microservices. Detecting QoS violations after they occur in systems with microservices results in long recovery times, as hotspots propagate and amplify across dependent services. We present Seer, an online cloud performance debugging system that leverages deep learning and the massive amount of tracing data cloud systems collect to learn spatial and temporal patterns that translate to QoS violations. Seer combines lightweight distributed RPC level tracing, with detailed low level hardware monitoring to signal an upcoming QoS violation, and diagnose the source of unpredictable performance. Once an imminent QoS violation is detected, Seer notifies the cluster manager to take action to avoid performance degradation altogether. We evaluate Seer both in local clusters, and in large scale deployments of end to end applications built with microservices with hundreds of users. We show that Seer correctly anticipates QoS violations 91 of the time, and avoids the QoS violation to begin with in 84 of cases. Finally, we show that Seer can identify application level design bugs, and provide insights on how to better architect microservices to achieve predictable performance.


Hierarchical Graph Network for Multi hop Question Answering. In this paper, we present Hierarchical Graph Network (HGN) for multi hop question answering. To aggregate clues from scattered texts across multiple paragraphs, a hierarchical graph is created by constructing nodes on different levels of granularity (questions, paragraphs, sentences, entities), the representations of which are initialized with pre trained contextual encoders. Given this hierarchical graph, the initial node representations are updated through graph propagation, and multi hop reasoning is performed via traversing through the graph edges for each subsequent sub task (e.g., paragraph selection, supporting facts extraction, answer prediction). By weaving heterogeneous nodes into an integral unified graph, this hierarchical differentiation of node granularity enables HGN to support different question answering sub tasks simultaneously. Experiments on the HotpotQA benchmark demonstrate that the proposed model achieves new state of the art, outperforming existing multi hop QA approaches.


Towards sodium combustion modelling with liquid water. Solid and liquid sodium combustion with liquid water occurs through a thin gas layer where exothermic reactions happen with sodium and water vapors. It thus involves multiple interfaces separating liquid and gas in the presence of surface tension, phase transition and surface reactions. The gas phase reaction involves compressible effects resulting in possible shock wave appearance in both gas and liquid phases. To understand and predict the complexity of sodium combustion with water a diffuse interface flow model is built. This formulation enables flow resolution in multidimension in the presence of complex motion, such as for example Leidenfrost type thermo chemical flow. More precisely sodium drop autonomous motion on the liquid surface is computed. Various modelling and numerical issues are present and addressed in the present contribution. In the author's knowledge, the first computed results of such type of combustion phenomenon in multidimensions are presented in this paper thanks to the diffuse interface approach. Explosion phenomenon is addressed as well and is reproduced at least qualitatively thanks to extra ingredients such as turbulent mixing of sodium and water vapors in the gas film and delayed ignition. Shock wave emission from the thermo chemical Leidenfrost type flow is observed as reported in related experiments.


Uncertainty Aware Anticipation of Activities. Anticipating future activities in video is a task with many practical applications. While earlier approaches are limited to just a few seconds in the future, the prediction time horizon has just recently been extended to several minutes in the future. However, as increasing the predicted time horizon, the future becomes more uncertain and models that generate a single prediction fail at capturing the different possible future activities. In this paper, we address the uncertainty modelling for predicting long term future activities. Both an action model and a length model are trained to model the probability distribution of the future activities. At test time, we sample from the predicted distributions multiple samples that correspond to the different possible sequences of future activities. Our model is evaluated on two challenging datasets and shows a good performance in capturing the multi modal future activities without compromising the accuracy when predicting a single sequence of future activities.


Stability of vacuum for the Boltzmann Equation with moderately soft potentials. We consider the spatially inhomogeneous non cutoff Boltzmann equation with moderately soft potentials and any singularity parameter s in (0,1) , i.e. with gamma 2s in(0,2 on the whole space mathbb R 3 . We prove that if the initial data f text in are close to the vacuum solution f text vac 0 in an appropriate weighted norm then the solution f remains regular globally in time and approaches a solution to a linear transport equation. Our proof uses L 2 estimates and we prove a multitude of new estimates involving the Boltzmann kernel without angular cut off. Moreover, we rely on various previous works including those of Gressman Strain, Henderson Snelson Tarfulea and Silverstre. From the point of view of the long time behavior we treat the Boltzmann collisional operator perturbatively. Thus an important challenge of this problem is to exploit the dispersive properties of the transport operator to prove integrable time decay of the collisional operator. This requires the most care and to successfully overcome this difficulty we draw inspiration from Luk's work Stability of vacuum for the Landau equation with moderately soft potentials, Annals of PDE (2019) 5 11 and that of Smulevici Small data solutions of the Vlasov Poisson system and the vector field method, Ann. PDE, 2(2) Art. 11, 55, 2016 . In particular, to get at least integrable time decay we need to consolidate the decay coming from the space time weights and the decay coming from commuting vector fields.


E commerce Recommendation with Weighted Expected Utility. Different from shopping at retail stores, consumers on e commerce platforms usually cannot touch or try products before purchasing, which means that they have to make decisions when they are uncertain about the outcome (e.g., satisfaction level) of purchasing a product. To study people's preferences, economics researchers have proposed the hypothesis of Expected Utility (EU) that models the subject value associated with an individual's choice as the statistical expectations of that individual's valuations of the outcomes of this choice. Despite its success in studies of game theory and decision theory, the effectiveness of EU, however, is mostly unknown in e commerce recommendation systems. Previous research on e commerce recommendation interprets the utility of purchase decisions either as a function of the consumed quantity of the product or as the gain of sellers buyers in the monetary sense. As most consumers just purchase one unit of a product at a time and most alternatives have similar prices, such modeling of purchase utility is likely to be inaccurate in practice. In this paper, we interpret purchase utility as the satisfaction level a consumer gets from a product and propose a recommendation framework using EU to model consumers' behavioral patterns. We assume that consumer estimates the expected utilities of all the alternatives and choose products with maximum expected utility for each purchase. To deal with the potential psychological biases of each consumer, we introduce the usage of Probability Weight Function (PWF) and design our algorithm based on Weighted Expected Utility (WEU). Empirical study on real world e commerce datasets shows that our proposed ranking based recommendation framework achieves statistically significant improvement against both classical Collaborative Filtering Latent Factor Models and state of the art deep models in top K recommendation.


Two variable fragment of Term Modal Logic. Term modal logics (TML) are modal logics with unboundedly many modalities, with quantification over modal indices, so that we can have formulas of the form exists y. forall x. ( Box x P(x,y) supset Diamond y P(y,x)) . Like First order modal logic, TML is also "notoriously" undecidable, in the sense that even very simple fragments are undecidable. In this paper, we show the decidability of one interesting fragment, that of two variable TML. This is in contrast to two variable First order modal logic, which is undecidable.


Unraveling linguistic patterns in dog behaviour. Apparently random events in nature often reveal hidden patterns when analysed using diverse and robust statistical tools. Power law distributions, for example, project diverse natural phenomenon, ranging from earthquakes1 to heartbeat dynamics2 onto a common platform of statistical self similarity. A large range of human languages are known to follow a specific regime of power law distributions, the Zipf Mandelbrot law, in addition to showing properties like the Pareto principle and Shannon entropy3,4. Animal behaviour in specific contexts have been shown to follow power law distributions5,6. However, the entire behavioural repertoire of a species has never been analysed for the existence of underlying patterns. Here we show that the frequency rank data of randomly sighted behaviours at the population level of free ranging dogs follow a scale invariant power law behaviour. While the data does not display Zipfian trends, it obeys the Pareto principle and Shannon entropy rules akin to languages. Interestingly, the data also exhibits robust self similarity patterns at different scales which we extract using multifractal detrended fluctuation analysis7. The observed multifractal trends suggest that the probability of consecutive occurrence of behaviours of adjacent ranks is much higher than behaviours widely separated in rank. Since we observe such robust trends in random data sets, we hypothesize that the general behavioural repertoire of a species is shaped by a syntax similar to languages. This opens up the prospect of future multifractal and other statistical investigations on true time series of behavioural data to probe the existence of possible long and short range correlations, and thereby develop predictive models of behaviour.


LaserTank is NP complete. We show that the classical game LaserTank is mathrm NP complete, even when the tank movement is restricted to a single column and the only blocks appearing on the board are mirrors and solid blocks. We show this by reducing 3 SAT instances to LaserTank puzzles.


Private Yet Verifiable Contact Tracing. We propose PrYVeCT, a private yet verifiable contact tracing system. PrYVeCT works also as an authorization framework allowing for the definition of fine grained policies, which a certain facility can define and apply to better model its own access rules. Users are authorized to access the facility only when they exhibit a contact trace that complies with the policy. The policy evaluation process is carried out without disclosing the personal data of the user. At the same time, each user can prove to a third party (e.g., a public authority) that she received a certain authorization. PrYVeCT takes advantage of oblivious automata evaluation to implement a privacy preserving policy enforcement mechanism.


On smooth Fano fourfolds of Picard number two. We classify the smooth Fano 4 folds of Picard number two that have a general hypersurface Cox ring.


The Hodge realization of the polylogarithm on the product of multiplicative groups. The purpose of this article is to describe explicitly the polylogarithm class in absolute Hodge cohomology of a product of multiplicative groups, in terms of the Bloch Wigner Ramakrishnan polylogarithm functions. We will use the logarithmic Dolbeault complex defined by Burgos to calculate the corresponding absolute Hodge cohomology groups.


The Kurdyka L ojasiewicz inequality as regularity condition. We show that a Kurdyka L ojasiewicz (KL) inequality can be used as regularity condition for Tikhonov regularization with linear operators in Banach spaces. In fact, we prove the equivalence of a KL inequality and various known regularity conditions (variational inequality, rate conditions, and others) that are utilized for postulating smoothness conditions to obtain convergence rates. Case examples of rate estimates for Tikhonov regularization with source conditions or with conditional stability estimate illustrate the theoretical result.


Ergodicity for stochastic equation of Navier Stokes type. In the first part of the note we analyze the long time behaviour of a two dimensional stochastic Navier Stokes equations system on a torus with a degenerate, one dimensional noise. In particular, for some initial data and noises we identify the invariant probability measure for the system and give a sufficient condition under which it is unique and stochastically stable. In the second part of the note, we consider a simple example of a finite dimensional system of stochastic differential equations driven by a one dimensional Wiener process with a drift, that displays some similarity with the stochastic N.S.E., and investigate its ergodic properties depending on the strength of the drift. If the latter is sufficiently small and lies below a critical threshold, then the system admits a unique invariant probability measure which is Gaussian. If, on the other hand, the strength of the noise drift is larger than the threshold, then in addition to a Gaussian invariant probability measure, there exist another one. In particular, the generator of the system is not hypoelliptic.


Incremental Sense Weight Training for the Interpretation of Contextualized Word Embeddings. We present a novel online algorithm that learns the essence of each dimension in word embeddings by minimizing the within group distance of contextualized embedding groups. Three state of the art neural based language models are used, Flair, ELMo, and BERT, to generate contextualized word embeddings such that different embeddings are generated for the same word type, which are grouped by their senses manually annotated in the SemCor dataset. We hypothesize that not all dimensions are equally important for downstream tasks so that our algorithm can detect unessential dimensions and discard them without hurting the performance. To verify this hypothesis, we first mask dimensions determined unessential by our algorithm, apply the masked word embeddings to a word sense disambiguation task (WSD), and compare its performance against the one achieved by the original embeddings. Several KNN approaches are experimented to establish strong baselines for WSD. Our results show that the masked word embeddings do not hurt the performance and can improve it by 3 . Our work can be used to conduct future research on the interpretability of contextualized embeddings.


Ancient solutions to the K "ahler Ricci flow. We give a complete classification of all kappa noncollapsed, complete ancient solutions to the K "ahler Ricci flow with nonnegative bisectional curvature.


Downlink Goodput Analysis for D2D Underlaying Massive MIMO Networks. The performance of downlink massive multiple input multiple output networks with co channel device to device communications is investigated in this paper. Specifically, we consider a cellular network with sufficient number of antennas at the base station and typical hexagonal cell coverage, where the cell users and device to device transmitters are randomly and uniformly distributed. To obtain the analytical expressions of system level performance, the asymptotic signal to interference ratios for both downlink and device to device links are first obtained, which depend on the pathloss and small scale fading of the interference channels. Since these information may not be available at the service base station or device to device transmitters, there exists a chance of packet outage. Therefore, we continue to derive the closed form approximation of the average goodput, which measures the average number of information bits successfully delivered to the receiver. Hence, the system design trade off between downlink and co channel device to device communications can be investigated analytically. Moreover, the performance region in which the co channel device to device communications could lead to better overall spectral efficiency can be obtained. Finally, it is shown by simulations that the analytical results matches the actual performance very well.


On associative operations on commutative integral domains. We describe the associative multilinear polynomial functions over commutative integral domains. This extends Marichal and Mathonet's result on infinite integral domains and provides a new proof of Andres's classification of two element n semigroups.


On the initial behaviour of the number of generators of powers of monomial ideals. Given a number q , we construct a monomial ideal I with the property that the function which describes the number of generators of I k has at least q local maxima.


Flow excited membrane instability at moderate Reynolds numbers. In this paper, we study the fluid structure interaction (FSI) of a three dimensional (3D) flexible membrane immersed in an unsteady separated flow at moderate Reynolds numbers. We employ a body conforming variational FSI solver based on the recently developed partitioned iterative scheme for the coupling of turbulent fluid flow with nonlinear structural dynamics. Of particular interest is to understand the flow excited instability of a 3D flexible membrane as a function of the non dimensional mass ratio, Reynolds number and aeroelastic number. For a wide range of the parameters, we examine two distinctive stability regimes of fluid membrane interaction deformed steady state (DSS) and dynamic balance state (DBS). We propose stability phase diagrams to demarcate the DSS and DBS regimes for the parameter space of mass ratio vs. Reynolds number and mass ratio vs. aeroelastic number. Based on the aeroelastic mode analysis, we observe a frequency synchronization between the vortex shedding frequency and the membrane vibration frequency which leads to self sustained vibrations in the dynamic balance state. To characterize the origin of the frequency lock in, we derive an approximate analytical formula for the nonlinear natural frequency by considering the added mass effect and employing a large deflection theory for a simply supported rectangular membrane. Through our systematic high fidelity numerical investigation, we find that the onset of the membrane vibration and the mode transition has a dependence on the frequency lock in between the natural frequency of the tensioned membrane and the vortex shedding frequency or its harmonics. These findings on the fluid elastic instability of membranes have implications for the design and development of control strategies for membrane wing based unmanned systems and drones.


An exploration of the encoding of grammatical gender in word embeddings. The vector representation of words, known as word embeddings, has opened a new research approach in linguistic studies. These representations can capture different types of information about words. The grammatical gender of nouns is a typical classification of nouns based on their formal and semantic properties. The study of grammatical gender based on word embeddings can give insight into discussions on how grammatical genders are determined. In this study, we compare different sets of word embeddings according to the accuracy of a neural classifier determining the grammatical gender of nouns. It is found that there is an overlap in how grammatical gender is encoded in Swedish, Danish, and Dutch embeddings. Our experimental results on the contextualized embeddings pointed out that adding more contextual information to embeddings is detrimental to the classifier's performance. We also observed that removing morpho syntactic features such as articles from the training corpora of embeddings decreases the classification performance dramatically, indicating a large portion of the information is encoded in the relationship between nouns and articles.


Explicit Pseudo K "ahler Metrics on Flag Manifolds. The coadjoint orbits of compact Lie groups each carry a canonical (positive definite) K "ahler structure, famously used to realize the group's irreducible representations in holomorphic sections of appropriate line bundles (Borel Weil theorem). Less studied are the (indefinite) invariant pseudo K "ahler structures they also admit, which can be used to realize the same representations in higher cohomology of the sections (Bott's theorem). Using eigenflag'' embeddings, we give a very explicit description of these metrics in the case of the unitary group. As a byproduct we show that U n (U n 1 times cdots times U n k ) has exactly k! invariant complex structures, a count which seems to have hitherto escaped attention.


Ultra slow electron holes in collisionless plasmas stability at high ion temperature. Numerical simulations recover ultra slow electron holes (EH) of electron acoustic genre propagating stably well below the ion acoustic speed where the ion response disallows any known pure electron perturbation. The reason of stability of EH at high ion temperature ( T i T e ) is traced to the loss of neutralizing cold ion response. In a background of cold ions, theta T e T i gg 1 , they have an ion compression that accelerates to jump over a forbidden velocity gap and settle on the high velocity tail of the electron distribution f e , confirming to a recently identified limit of the nonlinear dispersion relation. For theta T e T i le 1 , however, the warm ions begin to supplement the electron response transforming the ion compression to decompression at the hole location and triggering multiplicity of the scales in trapped electron population which prompts an immediate generalization of the basic EH theory.


Macroscopic scalar curvature and local collapsing. Consider a closed Riemannian n manifold M admitting a negatively curved Riemannian metric. We show that for every Riemannian metric on M of sufficiently small volume, there is a point in the universal cover of M such that the volume of every ball of radius r geq 1 centered at this point is greater or equal to the volume of the ball of the same radius in the hyperbolic n space. We also give an interpretation of this result in terms of macroscopic scalar curvature. This result, which holds more generally in the context of polyhedral length spaces, is related to a question of Guth. Its proof relies on a generalization of recent progress in metric geometry about the Alexandrov Urysohn width involving the volume of balls of radius in a certain range with collapsing at different scales.


TF NAS Rethinking Three Search Freedoms of Latency Constrained Differentiable Neural Architecture Search. With the flourish of differentiable neural architecture search (NAS), automatically searching latency constrained architectures gives a new perspective to reduce human labor and expertise. However, the searched architectures are usually suboptimal in accuracy and may have large jitters around the target latency. In this paper, we rethink three freedoms of differentiable NAS, i.e. operation level, depth level and width level, and propose a novel method, named Three Freedom NAS (TF NAS), to achieve both good classification accuracy and precise latency constraint. For the operation level, we present a bi sampling search algorithm to moderate the operation collapse. For the depth level, we introduce a sink connecting search space to ensure the mutual exclusion between skip and other candidate operations, as well as eliminate the architecture redundancy. For the width level, we propose an elasticity scaling strategy that achieves precise latency constraint in a progressively fine grained manner. Experiments on ImageNet demonstrate the effectiveness of TF NAS. Particularly, our searched TF NAS A obtains 76.9 top 1 accuracy, achieving state of the art results with less latency. The total search time is only 1.8 days on 1 Titan RTX GPU. Code is available at https github.com AberHu TF NAS.


Instance Segmentation of Industrial Point Cloud Data. The challenge that this paper addresses is how to efficiently minimize the cost and manual labour for automatically generating object oriented geometric Digital Twins (gDTs) of industrial facilities, so that the benefits provide even more value compared to the initial investment to generate these models. Our previous work achieved the current state of the art class segmentation performance (75 average accuracy per point and average AUC 90 in the CLOI dataset classes) as presented in (Agapaki and Brilakis 2020) and directly produces labelled point clusters of the most important to model objects (CLOI classes) from laser scanned industrial data. CLOI stands for C shapes, L shapes, O shapes, I shapes and their combinations. However, the problem of automated segmentation of individual instances that can then be used to fit geometric shapes remains unsolved. We argue that the use of instance segmentation algorithms has the theoretical potential to provide the output needed for the generation of gDTs. We solve instance segmentation in this paper through (a) using a CLOI Instance graph connectivity algorithm that segments the point clusters of an object class into instances and (b) boundary segmentation of points that improves step (a). Our method was tested on the CLOI benchmark dataset (Agapaki et al. 2019) and segmented instances with 76.25 average precision and 70 average recall per point among all classes. This proved that it is the first to automatically segment industrial point cloud shapes with no prior knowledge other than the class point label and is the bedrock for efficient gDT generation in cluttered industrial point clouds.


On modified kernel polynomials and classical type Sobolev orthogonal polynomials. In this paper we study modified kernel polynomials u n(x) sum k 0 n c k g k(x) , depending on parameters c k 0 , where g k 0 infty are orthonormal polynomials on the real line. Besides kernel polynomials with c k g k(t 0) 0 , for example, c k may be chosen to be some other solutions of the corresponding second order difference equation of g k . It is shown that all these polynomials satisfy a 4 th order recurrence relation. The cases with g k being Jacobi or Laguerre polynomials are of a special interest. Suitable choices of parameters c k imply u n to be Sobolev orthogonal polynomials with a (3 times 3) matrix measure. Moreover, a further selection of parameters gives differential equations for u n . In the latter case, polynomials u n(x) are solutions to a generalized eigenvalue problems both in x and in n .


A Simple Approach for Handling Out of Vocabulary Identifiers in Deep Learning for Source Code. There is an emerging interest in the application of natural language processing models to source code processing tasks. One of the major problems in applying deep learning to software engineering is that source code often contains a lot of rare identifiers, resulting in huge vocabularies. We propose a simple, yet effective method, based on identifier anonymization, to handle out of vocabulary (OOV) identifiers. Our method can be treated as a preprocessing step and, therefore, allows for easy implementation. We show that the proposed OOV anonymization method significantly improves the performance of the Transformer in two code processing tasks code completion and bug fixing.


The partial complex on weighted Bergman spaces on Hermitian manifolds. In this paper, we investigate the partial complex on weighted Bergman spaces on Hermitian manifolds satisfying a certain holomorphicity duality condition. This generalizes the situation of the Segal Bargmann space in mathbb C n , studied earlier by the first named author, in which the adjoint of the differentiation is the multiplication by z . The results are applied to two important examples in the unit ball, namely, the complex hyperbolic metric and a conformally K "ahler metric which are related to Bergman spaces with so called "exponential" and "standard" weights, respectively. In particular, we obtain new estimates for the solutions of the partial equation on these weighted Bergman spaces.


UCCA's Foundational Layer Annotation Guidelines v2.1. This is the annotation manual for Universal Conceptual Cognitive Annotation (UCCA Abend and Rappoport, 2013), specifically the Foundational Layer. UCCA is a graph based semantic annotation scheme based on typological linguistic principles. It has been applied to several languages for ease of exposition these guidelines give examples mainly in English. New annotators may wish to start with the tutorial on the UCCA framework (Abend et al., 2020). Further resources are available at the project homepage https universalconceptualcognitiveannotation.github.io


Distributed Resource Scheduling for Large Scale MEC Systems A Multi Agent Ensemble Deep Reinforcement Learning with Imitation Acceleration. We consider the optimization of distributed resource scheduling to minimize the sum of task latency and energy consumption for all the Internet of things devices (IoTDs) in a large scale mobile edge computing (MEC) system. To address this problem, we propose a distributed intelligent resource scheduling (DIRS) framework, which includes centralized training relying on the global information and distributed decision making by each agent deployed in each MEC server. More specifically, we first introduce a novel multi agent ensemble assisted distributed deep reinforcement learning (DRL) architecture, which can simplify the overall neural network structure of each agent by partitioning the state space and also improve the performance of a single agent by combining decisions of all the agents. Secondly, we apply action refinement to enhance the exploration ability of the proposed DIRS framework, where the near optimal state action pairs are obtained by a novel L 'evy flight search. Finally, an imitation acceleration scheme is presented to pre train all the agents, which can significantly accelerate the learning process of the proposed framework through learning the professional experience from a small amount of demonstration data. Extensive simulations are conducted to demonstrate that the proposed DIRS framework is efficient and outperforms the existing benchmark schemes.


Magnetic Moment Tensor Potentials for collinear spin polarized materials reproduce different magnetic states of bcc Fe. We present the magnetic Moment Tensor Potentials (mMTPs), a class of machine learning interatomic potentials, accurately reproducing both vibrational and magnetic degrees of freedom as provided, e.g., from first principles calculations. The accuracy is achieved by a two step minimization scheme that coarse grains the atomic and the spin space. The performance of the mMTPs is demonstrated for the prototype magnetic system bcc iron, with applications to phonon calculations for different magnetic states, and molecular dynamics simulations with fluctuating magnetic moments.


Fixed points and stable images of endomorphisms for the free group of rank two. We give an algorithm which computes the fixed subgroup and the stable image for any endomorphism of the free group of rank two F 2 , answering for F 2 a question posed by Stallings in 1984 and a question of Ventura.


Multi layer Trajectory Clustering A Network Algorithm for Disease Subtyping. Many diseases display heterogeneity in clinical features and their progression, indicative of the existence of disease subtypes. Extracting patterns of disease variable progression for subtypes has tremendous application in medicine, for example, in early prognosis and personalized medical therapy. This work present a novel, data driven, network based Trajectory Clustering (TC) algorithm for identifying Parkinson's subtypes based on disease trajectory. Modeling patient variable interactions as a bipartite network, TC first extracts communities of co expressing disease variables at different stages of progression. Then, it identifies Parkinson's subtypes by clustering similar patient trajectories that are characterized by severity of disease variables through a multi layer network. Determination of trajectory similarity accounts for direct overlaps between trajectories as well as second order similarities, i.e., common overlap with a third set of trajectories. This work clusters trajectories across two types of layers (a) temporal, and (b) ranges of independent outcome variable (representative of disease severity), both of which yield four distinct subtypes. The former subtypes exhibit differences in progression of disease domains (Cognitive, Mental Health etc.), whereas the latter subtypes exhibit different degrees of progression, i.e., some remain mild, whereas others show significant deterioration after 5 years. The TC approach is validated through statistical analyses and consistency of the identified subtypes with medical literature. This generalizable and robust method can easily be extended to other progressive multi variate disease datasets, and can effectively assist in targeted subtype specific treatment in the field of personalized medicine.


idris ct A Library to do Category Theory in Idris. We introduce idris ct, a Idris library providing verified type definitions of categorical concepts.idris ct strives to be a bridge between academy and industry, catering both to category theorists who want to implement and try their ideas in a practical environment and to businesses and engineers who care about formalization with category theory It is inspired by similar libraries developed for theorem proving but remains very practical, being aimed at software production in business. Nevertheless, the use of dependent types allows for a formally correct implementation of categorical concepts, so that guarantees can be made on software properties.


An overview of optimal control optimization problems driven by non convexity measures. Recently, literature on dynamic coherent risk measures has broadened the choices for risk sensitive performance evaluation. A running example includes Cumulative prospect theory and Conditional variance at risk. Most of them can be can be interpreted in general as a non linear transformation of a given random variable. Non convexity property has implied a lot of mathematical intricacies and challenges. The paper gives overview on the recent development of dynamic programming optimal control optimization problems driven by non convex measures.


Fair Classification with Group Dependent Label Noise. This work examines how to train fair classifiers in settings where training labels are corrupted with random noise, and where the error rates of corruption depend both on the label class and on the membership function for a protected subgroup. Heterogeneous label noise models systematic biases towards particular groups when generating annotations. We begin by presenting analytical results which show that naively imposing parity constraints on demographic disparity measures, without accounting for heterogeneous and group dependent error rates, can decrease both the accuracy and the fairness of the resulting classifier. Our experiments demonstrate these issues arise in practice as well. We address these problems by performing empirical risk minimization with carefully defined surrogate loss functions and surrogate constraints that help avoid the pitfalls introduced by heterogeneous label noise. We provide both theoretical and empirical justifications for the efficacy of our methods. We view our results as an important example of how imposing fairness on biased data sets without proper care can do at least as much harm as it does good.


ContactNets Learning Discontinuous Contact Dynamics with Smooth, Implicit Representations. Common methods for learning robot dynamics assume motion is continuous, causing unrealistic model predictions for systems undergoing discontinuous impact and stiction behavior. In this work, we resolve this conflict with a smooth, implicit encoding of the structure inherent to contact induced discontinuities. Our method, ContactNets, learns parameterizations of inter body signed distance and contact frame Jacobians, a representation that is compatible with many simulation, control, and planning environments for robotics. We furthermore circumvent the need to differentiate through stiff or non smooth dynamics with a novel loss function inspired by the principles of complementarity and maximum dissipation. Our method can predict realistic impact, non penetration, and stiction when trained on 60 seconds of real world data.


Remarks on the Liechti Strenner's examples having small dilatations. We show that the Liechti Strenner's example for the closed nonorientable surface in cite LiechtiStrenner18 minimizes the dilatation within the class of pseudo Anosov homeomorphisms with an orientable invariant foliation and all but the first coefficient of the characteristic polynomial of the action induced on the first cohomology nonpositive. We also show that the Liechti Strenner's example of orientation reversing homeomorphism for the closed orientable surface in cite LiechtiStrenner18 minimizes the dilatation within the class of pseudo Anosov homeomorphisms with an orientable invariant foliation and all but the first coefficient of the characteristic polynomial p(x) of the action induced on the first cohomology nonpositive or all but the first coefficient of p(x) (x pm 1) 2 , p(x) (x 2 pm 1) , or p(x) (x 2 pm x 1) nonpositive.


Explicit Holomorphic Structures for embeddings of closed 3 manifolds into mathbb C 3 . Expanding on my former work in 1 and with the work of Kasuya and Takase in 5 , we demonstrate that for a given link L subset M which is null homologous in H 1(M) and for any smooth 2 plane field eta over L there exists a smooth embedding F M hookrightarrow mathbb C 3 so that the complex tangents of the embedding is exactly L and at each x in L the holomorphic tangent is exactly eta x . Furthermore, we demonstrate how the analyticity of a complex tangent, as given by the Bishop invariant, may be determined exactly from the angle formed between the holomorphoc complex plane the the curve of complex tangents.


Analytically stable Higgs bundles on some non K "ahler manifolds. In this paper, we study Higgs bundles on non compact Hermitian manifolds. Under some assumptions for the underlying Hermitian manifolds which are not necessarily K "ahler, we solve the Hermitian Einstein equation on analytically stable Higgs bundles.


Cohen real or random real effect on strong measure zero sets and strongly meager sets. We show that the set of the ground model reals has strong measure zero (is strongly meager) after adding a single Cohen real (random real). As consequence we prove that the set of the ground model reals has strong measure zero after adding a single Hechler real.


Accurate Optimization of Weighted Nuclear Norm for Non Rigid Structure from Motion. Fitting a matrix of a given rank to data in a least squares sense can be done very effectively using 2nd order methods such as Levenberg Marquardt by explicitly optimizing over a bilinear parameterization of the matrix. In contrast, when applying more general singular value penalties, such as weighted nuclear norm priors, direct optimization over the elements of the matrix is typically used. Due to non differentiability of the resulting objective function, first order sub gradient or splitting methods are predominantly used. While these offer rapid iterations it is well known that they become inefficent near the minimum due to zig zagging and in practice one is therefore often forced to settle for an approximate solution. In this paper we show that more accurate results can in many cases be achieved with 2nd order methods. Our main result shows how to construct bilinear formulations, for a general class of regularizers including weighted nuclear norm penalties, that are provably equivalent to the original problems. With these formulations the regularizing function becomes twice differentiable and 2nd order methods can be applied. We show experimentally, on a number of structure from motion problems, that our approach outperforms state of the art methods.


A Generic Solver for Unconstrained Control Problems with Integral Functional Objectives. We present a generic solver for unconstrained control problems (UCPs) whose objectives take the form of an integral functional of the controllers. The solver generalizes and improves upon the algorithm proposed by Tseng and Tang for the Witsenhausen's counterexample, which provides the best known results. In essence, we show that minimizing the objective implies minimizing the marginal cost functions almost everywhere, and we perform the latter task pointwisely by the adaptive minimization technique, which speeds up the computation. We implement single threaded and parallelized versions of the proposed algorithm. Our implementation runs 30 times faster than Tseng and Tang's algorithm on the Witsenhausen's counterexample, and we demonstrate the applicability of the solver and discuss the possible generalization to constrained problems through two more examples.


Time Lagged t Distributed Stochastic Neighbor Embedding (t SNE) of Molecular Simulation Trajectories. Molecular simulation trajectories represent high dimensional data. Such data can be visualized by methods of dimensionality reduction. Non linear dimensionality reduction methods are likely to be more efficient than linear ones due to the fact that motions of atoms are non linear. Here we test a popular non linear t distributed stochastic neighbor embedding (t SNE) method on analysis of trajectories of alanine dipeptide dynamics and Trp cage folding and unfolding. Furthermore, we introduced a time lagged variant of t SNE in order to focus on slow motions in the molecular system. This time lagged t SNE efficiently visualizes slow dynamics of molecular systems.