Reconfigurable continuous zoom metalens in visible. Design of a conventional zoom lens is always challengeable because it requires not only sophisticated optical design strategy, but also complex and precise mechanical structures for lens adjustment. In this paper, we propose a continuous zoom lens consisting of two chiral geometric metasurfaces with dielectric nanobrick arrays sitting on a transparent substrate. The metalens can continuously vary the focal length by rotating either of the two metasurfaces along its optical axis without changing any other conditions. More importantly, because of the polarization dependence of the geometric metasurface, the positive and negative polarities are interchangeable in one identical metalens only by changing the handedness of the incident circularly polarized light, which can generate varyingfocal lengths ranging from negative infinity to positive infinity in principle. On account of its advantages of compactness, flexibility and easiness in design, the proposed zoom metalens can provide new perspectives for the development of continuous zoom optical system and it can find applications in fields which require ultracompact and continuous zoom imaging and reconfigurable beam wavefront steering.


Exploring Scientific Exchange in Agricultural Meteorology with Network Analysis. Network analysis is becoming increasingly relevant in the historical investigation of scientific communities and their knowledge circulation process, because it offers the opportunity to explore and visualize connections amog scientific actors on a scale qualitatively different from traditional historical methods. Temporal networks are especially suitable for this task, as they allow to investigate the evolution of scientific communities over time. In this paper we will rely on the analytical tools provided by temporal networks to examine the technical comission on agriculture (1913 1947) established by the International Meteorological Organization (IMO). By using the membership data available on this commission, we will investigate how this scientific community evolved over the decades, who were its key members, which national groups were represented, and how historical events, such as the two world wars, impacted on the work of this organization. This will give us an insight into the knowledge circulation process of this scientific body, as the IMO was an international organization based on voluntary cooperation and its work was first and foremost the immediate consequence of the interaction amog its members. In our paper we will rely on centrality measures (eigenvector, joint, and conditional centrality) to understand the structure of the comission's network, and we will constantly point out the strengths and weaknesses of temporal networks in the analysis of historical data.


Admissible surfaces in progressive addition lenses. Progressive addition lenses contain a surface of spatially varying curvature, which provides variable optical power for different viewing areas over the lens. We derive complete compatibility equations that provide the exact magnitude of cylinder along lines of curvatures on any arbitrary PAL smooth surface. These equations reveal that, contrary to current knowledge, cylinder, and its derivative, does not only depend on principal curvature and its derivatives along the principal line but also on the geodesic curvature and its derivatives along the line orthogonal to the principal line. We quantify the relevance of the geodesic curvature through numerical computations. We also derive an extended and exact Minkwitz theorem only restricted to be applied along lines of curvatures, but excluding umbilical points.


Dendrite Net A White Box Module for Classification, Regression, and System Identification. The simulation of biological dendrite computations is vital for the development of artificial intelligence (AI). This paper presents a basic machine learning algorithm, named Dendrite Net or DD, just like Support Vector Machine (SVM) or Multilayer Perceptron (MLP). DD's main concept is that the algorithm can recognize this class after learning, if the output's logical expression contains the corresponding class's logical relationship among inputs (and backslash or backslash not). Experiments and main results DD, a white box machine learning algorithm, showed excellent system identification performance for the black box system. Secondly, it was verified by nine real world applications that DD brought better generalization capability relative to MLP architecture that imitated neurons' cell body (Cell body Net) for regression. Thirdly, by MNIST and FASHION MNIST datasets, it was verified that DD showed higher testing accuracy under greater training loss than Cell body Net for classification. The number of modules can effectively adjust DD's logical expression capacity, which avoids over fitting and makes it easy to get a model with outstanding generalization capability. Finally, repeated experiments in MATLAB and PyTorch (Python) demonstrated that DD was faster than Cell body Net both in epoch and forward propagation. The main contribution of this paper is the basic machine learning algorithm (DD) with a white box attribute, controllable precision for better generalization capability, and lower computational complexity. Not only can DD be used for generalized engineering, but DD has vast development potential as a module for deep learning. DD code is available at GitHub https github.com liugang1234567 Gang neuron .


Seismic wave shield using cubic arrays of split ball resonators. Metre size inertial resonators located in the ground have been theoretically shown to interact with a seismic wave (attenuation, band gaps) to enable protection of surface structures such as buildings. The challenge for Civil Engineering is to both reduce the size of these resonators and to increase their efficiency. Here we explore steel spheres, connected to a concrete bulk medium, either by a coating of rubber, or rubber and steel ligaments, or air and steel ligaments. We show that for a cubic lattice periodicity of 1 metre, we achieve stop bands in the frequency range 14 to 20 Hz by splitting spheres in 2 and 8 pieces, we tune down the stop bands frequencies and further increase their bandwidth. We thus demonstrate we are able to provide a variety of inertial resonators with stop bands below 10 Hz i.e., in the frequency range of interest for earthquake engineering.


Laser plasma proton acceleration with a combined gas foil target. Laser plasma proton acceleration was investigated in the Target Normal Sheath Acceleration (TNSA) regime using a novel gas foil target. The target is designed for reaching higher laser intensity at the foil plane owing to relativistic self focusing and self compression of the pulse in the gas layer. Numerical 3D particle in cell (PIC) simulations were used to study pulse propagation in the gas, showing a nearly seven fold increase in peak intensity. In the experiment, maximum proton energies showed high dependence on the energy transmission of the laser through the gas and a lesser dependence on the size and shape of the pulse. At high gas densities, laser energy depletion and pulse distortion suppressed proton energies. At low densities, self focusing was observed and comparable or higher proton energies were measured with the gas.


Hierarchical Neural Architecture Search for Deep Stereo Matching. To reduce the human efforts in neural network design, Neural Architecture Search (NAS) has been applied with remarkable success to various high level vision tasks such as classification and semantic segmentation. The underlying idea for the NAS algorithm is straightforward, namely, to enable the network the ability to choose among a set of operations (e.g., convolution with different filter sizes), one is able to find an optimal architecture that is better adapted to the problem at hand. However, so far the success of NAS has not been enjoyed by low level geometric vision tasks such as stereo matching. This is partly due to the fact that state of the art deep stereo matching networks, designed by humans, are already sheer in size. Directly applying the NAS to such massive structures is computationally prohibitive based on the currently available mainstream computing resources. In this paper, we propose the first end to end hierarchical NAS framework for deep stereo matching by incorporating task specific human knowledge into the neural architecture search framework. Specifically, following the gold standard pipeline for deep stereo matching (i.e., feature extraction feature volume construction and dense matching), we optimize the architectures of the entire pipeline jointly. Extensive experiments show that our searched network outperforms all state of the art deep stereo matching architectures and is ranked at the top 1 accuracy on KITTI stereo 2012, 2015 and Middlebury benchmarks, as well as the top 1 on SceneFlow dataset with a substantial improvement on the size of the network and the speed of inference. The code is available at https github.com XuelianCheng LEAStereo.


Pivot Rules for Circuit Augmentation Algorithms in Linear Optimization. Circuit augmentation algorithms are generalizations of the Simplex method, where in each step one is allowed to move along a fixed set of directions, called circuits, that is a superset of the edges of a polytope. We show that in the circuit augmentation framework the greatest improvement and Dantzig pivot rules are NP hard, already for 0 1 LPs. Differently, the steepest descent pivot rule can be carried out in polynomial time in the 0 1 setting, and the number of circuit augmentations required to reach an optimal solution according to this rule is strongly polynomial for 0 1 LPs. The number of circuit augmentations has been of interest as a proxy for the number of steps in the Simplex method, and the circuit diameter of polyhedra has been studied as a lower bound to the combinatorial diameter of polyhedra. Extending prior results, we show that for any polyhedron P the circuit diameter is bounded by a polynomial in the input bit size of P . This is in contrast with the best bounds for the combinatorial diameter of polyhedra. Interestingly, we show that the circuit augmentation framework can be exploited to make novel conclusions about the classical Simplex method itself In particular, as a byproduct of our circuit results, we prove that (i) computing the shortest (monotone) path to an optimal solution on the 1 skeleton of a polytope is NP hard, and hard to approximate within a factor better than 2, and (ii) for 0 1 polytopes, a monotone path of strongly polynomial length can be constructed using steepest improving edges.


Securing Organization's Data A Role Based Authorized Keyword Search Scheme with Efficient Decryption. For better data availability and accessibility while ensuring data secrecy, organizations often tend to outsource their encrypted data to the cloud storage servers, thus bringing the challenge of keyword search over encrypted data. In this paper, we propose a novel authorized keyword search scheme using Role Based Encryption (RBE) technique in a cloud environment. The contributions of this paper are multi fold. First, it presents a keyword search scheme which enables only the authorized users, having proper assigned roles, to delegate keyword based data search capabilities over encrypted data to the cloud providers without disclosing any sensitive information. Second, it supports a multi organization cloud environment, where the users can be associated with more than one organization. Third, the proposed scheme provides efficient decryption, conjunctive keyword search and revocation mechanisms. Fourth, the proposed scheme outsources expensive cryptographic operations in decryption to the cloud in a secure manner. Fifth, we have provided a formal security analysis to prove that the proposed scheme is semantically secure against Chosen Plaintext and Chosen Keyword Attacks. Finally, our performance analysis shows that the proposed scheme is suitable for practical applications.


Convolutional Autoencoders for Human Motion Infilling. In this paper we propose a convolutional autoencoder to address the problem of motion infilling for 3D human motion data. Given a start and end sequence, motion infilling aims to complete the missing gap in between, such that the filled in poses plausibly forecast the start sequence and naturally transition into the end sequence. To this end, we propose a single, end to end trainable convolutional autoencoder. We show that a single model can be used to create natural transitions between different types of activities. Furthermore, our method is not only able to fill in entire missing frames, but it can also be used to complete gaps where partial poses are available (e.g. from end effectors), or to clean up other forms of noise (e.g. Gaussian). Also, the model can fill in an arbitrary number of gaps that potentially vary in length. In addition, no further post processing on the model's outputs is necessary such as smoothing or closing discontinuities at the end of the gap. At the heart of our approach lies the idea to cast motion infilling as an inpainting problem and to train a convolutional de noising autoencoder on image like representations of motion sequences. At training time, blocks of columns are removed from such images and we ask the model to fill in the gaps. We demonstrate the versatility of the approach via a number of complex motion sequences and report on thorough evaluations performed to better understand the capabilities and limitations of the proposed approach.


Cosimplicial monoids and deformation theory of tensor categories. We introduce a notion of n commutativity ( 0 le n le infty ) for cosimplicial monoids in a symmetric monoidal category bf V , where n 0 corresponds to just cosimplicial monoids in bf V, while n infty corresponds to commutative cosimplicial monoids. If bf V has a monoidal model structure we show (under some mild technical conditions) that the total object of an n cosimplicial monoid has a natural E n 1 algebra structure. Our main applications are to the deformation theory of tensor categories and tensor functors. We show that the deformation complex of a tensor functor is a total complex of a 1 commutative cosimplicial monoid and, hence, has an E 2 algebra structure similar to the E 2 structure on Hochschild complex of an associative algebra provided by Deligne's conjecture. We further demonstrate that the deformation complex of a tensor category is the total complex of a 2 commutative cosimplicial monoid and, therefore, is naturally an E 3 algebra. We make these structures very explicit through a language of Delannoy paths and their noncommutative liftings. We investigate how these structures manifest themselves in concrete examples.


Solutions to arithmetic differential equations in algebraically closed fields. We prove that the main examples in the theory of algebraic differential equations possess a remarkable total differential overconvergence property. This allows one to consider solutions to these equations with coordinates in algebraically closed fields.


Local and Global Homogeneity for Manifolds that admit a Positive Curvature Metric. In this note we study globally homogeneous Riemannian quotients Gamma backslash (M,ds 2) of homogeneous Riemannian manifolds (M,ds 2) . The Homogeneity Conjecture is that Gamma backslash (M,ds 2) is (globally) homogeneous if and only if (M,ds 2) is homogeneous and every gamma in Gamma is of constant displacement on (M,ds 2) . We provide further evidence for that conjecture by (i) verifying it for normal homogeneous Riemannian manifolds that also admit an invariant Riemannian metric of strictly positive sectional curvature and (ii) showing that in most (three or less) cases the normality condition can be dropped.


Bayesian regression explains how human participants handle parameter uncertainty. The human brain copes with sensory uncertainty in accordance with Bayes' rule. However, it is unknown how the brain makes predictions in the presence of parameter uncertainty. Here, we tested whether and how humans take parameter uncertainty into account in a regression task. Participants extrapolated a parabola from a limited number of noisy points, shown on a computer screen. The quadratic parameter was drawn from a prior distribution, unknown to the observers. We tested whether human observers take full advantage of the given information, including the likelihood function of the observed points and the prior distribution of the quadratic parameter. We compared human performance with Bayesian regression, which is the (Bayes) optimal solution to this problem, and three sub optimal models, namely maximum likelihood regression, prior regression and maximum a posteriori regression, which are simpler to compute. Our results clearly show that humans use Bayesian regression. We further investigated several variants of Bayesian regression models depending on how the generative noise is treated and found that participants act in line with the more sophisticated version.


Fine grained classification for multi source land cover mapping. Nowadays, there is a general agreement on the need to better characterize agricultural monitoring systems in response to the global changes. Timely and accurate land use land cover mapping can support this vision by providing useful information at fine scale. Here, a deep learning approach is proposed to deal with multi source land cover mapping at object level. The approach is based on an extension of Recurrent Neural Network enriched via an attention mechanism dedicated to multi temporal data context. Moreover, a new hierarchical pretraining strategy designed to exploit specific domain knowledge available under hierarchical relationships within land cover classes is introduced. Experiments carried out on the Reunion island a french overseas department demonstrate the significance of the proposal compared to remote sensing standard approaches for land cover mapping.


Size Matters Microservices Research and Applications. In this chapter we offer an overview of microservices providing the introductory information that a reader should know before continuing reading this book. We introduce the idea of microservices and we discuss some of the current research challenges and real life software applications where the microservice paradigm play a key role. We have identified a set of areas where both researcher and developer can propose new ideas and technical solutions.


Should artificial agents ask for help in human robot collaborative problem solving?. Transferring as fast as possible the functioning of our brain to artificial intelligence is an ambitious goal that would help advance the state of the art in AI and robotics. It is in this perspective that we propose to start from hypotheses derived from an empirical study in a human robot interaction and to verify if they are validated in the same way for children as for a basic reinforcement learning algorithm. Thus, we check whether receiving help from an expert when solving a simple close ended task (the Towers of Hano "i) allows to accelerate or not the learning of this task, depending on whether the intervention is canonical or requested by the player. Our experiences have allowed us to conclude that, whether requested or not, a Q learning algorithm benefits in the same way from expert help as children do.


The Wreath Product of Semiprime Skew Braces is Semiprime. In this note, we show that the wreath product of two semiprime skew braces is also a semiprime skew brace.


Hypocoercivity of the linearized BGK equation with stochastic coefficients. In this paper we study the effect of randomness on a linearized BGK model in one dimension. We prove exponential decay rate to a global equilibrium. This decay rate can be proven to be independent of the stochastic influence in a physical reasonable norm. We will further discuss the decay rate of the n th derivative with respect to the stochastic variable of the solutions. Our strategy is based on Lyapunov's method. The matrices we need for a Lyapunov's estimate now depend on the stochastic variable. This requires a careful analysis of the random effect.


Exploiting Cross Dialectal Gold Syntax for Low Resource Historical Languages Towards a Generic Parser for Pre Modern Slavic. This paper explores the possibility of improving the performance of specialized parsers for pre modern Slavic by training them on data from different related varieties. Because of their linguistic heterogeneity, pre modern Slavic varieties are treated as low resource historical languages, whereby cross dialectal treebank data may be exploited to overcome data scarcity and attempt the training of a variety agnostic parser. Previous experiments on early Slavic dependency parsing are discussed, particularly with regard to their ability to tackle different orthographic, regional and stylistic features. A generic pre modern Slavic parser and two specialized parsers one for East Slavic and one for South Slavic are trained using jPTDP (Nguyen Verspoor 2018), a neural network model for joint part of speech (POS) tagging and dependency parsing which had shown promising results on a number of Universal Dependency (UD) treebanks, including Old Church Slavonic (OCS). With these experiments, a new state of the art is obtained for both OCS (83.79 unlabelled attachment score (UAS) and 78.43 labelled attachement score (LAS)) and Old East Slavic (OES) (85.7 UAS and 80.16 LAS).


All optical reversible controls of integrated photonics by self assembled azobenzene. The next frontier in photonics will rely on the synergistic combination of disparate material systems. One unique organic molecule is azobenzene. This molecule can reversibly change conformations when optically excited in the blue (trans to cis) or mid IR (cis to trans). Here, we demonstrate SiO2 optical resonators modified with a monolayer of azobenzene containing 4 (4 diethylaminophenylazo)pyridine (Aazo) with quality factors over 106. Using a pair of lasers, the molecule is reversibly flipped between molecular conformations, inducing resonant wavelength shifts, and multiple switching cycles are demonstrated. The magnitude of the shift scales with the relative surface density of Aazo. The experimental data agrees with theoretical modeling.


Towards Better Opioid Antagonists Using Deep Reinforcement Learning. Naloxone, an opioid antagonist, has been widely used to save lives from opioid overdose, a leading cause for death in the opioid epidemic. However, naloxone has short brain retention ability, which limits its therapeutic efficacy. Developing better opioid antagonists is critical in combating the opioid epidemic.Instead of exhaustively searching in a huge chemical space for better opioid antagonists, we adopt reinforcement learning which allows efficient gradient based search towards molecules with desired physicochemical and or biological properties. Specifically, we implement a deep reinforcement learning framework to discover potential lead compounds as better opioid antagonists with enhanced brain retention ability. A customized multi objective reward function is designed to bias the generation towards molecules with both sufficient opioid antagonistic effect and enhanced brain retention ability. Thorough evaluation demonstrates that with this framework, we are able to identify valid, novel and feasible molecules with multiple desired properties, which has high potential in drug discovery.


Asymptotic Boundary Shrink Control with Multi robot Systems. Harmful marine spills, such as algae blooms and oil spills, damage ecosystems and threaten public health tremendously. Hence, an effective spill coverage and removal strategy will play a significant role in environmental protection. In recent years, low cost water surface robots have emerged as a solution, with their efficacy verified at small scale. However, practical limitations such as connectivity, scalability, and sensing and operation ranges significantly impair their large scale use. To circumvent these limitations, we propose a novel asymptotic boundary shrink control strategy that enables collective coverage of a spill by autonomous robots featuring customized operation ranges. For each robot, a novel controller is implemented that relies only on local vision sensors with limited vision range. Moreover, the distributedness of this strategy allows any number of robots to be employed without inter robot collisions. Finally, features of this approach including the convergence of robot motion during boundary shrink control, spill clearance rate, and the capability to work under limited ranges of vision and wireless connectivity are validated through extensive experiments with simulation.


On the dimension of points which escape to infinity at given rate under exponential iteration. We prove a number of results concerning the Hausdorff and packing dimension of sets of points which escape (at least in average) to infinity at a given rate under non autonomous iteration of exponential maps. In particular, we generalize the results proved by Sixsmith in 2016 and answer his question on annular itineraries for exponential maps.


Personalised Visual Art Recommendation by Learning Latent Semantic Representations. In Recommender systems, data representation techniques play a great role as they have the power to entangle, hide and reveal explanatory factors embedded within datasets. Hence, they influence the quality of recommendations. Specifically, in Visual Art (VA) recommendations the complexity of the concepts embodied within paintings, makes the task of capturing semantics by machines far from trivial. In VA recommendation, prominent works commonly use manually curated metadata to drive recommendations. Recent works in this domain aim at leveraging visual features extracted using Deep Neural Networks (DNN). However, such data representation approaches are resource demanding and do not have a direct interpretation, hindering user acceptance. To address these limitations, we introduce an approach for Personalised Recommendation of Visual arts based on learning latent semantic representation of paintings. Specifically, we trained a Latent Dirichlet Allocation (LDA) model on textual descriptions of paintings. Our LDA model manages to successfully uncover non obvious semantic relationships between paintings whilst being able to offer explainable recommendations. Experimental evaluations demonstrate that our method tends to perform better than exploiting visual features extracted using pre trained Deep Neural Networks.


Nova A rainbow cloud over the Alps. A pooled and shared on demand Infrastructure as a Service (IaaS), based on the Openstack software suite, was rolled out on the Grenoble university campus in 2018 and updated in 2019.We present the methods used to deploy and manage the infrastructure racadm and preseed for basic system installation, then Kolla for Openstack deployment. This latter solution, based on containers for each service, enables a centralised and logged configuration (GitLab) of controllers and calculation nodes. The solution is the benchmark solution for a reproducible deployment of Openstack. We have been able to expand our cloud easily with new nodes. The change in version of the basic OS was also successfully tested despite a few small hitches... As security is a key element in the proper operation of this type of shared service, each project has been made watertight and its data perfectly isolated from other projects, thanks to the encryption of all network flows in VXLANs.This OpenStack infotainment platform is operational. What is it all for? For example, our first users use the Jupyter Notebook through the provision of Jupyterhub servers (web portal) the Distributed Health Assessment IT System (SIDES project) the continuous integration in connection with the GitLab platform the test for the Kubernetes container scheduler or the calculation and visualisation software, etc. Highly varied uses that other platforms had difficulty offering.Nova, a new platform, was born.


Automating Seccomp Filter Generation for Linux Applications. Software vulnerabilities in applications undermine the security of applications. By blocking unused functionality, the impact of potential exploits can be reduced. While seccomp provides a solution for filtering syscalls, it requires manual implementation of filter rules for each individual application. Recent work has investigated automated approaches for detecting and installing the necessary filter rules. However, as we show, these approaches make assumptions that are not necessary or require overly time consuming analysis. In this paper, we propose Chestnut, an automated approach for generating strict syscall filters for Linux userspace applications with lower requirements and limitations. Chestnut comprises two phases, with the first phase consisting of two static components, i.e., a compiler and a binary analyzer, that extract the used syscalls during compilation or in an analysis of the binary. The compiler based approach of Chestnut is up to factor 73 faster than previous approaches without affecting the accuracy adversely. On the binary analysis level, we demonstrate that the requirement of position independent binaries of related work is not needed, enlarging the set of applications for which Chestnut is usable. In an optional second phase, Chestnut provides a dynamic refinement tool that allows restricting the set of allowed syscalls further. We demonstrate that Chestnut on average blocks 302 syscalls (86.5 ) via the compiler and 288 (82.5 ) using the binary level analysis on a set of 18 widely used applications. We found that Chestnut blocks the dangerous exec syscall in 50 and 77.7 of the tested applications using the compiler and binary based approach, respectively. For the tested applications, Chestnut prevents exploitation of more than 62 of the 175 CVEs that target the kernel via syscalls. Finally, we perform a 6 month long term study of a sandboxed Nginx server.


Screening of Therapeutic Agents for COVID 19 using Machine Learning and Ensemble Docking Simulations. The world has witnessed unprecedented human and economic loss from the COVID 19 disease, caused by the novel coronavirus SARS CoV 2. Extensive research is being conducted across the globe to identify therapeutic agents against the SARS CoV 2. Here, we use a powerful and efficient computational strategy by combining machine learning (ML) based models and high fidelity ensemble docking simulations to enable rapid screening of possible therapeutic molecules (or ligands). Our screening is based on the binding affinity to either the isolated SARS CoV 2 S protein at its host receptor region or to the Sprotein human ACE2 interface complex, thereby potentially limiting and or disrupting the host virus interactions. We first apply our screening strategy to two drug datasets (CureFFI and DrugCentral) to identify hundreds of ligands that bind strongly to the aforementioned two systems. Candidate ligands were then validated by all atom docking simulations. The validated ML models were subsequently used to screen a large bio molecule dataset (with nearly a million entries) to provide a rank ordered list of 19,000 potentially useful compounds for further validation. Overall, this work not only expands our knowledge of small molecule treatment against COVID 19, but also provides an efficient pathway to perform high throughput computational drug screening by combining quick ML surrogate models with expensive high fidelity simulations, for accelerating the therapeutic cure of diseases.


Bootstrapping Techniques for Polysynthetic Morphological Analysis. Polysynthetic languages have exceptionally large and sparse vocabularies, thanks to the number of morpheme slots and combinations in a word. This complexity, together with a general scarcity of written data, poses a challenge to the development of natural language technologies. To address this challenge, we offer linguistically informed approaches for bootstrapping a neural morphological analyzer, and demonstrate its application to Kunwinjku, a polysynthetic Australian language. We generate data from a finite state transducer to train an encoder decoder model. We improve the model by "hallucinating" missing linguistic structure into the training data, and by resampling from a Zipf distribution to simulate a more natural distribution of morphemes. The best model accounts for all instances of reduplication in the test set and achieves an accuracy of 94.7 overall, a 10 percentage point improvement over the FST baseline. This process demonstrates the feasibility of bootstrapping a neural morph analyzer from minimal resources.


cs.NE cs.LG physics.chem-ph physics.comp-ph

Augmenting Genetic Algorithms with Deep Neural Networks for Exploring the Chemical Space. Challenges in natural sciences can often be phrased as optimization problems. Machine learning techniques have recently been applied to solve such problems. One example in chemistry is the design of tailor made organic materials and molecules, which requires efficient methods to explore the chemical space. We present a genetic algorithm (GA) that is enhanced with a neural network (DNN) based discriminator model to improve the diversity of generated molecules and at the same time steer the GA. We show that our algorithm outperforms other generative models in optimization tasks. We furthermore present a way to increase interpretability of genetic algorithms, which helped us to derive design principles.


Bohr inequalities for unimodular bounded functions on simply connected domains. Let mathcal H ( mathbb D ) be the class of analytic functions in the unit disk mathbb D z in mathbb C z 1 . The classical Bohr's inequality states that if a power series f(z) sum n 0 infty a nz n converges in mathbb D and f(z) 1 for z in mathbb D , then begin equation sum n 0 infty a n r n leq 1 mbox for r leq frac 1 3 end equation and the constant 1 3 cannot be improved. The constant 1 3 is known as Bohr radius. In this paper, we study Bohr phenomenon for analytic as well as harmonic mappings on simply connected domains. We prove several sharp results on improved Bohr radius for analytic functions as well as for harmonic mappings on simply connected domains.


Comparison of different Tate conjectures. In this paper, we study the relation between different versions of Tate conjectures for smooth projective varieties over arbitrary finitely generated fields of positive characteristic, generalizing a theorem of Tate for smooth projective varieties over finite fields.


Klein coverings of genus 2 curves. We investigate the geometry of 'etale 4 1 coverings of smooth complex genus 2 curves with the monodromy group isomorphic to the Klein four group. There are two cases, isotropic and non isotropic depending on the values of the Weil pairing restricted to the group defining the covering. We recall from our previous work cite bo the results concerning the non isotropic case and fully describe the isotropic case. We show that the necessary information to construct the Klein coverings is encoded in the 6 points on mathbb P 1 defining the genus 2 curve. The main result of the paper is the fact that, in both cases the Prym map associated to these coverings is injective. Additionally, we provide a concrete description of the closure of the image of the Prym map inside the corresponding moduli space of polarised abelian varieties.


On the Bourbaki's fixed point theorem and the axiom of choice. In this note we generalize the Moroianu's fixed point theorem. We propose a very elegant common proof of the Bourbaki's fixed point theorem and our result. We apply our result to give a very elegant proof of the fact that, in the Zermelo Fraenkel system, the axiom of choice is equivalent to each of the following statements H. Kneser's Lemma, Zorn's Lemma, Zermelo's Lemma


Convergence of the Non Uniform Directed Physarum Model. The directed Physarum dynamics is known to solve positive linear programs minimize c T x subject to Ax b and x ge 0 for a positive cost vector c . The directed Physarum dynamics evolves a positive vector x according to the dynamics dot x q(x) x . Here q(x) is the solution to Af b that minimizes the "energy" sum i c i f i 2 x i . In this paper, we study the non uniform directed dynamics dot x D(q(x) x) , where D is a positive diagonal matrix. The non uniform dynamics is more complex than the uniform dynamics (with D being the identity matrix), as it allows each component of x to react with different speed to the differences between q(x) and x . Our contribution is to show that the non uniform directed dynamics solves positive linear programs.


SeesawFaceNets sparse and robust face verification model for mobile platform. Deep Convolutional Neural Network (DCNNs) come to be the most widely used solution for most computer vision related tasks, and one of the most important application scenes is face verification. Due to its high accuracy performance, deep face verification models of which the inference stage occurs on cloud platform through internet plays the key role on most prectical scenes. However, two critical issues exist First, individual privacy may not be well protected since they have to upload their personal photo and other private information to the online cloud backend. Secondly, either training or inference stage is time comsuming and the latency may affect customer experience, especially when the internet link speed is not so stable or in remote areas where mobile reception is not so good, but also in cities where building and other construction may block mobile signals. Therefore, designing lightweight networks with low memory requirement and computational cost is one of the most practical solutions for face verification on mobile platform. In this paper, a novel mobile network named SeesawFaceNets, a simple but effective model, is proposed for productively deploying face recognition for mobile devices. Dense experimental results have shown that our proposed model SeesawFaceNets outperforms the baseline MobilefaceNets, with only bf66 (146M VS 221M MAdds) computational cost, smaller batch size and less training steps, and SeesawFaceNets achieve comparable performance with other SOTA model e.g. mobiface with only bf54.2 (1.3M VS 2.4M) parameters and bf31.6 (146M VS 462M MAdds) computational cost, It is also eventually competitive against large scale deep networks face recognition on all 5 listed public validation datasets, with bf6.5 (4.2M VS 65M) parameters and bf4.35 (526M VS 12G MAdds) computational cost.


An Evoked Potential Guided Deep Learning Brain Representation For Visual Classification. The new perspective in visual classification aims to decode the feature representation of visual objects from human brain activities. Recording electroencephalogram (EEG) from the brain cortex has been seen as a prevalent approach to understand the cognition process of an image classification task. In this study, we proposed a deep learning framework guided by the visual evoked potentials, called the Event Related Potential (ERP) Long short term memory (LSTM) framework, extracted by EEG signals for visual classification. In specific, we first extracted the ERP sequences from multiple EEG channels to response image stimuli related information. Then, we trained an LSTM network to learn the feature representation space of visual objects for classification. In the experiment, 10 subjects were recorded by over 50,000 EEG trials from an image dataset with 6 categories, including a total of 72 exemplars. Our results showed that our proposed ERP LSTM framework could achieve classification accuracies of cross subject of 66.81 and 27.08 for categories (6 classes) and exemplars (72 classes), respectively. Our results outperformed that of using the existing visual classification frameworks, by improving classification accuracies in the range of 12.62 53.99 . Our findings suggested that decoding visual evoked potentials from EEG signals is an effective strategy to learn discriminative brain representations for visual classification.


Vulnerability Forecasting In theory and practice. Why wait for zero days when you could predict them in advance? It is possible to predict the volume of CVEs released in the NVD as much as a year in advance. This can be done within 3 percent of the actual value, and different predictive algorithms perform well at different lookahead values. It is also possible to estimate the proportions of that total volumn belonging to specific vendors, software, CVSS scores, or vulnerability types. Strategic patch management should become much easier, with this uncertainty reduction.


Topic Modeling the Reading and Writing Behavior of Information Foragers. The general problem of "information foraging" in an environment about which agents have incomplete information has been explored in many fields, including cognitive psychology, neuroscience, economics, finance, ecology, and computer science. In all of these areas, the searcher aims to enhance future performance by surveying enough of existing knowledge to orient themselves in the information space. Individuals can be viewed as conducting a cognitive search in which they must balance exploration of ideas that are novel to them against exploitation of knowledge in domains in which they are already expert. In this dissertation, I present several case studies that demonstrate how reading and writing behaviors interact to construct personal knowledge bases. These studies use LDA topic modeling to represent the information environment of the texts each author read and wrote. Three studies revolve around Charles Darwin. Darwin left detailed records of every book he read for 23 years, from disembarking from the H.M.S. Beagle to just after publication of The Origin of Species. Additionally, he left copies of his drafts before publication. I characterize his reading behavior, then show how that reading behavior interacted with the drafts and subsequent revisions of The Origin of Species, and expand the dataset to include later readings and writings. Then, through a study of Thomas Jefferson's correspondence, I expand the study to non book data. Finally, through an examination of neuroscience citation data, I move from individual behavior to collective behavior in constructing an information environment. Together, these studies reveal "the interplay between individual and collective phenomena where innovation takes place" (Tria et al. 2014).


Towards Understanding Sample Variance in Visually Grounded Language Generation Evaluations and Observations. A major challenge in visually grounded language generation is to build robust benchmark datasets and models that can generalize well in real world settings. To do this, it is critical to ensure that our evaluation protocols are correct, and benchmarks are reliable. In this work, we set forth to design a set of experiments to understand an important but often ignored problem in visually grounded language generation given that humans have different utilities and visual attention, how will the sample variance in multi reference datasets affect the models' performance? Empirically, we study several multi reference datasets and corresponding vision and language tasks. We show that it is of paramount importance to report variance in experiments that human generated references could vary drastically in different datasets tasks, revealing the nature of each task that metric wise, CIDEr has shown systematically larger variances than others. Our evaluations on reference per instance shed light on the design of reliable datasets in the future.


Extensional realizability for intuitionistic set theory. In generic realizability for set theories, realizers treat unbounded quantifiers generically. To this form of realizability, we add another layer of extensionality by requiring that realizers ought to act extensionally on realizers, giving rise to a realizability universe mathrm V ex (A) in which the axiom of choice in all finite types sf AC sf FT is realized, where A stands for an arbitrary partial combinatory algebra. This construction furnishes 'inner models' of many set theories that additionally validate sf AC sf FT , in particular it provides a self validating semantics for sf CZF (Constructive Zermelo Fraenkel set theory) and sf IZF (Intuitionistic Zermelo Fraenkel set theory). One can also add large set axioms and many other principles.


On the slope of the moduli space of genus 15 and 16 curves. We revisit the work of Chang and Ran on bounding the slopes of overline mathscr M 15 and overline mathscr M 16 , correct one of the formulas used at the conclusion of the argument, and recompute the lower bounds on the slopes, yielding s( overline mathscr M 15 ) 6.5 but not for overline mathscr M 16 . Our contribution only involves plugging in formulas.


Automatic Horizontal Fusion for GPU Kernels. We present automatic horizontal fusion, a novel optimization technique that complements the standard kernel fusion techniques for GPU programs. Unlike the standard fusion, whose goal is to eliminate intermediate data round trips, our horizontal fusion technique aims to increase the thread level parallelism to hide instruction latencies. We also present HFuse, a new source to source CUDA compiler that implements automatic horizontal fusion. Our experimental results show that horizontal fusion can speed up the running time by 2.5 60.8 . Our results reveal that the horizontal fusion is especially beneficial for fusing kernels with instructions that require different kinds of GPU resources (e.g., a memory intensive kernel and a compute intensive kernel).


COVID 19 second wave mortality in Europe and the United States. This paper introduces new methods to analyze the changing progression of COVID 19 cases to deaths in different waves of the pandemic. First, an algorithmic approach partitions each country or state's COVID 19 time series into a first wave and subsequent period. Next, offsets between case and death time series are learned for each country via a normalized inner product. Combining these with additional calculations, we can determine which countries have most substantially reduced the mortality rate of COVID 19. Finally, our paper identifies similarities in the trajectories of cases and deaths for European countries and U.S. states. Our analysis refines the popular conception that the mortality rate has greatly decreased throughout Europe during its second wave of COVID 19 instead, we demonstrate substantial heterogeneity throughout Europe and the U.S. The Netherlands exhibited the largest reduction of mortality, a factor of 16, followed by Denmark, France, Belgium, and other Western European countries, greater than both Eastern European countries and U.S. states. Some structural similarity is observed between Europe and the United States, in which Northeastern states have been the most successful in the country. Such analysis may help European countries learn from each other's experiences and differing successes to develop the best policies to combat COVID 19 as a collective unit.


Observations on Annotations. The annotation of textual information is a fundamental activity in Linguistics and Computational Linguistics. This article presents various observations on annotations. It approaches the topic from several angles including Hypertext, Computational Linguistics and Language Technology, Artificial Intelligence and Open Science. Annotations can be examined along different dimensions. In terms of complexity, they can range from trivial to highly sophisticated, in terms of maturity from experimental to standardised. Annotations can be annotated themselves using more abstract annotations. Primary research data such as, e.g., text documents can be annotated on different layers concurrently, which are independent but can be exploited using multi layer querying. Standards guarantee interoperability and reusability of data sets. The chapter concludes with four final observations, formulated as research questions or rather provocative remarks on the current state of annotation research.


With Wronskian through the Looking Glass. In the work of Mukhin and Varchenko from 2002 there was introduced a Wronskian map from the variety of full flags in a finite dimensional vector space into a product of projective spaces. We establish a precise relationship between this map and the Pl "ucker map. This allows us to recover the result of Varchenko and Wright saying that the polynomials appearing in the image of the Wronsky map are the initial values of the tau functions for the Kadomtsev Petviashvili hierarchy.


Nanofiber based displacement sensor. We report on the realization of a displacement sensor based on an optical nanofiber. A single gold nano sphere is deposited on top of a nanofiber and the system is placed within a standing wave which serves as a position ruler. Scattered light collected within the guided mode of the fiber gives a direct measure of the nanofiber displacement. We calibrated our device and found a sensitivity up to 1.2 nm sqrt text Hz . A mechanical model based on the Mie scattering theory is then used to evaluate the optically induced force on the nanofiber by an external laser. With our sensing system, we demonstrate that an external force of 1 pN applied at the nanofiber waist can be detected.


Resolution enhanced quantitative spectroscopy of atomic vapor in optical nanocells based on second derivative processing of spectra. We present a method for recovery of narrow homogeneous spectral features out of broad inhomogeneous overlapped profile based on second derivative processing of the absorption spectra of alkali metal atomic vapor nanocells. The method is shown to preserve the frequency positions and amplitudes of spectral transitions, thus being applicable for quantitative spectroscopy. The proposed technique was successfully applied and tested for measurements of hyperfine splitting and atomic transition probabilities development of an atomic frequency reference determination of isotopic abundance study of atom surface interaction and determination of magnetic field induced modification of atomic transitions frequency and probability. The obtained experimental results are fully consistent with theoretical modeling.


Optimal transformations of Muller conditions. In this paper, we are interested in automata over infinite words and infinite duration games, that we view as general transition systems. We study transformations of systems using a Muller condition into ones using a parity condition, extending Zielonka's construction. We introduce the alternating cycle decomposition transformation, and we prove a strong optimality result for any given deterministic Muller automaton, the obtained parity automaton is minimal both in size and number of priorities among those automata admitting a morphism into the original Muller automaton. We give two applications. The first is an improvement in the process of determinisation of B "uchi automata into parity automata by Piterman and Schewe. The second is to present characterisations on the possibility of relabelling automata with different acceptance conditions.


Rapidly adapting robot swarms with Swarm Map based Bayesian Optimisation. Rapid performance recovery from unforeseen environmental perturbations remains a grand challenge in swarm robotics. To solve this challenge, we investigate a behaviour adaptation approach, where one searches an archive of controllers for potential recovery solutions. To apply behaviour adaptation in swarm robotic systems, we propose two algorithms (i) Swarm Map based Optimisation (SMBO), which selects and evaluates one controller at a time, for a homogeneous swarm, in a centralised fashion and (ii) Swarm Map based Optimisation Decentralised (SMBO Dec), which performs an asynchronous batch based Bayesian optimisation to simultaneously explore different controllers for groups of robots in the swarm. We set up foraging experiments with a variety of disturbances injected faults to proximity sensors, ground sensors, and the actuators of individual robots, with 100 unique combinations for each type. We also investigate disturbances in the operating environment of the swarm, where the swarm has to adapt to drastic changes in the number of resources available in the environment, and to one of the robots behaving disruptively towards the rest of the swarm, with 30 unique conditions for each such perturbation. The viability of SMBO and SMBO Dec is demonstrated, comparing favourably to variants of random search and gradient descent, and various ablations, and improving performance up to 80 compared to the performance at the time of fault injection within at most 30 evaluations.


Online Linear Optimization with Many Hints. We study an online linear optimization (OLO) problem in which the learner is provided access to K "hint" vectors in each round prior to making a decision. In this setting, we devise an algorithm that obtains logarithmic regret whenever there exists a convex combination of the K hints that has positive correlation with the cost vectors. This significantly extends prior work that considered only the case K 1 . To accomplish this, we develop a way to combine many arbitrary OLO algorithms to obtain regret only a logarithmically worse factor than the minimum regret of the original algorithms in hindsight this result is of independent interest.


Aggressive Language Detection with Joint Text Normalization via Adversarial Multi task Learning. Aggressive language detection (ALD), detecting the abusive and offensive language in texts, is one of the crucial applications in NLP community. Most existing works treat ALD as regular classification with neural models, while ignoring the inherent conflicts of social media text that they are quite unnormalized and irregular. In this work, we target improving the ALD by jointly performing text normalization (TN), via an adversarial multi task learning framework. The private encoders for ALD and TN focus on the task specific features retrieving, respectively, and the shared encoder learns the underlying common features over two tasks. During adversarial training, a task discriminator distinguishes the separate learning of ALD or TN. Experimental results on four ALD datasets show that our model outperforms all baselines under differing settings by large margins, demonstrating the necessity of joint learning the TN with ALD. Further analysis is conducted for a better understanding of our method.


Hypergraphs an introduction and review. Hypergraphs were introduced in 1973 by Berg 'e. This review aims at giving some hints on the main results that we can find in the literature, both on the mathematical side and on their practical usage. Particularly, different definitions of hypergraphs are compared, some unpublished work on the visualisation of large hypergraphs done by the author. This review does not pretend to be exhaustive.


Interferobot aligning an optical interferometer by a reinforcement learning agent. Limitations in acquiring training data restrict potential applications of deep reinforcement learning (RL) methods to the training of real world robots. Here we train an RL agent to align a Mach Zehnder interferometer, which is an essential part of many optical experiments, based on images of interference fringes acquired by a monocular camera. The agent is trained in a simulated environment, without any hand coded features or a priori information about the physics, and subsequently transferred to a physical interferometer. Thanks to a set of domain randomizations simulating uncertainties in physical measurements, the agent successfully aligns this interferometer without any fine tuning, achieving a performance level of a human expert.


Deep Face Recognition Model Compression via Knowledge Transfer and Distillation. Fully convolutional networks (FCNs) have become de facto tool to achieve very high level performance for many vision and non vision tasks in general and face recognition in particular. Such high level accuracies are normally obtained by very deep networks or their ensemble. However, deploying such high performing models to resource constraint devices or real time applications is challenging. In this paper, we present a novel model compression approach based on student teacher paradigm for face recognition applications. The proposed approach consists of training teacher FCN at bigger image resolution while student FCNs are trained at lower image resolutions than that of teacher FCN. We explored three different approaches to train student FCNs knowledge transfer (KT), knowledge distillation (KD) and their combination. Experimental evaluation on LFW and IJB C datasets demonstrate comparable improvements in accuracies with these approaches. Training low resolution student FCNs from higher resolution teacher offer fourfold advantage of accelerated training, accelerated inference, reduced memory requirements and improved accuracies. We evaluated all models on IJB C dataset and achieved state of the art results on this benchmark. The teacher network and some student networks even achieved Top 1 performance on IJB C dataset. The proposed approach is simple and hardware friendly, thus enables the deployment of high performing face recognition deep models to resource constraint devices.


Combining Compositional Models and Deep Networks For Robust Object Classification under Occlusion. Deep convolutional neural networks (DCNNs) are powerful models that yield impressive results at object classification. However, recent work has shown that they do not generalize well to partially occluded objects and to mask attacks. In contrast to DCNNs, compositional models are robust to partial occlusion, however, they are not as discriminative as deep models. In this work, we combine DCNNs and compositional object models to retain the best of both approaches a discriminative model that is robust to partial occlusion and mask attacks. Our model is learned in two steps. First, a standard DCNN is trained for image classification. Subsequently, we cluster the DCNN features into dictionaries. We show that the dictionary components resemble object part detectors and learn the spatial distribution of parts for each object class. We propose mixtures of compositional models to account for large changes in the spatial activation patterns (e.g. due to changes in the 3D pose of an object). At runtime, an image is first classified by the DCNN in a feedforward manner. The prediction uncertainty is used to detect partially occluded objects, which in turn are classified by the compositional model. Our experimental results demonstrate that combining compositional models and DCNNs resolves a fundamental problem of current deep learning approaches to computer vision The combined model recognizes occluded objects, even when it has not been exposed to occluded objects during training, while at the same time maintaining high discriminative performance for non occluded objects.


Appearance invariant Entry Exit matching using visual soft biometric traits. The problem of appearance invariant subject recognition for Entry Exit surveillance applications is addressed. A novel Semantic Entry Exit matching model that makes use of ancillary information about subjects such as height, build, complexion and clothing color to endorse exit of every subject who had entered private area is proposed in this paper. The proposed method is robust to variations in clothing. Each describing attribute is given equal weight while computing the matching score and hence the proposed model achieves high rank k accuracy on benchmark datasets. The soft biometric traits used as a combination though cannot achieve high rank 1 accuracy, it helps to narrow down the search to match using reliable biometric traits such as gait and face whose learning and matching time is costlier when compared to the visual soft biometrics.


Polynomial time Updates of Epistemic States in a Fragment of Probabilistic Epistemic Argumentation (Technical Report). Probabilistic epistemic argumentation allows for reasoning about argumentation problems in a way that is well founded by probability theory. Epistemic states are represented by probability functions over possible worlds and can be adjusted to new beliefs using update operators. While the use of probability functions puts this approach on a solid foundational basis, it also causes computational challenges as the amount of data to process depends exponentially on the number of arguments. This leads to bottlenecks in applications such as modelling opponent's beliefs for persuasion dialogues. We show how update operators over probability functions can be related to update operators over much more compact representations that allow polynomial time updates. We discuss the cognitive and probabilistic logical plausibility of this approach and demonstrate its applicability in computational persuasion.


The Salted Kalman Filter Kalman Filtering on Hybrid Dynamical Systems. Many state estimation and control algorithms require knowledge of how probability distributions propagate through dynamical systems. However, despite hybrid dynamical systems becoming increasingly important in many fields, there has been little work on utilizing the knowledge of how probability distributions map through hybrid transitions. Here, we make use of a propagation law that employs the saltation matrix (a first order update to the sensitivity equation) to create the Salted Kalman Filter (SKF), a natural extension of the Kalman Filter and Extended Kalman Filter to hybrid dynamical systems. Away from hybrid events, the SKF is a standard Kalman filter. When a hybrid event occurs, the saltation matrix plays an analogous role as that of the system dynamics, subsequently inducing a discrete modification to both the prediction and update steps. The SKF outperforms a naive variational update the Jacobian of the reset map by having a reduced mean squared error in state estimation, especially immediately after a hybrid transition event. Compared a hybrid particle filter, the particle filter outperforms the SKF in mean squared error only when a large number of particles are used, likely due to a more accurate accounting of the split distribution near a hybrid transition.


A Reinforcement Learning Framework for Optimizing Age of Information in RF powered Communication Systems. In this paper, we study a real time monitoring system in which multiple source nodes are responsible for sending update packets to a common destination node in order to maintain the freshness of information at the destination. Since it may not always be feasible to replace or recharge batteries in all source nodes, we consider that the nodes are powered through wireless energy transfer (WET) by the destination. For this system setup, we investigate the optimal online sampling policy (referred to as the age optimal policy) that jointly optimizes WET and scheduling of update packet transmissions with the objective of minimizing the long term average weighted sum of Age of Information (AoI) values for different physical processes (observed by the source nodes) at the destination node, referred to as the sum AoI. To solve this optimization problem, we first model this setup as an average cost Markov decision process (MDP). Due to the extreme curse of dimensionality in the state space of the formulated MDP, classical reinforcement learning algorithms are no longer applicable to our problem. Motivated by this, we propose a deep reinforcement learning (DRL) algorithm that can learn the age optimal policy in a computationally efficient manner. We further characterize the structural properties of the age optimal policy analytically, and demonstrate that it has a threshold based structure with respect to the AoI values for different processes. We extend our analysis to characterize the structural properties of the policy that maximizes average throughput for our system setup, referred to as the throughput optimal policy. Afterwards, we analytically demonstrate that the structures of the age optimal and throughput optimal policies are different. We also numerically demonstrate these structures as well as the impact of system design parameters on the optimal achievable average weighted sum AoI.


The Poisson Boltzmann model for implicit solvation of electrolyte solutions Quantum chemical implementation and assessment via Sechenov coefficients. We present the theory and implementation of a Poisson Boltzmann implicit solvation model for electrolyte solutions. This model can be combined with arbitrary electronic structure methods that provide an accurate charge density of the solute. A hierarchy of approximations for this model includes a linear approximation for weak electrostatic potentials, finite size of the mobile electrolyte ions and a Stern layer correction. Recasting the Poisson Boltzmann equations into Euler Lagrange equations then significantly simplifies the derivation of the free energy of solvation for these approximate models. The parameters of the model are then either fit directly to experimental observables, e.g. the finite ion size, or optimized for agreement with experimental results. Experimental data for this optimization is available in the form of Sechenov coefficients that describe the linear dependence of the salting out effect of solutes with respect to the electrolyte concentration. In the final part we rationalize the qualitative disagreement of the finite ion size modification to the Poisson Boltzmann model with experimental observations by taking into account the electrolyte concentration dependence of the Stern layer. A route towards a revised model that captures the experimental observations while including the finite ion size effects is then outlined. This implementation paves the way for the study of electrochemical and electrocatalytic processes of molecules and cluster models with accurate electronic structure methods.


Singular limit for reactive diffusive transport through an array of thin channels in case of critical diffusivity. We consider a nonlinear reaction diffusion equation in a domain consisting of two bulk regions connected via small channels periodically distributed within a thin layer. The height and the thickness of the channels are of order epsilon , and the equation inside the layer depends on the parameter epsilon . We consider the critical scaling of the diffusion coefficients in the channels and nonlinear Neumann boundary condition on the channels' lateral boundaries. We derive effective models in the limit epsilon to 0 , when the channel domain is replaced by an interface Sigma between the two bulk domains. Due to the critical size of the diffusion coefficients, we obtain jumps for the solution and its normal fluxes across Sigma , involving the solutions of local cell problems on the reference channel in every point of the interface Sigma .


Topological method for controllability. In this work, we found a non trivial topology to achieve the controllability for linear and nonlinear system in finite or infinite time horizon. We give several examples illustrating this topologizing method for the controllability results. We obtain by the way the controllability for the one dimensional Schr "odinger. We also apply this method to achieve the both controllability of Korteweg de Vries and Saint Venant equations.


Hall algebras associated to complexes of fixed size. Let A be a finitary hereditary abelian category with enough projectives. We study the Hall algebra of complexes of fixed size over projectives. Explicitly, we first give a relation between Hall algebras of complexes of fixed size and cyclic complexes. Secondly, we characterize the Hall algebra of complexes of fixed size by generators and relations, and relate it to the derived Hall algebra of A . Finally, we give the integration map on the Hall algebra of 2 term complexes over projectives.


Invariant systems of representatives, or The cost of symmetry. Suppose that one can destroy all 100 gons in a graph by removing 2019 edges. How many edges must be removed to destroy all 100 gons in such a way that the set of removed edges is invariant with respect to all automorphisms the initial graph? This paper contains solutions to such kind of problems. Several open questions are raised.


AMR Autonomous Coin Mixer with Privacy Preserving Reward Distribution. It is well known that users on open blockchains are tracked by an industry providing services to governments, law enforcement, secret services, and alike. While most blockchains do not protect their users' privacy and allow external observers to link transactions and addresses, a growing research interest attempts to design add on privacy solutions to help users regain their privacy on non private blockchains. In this work, we propose to our knowledge the first censorship resilient mixer, which can reward its users in a privacy preserving manner for participating in the system. Increasing the anonymity set size, and diversity of users, is, as we believe, an important endeavor to raise a mixer's contributed privacy in practice. The paid out rewards can take the form of governance tokens to decentralize the voting on system parameters, similar to how popular "DeFi farming" protocols operate. Moreover, by leveraging existing "Defi" lending platforms, AMR is the first mixer design that allows participating clients to earn financial interests on their deposited funds. Our system AMR is autonomous as it does not rely on any external server or third party. The evaluation of our AMR implementation shows that the system supports today on Ethereum anonymity set sizes beyond thousands of users, and a capacity of over 66,000 deposits per day, at constant system costs. We provide a formal specification of our zksnark based AMR system, a privacy and security analysis, implementation, and evaluation with both the MiMC and Poseidon hash functions.


Partly Supervised Multitask Learning. Semi supervised learning has recently been attracting attention as an alternative to fully supervised models that require large pools of labeled data. Moreover, optimizing a model for multiple tasks can provide better generalizability than single task learning. Leveraging self supervision and adversarial training, we propose a novel general purpose semi supervised, multiple task model namely, self supervised, semi supervised, multitask learning (S 4 MTL) for accomplishing two important tasks in medical imaging, segmentation and diagnostic classification. Experimental results on chest and spine X ray datasets suggest that our S 4 MTL model significantly outperforms semi supervised single task, semi fully supervised multitask, and fully supervised single task models, even with a 50 reduction of class and segmentation labels. We hypothesize that our proposed model can be effective in tackling limited annotation problems for joint training, not only in medical imaging domains, but also for general purpose vision tasks.


Providing reliability and auditability to the IoT LwM2M protocol through Blockchain. Blockchain has come to provide transparency, reliability as well as to increase the security in computer systems, especially in distributed ones like the Internet of Things (IoT). A few integrations have been proposed in this context so far however, most of these solutions do not pay special attention to the interoperability of the IoT, one of the biggest challenges in this field. In this paper, a Blockchain solution has been integrated into the OMA Lightweight M2M (LwM2M), a promising industry IoT protocol for global interoperability. This integration provides reliability and auditability to the LwM2M protocol enabling IoT devices (LwM2M clients) to transparently interact with the protocol. Furthermore, a missing reliable API to allow users and applications to securely interact with the system and an interface to store critical information like anomalies for auditability have been defined.


Optimal Sharing and Fair Cost Allocation of Community Energy Storage. This paper studies an energy storage (ES) sharing model which is cooperatively invested by multiple buildings for harnessing on site renewable utilization and grid price arbitrage. To maximize the economic benefits, we jointly consider the ES sizing, operation, and cost allocation via a coalition game formulation. Particularly, we study a fair ex post cost allocation based on nucleolus which addresses fairness by minimizing the minimal dissatisfaction of all the players. To overcome the exponential computation burden caused by the implicit characteristic function, we employ a constraint generation technique to gradually approach the unique nucleolus by leveraging the sparse problem structure. We demonstrate both the fairness and computational efficiency of the method through case studies, which are not provided by the existing Shapley approach or proportional method. Particularly, only a small fraction of characteristic function (less than 1 for 20 buildings) is required to achieve the cost allocation versus the exponential information required by Shapley approach. Though there exists a minor increase of computation over the proportional method, the proposed method can ensure fairness while the latter fails in some cases. Further, we demonstrate both the building wise and community wise economic benefits are enhanced with the ES sharing model over the individual ES (IES) model. Accordingly, the overall value of ES is considerably improved (about 1.83 times).


Identification of scale independent material parameters in the relaxed micromorphic model through model adapted first order homogenization. We rigorously determine the scale independent short range elastic parameters in the relaxed micromorphic generalized continuum model for a given periodic microstructure. This is done using both classical periodic homogenization and a new procedure involving the concept of apparent material stiffness of a unit cell under affine Dirichlet boundary conditions and Neumann's principle on the overall representation of anisotropy. We explain our idea of "maximal" stiffness of the unit cell and use state of the art first order numerical homogenization methods to obtain the needed parameters for a given tetragonal unit cell. These results are used in the accompanying paper 16 to describe the wave propagation including band gaps in the same tetragonal metamaterial.


Quasi Direct Drive Actuation for a Lightweight Hip Exoskeleton with High Backdrivability and High Bandwidth. High performance actuators are crucial to enable mechanical versatility of lower limb wearable robots, which are required to be lightweight, highly backdrivable, and with high bandwidth. State of the art actuators, e.g., series elastic actuators (SEAs), have to compromise bandwidth to improve compliance (i.e., backdrivability). In this paper, we describe the design and human robot interaction modeling of a portable hip exoskeleton based on our custom quasi direct drive (QDD) actuation (i.e., a high torque density motor with low ratio gear). We also present a model based performance benchmark comparison of representative actuators in terms of torque capability, control bandwidth, backdrivability, and force tracking accuracy. This paper aims to corroborate the underlying philosophy of "design for control", namely meticulous robot design can simplify control algorithms while ensuring high performance. Following this idea, we create a lightweight bilateral hip exoskeleton (overall mass is 3.4 kg) to reduce joint loadings during normal activities, including walking and squatting. Experimental results indicate that the exoskeleton is able to produce high nominal torque (17.5 Nm), high backdrivability (0.4 Nm backdrive torque), high bandwidth (62.4 Hz), and high control accuracy (1.09 Nm root mean square tracking error, i.e., 5.4 of the desired peak torque). Its controller is versatile to assist walking at different speeds (0.8 1.4 m s) and squatting at 2 s cadence. This work demonstrates significant improvement in backdrivability and control bandwidth compared with state of the art exoskeletons powered by the conventional actuation or SEA.


Cut Selection For Benders Decomposition. In this paper, we present a new perspective on cut generation in the context of Benders decomposition. The approach, which is based on the relation between the alternative polyhedron and the reverse polar set, helps us to improve established cut selection procedures for Benders cuts, like the one suggested by Fischetti, Salvagnin, and Zanette FSZ10 . Our modified version of that criterion produces cuts which are always supporting and, unless in rare special cases, facet defining. We discuss our approach in relation to the state of the art in cut generation for Benders decomposition. In particular, we refer to Pareto optimality and facet defining cuts and observe that each of these criteria can be matched to a particular subset of parameterizations for our cut generation framework. As a consequence, our framework includes the method to generate facet defining cuts proposed by Conforti and Wolsey CW18 as a special case.


A parametric version of LLL and some consequences parametric shortest and closest vector problems. Given a parametric lattice with a basis given by polynomials in Z t , we give an algorithm to construct an LLL reduced basis whose elements are eventually quasi polynomial in t that is, they are given by formulas that are piecewise polynomial in t (for sufficiently large t), such that each piece is given by a congruence class modulo a period. As a consequence, we show that there are parametric solutions of the shortest vector problem (SVP) and closest vector problem (CVP) that are also eventually quasi polynomial in t.


Wild examples of rectifiable sets. We study the geometry of sets based on the behavior of the Jones function, J E (x) int 0 1 beta E 2 1 (x,r) 2 frac dr r . We construct two examples of countably 1 rectifiable sets in mathbb R 2 with positive and finite mathcal H 1 measure for which the Jones function is nowhere locally integrable. These examples satisfy different regularity properties one is connected and one is Ahlfors regular. Both examples can be generalized to higher dimension and co dimension.


A Hierarchical Framework to Generate Robust Biped Locomotion Based on Divergent Component of Motion. Keeping the stability can be counted as the essential ability of a humanoid robot to step out of the laboratory to work in our real environment. Since humanoid robots have similar kinematic to a human, humans expect these robots to be robustly capable of stabilizing even in a challenging situation like while a severe push is applied. This paper presents a robust walking framework which not only takes into account the traditional push recovery approaches (e.g., ankle, hip and step strategies) but also uses the concept of Divergent Component of the Motion (DCM) to adjust next step timing and location. The control core of the proposed framework is composed of a Linear Quadratic Gaussian (LQG) controller and two proportional controllers. In this framework, the LQG controller tries to track the reference trajectories and the proportional controllers are designed to adjust the next step timing and location that allow the robot to recover from a severe push. The robustness and the performance of the proposed framework have been validated by performing a set of simulations, including walking and push recovery using MATLAB. The simulation results verified that the proposed framework is capable of providing a robust walking even in very challenging situations.


The complexity of some ordinal determined classes of operators. We compute the complexity of the classes of operators mathfrak G xi, zeta cap mathcal L and mathfrak M xi, zeta cap mathcal L in the coding of operators between separable Banach spaces. We also prove the non existence of universal factoring operators for both complement mathfrak G xi, zeta and complement mathfrak M xi, zeta . The latter result is an ordinal extension of a result of Johnson and Girardi.


Roland Eotvos scientist, statesman, educator. This lecture recalls the memory of Baron Roland Eotvos, an outstanding figure of the experimental exploration of the gravitational interaction.


Learning Stable Models for Prediction and Control. This paper demonstrates the benefits of imposing stability on data driven Koopman operators. The data driven identification of stable Koopman operators (DISKO) is implemented using an algorithm cite mamakoukas stableLDS2020 that computes the nearest textit stable matrix solution to a least squares reconstruction error. As a first result, we derive a formula that describes the prediction error of Koopman representations for an arbitrary number of time steps, and which shows that stability constraints can improve the predictive accuracy over long horizons. As a second result, we determine formal conditions on basis functions of Koopman operators needed to satisfy the stability properties of an underlying nonlinear system. As a third result, we derive formal conditions for constructing Lyapunov functions for nonlinear systems out of stable data driven Koopman operators, which we use to verify stabilizing control from data. Lastly, we demonstrate the benefits of DISKO in prediction and control with simulations using a pendulum and a quadrotor and experiments with a pusher slider system. The paper is complemented with a video url https sites.google.com view learning stable koopman .


Large deviations for extreme eigenvalues of deformed Wigner random matrices. We present a large deviation principle at speed N for the largest eigenvalue of some additively deformed Wigner matrices. In particular this includes Gaussian ensembles with full rank general deformation. For the non Gaussian ensembles, the deformation should be diagonal, and we assume that the laws of the entries have sharp sub Gaussian Laplace transforms and satisfy certain concentration properties. For these latter ensembles we establish the large deviation principle in a restricted range ( infty, x c) , where x c depends on the deformation only and can be infinite.


Reduction of a nonlinear system and its numerical solution using a fractional iterative method. A nonlinear algebraic equation system of 5 variables is numerically solved, which is derived from the application of the Fourier transform to a differential equation system that allows modeling the behavior of the temperatures and the efficiencies of a hybrid solar receiver, which in simple terms is the combination of a photovoltaic system with a thermoelectric system. In addition, a way to reduce the previous system to a nonlinear system of only 2 variables is presented. Naturally, reducing algebraic equation systems of dimension N to systems of smaller dimensions has the main advantage of reducing the number of variables involved in a problem, but the analytical expressions of the systems become more complicated. However, to minimize this disadvantage, an iterative method that does not explicitly depend on the analytical complexity of the system to be solved is used. A fractional iterative method, valid for one and several variables, that uses the properties of fractional calculus, in particular the fact that the fractional derivatives of constants are not always zero, to find solutions of nonlinear systems is presented.


A critique of the DeepSec Platform for Security Analysis of Deep Learning Models. At IEEE S P 2019, the paper "DeepSec A Uniform Platform for Security Analysis of Deep Learning Model" aims to to "systematically evaluate the existing adversarial attack and defense methods." While the paper's goals are laudable, it fails to achieve them and presents results that are fundamentally flawed and misleading. We explain the flaws in the DeepSec work, along with how its analysis fails to meaningfully evaluate the various attacks and defenses. Specifically, DeepSec (1) evaluates each defense obliviously, using attacks crafted against undefended models (2) evaluates attacks and defenses using incorrect implementations that greatly under estimate their effectiveness (3) evaluates the robustness of each defense as an average, not based on the most effective attack against that defense (4) performs several statistical analyses incorrectly and fails to report variance and, (5) as a result of these errors draws invalid conclusions and makes sweeping generalizations.


On nonlinear Feynman Kac formulas for viscosity solutions of semilinear parabolic partial differential equations. The classical Feynman Kac identity builds a bridge between stochastic analysis and partial differential equations (PDEs) by providing stochastic representations for classical solutions of linear Kolmogorov PDEs. This opens the door for the derivation of sampling based Monte Carlo approximation methods, which can be meshfree and thereby stand a chance to approximate solutions of PDEs without suffering from the curse of dimensionality. In this article we extend the classical Feynman Kac formula to certain semilinear Kolmogorov PDEs. More specifically, we identify suitable solutions of stochastic fixed point equations (SFPEs), which arise when the classical Feynman Kac identity is formally applied to semilinear Kolmorogov PDEs, as viscosity solutions of the corresponding PDEs. This justifies, in particular, employing full history recursive multilevel Picard (MLP) approximation algorithms, which have recently been shown to overcome the curse of dimensionality in the numerical approximation of solutions of SFPEs, in the numerical approximation of semilinear Kolmogorov PDEs.


Using neural networks to accelerate the solution of the Boltzmann equation. One of the biggest challenges for simulating the Boltzmann equation is the evaluation of fivefold collision integral. Given the recent successes of deep learning and the availability of efficient tools, it is an obvious idea to try to substitute the evaluation of the collision operator by the evaluation of a neural network. However, it is unlcear whether this preserves key properties of the Boltzmann equation, such as conservation, invariances, the H theorem, and fluid dynamic limits. In this paper, we present an approach that guarantees the conservation properties and the correct fluid dynamic limit at leading order. The concept originates from a recently developed scientific machine learning strategy which has been named "universal differential equations". It proposes a hybridization that fuses the deep physical insights from classical Boltzmann modeling and the desirable computational efficiency from neural network surrogates. The construction of the method and the training strategy are demonstrated in detail. We conduct an asymptotic analysis and illustrate its multi scale applicability. The numerical algorithm for solving the neural network enhanced Boltzmann equation is presented as well. Several numerical test cases are investigated. The results of numerical experiments show that the time series modeling strategy enjoys the training efficiency on this supervised learning task.


Sunny Pointer Designing a mouse pointer for people with peripheral vision loss. We present a new mouse cursor designed to facilitate the use of the mouse by people with peripheral vision loss. The pointer consists of a collection of converging straight lines covering the whole screen and following the position of the mouse cursor. We measured its positive effects with a group of participants with peripheral vision loss of different kinds and we found that it can reduce by a factor of 7 the time required to complete a targeting task using the mouse. Using eye tracking, we show that this system makes it possible to initiate the movement towards the target without having to precisely locate the mouse pointer. Using Fitts' Law, we compare these performances with those of full visual field users in order to understand the relation between the accuracy of the estimated mouse cursor position and the index of performance obtained with our tool.


Computing the probability of gene trees concordant with the species tree in the multispecies coalescent. The multispecies coalescent process models the genealogical relationships of genes sampled from several species, enabling useful predictions about phenomena such as the discordance between the gene tree and the species phylogeny due to incomplete lineage sorting. Conversely, knowledge of large collections of gene trees can inform us about several aspects of the species phylogeny, such as its topology and ancestral population sizes. A fundamental open problem in this context is how to efficiently compute the probability of a gene tree topology, given the species phylogeny. Although a number of algorithms for this task have been proposed, they either produce approximate results, or, when they are exact, they do not scale to large data sets. In this paper, we present some progress towards exact and efficient computation of the probability of a gene tree topology. We provide a new algorithm that, given a species tree and the number of genes sampled for each species, calculates the probability that the gene tree topology will be concordant with the species tree. Moreover, we provide an algorithm that computes the probability of any specific gene tree topology concordant with the species tree. Both algorithms run in polynomial time and have been implemented in Python. Experiments show that they are able to analyse data sets where thousands of genes are sampled, in a matter of minutes to hours.


Physics informed Neural Networks for Solving Inverse Problems of Nonlinear Biot's Equations Batch Training. In biomedical engineering, earthquake prediction, and underground energy harvesting, it is crucial to indirectly estimate the physical properties of porous media since the direct measurement of those are usually impractical prohibitive. Here we apply the physics informed neural networks to solve the inverse problem with regard to the nonlinear Biot's equations. Specifically, we consider batch training and explore the effect of different batch sizes. The results show that training with small batch sizes, i.e., a few examples per batch, provides better approximations (lower percentage error) of the physical parameters than using large batches or the full batch. The increased accuracy of the physical parameters, comes at the cost of longer training time. Specifically, we find the size should not be too small since a very small batch size requires a very long training time without a corresponding improvement in estimation accuracy. We find that a batch size of 8 or 32 is a good compromise, which is also robust to additive noise in the data. The learning rate also plays an important role and should be used as a hyperparameter.


Global large solutions for the Navier Stokes equations with the Coriolis force. In this paper, we construct a class of global large solution to the three dimensional Navier Stokes equations with the Coriolis force in critical Fourier Besov space dot FB 2 frac 3 p p,r ( mathbb R 3) . In fact, our choice of special initial data u 0 can be arbitrarily large in dot FB s p,r ( mathbb R 3) for any s in mathbb R and 1 leq p,r leq infty .


Answer Graph Factorization Matters in Large Graphs. Our answer graph method to evaluate SPARQL conjunctive queries (CQs) finds a factorized answer set first, an answer graph, and then finds the embedding tuples from this. This approach can reduce greatly the cost to evaluate CQs. This affords a second advantage we can construct a cost based planner. We present the answer graph approach, and overview our prototype system, Wireframe. We then offer proof of concept via a micro benchmark over the YAGO2s dataset with two prevalent shapes of queries, snowflake and diamond. We compare Wireframe's performance over these against PostgreSQL, Virtuoso, MonetDB, and Neo4J to illustrate the performance advantages of our answer graph approach.


cs.MS cs.DS cs.NA math.NA physics.comp-ph

Algorithms and data structures for matrix free finite element operators with MPI parallel sparse multi vectors. Traditional solution approaches for problems in quantum mechanics scale as mathcal O(M 3) , where M is the number of electrons. Various methods have been proposed to address this issue and obtain linear scaling mathcal O(M) . One promising formulation is the direct minimization of energy. Such methods take advantage of physical localization of the solution, namely that the solution can be sought in terms of non orthogonal orbitals with local support. In this work a numerically efficient implementation of sparse parallel vectors within the open source finite element library deal.II is proposed. The main algorithmic ingredient is the matrix free evaluation of the Hamiltonian operator by cell wise quadrature. Based on an a priori chosen support for each vector we develop algorithms and data structures to perform (i) matrix free sparse matrix multivector products (SpMM), (ii) the projection of an operator onto a sparse sub space (inner products), and (iii) post multiplication of a sparse multivector with a square matrix. The node level performance is analyzed using a roofline model. Our matrix free implementation of finite element operators with sparse multivectors achieves the performance of 157 GFlop s on Intel Cascade Lake architecture. Strong and weak scaling results are reported for a typical benchmark problem using quadratic and quartic finite element bases.


Coconut Palm Static and Streaming Data Series Exploration Now in your Palm. Many modern applications produce massive streams of data series and maintain them in indexes to be able to explore them through nearest neighbor search. Existing data series indexes, however, are expensive to operate as they issue many random I Os to storage. To address this problem, we recently proposed Coconut, a new infrastructure that organizes data series based on a new sortable format. In this way, Coconut is able to leverage state of the art indexing techniques that rely on sorting for the first time to build, maintain and query data series indexes using fast sequential I Os. In this demonstration, we present Coconut Palm, a new exploration tool that allows to interactively combine different indexing techniques from within the Coconut infrastructure and to thereby seamlessly explore data series from across various scientific domains. We highlight the rich indexing design choices that Coconut opens up, and we present a new recommender tool that allows users to intelligently navigate them for both static and streaming data exploration scenarios.


Circulant Type Formulas for the Eigenvalues of Linear Network Maps. Given an admissible map F for a homogeneous network N, it is known that the Jacobian DF(x) around a fully synchronous point x (x0, ..., x0) is again an admissible map for N. Motivated by this, we study the spectra of linear admissible maps for homogeneous networks. In particular, we define so called network multipliers. These are (relatively small) matrices that depend linearly on the coefficients of the response function, and whose eigenvalues together make up the spectrum of the corresponding admissible map. More precisely, given a network N, we define a finite set of network multipliers L1 to Lk and a class of networks C containing N. This class is furthermore closed under taking quotient networks, subnetworks and disjoint unions. We then show that the eigenvalues of an admissible map for any network in C are given by those of (a subset of) the network multipliers, with fixed multiplicities m1 to mk and independently of the given (finite dimensional) phase space of a node. The coefficients of all the network multipliers of C are furthermore linearly independent, which implies that one may find the multiplicities m1 to mk by simply expressing the trace of an admissible map as a linear combination of the traces of the multipliers. In particular, we will give examples of networks where the network multipliers need not be constructed, but can be determined by looking at small networks in C. We also show that network multipliers are multiplicative with respect to composition of linear maps.


Global Existence and Uniform Estimates of Solution to Reaction Diffusion Systems with Mass Transport Type Boundary Conditions. We consider reaction diffusion systems where components diffuse inside the domain and react on the surface through mass transport type boundary conditions. Under reasonable hypotheses, we establish the existence of component wise non negative global solutions which are uniformly bounded in the sup norm.


Recognizing Chinese Judicial Named Entity using BiLSTM CRF. Named entity recognition (NER) plays an essential role in natural language processing systems. Judicial NER is a fundamental component of judicial information retrieval, entity relation extraction, and knowledge map building. However, Chinese judicial NER remains to be more challenging due to the characteristics of Chinese and high accuracy requirements in the judicial filed. Thus, in this paper, we propose a deep learning based method named BiLSTM CRF which consists of bi directional long short term memory (BiLSTM) and conditional random fields (CRF). For further accuracy promotion, we propose to use Adaptive moment estimation (Adam) for optimization of the model. To validate our method, we perform experiments on judgment documents including commutation, parole and temporary service outside prison, which is acquired from China Judgments Online. Experimental results achieve the accuracy of 0.876, recall of 0.856 and F1 score of 0.855, which suggests the superiority of the proposed BiLSTM CRF with Adam optimizer.


Initial boundary value problem for 2D magneto micropolar equations with zero angular viscosity. In this paper, we are concerned with the initial boundary value problem to the 2D magneto micropolar system with zero angular viscosity in a smooth bounded domain. We prove that there exists a unique global strong solution of such a system by imposing natural boundary conditions and regularity assumptions on the initial data, without any compatibility condition.


Semi invariants of Binary Forms and Sylvester's Theorem. We obtain a combinatorial formula related to the shear transformation for semi invariants of binary forms, which implies the classical characterization of semi invariants in terms of a differential operator. Then, we present a combinatorial proof of an identity of Hilbert, which leads to a relation of Cayley on semi invariants. This identity plays a crucial role in the original proof of Sylvester's theorem on semi invariants in connection with the Gaussian coefficients. Moreover, we show that the additivity lemma of Pak and Panova which yields the strict unimodality of the Gaussian coefficients for n,k geq 8 can be deduced from the ring property of semi invariants.