A high level characterisation and generalisation of communication avoiding programming techniques. Today's hardware's explosion of concurrency plus the explosion of data we build upon in both machine learning and scientific simulations have multifaceted impact on how we write our codes. They have changed our notion of performance and, hence, of what a good code is Good code has, first of all, to be able to exploit the unprecedented levels of parallelism. To do so, it has to manage to move the compute data into the compute facilities on time. As communication and memory bandwidth cannot keep pace with the growth in compute capabilities and as latency increases at least relative to what the hardware could do communication avoiding techniques gain importance. We characterise and classify the field of communication avoiding algorithms. A review of some examples of communication avoiding programming by means of our new terminology shows that we are well advised to broaden our notion of "communication avoiding" and to look beyond numerical linear algebra. An abstraction, generalisation and weakening of the term enriches our toolset of how to tackle the data movement challenges. Through this, we eventually gain access to a richer set of tools that we can use to deliver proper code for current and upcoming hardware generations.


Brain Tumor Segmentation on MRI with Missing Modalities. Brain Tumor Segmentation from magnetic resonance imaging (MRI) is a critical technique for early diagnosis. However, rather than having complete four modalities as in BraTS dataset, it is common to have missing modalities in clinical scenarios. We design a brain tumor segmentation algorithm that is robust to the absence of any modality. Our network includes a channel independent encoding path and a feature fusion decoding path. We use self supervised training through channel dropout and also propose a novel domain adaptation method on feature maps to recover the information from the missing channel. Our results demonstrate that the quality of the segmentation depends on which modality is missing. Furthermore, we also discuss and visualize the contribution of each modality to the segmentation results. Their contributions are along well with the expert screening routine.


Deep Metric Learning with Density Adaptivity. The problem of distance metric learning is mostly considered from the perspective of learning an embedding space, where the distances between pairs of examples are in correspondence with a similarity metric. With the rise and success of Convolutional Neural Networks (CNN), deep metric learning (DML) involves training a network to learn a nonlinear transformation to the embedding space. Existing DML approaches often express the supervision through maximizing inter class distance and minimizing intra class variation. However, the results can suffer from overfitting problem, especially when the training examples of each class are embedded together tightly and the density of each class is very high. In this paper, we integrate density, i.e., the measure of data concentration in the representation, into the optimization of DML frameworks to adaptively balance inter class similarity and intra class variation by training the architecture in an end to end manner. Technically, the knowledge of density is employed as a regularizer, which is pluggable to any DML architecture with different objective functions such as contrastive loss, N pair loss and triplet loss. Extensive experiments on three public datasets consistently demonstrate clear improvements by amending three types of embedding with the density adaptivity. More remarkably, our proposal increases Recall 1 from 67.95 to 77.62 , from 52.01 to 55.64 and from 68.20 to 70.56 on Cars196, CUB 200 2011 and Stanford Online Products dataset, respectively.


Global aware Beam Search for Neural Abstractive Summarization. This study develops a calibrated beam based algorithm with awareness of the global attention distribution for neural abstractive summarization, aiming to improve the local optimality problem of the original beam search in a rigorous way. Specifically, a novel global protocol is proposed based on the attention distribution to stipulate how a global optimal hypothesis should attend to the source. A global scoring mechanism is then developed to regulate beam search to generate summaries in a near global optimal fashion. This novel design enjoys a distinctive property, i.e., the global attention distribution could be predicted before inference, enabling step wise improvements on the beam search through the global scoring mechanism. Extensive experiments on nine datasets show that the global (attention) aware inference significantly improves state of the art summarization models even using empirical hyper parameters. The algorithm is also proven robust as it remains to generate meaningful texts with corrupted attention distributions. The codes and a comprehensive set of examples are available.


Proposal free Temporal Moment Localization of a Natural Language Query in Video using Guided Attention. This paper studies the problem of temporal moment localization in a long untrimmed video using natural language as the query. Given an untrimmed video and a sentence as the query, the goal is to determine the starting, and the ending, of the relevant visual moment in the video, that corresponds to the query sentence. While previous works have tackled this task by a propose and rank approach, we introduce a more efficient, end to end trainable, and em proposal free approach that relies on three key components a dynamic filter to transfer language information to the visual domain, a new loss function to guide our model to attend the most relevant parts of the video, and soft labels to model annotation uncertainty. We evaluate our method on two benchmark datasets, Charades STA and ActivityNet Captions. Experimental results show that our approach outperforms state of the art methods on both datasets.


Helly meets Garside and Artin. A graph is Helly if every family of pairwise intersecting combinatorial balls has a nonempty intersection. We show that weak Garside groups of finite type and FC type Artin groups are Helly, that is, they act geometrically on Helly graphs. In particular, such groups act geometrically on spaces with convex geodesic bicombing, equipping them with a nonpositive curvature like structure. That structure has many properties of a CAT(0) structure and, additionally, it has a combinatorial flavor implying biautomaticity. As immediate consequences we obtain new results for FC type Artin groups (in particular braid groups and spherical Artin groups) and weak Garside groups, including e.g. fundamental groups of the complements of complexified finite simplicial arrangements of hyperplanes, braid groups of well generated complex reflection groups, and one relator groups with non trivial center. Among the results are biautomaticity, existence of EZ and Tits boundaries, the Farrell Jones conjecture, the coarse Baum Connes conjecture, and a description of higher order homological and homotopical Dehn functions. As a mean of proving the Helly property we introduce and use the notion of a (generalized) cell Helly complex.


Closed form optimal exercise boundary of the American put option. We present three models of stock price with time dependent interest rate, dividend yield, and volatility, respectively, that allow for explicit forms of the optimal exercise boundary of the finite maturity American put option. The optimal exercise boundary satisfies the nonlinear integral equation of Volterra type. We choose time dependent parameters of the model so that the integral equation for the exercise boundary can be solved in the closed form. We also define the contracts of put type with time dependent strike price that support the explicit optimal exercise boundary.


On the speed of algebraically defined graph classes. The speed of a class of graphs counts the number of graphs on the vertex set lbrace 1, dots, n rbrace inside the class as a function of n . In this paper, we investigate this function for many classes of graphs that naturally arise in discrete geometry, for example intersection graphs of segments or disks in the plane. While upper bounds follow from Warren's theorem (a variant of a theorem of Milnor and Thom), all the previously known lower bounds were obtained from ad hoc constructions for very specific classes. We prove a general theorem giving an essentially tight lower bound for the number of graphs on lbrace 1, dots, n rbrace whose edges are defined using the signs of a given finite list of polynomials, assuming these polynomials satisfy some reasonable conditions. This in particular implies lower bounds for the speed of many different classes of intersection graphs, which essentially match the known upper bounds. Our general result also gives essentially tight lower bounds for counting containment orders of various families of geometric objects, including circle orders and angle orders. Some of the applications presented in this paper are new, whereas others recover results of Alon Scheinerman, Fox, McDiarmid M " u ller and Shi. For the proof of our result we use some tools from algebraic geometry and differential topology.


A Statistical Characterization of Localization Performance in Millimeter Wave Cellular Networks. Millimeter wave (mmWave) communication is a promising solution for achieving high data rate and low latency in 5G wireless cellular networks. Since directional beamforming and antenna arrays are exploited in the mmWave networks, accurate angle of arrival (AOA) information can be obtained and utilized for localization purposes. The performance of a localization system is typically assessed by the Cramer Rao lower bound (CRLB) evaluated based on fixed node locations. However, this strategy only produces a fixed value for the CRLB specific to the scenario of interest. To allow randomly distributed nodes, stochastic geometry has been proposed to study the CRLB for time of arrival based localization. To the best of our knowledge, this methodology has not yet been investigated for AOA based localization. In this work, we are motivated to consider the mmWave cellular network and derive the CRLB for AOA based localization and its distribution using stochastic geometry. We analyze how the CRLB is affected by the node locations' spatial distribution, including the target and participating base stations. To apply the CRLB on a network setting with random node locations, we propose an accurate approximation of the CRLB using the L 4 th value of ordered distances where L is the number of participating base stations. Furthermore, we derive the localizability of the mmWave network, which is the probability that a target is localizable, and examine how the network parameters influence the localization performance. These findings provide us deep insight into optimum network design that meets specified localization requirements.


Review of Recent Heap Specification and Verification Techniques. The article provides an overview of the existing methods of dynamic memory verification a comparative analysis is carried out the applicability for solving problems of control, monitoring, and verification of dynamic memory is evaluated. This article is divided into eight sections. The first section introduces formal verification, followed by a section that discusses dynamic memory management problems. The third section discusses Hoare's calculus resumed by heap transformations to the stack. The fifth and sixth sections introduce the concept of dynamic memory shape analysis and the rotation of pointers. The seventh is on separation logic. The last section discusses possible areas of further research, particularly the recognition at recording level of various instances of objects automation of proofs "hot" code, that is, software code that updates itself when the program runs expanding intuitiveness, for instance, on proof explanations.


Random scattering by rough surfaces with spatially varying impedance. A method is given for evaluating electromagnetic scattering by an irregular surface with spatially varying impedance. This uses an operator expansion with respect to impedance variation and allows examination of its effects and the resulting modification of the field scattered by the rough surface. For a fixed rough surface and randomly varying impedance, expressions are derived for the scattered field itself, and for the coherent field with respect to impedance variation for both flat and rough surfaces in the form of effective impedance conditions.


Finite Point Configurations and the Regular Value Theorem in a Fractal setting. In this article, we study two problems concerning the size of the set of finite point configurations generated by a compact set E subset mathbb R d . The first problem concerns how the Lebesgue measure or the Hausdorff dimension of the finite point configuration set depends on that of E . In particular, we show that if a planar set has dimension exceeding frac 5 4 , then there exists a point x in E so that for each integer k geq2 , the set of " k chains" with initial point at x has positive Lebesgue measure. The second problem is a continuous analogue of the Erd H o s unit distance problem, which aims to determine the maximum number of times a point configuration with prescribed gaps can appear in E . For instance, given a triangle with prescribed sides and given a sufficiently regular planar set E with Hausdorff dimension no less than frac 7 4 , we show that the dimension of the set of vertices in E forming said triangle does not exceed 3 , dim mathcal H (E) 3 . In addition to the Euclidean norm, we consider more general distances given by functions satisfying the so called Phong Stein rotational curvature condition. We also explore a number of examples to demonstrate the extent to which our results are sharp.


A survey on test practitioners' awareness of test smells. Developing test code may be a time consuming task that usually requires much effort and cost, especially when it is done manually. Besides, during this process, developers and testers are likely to adopt bad design choices, which may lead to the introduction of the so called test smells in test code. Test smells are bad solutions to either implement or design test code. As the test code with test smells increases in size, these tests might become more complex, and as a consequence, much harder to understand and evolve correctly. Therefore, test smells may have a negative impact on the quality and maintenance of test code and may also harm the whole software testing activities. In this context, this study aims to understand whether test professionals non intentionally insert test smells. We carried out an expert survey to analyze the usage frequency of a set of test smells. Sixty professionals from different companies participated in the survey. We selected 14 widely studied smells from the literature, which are also implemented in existing test smell detection tools. The yielded results indicate that experienced professionals introduce test smells during their daily programming tasks, even when they are using standardized practices from their companies, and not only for their personal assumptions. Another relevant evidence was that developers' professional experience can not be considered as a root cause for the insertion of test smells in test code.


Characterization of Probability Distributions via Functional Equations of Power Mixture Type. We study power mixture type functional equations in terms of Laplace Stieltjes transforms of probability distributions. These equations arise when studying distributional equations of the type Z X TZ, where T is a known random variable, while the variable Z is defined via X, and we want to find' X. We provide necessary and sufficient conditions for such functional equations to have unique solutions. The uniqueness is equivalent to a characterization property of a probability distribution. We present results which are either new or extend and improve previous results about functional equations of compound exponential and compound Poisson types. In particular, we give another affirmative answer to a question posed by J. Pitman and M. Yor in 2003. We provide explicit illustrative examples and deal with related topics.


Options on infectious diseases. We present a parsimonious stochastic model for valuation of options on the fraction of infected individuals during an epidemic. The underlying stochastic dynamical system is a stochastic differential version of the SIR model of mathematical epidemiology.


Unraveling the Veil of Subspace RIP Through Near Isometry on Subspaces. Dimensionality reduction is a popular approach to tackle high dimensional data with low dimensional nature. Subspace Restricted Isometry Property, a newly proposed concept, has proved to be a useful tool in analyzing the effect of dimensionality reduction algorithms on subspaces. In this paper, we provide a characterization of subspace Restricted Isometry Property, asserting that matrices which act as a near isometry on low dimensional subspaces possess subspace Restricted Isometry Property. This points out a unified approach to discuss subspace Restricted Isometry Property. Its power is further demonstrated by the possibility to prove with this result the subspace RIP for a large variety of random matrices encountered in theory and practice, including subgaussian matrices, partial Fourier matrices, partial Hadamard matrices, partial circulant Toeplitz matrices, matrices with independent strongly regular rows (for instance, matrices with independent entries having uniformly bounded 4 epsilon moments), and log concave ensembles. Thus our result could extend the applicability of random projections in subspace based machine learning algorithms including subspace clustering and allow for the application of some useful random matrices which are easier to implement on hardware or are more efficient to compute.


Consistent Internal Energy Based Schemes for the Compressible Euler Equations. Numerical schemes for the solution of the Euler equations have recently been developed, which involve the discretisation of the internal energy equation, with corrective terms to ensure the correct capture of shocks, and, more generally, the consistency in the Lax Wendroff sense. These schemes may be staggered or colocated, using either struc tured meshes or general simplicial or tetrahedral hexahedral meshes. The time discretization is performed by fractional step algorithms these may be either based on semi implicit pressure correction techniques or segregated in such a way that only explicit steps are involved (referred to hereafter as "explicit" variants). In order to ensure the positivity of the density, the internal energy and the pressure, the discrete convection operators for the mass and internal energy balance equations are carefully designed they use an upwind technique with respect to the material velocity only. The construction of the fluxes thus does not need any Rie mann or approximate Riemann solver, and yields easily implementable algorithms. The stability is obtained without restriction on the time step for the pressure correction scheme and under a CFL like condition for explicit variants preservation of the integral of the total energy over the computational domain, and positivity of the density and the internal energy. The semi implicit first order upwind scheme satisfies a local discrete entropy inequality. If a MUSCL like scheme is used in order to limit the scheme diffusion, then a weaker property holds the entropy inequality is satisfied up to a remainder term which is shown to tend to zero with the space and time steps, if the discrete solution is controlled in L infty and BV norms. The explicit upwind variant also satisfies such a weaker property, at the price of an estimate for the velocity which could be derived from the introduction of a new stabilization term in the momentum balance. Still for the explicit scheme, with the above mentioned MUSCL like scheme, the same result only holds if the ratio of the time to the space step tends to zero.


Dynamical systems on chain complexes and canonical minimal resolutions. We introduce notions of vector field and its (discrete time) flow on a chain complex. The resulting dynamical systems theory provides a set of tools with a broad range of applicability that allow, among others, to replace in a canonical way a chain complex with a "smaller" one of the same homotopy type. As applications we construct in an explicit, canonical, and symmetry preserving fashion a minimal free resolution for every toric ring and every monomial ideal. Our constructions work in all characteristics and over any base field. A key subtle new point is that in certain finitely many positive characteristics (which depend on the object that is being resolved) a transcendental extension of the base field is produced before a resolution is obtained, while in all other characteristics the base field is kept unchanged. In the monomial case we show that such a transcendental base field extension cannot in general be avoided, and we conjecture that the same holds in the toric case.


Lower Bounds on the Running Time of Two Way Quantum Finite Automata and Sublogarithmic Space Quantum Turing Machines. The two way finite automaton with quantum and classical states (2QCFA), defined by Ambainis and Watrous, is a model of quantum computation whose quantum part is extremely limited however, as they showed, 2QCFA are surprisingly powerful a 2QCFA with only a single qubit can recognize the language L pal w in a,b w text is a palindrome with bounded error in expected time 2 O(n) , on inputs of length n . We prove that their result essentially cannot be improved upon a 2QCFA (of any size) cannot recognize L pal with bounded error in expected time 2 o(n) . To our knowledge, this is the first example of a language that can be recognized with bounded error by a 2QCFA in exponential time but not in subexponential time. Moreover, we prove that a quantum Turing machine (QTM) running in space o( log n) and expected time 2 n 1 Omega(1) cannot recognize L pal with bounded error again, this is the first lower bound of its kind. Far more generally, we establish a lower bound on the running time of any 2QCFA or o( log n) space QTM that recognizes any language L in terms of a natural "hardness measure" of L . This allows us to exhibit a large family of languages for which we have asymptotically matching lower and upper bounds on the running time of any such 2QCFA or QTM recognizer.


NELEC at SemEval 2019 Task 3 Think Twice Before Going Deep. Existing Machine Learning techniques yield close to human performance on text based classification tasks. However, the presence of multi modal noise in chat data such as emoticons, slang, spelling mistakes, code mixed data, etc. makes existing deep learning solutions perform poorly. The inability of deep learning systems to robustly capture these covariates puts a cap on their performance. We propose NELEC Neural and Lexical Combiner, a system which elegantly combines textual and deep learning based methods for sentiment classification. We evaluate our system as part of the third task of 'Contextual Emotion Detection in Text' as part of SemEval 2019. Our system performs significantly better than the baseline, as well as our deep learning model benchmarks. It achieved a micro averaged F1 score of 0.7765, ranking 3rd on the test set leader board. Our code is available at https github.com iamgroot42 nelec


Isolas of multi pulse solutions to lattice dynamical systems. This work investigates the existence and bifurcation structure of multi pulse steady state solutions to bistable lattice dynamical systems. Such solutions are characterized by multiple compact disconnected regions where the solution resembles one of the bistable states and resembles another trivial bistable state outside of these compact sets. It is shown that the bifurcation curves of these multi pulse solutions lie along closed and bounded curves (isolas), even when single pulse solutions lie along unbounded curves. These results are applied to a discrete Nagumo differential equation and we show that the hypotheses of this work can be confirmed analytically near the anti continuum limit. Results are demonstrated with a number of numerical investigations.


G 'EANT Software Maturity Model. G 'EANT project is an example of a large organization with around 30 software projects and around 20 software development teams. Software development teams consist of many skilled associates coming from all members National Research and Education Networks. Three main issues that are common for all these software development teams and their members are geographical distribution, scattered manpower percentage, and parallel involvement in other high priority projects in their native organizations. This paper presents a novel software maturity model that is designed specifically for G 'EANT software development teams and aims to address the described issues.


Inertial Manifolds and Limit Cycles of Dynamical Systems in mathbb R n . We show that the presence of a two dimensional inertial manifold for an ordinary differential equation in mathbb R n permits reducing the problem of determining asymptotically orbitally stable limit cycles to the Poincare Bendixson theory. In the case n 3 we implement such a scenario for a model of a satellite rotation around a celestial body of small mass and for a biochemical model.


Higher Connectivity of Tropicalizations. We show that the tropicalization of an irreducible d dimensional variety over a field of characteristic 0 is (d l) connected through codimension one, where l is the dimension of the lineality space of the tropicalization. From this we obtain a higher connectivity result for skeleta of rational polytopes. We also prove a tropical analogue of the Bertini Theorem the intersection of the tropicalization of an irreducible variety with a generic hyperplane is again the tropicalization of an irreducible variety.


A Framework for Measuring the Costs of Security at Runtime. In Industry 4.0, Cyber Physical Systems (CPS) are formed by components, which are interconnected with each other over the Internet of Things (IoT). The resulting capabilities of sensing and affecting the physical world offer a vast range of opportunities, yet, at the same time pose new security challenges. To address these challenges there are various IoT Frameworks, which offer solutions for managing and controlling IoT components and their interactions. In this regard, providing security for an interaction usually requires performing additional security related tasks (e.g. authorisation, encryption, etc.) to prevent possible security risks. Research currently focuses more on designing and developing these frameworks and does not satisfactorily provide methodologies for evaluating the resulting costs of providing security. In this paper we propose an initial approach for measuring the resulting costs of providing security for interacting IoT components by using a Security Cost Modelling Framework. Furthermore, we describe the necessary building blocks of the framework and provide an experimental design showing how it could be used to measure security costs at runtime.


Using Vision Videos in a Virtual Focus Group Experiences and Recommendations. Facilitated meetings are an established practice for the requirements engineering activities elicitation and validation. Focus groups are one well known technique to implement this practice. Several researchers already reported the successful use of vision videos to stimulate active discussions among the participants of on site focus groups, e.g., for validating scenarios and eliciting feedback. These vision videos show scenarios of a system vision. In this way, the videos serve all parties involved as a visual reference point to actively disclose, discuss, and align their mental models of the future system to achieve shared understanding. In the joint project TrUSD, we had planned to conduct such an on site focus group using a vision video to validate a scenario of a future software tool, the so called Privacy Dashboard. However, the COVID 19 pandemic and its associated measures led to an increase in home and remote working, which also affected us. Therefore, we had to replan and conduct the focus group virtually. In this paper, we report about our experiences and recommendations for the use of vision videos in virtual focus groups.


Quantum no signalling correlations and non local games. We introduce and examine three subclasses of the family of quantum no signalling (QNS) correlations introduced by Duan and Winter quantum commuting, quantum and local. We formalise the notion of a universal TRO of a block operator isometry, define an operator system, universal for stochastic operator matrices, and realise it as a quotient of a matrix algebra. We describe the classes of QNS correlations in terms of states on the tensor products of two copies of the universal operator system, and specialise the correlation classes and their representations to classical to quantum correlations. We study various quantum versions of synchronous no signalling correlations and show that they possess invariance properties for suitable sets of states. We introduce quantum non local games as a generalisation of non local games. We define the operation of quantum game composition and show that the perfect strategies belonging to a certain class are closed under channel composition. We specialise to the case of graph colourings, where we exhibit quantum versions of the orthogonal rank of a graph as the optimal output dimension for which perfect classical to quantum strategies of the graph colouring game exist, as well as to non commutative graph homomorphisms, where we identify quantum versions of non commutative graph homomorphisms introduced by Stahlke.


UniCase Rethinking Casing in Language Models. In this paper, we introduce a new approach to dealing with the problem of case sensitiveness in Language Modelling (LM). We propose simple architecture modification to the RoBERTa language model, accompanied by a new tokenization strategy, which we named Unified Case LM (UniCase). We tested our solution on the GLUE benchmark, which led to increased performance by 0.42 points. Moreover, we prove that the UniCase model works much better when we have to deal with text data, where all tokens are uppercased ( 5.88 point).


Inertial Only Optimization for Visual Inertial Initialization. We formulate for the first time visual inertial initialization as an optimal estimation problem, in the sense of maximum a posteriori (MAP) estimation. This allows us to properly take into account IMU measurement uncertainty, which was neglected in previous methods that either solved sets of algebraic equations, or minimized ad hoc cost functions using least squares. Our exhaustive initialization tests on EuRoC dataset show that our proposal largely outperforms the best methods in the literature, being able to initialize in less than 4 seconds in almost any point of the trajectory, with a scale error of 5.3 on average. This initialization has been integrated into ORB SLAM Visual Inertial boosting its robustness and efficiency while maintaining its excellent accuracy.


Lyapunov instability in KAM stable Hamiltonians with two degrees of freedom. For a fixed frequency vector omega in mathbb R 2 , setminus , lbrace 0 rbrace obeying omega 1 omega 2 0 we show the existence of Gevrey smooth Hamiltonians, arbitrarily close to an integrable Kolmogorov non degenerate analytic Hamiltonian, having a Lyapunov unstable elliptic equilibrium with frequency omega . In particular, the elliptic fixed points thus constructed will be KAM stable, i.e. accumulated by invariant tori whose Lebesgue density tend to one in the neighbourhood of the point and whose frequencies cover a set of positive measure. Similar examples for near integrable Hamiltonians in action angle coordinates in the neighbourhood of a Lagragian invariant torus with arbitrary rotation vector are also given in this work.


Enhancing Resource Management through Prediction based Policies. Task based programming models are emerging as a promising alternative to make the most of multi many core systems. These programming models rely on runtime systems, and their goal is to improve application performance by properly scheduling application tasks to cores. Additionally, these runtime systems offer policies to cope with application phases that lack in parallelism to fill all cores. However, these policies are usually static and favor either performance or energy efficiency. In this paper, we have extended a task based runtime system with a lightweight monitoring and prediction infrastructure that dynamically predicts the optimal number of cores required for each application phase, thus improving both performance and energy efficiency. Through the execution of several benchmarks in multi many core systems, we show that our prediction based policies have competitive performance while improving energy efficiency when compared to state of the art policies.


Bilinear estimates on Morrey spaces by using average. This paper is a follow up of 6 . We investigate the boundedness of the bilinear fractional integral operator introduced by Grafakos in 3 . When the local integrability index s falls 1 with weights and t exceeds 1, He and Yan obtained some results on this operator was worked on Morrey spaces earlier in 7 . Later in the paper 6 , we considered the case t 1 . This paper handles the remaining case 0 t 1 .


A Multi Level Approach to Waste Object Segmentation. We address the problem of localizing waste objects from a color image and an optional depth image, which is a key perception component for robotic interaction with such objects. Specifically, our method integrates the intensity and depth information at multiple levels of spatial granularity. Firstly, a scene level deep network produces an initial coarse segmentation, based on which we select a few potential object regions to zoom in and perform fine segmentation. The results of the above steps are further integrated into a densely connected conditional random field that learns to respect the appearance, depth, and spatial affinities with pixel level accuracy. In addition, we create a new RGBD waste object segmentation dataset, MJU Waste, that is made public to facilitate future research in this area. The efficacy of our method is validated on both MJU Waste and the Trash Annotation in Context (TACO) dataset.


Challenges for Verifying and Validating Scientific Software in Computational Materials Science. Many fields of science rely on software systems to answer different research questions. For valid results researchers need to trust the results scientific software produces, and consequently quality assurance is of utmost importance. In this paper we are investigating the impact of quality assurance in the domain of computational materials science (CMS). Based on our experience in this domain we formulate challenges for validation and verification of scientific software and their results. Furthermore, we describe directions for future research that can potentially help dealing with these challenges.


The L p Dirichlet and Regularity problems for second order Elliptic Systems with application to the Lam 'e system. In the paper arXiv 1708.02289 we have introduced new solvability methods for strongly elliptic second order systems in divergence form on a domains above a Lipschitz graph, satisfying L p boundary data for p near 2 . The main novel aspect of our result is that it applies to operators with coefficients of limited regularity and applies to operators satisfying a natural Carleson condition that has been first considered in the scalar case. In this paper we extend this result in several directions. We improve the range of solvability of the L p Dirichlet problem to the interval 2 varepsilon p frac 2(n 1) (n 3) varepsilon , for systems in dimension n 2,3 in the range 2 varepsilon p infty . We do this by considering solvability of the Regularity problem (with boundary data having one derivative in L p ) in the range 2 varepsilon p 2 varepsilon . Secondly, we look at perturbation type results where we can deduce solvability of the L p Dirichlet problem for one operator from known L p Dirichlet solvability of a lq lq close" operator (in the sense of Carleson measure). This leads to improvement of the main result of the paper arXiv 1708.02289 we establish solvability of the L p Dirichlet problem in the interval 2 varepsilon p frac 2(n 1) (n 2) varepsilon under a much weaker (oscillation type) Carleson condition. A particular example of the system where all these results apply is the Lam 'e operator for isotropic inhomogeneous materials with Poisson ratio nu 0.396 . In this specific case further improvements of the solvability range are possible, see the upcoming work with J. Li and J. Pipher.


Exponentially convergent distributed Nash equilibrium seeking for constrained aggregative games. Distributed Nash equilibrium seeking of aggregative games is investigated and a continuous time algorithm is proposed. The algorithm is designed by virtue of projected gradient play dynamics and distributed average tracking dynamics, and is applicable to games with constrained strategy sets and weight balanced communication graphs. We obtain an exponential convergence of the proposed algorithm to the Nash equilibrium. Numerical examples illustrate the effectiveness of our methods.


On Designing a Machine Learning Based Wireless Link Quality Classifier. Ensuring a reliable communication in wireless networks strictly depends on the effective estimation of the link quality, which is particularly challenging when propagation environment for radio signals significantly varies. In such environments, intelligent algorithms that can provide robust, resilient and adaptive links are being investigated to complement traditional algorithms in maintaining a reliable communication. In this respect, the data driven link quality estimation (LQE) using machine learning (ML) algorithms is one of the most promising approaches. In this paper, we provide a quantitative evaluation of design decisions taken at each step involved in developing a ML based wireless LQE on a selected, publicly available dataset. Our study shows that, re sampling to achieve training class balance and feature engineering have a larger impact on the final performance of the LQE than the selection of the ML method on the selected data.


Multi Objective Evolutionary Design of Deep Convolutional Neural Networks for Image Classification. Early advancements in convolutional neural networks (CNNs) architectures are primarily driven by human expertise and by elaborate design processes. Recently, neural architecture search was proposed with the aim of automating the network design process and generating task dependent architectures. While existing approaches have achieved competitive performance in image classification, they are not well suited to problems where the computational budget is limited for two reasons (1) the obtained architectures are either solely optimized for classification performance, or only for one deployment scenario (2) the search process requires vast computational resources in most approaches. To overcome these limitations, we propose an evolutionary algorithm for searching neural architectures under multiple objectives, such as classification performance and floating point operations (FLOPs). The proposed method addresses the first shortcoming by populating a set of architectures to approximate the entire Pareto frontier through genetic operations that recombine and modify architectural components progressively. Our approach improves computational efficiency by carefully down scaling the architectures during the search as well as reinforcing the patterns commonly shared among past successful architectures through Bayesian model learning. The integration of these two main contributions allows an efficient design of architectures that are competitive and in most cases outperform both manually and automatically designed architectures on benchmark image classification datasets CIFAR, ImageNet, and human chest X ray. The flexibility provided from simultaneously obtaining multiple architecture choices for different compute requirements further differentiates our approach from other methods in the literature. Code is available at https github.com mikelzc1990 nsganetv1


Synthesizing Approximate Implementations for Unrealizable Specifications. The unrealizability of a specification is often due to the assumption that the behavior of the environment is unrestricted. In this paper, we present algorithms for synthesis in bounded environments, where the environment can only generate input sequences that are ultimately periodic words (lassos) with finite representations of bounded size. We provide automata theoretic and symbolic approaches for solving this synthesis problem, and also study the synthesis of approximative implementations from unrealizable specifications. Such implementations may violate the specification in general, but are guaranteed to satisfy the specification on at least a specified portion of the bounded size lassos. We evaluate the algorithms on different arbiter specifications.


Image Reconstruction via Discrete Curvatures. The curvature regularities are well known for providing strong priors in the continuity of edges, which have been applied to a wide range of applications in image processing and computer vision. However, these models are usually non convex, non smooth and highly non linear, the first order optimal condition of which are high order partial differential equations. Thus, the numerical computation are extremely challenging. In this paper, we propose to estimate the discrete curvatures, i.e., mean curvature and Gaussian curvature, in the local neighborhood according to differential geometry theory. By minimizing certain functions of curvatures on all level curves of an image, it yields a kind of weighted total variation minimization problem, which can be efficiently solved by the proximal alternating direction method of multipliers (ADMM). Numerical experiments are implemented to demonstrate the effectiveness and superiority of our proposed variational models for different image reconstruction tasks.


Continuation Newton methods with the residual trust region time stepping scheme for nonlinear equations. For nonlinear equations, the homotopy methods (continuation methods) are popular in engineering fields since their convergence regions are large and they are quite reliable to find a solution. The disadvantage of the classical homotopy methods is that their computational time is heavy since they need to solve many auxiliary nonlinear systems during the intermediate continuation processes. In order to overcome this shortcoming, we consider the special explicit continuation Newton method with the residual trust region time stepping scheme for this problem. According to our numerical experiments, the new method is more robust and faster to find the required solution of the real world problem than the traditional optimization method (the built in subroutine fsolve.m of the MATLAB environment) and the homotopy continuation methods(HOMPACK90 and NAClab). Furthermore, we analyze the global convergence and the local superlinear convergence of the new method.


Video Representation Learning with Visual Tempo Consistency. Visual tempo, which describes how fast an action goes, has shown its potential in supervised action recognition. In this work, we demonstrate that visual tempo can also serve as a self supervision signal for video representation learning. We propose to maximize the mutual information between representations of slow and fast videos via hierarchical contrastive learning (VTHCL). Specifically, by sampling the same instance at slow and fast frame rates respectively, we can obtain slow and fast video frames which share the same semantics but contain different visual tempos. Video representations learned from VTHCL achieve the competitive performances under the self supervision evaluation protocol for action recognition on UCF 101 (82.1 ) and HMDB 51 (49.2 ). Moreover, comprehensive experiments suggest that the learned representations are generalized well to other downstream tasks including action detection on AVA and action anticipation on Epic Kitchen. Finally, we propose Instance Correspondence Map (ICM) to visualize the shared semantics captured by contrastive learning.


On the linear convergence of distributed Nash equilibrium seeking for multi cluster games under partial decision information. This paper considers the distributed strategy design for Nash equilibrium (NE) seeking in multi cluster games under a partial decision information scenario. In the considered game, there are multiple clusters and each cluster consists of a group of agents. A cluster is viewed as a virtual noncooperative player that aims to minimize its local payoff function and the agents in a cluster are the actual players that cooperate within the cluster to optimize the payoff function of the cluster through communication via a connected graph. In our setting, agents have only partial decision information, that is, they only know local information and cannot have full access to opponents' decisions. To solve the NE seeking problem of this formulated game, a discrete time distributed algorithm, called distributed gradient tracking algorithm (DGT), is devised based on the inter and intra communication of clusters. In the designed algorithm, each agent is equipped with strategy variables including its own strategy and estimates of other clusters' strategies. With the help of a weighted Fronbenius norm and a weighted Euclidean norm, theoretical analysis is presented to rigorously show the linear convergence of the algorithm. Finally, a numerical example is given to illustrate the proposed algorithm.


Taming Uncertainty in the Assurance Process of Self Adaptive Systems a Goal Oriented Approach. Goals are first class entities in a self adaptive system (SAS) as they guide the self adaptation. A SAS often operates in dynamic and partially unknown environments, which cause uncertainty that the SAS has to address to achieve its goals. Moreover, besides the environment, other classes of uncertainty have been identified. However, these various classes and their sources are not systematically addressed by current approaches throughout the life cycle of the SAS. In general, uncertainty typically makes the assurance provision of SAS goals exclusively at design time not viable. This calls for an assurance process that spans the whole life cycle of the SAS. In this work, we propose a goal oriented assurance process that supports taming different sources (within different classes) of uncertainty from defining the goals at design time to performing self adaptation at runtime. Based on a goal model augmented with uncertainty annotations, we automatically generate parametric symbolic formulae with parameterized uncertainties at design time using symbolic model checking. These formulae and the goal model guide the synthesis of adaptation policies by engineers. At runtime, the generated formulae are evaluated to resolve the uncertainty and to steer the self adaptation using the policies. In this paper, we focus on reliability and cost properties, for which we evaluate our approach on the Body Sensor Network (BSN) implemented in OpenDaVINCI. The results of the validation are promising and show that our approach is able to systematically tame multiple classes of uncertainty, and that it is effective and efficient in providing assurances for the goals of self adaptive systems.


Do NLP Models Know Numbers? Probing Numeracy in Embeddings. The ability to understand and work with numbers (numeracy) is critical for many complex reasoning tasks. Currently, most NLP models treat numbers in text in the same way as other tokens they embed them as distributed vectors. Is this enough to capture numeracy? We begin by investigating the numerical reasoning capabilities of a state of the art question answering model on the DROP dataset. We find this model excels on questions that require numerical reasoning, i.e., it already captures numeracy. To understand how this capability emerges, we probe token embedding methods (e.g., BERT, GloVe) on synthetic list maximum, number decoding, and addition tasks. A surprising degree of numeracy is naturally present in standard embeddings. For example, GloVe and word2vec accurately encode magnitude for numbers up to 1,000. Furthermore, character level embeddings are even more precise ELMo captures numeracy the best for all pre trained methods but BERT, which uses sub word units, is less exact.


Rolling with Random Slipping and Twisting A Large Deviation Point of View. We study a rolling model from the perspective of probability. More precisely, we consider a Riemannian manifold rolling against Euclidean space, where the rolling is coupled with random slipping and twisting. The system is modelled by a stochastic differential equation of Stratonovich type driven by semimartingales, on the orthonormal frame bundle. The stability of the system is examined via large deviations. We prove the large deviation principles for the projection curves on the base manifold and their horizontal lifts respectively, provided that the large deviation holds for the random Euclidean curves as semimartingales. The large deviation results for the case of compact manifolds and two special cases of noncompact manifolds are established.


Koszul duality in exact categories. In this paper we establish Koszul duality type results in the setting of chain complexes in exact categories. In particular we prove generalisations of Vallette's cooperadic Koszul duality theorem, and operadic Koszul duality along the lines of Lurie. We also prove a connective version. We conclude with some applications, including our main example, the category of complete bornological spaces over a Banach field.


Binary compositions and semi Pell compositions. In analogy with the semi Fibonacci partitions studied recently by Andrews, we define semi Pell compositions and semi m Pell compositions. We find that these are in bijection with certain weakly unimodal m ary compositions. We give generating functions, bijective proofs, and a number of unexpected congruences for these objects.


Frequency Fitness Assignment Making Optimization Algorithms Invariant under Bijective Transformations of the Objective Function Value. Under Frequency Fitness Assignment (FFA), the fitness corresponding to an objective value is its encounter frequency in fitness assignment steps and is subject to minimization. FFA renders optimization processes invariant under bijective transformations of the objective function value. On TwoMax, Jump, and Trap functions of dimension s, the classical (1 1) EA with standard mutation at rate 1 s can have expected runtimes exponential in s. In our experiments, a (1 1) FEA, the same algorithm but using FFA, exhibits mean runtimes that seem to scale as s 2 ln s . Since Jump and Trap are bijective transformations of OneMax, it behaves identical on all three. On OneMax, LeadingOnes, and Plateau problems, it seems to be slower than the (1 1) EA by a factor linear in s. The (1 1) FEA performs much better than the (1 1) EA on W Model and MaxSat instances. We further verify the bijection invariance by applying the Md5 checksum computation as transformation to some of the above problems and yield the same behaviors. Finally, we show that FFA can improve the performance of a memetic algorithm for job shop scheduling.


Are Chess Discussions Racist? An Adversarial Hate Speech Data Set. On June 28, 2020, while presenting a chess podcast on Grandmaster Hikaru Nakamura, Antonio Radi 'c's YouTube handle got blocked because it contained "harmful and dangerous" content. YouTube did not give further specific reason, and the channel got reinstated within 24 hours. However, Radi 'c speculated that given the current political situation, a referral to "black against white", albeit in the context of chess, earned him this temporary ban. In this paper, via a substantial corpus of 681,995 comments, on 8,818 YouTube videos hosted by five highly popular chess focused YouTube channels, we ask the following research question emph how robust are off the shelf hate speech classifiers to out of domain adversarial examples? We release a data set of 1,000 annotated comments where existing hate speech classifiers misclassified benign chess discussions as hate speech. We conclude with an intriguing analogy result on racial bias with our findings pointing out to the broader challenge of color polysemy.


Results in estimates for k plane transforms. This is an expository paper. We give proofs of some results of M. Christ (1984) and S. W. Drury (1984) for k plane transforms. Also, we give proofs for some related results including that for the existence of invariant measures on certain homogeneous manifolds of Lie groups.


Pathwise Regularisation of Singular Interacting Particle Systems and their Mean Field Limits. We investigate the regularizing effect of certain perturbations by noise in singular interacting particle systems in mean field scaling. In particular, we show that the addition of a suitably irregular path can regularise these dynamics and we recover the McKean Vlasov limit under very broad assumptions on the interaction kernel, only requiring it to be controlled in a possibly distributional H "older Besov space. In the particle system we include two sources of randomness, a common noise path Z which regularises the dynamics and a family of idiosyncratic noises, which we only assume to converge in mean field scaling to a representative noise in the McKean Vlasov equation.


Robot Navigation in Unseen Spaces using an Abstract Map. Human navigation in built environments depends on symbolic spatial information which has unrealised potential to enhance robot navigation capabilities. Information sources such as labels, signs, maps, planners, spoken directions, and navigational gestures communicate a wealth of spatial information to the navigators of built environments a wealth of information that robots typically ignore. We present a robot navigation system that uses the same symbolic spatial information employed by humans to purposefully navigate in unseen built environments with a level of performance comparable to humans. The navigation system uses a novel data structure called the abstract map to imagine malleable spatial models for unseen spaces from spatial symbols. Sensorimotor perceptions from a robot are then employed to provide purposeful navigation to symbolic goal locations in the unseen environment. We show how a dynamic system can be used to create malleable spatial models for the abstract map, and provide an open source implementation to encourage future work in the area of symbolic navigation. Symbolic navigation performance of humans and a robot is evaluated in a real world built environment. The paper concludes with a qualitative analysis of human navigation strategies, providing further insights into how the symbolic navigation capabilities of robots in unseen built environments can be improved in the future.


On Measuring and Mitigating Biased Inferences of Word Embeddings. Word embeddings carry stereotypical connotations from the text they are trained on, which can lead to invalid inferences in downstream models that rely on them. We use this observation to design a mechanism for measuring stereotypes using the task of natural language inference. We demonstrate a reduction in invalid inferences via bias mitigation strategies on static word embeddings (GloVe). Further, we show that for gender bias, these techniques extend to contextualized embeddings when applied selectively only to the static components of contextualized embeddings (ELMo, BERT).


Site selective and real time observation of bimolecular electron transfer during photocatalytic water splitting. Time resolved X ray absorption spectroscopy has been utilized to monitor the bimolecular electron transfer in a photocatalytic water splitting system for the first time. This has been possible by uniting the local probe and element specific character of X ray transitions with insights from high level ab initio calculations. The specific target has been a heteroleptic Ir rm III (ppy) 2 (bpy) photosensitizer, in combination with triethylamine as a sacrificial reductant and Fe 3 (CO) 12 as a water reduction catalyst. The relevant molecular transitions have been characterized via high resolution Ir L edge X ray absorption spectroscopy on the picosecond time scale. The present findings enhance our understanding of functionally relevant bimolecular electron transfer reactions and thus will pave the road to rational optimization of photocatalytic performance.


Optimal Time Trajectory and Coordination for Connected and Automated Vehicles. In this paper, we provide a decentralized theoretical framework for coordination of connected and automated vehicles (CAVs) at different traffic scenarios. The framework includes (1) an upper level optimization that yields for each CAV its optimal time trajectory and lane to pass through a given traffic scenario while alleviating congestion and (2) a low level optimization that yields for each CAV its optimal control input (acceleration deceleration). We provide a complete, analytical solution of the low level optimization problem that includes the rear end, speed dependent safety constraint. Furthermore, we provide a problem formulation for the upper level optimization in which there is no duality gap. The latter implies that the optimal time trajectory for each CAV does not activate any of the state, control, and safety constraints of the low level optimization, thus allowing for online implementation. Finally, we present a geometric duality framework with hyperplanes to derive the condition under which the optimal solution of the upper level optimization always exists. We validate the effectiveness of the proposed theoretical framework through simulation.


Topology and adjunction in promise constraint satisfaction. The approximate graph colouring problem concerns colouring a k colourable graph with c colours, where c geq k . This problem naturally generalises to promise graph homomorphism and further to promise constraint satisfaction problems. Complexity analysis of all these problems is notoriously difficult. In this paper, we introduce two new techniques to analyse the complexity of promise CSPs one is based on topology and the other on adjunction. We apply these techniques, together with the previously introduced algebraic approach, to obtain new NP hardness results for a significant class of approximate graph colouring and promise graph homomorphism problems.


Reduction in respiratory mortality not associated with influenza in Russia effect of the introduction of pneumococcal vaccination (PCV13), or improvement in care?. Background. Pneumococcal vaccination (PCV13) for children (as well as older adults) in Russia was introduced in 2014, with no prior PCV7 use. While pneumonia hospitalization rates, both in children and adults did not decrease in the following years, respiratory mortality rates did decline with time. Moreover, there is a strong association between antibiotic, including multidrug resistance and PCV13 vaccine serotypes for S. pneumoniae in children in Russia, and presence of S. pneumoniae among sepsis cases in Russia during the recent years has been very low. Annual variability in influenza circulation may affect some of the changes in respiratory mortality rates. Methods. We applied the inference method from our recent study of influenza associated mortality in Russia to relate monthly respiratory mortality rates between 09 2010 and 08 2019 to monthly indices of influenza circulation and baseline rates of mortality not associated with influenza, allowing for a potential trend in the baseline rates starting 2015. Results. Baseline rates of respiratory mortality not associated with influenza decreased with time starting from the 2014 15 season (with each season running from September to August), with the 2018 19 baseline rates of respiratory mortality per 100,000 individuals being lower by 12.41 (95 CI (10.6,14.2)) compared to the 2010 2014 period. Conclusions. While improvement in care might have contributed to the reduction in the rates of respiratory mortality not associated with influenza in Russia, the above temporally consistent reduction is compatible with the gradual replacement of vaccine serotypes in the transmission and carriage of S. pneumoniae following the introduction of PCV13. Further work is needed to better understand the impact of PCV13 on the epidemiology of respiratory infections and related mortality in Russia.


Surface tension and instability in the acoustic white hole of a circular hydraulic jump. We impose a linearized Eulerian perturbation on a steady shallow radial outflow of a liquid (water), whose local pressure function includes both the hydrostatic and the Laplace pressure terms. The resulting wave equation bears the form of an acoustic metric. A dispersion relation, extracted from the wave equation, gives an instability due to surface tension and the cylindrical flow symmetry. Using the dispersion relation, we also derive three known relations that scale the radius of the circular hydraulic jump in the outflow. The first two relations are scaled by viscosity and gravity, with a capillarity dependent crossover to the third relation, which is scaled by viscosity and surface tension. The perturbation as a high frequency travelling acoustic wave, propagating radially inward against the bulk outflow, is blocked just outside the circular hydraulic jump. The amplitude of the wave also diverges here because of a singularity. The blocking is associated with surface tension, which renders the circular hydraulic jump an acoustic white hole.


The missing pieces of the PuO 2 nanoparticle puzzle. The nanoscience field often produces results more mystifying than any other discipline. It has been argued that changes in the plutonium dioxide (PuO2) particle size from bulk to nano can have a drastic effect on PuO2 properties. Here we report a full characterization of PuO2 nanoparticles (NPs) at the atomic level and probe their local and electronic structures by a variety of methods available at the synchrotron.


Acceleration of Convolutional Neural Network Using FFT Based Split Convolutions. Convolutional neural networks (CNNs) have a large number of variables and hence suffer from a complexity problem for their implementation. Different methods and techniques have developed to alleviate the problem of CNN's complexity, such as quantization, pruning, etc. Among the different simplification methods, computation in the Fourier domain is regarded as a new paradigm for the acceleration of CNNs. Recent studies on Fast Fourier Transform (FFT) based CNN aiming at simplifying the computations required for FFT. However, there is a lot of space for working on the reduction of the computational complexity of FFT. In this paper, a new method for CNN processing in the FFT domain is proposed, which is based on input splitting. There are problems in the computation of FFT using small kernels in situations such as CNN. Splitting can be considered as an effective solution for such issues aroused by small kernels. Using splitting redundancy, such as overlap and add, is reduced and, efficiency is increased. Hardware implementation of the proposed FFT method, as well as different analyses of the complexity, are performed to demonstrate the proper performance of the proposed method.


Kreiss bounded and uniformly Kreiss bounded operators. If T is a Kreiss bounded operator on a Banach space, then T n O(n) . Forty years ago Shields conjectured that in Hilbert spaces, T n O( sqrt n ) . A negative answer to this conjecture was given by Spijker, Tracogna and Welfert in 2003. We improve their result and show that this conjecture is not true even for uniformly Kreiss bounded operators. More precisely, for every varepsilon 0 there exists a uniformly Kreiss bounded operator T on a Hilbert space such that T n sim (n 1) 1 varepsilon for all n in Bbb N . On the other hand, any Kreiss bounded operator on Hilbert spaces satisfies T n O( frac n sqrt log n ) . We also prove that the residual spectrum of a Kreiss bounded operator on a reflexive Banach space is contained in the open unit disc, extending known results for power bounded operators. As a consequence we obtain examples of mean ergodic Hilbert space operators which are not Kreiss bounded.


On metabelian galois coverings of complex algebraic varieties. Let f X to Y be a finite ramified Galois covering of algebraic varieties defined over the complex numbers. In this paper, we prove some structure theorems for such coverings in the case that the non abelian Galois group of the cover is metabelian (in particular metacyclic). Our results extend the previous ones, obtained by several authors, in the case of abelian and dihedral Galois coverings. In analogy with the abelian (and generalizing the dihedral) case, we find "building data" of metabelian covers from which the cover can be reconstructed. In addition to analyzing several examples, we compute invariants and eigensheaves of the group actions of the coverings under study with some applications.


Microlocal inversion of a 3 dimensional restricted transverse ray transform of symmetric m tensor fields. We study the problem of inverting a restricted transverse ray transform to recover a symmetric m tensor field in mathbb R 3 using microlocal analysis techniques. More precisely, we prove that a symmetric m tensor field can be recovered up to a known singular term and a smoothing term if its transverse ray transform is known along all lines intersecting a fixed smooth curve satisfying the Kirillov Tuy condition.


From the backward Kolmogorov PDE on the Wasserstein space to propagation of chaos for Mckean Vlasov SDEs. This article is a continuation of our first work cite chaudruraynal frikha . We here establish some new quantitative estimates for propagation of chaos of non linear stochastic differential equations in the sense of McKean Vlasov. We obtain explicit error estimates, at the level of the trajectories, at the level of the semi group and at the level of the densities, for the mean field approximation by systems of interacting particles under mild regularity assumptions on the coefficients. A first order expansion for the difference between the densities of one particle and its mean field limit is also established. Our analysis relies on the well posedness of classical solutions to the backward Kolmogorov partial differential equations defined on the strip 0,T times mathbb R d times mathcal P 2( mathbb R d) , mathcal P 2( mathbb R d) being the Wasserstein space, that is, the space of probability measures on mathbb R d with a finite second order moment and also on the existence and uniqueness of a fundamental solution for the related parabolic linear operator here stated on 0,T times mathcal P 2( mathbb R d) .


Nonlinear Mid infrared Metasurface based on a Phase Change Material. The mid wave infrared (MWIR) spectral region (3 5 mu m) is important to a vast variety of applications in imaging, sensing, spectroscopy, surgery, and optical communications. Efficient third harmonic generation (THG), converting light from the MWIR range into the near infrared, a region with mature optical detection and manipulation technologies, offers the opportunity to mitigate a commonly recognized limitation of current MWIR systems. In this work, we present the possibility of boosting THG in the MWIR through a metasurface design. Specifically, we demonstrate a 30 fold enhancement in a highly nonlinear phase change material Ge2Sb2Se4Te1 (GSST), by patterning arrays of subwavelength cylinders supporting a magnetic dipolar resonance. The unprecedented broadband transparency, large refractive index, and remarkably high nonlinear response, together with unique phase change properties, make GSST based metasurfaces an appealing solution for reconfigurable and ultra compact nonlinear devices operating in the MWIR.


Finite presentability of universal central extensions of mathfrak sl n , II. In this note we connect finite presentability of a Jordan algebra to finite presentability of its Tits Kantor Koecher algebra. Through this we complete our discussion of finite presentability of universal central extensions of mathfrak sl n(A) , A a k algebra, initiated in our previous paper, and answer a question raised by Shestakov Zelmanov in the positive.


Resilience Bounds of Network Clock Synchronization with Fault Correction. The Internet of Things (IoT) will be a main data generation infrastructure for achieving better system intelligence. This paper considers the design and implementation of a practical privacy preserving collaborative learning scheme, in which a curious learning coordinator trains a better machine learning model based on the data samples contributed by a number of IoT objects, while the confidentiality of the raw forms of the training data is protected against the coordinator. Existing distributed machine learning and data encryption approaches incur significant computation and communication overhead, rendering them ill suited for resource constrained IoT objects. We study an approach that applies independent random projection at each IoT object to obfuscate data and trains a deep neural network at the coordinator based on the projected data from the IoT objects. This approach introduces light computation overhead to the IoT objects and moves most workload to the coordinator that can have sufficient computing resources. Although the independent projections performed by the IoT objects address the potential collusion between the curious coordinator and some compromised IoT objects, they significantly increase the complexity of the projected data. In this paper, we leverage the superior learning capability of deep learning in capturing sophisticated patterns to maintain good learning performance. Extensive comparative evaluation shows that this approach outperforms other lightweight approaches that apply additive noisification for differential privacy and or support vector machines for learning in the applications with light to moderate data pattern complexities.


M "obius Functions of Some Annular Noncrossing Objects. We present the M " o bius functions of several posets of annular noncrossing objects, namely a self dual extension of the annular noncrossing permutations, minimal length annular partitioned permutations, and annular noncrossing partitons.


Detecting Word Sense Disambiguation Biases in Machine Translation for Model Agnostic Adversarial Attacks. Word sense disambiguation is a well known source of translation errors in NMT. We posit that some of the incorrect disambiguation choices are due to models' over reliance on dataset artifacts found in training data, specifically superficial word co occurrences, rather than a deeper understanding of the source text. We introduce a method for the prediction of disambiguation errors based on statistical data properties, demonstrating its effectiveness across several domains and model types. Moreover, we develop a simple adversarial attack strategy that minimally perturbs sentences in order to elicit disambiguation errors to further probe the robustness of translation models. Our findings indicate that disambiguation robustness varies substantially between domains and that different models trained on the same data are vulnerable to different attacks.


A Hierarchical Feature Constraint to Camouflage Medical Adversarial Attacks. Deep neural networks (DNNs) for medical images are extremely vulnerable to adversarial examples (AEs), which poses security concerns on clinical decision making. Luckily, medical AEs are also easy to detect in hierarchical feature space per our study herein. To better understand this phenomenon, we thoroughly investigate the intrinsic characteristic of medical AEs in feature space, providing both empirical evidence and theoretical explanations for the question why are medical adversarial attacks easy to detect? We first perform a stress test to reveal the vulnerability of deep representations of medical images, in contrast to natural images. We then theoretically prove that typical adversarial attacks to binary disease diagnosis network manipulate the prediction by continuously optimizing the vulnerable representations in a fixed direction, resulting in outlier features that make medical AEs easy to detect. However, this vulnerability can also be exploited to hide the AEs in the feature space. We propose a novel hierarchical feature constraint (HFC) as an add on to existing adversarial attacks, which encourages the hiding of the adversarial representation within the normal feature distribution. We evaluate the proposed method on two public medical image datasets, namely Fundoscopy and Chest X Ray . Experimental results demonstrate the superiority of our adversarial attack method as it bypasses an array of state of the art adversarial detectors more easily than competing attack methods, supporting that the great vulnerability of medical features allows an attacker more room to manipulate the adversarial representations.


Second Harmonic Generation from a Single Plasmonic Nanorod Strongly Coupled to a WSe2 Monolayer. Monolayer transition metal dichalcogenides, coupled to metal plasmonic nanocavities, have recently emerged as new platforms for strong light matter interactions. These systems are expected to have nonlinear optical properties that will enable them to be used as entangled photon sources, compact wave mixing devices, and other elements for classical and quantum photonic technologies. Here we report the first experimental investigation of the nonlinear properties of these strongly coupled systems, by observing second harmonic generation from a WSe2 monolayer strongly coupled to a single gold nanorod. The pump frequency dependence of the second harmonic signal displays a pronounced splitting that can be explained by a coupled oscillator model with second order nonlinearities. Rigorous numerical simulations utilizing a nonperturbative nonlinear hydrodynamic model of conduction electrons support this interpretation and reproduce experimental results. Our study thus lays the groundwork for understanding the nonlinear properties of strongly coupled nanoscale systems.


Exceptional Point and Toward Mode Selective Optical Isolation. Dynamical encirclement of an Exceptional Point (EP) and corresponding time asymmetric mode evolution properties due to breakdown in adiabatic theorem have been a key to range of exotic physical effects in various open atomic, molecular and optical systems. Here, exploiting a gain loss assisted dual mode optical waveguide that hosts a dynamical EP encirclement scheme, we have explored enhanced nonreciprocal effect in the dynamics of light with onset of saturable nonlinearity in the optical medium. We propose a prototype waveguide based isolation scheme with judicious tuning of nonlinearity level where one can pass only a chosen mode in any of the desired directions as per device requirement. The deliberate presence of EP enormously enhances the nonreciprocal transmission contrast even up to 40 dB over the proposed device length with a scope of further scalability. This exclusive topologically robust mode selective all optical isolation scheme will certainly offer opportunities in integrated photonic circuits for efficient coupling operation from external sources and improve device performances.


Rigidity of proper holomorphic maps between type mathrm I irreducible bounded symmetric domains. We study proper holomorphic maps between type mathrm I irreducible bounded symmetric domains. In particular, we obtain rigidity results for such maps under certain assumptions. More precisely, let f D mathrm I p,q to D mathrm I p',q' be a proper holomorphic map, where p ge q ge 2 and q' min 2q 1,p . Then, we show that p' ge p and q' ge q . Moreover, we prove that there exist automorphisms psi and Phi of D mathrm I p,q and D mathrm I p',q' respectively, such that f Phi circ G h circ psi for some map G h D mathrm I p,q to D mathrm I p',q' defined by G h(Z) begin bmatrix Z bf 0 bf 0 h(Z) end bmatrix quad forall Z in D mathrm I p,q , where h D mathrm I p,q to D mathrm I p' p,q' q is a holomorphic map.


A New Efficient Methodology for AC Transmission Network Expansion Planning in The Presence of Uncertainties. Consideration of generation, load and network uncertainties in modern transmission network expansion planning (TNEP) is gaining interest due to large scale integration of renewable energy sources with the existing grid. However, it is a formidable task when iterative AC formulation is used. Computational burden for solving the usual ACTNEP with these uncertainties is such that, it is almost impossible to obtain a solution even for a medium sized system within a viable time frame. In this work, a two stage solution methodology is proposed to obtain quick, good quality, sub optimal solutions with reasonable computational burden. Probabilistic formulation is used to account for the different uncertainties. Probabilistic TNEP is solved by 2m 1 point estimate method along with a modified artificial bee colony (MABC) algorithm, for Garver 6 bus and IEEE 24 bus systems. In both the systems, rated wind generation is considered to be more than one tenth of the total generation capacity. When compared with the conventional single stage and existing solution methods, the proposed methodology is able to obtain almost identical solutions with extremely low computational burdens. Therefore, the proposed method provides a tool for efficient solution of future probabilistic ACTNEP problems with greater level of complexity.


Deforming the Loss Surface. In deep learning, it is usually assumed that the shape of the loss surface is fixed. Differently, a novel concept of deformation operator is first proposed in this paper to deform the loss surface, thereby improving the optimization. Deformation function, as a type of deformation operator, can improve the generalization performance. Moreover, various deformation functions are designed, and their contributions to the loss surface are further provided. Then, the original stochastic gradient descent optimizer is theoretically proved to be a flat minima filter that owns the talent to filter out the sharp minima. Furthermore, the flatter minima could be obtained by exploiting the proposed deformation functions, which is verified on CIFAR 100, with visualizations of loss landscapes near the critical points obtained by both the original optimizer and optimizer enhanced by deformation functions. The experimental results show that deformation functions do find flatter regions. Moreover, on ImageNet, CIFAR 10, and CIFAR 100, popular convolutional neural networks enhanced by deformation functions are compared with the corresponding original models, where significant improvements are observed on all of the involved models equipped with deformation functions. For example, the top 1 test accuracy of ResNet 20 on CIFAR 100 increases by 1.46 , with insignificant additional computational overhead.


On Legendrian products and twist spuns. The Legendrian product of two Legendrian knots, as defined by Lambert Cole, is a Legendrian torus. We show that this Legendrian torus is a twist spun whenever one of the Legendrian knot components is sufficiently large. We then study examples of Legendrian products which are not Legendrian isotopic to twist spuns. In order to do this, we prove a few structural results on the bilinearised Legendrian contact homology and augmentation variety of a twist spun. In addition, we show that the threefold Bohr Sommerfeld covers of the Clifford torus and Chekanov torus are not twist spuns.


On More General Distributions of Random Binning for Slepian Wolf Encoding. Traditionally, ensembles of Slepian Wolf (SW) codes are defined such that every bin of each n vector of each source is randomly drawn under the uniform distribution across the sets 0,1, ldots,2 nR X 1 and 0,1, ldots,2 nR Y 1 , where R X and R Y are the coding rates of the two sources, X and Y , respectively. In a few more recent works, where only one source, say, X , is compressed and the other one, Y , serves as side information available at the decoder, the scope is extended to variable rate S W (VRSW) codes, where the rate is allowed to depend on the type class of the source string, but still, the random binning distribution is assumed uniform within the corresponding, type dependent, bin index set. In this expository work, we investigate the role of the uniformity of the random binning distribution from the perspective of the trade off between the reliability (defined in terms of the error exponent) and the compression performance (measured from the viewpoint of the source coding exponent). To this end, we study a much wider class of random binning distributions, which includes the ensemble of VRSW codes as a special case, but it also goes considerably beyond. We first show that, with the exception of some pathological cases, the smaller ensemble, of VRSW codes, is as good as the larger ensemble in terms the trade off between the error exponent and the source coding exponent. Notwithstanding this finding, the wider class of ensembles proposed is motivated in two ways. The first is that it outperforms VRSW codes in the above mentioned pathological cases, and the second is that it allows robustness in the event of a system failure that causes unavailability of the compressed bit stream from one of the sources, it still allows reconstruction of the other source within some controllable distortion.


Asymptotics for stochastic Burgers equation with jumps. For one dimensional stochastic Burgers equation driven by Brownian motion and Poisson process, we study the psi uniformly exponential ergodicity with psi(x) 1 x , the moderate deviation principle and the large deviation principle for the occupation measures.


A Deep Neural Framework for Contextual Affect Detection. A short and simple text carrying no emotion can represent some strong emotions when reading along with its context, i.e., the same sentence can express extreme anger as well as happiness depending on its context. In this paper, we propose a Contextual Affect Detection (CAD) framework which learns the inter dependence of words in a sentence, and at the same time the inter dependence of sentences in a dialogue. Our proposed CAD framework is based on a Gated Recurrent Unit (GRU), which is further assisted by contextual word embeddings and other diverse hand crafted feature sets. Evaluation and analysis suggest that our model outperforms the state of the art methods by 5.49 and 9.14 on Friends and EmotionPush dataset, respectively.


Optimal dual quantizers of 1D log concave distributions uniqueness and Lloyd like algorithm. We establish for dual quantization the counterpart of Kieffer's uniqueness result for compactly supported one dimensional probability distributions having a log concave density (also called strongly unimodal) for such distributions, L r optimal dual quantizers are unique at each level N , the optimal grid being the unique critical point of the quantization error. An example of non strongly unimodal distribution for which uniqueness of critical points fails is exhibited. In the quadratic r 2 case, we propose an algorithm to compute the unique optimal dual quantizer. It provides a counterpart of Lloyd's method I algorithm in a Voronoi framework. Finally semi closed forms of L r optimal dual quantizers are established for power distributions on compacts intervals and truncated exponential distributions.


Complexity and Algorithms for Exploiting Quantal Opponents in Large Two Player Games. Solution concepts of traditional game theory assume entirely rational players therefore, their ability to exploit subrational opponents is limited. One type of subrationality that describes human behavior well is the quantal response. While there exist algorithms for computing solutions against quantal opponents, they either do not scale or may provide strategies that are even worse than the entirely rational Nash strategies. This paper aims to analyze and propose scalable algorithms for computing effective and robust strategies against a quantal opponent in normal form and extensive form games. Our contributions are (1) we define two different solution concepts related to exploiting quantal opponents and analyze their properties (2) we prove that computing these solutions is computationally hard (3) therefore, we evaluate several heuristic approximations based on scalable counterfactual regret minimization (CFR) and (4) we identify a CFR variant that exploits the bounded opponents better than the previously used variants while being less exploitable by the worst case perfectly rational opponent.


An acceleration of decentralized SGD under general assumptions with low stochastic noise. Distributed optimization methods are actively researched by optimization community. Due to applications in distributed machine learning, modern research directions include stochastic objectives, reducing communication frequency, and time varying communication network topology. Recently, an analysis unifying several centralized and decentralized approaches to stochastic distributed optimization was developed in Koloskova et al. (2020). In this work, we employ a Catalyst framework and accelerate the rates of Koloskova et al. (2020) in the case of low stochastic noise.


MERANet Facial Micro Expression Recognition using 3D Residual Attention Network. Micro expression has emerged as a promising modality in affective computing due to its high objectivity in emotion detection. Despite the higher recognition accuracy provided by the deep learning models, there are still significant scope for improvements in micro expression recognition techniques. The presence of micro expressions in small local regions of the face, as well as the limited size of available databases, continue to limit the accuracy in recognizing micro expressions. In this work, we propose a facial micro expression recognition model using 3D residual attention network named MERANet to tackle such challenges. The proposed model takes advantage of spatial temporal attention and channel attention together, to learn deeper fine grained subtle features for classification of emotions. Further, the proposed model encompasses both spatial and temporal information simultaneously using the 3D kernels and residual connections. Moreover, the channel features and spatio temporal features are re calibrated using the channel and spatio temporal attentions, respectively in each residual module. Our attention mechanism enables the model to learn to focus on different facial areas of interest. The experiments are conducted on benchmark facial micro expression datasets. A superior performance is observed as compared to the state of the art for facial micro expression recognition on benchmark data.


Optimal Load Balanced Demand Distribution under Overload Penalties. Input to the Load Balanced Demand Distribution (LBDD) consists of the following (a) a set of service centers (b) a set of demand nodes and (c) a cost matrix containing the cost of assignment for each (demand node, service center) pair. In addition, each service center is also associated with a notion of capacity and a penalty which is incurred if it gets overloaded. Given the input, the LBDD problem determines a mapping from the set of n demand vertices to the set of k service centers, n being much larger than k. The objective is to determine a mapping that minimizes the sum of the following two terms (i) the total cost between demand units and their allotted service centers and, (ii) total penalties incurred. The problem of LBDD has a variety of applications. An instance of the LBDD problem can be reduced to an instance of the min cost bi partite matching problem. The best known algorithm for min cost matching in an unbalanced bipartite graph yields a complexity of O( n 3k ). This paper proposes novel allotment subspace re adjustment based approach which allows us to characterize the optimality of the mapping without invoking matching or mincost flow. This approach yields an optimal solution with time complexity O(nk 3 nk 2 log n) , and also allows us to efficiently maintain an optimal allotment under insertions and deletions.


Joint optimization of train blocking and shipment path An integrated model and a sequential algorithm. The INFORMS RAS 2019 Problem Solving Competition is focused on the integrated train blocking and shipment path (TBSP) optimization for tonnage based operating railways. In nature, the TBSP problem could be viewed as a multi commodity network design problem with a double layer network structure. By introducing a directed physical railway network and a directed train services (blocks) network, we formulate completely the TBSP problem as a mixed integer linear programming (MILP) model that incorporates all decisions, objectives and constraints especially the merge flow (called intree rule here) in an integrated manner. The scale of the MILP model can be reduced efficiently if we only enumerate the arc selection and block sequence variables for each shipment on the legal paths from its origin to its destination satisfying the given detour ratio. We further develop a sequential algorithm that decomposes the TBSP problem into the shipment path subproblem and train blocking subproblem which are solved sequentially. Computational tests on the three given data sets show that the reduced MILP model can solve DataSet 1 to optimality in 8.48 seconds and DataSet 2 with a gap of 0.16 in 6 hours on a GPU workstation. The reduced model also can provide strong lower bounds for DataSet 2 and DataSet 3. The sequential algorithm can find a high quality solution with 0.04 gap within 0.26 seconds for DataSet 1, 0.42 gap within 4.53 seconds for DataSet 2 and 1.54 gap within 0.58 hours for DataSet 3 respectively on a Thinkpad laptop.


Application of Transformation Optics for the Purpose of Cloaking. The advent of transformation optics has lead to the initiation of designing devices and applications associated to electromagnetic wave propagation in anisotropic media. Here, a method is suggested using a coordinate transformation with spherical coordinates for the purpose of designing a three dimensional cloak for a body having an arbitrary convex geometry. For the purpose of verification of the algorithm, a ray tracing process is carried out for an ellipsoid having axial symmetry.


Learning to Interactively Learn and Assist. When deploying autonomous agents in the real world, we need effective ways of communicating objectives to them. Traditional skill learning has revolved around reinforcement and imitation learning, each with rigid constraints on the format of information exchanged between the human and the agent. While scalar rewards carry little information, demonstrations require significant effort to provide and may carry more information than is necessary. Furthermore, rewards and demonstrations are often defined and collected before training begins, when the human is most uncertain about what information would help the agent. In contrast, when humans communicate objectives with each other, they make use of a large vocabulary of informative behaviors, including non verbal communication, and often communicate throughout learning, responding to observed behavior. In this way, humans communicate intent with minimal effort. In this paper, we propose such interactive learning as an alternative to reward or demonstration driven learning. To accomplish this, we introduce a multi agent training framework that enables an agent to learn from another agent who knows the current task. Through a series of experiments, we demonstrate the emergence of a variety of interactive learning behaviors, including information sharing, information seeking, and question answering. Most importantly, we find that our approach produces an agent that is capable of learning interactively from a human user, without a set of explicit demonstrations or a reward function, and achieving significantly better performance cooperatively with a human than a human performing the task alone.


Intel Page Modification Logging, a hardware virtualization feature study and improvement for virtual machine working set estimation. Intel Page Modification Logging (PML) is a novel hardware feature for tracking virtual machine (VM) accessed memory pages. This task is essential in today's data centers since it allows, among others, checkpointing, live migration and working set size (WSS) estimation. Relying on the Xen hypervisor, this paper studies PML from three angles power consumption, efficiency, and performance impact on user applications. Our findings are as follows. First, PML does not incur any power consumption overhead. Second, PML reduces by up to 10.18 both VM live migration and checkpointing time. Third, PML slightly reduces by up to 0.95 the performance degradation on applications incurred by live migration and checkpointing. Fourth, PML however does not allow accurate WSS estimation because read accesses are not tracked and hot pages cannot be identified. A naive extension of PML for addressing these limitations could lead to severe performance degradation (up to 34.8 ) for the VM whose WSS is computed. This paper presents Page Reference Logging (PRL), a smart extension of PML for allowing both read and write accesses to be tracked. It does this without impacting user VMs. The paper also presents a WSS estimation system which leverages PRL and shows how this algorithm can be integrated into a data center which implements memory overcommitment. We implement PRL and the WSS estimation system under Gem5, a very popular hardware simulator. The evaluation results validate the accuracy of PRL in the estimation of WSS. They also show that PRL incurs no performance degradation for user VMs.


The Shmoop Corpus A Dataset of Stories with Loosely Aligned Summaries. Understanding stories is a challenging reading comprehension problem for machines as it requires reading a large volume of text and following long range dependencies. In this paper, we introduce the Shmoop Corpus a dataset of 231 stories that are paired with detailed multi paragraph summaries for each individual chapter (7,234 chapters), where the summary is chronologically aligned with respect to the story chapter. From the corpus, we construct a set of common NLP tasks, including Cloze form question answering and a simplified form of abstractive summarization, as benchmarks for reading comprehension on stories. We then show that the chronological alignment provides a strong supervisory signal that learning based methods can exploit leading to significant improvements on these tasks. We believe that the unique structure of this corpus provides an important foothold towards making machine story comprehension more approachable.


A Random Growth Model with any Real or Theoretical Degree Distribution. The degree distributions of complex networks are usually considered to be power law. However, it is not the case for a large number of them. We thus propose a new model able to build random growing networks with (almost) any wanted degree distribution. The degree distribution can either be theoretical or extracted from a real world network. The main idea is to invert the recurrence equation commonly used to compute the degree distribution in order to find a convenient attachment function for node connections commonly chosen as linear. We compute this attachment function for some classical distributions, as the power law, broken power law, geometric and Poisson distributions. We also use the model on an undirected version of the Twitter network, for which the degree distribution has an unusual shape. We finally show that the divergence of chosen attachment functions is heavily links to the heavy tailed property of the obtained degree distributions.


Generalisations of Capparelli's and Primc's identities, II perfect A n 1 (1) crystals and explicit character formulas. In the first paper of this series, we gave infinite families of coloured partition identities which generalise Primc's and Capparelli's classical identities. In this second paper, we study the representation theoretic consequences of our combinatorial results. First, we show that the difference conditions we defined in our n 2 coloured generalisation of Primc's identity, which have a very simple expression, are actually the energy function with values in 0,1,2 for the perfect crystal of the tensor product of the vector representation and its dual in A n 1 (1) . Then we introduce a new type of partitions, grounded partitions, which allows us to retrieve connections between character formulas and partition generating functions without having to perform a specialisation. Finally, using the formulas for the generating functions of our generalised partitions, we recover the Kac Peterson character formula for the characters of all the irreducible highest weight A n 1 (1) modules of level 1 , and give a new character formula as a sum of infinite products with obviously positive coefficients in the generators e alpha i (i in 0, dots , n 1 ), where the alpha i 's are the simple roots.


Correlation transfer by layer 5 cortical neurons under recreated synaptic inputs in vitro. Correlated electrical activity in neurons is a prominent characteristic of cortical microcircuits. Despite a growing amount of evidence concerning both spike count and subthreshold membrane potential pairwise correlations, little is known about how different types of cortical neurons convert correlated inputs into correlated outputs. We studied pyramidal neurons and two classes of GABAergic interneurons of layer 5 in neocortical brain slices obtained from rats of both sexes, and we stimulated them with biophysically realistic correlated inputs, generated using dynamic clamp. We found that the physiological differences between cell types manifested unique features in their capacity to transfer correlated inputs. We used linear response theory and computational modeling to gain clear insights into how cellular properties determine both the gain and timescale of correlation transfer, thus tying single cell features with network interactions. Our results provide further ground for the functionally distinct roles played by various types of neuronal cells in the cortical microcircuit.