PubSqueezer A Text Mining Web Tool to Transform Unstructured Documents into Structured Data. The amount of scientific papers published every day is daunting and constantly increasing. Keeping up with literature represents a challenge. If one wants to start exploring new topics it is hard to have a big picture without reading lots of articles. Furthermore, as one reads through literature, making mental connections is crucial to ask new questions which might lead to discoveries. In this work, I present a web tool which uses a Text Mining strategy to transform large collections of unstructured biomedical articles into structured data. Generated results give a quick overview on complex topics which can possibly suggest not explicitly reported information. In particular, I show two Data Science analyses. First, I present a literature based rare diseases network build using this tool in the hope that it will help clarify some aspects of these less popular pathologies. Secondly, I show how a literature based analysis conducted with PubSqueezer results allows to describe known facts about SARS CoV 2. In one sentence, data generated with PubSqueezer make it easy to use scientific literate in any computational analysis such as machine learning, natural language processing etc. Availability http www.pubsqueezer.com


Fault Diagnosing SLAM for Varying Scale Change Detection. In this paper, we present a new fault diagnosis (FD) based approach for detection of imagery changes that can detect significant changes as inconsistencies between different sub modules (e.g., self localizaiton) of visual SLAM. Unlike classical change detection approaches such as pairwise image comparison (PC) and anomaly detection (AD), neither the memorization of each map image nor the maintenance of up to date place specific anomaly detectors are required in this FD approach. A significant challenge that is encountered when incorporating different SLAM sub modules into FD involves dealing with the varying scales of objects that have changed (e.g., the appearance of small dangerous obstacles on the floor). To address this issue, we reconsider the bag of words (BoW) image representation, by exploiting its recent advances in terms of self localization and change detection. As a key advantage, BoW image representation can be reorganized into any different scaling by simply cropping the original BoW image. Furthermore, we propose to combine different self localization modules with strong and weak BoW features with different discriminativity, and to treat inconsistency between strong and weak self localization as an indicator of change. The efficacy of the proposed approach for FD with without AD and or PC was experimentally validated.


Instability of social network dynamics with stubborn links. This paper studies the signed networks in the presence of stubborn links, based on the structural balance theory. Each agent in the network has a mixture of positive and negative links represent friendly and antagonistic interactions and his stubbornness about interactions. Structural balance theory affirms that in signed social networks with simultaneous friendly hostile interactions, there is a general tendency of evolving over time to reduce the tensions. From this perspective, individuals iteratively invert their own sentiments to reduce the felt tensions induced by imbalance. In this paper, we investigate the consequences of the agents' stubbornness on their interactions. We define stubbornness as an extreme antagonistic interaction which is resistant to change. In the current paper, we investigated if the presence of stubborn links renders an impact on the balance state of the network and whether or not the degree of balance in a signed network depends on the location of stubborn links. Our results show that a poorly balanced configuration consists of multiple antagonistic groups. Both analytical and simulation results demonstrate that the global level of balance of the network is more influenced by the locations of stubborn links in the resulting network topology than by the fraction of stubborn links. This means that even with a large fraction of stubborn links the network would evolve towards a balanced state. On the other hand, if a small fraction of stubborn links are clustered in five stubborn communities, the network evolves to an unbalanced state.


On Analysis of the Bitcoin and Prism Backbone Protocols. Bitcoin is a peer to peer payment system proposed by Nakamoto in 2008. Properties of the bitcoin backbone protocol have been investigated in some depth the blockchain growth property quantifies the number of blocks added to the blockchain during any time intervals the blockchain quality property ensures the honest miners always contribute at least a certain fraction of the blockchain the common prefix property ensures if a block is deep enough, it will eventually be adopted by all honest miners with high probability. Following the spirit of decoupling various functionalities of the blockchain, the Prism protocol is proposed to dramatically improve the throughput while maintaining the same level of security. Prior analyses of the bitcoin and Prism backbone protocols assume the lifespan of blockchain is finite. This paper presents a streamlined and strengthened analysis without the finite horizon assumption. Specifically, the results include a blockchain growth property, a blockchain quality property, and a common prefix property of the bitcoin backbone protocol, as well as the liveness and persistence of the Prism backbone protocol regardless of whether the blockchains have a infinite lifespan. We also express the properties of bitcoin and Prism backbone protocols in explicit expressions rather than order optimal results, which lead to tighter bounds and practical references for public transaction ledger protocol design.


Charting Coordination Needs in Large Scale Agile Organisationswith Boundary Objects and Methodological Islands. Large scale system development companies are increasingly adopting agile methods. While this adoption may improve lead times, such companies need to balance two trade offs (i) the need to have a uniform, consistent development method on system level with the need for specialised methods for teams in different disciplines(e.g., hardware, software, mechanics, sales, support) (ii) the need for comprehensive documentation on system level with the need to have lightweight documentation enabling iterative and agile work. With specialised methods for teams, isolated teams work within larger ecosystems of plan driven culture, i.e., teams become agile "islands". At the boundaries, these teams share knowledge which needs to be managed well for a correct system to be developed. While it is useful to support diverse and specialised methods, it is important to understand which islands are repeatedly encountered, the reasons or factors triggering their existence, and how best to handle coordination between them. Based on a multiple case study, this work presents a catalogue of islands and the boundary objects between them. We believe this work will be beneficial to practitioners aiming to understand their ecosystems and researchers addressing communication and coordination challenges in large scale development.


A dichotomy for subsymmetric basic sequences with applications to Garling spaces. Our aim in this article is to contribute to the study of the structure of subsymmetric basic sequences in Banach spaces (even, more generally, in quasi Banach spaces). For that we introduce the notion of positioning and develop new tools which lead to a dichotomy theorem that holds for general spaces with subsymmetric bases. As an illustration of how to use this dichotomy theorem we obtain the classification of all subsymmetric sequences in certain types of spaces. To be more specific, we show that Garling sequence spaces have a unique symmetric basic sequence but no symmetric basis and that these spaces have a continuum of subsymmetric basic sequences.


ROOT I O compression algorithms and their performance impact within Run 3. The LHCs Run3 will push the envelope on data intensive workflows and, since at the lowest level this data is managed using the ROOT software framework, preparations for managing this data are starting already. At the beginning of LHC Run 1, all ROOT data was compressed with the ZLIB algorithm since then, ROOT has added support for additional algorithms such as LZMA and LZ4, each with unique strengths. This work must continue as industry introduces new techniques ROOT can benefit saving disk space or reducing the I O and bandwidth for online and offline needs of experiments by introducing better compression algorithms. In addition to alternate algorithms, we have been exploring alternate techniques to improve parallelism and apply pre conditioners to the serialized data. We have performed a survey of the performance of the new compression techniques. Our survey includes various use cases of data compression of ROOT files provided by different LHC experiments. We also provide insight into solutions applied to resolve bottlenecks in compression algorithms, resulting in improved ROOT performance.


ZPD Teaching Strategies for Deep Reinforcement Learning from Demonstrations. Learning from demonstrations is a popular tool for accelerating and reducing the exploration requirements of reinforcement learning. When providing expert demonstrations to human students, we know that the demonstrations must fall within a particular range of difficulties called the "Zone of Proximal Development (ZPD)". If they are too easy the student learns nothing, but if they are too difficult the student is unable to follow along. This raises the question Given a set of potential demonstrators, which among them is best suited for teaching any particular learner? Prior work, such as the popular Deep Q learning from Demonstrations (DQfD) algorithm has generally focused on single demonstrators. In this work we consider the problem of choosing among multiple demonstrators of varying skill levels. Our results align with intuition from human learners it is not always the best policy to draw demonstrations from the best performing demonstrator (in terms of reward). We show that careful selection of teaching strategies can result in sample efficiency gains in the learner's environment across nine Atari games


Operationalizing the Legal Principle of Data Minimization for Personalization. Article 5(1)(c) of the European Union's General Data Protection Regulation (GDPR) requires that "personal data shall be ... adequate, relevant, and limited to what is necessary in relation to the purposes for which they are processed ( data minimisation')". To date, the legal and computational definitions of purpose limitation' and data minimization' remain largely unclear. In particular, the interpretation of these principles is an open issue for information access systems that optimize for user experience through personalization and do not strictly require personal data collection for the delivery of basic service. In this paper, we identify a lack of a homogeneous interpretation of the data minimization principle and explore two operational definitions applicable in the context of personalization. The focus of our empirical study in the domain of recommender systems is on providing foundational insights about the (i) feasibility of different data minimization definitions, (ii) robustness of different recommendation algorithms to minimization, and (iii) performance of different minimization strategies.We find that the performance decrease incurred by data minimization might not be substantial, but that it might disparately impact different users a finding which has implications for the viability of different formal minimization definitions. Overall, our analysis uncovers the complexities of the data minimization problem in the context of personalization and maps the remaining computational and regulatory challenges.


ASP(AC) Answer Set Programming with Algebraic Constraints. Weighted Logic is a powerful tool for the specification of calculations over semirings that depend on qualitative information. Using a novel combination of Weighted Logic and Here and There (HT) Logic, in which this dependence is based on intuitionistic grounds, we introduce Answer Set Programming with Algebraic Constraints (ASP(AC)), where rules may contain constraints that compare semiring values to weighted formula evaluations. Such constraints provide streamlined access to a manifold of constructs available in ASP, like aggregates, choice constraints, and arithmetic operators. They extend some of them and provide a generic framework for defining programs with algebraic computation, which can be fruitfully used e.g. for provenance semantics of datalog programs. While undecidable in general, expressive fragments of ASP(AC) can be exploited for effective problem solving in a rich framework. This work is under consideration for acceptance in Theory and Practice of Logic Programming.


Torsion functions and the Cheeger problem a fractional approach. Let Omega be a Lipschitz bounded domain of mathbb R N , N geq2 . The fractional Cheeger constant h s ( Omega) , 0 s 1 , is defined by h s( Omega) inf E subset Omega frac P s(E) E , text where P s (E) int mathbb R N int mathbb R N frac chi E (x) chi E (y) x y N s dx dy, with chi E denoting the characteristic function of the smooth subdomain E . The main purpose of this paper is to show that lim p rightarrow1 left phi p s right L infty ( Omega) 1 p h s ( Omega) lim p rightarrow1 left phi p s right L 1( Omega) 1 p , where phi p s is the fractional (s,p) torsion function of Omega , that is, the solution of the Dirichlet problem for the fractional p Laplacian ( Delta) p s ,u 1 in Omega , u 0 in mathbb R N setminus Omega . For this, we derive suitable bounds for the first eigenvalue lambda 1,p s( Omega) of the fractional p Laplacian operator in terms of phi p s . We also show that phi p s minimizes the (s,p) Gagliardo seminorm in mathbb R N , among the functions normalized by the L 1 norm.


Integrating Prior Knowledge in Mixed Initiative Social Network Clustering. We propose a new approach called PK clustering to help social scientists create meaningful clusters in social networks. Many clustering algorithms exist but most social scientists find them difficult to understand, and tools do not provide any guidance to choose algorithms, or to evaluate results taking into account the prior knowledge of the scientists. Our work introduces a new clustering approach and a visual analytics user interface that address this issue. It is based on a process that 1) captures the prior knowledge of the scientists as a set of incomplete clusters, 2) runs multiple clustering algorithms (similarly to clustering ensemble methods), 3) visualizes the results of all the algorithms ranked and summarized by how well each algorithm matches the prior knowledge, 4) evaluates the consensus between user selected algorithms, and 5) allows users to review details and iteratively update the acquired knowledge. We describe our approach using an initial functional prototype, then provide two examples of use and early feedback from social scientists. We believe our clustering approach offers a novel constructive method to iteratively build knowledge while avoiding being overly influenced by the results of often randomly selected black box clustering algorithms.


Deep neural network approximations for Monte Carlo algorithms. Recently, it has been proposed in the literature to employ deep neural networks (DNNs) together with stochastic gradient descent methods to approximate solutions of PDEs. There are also a few results in the literature which prove that DNNs can approximate solutions of certain PDEs without the curse of dimensionality in the sense that the number of real parameters used to describe the DNN grows at most polynomially both in the PDE dimension and the reciprocal of the prescribed approximation accuracy. One key argument in most of these results is, first, to use a Monte Carlo approximation scheme which can approximate the solution of the PDE under consideration at a fixed space time point without the curse of dimensionality and, thereafter, to prove that DNNs are flexible enough to mimic the behaviour of the used approximation scheme. Having this in mind, one could aim for a general abstract result which shows under suitable assumptions that if a certain function can be approximated by any kind of (Monte Carlo) approximation scheme without the curse of dimensionality, then this function can also be approximated with DNNs without the curse of dimensionality. It is a key contribution of this article to make a first step towards this direction. In particular, the main result of this paper, essentially, shows that if a function can be approximated by means of some suitable discrete approximation scheme without the curse of dimensionality and if there exist DNNs which satisfy certain regularity properties and which approximate this discrete approximation scheme without the curse of dimensionality, then the function itself can also be approximated with DNNs without the curse of dimensionality. As an application of this result we establish that solutions of suitable Kolmogorov PDEs can be approximated with DNNs without the curse of dimensionality.


Universal Lossless Compression of Graphical Data. Graphical data is comprised of a graph with marks on its edges and vertices. The mark indicates the value of some attribute associated to the respective edge or vertex. Examples of such data arise in social networks, molecular and systems biology, and web graphs, as well as in several other application areas. Our goal is to design schemes that can efficiently compress such graphical data without making assumptions about its stochastic properties. Namely, we wish to develop a universal compression algorithm for graphical data sources. To formalize this goal, we employ the framework of local weak convergence, also called the objective method, which provides a technique to think of a marked graph as a kind of stationary stochastic processes, stationary with respect to movement between vertices of the graph. In recent work, we have generalized a notion of entropy for unmarked graphs in this framework, due to Bordenave and Caputo, to the case of marked graphs. We use this notion to evaluate the efficiency of a compression scheme. The lossless compression scheme we propose in this paper is then proved to be universally optimal in a precise technical sense. It is also capable of performing local data queries in the compressed form.


Global mild solutions to three dimensional magnetohydrodynamic system in Morrey spaces. In this article, the Cauchy problem of three dimensional (3 D) incompressible magnetohydrodynamic system was investigated. If the initial mathcal M 1,1 norms of the vorticity omega and the current density j are both sufficiently small, then some uniform estimates with respect to time for the coupling terms between the fluid and the magnetic field can be established, which lead to a global in time well posedness of mild solutions in Morrey spaces via some effective arguments.


Impurity temperature screening in stellarators close to quasisymmetry. Impurity temperature screening is a favorable neoclassical phenomenon involving an outward radial flux of impurity ions from the core of fusion devices. Quasisymmetric magnetic fields are intrinsically ambipolar and give rise to temperature screening for low enough eta 1 equiv d ln n d ln T . In contrast, neoclassical fluxes in generic stellarators will depend on the radial electric field, which is predicted to be inward for ion root plasmas, potentially leading to impurity accumulation. Here we examine the impurity particle flux in a number of approximately quasisymmetric stellarator configurations and parameter regimes while varying the amount of symmetry breaking in the magnetic field. The amount of symmetry breaking (from perfect quasisymmetry) required to lose temperature screening is dependent on the particular configuration and flux surface. Neoclassical fluxes have been obtained using the SFINCS drift kinetic equation solver with the electrostatic potential Phi Phi( psi) , where psi is a flux surface label. Results indicate that achieving temperature screening is possible, but unlikely, at reactor relevant conditions in the core. Thus, the small departures from symmetry in nominally quasisymmetric stellarators are large enough to significantly alter the neoclassical impurity transport. A further look at these fluxes when compared to a gyro Bohm turbulence estimate suggests that neoclassical fluxes are small in optimized configurations compared to turbulent fluxes. Therefore, although neoclassical impurity accumulation is expected in most situations, the strength of the turbulence may render this irrelevant.


On families of 13 congruent elliptic curves. We compute twists of the modular curve X(13) that parametrise the elliptic curves 13 congruent to a given elliptic curve. Searching for rational points on these twists enables us to find non trivial pairs of 13 congruent elliptic curves over mathbb Q , i.e. pairs of non isogenous elliptic curves over mathbb Q whose 13 torsion subgroups are isomorphic as Galois modules. We also find equations for the surfaces parametrising pairs of 13 congruent elliptic curves. There are two such surfaces, corresponding to 13 congruences that do, or do not, respect the Weil pairing. We write each as a double cover of the projective plane ramified over a highly singular model for Baran's modular curve of level 13. By finding suitable rational curves on these surfaces, we show that there are infinitely many non trivial pairs of 13 congruent elliptic curves over mathbb Q .


Towards Distributed Logic Programming based on Computability Logic. em Computability logic (CoL) is a powerful computational model which views computational problems as games played by a machine and its environment. It uses formulas to represent computational problems. In this paper, we show that CoL naturally supports multiagent programming models with distributed control. To be specific, we discuss a web based implemention of a distributed logic programming model based on CoL (CL1 to be exact).


The feasible region of hypergraphs. Let mathcal F be a family of r uniform hypergraphs. The feasible region Omega( mathcal F ) of mathcal F is the set of points (x,y) in the unit square such that there exists a sequence of mathcal F free r uniform hypergraphs whose edge density approaches x and whose shadow density approaches y . The feasible region provides a lot of combinatorial information, for example, the supremum of y over all (x,y) in Omega( mathcal F ) is the Tur ' a n density pi( mathcal F ) , and Omega( emptyset) gives the Kruskal Katona theorem. We undertake a systematic study of Omega( mathcal F ) , and prove that Omega( mathcal F ) is completely determined by a left continuous almost everywhere differentiable function and moreover, there exists an mathcal F for which this function is not continuous. We also extend some old related theorems. For example, we generalize a result of Fisher and Ryan to hypergraphs and extend a classical result of Bollob 'as by almost completely determining the feasible region for cancellative triple systems.


A degree associated to linear eigenvalue problems in Hilbert spaces and applications to nonlinear spectral theory. We extend to the infinite dimensional context the link between two completely different topics recently highlighted by the authors the classical eigenvalue problem for real square matrices and the Brouwer degree for maps between oriented finite dimensional real manifolds. Thanks to this extension, we solve a conjecture regarding global continuation in nonlinear spectral theory that we have formulated in a recent article. Our result (the ex conjecture) is applied to prove a Rabinowitz type global continuation property of the solutions to a perturbed motion equation containing an air resistance frictional force.


Compactification of the group of rigid motions and applications to robotics. We introduce a compactification of the group of rigid motions in 3 space derived from the Study model for this group. We use this compactifi cation in robot kinematics, by considering the boundary of the configuration space of a robot. We study in particular the degeneration of the direct kine matic problem for some parallel robots with three degrees of freedom.


A Submatrix Based Method for Approximate Matrix Function Evaluation in the Quantum Chemistry Code CP2K. Electronic structure calculations based on density functional theory (DFT) represent a significant part of today's HPC workloads and pose high demands on high performance computing resources. To perform these quantum mechanical DFT calculations on complex large scale systems, so called linear scaling methods instead of conventional cubic scaling methods are required. In this work, we take up the idea of the submatrix method and apply it to the DFT computations in the software package CP2K. For that purpose, we transform the underlying numeric operations on distributed, large, sparse matrices into computations on local, much smaller and nearly dense matrices. This allows us to exploit the full floating point performance of modern CPUs and to make use of dedicated accelerator hardware, where performance has been limited by memory bandwidth before. We demonstrate both functionality and performance of our implementation and show how it can be accelerated with GPUs and FPGAs.


The Hamilton Jacobi Equation an intuitive approach. The Hamilton Jacobi equation (HJE) is one of the most elegant approach to Lagrangian systems such as geometrical optics and classical mechanics, establishing the duality between trajectories and waves and paving the way naturally for the quantum mechanics. Usually, this formalism is taught at the end of a course on analytical mechanics through its technical aspects and its relation to canonical transformations. I propose that the teaching of this subject be centered on this duality along the lines proposed here, and the canonical transformations be taught only after some familiarity with the HJE has been gained by the students.


Predicting Actions to Help Predict Translations. We address the task of text translation on the How2 dataset using a state of the art transformer based multimodal approach. The question we ask ourselves is whether visual features can support the translation process, in particular, given that this is a dataset extracted from videos, we focus on the translation of actions, which we believe are poorly captured in current static image text datasets currently used for multimodal translation. For that purpose, we extract different types of action features from the videos and carefully investigate how helpful this visual information is by testing whether it can increase translation quality when used in conjunction with (i) the original text and (ii) the original text where action related words (or all verbs) are masked out. The latter is a simulation that helps us assess the utility of the image in cases where the text does not provide enough context about the action, or in the presence of noise in the input text.


Movie Summarization via Sparse Graph Construction. We summarize full length movies by creating shorter videos containing their most informative scenes. We explore the hypothesis that a summary can be created by assembling scenes which are turning points (TPs), i.e., key events in a movie that describe its storyline. We propose a model that identifies TP scenes by building a sparse movie graph that represents relations between scenes and is constructed using multimodal information. According to human judges, the summaries created by our approach are more informative and complete, and receive higher ratings, than the outputs of sequence based models and general purpose summarization algorithms. The induced graphs are interpretable, displaying different topology for different movie genres.


Evaluating and Boosting Uncertainty Quantification in Classification. Emergence of artificial intelligence techniques in biomedical applications urges the researchers to pay more attention on the uncertainty quantification (UQ) in machine assisted medical decision making. For classification tasks, prior studies on UQ are difficult to compare with each other, due to the lack of a unified quantitative evaluation metric. Considering that well performing UQ models ought to know when the classification models act incorrectly, we design a new evaluation metric, area under Confidence Classification Characteristic curves (AUCCC), to quantitatively evaluate the performance of the UQ models. AUCCC is threshold free, robust to perturbation, and insensitive to the classification performance. We evaluate several UQ methods (e.g., max softmax output) with AUCCC to validate its effectiveness. Furthermore, a simple scheme, named Uncertainty Distillation (UDist), is developed to boost the UQ performance, where a confidence model is distilling the confidence estimated by deep ensembles. The proposed method is easy to implement it consistently outperforms strong baselines on natural and medical image datasets in our experiments.


Towards Question Answering as an Automatic Metric for Evaluating the Content Quality of a Summary. A desirable property of a reference based evaluation metric that measures the content quality of a summary is that it should estimate how much information that summary has in common with a reference. Traditional text overlap based metrics such as ROUGE fail to achieve this because they are limited to matching tokens, either lexically or via embeddings. In this work, we propose a metric to evaluate the content quality of a summary using question answering (QA). QA based methods directly measure a summary's information overlap with a reference, making them fundamentally different than text overlap metrics. We demonstrate the experimental benefits of QA based metrics through an analysis of our proposed metric, QAEval. QAEval out performs current state of the art metrics on most evaluations using benchmark datasets, while being competitive on others due to limitations of state of the art models. Through a careful analysis of each component of QAEval, we identify its performance bottlenecks and estimate that its potential upper bound performance surpasses all other automatic metrics, approaching that of the gold standard Pyramid Method.


More About Operator Order Preserving. It is well known that increasing functions do not preserve operator order in general nor do decreasing functions reverse operator order. However, operator monotone increasing or operator monotone decreasing do. In this article, we employ a convex approach to discuss operator order preserving or conversing. As an easy consequence of more general results, we find non negative constants gamma and psi such that A leq B implies f(B) leq f(A) gamma bf 1 mathcal H text and f(A) leq f(B) psi bf 1 mathcal H , for the self adjoint operators A,B on a Hilbert space mathcal H with identity operator bf 1 mathcal H and for the convex function f whose domain contains the spectra of both A and B . The connection of these results to the existing literature will be discussed and the significance will be emphasized by some examples.


Cross Spectral Face Hallucination via Disentangling Independent Factors. The cross sensor gap is one of the challenges that have aroused much research interests in Heterogeneous Face Recognition (HFR). Although recent methods have attempted to fill the gap with deep generative networks, most of them suffer from the inevitable misalignment between different face modalities. Instead of imaging sensors, the misalignment primarily results from facial geometric variations that are independent of the spectrum. Rather than building a monolithic but complex structure, this paper proposes a Pose Aligned Cross spectral Hallucination (PACH) approach to disentangle the independent factors and deal with them in individual stages. In the first stage, an Unsupervised Face Alignment (UFA) module is designed to align the facial shapes of the near infrared (NIR) images with those of the visible (VIS) images in a generative way, where UV maps are effectively utilized as the shape guidance. Thus the task of the second stage becomes spectrum translation with aligned paired data. We develop a Texture Prior Synthesis (TPS) module to achieve complexion control and consequently generate more realistic VIS images than existing methods. Experiments on three challenging NIR VIS datasets verify the effectiveness of our approach in producing visually appealing images and achieving state of the art performance in HFR.


Continuum Scale Non Newtonian Particle Transport Model for Haemorheology Implementation and Validation. We present a continuum scale particle transport model for red blood cells following collision arguments in a diffusive flux formulation. The model is implemented in FOAM, in a framework for haemodynamics simulations. Modern mechanistic rheology models are implemented and tested. The model is verified against a known analytical solution and shows excellent agreement for high quality meshes and good agreement for typical meshes as used in vascular flow simulations. Simulation results for different size and time scales show that migration of red blood cells does occur on physiologically relevany timescales on small vessels below 1 mm and that the haematocrit concentration modulates the non Newtonian viscosity. This model forms part of a multi scale approach to haemorheology and model parameters will be derived from meso scale simulations using multi component Lattice Boltzmann methods. The code, haemoFoam, is made available for interested researchers.


On inverse spectral problems for Sturm Liouville differential operators on closed sets. We study Sturm Liouville operators on closed sets of a special structure, which are sometimes referred as time scales and often appear in modelling various real processes. Depending on the set structure, such operators unify both differential and difference operators. We obtain properties of their spectral characteristics and study inverse problems with respect to them. We prove that the spectral characteristics uniquely determine the operator.


Learning Grasp Affordance Reasoning through Semantic Relations. Reasoning about object affordances allows an autonomous agent to perform generalised manipulation tasks among object instances. While current approaches to grasp affordance estimation are effective, they are limited to a single hypothesis. We present an approach for detection and extraction of multiple grasp affordances on an object via visual input. We define semantics as a combination of multiple attributes, which yields benefits in terms of generalisation for grasp affordance prediction. We use Markov Logic Networks to build a knowledge base graph representation to obtain a probability distribution of grasp affordances for an object. To harvest the knowledge base, we collect and make available a novel dataset that relates different semantic attributes. We achieve reliable mappings of the predicted grasp affordances on the object by learning prototypical grasping patches from several examples. We show our method's generalisation capabilities on grasp affordance prediction for novel instances and compare with similar methods in the literature. Moreover, using a robotic platform, on simulated and real scenarios, we evaluate the success of the grasping task when conditioned on the grasp affordance prediction.


SemEval 2015 Task 3 Answer Selection in Community Question Answering. Community Question Answering (cQA) provides new interesting research directions to the traditional Question Answering (QA) field, e.g., the exploitation of the interaction between users and the structure of related posts. In this context, we organized SemEval 2015 Task 3 on "Answer Selection in cQA", which included two subtasks (a) classifying answers as "good", "bad", or "potentially relevant" with respect to the question, and (b) answering a YES NO question with "yes", "no", or "unsure", based on the list of all answers. We set subtask A for Arabic and English on two relatively different cQA domains, i.e., the Qatar Living website for English, and a Quran related website for Arabic. We used crowdsourcing on Amazon Mechanical Turk to label a large English training dataset, which we released to the research community. Thirteen teams participated in the challenge with a total of 61 submissions 24 primary and 37 contrastive. The best systems achieved an official score (macro averaged F1) of 57.19 and 63.7 for the English subtasks A and B, and 78.55 for the Arabic subtask A.


Microsoft Recommenders Tools to Accelerate Developing Recommender Systems. The purpose of this work is to highlight the content of the Microsoft Recommenders repository and show how it can be used to reduce the time involved in developing recommender systems. The open source repository provides python utilities to simplify common recommender related data science work as well as example Jupyter notebooks that demonstrate use of the algorithms and tools under various environments.


Commuting vector fields. In this paper we study the centralizer C(X) of a germ of vector field at 0 in C n . A particular atention is given to the case of dimension two.


Connectedness of square free Groebner Deformations. Let I subseteq S K x 1, ldots,x n be a homogeneous ideal equipped with a monomial order . We show that if operatorname in (I) is a square free monomial ideal, then S I and S operatorname in (I) have the same connectedness dimension. We also show that graphs related to connectedness of these quotient rings have the same number of components. We also provide consequences regarding Lyubeznik numbers. We obtain these results by furthering the study of connectedness modulo a parameter in a local ring.


Superconductor ferromagnet tunnel junction thermoelectric bolometer and calorimeter with a SQUID readout. Superconductor ferromagnet thermoelectric detector (SFTED) is a novel ultrasensitive radiation detector based on the giant thermoelectric effect in superconductor ferromagnet tunnel junctions. This type of detector can be operated without the need of additional bias lines, and is predicted to provide a performance rivaling transition edge sensors and kinetic inductance detectors. Here we report our numerical studies on the SFTED noise equivalent power, energy resolution and time constant, and the feasibility of a SQUID readout in both bolometric and calorimetric regimes, with the goal to provide practical design parameters for the detector fabrication and the readout circuitry implementation.


Homogenization of random quasiconformal mappings and random Delauney triangulations. In this paper, we solve two problems dealing with the homogenization of random media. We show that a random quasiconformal mapping is close to an affine mapping, while a circle packing of a random Delauney triangulation is close to a conformal map, confirming a conjecture of Stephenson. We also show that on a Riemann surface equipped with a conformal metric, a random Delauney triangulation is close to being circle packed.


Weak error rates for option pricing under linear rough volatility. In quantitative finance, modeling the volatility structure of underlying assets is vital to pricing options. Rough stochastic volatility models, such as the rough Bergomi model Bayer, Friz, Gatheral, Quantitative Finance 16(6), 887 904, 2016 , seek to fit observed market data based on the observation that the log realized variance behaves like a fractional Brownian motion with small Hurst parameter, H 1 2 , over reasonable timescales. Both time series of asset prices and option derived price data indicate that H often takes values close to 0.1 or less, i.e., rougher than Brownian motion. This change improves the fit to both option prices and time series of underlying asset prices while maintaining parsimoniousness. However, the non Markovian nature of the driving fractional Brownian motion in rough volatility models poses severe challenges for theoretical and numerical analyses and for computational practice. While the explicit Euler method is known to converge to the solution of the rough Bergomi and similar models, its strong rate of convergence is only H . We prove rate H 1 2 for the weak convergence of the Euler method for the rough Stein Stein model, which treats the volatility as a linear function of the driving fractional Brownian motion, and, surprisingly, we prove rate one for the case of quadratic payoff functions. Our proof uses Talay Tubaro expansions and an affine Markovian representation of the underlying and is further supported by numerical experiments. These convergence results provide a first step toward deriving weak rates for the rough Bergomi model, which treats the volatility as a nonlinear function of the driving fractional Brownian motion.


Minimum stationary values of sparse random directed graphs. We consider the stationary distribution of the simple random walk on the directed configuration model with bounded degrees. Provided that the minimum out degree is at least 2 , with high probability (whp) there is a unique stationary distribution. We show that the minimum positive stationary value is whp n (1 C o(1)) for some constant C ge 0 determined by the degree distribution. In particular, C is the competing combination of two factors (1) the contribution of atypically "thin" in neighbourhoods, controlled by subcritical branching processes and (2) the contribution of atypically "light" trajectories, controlled by large deviation rate functions. Additionally, our proof implies that whp the hitting and the cover time are both n 1 C o(1) . Our results complement those of Caputo and Quattropani who showed that if the minimum in degree is at least 2, stationary values have logarithmic fluctuations around n 1 .


Sharp approximation theorems and Fourier inequalities in the Dunkl setting. In this paper we study direct and inverse approximation inequalities in L p ( mathbb R d ) , 1 p infty , with the Dunkl weight. We obtain these estimates in their sharp form substantially improving previous results. We also establish new estimates of the modulus of smoothness of a function f via the fractional powers of the Dunkl Laplacian of approximants of f . Moreover, we obtain new Lebesgue type estimates for moduli of smoothness in terms of Dunkl transforms. Needed Pitt type and Kellogg type Fourier Dunkl inequalities are derived.


Learn2Perturb an End to end Feature Perturbation Learning to Improve Adversarial Robustness. While deep neural networks have been achieving state of the art performance across a wide variety of applications, their vulnerability to adversarial attacks limits their widespread deployment for safety critical applications. Alongside other adversarial defense approaches being investigated, there has been a very recent interest in improving adversarial robustness in deep neural networks through the introduction of perturbations during the training process. However, such methods leverage fixed, pre defined perturbations and require significant hyper parameter tuning that makes them very difficult to leverage in a general fashion. In this study, we introduce Learn2Perturb, an end to end feature perturbation learning approach for improving the adversarial robustness of deep neural networks. More specifically, we introduce novel perturbation injection modules that are incorporated at each layer to perturb the feature space and increase uncertainty in the network. This feature perturbation is performed at both the training and the inference stages. Furthermore, inspired by the Expectation Maximization, an alternating back propagation training algorithm is introduced to train the network and noise parameters consecutively. Experimental results on CIFAR 10 and CIFAR 100 datasets show that the proposed Learn2Perturb method can result in deep neural networks which are 4 7 more robust on l infty FGSM and PDG adversarial attacks and significantly outperforms the state of the art against l 2 C W attack and a wide range of well known black box attacks.


Lasso hyperinterpolation over general regions. This paper develops a fully discrete soft thresholding polynomial approximation over a general region, named Lasso hyperinterpolation. This approximation is an ell 1 regularized discrete least squares approximation under the same conditions of hyperinterpolation. Lasso hyperinterpolation also uses a high order quadrature rule to approximate the Fourier coefficients of a given continuous function with respect to some orthonormal basis, and then it obtains its coefficients by acting a soft threshold operator on all approximated Fourier coefficients. Lasso hyperinterpolation is not a discrete orthogonal projection, but it is an efficient tool to deal with noisy data. We theoretically analyze Lasso hyperinterpolation for continuous and smooth functions. The principal results are twofold the norm of the Lasso hyperinterpolation operator is bounded independently of the polynomial degree, which is inherited from hyperinterpolation and the L 2 error bound of Lasso hyperinterpolation is less than that of hyperinterpolation when the level of noise becomes large, which improves the robustness of hyperinterpolation. Explicit constructions and corresponding numerical examples of Lasso hyperinterpolation over intervals, discs, spheres, and cubes are given.


A stochastic time delayed model for the effectiveness of Moroccan COVID 19 deconfinement strategy. Coronavirus disease 2019 (COVID 19) poses a great threat to public health and the economy worldwide. Currently, COVID 19 evolves in many countries to a second stage, characterized by the need for the liberation of the economy and relaxation of the human psychological effects. To this end, numerous countries decided to implement adequate deconfinement strategies. After the first prolongation of the established confinement, Morocco moves to the deconfinement stage on May 20, 2020. The relevant question concerns the impact on the COVID 19 propagation by considering an additional degree of realism related to stochastic noises due to the effectiveness level of the adapted measures. In this paper, we propose a delayed stochastic mathematical model to predict the epidemiological trend of COVID 19 in Morocco after the deconfinement. To ensure the well posedness of the model, we prove the existence and uniqueness of a positive solution. Based on the large number theorem for martingales, we discuss the extinction of the disease under an appropriate threshold parameter. Moreover, numerical simulations are performed in order to test the efficiency of the deconfinement strategies chosen by the Moroccan authorities to help the policy makers and public health administration to make suitable decisions in the near future.


Complex valued Iris Recognition Network. In this work, we design a fully complex valued neural network for the task of iris recognition. Unlike the problem of general object recognition, where real valued neural networks can be used to extract pertinent features, iris recognition depends on the extraction of both phase and magnitude information from the input iris texture in order to better represent its biometric content. This necessitates the extraction and processing of phase information that cannot be effectively handled by a real valued neural network. In this regard, we design a fully complex valued neural network that can better capture the multi scale, multi resolution, and multi orientation phase and amplitude features of the iris texture. We show a strong correspondence of the proposed complex valued iris recognition network with Gabor wavelets that are used to generate the classical IrisCode however, the proposed method enables a new capability of automatic complex valued feature learning that is tailored for iris recognition. We conduct experiments on three benchmark datasets ND CrossSensor 2013, CASIA Iris Thousand and UBIRIS.v2 and show the benefit of the proposed network for the task of iris recognition. We exploit visualization schemes to convey how the complex valued network, when compared to standard real valued networks, extracts fundamentally different features from the iris texture.


Construction of Quasisymmetric Stellarators Using a Direct Coordinate Approach. Optimized stellarator configurations and their analytical properties are obtained using a near axis expansion approach. Such configurations are associated with good confinement as the guiding center particle trajectories and neoclassical transport are isomorphic to those in a tokamak. This makes them appealing as fusion reactor candidates. Using a direct coordinate approach, where the magnetic field and flux surface functions are found explicitly in terms of the position vector at successive orders in the distance to the axis, the set of ordinary differential equations for first and second order quasisymmetry is derived. Examples of quasi axisymmetric shapes are constructed using a pseudospectral numerical method. Finally, the direct coordinate approach is used to independently verify two hypotheses commonly associated with quasisymmetric magnetic fields, namely that the number of equations exceeds the number of parameters at third order in the expansion and that the near axis expansion does not prohibit exact quasisymmetry from being achieved on a single flux surface.


Markov chain Monte Carlo methods for hierarchical clustering of dynamic causal models. In this paper, we address technical difficulties that arise when applying Markov chain Monte Carlo (MCMC) to hierarchical models designed to perform clustering in the space of latent parameters of subject wise generative models. Specifically, we focus on the case where the subject wise generative model is a dynamic causal model (DCM) for fMRI and clusters are defined in terms of effective brain connectivity. While an attractive approach for detecting mechanistically interpretable subgroups in heterogeneous populations, inverting such a hierarchical model represents a particularly challenging case, since DCM is often characterized by high posterior correlations between its parameters. In this context, standard MCMC schemes exhibit poor performance and extremely slow convergence. In this paper, we investigate the properties of hierarchical clustering which lead to the observed failure of standard MCMC schemes and propose a solution designed to improve convergence but preserve computational complexity. Specifically, we introduce a class of proposal distributions which aims to capture the interdependencies between the parameters of the clustering and subject wise generative models and helps to reduce random walk behaviour of the MCMC scheme. Critically, these proposal distributions only introduce a single hyperparameter that needs to be tuned to achieve good performance. For validation, we apply our proposed solution to synthetic and real world datasets and also compare it, in terms of computational complexity and performance, to Hamiltonian Monte Carlo (HMC), a state of the art Monte Carlo. Our results indicate that, for the specific application domain considered here, our proposed solution shows good convergence performance and superior runtime compared to HMC.


Recovering a perturbation of a matrix polynomial from a perturbation of its linearization. A number of theoretical and computational problems for matrix polynomials are solved by passing to linearizations. Therefore a perturbation theory results for linearizations need to be related back to matrix polynomials. In this paper we present an algorithm that finds which perturbation of matrix coefficients of a matrix polynomial corresponds to a given perturbation of the entire linearization pencil. Moreover we find transformation matrices that, via strict equivalence, transform a perturbation of the linearization to the linearization of a perturbed polynomial. For simplicity, we present the results for the first companion linearization but they can be generalized to a broader class of linearizations.


Separation bodies a conceptual dual to floating bodies. Let K be a convex body in Euclidean space mathbb R d , and let a translation invariant, locally finite Borel measure on the space of hyperplanes in mathbb R d be given. For delta ge 0 , we consider the set of all points x for which the set of hyperplanes separating K and x has measure at most delta . This defines the separation body of K , with respect to the given measure and the parameter delta . Separation bodies are meant as conceptual duals to floating bodies, and they are expected to play a role in the investigation of random polytopes generated as intersections of random halfspaces, in a similar way that floating bodies are useful for studying convex hulls of random points. After discussing some elementary properties of separation bodies, we carry out first examples to this effect.


Characterization of metrizable Esakia spaces via some forbidden configurations. By Priestley duality, each bounded distributive lattice is represented as the lattice of clopen upsets of a Priestley space, and by Esakia duality, each Heyting algebra is represented as the lattice of clopen upsets of an Esakia space. Esakia spaces are those Priestley spaces that satisfy the additional condition that the downset of each clopen is clopen. We show that in the metrizable case Esakia spaces can be singled out by forbidding three simple configurations. Since metrizability yields that the corresponding lattice of clopen upsets is countable, this provides a characterization of countable Heyting algebras. We show that this characterization no longer holds in the uncountable case. Our results have analogues for co Heyting algebras and bi Heyting algebras, and they easily generalize to the setting of p algebras.


A structure theorem for finite fields. We present a new structure theorem for finite fields of odd order that relates multiplicative and additive structure in an interesting way. This theorem has several applications, including an improved understanding of Dickson and Chebyshev polynomials and some formulas with a number theoretic flavor. This paper is an abridged version of two math arXiv articles by the author arXiv 1707.06870, arXiv 1707.06877 .


Scheduling Games with Machine Dependent Priority Lists. We consider a scheduling game on parallel related machines, in which jobs try to minimize their completion time by choosing a machine to be processed on. Each machine uses an individual priority list to decide on the order according to which the jobs on the machine are processed. We prove that it is NP hard to decide if a pure Nash equilibrium exists and characterize four classes of instances in which a pure Nash equilibrium is guaranteed to exist. For each of these classes, we give an algorithm that computes a Nash equilibrium, we prove that best response dynamics converge to a Nash equilibrium, and we bound the inefficiency of Nash equilibria with respect to the makespan of the schedule and the sum of completion times. In addition, we show that although a pure Nash equilibrium is guaranteed to exist in instances with identical machines, it is NP hard to approximate the best Nash equilibrium with respect to both objectives. We finally extend our results to a more general model in which jobs pick subsets of machines.


Introduction to Solving Quant Finance Problems with Time Stepped FBSDE and Deep Learning. In this introductory paper, we discuss how quantitative finance problems under some common risk factor dynamics for some common instruments and approaches can be formulated as time continuous or time discrete forward backward stochastic differential equations (FBSDE) final value or control problems, how these final value problems can be turned into control problems, how time continuous problems can be turned into time discrete problems, and how the forward and backward stochastic differential equations (SDE) can be time stepped. We obtain both forward and backward time stepped time discrete stochastic control problems (where forward and backward indicate in which direction the Y SDE is time stepped) that we will solve with optimization approaches using deep neural networks for the controls and stochastic gradient and other deep learning methods for the actual optimization learning. We close with examples for the forward and backward methods for an European option pricing problem. Several methods and approaches are new.


Physics informed deep learning for computational elastodynamics without labeled data. Numerical methods such as finite element have been flourishing in the past decades for modeling solid mechanics problems via solving governing partial differential equations (PDEs). A salient aspect that distinguishes these numerical methods is how they approximate the physical fields of interest. Physics informed deep learning is a novel approach recently developed for modeling PDE solutions and shows promise to solve computational mechanics problems without using any labeled data. The philosophy behind it is to approximate the quantity of interest (e.g., PDE solution variables) by a deep neural network (DNN) and embed the physical law to regularize the network. To this end, training the network is equivalent to minimization of a well designed loss function that contains the PDE residuals and initial boundary conditions (I BCs). In this paper, we present a physics informed neural network (PINN) with mixed variable output to model elastodynamics problems without resort to labeled data, in which the I BCs are hardly imposed. In particular, both the displacement and stress components are taken as the DNN output, inspired by the hybrid finite element analysis, which largely improves the accuracy and trainability of the network. Since the conventional PINN framework augments all the residual loss components in a "soft" manner with Lagrange multipliers, the weakly imposed I BCs cannot not be well satisfied especially when complex I BCs are present. To overcome this issue, a composite scheme of DNNs is established based on multiple single DNNs such that the I BCs can be satisfied forcibly in a "hard" manner. The propose PINN framework is demonstrated on several numerical elasticity examples with different I BCs, including both static and dynamic problems as well as wave propagation in truncated domains. Results show the promise of PINN in the context of computational mechanics applications.


When Maximum Stable Set can be solved in FPT time. Maximum Independent Set (MIS for short) is in general graphs the paradigmatic W 1 hard problem. In stark contrast, polynomial time algorithms are known when the inputs are restricted to structured graph classes such as, for instance, perfect graphs (which includes bipartite graphs, chordal graphs, co graphs, etc.) or claw free graphs. In this paper, we introduce some variants of co graphs with parameterized noise, that is, graphs that can be made into disjoint unions or complete sums by the removal of a certain number of vertices and the addition deletion of a certain number of edges per incident vertex, both controlled by the parameter. We give a series of FPT Turing reductions on these classes and use them to make some progress on the parameterized complexity of MIS in H free graphs. We show that for every fixed t geqslant 1 , MIS is FPT in P(1,t,t,t) free graphs, where P(1,t,t,t) is the graph obtained by substituting all the vertices of a four vertex path but one end of the path by cliques of size t . We also provide randomized FPT algorithms in dart free graphs and in cricket free graphs. This settles the FPT W 1 hard dichotomy for five vertex graphs H .


Graded Linearity of Stanley Reisner Ring of Broken Circuit Complexes. This paper introduces two new notions of graded linear resolution and graded linear quotients, which generalize the concepts of linear resolution property and linear quotient for modules over the polynomial ring A k x 1, dots ,x n . Besides, we compare graded linearity with componentwise linearity in general. For modules minimally generated by a regular sequence in a maximal ideal of A , we show that graded linear quotients imply graded linear resolution property for the colon ideals. On the other hand, we provide specific characterizations of graded linear resolution property for the Stanley Reisner ring of broken circuit complexes and generalize several results of cite RV on the decomposition of matroids into the direct sum of uniform matroids. Specifically, we show that the matroid can be stratified such that each strata has a decomposition into uniform matroids. We also present analogs of our results for the Orlik Terao ideal of hyperplane arrangements which are translations of the corresponding results on matroids.


Interchromophoric Interactions Determine the Maximum Brightness Density in DNA Origami Structures. An ideal point light source is as small and as bright as possible. For fluorescent point light sources, homogeneity of the light sources is important as well as that the fluorescent units inside the light source maintain their photophysical properties which is compromised by dye aggregation. Here we propose DNA origami as a rigid scaffold to arrange dye molecules in a dense pixel array with high control of stoichiometry and dye dye interactions. In order to find the highest labeling density in a DNA origami structure without influencing dye photophysics we alter the distance of two ATTO647N dyes in single base pair steps and probe the dye dye interactions on the single molecule level. For small distances strong quenching in terms of intensity and fluorescence lifetime is observed. With increasing distance, we observe reduced quenching and molecular dynamics. However, energy transfer processes in the weak coupling regime still have a significant impact and can lead to quenching by singlet dark state annihilation. Our study fills a gap of studying the interactions of dyes relevant for superresolution microscopy with dense labeling and for single molecule biophysics. Incorporating these findings in a 3D DNA origami object will pave the way to bright and homogeneous DNA origami nanobeads.


Birds have four legs?! NumerSense Probing Numerical Commonsense Knowledge of Pre trained Language Models. Recent works show that pre trained language models (PTLMs), such as BERT, possess certain commonsense and factual knowledge. They suggest that it is promising to use PTLMs as "neural knowledge bases" via predicting masked words. Surprisingly, we find that this may not work for numerical commonsense knowledge (e.g., a bird usually has two legs). In this paper, we investigate whether and to what extent we can induce numerical commonsense knowledge from PTLMs as well as the robustness of this process. To study this, we introduce a novel probing task with a diagnostic dataset, NumerSense, containing 13.6k masked word prediction probes (10.5k for fine tuning and 3.1k for testing). Our analysis reveals that (1) BERT and its stronger variant RoBERTa perform poorly on the diagnostic dataset prior to any fine tuning (2) fine tuning with distant supervision brings some improvement (3) the best supervised model still performs poorly as compared to human performance (54.06 vs 96.3 in accuracy).


File Classification Based on Spiking Neural Networks. In this paper, we propose a system for file classification in large data sets based on spiking neural networks (SNNs). File information contained in key value metadata pairs is mapped by a novel correlative temporal encoding scheme to spike patterns that are input to an SNN. The correlation between input spike patterns is determined by a file similarity measure. Unsupervised training of such networks using spike timing dependent plasticity (STDP) is addressed first. Then, supervised SNN training is considered by backpropagation of an error signal that is obtained by comparing the spike pattern at the output neurons with a target pattern representing the desired class. The classification accuracy is measured for various publicly available data sets with tens of thousands of elements, and compared with other learning algorithms, including logistic regression and support vector machines. Simulation results indicate that the proposed SNN based system using memristive synapses may represent a valid alternative to classical machine learning algorithms for inference tasks, especially in environments with asynchronous ingest of input data and limited resources.


Regularizing effect of absorption terms in singular and degenerate elliptic problems. In this paper we study the existence and regularity of solutions to the following singular problem begin equation left begin array lll displaystyle mbox div big(a(x,u) nabla u p 2 nabla u big) u s 1 u frac f u gamma mbox in Omega u 0 mbox in Omega u 0 mbox on delta Omega end array right. end equation proving that the lower order term u u s 1 has some regularizing effects on the solutions in the case of an elliptic operator with degenerate coercivity.


Approach to the construction of the spaces S D p mathbb R infty for 1 leq p leq infty . The objective of this paper is to construct separable Banach spaces S D p mathbb R infty for 1 leq p leq infty , each of which contains the L p mathbb R infty spaces, as well as finitely additive measures, as compact dense embedding. Also these spaces contains Henstock Kurzweil integrable functions.


A limit theorem for small cliques in inhomogeneous random graphs. The theory of graphons comes with a natural sampling procedure, which results in an inhomogeneous variant of the Erd H o s R 'enyi random graph, called W random graphs. We prove, via the method of moments, a limit theorem for the number of r cliques in such random graphs. We show that, whereas in the case of dense Erd H o s R 'enyi random graphs the fluctuations are normal of order n r 1 , the fluctuations in the setting of W random graphs may be of order 0, n r 1 , or n r 0.5 . Furthermore, when the fluctuations are of order n r 0.5 they are normal, while when the fluctuations are of order n r 1 they exhibit either normal or a particular type of chi square behavior whose parameters relate to spectral properties of W . These results can also be deduced from a general setting Janson and Nowicki, PTRF 1991 , based on the projection method. In addition to providing alternative proofs, our approach makes direct links to the theory of graphons.


UCT ADP Progressive Bias Algorithm for Solving Gomoku. We combine Adaptive Dynamic Programming (ADP), a reinforcement learning method and UCB applied to trees (UCT) algorithm with a more powerful heuristic function based on Progressive Bias method and two pruning strategies for a traditional board game Gomoku. For the Adaptive Dynamic Programming part, we train a shallow forward neural network to give a quick evaluation of Gomoku board situations. UCT is a general approach in MCTS as a tree policy. Our framework use UCT to balance the exploration and exploitation of Gomoku game trees while we also apply powerful pruning strategies and heuristic function to re select the available 2 adjacent grids of the state and use ADP instead of simulation to give estimated values of expanded nodes. Experiment result shows that this method can eliminate the search depth defect of the simulation process and converge to the correct value faster than single UCT. This approach can be applied to design new Gomoku AI and solve other Gomoku like board game.


Modulation Compression in Next Generation RAN Air Interface and Fronthaul trade offs. Modulation compression is a technique considered in the recent Open RAN (O RAN) framework, which has continued the 3GPP effort towards the definition of new virtualized and multi vendor RAN architectures. Basically, fronthaul compression is achieved by means of reducing the modulation order, thus enabling a dramatic reduction of the required fronthaul capacity with a simple technique. In this work, we provide a survey of the architectures, functional splits, and fronthaul compression techniques envisioned in 3GPP and O RAN. Then, we focus on assessing the trade offs that modulation compression exhibits in terms of reduced fronthaul capacity versus the impact on the air interface performance, through a dynamic multi cell system level simulation. For that, we use an ns 3 based system level simulator compliant with 5G New Radio (NR) specifications and evaluate different traffic load conditions and NR numerologies. In a multi cell scenario, our results show that an 82 reduction of the required fronthaul capacity can be achieved with negligible air interface performance degradation by reducing the modulation order down to 64QAM, for different numerologies and load conditions. A higher modulation order reduction without degradation is permitted in low medium traffic loads (reaching up to 94 fronthaul capacity reduction).


Learning Aggregation Functions. Learning on sets is increasingly gaining attention in the machine learning community, due to its widespread applicability. Typically, representations over sets are computed by using fixed aggregation functions such as sum or maximum. However, recent results showed that universal function representation by sum (or max ) decomposition requires either highly discontinuous (and thus poorly learnable) mappings, or a latent dimension equal to the maximum number of elements in the set. To mitigate this problem, we introduce a learnable aggregation function (LAF) for sets of arbitrary cardinality. LAF can approximate several extensively used aggregators (such as average, sum, maximum) as well as more complex functions (e.g., variance and skewness). We report experiments on semi synthetic and real data showing that LAF outperforms state of the art sum (max ) decomposition architectures such as DeepSets and library based architectures like Principal Neighborhood Aggregation, and can be effectively combined with attention based architectures.


Twisting lemma for Lambda adic modules. A classical twisting lemma says that given a finitely generated torsion module M over the Iwasawa algebra mathbb Z p Gamma with Gamma cong mathbb Z p, exists a continuous character theta Gamma rightarrow mathbb Z p times such that, the Gamma n Euler characteristic of the twist M( theta) is finite for every n . This twisting lemma has been generalized for the Iwasawa algebra of a general compact p adic Lie group G . In this article, we consider a further generalization of the twisting lemma to mathcal T G modules, where G is a compact p adic Lie group and mathcal T is a finite extension of mathbb Z p X . Such modules naturally occur in Hida theory. We also indicate arithmetic application by considering the twisted Euler Characteristic of the big Selmer (respectively fine Selmer) group of a Lambda adic form over a p adic Lie extension.


Benchmarking Unsupervised Object Representations for Video Sequences. Perceiving the world in terms of objects and tracking them through time is a crucial prerequisite for reasoning and scene understanding. Recently, several methods have been proposed for unsupervised learning of object centric representations. However, since these models were evaluated on different downstream tasks, it remains unclear how they compare in terms of basic perceptual abilities such as detection, figure ground segmentation and tracking of objects. To close this gap, we design a benchmark with four data sets of varying complexity and seven additional test sets featuring challenging tracking scenarios relevant for natural videos. Using this benchmark, we compare the perceptual abilities of four object centric approaches ViMON, a video extension of MONet, based on recurrent spatial attention, OP3, which exploits clustering via spatial mixture models, as well as TBA and SCALOR, which use explicit factorization via spatial transformers. Our results suggest that the architectures with unconstrained latent representations learn more powerful representations in terms of object detection, segmentation and tracking than the spatial transformer based architectures. We also observe that none of the methods are able to gracefully handle the most challenging tracking scenarios despite their synthetic nature, suggesting that our benchmark may provide fruitful guidance towards learning more robust object centric video representations.


Deep Audio Visual Learning A Survey. Audio visual learning, aimed at exploiting the relationship between audio and visual modalities, has drawn considerable attention since deep learning started to be used successfully. Researchers tend to leverage these two modalities either to improve the performance of previously considered single modality tasks or to address new challenging problems. In this paper, we provide a comprehensive survey of recent audio visual learning development. We divide the current audio visual learning tasks into four different subfields audio visual separation and localization, audio visual correspondence learning, audio visual generation, and audio visual representation learning. State of the art methods as well as the remaining challenges of each subfield are further discussed. Finally, we summarize the commonly used datasets and performance metrics.


Boundary value problems for elliptic partial differential equations. This course is intended as an introduction to the analysis of elliptic partial differential equations. The objective is to provide a large overview of the different aspects of elliptic partial differential equations and their modern treatment. Besides variational and Schauder methods we study the unique continuation property and the stability for Cauchy problems. The derivation of the unique continuation property and the stability for Cauchy problems relies on a Carleman inequality. This inequality is efficient to establish three ball type inequalities which are the main tool in the continuation argument. We know that historically a central role in the analysis of partial differential equations is played by their fundamental solutions. We added an appendix dealing with the construction of a fundamental solution by the so called Levi parametrix method. We tried as much as possible to render this course self contained. Moreover each chapter contains many exercices and problems. We have provided detailed solutions of these exercises and problems. The most parts of this course consist in an enhanced version of courses given by the author in both undergraduate and graduate levels during several years. Remarks and comments that can help to improve this course are welcome.


Suphx Mastering Mahjong with Deep Reinforcement Learning. Artificial Intelligence (AI) has achieved great success in many domains, and game AI is widely regarded as its beachhead since the dawn of AI. In recent years, studies on game AI have gradually evolved from relatively simple environments (e.g., perfect information games such as Go, chess, shogi or two player imperfect information games such as heads up Texas hold'em) to more complex ones (e.g., multi player imperfect information games such as multi player Texas hold'em and StartCraft II). Mahjong is a popular multi player imperfect information game worldwide but very challenging for AI research due to its complex playing scoring rules and rich hidden information. We design an AI for Mahjong, named Suphx, based on deep reinforcement learning with some newly introduced techniques including global reward prediction, oracle guiding, and run time policy adaptation. Suphx has demonstrated stronger performance than most top human players in terms of stable rank and is rated above 99.99 of all the officially ranked human players in the Tenhou platform. This is the first time that a computer program outperforms most top human players in Mahjong.


On card guessing game with one time riffle shuffle and complete feedback. This paper studies the game of guessing riffle shuffled cards with complete feedback. A deck of n cards labelled 1 to n is riffle shuffled once and placed on a table. A player tries to guess the cards from top and is given complete feedback after each guess. The goal is to find the guessing strategy with maximum reward (expected number of correct guesses). We give the optimal strategy for this game and prove that the maximum expected reward is n 2 sqrt 2 pi cdot sqrt n O(1) , partially solving an open problem of Bayer and Diaconis.


Measurements of the energy distribution of electrons lost from the minimum B field the effect of instabilities and two frequency heating. Further progress in the development of ECR ion sources (ECRIS) requires deeper understanding of the underlying physics. One of the topics that remains obscure, though being crucial for the performance of the ECRIS, is the electron energy distribution (EED). A well developed technique of measuring the EED of electrons escaping axially from the magnetically confined plasma of an ECRIS was used for the study of EED in unstable mode of plasma confinement, i.e. in the presence of kinetic instabilities. The experimental data were recorded for pulsed and CW discharges with a room temperature 14 GHz ECRIS at the JYFL accelerator laboratory. The measurements were focused on observing differences between the EED escaping from a stable and unstable plasmas. It was found that nonlinear phenomena alter the EED noticeably. The electron losses are enhanced in both unstable regime and with two frequency heating suppressing the instabilities. It has been shown earlier that two frequency heating boosts the ECRIS performance presumably owing to the suppression of instabilities. We report the observed changes in EED introduced by the secondary frequency in different regimes, including an off resonance condition where the secondary frequency is lower than the minimum frequency satisfying the resonance condition for cold electrons at the magnetic field minimum. Finally, we suggest an experimental method of qualitative evaluation of the energy distribution of electrons confined in the magnetic trap using a method of measuring energy distribution of lost electrons during the plasma decay in pulsed operation of the ion source.


Context and Attribute Grounded Dense Captioning. Dense captioning aims at simultaneously localizing semantic regions and describing these regions of interest (ROIs) with short phrases or sentences in natural language. Previous studies have shown remarkable progresses, but they are often vulnerable to the aperture problem that a caption generated by the features inside one ROI lacks contextual coherence with its surrounding context in the input image. In this work, we investigate contextual reasoning based on multi scale message propagations from the neighboring contents to the target ROIs. To this end, we design a novel end to end context and attribute grounded dense captioning framework consisting of 1) a contextual visual mining module and 2) a multi level attribute grounded description generation module. Knowing that captions often co occur with the linguistic attributes (such as who, what and where), we also incorporate an auxiliary supervision from hierarchical linguistic attributes to augment the distinctiveness of the learned captions. Extensive experiments and ablation studies on Visual Genome dataset demonstrate the superiority of the proposed model in comparison to state of the art methods.


A Software Framework and Datasets for the Analysis of Graph Measures on RDF Graphs. As the availability and the inter connectivity of RDF datasets grow, so does the necessity to understand the structure of the data. Understanding the topology of RDF graphs can guide and inform the development of, e.g. synthetic dataset generators, sampling methods, index structures, or query optimizers. In this work, we propose two resources (i) a software framework able to acquire, prepare, and perform a graph based analysis on the topology of large RDF graphs, and (ii) results on a graph based analysis of 280 datasets from the LOD Cloud with values for 28 graph measures computed with the framework. We present a preliminary analysis based on the proposed resources and point out implications for synthetic dataset generators. Finally, we identify a set of measures, that can be used to characterize graphs in the Semantic Web.


FactorizeNet Progressive Depth Factorization for Efficient Network Architecture Exploration Under Quantization Constraints. Depth factorization and quantization have emerged as two of the principal strategies for designing efficient deep convolutional neural network (CNN) architectures tailored for low power inference on the edge. However, there is still little detailed understanding of how different depth factorization choices affect the final, trained distributions of each layer in a CNN, particularly in the situation of quantized weights and activations. In this study, we introduce a progressive depth factorization strategy for efficient CNN architecture exploration under quantization constraints. By algorithmically increasing the granularity of depth factorization in a progressive manner, the proposed strategy enables a fine grained, low level analysis of layer wise distributions. Thus enabling the gain of in depth, layer level insights on efficiency accuracy tradeoffs under fixed precision quantization. Such a progressive depth factorization strategy also enables efficient identification of the optimal depth factorized macroarchitecture design (which we will refer to here as FactorizeNet) based on the desired efficiency accuracy requirements.


Conformally K "ahler, Einstein Maxwell metrics on Hirzebruch surfaces. In this note we prove that a special family of Killing potentials on certain Hirzebruch complex surfaces, found by Futaki and Ono, gives rise to new conformally K "ahler, Einstein Maxwell metrics. The correspondent K "ahler metrics are ambitoric but they are not given by the Calabi ansatz. This answers in positive questions raised by Futaki Ono.


Congruences for Level 1 cusp forms of half integral weight. Suppose that ell geq 5 is prime. For a positive integer N with 4 mid N , previous works studied properties of half integral weight modular forms on Gamma 0(N) which are supported on finitely many square classes modulo ell , in some cases proving that these forms are congruent to the image of a single variable theta series under some number of iterations of the Ramanujan Theta operator. Here, we study the analogous problem for modular forms of half integral weight on operatorname SL 2 ( mathbb Z ) . Let eta be the Dedekind eta function. For a wide range of weights, we prove that every half integral weight modular form on operatorname SL 2 ( mathbb Z ) which is supported on finitely many square classes modulo ell can be written modulo ell in terms of eta ell and an iterated derivative of eta .


NESSi The Non Equilibrium Systems Simulation package. The nonequilibrium dynamics of correlated many particle systems is of interest in connection with pump probe experiments on molecular systems and solids, as well as theoretical investigations of transport properties and relaxation processes. Nonequilibrium Green's functions are a powerful tool to study interaction effects in quantum many particle systems out of equilibrium, and to extract physically relevant information for the interpretation of experiments. We present the open source software package NESSi (The Non Equilibrium Systems Simulation package) which allows to perform many body dynamics simulations based on Green's functions on the L shaped Kadanoff Baym contour. NESSi contains the library libcntr which implements tools for basic operations on these nonequilibrium Green's functions, for constructing Feynman diagrams, and for the solution of integral and integro differential equations involving contour Green's functions. The library employs a discretization of the Kadanoff Baym contour into time N points and a high order implementation of integration routines. The total integrated error scales up to mathcal O (N 7 ) , which is important since the numerical effort increases at least cubically with the simulation time. A distributed memory parallelization over reciprocal space allows large scale simulations of lattice systems. We provide a collection of example programs ranging from dynamics in simple two level systems to problems relevant in contemporary condensed matter physics, including Hubbard clusters and Hubbard or Holstein lattice models. The libcntr library is the basis of a follow up software package for nonequilibrium dynamical mean field theory calculations based on strong coupling perturbative impurity solvers.


Model driven Engineering of Safety and Security Systems A Systematic Mapping Study. This paper presents a systematic mapping study on the model driven engineering of safety and security concerns in systems. Integrated modeling and development of both safety and security concerns is an emerging field of research. Our mapping study provides an overview of the current state of the art in this field. Through a rigorous and systematic process, this study carefully selected 95 publications out of 17,927 relevant papers published between 1992 and 2018. This paper then proposes and answers several relevant research questions about frequently used methods, development stages where these concerns are typically investigated in, or application domains. Additionally, we identify the community's preference for publication venues and trends.


Translating Asynchronous Games for Distributed Synthesis (Full Version). In distributed synthesis, we generate a set of process implementations that, together, accomplish an objective against all possible behaviors of the environment. A lot of recent work has focussed on systems with causal memory, i.e., sets of asynchronous processes that exchange their causal histories upon synchronization. Decidability results for this problem have been stated either in terms of control games, which extend Zielonka's asynchronous automata by partitioning the actions into controllable and uncontrollable, or in terms of Petri games, which extend Petri nets by partitioning the tokens into system and environment players. The precise connection between these two models was so far, however, an open question. In this paper, we provide the first formal connection between control games and Petri games. We establish the equivalence of the two game models based on weak bisimulations between their strategies. For both directions, we show that a game of one type can be translated into an equivalent game of the other type. We provide exponential upper and lower bounds for the translations. Our translations make it possible to transfer and combine decidability results between the two types of games. Exemplarily, we translate decidability in acyclic communication architectures, originally obtained for control games, to Petri games, and decidability in single process systems, originally obtained for Petri games, to control games.


Data by Proxy Material Traces as Autographic Visualizations. Information visualization limits itself, per definition, to the domain of symbolic information. This paper discusses arguments why the field should also consider forms of data that are not symbolically encoded, including physical traces and material indicators. Continuing a provocation presented by Pat Hanrahan in his 2004 IEEE Vis capstone address, this paper compares physical traces to visualizations and describes the techniques and visual practices for producing, revealing, and interpreting them. By contrasting information visualization with a speculative counter model of autographic visualization, this paper examines the design principles for material data. Autographic visualization addresses limitations of information visualization, such as the inability to directly reflect the material circumstances of data generation. The comparison between the two models allows probing the epistemic assumptions behind information visualization and uncovers linkages with the rich history of scientific visualization and trace reading.


Crowdsourcing Lightweight Pyramids for Manual Summary Evaluation. Conducting a manual evaluation is considered an essential part of summary evaluation methodology. Traditionally, the Pyramid protocol, which exhaustively compares system summaries to references, has been perceived as very reliable, providing objective scores. Yet, due to the high cost of the Pyramid method and the required expertise, researchers resorted to cheaper and less thorough manual evaluation methods, such as Responsiveness and pairwise comparison, attainable via crowdsourcing. We revisit the Pyramid approach, proposing a lightweight sampling based version that is crowdsourcable. We analyze the performance of our method in comparison to original expert based Pyramid evaluations, showing higher correlation relative to the common Responsiveness method. We release our crowdsourced Summary Content Units, along with all crowdsourcing scripts, for future evaluations.


Approximate Majority With Catalytic Inputs. Population protocols are a class of algorithms for modeling distributed computation in networks of finite state agents communicating through pairwise interactions. Their suitability for analyzing numerous chemical processes has motivated the adaptation of the original population protocol framework to better model these chemical systems. In this paper, we further the study of two such adaptations in the context of solving approximate majority persistent state agents (or catalysts) and spontaneous state changes (or leaks). Based on models considered in recent protocols for populations with persistent state agents, we assume a population with n catalytic input agents and m worker agents, and the goal of the worker agents is to compute some predicate over the states of the catalytic inputs. We call this model the Catalytic Input (CI) model. For m Theta(n) , we show that computing the parity of the input population with high probability requires at least Omega(n 2) total interactions, demonstrating a strong separation between the CI model and the standard population protocol model. On the other hand, we show that the simple third state dynamics of Angluin et al. for approximate majority in the standard model can be naturally adapted to the CI model we present such a constant state protocol for the CI model that solves approximate majority in O(n log n) total steps with high probability when the input margin is Omega( sqrt n log n ) . We then show the robustness of third state dynamics protocols to the transient leaks events introduced by Alistarh et al. In both the original and CI models, these protocols successfully compute approximate majority with high probability in the presence of leaks occurring at each step with probability beta leq O left( sqrt n log n n right) , exhibiting a resilience to leaks similar to that of Byzantine agents in previous works.


The dynamics of the stomatognathic system from 4D multimodal data. The purpose of this chapter is to discuss methods of acquisition, visualization and analysis of the dynamics of a complex biomedical system, illustrated by the human stomatognathic system. The stomatognathic system consists of the teeth and the skull bones with the maxilla and the mandible. Its dynamics can be described by the change of mutual position of the lower mandibular part versus the upper maxillary one due to the physiological motion of opening, chewing and swallowing. In order to analyse the dynamics of the stomatognathic system its morphology and motion has to be digitized, which is done using static and dynamic multimodal imagery like CBCT and 3D scans data and temporal measurements of motion. The integration of multimodal data incorporates different direct and indirect methods of registration aligning of all the data in the same coordinate system. The integrated sets of data form 4D multimodal data which can be further visualized, modeled, and subjected to multivariate time series analysis. Example results are shown. Although there is no direct method of imaging the TMJ motion, the integration of multimodal data forms an adequate tool. As medical imaging becomes ever more diverse and ever more accessible, organizing the imagery and measurements into unified, comprehensive records can deliver to the doctor the most information in the most accessible form, creating a new quality in data simulation, analysis and interpretation.


Symmetric brackets induced by connections with totally skew symmetric torsion on skew symmetric algebroids. In this note, we discuss symmetric brackets on skew symmetric algebroids associated with a metric structure. Given a pseudo Riemannian metric structure, we describe symmetric brackets induced by connections with totally skew symmetric torsion in the language of Lie derivatives and differentials of functions. In particular, we obtain an explicit formula of the Levi Civita connection. We also present some symmetric brackets on almost Hermitian manifolds. Especially, we discuss the first canonical Hermitian connection and show the formula for it in the case of nearly Kaehler manifolds using the properties of symmetric brackets.


A3D Adaptive 3D Networks for Video Action Recognition. This paper presents A3D, an adaptive 3D network that can infer at a wide range of computational constraints with one time training. Instead of training multiple models in a grid search manner, it generates good configurations by trading off between network width and spatio temporal resolution. Furthermore, the computation cost can be adapted after the model is deployed to meet variable constraints, for example, on edge devices. Even under the same computational constraints, the performance of our adaptive networks can be significantly boosted over the baseline counterparts by the mutual training along three dimensions. When a multiple pathway framework, e.g. SlowFast, is adopted, our adaptive method encourages a better trade off between pathways than manual designs. Extensive experiments on the Kinetics dataset show the effectiveness of the proposed framework. The performance gain is also verified to transfer well between datasets and tasks. Code will be made available.


Composition operator for functions of bounded variation. We study the optimal conditions on a homeomorphism f Omega subset R n to R n to guarantee that the composition u circ f belongs to the space of functions of bounded variation for every function u of bounded variation. We show that a sufficient and necessary condition is the existence of a constant K such that Df (f 1 (A)) leq K Ln(A) for all Borel sets A . We also characterize homeomorphisms which maps sets of finite perimeter to sets of finite perimeter. Towards these results we study when f 1 maps sets of measure zero onto sets of measure zero (i.e. f satisfies the Lusin (N 1 ) condition).


Heterochromatic nonlinear optical responses in upconversion nanoparticles for point spread function engineering. Point spread function (PSF) engineering of the emitter can code higher spatial frequency information of an image to break diffraction limit but suffer from the complexed optical systems. Here we present a robust strategy to simultaneously achieve diverse PSFs from upconversion nanoparticles under a single doughnut shape scanning beam. By saturating the four photon state, the high frequency information can be extracted through the doughnut emission PSF. In contrast, the complementary lower frequency information can be carried out by the Gaussian like emission PSF, as a result of over saturated at the two photon state. With the Fourier domain heterochromatic fusion, we verify the capability of the synthesised PSF to cover both low and high frequency information, yielding the overall enhanced image quality. We show a spatial resolution of 40 nm, 1 24th of the excitation wavelength. This work suggests a new scope for developing nonlinear multi colour emitting probes to improve image quality and noise control in nanoscopy.


Extending Attack Graphs to Represent Cyber Attacks in Communication Protocols and Modern IT Networks. An attack graph is a method used to enumerate the possible paths that an attacker can execute in the organization network. MulVAL is a known open source framework used to automatically generate attack graphs. MulVAL's default modeling has two main shortcomings. First, it lacks the representation of network protocol vulnerabilities, and thus it cannot be used to model common network attacks such as ARP poisoning, DNS spoofing, and SYN flooding. Second, it does not support advanced types of communication such as wireless and bus communication, and thus it cannot be used to model cyber attacks on networks that include IoT devices or industrial components. In this paper, we present an extended network security model for MulVAL that (1) considers the physical network topology, (2) supports short range communication protocols (e.g., Bluetooth), (3) models vulnerabilities in the design of network protocols, and (4) models specific industrial communication architectures. Using the proposed extensions, we were able to model multiple attack techniques including spoofing, man in the middle, and denial of service, as well as attacks on advanced types of communication. We demonstrate the proposed model on a testbed implementing a simplified network architecture comprised of both IT and industrial components.


Study of Linear Precoding and Stream Combining for Rate Splitting in MU MIMO Systems. This paper develops stream combining techniques for rate splitting (RS) multiple antenna systems with multiple users to enhance the common rate. We propose linear combining techniques based on the Min Max, the maximum ratio and the minimum mean square error criteria along with Regularized Block Diagonalization (RBD) precoders for RS based multiuser multiple antenna systems. An analysis of the sum rate performance is carried out, leading to closed form expressions. Simulations show that the proposed combining schemes offer a significant sum rate performance gain over conventional linear precoding schemes.


On all things star free. We investigate the star free closure, which associates to a class of languages its closure under Boolean operations and marked concatenation. We prove that the star free closure of any finite class and of any class of groups languages with decidable separation (plus mild additional properties) has decidable separation. We actually show decidability of a stronger property, called covering. This generalizes many results on the subject in a unified framework. A key ingredient is that star free closure coincides with another closure operator where Kleene stars are also allowed in restricted contexts.