Curved fronts of bistable reaction diffusion equations in spatially periodic media. In this paper, curved fronts are constructed for spatially periodic bistable reaction diffusion equations under the a priori assumption that there exist pulsating fronts in every direction. Some sufficient and some necessary conditions of the existence of curved fronts are given. Furthermore, the curved front is proved to be unique and stable. Finally, a curved front with varying interfaces is also constructed. Despite the effect of the spatial heterogeneity, the result shows the existence of curved fronts for spatially periodic bistable reaction diffusion equations which is known for the homogeneous case.


IR Reflection mechanism inside the annulus between two concentric cylindrical tubes. A mathematical model was derived to calculate the IR reflection inside the annulus between two concentric cylindrical tubes, where the inner side of the outer cylinder is assumed to be coated with an IR reflected mirror. The mathematical model is implemented in a simulation code and experimentally validated. The experimental results of a system of two concentric cylindrical tubes operating with an IR reflected mirror on the inside of the outer cylinder are presented, and the results between the model and the simulation are compared. It is seen that the correspondence is encouragingly close (Chi squared test p values between 0.995 and 0.80), where the simulation underestimates the experimental performance.


Realization of graded monomial ideal rings modulo torsion. Let A be the quotient of a graded polynomial ring mathbb Z x 1, cdots,x m otimes Lambda y 1, cdots,y n by an ideal generated by monomials with leading coefficients 1. Then we constructed a space X A such that A is isomorphic to H (X A) modulo torsion elements.


Man is to Person as Woman is to Location Measuring Gender Bias in Named Entity Recognition. We study the bias in several state of the art named entity recognition (NER) models specifically, a difference in the ability to recognize male and female names as PERSON entity types. We evaluate NER models on a dataset containing 139 years of U.S. census baby names and find that relatively more female names, as opposed to male names, are not recognized as PERSON entities. We study the extent of this bias in several NER systems that are used prominently in industry and academia. In addition, we also report a bias in the datasets on which these models were trained. The result of this analysis yields a new benchmark for gender bias evaluation in named entity recognition systems. The data and code for the application of this benchmark will be publicly available for researchers to use.


Beyond Identity What Information Is Stored in Biometric Face Templates?. Deeply learned face representations enable the success of current face recognition systems. Despite the ability of these representations to encode the identity of an individual, recent works have shown that more information is stored within, such as demographics, image characteristics, and social traits. This threatens the user's privacy, since for many applications these templates are expected to be solely used for recognition purposes. Knowing the encoded information in face templates helps to develop bias mitigating and privacy preserving face recognition technologies. This work aims to support the development of these two branches by analysing face templates regarding 113 attributes. Experiments were conducted on two publicly available face embeddings. For evaluating the predictability of the attributes, we trained a massive attribute classifier that is additionally able to accurately state its prediction confidence. This allows us to make more sophisticated statements about the attribute predictability. The results demonstrate that up to 74 attributes can be accurately predicted from face templates. Especially non permanent attributes, such as age, hairstyles, haircolors, beards, and various accessories, found to be easily predictable. Since face recognition systems aim to be robust against these variations, future research might build on this work to develop more understandable privacy preserving solutions and build robust and fair face templates.


Performance Enhancement for High order Gas kinetic Scheme Based on WENO adaptive order Reconstruction. High order gas kinetic scheme (HGKS) has been well developed in the past years. Abundant numerical tests including hypersonic flow, turbulence, and aeroacoustic problems, have been used to validate its accuracy, efficiency, and robustness. However, there are still rooms for its further improvement. Firstly, the reconstruction in the previous scheme mainly achieves a third order accuracy for the initial non equilibrium states. At the same time, the equilibrium state in space and time in HGKS has to be reconstructed separately. Secondly, it is complicated to get reconstructed data at Gaussian points from the WENO type method in high dimensions. For HGKS, besides the point wise values at the Gaussian points it also requires the slopes in both normal and tangential directions of a cell interface. Thirdly, there exists visible spurious overshoot undershoot at weak discontinuities from the previous HGKS with the standard WENO reconstruction. In order to overcome these difficulties, in this paper we use an improved reconstruction for HGKS. The WENO with adaptive order (WENO AO) method is implemented for reconstruction.A whole polynomial inside each cell is provided in WENO AO reconstruction. The HGKS becomes simpler than the previous one with the direct implementation of cell interface values and their slopes from WENO AO. The additional reconstruction of equilibrium state at the beginning of each time step can be avoided as well by dynamically merging the reconstructed non equilibrium slopes. The new HGKS essentially releases or totally removes the above existing problems in previous HGKS. The accuracy of the scheme from 1D to 3D from the new HGKS can recover the theoretical order of accuracy of the WENO reconstruction.In the two and three dimensional simulations, the new HGKS shows better robustness and efficiency than the previous scheme in all test cases.


Primal dual path following methods and the trust region updating strategy for linear programming with noisy data. In this article, we consider the primal dual path following method and the trust region updating strategy for the standard linear programming problem. For the rank deficient problem with the small noisy data, we also give the preprocessing method based on the QR decomposition with column pivoting. Then, we prove the global convergence of the new method when the initial point is strictly primal dual feasible. Finally, for some rank deficient problems with or without the small noisy data from the NETLIB collection, we compare it with other two popular interior point methods, i.e. the subroutine pathfollow.m and the built in subroutine linprog.m of the MATLAB environment. Numerical results show that the new method is more robust than the other two methods for the rank deficient problem with the small noise data.


Unsupervised Domain Adaptation for Multispectral Pedestrian Detection. Multimodal information (e.g., visible and thermal) can generate robust pedestrian detections to facilitate around the clock computer vision applications, such as autonomous driving and video surveillance. However, it still remains a crucial challenge to train a reliable detector working well in different multispectral pedestrian datasets without manual annotations. In this paper, we propose a novel unsupervised domain adaptation framework for multispectral pedestrian detection, by iteratively generating pseudo annotations and updating the parameters of our designed multispectral pedestrian detector on target domain. Pseudo annotations are generated using the detector trained on source domain, and then updated by fixing the parameters of detector and minimizing the cross entropy loss without back propagation. Training labels are generated using the pseudo annotations by considering the characteristics of similarity and complementarity between well aligned visible and infrared image pairs. The parameters of detector are updated using the generated labels by minimizing our defined multi detection loss function with back propagation. The optimal parameters of detector can be obtained after iteratively updating the pseudo annotations and parameters. Experimental results show that our proposed unsupervised multimodal domain adaptation method achieves significantly higher detection performance than the approach without domain adaptation, and is competitive with the supervised multispectral pedestrian detectors.


Existence of weak solutions for inhomogeneous generalized Navier Stokes equations. We prove existence of weak solutions for the fully inhomogeneous, stationary generalized Navier Stokes equations for shear thinning fluids. Our proof is based on the theory of pseudomonotone operators and the Lipschitz truncation method, whose application is presented as a general result. Our approach requires a smallness and a regularity assumption on the data we show that this is inevitable in the framework of pseudomonotone operators.


Lane Detection and Classification using Cascaded CNNs. Lane detection is extremely important for autonomous vehicles. For this reason, many approaches use lane boundary information to locate the vehicle inside the street, or to integrate GPS based localization. As many other computer vision based tasks, convolutional neural networks (CNNs) represent the state of the art technology to indentify lane boundaries. However, the position of the lane boundaries w.r.t. the vehicle may not suffice for a reliable positioning, as for path planning or localization information regarding lane types may also be needed. In this work, we present an end to end system for lane boundary identification, clustering and classification, based on two cascaded neural networks, that runs in real time. To build the system, 14336 lane boundaries instances of the TuSimple dataset for lane detection have been labelled using 8 different classes. Our dataset and the code for inference are available online.


Machine learning based co creative design framework. We propose a flexible, co creative framework bringing together multiple machine learning techniques to assist human users to efficiently produce effective creative designs. We demonstrate its potential with a perfume bottle design case study, including human evaluation and quantitative and qualitative analyses.


Group Ensemble Learning an Ensemble of ConvNets in a single ConvNet. Ensemble learning is a general technique to improve accuracy in machine learning. However, the heavy computation of a ConvNets ensemble limits its usage in deep learning. In this paper, we present Group Ensemble Network (GENet), an architecture incorporating an ensemble of ConvNets in a single ConvNet. Through a shared base and multi head structure, GENet is divided into several groups to make explicit ensemble learning possible in a single ConvNet. Owing to group convolution and the shared base, GENet can fully leverage the advantage of explicit ensemble learning while retaining the same computation as a single ConvNet. Additionally, we present Group Averaging, Group Wagging and Group Boosting as three different strategies to aggregate these ensemble members. Finally, GENet outperforms larger single networks, standard ensembles of smaller networks, and other recent state of the art methods on CIFAR and ImageNet. Specifically, group ensemble reduces the top 1 error by 1.83 for ResNeXt 50 on ImageNet. We also demonstrate its effectiveness on action recognition and object detection tasks.


Existence of infinitely many free boundary minimal hypersurfaces. In this paper, we prove that in any compact Riemannian manifold with smooth boundary, of dimension at least 3 and at most 7, there exist infinitely many almost properly embedded free boundary minimal hypersurfaces. This settles the free boundary version of Yau's conjecture. The proof uses adaptions of A. Song's work and the early works by Marques Neves in their resolution to Yau's conjecture, together with Li Zhou's regularity theorem for free boundary min max minimal hypersurfaces.


Extrema Analysis of Node Centrality in Weighted Networks. A very interesting matter of Network Science is assessing how complex a given network is. In other words, by how much does such a network departs from any general patterns which could be evoked for its description. Among other choices, these patterns can be defined in terms of node or edge properties, as one of the various modes of centrality. Although there are centrality indexes defined for weighted graphs, the discussions on this subject are far from over, especially because the influence of edge weights in this regard can vary not only in form but also in intensity, a still incipient approach so far. For the aforementioned complexity evaluation, the situation is even more acute to the best of our knowledge, this was never addressed in the literature, from the standpoint of centrality in weighted graphs. This paper details in a colorful fashion a sound methodology covering both topics, as well as experiments confirming its practical applicability and future trends in this context.


Random cographs Brownian graphon limit and asymptotic degree distribution. We consider uniform random cographs (either labeled or unlabeled) of large size. Our first main result is the convergence towards a Brownian limiting object in the space of graphons. We then show that the degree of a uniform random vertex in a uniform cograph is of order n , and converges after normalization to the Lebesgue measure on 0,1 . We finally analyze the vertex connectivity (i.e. the minimal number of vertices whose removal disconnects the graph) of random connected cographs, and show that this statistics converges in distribution without renormalization. Unlike for the graphon limit and for the degree of a random vertex, the limiting distribution is different in the labeled and unlabeled settings. Our proofs rely on the classical encoding of cographs via cotrees. We then use mainly combinatorial arguments, including the symbolic method and singularity analysis.


On the optimality of double barrier strategies for L 'evy processes. This paper studies de Finetti's optimal dividend problem with capital injection. We confirm the optimality of a double barrier strategy when the underlying risk model follows a L 'evy process that may have positive and negative jumps. The main result in this paper is a generalization of Theorem 3 in Avram et al.(2007), which is the spectrally negative case, and Theorem 3.1 in Bayraktar et al.(2013), which is the spectrally positive case. In contrast with the spectrally one sided cases, double barrier strategies cannot be handled by using scale functions to obtain some properties of the expected net present values (NPVs) of dividends and capital injections. Instead, to obtain these properties, we observe changes in the sample path (and the associated NPV) when there is a slight change to the initial value or the barrier value.


Toward Enabling Reproducibility for Data Intensive Research using the Whole Tale Platform. Whole Tale http wholetale.org is a web based, open source platform for reproducible research supporting the creation, sharing, execution, and verification of "Tales" for the scientific research community. Tales are executable research objects that capture the code, data, and environment along with narrative and workflow information needed to re create computational results from scientific studies. Creating reproducible research objects that enable reproducibility, transparency, and re execution for computational experiments requiring significant compute resources or utilizing massive data is an especially challenging open problem. We describe opportunities, challenges, and solutions to facilitating reproducibility for data and compute intensive research, that we call "Tales at Scale," using the Whole Tale computing platform. We highlight challenges and solutions in frontend responsiveness needs, gaps in current middleware design and implementation, network restrictions, containerization, and data access. Finally, we discuss challenges in packaging computational experiment implementations for portable data intensive Tales and outline future work.


Self Interaction Correction in Water Ion Clusters. We study the importance of self interaction errors in density functional approximations for various water ion clusters. We have employed the Fermi L "owdin orbital self interaction correction (FLOSIC) method in conjunction with LSDA, PBE, and SCAN to describe binding energies of hydrogen bonded water ion clusters, textit i.e. , water hydronium, water hydroxide, water halide, as well as non hydrogen bonded water alkali clusters. In the hydrogen bonded water ion clusters, the building blocks are linked by hydrogen atoms, although the links are much stronger and longer ranged than the normal hydrogen bonds between water molecules, because the monopole on the ion interacts with both permanent and induced dipoles on the water molecules. We find that self interaction errors overbind the hydrogen bonded water ion clusters and that FLOSIC reduces the error and brings the binding energies into closer agreement with higher level calculations. The non hydrogen bonded water alkali clusters are not significantly affected by self interaction errors. Self interaction corrected PBE predicts the lowest mean unsigned error in binding energies ( leq 50 meV ce H2O ) for hydrogen bonded water ion clusters. Self interaction errors are also largely dependent on the cluster size, and FLOSIC does not accurately capture the subtle variation in all clusters, indicating the need for further refinement.


P CRITICAL A Reservoir Autoregulation Plasticity Rule for Neuromorphic Hardware. Backpropagation algorithms on recurrent artificial neural networks require an unfolding of accumulated states over time. These states must be kept in memory for an undefined period of time which is task dependent. This paper uses the reservoir computing paradigm where an untrained recurrent neural network layer is used as a preprocessor stage to learn temporal and limited data. These so called reservoirs require either extensive fine tuning or neuroplasticity with unsupervised learning rules. We propose a new local plasticity rule named P CRITICAL designed for automatic reservoir tuning that translates well to Intel's Loihi research chip, a recent neuromorphic processor. We compare our approach on well known datasets from the machine learning community while using a spiking neuronal architecture. We observe an improved performance on tasks coming from various modalities without the need to tune parameters. Such algorithms could be a key to end to end energy efficient neuromorphic based machine learning on edge devices.


ColorFool Semantic Adversarial Colorization. Adversarial attacks that generate small L p norm perturbations to mislead classifiers have limited success in black box settings and with unseen classifiers. These attacks are also not robust to defenses that use denoising filters and to adversarial training procedures. Instead, adversarial attacks that generate unrestricted perturbations are more robust to defenses, are generally more successful in black box settings and are more transferable to unseen classifiers. However, unrestricted perturbations may be noticeable to humans. In this paper, we propose a content based black box adversarial attack that generates unrestricted perturbations by exploiting image semantics to selectively modify colors within chosen ranges that are perceived as natural by humans. We show that the proposed approach, ColorFool, outperforms in terms of success rate, robustness to defense frameworks and transferability, five state of the art adversarial attacks on two different tasks, scene and object classification, when attacking three state of the art deep neural networks using three standard datasets. The source code is available at https github.com smartcameras ColorFool.


Regular Isotopy Classes of Link Diagrams From Thompson's Groups. In 2014, Vaughan Jones developed a method to produce links from elements of Thompson's group F , and showed that all links arise this way. He also introduced a subgroup vec F of F and a method to produce oriented links from elements of this subgroup. In 2018, Valeriano Aiello showed that all oriented links arise from this construction. We classify exactly those regular isotopy classes of links that arise from F , as well as exactly those regular isotopy classes of oriented links that arise from vec F , answering a question asked by Jones in 2018.


Diffusions on a space of interval partitions The two parameter model. We study interval partition diffusions with Poisson Dirichlet ( alpha, theta) stationary distribution for parameters alpha in(0,1) and theta ge 0 . This extends previous work on the cases ( alpha,0) and ( alpha, alpha) and builds on our recent work on measure valued diffusions. We work on spaces of interval partitions with alpha diversity. These processes can be viewed as diffusions on the boundary of a branching graph of integer compositions. The additional order and diversity structure of such interval partitions is essential for applications to continuum random tree models such as stable CRTs and limit structures of other regenerative tree growth processes, where intervals correspond to masses of spinal subtrees (or spinal bushes) in spinal order and diversities give distances between any two spinal branch points. We further show that our processes can be extended to enter continuously from the Hausdorff completion of our state space and that, in contrast to the measure valued setting, these extensions are Feller processes.


Defocused images removal of axial overlapping scattering particles by using three dimensional nonlinear diffusion based on digital holography. We propose a three dimensional nonlinear diffusion method to implement the similar autofocusing function of multiple micro objects and simultaneously remove the defocused images, which can distinguish the locations of certain sized scattering particles that are overlapping along z axis. It is applied to all of the reconstruction slices that are generated from the captured hologram after each back propagation. For certain small sized particles, the maxima of maximum gradient magnitude of each reconstruction slice appears at the ground truth z position after applying the proposed scheme when the reconstruction range along z axis is sufficiently long and the reconstruction depth spacing is sufficiently fine. Therefore, the reconstructed image at ground truth z position is remained, while the defocused images are diffused out. The results demonstrated that the proposed scheme can diffuse out the defocused images which are 20 um away from the ground truth z position in spite of that several scattering particles with different diameters are completely overlapping along z axis with a distance of 800 um when the hologram pixel pitch is 2 um. It also demonstrated that the sparsity distribution of the ground truth z slice cannot be affected by the sparsity distribution of corresponding defocused images when the diameter of the particle is not more than 35um and the reconstruction depth spacing is not less than 20 um.


InfoMask Masked Variational Latent Representation to Localize Chest Disease. The scarcity of richly annotated medical images is limiting supervised deep learning based solutions to medical image analysis tasks, such as localizing discriminatory radiomic disease signatures. Therefore, it is desirable to leverage unsupervised and weakly supervised models. Most recent weakly supervised localization methods apply attention maps or region proposals in a multiple instance learning formulation. While attention maps can be noisy, leading to erroneously highlighted regions, it is not simple to decide on an optimal window bag size for multiple instance learning approaches. In this paper, we propose a learned spatial masking mechanism to filter out irrelevant background signals from attention maps. The proposed method minimizes mutual information between a masked variational representation and the input while maximizing the information between the masked representation and class labels. This results in more accurate localization of discriminatory regions. We tested the proposed model on the ChestX ray8 dataset to localize pneumonia from chest X ray images without using any pixel level or bounding box annotations.


Virial Relations in Density Embedding. The accuracy of charge transfer excitation energies, solvatochromic shifts and other environmental effects calculated via various density embedding techniques depend critically on the approximations employed for the non additive non interacting kinetic energy functional, T scriptscriptstyle rm s scriptscriptstyle rm nad n . Approximating this functional remains an important challenge in electronic structure theory. To assist in the development and testing of approximations for T scriptscriptstyle rm s scriptscriptstyle rm nad n , we derive two virial relations for fragments in molecules. These establish separate connections between the non additive kinetic energies of the non interacting and interacting systems of electrons, and quantities such as the electron nuclear attraction forces, the partition (or embedding) energy and potential, and the Kohn Sham potentials of the system and its parts. We numerically verify both relations on diatomic molecules.


Free quotients of fundamental groups of smooth quasi projective varieties. We consider the structure of classes of curves on a projective simply connected surface for which fundamental groups of the complements admit free quotients having rank greater than one with irreducible components belonging to a selected subset the effective cone of the surface. In particular we show a finiteness result for such classes if the ranks of free quotients of the fundamental groups with components in the subset of effective cone are sufficiently large.


Polynomial Rewritings from Expressive Description Logics with Closed Predicates to Variants of Datalog. In many scenarios, complete and incomplete information coexist. For this reason, the knowledge representation and database communities have long shown interest in simultaneously supporting the closed and the open world views when reasoning about logic theories. Here we consider the setting of querying possibly incomplete data using logic theories, formalized as the evaluation of an ontology mediated query (OMQ) that pairs a query with a theory, sometimes called an ontology, expressing background knowledge. This can be further enriched by specifying a set of closed predicates from the theory that are to be interpreted under the closed world assumption, while the rest are interpreted with the open world view. In this way we can retrieve more precise answers to queries by leveraging the partial completeness of the data. The central goal of this paper is to understand the relative expressiveness of OMQ languages in which the ontology is written in the expressive Description Logic (DL) ALCHOI and includes a set of closed predicates. We consider a restricted class of conjunctive queries. Our main result is to show that every query in this non monotonic query language can be translated in polynomial time into Datalog with negation under the stable model semantics. To overcome the challenge that Datalog has no direct means to express the existential quantification present in ALCHOI, we define a two player game that characterizes the satisfaction of the ontology, and design a Datalog query that can decide the existence of a winning strategy for the game. If there are no closed predicates, that is in the case of querying a plain ALCHOI knowledge base, our translation yields a positive disjunctive Datalog program of polynomial size. To the best of our knowledge, unlike previous translations for related fragments with expressive (non Horn) DLs, these are the first polynomial time translations.


Label free cell signaling pathway deconvolution of Angiotensin type 1 receptor reveals time resolved G protein activity and distinct AngII and AngIII IV responses. Angiotensin II (AngII) type 1 receptor (AT1R) is a G protein coupled receptor known for its role in numerous physiological processes and its implication in many vascular diseases. Its functions are mediated through G protein dependent and independent signaling pathways. AT1R has several endogenous peptidic agonists, all derived from angiotensinogen, as well as several synthetic ligands known to elicit biased signaling responses. Here, surface plasmon resonance (SPR) was used as a cell based and label free technique to quantify, in real time, the response of HEK293 cells stably expressing the human AT1R. The goal was to take advantage of the integrative nature of this assay to identify specific signaling pathways in the features of the response profiles generated by numerous endogenous and synthetic ligands of AT1R. First, we assessed the contributions of Gq, G12 13, Gi, Gbg, ERK1 2 and b eta arrestins pathways in the cellular responses measured by SPR where Gq, G12 Rho ROCK together with b eta arrestins and ERK1 2 were found to play significant roles. More specifically, we established a major role for G12 in the early events of the AT1R dependent response, which was followed by a robust ERK1 2 component associated to the later phase of the signal. Interestingly, endogenous AT1R ligands (AngII, AngIII and AngIV) exhibited distinct responses signatures with a significant increase of the ERK1 2 like components for both AngIII and AngIV, which points toward possibly distinct physiological roles for the later. We also tested AT1R biased ligands, all of which affected both the early and later events. Our results support SPR based integrative cellular assays as a powerful approach to delineate the contribution of specific signaling pathways for a given cell response and reveal response differences associated with ligands with distinct pharmacological properties.


Transformers for Modeling Physical Systems. Transformers are widely used in natural language processing due to their ability to model longer term dependencies in text. Although these models achieve state of the art performance for many language related tasks, their applicability outside of the natural language processing field has been minimal. In this work, we propose the use of transformer models for the prediction of dynamical systems representative of physical phenomena. The use of Koopman based embeddings provide a unique and powerful method for projecting any dynamical system into a vector representation which can then be predicted by a transformer. The proposed model is able to accurately predict various dynamical systems and outperform classical methods that are commonly used in the scientific machine learning literature.


CAD Deform Deformable Fitting of CAD Models to 3D Scans. Shape retrieval and alignment are a promising avenue towards turning 3D scans into lightweight CAD representations that can be used for content creation such as mobile or AR VR gaming scenarios. Unfortunately, CAD model retrieval is limited by the availability of models in standard 3D shape collections (e.g., ShapeNet). In this work, we address this shortcoming by introducing CAD Deform, a method which obtains more accurate CAD to scan fits by non rigidly deforming retrieved CAD models. Our key contribution is a new non rigid deformation model incorporating smooth transformations and preservation of sharp features, that simultaneously achieves very tight fits from CAD models to the 3D scan and maintains the clean, high quality surface properties of hand modeled CAD objects. A series of thorough experiments demonstrate that our method achieves significantly tighter scan to CAD fits, allowing a more accurate digital replica of the scanned real world environment while preserving important geometric features present in synthetic CAD environments.


Traffic lights, clumping and QBDs. In discrete time, ell blocks of red lights are separated by ell blocks of green lights. Cars arrive at random. We seek the distribution of maximum line length of idle cars, and justify conjectured probabilistic asymptotics algebraically for 2 leq ell leq3 and numerically for ell geq4 .


AI Centered on Scene Fitting and Dynamic Cognitive Network. This paper briefly analyzes the advantages and problems of AI mainstream technology and puts forward To achieve stronger Artificial Intelligence, the end to end function calculation must be changed and adopt the technology system centered on scene fitting. It also discusses the concrete scheme named Dynamic Cognitive Network model (DC Net). Discussions The knowledge and data in the comprehensive domain are uniformly represented by using the rich connection heterogeneous Dynamic Cognitive Network constructed by conceptualized elements A network structure of two dimensions and multi layers is designed to achieve unified implementation of AI core processing such as combination and generalization This paper analyzes the implementation differences of computer systems in different scenes, such as open domain, closed domain, significant probability and non significant probability, and points out that the implementation in open domain and significant probability scene is the key of AI, and a cognitive probability model combining bidirectional conditional probability, probability passing and superposition, probability col lapse is designed An omnidirectional network matching growth algorithm system driven by target and probability is designed to realize the integration of parsing, generating, reasoning, querying, learning and so on The principle of cognitive network optimization is proposed, and the basic framework of Cognitive Network Learning algorithm (CNL) is designed that structure learning is the primary method and parameter learning is the auxiliary. The logical similarity of implementation between DC Net model and human intelligence is analyzed in this paper.


The Loewy series of an FCP (distributive) ring extension. We examine the Loewy series associated to the lattice of subalgebras of an extension of commutative rings.


A kilopixel array of superconducting nanowire single photon detectors. We present a 1024 element imaging array of superconducting nanowire single photon detectors (SNSPDs) using a 32x32 row column multiplexing architecture. Large arrays are desirable for applications such as imaging, spectroscopy, or particle detection.


Deep Learning and Word Embeddings for Tweet Classification for Crisis Response. Tradition tweet classification models for crisis response focus on convolutional layers and domain specific word embeddings. In this paper, we study the application of different neural networks with general purpose and domain specific word embeddings to investigate their ability to improve the performance of tweet classification models. We evaluate four tweet classification models on CrisisNLP dataset and obtain comparable results which indicates that general purpose word embedding such as GloVe can be used instead of domain specific word embedding especially with Bi LSTM where results reported the highest performance of 62.04 F1 score.


Strong solutions of semilinear SPDEs with unbounded diffusion. We prove a modification to the classical maximal inequality for stochastic convolutions in 2 smooth Banach spaces using the factorization method. This permits to study semilinear stochastic partial differential equations with unbounded diffusion operators driven by cylindrical Brownian motion via the mild solution approach. In the case of finite dimensional driving noise, provided sufficient regularity on the coefficients, we establish existence and uniqueness of strong solutions.


The group of rational points on the Holm curve is torsion free. Using the division polynomials for elliptic curves in Weierstrass form, it shown that the group of rational points on the curve H ky(yy 1) lx(xx 1) is torsion free.


Special cases of power decay in multilinear oscillatory integrals. We use tools from the multilinear oscillatory integral program developed by Christ, Li, Thiele, and Tao to treat special cases which are not covered by existing theory. Consideration of special cases leads to an extended class of examples for which lambda power decay holds.


Functional Limit Theorems of moving averages of Hermite processes and an application to homogenization. We aim to generalize the homogenisation theorem in cite Gehringer Li tagged for a passive tracer interacting with a fractional Gau ss ian noise to also cover fractional non Gau ss ian noises. To do so we analyse limit theorems for normalized functionals of Hermite Volterra processes, extending the result in cite Diu Tran to power series with fast decaying coefficients. We obtain either convergence to a Wiener process, in the short range dependent case, or to a Hermite process, in the long range dependent case. Furthermore, we prove convergence in the multivariate case with both, short and long range dependent components. Applying this theorem we obtain a homogenisation result for a slow fast system driven by such Hermite noises.


Fast and Accurate Capitalization and Punctuation for Automatic Speech Recognition Using Transformer and Chunk Merging. In recent years, studies on automatic speech recognition (ASR) have shown outstanding results that reach human parity on short speech segments. However, there are still difficulties in standardizing the output of ASR such as capitalization and punctuation restoration for long speech transcription. The problems obstruct readers to understand the ASR output semantically and also cause difficulties for natural language processing models such as NER, POS and semantic parsing. In this paper, we propose a method to restore the punctuation and capitalization for long speech ASR transcription. The method is based on Transformer models and chunk merging that allows us to (1), build a single model that performs punctuation and capitalization in one go, and (2), perform decoding in parallel while improving the prediction accuracy. Experiments on British National Corpus showed that the proposed approach outperforms existing methods in both accuracy and decoding speed.


A State Aggregation Approach for Solving Knapsack Problem with Deep Reinforcement Learning. This paper proposes a Deep Reinforcement Learning (DRL) approach for solving knapsack problem. The proposed method consists of a state aggregation step based on tabular reinforcement learning to extract features and construct states. The state aggregation policy is applied to each problem instance of the knapsack problem, which is used with Advantage Actor Critic (A2C) algorithm to train a policy through which the items are sequentially selected at each time step. The method is a constructive solution approach and the process of selecting items is repeated until the final solution is obtained. The experiments show that our approach provides close to optimal solutions for all tested instances, outperforms the greedy algorithm, and is able to handle larger instances and more flexible than an existing DRL approach. In addition, the results demonstrate that the proposed model with the state aggregation strategy not only gives better solutions but also learns in less timesteps, than the one without state aggregation.


Input Sparsity Low Rank Approximation in Schatten Norm. We give the first input sparsity time algorithms for the rank k low rank approximation problem in every Schatten norm. Specifically, for a given n times n matrix A , our algorithm computes Y,Z in mathbb R n times k , which, with high probability, satisfy A YZ T p leq (1 epsilon) A A k p , where M p left ( sum i 1 n sigma i(M) p right ) 1 p is the Schatten p norm of a matrix M with singular values sigma 1(M), ldots, sigma n(M) , and where A k is the best rank k approximation to A . Our algorithm runs in time tilde O ( operatorname nnz (A) mn alpha p operatorname poly (k epsilon)) , where alpha p 0 for p in 1,2) and alpha p ( omega 1)(1 2 p) for p 2 and omega approx 2.374 is the exponent of matrix multiplication. For the important case of p 1 , which corresponds to the more "robust" nuclear norm, we obtain tilde O ( operatorname nnz (A) m cdot operatorname poly (k epsilon)) time, which was previously only known for the Frobenius norm ( p 2 ). Moreover, since alpha p omega 1 for every p , our algorithm has a better dependence on n than that in the singular value decomposition for every p . Crucial to our analysis is the use of dimensionality reduction for Ky Fan p norms.


SCGAN Saliency Map guided Colorization with Generative Adversarial Network. Given a grayscale photograph, the colorization system estimates a visually plausible colorful image. Conventional methods often use semantics to colorize grayscale images. However, in these methods, only classification semantic information is embedded, resulting in semantic confusion and color bleeding in the final colorized image. To address these issues, we propose a fully automatic Saliency Map guided Colorization with Generative Adversarial Network (SCGAN) framework. It jointly predicts the colorization and saliency map to minimize semantic confusion and color bleeding in the colorized image. Since the global features from pre trained VGG 16 Gray network are embedded to the colorization encoder, the proposed SCGAN can be trained with much less data than state of the art methods to achieve perceptually reasonable colorization. In addition, we propose a novel saliency map based guidance method. Branches of the colorization decoder are used to predict the saliency map as a proxy target. Moreover, two hierarchical discriminators are utilized for the generated colorization and saliency map, respectively, in order to strengthen visual perception performance. The proposed system is evaluated on ImageNet validation set. Experimental results show that SCGAN can generate more reasonable colorized images than state of the art techniques.


Existence of almost automorphic solution in distribution for a class of stochastic integro differential equation driven by Levy noise. We investigate a class of stochastic integro differential equations driven by Levy noise.


Spreading linear triple systems and expander triple systems. The existence of Steiner triple systems STS(n) of order n containing no nontrivial subsystem is well known for every admissible n. We generalize this result in two ways. First we define the expander property of 3 uniform hypergraphs and show the existence of Steiner triple systems which are almost perfect expanders. Next we define the strong and weak spreading property of linear hypergraphs, and determine the minimum size of a linear triple system with these properties, up to a small constant factor. This property is strongly connected to the connectivity of the structure and of the so called influence maximization. We also discuss how the results are related to Erd H o s' conjecture on locally sparse STSs, influence maximization, subsquare free Latin squares and possible applications in finite geometry.


A Combinatorial Cut and Lift Procedure with an Application to 0 1 Second Order Conic Programming. Cut generation and lifting are key components for the performance of state of the art mathematical programming solvers. This work proposes a new general cut and lift procedure that exploits the combinatorial structure of 0 1 problems via a binary decision diagram (BDD) encoding of their constraints. We present a general framework that can be applied to a wide range of binary optimization problems and show its applicability for second order conic inequalities. We identify conditions for which our lifted inequalities are facet defining and derive a new BDD based cut generation linear program. Such a model serves as a basis for a max flow combinatorial algorithm over the BDD that can be applied to derive valid cuts more efficiently. Our numerical results show encouraging performance when incorporated into a state of the art mathematical programming solver, significantly reducing the root node gap, increasing the number of problems solved, and reducing the run time by a factor of three on average.


Classification of homogeneous strictly pseudoconvex hypersurfaces in mathbb C 3 . Locally homogeneous strictly pseudoconvex hypersurfaces in mathbb C 2 were classified by E. ,Cartan in 1932. In this work, we complete the classification of locally homogeneous strictly pseudoconvex hypersurfaces in mathbb C 3 .


Does the h alpha index reinforce the Matthew effect in science? Agent based simulations using Stata and R. Recently, Hirsch (2019a) proposed a new variant of the h index called the h alpha index. He formulated as follows "we define the h alpha index of a scientist as the number of papers in the h core of the scientist (i.e. the set of papers that contribute to the h index of the scientist) where this scientist is the alpha author" (p. 673). The h alpha index was criticized by Leydesdorff, Bornmann, and Opthof (2019). One of their most important points is that the index reinforces the Matthew effect in science. We address this point in the current study using a recently developed Stata command (h index) and R package (hindex), which can be used to simulate h index and h alpha index applications in research evaluation. The user can investigate under which conditions h alpha reinforces the Matthew effect. The results of our study confirm what Leydesdorff et al. (2019) expected the h alpha index reinforces the Matthew effect. This effect can be intensified if strategic behavior of the publishing scientists and cumulative advantage effects are additionally considered in the simulation.


Relations between topological and metrical properties of self affine Sierpi acute text n ski sponges. We investigate two Lipschitz invariants of metric spaces defined by delta connected components, called the maximal power law property and the perfectly disconnectedness. The first property has been studied in literature for some self similar sets and Bedford McMullen carpets, while the second property seems to be new. For a self affine Sierpi acute text n ski sponge E , we first show that E satisfies the maximal power law if and only if E and all its major projections contain trivial connected components secondly, we show that E is perfectly disconnected if and only if E and all its major projections are totally disconnected.


Reliable Hubs for Partially Dynamic All Pairs Shortest Paths in Directed Graphs. We give new partially dynamic algorithms for the all pairs shortest paths problem in weighted directed graphs. Most importantly, we give a new deterministic incremental algorithm for the problem that handles updates in widetilde O (mn 4 3 log W epsilon) total time (where the edge weights are from 1,W ) and explicitly maintains a (1 epsilon) approximate distance matrix. For a fixed epsilon 0 , this is the first deterministic partially dynamic algorithm for all pairs shortest paths in directed graphs, whose update time is o(n 2) regardless of the number of edges. Furthermore, we also show how to improve the state of the art partially dynamic randomized algorithms for all pairs shortest paths Baswana et al. STOC'02, Bernstein STOC'13 from Monte Carlo randomized to Las Vegas randomized without increasing the running time bounds (with respect to the widetilde O ( cdot) notation). Our results are obtained by giving new algorithms for the problem of dynamically maintaining hubs, that is a set of widetilde O (n d) vertices which hit a shortest path between each pair of vertices, provided it has hop length Omega(d) . We give new subquadratic deterministic and Las Vegas algorithms for maintenance of hubs under either edge insertions or deletions.


Automatically Discovering and Learning New Visual Categories with Ranking Statistics. We tackle the problem of discovering novel classes in an image collection given labelled examples of other classes. This setting is similar to semi supervised learning, but significantly harder because there are no labelled examples for the new classes. The challenge, then, is to leverage the information contained in the labelled images in order to learn a general purpose clustering model and use the latter to identify the new classes in the unlabelled data. In this work we address this problem by combining three ideas (1) we suggest that the common approach of bootstrapping an image representation using the labeled data only introduces an unwanted bias, and that this can be avoided by using self supervised learning to train the representation from scratch on the union of labelled and unlabelled data (2) we use rank statistics to transfer the model's knowledge of the labelled classes to the problem of clustering the unlabelled images and, (3) we train the data representation by optimizing a joint objective function on the labelled and unlabelled subsets of the data, improving both the supervised classification of the labelled data, and the clustering of the unlabelled data. We evaluate our approach on standard classification benchmarks and outperform current methods for novel category discovery by a significant margin.


Reflection equation as a tool for studying solutions to the Yang Baxter equation. Given a right non degenerate set theoretic solution (X,r) to the Yang Baxter equation, we construct a whole family of YBE solutions r (k) on X indexed by its reflections k (i.e., solutions to the reflection equation for r ). This family includes the original solution and the classical derived solution. All these solutions induce isomorphic actions of the braid group monoid on X n . The structure monoids of r and r (k) are related by an explicit bijective 1 cocycle like map. We thus turn reflections into a tool for studying YBE solutions, rather than a side object of study. In a different direction, we study the reflection equation for non degenerate involutive YBE solutions, show it to be equivalent to (any of the) three simpler relations, and deduce from the latter systematic ways of constructing new reflections.


Efficient radiational outcoupling of electromagnetic energy from hyperbolic metamaterial resonators. Hyperbolic metamaterials were initially proposed in optics to boost radiation efficiencies of quantum emitters. Adopting this concept for antenna design can allow approaching long standing challenges in radio physics. For example, impedance matching and gain are among the most challenging antenna parameters to achieve in case when a broadband operation is needed. Here we pro pose and numerically analyse a new compact antenna design, based on hyperbolic metamaterial slab with a patterned layer on top. Energy from a subwavelength loop antenna is shown to be efficiently harvested into bulk modes of the metamaterial over a broad frequency range. Highly localized propagating waves within the medium have a well resolved spatial temporal separation owing to the hyperbolic type of effective permeability tensor. This strong interplay between chromatic and modal dispersions enables routing different frequencies into different spatial locations within compact subwavelength geometry. An array of non overlapping resonant elements is placed on the metamaterial layer and provides a superior matching of localized electromagnetic energy to the free space radiation. As the result, two order of magnitude improvement in linear gain of the device is predicted. The proposed new architecture can find a use in applications, where multiband or broadband compact devices are required.


Existence of W 1,1 solutions to a class of variational problems with linear growth on convex domains. We consider a class of convex integral functionals composed of a term of linear growth in the gradient of the argument, and a fidelity term involving L 2 distance from a datum. Such functionals are known to attain their infima in the BV space. Under the assumption that the domain of integration is convex, we prove that if the datum is in W 1,1 , then the functional has a minimizer in W 1,1 . In fact, the minimizer inherits W 1,p regularity from the datum for any p in 1, infty . We also obtain a quantitative bound on the singular part of the gradient of the minimizer in the case that the datum is in BV . We infer analogous results for the gradient flow of the underlying functional of linear growth. We admit any convex integrand of linear growth.


A Joint Model for Definition Extraction with Syntactic Connection and Semantic Consistency. Definition Extraction (DE) is one of the well known topics in Information Extraction that aims to identify terms and their corresponding definitions in unstructured texts. This task can be formalized either as a sentence classification task (i.e., containing term definition pairs or not) or a sequential labeling task (i.e., identifying the boundaries of the terms and definitions). The previous works for DE have only focused on one of the two approaches, failing to model the inter dependencies between the two tasks. In this work, we propose a novel model for DE that simultaneously performs the two tasks in a single framework to benefit from their inter dependencies. Our model features deep learning architectures to exploit the global structures of the input sentences as well as the semantic consistencies between the terms and the definitions, thereby improving the quality of the representation vectors for DE. Besides the joint inference between sentence classification and sequential labeling, the proposed model is fundamentally different from the prior work for DE in that the prior work has only employed the local structures of the input sentences (i.e., word to word relations), and not yet considered the semantic consistencies between terms and definitions. In order to implement these novel ideas, our model presents a multi task learning framework that employs graph convolutional neural networks and predicts the dependency paths between the terms and the definitions. We also seek to enforce the consistency between the representations of the terms and definitions both globally (i.e., increasing semantic consistency between the representations of the entire sentences and the terms definitions) and locally (i.e., promoting the similarity between the representations of the terms and the definitions).


Trace identities and almost polynomial growth. In this paper we study algebras with trace and their trace polynomial identities over a field of characteristic 0. We consider two commutative matrix algebras D 2 , the algebra of 2 times 2 diagonal matrices and C 2 , the algebra of 2 times 2 matrices generated by e 11 e 22 and e 12 . We describe all possible traces on these algebras and we study the corresponding trace codimensions. Moreover we characterize the varieties with trace of polynomial growth generated by a finite dimensional algebra. As a consequence, we see that the growth of a variety with trace is either polynomial or exponential.


Data efficient Learning of Morphology and Controller for a Microrobot. Robot design is often a slow and difficult process requiring the iterative construction and testing of prototypes, with the goal of sequentially optimizing the design. For most robots, this process is further complicated by the need, when validating the capabilities of the hardware to solve the desired task, to already have an appropriate controller, which is in turn designed and tuned for the specific hardware. In this paper, we propose a novel approach, HPC BBO, to efficiently and automatically design hardware configurations, and evaluate them by also automatically tuning the corresponding controller. HPC BBO is based on a hierarchical Bayesian optimization process which iteratively optimizes morphology configurations (based on the performance of the previous designs during the controller learning process) and subsequently learns the corresponding controllers (exploiting the knowledge collected from optimizing for previous morphologies). Moreover, HPC BBO can select a "batch" of multiple morphology designs at once, thus parallelizing hardware validation and reducing the number of time consuming production cycles. We validate HPC BBO on the design of the morphology and controller for a simulated 6 legged microrobot. Experimental results show that HPC BBO outperforms multiple competitive baselines, and yields a 360 reduction in production cycles over standard Bayesian optimization, thus reducing the hypothetical manufacturing time of our microrobot from 21 to 4 months.


Edge Computing for User Centric Secure Search on Cloud Based Encrypted Big Data. Cloud service providers offer a low cost and convenient solution to host unstructured data. However, cloud services act as third party solutions and do not provide control of the data to users. This has raised security and privacy concerns for many organizations (users) with sensitive data to utilize cloud based solutions. User side encryption can potentially address these concerns by establishing user centric cloud services and granting data control to the user. Nonetheless, user side encryption limits the ability to process (e.g., search) encrypted data on the cloud. Accordingly, in this research, we provide a framework that enables processing (in particular, searching) of encrypted multi organizational (i.e., multi source) big data without revealing the data to cloud provider. Our framework leverages locality feature of edge computing to offer a user centric search ability in a real time manner. In particular, the edge system intelligently predicts the user's search pattern and prunes the multi source big data search space to reduce the search time. The pruning system is based on efficient sampling from the clustered big dataset on the cloud. For each cluster, the pruning system dynamically samples appropriate number of terms based on the user's search tendency, so that the cluster is optimally represented. We developed a prototype of a user centric search system and evaluated it against multiple datasets. Experimental results demonstrate 27 improvement in the pruning quality and search accuracy.


On the rare event simulations of diffusion processes pertaining to a chain of distributed systems with small random perturbations. In this paper, we consider an importance sampling problem for a certain rare event simulations involving the behavior of a diffusion process pertaining to a chain of distributed systems with random perturbations. We also assume that the distributed system formed by n subsystems in which a small random perturbation enters in the first subsystem and then subsequently transmitted to the other subsystems satisfies an appropriate H " o rmander condition. Here we provide an efficient importance sampling estimator, with an exponential variance decay rate, for the asymptotics of the probabilities of the rare events involving such a diffusion process that also ensures a minimum relative estimation error in the small noise limit. The framework for such an analysis basically relies on the connection between the probability theory of large deviations and the values functions for a family of stochastic control problems associated with the underlying distributed system, where such a connection provides a computational paradigm based on an exponentially tilted biasing distribution for constructing efficient importance sampling estimators for the rare event simulation. Moreover, as a by product, the framework also allows us to derive a family of Hamilton Jacobi Bellman for which we also provide a solvability condition for the corresponding optimal control problem.


Refined model of the covariance correlation matrix between securities. A new methodology has been introduced to clean the correlation matrix of single stocks returns based on a constrained principal component analysis using financial data. Portfolios were introduced, namely "Fundamental Maximum Variance Portfolios", to capture in an optimal way the risks defined by financial criteria ("Book", "Capitalization", etc.). The constrained eigenvectors of the correlation matrix, which are the linear combination of these portfolios, are then analyzed. Thanks to this methodology, several stylized patterns of the matrix were identified i) the increase of the first eigenvalue with a time scale from 1 minute to several months seems to follow the same law for all the significant eigenvalues with 2 regimes ii) a universal law seems to govern the weights of all the "Maximum variance" portfolios, so according to that law, the optimal weights should be proportional to the ranking based on the financial studied criteria iii) the volatility of the volatility of the "Maximum Variance" portfolios, which are not orthogonal, could be enough to explain a large part of the diffusion of the correlation matrix iv) the leverage effect (increase of the first eigenvalue with the decline of the stock market) occurs only for the first mode and cannot be generalized for other factors of risk. The leverage effect on the beta, which is the sensitivity of stocks with the market mode, makes variable the weights of the first eigenvector.


Measurements of an AC LGAD strip sensor with a 120 GeV proton beam. The development of detectors that provide high resolution in four dimensions has attracted wide spread interest in the scientific community for several applications in high energy physics, nuclear physics, medical imaging, mass spectroscopy as well as quantum information. In addition to high time resolution and thanks to the AC coupling of the electrodes, LGAD silicon sensors can provide high resolution in the measurement of spatial coordinates of an incident minimum ionizing particle. Such AC coupled LGADs, also known as AC LGADs, are therefore considered as candidates for future detectors to provide 4 dimensional measurements in a single sensing device with 100 fill factor. This article presents the first characterization of an AC LGAD sensor with a proton beam of 120 GeV momentum at Fermilab. The sensor consists of strips with 80 mu m width, fabricated at Brookhaven National Laboratory. The signal properties, efficiency, spatial, and time resolution are presented. The experimental results show that the time resolution of such an AC LGAD is compatible to standard LGADs with similar gain, and that AC LGADs can be segmented with fine pitches as standard strip or pixel detectors.


Analyzing the Kasiski Method Against Vigenere Cipher. The weakness of the vigenere cipher lies in its short key and is repeated, so there is a key loop in encrypting messages, this is used by cryptanalysts using the Kasiski method to know the key length so it can solve this algorithm. The Kasiski method uses repetitive cryptograms found in the ciphertext to determine the key length. Modification of the vigenere cipher solves strengthen the cipher by using arranged keys to make it difficult to crack the keys against the Kasiski method attacks. This study analyzes the strength of the vigenere cipher ciphertext and the modification of the vigenere cipher from the encryption results composed of plaintexts that use different keys. Against the Kasiski method attack. The method used in this study is a quantitative method with a descriptive approach through nonparametric statistical tests on the sign test. The results showed a difference in the ciphertext's strength from the encryption process even though using the same key. The kaiseki method if can know not all key lengths the ciphertext in the compilation does not occur repetitive cryptograms. Modification of the vigenere cipher has a positive effect on the strength of the cipher and can influence the strength of the ciphertext that is built against the Kasiski method attacks.


Integration of Clinical Criteria into the Training of Deep Models Application to Glucose Prediction for Diabetic People. Standard objective functions used during the training of neural network based predictive models do not consider clinical criteria, leading to models that are not necessarily clinically acceptable. In this study, we look at this problem from the perspective of the forecasting of future glucose values for diabetic people. In this study, we propose the coherent mean squared glycemic error (gcMSE) loss function. It penalizes the model during its training not only of the prediction errors, but also on the predicted variation errors which is important in glucose prediction. Moreover, it makes possible to adjust the weighting of the different areas in the error space to better focus on dangerous regions. In order to use the loss function in practice, we propose an algorithm that progressively improves the clinical acceptability of the model, so that we can achieve the best tradeoff possible between accuracy and given clinical criteria. We evaluate the approaches using two diabetes datasets, one having type 1 patients and the other type 2 patients. The results show that using the gcMSE loss function, instead of a standard MSE loss function, improves the clinical acceptability of the models. In particular, the improvements are significant in the hypoglycemia region. We also show that this increased clinical acceptability comes at the cost of a decrease in the average accuracy of the model. Finally, we show that this tradeoff between accuracy and clinical acceptability can be successfully addressed with the proposed algorithm. For given clinical criteria, the algorithm can find the optimal solution that maximizes the accuracy while at the same meeting the criteria.


On the asymptotic behaviour of the sine product prod r 1 n 2 sin( pi r alpha) . In this paper we review recently established results on the asymptotic behaviour of the trigonometric product P n( alpha) prod r 1 n 2 sin pi r alpha as n to infty . We focus on irrationals alpha whose continued fraction coefficients are bounded. Our main goal is to illustrate that when discussing the regularity of P n( alpha) , not only the boundedness of the coefficients plays a role also their size, as well as the structure of the continued fraction expansion of alpha , is important.


Towards Robust Image Classification Using Sequential Attention Models. In this paper we propose to augment a modern neural network architecture with an attention model inspired by human perception. Specifically, we adversarially train and analyze a neural model incorporating a human inspired, visual attention component that is guided by a recurrent top down sequential process. Our experimental evaluation uncovers several notable findings about the robustness and behavior of this new model. First, introducing attention to the model significantly improves adversarial robustness resulting in state of the art ImageNet accuracies under a wide range of random targeted attack strengths. Second, we show that by varying the number of attention steps (glances fixations) for which the model is unrolled, we are able to make its defense capabilities stronger, even in light of stronger attacks resulting in a "computational race" between the attacker and the defender. Finally, we show that some of the adversarial examples generated by attacking our model are quite different from conventional adversarial examples they contain global, salient and spatially coherent structures coming from the target class that would be recognizable even to a human, and work by distracting the attention of the model away from the main object in the original image.


The lion in the attic A resolution of the Borel Kolmogorov paradox. The Borel Kolmogorov paradox of conditioning with respect to events of prior probability zero has fascinated students and researchers since its discovery more than 100 years ago. Classical conditioning is only valid with respect to events of positive probability. If we ignore this constraint and condition on such sets, for example events of type Y y for a continuously distributed random variable Y , almost any probability measure can be chosen as the conditional measure on such sets. There have been numerous descriptions and explanations of the paradox' appearance in the setting of conditioning on a subset of probability zero. However, most treatments don't supply explicit instructions on how to avoid it. We propose to close this gap by defining a version of conditional measure which utilizes the Hausdorff measure. This makes the choice canonical in the sense that it only depends on the geometry of the space, thus removing any ambiguity. We describe the set of possible measures arising in the context of the Borel Kolmogorov paradox and classify those coinciding with the canonical measure. The objective of this manuscript is to provide a manual for singular conditional probability We give an explicit explanation in which settings ambiguity arises (and where not) and how to get rid of this ambiguity once and for all by a canonical choice.


Infections and Identified Cases of COVID 19 from Random Testing Data. There are many hard to reconcile numbers circulating concerning Covid 19. Using reports from random testing, the fatality ratio per infection is evaluated and used to extract further information on the actual fraction of infections and the success of their identification for different countries.


Orientable Hamiltonian Embeddings of the Hypercube Graph. A Hamiltonian embedding is an embedding of a graph G such that the boundary of each face is a Hamiltonian cycle of G . It is shown that the hypercube graph Q n admits such an embedding on an orientable surface when n is a power of 2. Basic necessary conditions on Hamiltonian embeddings for Q n and conjectures are made about other values of n .


Equilibration of aggregation diffusion equations with weak interaction forces. This paper studies the large time behavior of aggregation diffusion equations. For one spatial dimension with certain assumptions on the interaction potential, the diffusion index m , and the initial data, we prove the convergence to the unique steady state as time goes to infinity (equilibration), with an explicit algebraic rate. The proof is based on a uniform in time bound on the first moment of the density distribution, combined with an energy dissipation rate estimate. This is the first result on the equilibration of aggregation diffusion equations for a general class of weakly confining potentials W(r) those satisfying lim r rightarrow infty W(r) infty .


Property (T) and actions on infinite measure spaces. The aim of the article is to provide a characterization of Kazhdan's property (T) for locally compact, second countable pairs of groups H subset G in terms of actions on infinite, sigma finite measure spaces. It is inspired by the recent characterization of the Haagerup property by similar actions due to T. Delabie, A. Zumbrunnen and the author.


A Novel Fuzzy Search Approach over Encrypted Data with Improved Accuracy and Efficiency. As cloud computing becomes prevalent in recent years, more and more enterprises and individuals outsource their data to cloud servers. To avoid privacy leaks, outsourced data usually is encrypted before being sent to cloud servers, which disables traditional search schemes for plain text. To meet both end of security and searchability, search supported encryption is proposed. However, many previous schemes suffer severe vulnerability when typos and semantic diversity exist in query requests. To overcome such flaw, higher error tolerance is always expected for search supported encryption design, sometimes defined as 'fuzzy search'. In this paper, we propose a new scheme of multi keyword fuzzy search over encrypted and outsourced data. Our approach introduces a new mechanism to map a natural language expression into a word vector space. Compared with previous approaches, our design shows higher robustness when multiple kinds of typos are involved. Besides, our approach is enhanced with novel data structures to improve search efficiency. These two innovations can work well for both accuracy and efficiency. Moreover, these designs will not hurt the fundamental security. Experiments on a real world dataset demonstrate the effectiveness of our proposed approach, which outperforms currently popular approaches focusing on similar tasks.


RCC Resilient Concurrent Consensus for High Throughput Secure Transaction Processing. Recently, we saw the emergence of consensus based database systems that promise resilience against failures, strong data provenance, and federated data management. Typically, these fully replicated systems are operated on top of a primary backup consensus protocol, which limits the throughput of these systems to the capabilities of a single replica (the primary). To push throughput beyond this single replica limit, we propose concurrent consensus. In concurrent consensus, replicas independently propose transactions, thereby reducing the influence of any single replica on performance. To put this idea in practice, we propose our RCC paradigm that can turn any primary backup consensus protocol into a concurrent consensus protocol by running many consensus instances concurrently. RCC is designed with performance in mind and requires minimal coordination between instances. Furthermore, RCC also promises increased resilience against failures. We put the design of RCC to the test by implementing it in ResilientDB, our high performance resilient blockchain fabric, and comparing it with state of the art primary backup consensus protocols. Our experiments show that RCC achieves up to 2.75x higher throughput than other consensus protocols and can be scaled to 91 replicas.


Efficient Oblivious Database Joins. A major algorithmic challenge in designing applications intended for secure remote execution is ensuring that they are oblivious to their inputs, in the sense that their memory access patterns do not leak sensitive information to the server. This problem is particularly relevant to cloud databases that wish to allow queries over the client's encrypted data. One of the major obstacles to such a goal is the join operator, which is non trivial to implement obliviously without resorting to generic but inefficient solutions like Oblivious RAM (ORAM). We present an oblivious algorithm for equi joins which (up to a logarithmic factor) matches the optimal O(n log n) complexity of the standard non secure sort merge join (on inputs producing O(n) outputs). We do not use use expensive primitives like ORAM or rely on unrealistic hardware or security assumptions. Our approach, which is based on sorting networks and novel provably oblivious constructions, is conceptually simple, easily verifiable, and very efficient in practice. Its data independent algorithmic structure makes it secure in various different settings for remote computation, even in those that are known to be vulnerable to certain side channel attacks (such as Intel SGX) or with strict requirements for low circuit complexity (like secure multiparty computation). We confirm that our approach is easily realizable through a compact implementation which matches our expectations for performance and is shown, both formally and empirically, to possess the desired security characteristics.


Distributionally Robust Chance Constrained Data enabled Predictive Control. We study the problem of finite time constrained optimal control of unknown stochastic linear time invariant systems, which is the key ingredient of a predictive control algorithm albeit typically having access to a model. We propose a novel distributionally robust data enabled predictive control (DeePC) algorithm which uses noise corrupted input output data to predict future trajectories and compute optimal control inputs while satisfying output chance constraints. The algorithm is based on (i) a non parametric representation of the subspace spanning the system behaviour, where past trajectories are sorted in Page or Hankel matrices and (ii) a distributionally robust optimization formulation which gives rise to strong probabilistic performance guarantees. We show that for certain objective functions, DeePC exhibits strong out of sample performance, and at the same time respects constraints with high probability. The algorithm provides an end to end approach to control design for unknown stochastic linear time invariant systems. We illustrate the closed loop performance of the DeePC in an aerial robotics case study.


Knowledge Based Strategies for Multi Agent Teams Playing Against Nature. We study teams of agents that play against Nature towards achieving a common objective. The agents are assumed to have imperfect information due to partial observability, and have no communication during the play of the game. We propose a natural notion of higher order knowledge of agents. Based on this notion, we define a class of knowledge based strategies, and consider the problem of synthesis of strategies of this class. We introduce a multi agent extension, MKBSC, of the well known Knowledge Based Subset Construction applied to such games. Its iterative applications turn out to compute higher order knowledge of the agents. We show how the MKBSC can be used for the design of knowledge based strategy profiles and investigate the transfer of existence of such strategies between the original game and in the iterated applications of the MKBSC, under some natural assumptions. We also relate and compare the "intensional" view on knowledge based strategies based on explicit knowledge representation and update, with the "extensional" view on finite memory strategies based on finite transducers and show that, in a certain sense, these are equivalent.


A High Order Discontinuous Galerkin Solver with Dynamic Adaptive Mesh Refinement to Simulate Cloud Formation Processes. We present a high order discontinuous Galerkin (DG) solver of the compressible Navier Stokes equations for cloud formation processes. The scheme exploits an underlying parallelized implementation of the ADER DG method with dynamic adaptive mesh refinement. We improve our method by a PDE independent general refinement criterion, based on the local total variation of the numerical solution. While established methods use numerics tailored towards the specific simulation, our scheme works scenario independent. Our generic scheme shows competitive results for both classical CFD and stratified scenarios. We focus on two dimensional simulations of two bubble convection scenarios over a background atmosphere. The largest simulation here uses order 6 and 6561 cells which were reduced to 1953 cells by our refinement criterion.


Collective motion planning for a group of robots using intermittent diffusion. In this work we establish a simple yet effective strategy, based on optimal transport theory, for enabling a group of robots to accomplish complex tasks, such as shape formation and assembly. We demonstrate the feasibility of this approach and rigorously prove collision avoidance and convergence properties of the proposed algorithms.


Domain Generalization for Session Independent Brain Computer Interface. The inter intra subject variability of electroencephalography (EEG) makes the practical use of the brain computer interface (BCI) difficult. In general, the BCI system requires a calibration procedure to acquire subject session specific data to tune the model every time the system is used. This problem is recognized as a major obstacle to BCI, and to overcome it, an approach based on domain generalization (DG) has recently emerged. The main purpose of this paper is to reconsider how the zero calibration problem of BCI for a realistic situation can be overcome from the perspective of DG tasks. In terms of the realistic situation, we have focused on creating an EEG classification framework that can be applied directly in unseen sessions, using only multi subject session data acquired previously. Therefore, in this paper, we tested four deep learning models and four DG algorithms through leave one session out validation. Our experiment showed that deeper and larger models were effective in cross session generalization performance. Furthermore, we found that none of the explicit DG algorithms outperformed empirical risk minimization. Finally, by comparing the results of fine tuning using subject specific data, we found that subject specific data may deteriorate unseen session classification performance due to inter session variability.


New Framework Model to Secure Cloud Data Storage. Nowadays companies are increasingly adopting the technology ofcloud computing. This technology is subject to a lot of research and continuousadvances are made. The use of cloud computing in the companies advantagessuch as reducing costs, sharing and exchange of information between institutions,but the data in the Cloud computing are susceptible to be compromisedand the companies are exposing to see their data loss. In this study, we addressthe subject of security in cloud computing we expose and discuss someresearches that had been proposed to secure the data stored in the cloud. Andthen we will present our new frameworks that ensure confidentiality of datastorage in the cloud environment


Content Caching and Delivery in Wireless Radio Access Networks. Today's mobile data traffic is dominated by content oriented traffic. Caching popular contents at the network edge can alleviate network congestion and reduce content delivery latency. This paper provides a comprehensive and unified study of caching and delivery techniques in wireless radio access networks (RANs) with caches at all edge nodes (ENs) and user equipments (UEs). Three cache aided RAN architectures are considered RANs without fronthaul, with dedicated fronthaul, and with wireless fronthaul. It first reviews in a tutorial nature how caching facilitates interference management in these networks by enabling interference cancellation (IC), zero forcing (ZF), and interference alignment (IA). Then, two new delivery schemes are presented. One is for RANs with dedicated fronthaul, which considers centralized cache placement at the ENs but both centralized and decentralized placement at the UEs. This scheme combines IA, ZF, and IC together with soft transfer fronthauling. The other is for RANs with wireless fronthaul, which considers decentralized cache placement at all nodes. It leverages the broadcast nature of wireless fronthaul to fetch not only uncached but also cached contents to boost transmission cooperation among the ENs. Numerical results show that both schemes outperform existing results for a wide range of system parameters, thanks to the various caching gains obtained opportunistically.


On Inexact Accelerated Proximal Gradient Methods with Relative Error Rules. One of the most popular and important first order iterations that provides optimal complexity of the classical proximal gradient method (PGM) is the "Fast Iterative Shrinkage Thresholding Algorithm" (FISTA). In this paper, two inexact versions of FISTA for minimizing the sum of two convex functions are studied. The proposed schemes inexactly solve their subproblems by using relative error criteria instead of exogenous and diminishing error rules. When the evaluation of the proximal operator is difficult, inexact versions of FISTA are necessary and the relative error rules proposed here may have certain advantages over previous error rules. The same optimal convergence rate of FISTA is recovered for both proposed schemes. Some numerical experiments are reported to illustrate the numerical behavior of the new approaches.


A limit theorem for the 1 st Betti number of layer 1 subgraphs in random graphs. We initiate the study of local topology of random graphs. The high level goal is to characterize local "motifs" in graphs. In this paper, we consider what we call the layer r subgraphs for an input graph G (V,E) Specifically, the layer r subgraph at vertex u in V , denoted by G u r , is the induced subgraph of G over vertex set Delta u r left v in V d G(u,v) r right , where d G is shortest path distance in G . Viewing a graph as a 1 dimensional simplicial complex, we then aim to study the 1 st Betti number of such subgraphs. Our main result is that the 1 st Betti number of layer 1 subgraphs in Erd H o s R 'enyi random graphs G(n,p) satisfies a central limit theorem.


Numerical Abstract Persuasion Argumentation for Expressing Concurrent Multi Agent Negotiations. A negotiation process by 2 agents e1 and e2 can be interleaved by another negotiation process between, say, e1 and e3. The interleaving may alter the resource allocation assumed at the inception of the first negotiation process. Existing proposals for argumentation based negotiations have focused primarily on two agent bilateral negotiations, but scarcely on the concurrency of multi agent negotiations. To fill the gap, we present a novel argumentation theory, basing its development on abstract persuasion argumentation (which is an abstract argumentation formalism with a dynamic relation). Incorporating into it numerical information and a mechanism of handshakes among members of the dynamic relation, we show that the extended theory adapts well to concurrent multi agent negotiations over scarce resources.


How to Better Distinguish Security Bug Reports (using Dual Hyperparameter Optimization. Background In order that the general public is not vulnerable to hackers, security bug reports need to be handled by small groups of engineers before being widely discussed. But learning how to distinguish the security bug reports from other bug reports is challenging since they may occur rarely. Data mining methods that can find such scarce targets require extensive optimization effort. Goal The goal of this research is to aid practitioners as they struggle to optimize methods that try to distinguish between rare security bug reports and other bug reports. Method Our proposed method, called Swift, is a dual optimizer that optimizes both learner and pre processor options. Since this is a large space of options, Swift uses a technique called epsilon dominance that learns how to avoid operations that do not significantly improve performance. Result When compared to recent state of the art results (from FARSEC which is published in TSE'18), we find that the Swift's dual optimization of both pre processor and learner is more useful than optimizing each of them individually. For example, in a study of security bug reports from the Chromium dataset, the median recalls of FARSEC and Swift were 15.7 and 77.4 , respectively. For another example, in experiments with data from the Ambari project, the median recalls improved from 21.5 to 85.7 (FARSEC to SWIFT). Conclusion Overall, our approach can quickly optimize models that achieve better recalls than the prior state of the art. These increases in recall are associated with moderate increases in false positive rates (from 8 to 24 , median). For future work, these results suggest that dual optimization is both practical and useful.


On Reductions of Hintikka Sets for Higher Order Logic. Steen's (2018) Hintikka set properties for Church's type theory based on primitive equality are reduced to the Hintikka set properties of Brown (2007). Using this reduction, a model existence theorem for Steen's properties is derived.


BERT ATTACK Adversarial Attack Against BERT Using BERT. Adversarial attacks for discrete data (such as texts) have been proved significantly more challenging than continuous data (such as images) since it is difficult to generate adversarial samples with gradient based methods. Current successful attack methods for texts usually adopt heuristic replacement strategies on the character or word level, which remains challenging to find the optimal solution in the massive space of possible combinations of replacements while preserving semantic consistency and language fluency. In this paper, we propose textbf BERT Attack , a high quality and effective method to generate adversarial samples using pre trained masked language models exemplified by BERT. We turn BERT against its fine tuned models and other deep neural models in downstream tasks so that we can successfully mislead the target models to predict incorrectly. Our method outperforms state of the art attack strategies in both success rate and perturb percentage, while the generated adversarial samples are fluent and semantically preserved. Also, the cost of calculation is low, thus possible for large scale generations. The code is available at https github.com LinyangLee BERT Attack.


A complete derived invariant for gentle algebras via winding numbers and Arf invariants. Gentle algebras are in bijection with admissible dissections of marked oriented surfaces. In this paper, we further study the properties of admissible dissections and we show that silting objects for gentle algebras are given by admissible dissections of the associated surface. We associate to each gentle algebra a line field on the corresponding surface and prove that the derived equivalence class of the algebra is completely determined by the homotopy class of the line field up to homeomorphism of the surface. Then, based on winding numbers and the Arf invariant of a certain quadratic form over mathbb Z 2 , we translate this to a numerical complete derived invariant for gentle algebras.


Bifunctional Luneburg fisheye Lens Based on the Manipulation of Spoof Surface Plasmons. Manipulation of spoof surface plasmons (SSPs) has recently intrigued enormous interest due to the capability of guiding waves with subwavelength footsteps. However, most of the previous studies, manifested for a single functionality, are not suitable for multifunctional integrated devices. Herein, a bifunctional Luneburg fisheye lens is proposed based on a two dimension metal pillar array. Firstly, by tuning the geometric dimension of the metal pillars in the array, its ability to precisely manipulate the excited SSPs along one direction is confirmed, achieving subwavelength focusing and imaging with the resolution up to 0.14 times the wavelength. Then, separately controlling the propagation of the SSPs along the orthotropic directions is further implemented, and the bifunctional Luneburg fisheye lens is realized. The bifunctional lens is characterized as a Luneburg one along the x axis, whereas in the y axis, it presents the properties of a Maxwell fisheye lens. The experimental results almost immaculately match with the simulation ones. This bifunctional lens can validly reduce the system complexity and exert flexibility in multifunctional applications, while the proposed metal pillar based design method broadens the application range of gradient refractive index lens in the microwaves, terahertz, and even optical ranges.


Polar coordinates view on KM arcs. We study presentations of KM arcs in polar coordinates. New characterizations on the points set of KM arcs are obtained in terms of power sums and bilinear forms. We also construct some examples of KM arcs in this presentation.


Switching to nonhyperbolic cycles from codimension two bifurcations of equilibria of delay differential equations. In this paper we perform the parameter dependent center manifold reduction near the generalized Hopf (Bautin), fold Hopf, Hopf Hopf and transcritical Hopf bifurcations in delay differential equations (DDEs). This allows us to initialize the continuation of codimension one equilibria and cycle bifurcations emanating from these codimension two bifurcation points. The normal form coefficients are derived in the functional analytic perturbation framework for dual semigroups (sun star calculus) using a normalization technique based on the Fredholm alternative. The obtained expressions give explicit formulas which have been implemented in the freely available numerical software package DDE BifTool. While our theoretical results are proven to apply more generally, the software implementation and examples focus on DDEs with finitely many discrete delays. Together with the continuation capabilities of DDE BifTool, this provides a powerful tool to study the dynamics near equilibria of such DDEs. The effectiveness is demonstrated on various models.


Two Point Statistics of Coherent Structure in Turbulent Flow. This review summarizes the coherent structures (CS) based on two point correlations and their applications, with a focus on the interpretation of statistic CS and their characteristics. We review studies on this topic, which have attracted attention in recent years, highlighting improvements, expansions, and promising future directions for two point statistics of CS in turbulent flow. The CS is one of typical structures of turbulent flow, transporting energy from large scale to small scale structures. To investigate the CS in turbulent flow, a large amount of two point correlation techniques for CS identification and visualization have been, and are currently being, intensively studied by researchers. Two point correlations with examples and comparisons between different methods are briefly reviewed at first. Some of the uses of correlations in both Eulerian and Lagrangian frames of reference to obtain their properties at consecutive spatial locations and time events are surveyed. Two point correlations, involving space time correlations, two point spatial correlations, and cross correlations, as essential to theories and models of turbulence and for the analyses of experimental and numerical turbulence data are then discussed. The velocity vorticity correlation structure (VVCS) as one of the statistical CS based on two point correlations is reiterated in detail. Finally, we summarize the current understanding of two point correlations of turbulence and conclude with future issues for this field.


CLRGaze Contrastive Learning of Representations for Eye Movement Signals. Eye movements are intricate and dynamic biosignals that contain a wealth of cognitive information about the subject. However, these are ambiguous signals and therefore require meticulous feature engineering to be used by machine learning algorithms. We instead propose to learn feature vectors of eye movements in a self supervised manner. We adopt a contrastive learning approach and propose a set of data transformations that encourage a deep neural network to discern salient and granular gaze patterns. This paper presents a novel experiment utilizing six eye tracking data sets despite different data specifications and experimental conditions. We assess the learned features on biometric tasks with only a linear classifier, achieving 84.6 accuracy on a mixed dataset, and up to 97.3 accuracy on a single dataset. Our work advances the state of machine learning for eye movements and provides insights into a general representation learning method not only for eye movements but also for similar biosignals.


Tag Recommendation by Word Level Tag Sequence Modeling. In this paper, we transform tag recommendation into a word based text generation problem and introduce a sequence to sequence model. The model inherits the advantages of LSTM based encoder for sequential modeling and attention based decoder with local positional encodings for learning relations globally. Experimental results on Zhihu datasets illustrate the proposed model outperforms other state of the art text classification based methods.


Generalized Sturmian Functions in prolate spheroidal coordinates. With the aim of describing bound and continuum states for diatomic molecules, we develop and implement a spectral method that makes use of Generalized Sturmian Functions (GSF) in prolate spheroidal coordinates. In order to master all computational issues, we apply here the method to one electron molecular ions and compare it with benchmark data for both ground and excited states. We actually propose two different computational schemes to solve the two coupled differential equations. The first one is an iterative 1d procedure in which one solves alternately the angular and the radial equations, the latter yielding the state energy. The second, named direct 2d method, consists in representing the Hamiltonian matrix in a two dimensional GSF basis set, and its further diagonalization. Both spectral schemes are timewise computationally efficient since the basis elements are such that no derivatives have to be calculated numerically. Moreover, very accurate results are obtained with minimal basis sets. This is related on one side to the use of the natural coordinate system and, on the other, to the intrinsic good property of all GSF basis elements that are constructed as to obey appropriate physical boundary conditions. The present implementation for bound states paves the way for the study of continuum states involved in ionization of one or two electron diatomic targets.


Well posedness and direct internal stability of coupled non degenrate Kirchhoff system via heat conduction. In the paper under study, we consider the following coupled non degenerate Kirchhoff system begin equation label P left begin aligned displaystyle y tt upvarphi Big( int Omega nabla y 2 ,dx Big) Delta y upalpha Delta uptheta 0, mbox in Omega times (0, infty) displaystyle uptheta t Delta uptheta upbeta Delta y t 0, mbox in Omega times (0, infty) displaystyle y uptheta 0, mbox on partial Omega times(0, infty) displaystyle y 0, mbox on partial Omega times(0, infty) displaystyle partial nu y 0, mbox on Gamma 1 times(0, infty) displaystyle y( cdot, 0) y 0, y t( cdot, 0) y 1, uptheta( cdot, 0) uptheta 0, mbox in Omega end aligned right. end equation where Omega is a bounded open subset of mathbb R n , upalpha and upbeta be two nonzero real numbers with the same sign and upvarphi is given by upvarphi(s) mathfrak m 0 mathfrak m 1s with some positive constants mathfrak m 0 and mathfrak m 1 . So we prove existence of solution and establish its exponential decay. The method used is based on multiplier technique and some integral inequalities due to Haraux and Komornik cite H1,KOM .


Degree bounds for projective division fields associated to elliptic modules with a trivial endomorphism ring. Let k be a global field, let A be a Dedekind domain with text Quot (A) k , and let K be a finitely generated field. Using a unified approach for both elliptic curves and Drinfeld modules M defined over K and having a trivial endomorphism ring, with k mathbb Q , A mathbb Z in the former case and k a global function field, A its ring of functions regular away from a fixed prime in the latter case, for any nonzero ideal mathfrak a lhd A we prove best possible estimates in the norm mathfrak a for the degrees over K of the subfields of the mathfrak a division fields of M fixed by scalars.