Abstract polynomial processes. We suggest a novel approach to polynomial processes solely based on a polynomial action operator. With this approach, we can analyse such processes on general state spaces, going far beyond Banach spaces. Moreover, we can be very flexible in the definition of what "polynomial" means. We show that "polynomial process" universally means "affine drift". Simple assumptions on the polynomial action operators lead to stronger characterisations on the polynomial class of processes. In our framework we do not need to specify polynomials explicitly but can work with a general sequence of graded vector spaces of functions on the state space. Elements of these graded vector spaces form the monomials by introducing a sequence of vector space complements. The basic tool of our analysis is the polynomial action operator, which is a semigroup of operators mapping conditional expected values of monomials acting on the polynomial process to monomials of the same or lower grade. Unlike the classical Euclidean case, the polynomial action operator may not form a finite dimensional subspace after a finite iteration, a property we call locally finite. We study abstract polynomial processes under both algebraic and topological assumptions on the polynomial actions, and establish an affine drift structure. Moreover, we characterize the covariance structure under similar but slightly stronger conditions. A crucial part in our analysis is the use of the (algebraic or topological) dual of the monomials of grade one, which serves as a linearization of the state space of the polynomial process. Our general framework covers polynomial processes with values in Banach spaces recently studied by Cuchiero and Svaluto Ferro.


Adversarial Prediction Guided Multi task Adaptation for Semantic Segmentation of Electron Microscopy Images. Semantic segmentation is an essential step for electron microscopy (EM) image analysis. Although supervised models have achieved significant progress, the need for labor intensive pixel wise annotation is a major limitation. To complicate matters further, supervised learning models may not generalize well on a novel dataset due to domain shift. In this study, we introduce an adversarial prediction guided multi task network to learn the adaptation of a well trained model for use on a novel unlabeled target domain. Since no label is available on target domain, we learn an encoding representation not only for the supervised segmentation on source domain but also for unsupervised reconstruction of the target data. To improve the discriminative ability with geometrical cues, we further guide the representation learning by multi level adversarial learning in semantic prediction space. Comparisons and ablation study on public benchmark demonstrated state of the art performance and effectiveness of our approach.


Multi Winner Voting with Approval Preferences. Multi winner voting is the process of selecting a fixed size set of representative candidates based on voters' preferences. It occurs in applications ranging from politics (parliamentary elections) to the design of modern computer applications (collaborative filtering, dynamic Q A platforms, diversifying search results). All these applications share the problem of identifying a representative subset of alternatives and the study of multi winner voting is the principled analysis of this task. This book provides a thorough and in depth look at multi winner voting based on approval preferences. One speaks of approval preferences if voters express their preferences by providing a set of candidates they approve. Approval preferences thus separate candidates in approved and disapproved ones, a simple, binary classification. The corresponding multi winner voting rules are called approval based committee (ABC) rules. Due to the simplicity of approval preferences, ABC rules are widely suitable for practical use. Recent years have seen a rising interest in ABC voting. While multi winner voting has been originally a topic studied by economists and political scientists, a significant share of recent progress has occurred in the field of computational social choice. This discipline is situated in the intersection of artificial intelligence, computer science, economics, and (to a lesser degree) political science, combining insights and methods from these distinct fields. The goal of this book is to present fundamental concepts and results for ABC voting and to discuss the recent advances in computational social choice. The main focus is on axiomatic analysis, algorithmic results, and relevant applications.


An Analytical Workflow for Clustering Forensic Images. Large collections of images, if curated, drastically contribute to the quality of research in many domains. Unsupervised clustering is an intuitive, yet effective step towards curating such datasets. In this work, we present a workflow for unsupervisedly clustering a large collection of forensic images. The workflow utilizes classic clustering on deep feature representation of the images in addition to domain related data to group them together. Our manual evaluation shows a purity of 89 for the resulted clusters.


On Riemann Poisson Lie groups. A Riemann Poisson Lie group is a Lie group endowed with a left invariant Riemannian metric and a left invariant Poisson tensor which are compatible in the sense introduced in C.R. Acad. Sci. Paris s 'er. bf I 333 (2001) 763 768. We study these Lie groups and we give a characterization of their Lie algebras. We give also a way of building these Lie algebras and we give the list of such Lie algebras up to dimension 5.


Green Algorithms Quantifying the carbon footprint of computation. Climate change is profoundly affecting nearly all aspects of life on earth, including human societies, economies and health. Various human activities are responsible for significant greenhouse gas emissions, including data centres and other sources of large scale computation. Although many important scientific milestones have been achieved thanks to the development of high performance computing, the resultant environmental impact has been underappreciated. In this paper, we present a methodological framework to estimate the carbon footprint of any computational task in a standardised and reliable way, based on the processing time, type of computing cores, memory available and the efficiency and location of the computing facility. Metrics to interpret and contextualise greenhouse gas emissions are defined, including the equivalent distance travelled by car or plane as well as the number of tree months necessary for carbon sequestration. We develop a freely available online tool, Green Algorithms (www.green algorithms.org), which enables a user to estimate and report the carbon footprint of their computation. The Green Algorithms tool easily integrates with computational processes as it requires minimal information and does not interfere with existing code, while also accounting for a broad range of CPUs, GPUs, cloud computing, local servers and desktop computers. Finally, by applying Green Algorithms, we quantify the greenhouse gas emissions of algorithms used for particle physics simulations, weather forecasts and natural language processing. Taken together, this study develops a simple generalisable framework and freely available tool to quantify the carbon footprint of nearly any computation. Combined with a series of recommendations to minimise unnecessary CO2 emissions, we hope to raise awareness and facilitate greener computation.


Reciprocity induced symmetry in the round trip transmission through complex systems. Reciprocity is a fundamental principle of wave physics and directly relates to the symmetry in the transmission through a system when interchanging the input and output. The coherent transmission matrix (TM) is a convenient method to characterize wave transmission through general media. Here we demonstrate the optical reciprocal nature of complex media by exploring their TM properties. We measured phase corrected TMs of forward and round trip propagation through a looped 1m long step index optical multimode fiber (MMF) to experimentally verify a transpose relationship between forward and backward transmission. This symmetry impedes straightforward MMF calibration from proximal measurements of the round trip TM. Furthermore, we show how focusing through the MMF with digital optical phase conjugation is compromised by system loss, since time reversibility relies on power conservation. These insights may inform development of new imaging techniques through complex media and coherent control of waves in photonic systems.


The global well posedness for the compressible fluid model of Korteweg type. In this paper, we consider the compressible fluid model of Korteweg type which can be used as a phase transition model. It is shown that the system admits a unique, global strong solution for small initial data in mathbb R N , N geq 3 . In this study, the main tools are the maximal L p L q regularity and L p L q decay properties of solutions to the linearized equations.


Casting dissipative compact states in coherent perfect absorbers. Coherent perfect absorption (CPA), also known as time reversed laser, is a wave phenomenon resulting from the reciprocity of destructive interference of transmitted and reflected waves. In this work we consider quasi one dimensional lattice networks which posses at least one flat band, and show that CPA and lasing can be induced in both linear and nonlinear regimes of this lattice by fine tuning non Hermitian defects (dissipative terms localized within one unit cell). We show that local dissipations that yield CPA simultaneously yield novel dissipative compact solutions of the lattice, whose growth or decay in time can be fine tuned via the dissipation parameter. The scheme used to numerically visualize the theoretical findings offers a novel platform for the experimental implementation of these phenomena in optical devices.


Frequency theorem for parabolic equations and its relation to inertial manifolds theory. We obtain a version of the Frequency Theorem (a theorem on solvability of certain operator inequalities), which allows to construct quadratic Lyapunov functionals for semilinear parabolic equations. We show that the well known Spectral Gap Condition, which was used in the theory of inertial manifolds by C. Foias, R. Temam and G. R. Sell, is a particular case of some frequency inequality, which arises within the Frequency Theorem. In particular, this allows to construct inertial manifolds for semilinear parabolic equations (including also some non autonomous problems) in the context of a more general geometric theory developed in our adjacent works. This theory is based on quadratic Lyapunov functionals and generalizes the frequency domain approach used by R. A. Smith. We also discuss the optimality of frequency inequalities and its relationship with known old and recent results in the field.


Two New Normals Forms for Polynomial Endomorphisms of the Projective Line with Applications to Postcritically Finite Maps. We explore two normal forms for polynomial endomorphisms of the projective line. The first is a normal form for degree 3 polynomials in terms of the multipliers of the fixed points. This normal form allows for an enumeration of all K rational conjugacy classes in the moduli space of degree 3 polynomials. The second normal form is for polynomials of arbitrary degree with n critical points. As an application, we give an algebraic proof of Thurston transversality in the periodic case for bicritical polynomials of any degree.


Hypocoercivity and global hypoellipticity for the kinetic Fokker Planck equation in H k spaces. The purpose of this paper is to extend the hypocoercivity results for the kinetic Fokker Planck equation in H 1 space in Villani's memoir cite Villani to higher order Sobolev spaces. As in the L 2 and H 1 setting, there is lack of coercivity in H k for the associated operator. To remedy this issue, we shall modify the usual H k norm with certain well chosen mixed terms and with suitable coefficients which are constructed by induction on k . In parallel, a similar strategy but with coefficients depending on time (c.f. cite Herau ), usually referred as H 'erau's method, can be employed to prove global hypoellipticity in H k . The exponents in our regularity estimates are optimal in short time. Moreover, as in our recent work cite GLWZ , the general results here can be applied in the mean field setting to get estimates independent of the dimension in particular, an application to the Curie Weiss model is presented.


An Entropy Equation for Energy. This paper describes an entropy equation, but one that should be used for measuring energy and not information. In relation to the human brain therefore, both of these quantities can be used to represent the stored information. The human brain makes use of energy efficiency to form its structures, which is likely to be linked to the neuron wiring. This energy efficiency can also be used as the basis for a clustering algorithm, which is described in a different paper. This paper is more of a discussion about global properties, where the rules used for the clustering algorithm can also create the entropy equation E (mean variance). This states that work is done through the energy released by the 'change' in entropy. The equation is so simplistic and generic that it can offer arguments for completely different domains, where the journey ends with a discussion about global energy properties in physics and beyond. A comparison with Einstein's relativity equation is made and also the audacious suggestion that a black hole has zero energy inside.


The statistically unbounded tau convergence on locally solid Riesz spaces. A sequence (x n) in a locally solid Riesz space (E, tau) is said to be statistically unbounded tau convergent to x in E if, for every zero neighborhood U , frac 1 n big lvert k leq n lvert x k x rvert wedge u notin U big rvert to 0 as n to infty . In this paper, we introduce this concept and give the notions st u tau closed subset, st u tau Cauchy sequence, st u tau continuous and st u tau complete locally solid vector lattice. Also, we give some relations between the order convergence and the st u tau convergence.


Stochastic Wave Equations defined by Fractal Laplacians on Cantor like Sets. We study stochastic wave equations in the sense of Walsh defined by fractal Laplacians on Cantor like sets. For this purpose, we give an improved estimate on the uniform norm of eigenfunctions and approximate the wave propagator using the resolvent density. Afterwards, we establish existence and uniqueness of mild solutions to stochastic wave equations provided some Lipschitz and linear growth conditions. We prove H "older continuity in space and time and compute the H "older exponents. Moreover, we are concerned with the phenomenon of weak intermittency.


Robustness a New Form of Heredity Motivated by Dynamic Networks. We investigate a special case of hereditary property in graphs, referred to as em robustness . A property (or structure) is called robust in a graph G if it is inherited by all the connected spanning subgraphs of G . We motivate this definition using two different settings of dynamic networks. The first corresponds to networks of low dynamicity, where some links may be permanently removed so long as the network remains connected. The second corresponds to highly dynamic networks, where communication links appear and disappear arbitrarily often, subject only to the requirement that the entities are temporally connected in a recurrent fashion ( it i.e. they can always reach each other through temporal paths). Each context induces a different interpretation of the notion of robustness. We start by motivating the definition and discussing the two interpretations, after what we consider the notion independently from its interpretation, taking as our focus the robustness of em maximal independent sets (MIS). A graph may or may not admit a robust MIS. We characterize the set of graphs forallMIS in which em all MISs are robust. Then, we turn our attention to the graphs that em admit a robust MIS ( existsMIS). This class has a more complex structure we give a partial characterization in terms of elementary graph properties, then a complete characterization by means of a (polynomial time) decision algorithm that accepts if and only if a robust MIS exists. This algorithm can be adapted to construct such a solution if one exists.


Academic viewpoints and concerns on CSCW education and training in Latin America. Computer Supported Cooperative Work, or simply CSCW, is the research area that studies the design and use of socio technical technology for supporting group work. CSCW has a long tradition in interdisciplinary work exploring technical, social, and theoretical challenges for the design of technologies to support cooperative and collaborative work and life activities. However, most of the research tradition, methods, and theories in the field follow a strong trend grounded in social and cultural aspects from North America and Western Europe. Therefore, it is inevitable that some of the underlying, and established, knowledge in the field will not be directly transferrable or applicable to other populations. This paper presents the results of an interview study conducted with Latin American faculty on the feasability, viability, and prospect of a curriculum proposal for CSCW Education in Latin America To this end, we conducted nine interviews with faculty currently based in six countries of the region, aiming to understand how a CSCW course targeted to undergraduate and or graduate students in Latin America might be deployed. Our findings suggest that there are specific traits that need to be addressed in such a course, such as tailoring foundational CSCW concepts to the diversity of local cultures, motivating the involvement of students by tackling relevant problems to their local communities, and revitalizing CSCW research and practice in the continent.


Discontinuous solutions of Hamilton Jacobi equations versus Radon measure valued solutions of scalar conservation laws Disappearance of singularities. Let H be a bounded and Lipschitz continuous function. We consider discontinuous viscosity solutions of the Hamilton Jacobi equation U t H(U x) 0 and signed Radon measure valued entropy solutions of the conservation law u t H(u) x 0 . After having proved a precise statement of the formal relation U x u , we establish estimates for the (strictly positive!) times at which singularities of the solutions disappear. Here singularities are jump discontinuities in case of the Hamilton Jacobi equation and signed singular measures in case of the conservation law.


Toward finite generation of higher rational rank valuations. We propose a finite generation conjecture for the valuation which computes the stability threshold of a log Fano pair. We also initiate a degeneration strategy of attacking the conjecture.


On tauroctonies and stars Mithras and the life of an image. A hero or a god, wearing an oriental garb and a Phrygian cap, presses his body on that of a bull to subdue it. With his flexed knee he presses the back of the animal and holds its head with his left hand, while with his right hand he stabs a dagger into the neck of the beast. Referring to this representation of the sacrifice of the bull, or tauroctony, Fritz Saxl once wrote that he could not imagine another case in which the birth of an image could be observed with such precision. Although the complete iconography of the Mithras cult varies substantially from one sanctuary to another, the tauroctony, an element always present in all temples, is considered key to its ideology. This image was not neglected by Aby Warburg and was reproduced in abundance in Panel 8 on the Ascension towards the Sun in his Bilderatlas Mnemosyne. In this work we propose to make a journey through the life of this image that, very early on, was related to the constellations, to the great circles of the celestial sphere and to certain singular moments of the seasonal cycle. We will conclude with a critical analysis of recent speculations that bring into play subtle aspects of the movement of the sky, driven by a powerful god who resided beyond the stars, and relate them to the symbolic death of the bull.


ERIC Extracting Relations Inferred from Convolutions. Our main contribution is to show that the behaviour of kernels across multiple layers of a convolutional neural network can be approximated using a logic program. The extracted logic programs yield accuracies that correlate with those of the original model, though with some information loss in particular as approximations of multiple layers are chained together or as lower layers are quantised. We also show that an extracted program can be used as a framework for further understanding the behaviour of CNNs. Specifically, it can be used to identify key kernels worthy of deeper inspection and also identify relationships with other kernels in the form of the logical rules. Finally, we make a preliminary, qualitative assessment of rules we extract from the last convolutional layer and show that kernels identified are symbolic in that they react strongly to sets of similar images that effectively divide output classes into sub classes with distinct characteristics.


Vision based Robotic Grasping From Object Localization, Object Pose Estimation to Grasp Estimation for Parallel Grippers A Review. This paper presents a comprehensive survey on vision based robotic grasping. We conclude three key tasks during vision based robotic grasping, which are object localization, object pose estimation and grasp estimation. In detail, the object localization task contains object localization without classification, object detection and object instance segmentation. This task provides the regions of the target object in the input data. The object pose estimation task mainly refers to estimating the 6D object pose and includes correspondence based methods, template based methods and voting based methods, which affords the generation of grasp poses for known objects. The grasp estimation task includes 2D planar grasp methods and 6DoF grasp methods, where the former is constrained to grasp from one direction. These three tasks could accomplish the robotic grasping with different combinations. Lots of object pose estimation methods need not object localization, and they conduct object localization and object pose estimation jointly. Lots of grasp estimation methods need not object localization and object pose estimation, and they conduct grasp estimation in an end to end manner. Both traditional methods and latest deep learning based methods based on the RGB D image inputs are reviewed elaborately in this survey. Related datasets and comparisons between state of the art methods are summarized as well. In addition, challenges about vision based robotic grasping and future directions in addressing these challenges are also pointed out.


Solutions to Donaldson's hyperk "ahler reduction on a curve. We study an infinite dimensional hyperk "ahler reduction introduced by Donaldson and associated with the constant scalar curvature equation on a Riemann surface. It is known that the corresponding moment map equations admit special solutions constructed from holomorphic quadratic differentials. Here we obtain a more general existence result and so a larger hyperk "ahler moduli space.


The Signless Laplacian Matrix of Hypergraphs. In this paper we define signless Laplacian matrix of a hypergraph and obtain structural properties from its eigenvalues. We generalize several known results for graphs, relating the spectrum of this matrix with structural parameters of the hypergraph such as the maximum degree, diameter and the chromatic number. In addition, we characterize the complete signless Laplacian spectrum for the class of the power hypergraphs from the spectrum of its base hypergraph.


Concept oriented model Modeling and processing data using functions. We describe a new logical data model, called the concept oriented model (COM). It uses mathematical functions as first class constructs for data representation and data processing as opposed to using exclusively sets in conventional set oriented models. Functions and function composition are used as primary semantic units for describing data connectivity instead of relations and relation composition (join), respectively. Grouping and aggregation are also performed by using (accumulate) functions providing an alternative to group by and reduce operations. This model was implemented in an open source data processing toolkit examples of which are used to illustrate the model and its operations. The main benefit of this model is that typical data processing tasks become simpler and more natural when using functions in comparison to adopting sets and set operations.


Global well posedness of the 4 d energy critical stochastic nonlinear Schr " o dinger equations with non vanishing boundary condition. We consider the energy critical stochastic cubic nonlinear Schr "odinger equation on mathbb R 4 with additive noise, and with the non vanishing boundary conditions at spatial infinity. By viewing this equation as a perturbation to the energy critical cubic nonlinear Schr "odinger equation on mathbb R 4 , we prove global well posedness in the energy space. Moreover, we establish unconditional uniqueness of solutions in the energy space.


Imaging human blood cells in vivo with oblique back illumination capillaroscopy. We present a non invasive, label free method of imaging blood cells flowing through human capillaries in vivo using oblique back illumination capillaroscopy (OBC). Green light illumination allows simultaneous phase and absorption contrast, enhancing the ability to distinguish red and white blood cells. Single sided illumination through the objective lens enables 200 Hz imaging with close illumination detection separation and a simplified setup. Phase contrast is optimized when the illumination axis is offset from the detection axis by approximately 225 um when imaging 80 um deep in phantoms and human ventral tongue. We demonstrate high speed imaging of individual red blood cells, white blood cells with sub cellular detail, and platelets flowing through capillaries and vessels in human tongue. A custom pneumatic cap placed over the objective lens stabilizes the field of view, enabling longitudinal imaging of a single capillary for up to seven minutes. We present high quality images of blood cells in individuals with Fitzpatrick skin phototypes II, IV, and VI, showing that the technique is robust to high peripheral melanin concentration. The signal quality, speed, simplicity, and robustness of this approach underscores its potential for non invasive blood cell counting.


View consistent 4D Light Field Depth Estimation. We propose a method to compute depth maps for every sub aperture image in a light field in a view consistent way. Previous light field depth estimation methods typically estimate a depth map only for the central sub aperture view, and struggle with view consistent estimation. Our method precisely defines depth edges via EPIs, then we diffuse these edges spatially within the central view. These depth estimates are then propagated to all other views in an occlusion aware way. Finally, disoccluded regions are completed by diffusion in EPI space. Our method runs efficiently with respect to both other classical and deep learning based approaches, and achieves competitive quantitative metrics and qualitative performance on both synthetic and real world light fields


Estimating Example Difficulty Using Variance of Gradients. In machine learning, a question of great interest is understanding what examples are challenging for a model to classify. Identifying atypical examples ensures the safe deployment of models, isolates samples that require further human inspection and provides interpretability into model behavior. In this work, we propose Variance of Gradients (VoG) as a valuable and efficient metric to rank data by difficulty and to surface a tractable subset of the most challenging examples for human in the loop auditing. We show that data points with high VoG scores are far more difficult for the model to learn and over index on corrupted or memorized examples. Further, restricting the evaluation to the test set instances with the lowest VoG improves the model's generalization performance. Finally, we show that VoG is a valuable and efficient ranking for out of distribution detection.


Comparison of R1 Mapping Protocols What are we measuring?. Purpose Recent work highlights the breadth of reported spin lattice relaxation rates ( R 1 ) for individual tissues. One potential source of variation is the protocol used to determine R 1 . The methodological dependence of R1 and relaxivity r 1 are investigated. Methods R 1 is quantified in gel phantoms with varying concentration of MnCl2, and a small cohort of three healthy volunteers using different acquisition methods. Siemens inversion recovery (IR) and saturation recovery (SR) protocols are applied to phantoms and volunteers. Variable flip angle (VFA) protocols are additionally applied to phantoms. R 1 is quantified using single voxel fits, and distributions examined for regions in the thalamus, and cerebellum as well as grey and white matter. Phantoms exclude boundary fits and relaxivity is quantified across the full concentration range. Normality of R 1 distributions is assessed by Kolmogorov Smirnov score, and inter sequence agreement by two sample t test. Results Phantom relaxivity is found to be 7.16 Hz mM, 9.22 Hz mM and 10.65 Hz mM to 11.91 Hz mM for IR, SR and VFA methods, respectively. In vivo R 1 exhibit low intra participant variation for IR. SR R 1 are lower than IR values with inter and intra participant variation on the same order. Brain regions and phantoms mapped with different protocols varied significantly with t test p values between 0 and 5E 10. Conclusion Results suggest a significant protocol dependence of R 1 , and corresponding relaxivity, suggesting inter method comparisons should be attempted tentatively, if at all.


Kernel Based Progressive Distillation for Adder Neural Networks. Adder Neural Networks (ANNs) which only contain additions bring us a new way of developing deep neural networks with low energy consumption. Unfortunately, there is an accuracy drop when replacing all convolution filters by adder filters. The main reason here is the optimization difficulty of ANNs using ell 1 norm, in which the estimation of gradient in back propagation is inaccurate. In this paper, we present a novel method for further improving the performance of ANNs without increasing the trainable parameters via a progressive kernel based knowledge distillation (PKKD) method. A convolutional neural network (CNN) with the same architecture is simultaneously initialized and trained as a teacher network, features and weights of ANN and CNN will be transformed to a new space to eliminate the accuracy drop. The similarity is conducted in a higher dimensional space to disentangle the difference of their distributions using a kernel based method. Finally, the desired ANN is learned based on the information from both the ground truth and teacher, progressively. The effectiveness of the proposed method for learning ANN with higher performance is then well verified on several benchmarks. For instance, the ANN 50 trained using the proposed PKKD method obtains a 76.8 top 1 accuracy on ImageNet dataset, which is 0.6 higher than that of the ResNet 50.


On 1 D traveltime tomography and linear inhomogeneity. In this article, we develop a 1 D traveltime tomography method to calculate the seismic P wave velocity of a medium. We use the results of 1 D tomography to obtain linear inhomogeneity parameters in a specific layer. To get the trustworthiness of the method, we perform several synthetic experiments. We show that the inverted model parameters are reasonably accurate and stable. To examine the results of linear inhomogeneity parameters using a different method, we also develop an inversion method based on a two parameter velocity model. Finally, we apply both the methods to Vertical Seismic Profile (VSP) data and do a study comparing their results.


Low dimensional offshore wave input for extreme event quantification. In offshore engineering design, nonlinear wave models are often used to propagate stochastic waves from an input boundary to the location of an offshore structure. Each wave realization is typically characterized by a high dimensional input time series, and a reliable determination of the extreme events is associated with substantial computational effort. As the sea depth decreases, extreme events become more difficult to evaluate. We here construct a low dimensional characterization of the candidate input time series to circumvent the search for extreme wave events in a high dimensional input probability space. Each wave input is represented by a unique low dimensional set of parameters for which standard surrogate approximations, such as Gaussian processes, can estimate the short term exceedance probability efficiently and accurately. We demonstrate the advantages of the new approach with a simple shallow water wave model based on the Korteweg de Vries equation for which we can provide an accurate reference solution based on the simple Monte Carlo method. We furthermore apply the method to a fully nonlinear wave model for wave propagation over a sloping seabed. The results demonstrate that the Gaussian process can learn accurately the tail of the heavy tailed distribution of the maximum wave crest elevation based on only 1.7 of the required Monte Carlo evaluations.


s DRN Stabilized Developmental Resonance Network. Online incremental clustering of sequentially incoming data without prior knowledge suffers from changing cluster numbers and tends to fall into local extrema according to given data order. To overcome these limitations, we propose a stabilized developmental resonance network (s DRN). First, we analyze the instability of the conventional choice function during the node activation process and design a scalable activation function to make clustering performance stable over all input data scales. Next, we devise three criteria for the node grouping algorithm distance, intersection over union (IoU) and size criteria. The proposed node grouping algorithm effectively excludes unnecessary clusters from incrementally created clusters, diminishes the performance dependency on vigilance parameters and makes the clustering process robust. To verify the performance of the proposed s DRN model, comparative studies are conducted on six real world datasets whose statistical characteristics are distinctive. The comparative studies demonstrate the proposed s DRN outperforms baselines in terms of stability and accuracy.


LiSA A Lightweight and Secure Authentication Mechanism for Smart Metering Infrastructure. Smart metering infrastructure (SMI) is the core component of the smart grid (SG) which enables two way communication between consumers and utility companies to control, monitor, and manage the energy consumption data. Despite their salient features, SMIs equipped with information and communication technology are associated with new threats due to their dependency on public communication networks. Therefore, the security of SMI communications raises the need for robust authentication and key agreement primitives that can satisfy the security requirements of the SG. Thus, in order to realize the aforementioned issues, this paper introduces a lightweight and secure authentication protocol, "LiSA", primarily to secure SMIs in SG setups. The protocol employs Elliptic Curve Cryptography at its core to provide various security features such as mutual authentication, anonymity, replay protection, session key security, and resistance against various attacks. Precisely, LiSA exploits the hardness of the Elliptic Curve Qu Vanstone (EVQV) certificate mechanism along with Elliptic Curve Diffie Hellman Problem (ECDHP) and Elliptic Curve Discrete Logarithm Problem (ECDLP). Additionally, LiSA is designed to provide the highest level of security relative to the existing schemes with least computational and communicational overheads. For instance, LiSA incurred barely 11.826 ms and 0.992 ms for executing different passes across the smart meter and the service providers. Further, it required a total of 544 bits for message transmission during each session.


Fibrations between finite topological spaces. We study Hurewicz fibrations between finite T 0 spaces from a combinatorial viewpoint and give strong conditions that a continuous map between finite T 0 spaces must satisfy in order to be a Hurewicz fibration. We also show that there exists a strong relationship between Hurewicz fibrations between finite T 0 spaces and Grothendieck bifibrations. Finally we give several interesting examples that illustrate this theory and show that many of the assumptions of our results are necessary.


Blow up prevention by sublinear production in a n dimensional attraction repulsion chemotaxis system. In this paper we study a zero flux attraction repulsion che mo taxis system. We show that despite any mutual interplay between the repulsive and attractive coefficients from the corresponding chemo sensitivities, even less any restriction on their own sizes, if the production rate of that chemical signal responsible of the cellular coalescence is sublinear, then any initial data emanate a unique global classical solution, which is as well bounded. Further, in a remark of the manuscript, we also address an open question given in cite Viglialoro2019RepulsionAttraction .


A Hierarchical Optimizer for Recommendation System Based on Shortest Path Algorithm. Top k Nearest Geosocial Keyword (T kNGK) query on geosocial network is defined to give users k recommendations based on some keywords and designated spatial range, and can be realized by shortest path algorithms. However, shortest path algorithm cannot provide convincing recommendations, so we design a hierarchical optimizer consisting of classifiers and a constant optimizer to optimize the result by some features of the service providers.


Assessing Classifier Fairness with Collider Bias. The increasing application of machine learning techniques in everyday decision making processes has brought concerns about the fairness of algorithmic decision making. This paper concerns the problem of collider bias which produces spurious associations in fairness assessment and develops theorems to guide fairness assessment avoiding the collider bias. We consider a real world application of auditing a trained classifier by an audit agency. We propose an unbiased assessment algorithm by utilising the developed theorems to reduce collider biases in the assessment. Experiments and simulations show the proposed algorithm reduces collider biases significantly in the assessment and is promising in auditing trained classifiers.


Strong Differential Photoion Circular Dichroism in Strong Field Ionization of Chiral Molecules. We investigate the differential ionization probability of chiral molecules in the strong field regime as a function of the helicity of the incident light. To this end, we analyze the fourfold ionization of bromochlorofluoromethane (CHBrClF) with subsequent fragmentation into four charged fragments and different dissociation channels of the singly ionized methyloxirane. We observe a variation of the differential ionization probability in a range of several percent. Accordingly, we conclude that the helicity of light is a quantity that should be considered for the theoretical description of the strong field ionization rate of chiral molecules.


Moments de la fonction Delta de Hooley associ 'ee a un caract ere. Let f be an arithmetic function, V geqslant 1 a real number and Delta V(n,f) sup limits substack u in mathbb R v in 0,V Big sum limits substack d mid n rm e u d leqslant rm e u v f(d) Big rm . In a paper published in 2012, La Bret eche and Tenenbaum investigated weighted moments of Delta 1(n,f) where f is a non principal real Dirichlet character, or the M "obius function. Answering a question of Hooley, we extend their results studying dependance in V and including the case of complex characters.


Global Cardinality Constraints Make Approximating Some Max 2 CSPs Harder. Assuming the Unique Games Conjecture, we show that existing approximation algorithms for some Boolean Max 2 CSPs with cardinality constraints are optimal. In particular, we prove that Max Cut with cardinality constraints is UG hard to approximate within approx 0.858, and that Max 2 Sat with cardinality constraints is UG hard to approximate within approx 0.929. In both cases, the previous best hardness results were the same as the hardness of the corresponding unconstrained Max 2 CSP ( approx 0.878 for Max Cut, and approx 0.940 for Max 2 Sat). The hardness obtained for Max 2 Sat applies to monotone Max 2 Sat instances, meaning that we also obtain tight inapproximability for the Max k Vertex Cover problem.


Trimming Graphs Using Clausal Proof Optimization. We present a method to gradually compute a smaller and smaller unsatisfiable core of a propositional formula by minimizing proofs of unsatisfiability. The goal is to compute a minimal unsatisfiable core that is relatively small compared to other minimal unsatisfiable cores of the same formula. We try to achieve this goal by postponing deletion of arbitrary clauses from the formula as long as possible in contrast to existing minimal unsatisfiable core algorithms. We applied this method to reduce the smallest known unit distance graph with chromatic number 5 from 553 vertices and 2720 edges to 529 vertices and 2670 edges.


Group Knowledge Transfer Federated Learning of Large CNNs at the Edge. Scaling up the convolutional neural network (CNN) size (e.g., width, depth, etc.) is known to effectively improve model accuracy. However, the large model size impedes training on resource constrained edge devices. For instance, federated learning (FL) may place undue burden on the compute capability of edge nodes, even though there is a strong practical need for FL due to its privacy and confidentiality properties. To address the resource constrained reality of edge devices, we reformulate FL as a group knowledge transfer training algorithm, called FedGKT. FedGKT designs a variant of the alternating minimization approach to train small CNNs on edge nodes and periodically transfer their knowledge by knowledge distillation to a large server side CNN. FedGKT consolidates several advantages into a single framework reduced demand for edge computation, lower communication bandwidth for large CNNs, and asynchronous training, all while maintaining model accuracy comparable to FedAvg. We train CNNs designed based on ResNet 56 and ResNet 110 using three distinct datasets (CIFAR 10, CIFAR 100, and CINIC 10) and their non I.I.D. variants. Our results show that FedGKT can obtain comparable or even slightly higher accuracy than FedAvg. More importantly, FedGKT makes edge training affordable. Compared to the edge training using FedAvg, FedGKT demands 9 to 17 times less computational power (FLOPs) on edge devices and requires 54 to 105 times fewer parameters in the edge CNN. Our source code is released at FedML (https fedml.ai).


VISON An Ontology Based Approach for Software Visualization Tool Discoverability. Although many tools have been presented in the research literature of software visualization, there is little evidence of their adoption. To choose a suitable visualization tool, practitioners need to analyze various characteristics of tools such as their supported software concerns and level of maturity. Indeed, some tools can be prototypes for which the lifespan is expected to be short, whereas others can be fairly mature products that are maintained for a longer time. Although such characteristics are often described in papers, we conjecture that practitioners willing to adopt software visualizations require additional support to discover suitable visualization tools. In this paper, we elaborate on our efforts to provide such support. To this end, we systematically analyzed research papers in the literature of software visualization and curated a catalog of 70 available tools that employ various visualization techniques to support the analysis of multiple software concerns. We further encapsulate these characteristics in an ontology. VISON, our software visualization ontology, captures these semantics as concepts and relationships. We report on early results of usage scenarios that demonstrate how the ontology can support (i) developers to find suitable tools for particular development concerns, and (ii) researchers who propose new software visualization tools to identify a baseline tool for a controlled experiment.


Simulating Photodissociation Reactions in Bad Cavities with the Lindblad Equation. Optical cavities, e.g. as used in organic polariton experiments, often employ low finesse mirrors or plasmonic structures. The photon lifetime in these setups is comparable to the timescale of the nuclear dynamics governing the photochemistry. This highlights the need for including the effect of dissipation in the molecular simulations. In this study, we perform wave packet dynamics with the Lindblad master equation, to study the effect of a finite photon lifetime on the dissociation of the MgH molecule model system. Photon lifetimes of several different orders of magnitude are considered to encompass an ample range of effects inherent to lossy cavities.


Inexact Newton Methods for Stochastic Nonconvex Optimization with Applications to Neural Network Training. We study stochastic inexact Newton methods and consider their application in nonconvex settings. Building on the work of R. Bollapragada, R. H. Byrd, and J. Nocedal, IMA Journal of Numerical Analysis, 39 (2018), pp. 545 578 we derive bounds for convergence rates in expected value for stochastic low rank Newton methods, and stochastic inexact Newton Krylov methods. These bounds quantify the errors incurred in subsampling the Hessian and gradient, as well as in approximating the Newton linear solve, and in choosing regularization and step length parameters. We deploy these methods in training convolutional autoencoders for the MNIST and CIFAR10 data sets. Numerical results demonstrate that, relative to first order methods, these stochastic inexact Newton methods often converge faster, are more cost effective, and generalize better.


Existence and uniqueness of solution of the differential equation describing the TASEP LK coupled transport process. We study the existence and uniqueness of solution of a evolutionary partial differential equation originating from the continuum limit of a coupled process of totally asymmetric simple exclusion process (TASEP) and Langmuir kinetics (LK). In the fields of physics and biology, the TASEP LK coupled process has been extensively studied by Monte Carlo simulations, numerical computations, and detailed experiments. However, no rigorous mathematical analysis so far has been given for the corresponding differential equations, especially the existence and uniqueness of their solutions. In this paper, the existence of the W 1,2 (0,1) weak steady state solution is proved by the method of upper and lower solution, and the uniqueness by a generalized maximum principle. Also, the weak steady state solution has C infty regularity, thereby being a classical solution. We further prove the global existence and uniqueness of the time dependent solution in C( 0,1 times 0, infty)) cap C 2,1 ( 0,1 times (0, infty)) , which, for any continuous initial value, converges to the steady state solution uniformly in space (global attractivity). Our results support the numerical calculations and Monte Carlo simulations, and provide theoretical foundations for the TASEP LK coupled process, especially the most important phase diagram of particle density along the travel track under different model parameters, which is difficult because the boundary layers (at one or both boundaries) and domain wall (separating high and low particle densities) may appear as the length of the travel track tends to infinity. The methods used in this paper may be instructive for studies of the more general cases of the TASEP LK process, such as the one with multiple travel tracks and or multiple particle species.


Extension operators and nonlinear structure of Banach spaces. The problem involving the extension of functions from a certain class and defined on subdomains of the ambient space to the whole space is an old and a well investigated theme in analysis. A related question whether the extensions that result in the process may be chosen in a linear or a continuous manner between appropriate spaces of functions turns out to be highly nontrivial. That this holds for the class of continuous functions defined on metric spaces is the well known Borsuk Dugundji theorem which asserts that given a metric space M and a subspace S of M, each continuous function g on S can be extended to a continuous function f on X such that the resulting assignment from C(S) to C(M) is a norm one continuous linear extension operator. The present paper is devoted to an investigation of this problem in the context of extendability of Lipschitz functions from closed subspaces of a given Banach space to the whole space such that the choice of the extended function gives rise to a bounded linear (extension) operator between appropriate spaces of Lipschitz functions. It is shown that the indicated property holds precisely when the underlying space is isomorphic to a Hilbert space. Among certain useful consequences of this theorem, we provide an isomorphic analogue of a well known theorem of S. Reich by show ing that closed convex subsets of a Banach space X arise as Lipschitz retracts of X precisely when X is isomorphically a Hilbert space. We shall also discuss the issue of bounded linear extension operators between spaces of Lipschitz functions now defined on arbitrary subsets of Banach spaces and provide a direct proof of the known non existence of such an extension operator by using methods which are more accessible than those initially employed by the authors.


Analysis and Optimization of Outage Probability in Multi Intelligent Reflecting Surface Assisted Systems. Intelligent reflecting surface (IRS) is envisioned to be a promising solution for designing spectral and energy efficient wireless systems. In this letter, we study a multi IRS assisted system under Rician fading where the phase shifts adapt to only the line of sight (LoS) components. First, we analyze and optimize the outage probability of the multi IRS assisted system in the slow fading scenario for the non LoS (NLoS) components. We also show that the optimal outage probability decreases with the numbers of IRSs and elements of each IRS when the LoS components are stronger than the NLoS ones. Then, we characterize the asymptotically optimal outage probability in the high signal to noise ratio (SNR) regime, and show that it decreases with the powers of the LoS components. To the best of our knowledge, this is the first work that studies the outage probability in multi IRS assisted systems.


On general position sets in Cartesian products. The general position number rm gp (G) of a connected graph G is the cardinality of a largest set S of vertices such that no three distinct vertices from S lie on a common geodesic such sets are refereed to as gp sets of G . The general position number of cylinders P r , square , C s is deduced. It is proved that rm gp (C r , square , C s) in 6,7 whenever r ge s ge 3 , s ne 4 , and r ge 6 . A probabilistic lower bound on the general position number of Cartesian graph powers is achieved. Along the way a formula for the number of gp sets in P r , square , P s , where r,s ge 2 , is also determined.


On Near Linear Time Algorithms for Dense Subset Sum. In the Subset Sum problem we are given a set of n positive integers X and a target t and are asked whether some subset of X sums to t . Natural parameters for this problem that have been studied in the literature are n and t as well as the maximum input number rm mx X and the sum of all input numbers Sigma X . In this paper we study the dense case of Subset Sum, where all these parameters are polynomial in n . In this regime, standard pseudo polynomial algorithms solve Subset Sum in polynomial time n O(1) . Our main question is When can dense Subset Sum be solved in near linear time tilde O (n) ? We provide an essentially complete dichotomy by designing improved algorithms and proving conditional lower bounds, thereby determining essentially all settings of the parameters n,t, rm mx X, Sigma X for which dense Subset Sum is in time tilde O (n) . For notational convenience we assume without loss of generality that t ge rm mx X (as larger numbers can be ignored) and t le Sigma X 2 (using symmetry). Then our dichotomy reads as follows By reviving and improving an additive combinatorics based approach by Galil and Margalit SICOMP'91 , we show that Subset Sum is in near linear time tilde O (n) if t gg rm mx X Sigma X n 2 . We prove a matching conditional lower bound If Subset Sum is in near linear time for any setting with t ll rm mx X Sigma X n 2 , then the Strong Exponential Time Hypothesis and the Strong k Sum Hypothesis fail. We also generalize our algorithm from sets to multi sets, albeit with non matching upper and lower bounds.


Unconstrained Periocular Recognition Using Generative Deep Learning Frameworks for Attribute Normalization. Ocular biometric systems working in unconstrained environments usually face the problem of small within class compactness caused by the multiple factors that jointly degrade the quality of the obtained data. In this work, we propose an attribute normalization strategy based on deep learning generative frameworks, that reduces the variability of the samples used in pairwise comparisons, without reducing their discriminability. The proposed method can be seen as a preprocessing step that contributes for data regularization and improves the recognition accuracy, being fully agnostic to the recognition strategy used. As proof of concept, we consider the "eyeglasses" and "gaze" factors, comparing the levels of performance of five different recognition methods with without using the proposed normalization strategy. Also, we introduce a new dataset for unconstrained periocular recognition, composed of images acquired by mobile devices, particularly suited to perceive the impact of "wearing eyeglasses" in recognition effectiveness. Our experiments were performed in two different datasets, and support the usefulness of our attribute normalization scheme to improve the recognition performance.


Weighted Dyck paths for nonstationary queues. We consider a model for a queue in which only a fixed number N of customers can join. Each customer joins the queue independently at an exponentially distributed time. Assuming further that the service times are independent and follow an exponential distribution, this system can be described as a two dimensional Markov process on a finite triangular region mathfrak S of the square lattice. We interpret the resulting random walk on mathfrak S as a Dyck path that is weighted according to some state dependent transition probabilities that are constant along one axis, but are rather general otherwise. We untangle the resulting intricate combinatorial structure by introducing appropriate generating functions that exploit the recursive structure of the model. This allows us to derive a fully explicit expression for the probability density function of the number of customers served in any busy period (equivalently, of the length of any excursion of the Dyck path above the diagonal) as a weighted sum with alternating sign over a certain subclass of Dyck paths, whose study is of independent interest.


The contact process with dynamic edges on mathbb Z . We study the contact process running in the one dimensional lattice undergoing dynamical percolation, where edges open at rate vp and close at rate v(1 p) . Our goal is to explore how the speed of the environment, v , affects the behavior of the process. We show in particular that for small enough v the process dies out, while for large v the process behaves like a contact process on mathbb Z with rate lambda p , so it survives if lambda is large. We also show that if v and p are small then the network becomes immune, in the sense that the process dies out for any infection rate lambda , while if p is sufficiently close to 1 then for all v 0 survival is possible for large enough lambda .


Counting the Number of Centralizers of 2 Element Subsets in a Finite Group. Suppose G is a finite group. The set of all centralizers of 2 element subsets of G is denoted by 2 Cent(G) . A group G is called (2,n) centralizer if 2 Cent(G) n and primitive (2,n) centralizer if 2 Cent(G) 2 Cent( frac G Z(G) ) n , where Z(G) denotes the center of G . The aim of this paper is to present the main properties of (2,n) centralizer groups among them a characterization of (2,n) centralizer and primitive (2,n) centralizer groups, n leq 9 , are given.


Orthogonality Sampling Method for the Electromagnetic Inverse Scattering Problem. This paper is concerned with the electromagnetic inverse scattering problem that aims to determine the location and shape of anisotropic scatterers from far field data (at a fixed frequency). We study the orthogonality sampling method which is a simple, fast and robust imaging method for solving the electromagnetic inverse shape problem. We first provide a theoretical foundation for the sampling method and a resolution analysis of its imaging functional. We then establish an equivalent relation between the orthogonality sampling method and direct sampling method as well as resolution analysis for the latter. The analysis used to justify the Factorization method for the far field operator plays an important role in the justifications. Finally, we present some numerical examples to validate the performance of the sampling methods for anisotropic scatterers in three dimensions.


OverSketched Newton Fast Convex Optimization for Serverless Systems. Motivated by recent developments in serverless systems for large scale computation as well as improvements in scalable randomized matrix algorithms, we develop OverSketched Newton, a randomized Hessian based optimization algorithm to solve large scale convex optimization problems in serverless systems. OverSketched Newton leverages matrix sketching ideas from Randomized Numerical Linear Algebra to compute the Hessian approximately. These sketching methods lead to inbuilt resiliency against stragglers that are a characteristic of serverless architectures. Depending on whether the problem is strongly convex or not, we propose different iteration updates using the approximate Hessian. For both cases, we establish convergence guarantees for OverSketched Newton and empirically validate our results by solving large scale supervised learning problems on real world datasets. Experiments demonstrate a reduction of 50 in total running time on AWS Lambda, compared to state of the art distributed optimization schemes.


On the Distributed Construction of Stable Networks in Polylogarithmic Parallel Time. We study the class of networks which can be created in polylogarithmic parallel time by network constructors groups of anonymous agents that interact randomly under a uniform random scheduler with the ability to form connections between each other. Starting from an empty network, the goal is to construct a stable network which belongs to a given family. We prove that the class of trees where each node has any k 2 children can be constructed in O(log n) parallel time with high probability. We show that constructing networks which are k regular is Omega(n) time, but a minimal relaxation to (l, k) regular networks, where l k 1 can be constructed in polylogarithmic parallel time for any fixed k, where k 2. We further demonstrate that when the finite state assumption is relaxed and k is allowed to grow with n, then k log log n acts as a threshold above which network construction is again polynomial time. We use this to provide a partial characterisation of the class of polylogarithmic time network constructors.


On certain sign characters of tori and their extensions to Bruhat Tits groups. We consider two sign characters defined on a tamely ramified maximal torus T of a twisted Levi subgroup M of a reductive p adic group G. We show that their product extends to the stabilizer M(F) x of any point x in the Bruhat Tits building of T, and give a formula for this extension. This result is used in the passage between zero and positive depth in the explicit construction of supercuspidal L packets, as well as in forthcoming work on the Harish Chandra character formula for supercuspidal representations.


Geometric deformations of curves in the Minkowski plane. In this paper, we extend the method developed in 17, 18 to curves in the Minkowski plane. The method proposes a way to study deformations of plane curves taking into consideration their geometry as well as their singularities. We deal in detail with all local phenomena that occur generically in 2 parameters families of curves. In each case, we obtain the geometry of the deformed curve, that is, information about inflections, vertices and lightlike points. We also obtain the behavior of the evolute caustic of a curve at especial points and the bifurcations that can occur when the curve is deformed.


Continual Domain Adaptation for Machine Reading Comprehension. Machine reading comprehension (MRC) has become a core component in a variety of natural language processing (NLP) applications such as question answering and dialogue systems. It becomes a practical challenge that an MRC model needs to learn in non stationary environments, in which the underlying data distribution changes over time. A typical scenario is the domain drift, i.e. different domains of data come one after another, where the MRC model is required to adapt to the new domain while maintaining previously learned ability. To tackle such a challenge, in this work, we introduce the textit Continual Domain Adaptation (CDA) task for MRC. So far as we know, this is the first study on the continual learning perspective of MRC. We build two benchmark datasets for the CDA task, by re organizing existing MRC collections into different domains with respect to context type and question type, respectively. We then analyze and observe the catastrophic forgetting (CF) phenomenon of MRC under the CDA setting. To tackle the CDA task, we propose several BERT based continual learning MRC models using either regularization based methodology or dynamic architecture paradigm. We analyze the performance of different continual learning MRC models under the CDA task and show that the proposed dynamic architecture based model achieves the best performance.


Comparing consecutive letter counts in multiple context free languages. Context free grammars are not able to model cross serial dependencies in natural languages. To overcome this issue, Seki et al. introduced a generalization called m multiple context free grammars ( m MCFGs), which deal with m tuples of strings. We show that m MCFGs are capable of comparing the number of consecutive occurrences of at most 2m different letters. In particular, the language a 1 n 1 a 2 n 2 dots a k n 2m 1 mid n 1 geq n 2 geq dots geq n 2m 1 geq 0 is (m 1) multiple context free, but not m multiple context free.


Programmable Event Detection for In Band Network Telemetry. In Band Network Telemetry (INT) is a novel framework for collecting telemetry items and switch internal state information from the data plane at line rate. With the support of programmable data planes and programming language P4, switches parse telemetry instruction headers and determine which telemetry items to attach using custom metadata. At the network edge, telemetry information is removed and the original packets are forwarded while telemetry reports are sent to a distributed stream processor for further processing by a network monitoring platform. In order to avoid excessive load on the stream processor, telemetry items should not be sent for each individual packet but rather when certain events are triggered. In this paper, we develop a programmable INT event detection mechanism in P4 that allows customization of which events to report to the monitoring system, on a per flow basis, from the control plane. At the stream processor, we implement a fast INT report collector using the kernel bypass technique AF XDP, which parses telemetry reports and streams them to a distributed Kafka cluster, which can apply machine learning, visualization and further monitoring tasks. In our evaluation, we use real world traces from different data center workloads and show that our approach is highly scalable and significantly reduces the network overhead and stream processor load due to effective event pre filtering inside the switch data plane. While the INT report collector can process around 3 Mpps telemetry reports per core, using event pre filtering increases the capacity by 10 15x.


Probing strong field QED with Doppler boosted PetaWatt class lasers. We propose a scheme to explore regimes of strong field Quantum Electrodynamics (SF QED) otherwise unattainable with the currently available laser technology. The scheme relies on relativistic plasma mirrors curved by radiation pressure to boost the intensity of PetaWatt class laser pulses by Doppler effect and focus them to extreme field intensities. We show that very clear SF QED signatures could be observed by placing a secondary target where the boosted beam is focused.


Improved Distributed Expander Decomposition and Nearly Optimal Triangle Enumeration. An ( epsilon, phi) expander decomposition of a graph G (V,E) is a clustering of the vertices V V 1 cup cdots cup V x such that (1) each cluster V i induces subgraph with conductance at least phi , and (2) the number of inter cluster edges is at most epsilon E . In this paper, we give an improved distributed expander decomposition. Specifically, we construct an ( epsilon, phi) expander decomposition with phi ( epsilon log n) 2 O(k) in O(n 2 k cdot text poly (1 phi, log n)) rounds for any epsilon in(0,1) and positive integer k . For example, a (0.01,1 text poly log n) expander decomposition can be computed in O(n gamma ) rounds, for any arbitrarily small constant gamma 0 . Previously, the algorithm by Chang, Pettie, and Zhang can construct a (1 6,1 text poly log n) expander decomposition using tilde O (n 1 delta ) rounds for any delta 0 , with a caveat that the algorithm is allowed to throw away a set of edges into an extra part which forms a subgraph with arboricity at most n delta . Our algorithm does not have this caveat. By slightly modifying the distributed algorithm for routing on expanders by Ghaffari, Kuhn and Su PODC'17 , we obtain a triangle enumeration algorithm using tilde O (n 1 3 ) rounds. This matches the lower bound by Izumi and Le Gall PODC'17 and Pandurangan, Robinson and Scquizzato SPAA'18 of tilde Omega (n 1 3 ) which holds even in the CONGESTED CLIQUE model. This provides the first non trivial example for a distributed problem that has essentially the same complexity (up to a polylogarithmic factor) in both CONGEST and CONGESTED CLIQUE. The key technique in our proof is the first distributed approximation algorithm for finding a low conductance cut that is as balanced as possible. Previous distributed sparse cut algorithms do not have this nearly most balanced guarantee.


Multi Objective Bayesian Optimisation and Joint Inversion for Active Sensor Fusion. A critical decision process in data acquisition for mineral and energy resource exploration is how to efficiently combine a variety of sensor types and to minimize total cost. We propose a probabilistic framework for multi objective optimisation and inverse problems given an expensive cost function for allocating new measurements. This new method is devised to jointly solve multi linear forward models of 2D sensor data and 3D geophysical properties using sparse Gaussian Process kernels while taking into account the cross variances of different parameters. Multiple optimisation strategies are tested and evaluated on a set of synthetic and real geophysical data. We demonstrate the advantages on a specific example of a joint inverse problem, recommending where to place new drill core measurements given 2D gravity and magnetic sensor data, the same approach can be applied to a variety of remote sensing problems with linear forward models ranging from constraints limiting surface access for data acquisition to adaptive multi sensor positioning.


Peacock Exploration A Lightweight Exploration for UAV using Control Efficient Trajectory. Unmanned Aerial Vehicles have received much attention in recent years due to its wide range of applications, such as exploration of an unknown environment to acquire a 3D map without prior knowledge of it. Existing exploration methods have been largely challenged by computationally heavy probabilistic path planning. Similarly, kinodynamic constraints or proper sensors considering the payload for UAVs were not considered. In this paper, to solve those issues and to consider the limited payload and computational resource of UAVs, we propose "Peacock Exploration" A lightweight exploration method for UAVs using precomputed minimum snap trajectories which look like a peacock's tail. Using the widely known, control efficient minimum snap trajectories and OctoMap, the UAV equipped with a RGB D camera can explore unknown 3D environments without any prior knowledge or human guidance with only O(logN) computational complexity. It also adopts the receding horizon approach and simple, heuristic scoring criteria. The proposed algorithm's performance is demonstrated by exploring a challenging 3D maze environment and compared with a state of the art algorithm.


The Ballet of Triangle Centers on the Elliptic Billiard. The dynamic geometry of the family of 3 periodics in the Elliptic Billiard is mystifying. Besides conserving perimeter and the ratio of inradius to circumradius, it has a stationary point. Furthermore, its triangle centers sweep out mesmerizing loci including ellipses, quartics, circles, and a slew of other more complex curves. Here we explore a bevy of new phenomena relating to (i) the shape of 3 periodics and (ii) the kinematics of certain Triangle Centers constrained to the Billiard boundary, specifically the non monotonic motion some can display with respect to 3 periodics. Hypnotizing is the joint motion of two such non monotonic Centers, whose many stops and gos are akin to a Ballet.


Implementation of a Wiener Chaos Expansion Method for the Numerical Solution of the Stochastic Generalized Kuramoto Sivashinsky Equation driven by Brownian motion forcing. Numerical computations based on the Wiener Chaos Expansion (WCE) are carried out to approximate the solutions of the stochastic generalized Kuramoto Sivashinsky (SgKS) equation driven by Brownian motion forcing. In the assessment of the accuracy of the WCE based approximate numerical solutions, the WCE based solutions are contrasted with semi analytical solutions, and the absolute and relative errors are evaluated. It is found that the absolute error is O( varsigma t) , where varsigma is small constant and t is the time variabe and the relative error is order 10 2 or less. This demonstrates that numerical methods based on the WCE are powerful tools to solve the SgKS equation or other related stochastic evolution equations.


Three lectures on quiver Grassmannians. This paper contains the material discussed in the series of three lectures that I gave during the workshop of the ICRA 2018 in Prague. I will introduce the reader to some of the techniques used in the study of the geometry of quiver Grassmannians. The notes are quite elementary and thought for phd students or young researchers. I assume that the reader is familiar with the representation theory of quivers.


The It o Tanaka Trick a non semimartingale approach. In this paper we provide an It o Tanaka Wentzell trick in a non semimartingale context. We apply this result to the study of a fractional SDE with irregular drift coefficient.


Bit Interleaved Coded Multiple Beamforming in Millimeter Wave Massive MIMO Systems. An analysis of the diversity gain for bit interleaved coded multiple beamforming (BICMB) method in millimeter wave (mm Wave) massive multiple input multiple output (MIMO) systems is carried out for both the single user and multi user scenario. We show that the diversity gain is independent of the number of data streams and full spatial multiplexing order can be achieved in both scenarios. Also, we show that the diversity gain in the multi user scenario is independent of the number of users in the system and only depends on the number of the remote antenna units (RAUs) at the transmitter side, when each user has only one RAU. The assumption here is that the channel state information (CSI) is known at both sides of the transmitter and the receiver and the number of antennas in each RAU goes to infinity. This latter assumption can be relaxed by a large number of antennas in each RAU, similar to the case for all massive MIMO research. Based on these assumptions, the diversity gain for the single user scenario is frac left( sum i,j beta ij right) 2 sum i,j beta ij 2L ij 1 where L ij is the number of propagation paths and beta ij is the large scale fading coefficient between the i th RAU in the transmitter and the j th RAU in the receiver. The diversity gain in the multi user scenario for the k th user is frac M 2 sum j L kj 1 where M represents the number of RAUs at the transmitter. Simulation results show that when the perfect channel state information assumption is satisfied, the use of BICMB results in the diversity gain values predicted by the analysis.


Graceful and Prime Labelings Algorithms, Embeddings and Conjectures. Four algorithms giving rise to graceful graphs from a known (non)graceful graph are described. Some necessary conditions for a graph to be highly graceful and critical are given. Finally some conjectures are made on graceful, critical and highly graceful graphs. The RingelRosaKotzig Conjecture is generalized to highly graceful graphs. MayedaSeshu Tree Generation Algorithm is modified to generate all possible graceful labelings of trees of order p. An alternative algorithm in terms of integers modulo p is described which includes all possible graceful labelings of trees of order p and some interesting properties are observed. Optimal and graceful graph embeddings (not necessarily connected) are given. Alternative proofs for embedding a graph into a graceful graph as a subgraph and as an induced subgraph are included. An algorithm to obtain an optimal graceful embedding is described. A necessary condition for a graph to be supergraceful is given. As a consequence some classes of nonsupergraceful graphs are obtained. Embedding problems of a graph into a supergraceful graph are studied. A catalogue of super graceful graphs with at most five nodes is appended. Optimal graceful and supergraceful embeddings of a graph are given. Graph theoretical properties of prime and superprime graphs are listed. Good upper bound for minimum number of edges in a nonprime graph is given and some conjectures are proposed which in particular includes Entringers prime tree conjecture. A conjecture for regular prime graphs is also proposed.


A note on uniform exponential stability of linear periodic time varying systems. In this paper we derive new criterion for uniform stability assessment of the linear periodic time varying systems dot x A(t)x, A(t T) A(t). As a corollary, the lower and upper bounds for the Floquet characteristic exponents are established. The approach is based on the use of logarithmic norm of the system matrix A(t). Finally we analyze the robustness of the stability property under external disturbance.


Supersymmetric monoidal categories. We develop the idea of a supersymmetric monoidal supercategory, following ideas of Kapranov. Roughly, this is a monoidal category in which the objects and morphisms are bf Z 2 graded, equipped with isomorphisms X otimes Y to Y otimes X of parity vert X vert vert Y vert on homogeneous objects. There are two fundamental examples the groupoid of spin sets, and the category of queer vector spaces equipped with the half tensor product other important examples can be derived from these (such as the category of linear spin species). There are also two general constructions. The first is the exterior algebra of a supercategory (due to Ganter Kapranov). The second is a construction we introduce called Clifford eversion. This defines an equivalence between a certain 2 category of supersymmetric monoidal supercategories and a corresponding 2 category of symmetric monoidal supercategories. We use our theory to better understand some aspects of the queer superalgebra, such as certain factors of sqrt 2 in the theory of Q symmetric functions and Schur Sergeev duality.


Deciding the existence of quasi weak near unanimity terms in finite algebras. We show that for a fixed positive integer k one can efficiently decide if a finite algebra A admits a k ary weak near unanimity operation by looking at the local behavior of the terms of A. We also observe that the problem of deciding if a given finite algebra has a quasi Taylor operation is solvable in polynomial time by looking, essentially, for local quasi Siggers operations.


Geometrical Optical Illusion via Sub Riemannian Geodesics in the Roto Translation Group. We present a neuro mathematical model for geometrical optical illusions (GOIs), a class of illusory phenomena that consists in a mismatch of geometrical properties of the visual stimulus and its associated percept. They take place in the visual areas V1 V2 whose functional architecture have been modelled in previous works by Citti and Sarti as a Lie group equipped with a sub Riemannian (SR) metric. Here we extend their model proposing that the metric responsible for the cortical connectivity is modulated by the modelled neuro physiological response of simple cells to the visual stimulus, hence providing a more biologically plausible model that takes into account a presence of visual stimulus. Illusory contours in our model are described as geodesics in the new metric. The model is confirmed by numerical simulations, where we compute the geodesics via SR Fast Marching.


Performance optimization and modeling of fine grained irregular communication in UPC. The UPC programming language offers parallelism via logically partitioned shared memory, which typically spans physically disjoint memory sub systems. One convenient feature of UPC is its ability to automatically execute between thread data movement, such that the entire content of a shared data array appears to be freely accessible by all the threads. The programmer friendliness, however, can come at the cost of substantial performance penalties. This is especially true when indirectly indexing the elements of a shared array, for which the induced between thread data communication can be irregular and have a fine grained pattern. In this paper we study performance enhancement strategies specifically targeting such fine grained irregular communication in UPC. Starting from explicit thread privatization, continuing with block wise communication, and arriving at message condensing and consolidation, we obtained considerable performance improvement of UPC programs that originally require fine grained irregular communication. Besides the performance enhancement strategies, the main contribution of the present paper is to propose performance models for the different scenarios, in form of quantifiable formulas that hinge on the actual volumes of various data movements plus a small number of easily obtainable hardware characteristic parameters. These performance models help to verify the enhancements obtained, while also providing insightful predictions of similar parallel implementations, not limited to UPC, that also involve between thread or between process irregular communication. As a further validation, we also apply our performance modeling methodology and hardware characteristic parameters to an existing UPC code for solving a 2D heat equation on a uniform mesh.


Measuring Cellular Ion Transport by Magnetoencephalography. The cellular level process of ion transport is known to generate a magnetic field. A non invasive magnetoencephalography (MEG) technique was used to measure the magnetic field emanating from HeLa, HEK293 and H9c2(2 1) rat cardiac cells. The addition of a non lethal dose of ionomycin to HeLa and capsaicin to TRPV1 expressing HEK293 cells, respectively, resulted in a sudden change in the magnetic field signal consistent with Ca2 influx, which was also observed by confocal fluorescence microscopy under the same conditions. In contrast, addition of capsaicin to TRPV1 expressing HEK293 cells containing an optimum amount of Ca2 channel blockers, a TRPV1 antagonist (ruthenium red), resulted in no detectable magnetic or fluorescent signals. These signals confirmed that the measured MEG signals are due to cellular ion transport through the cell membrane. In general, there is evidence that ion channel transporter activation and ionic flux are linked to cancer Therefore, our work suggests that MEG could represent a non invasive method for detecting cancer.


Competitive Mirror Descent. Constrained competitive optimization involves multiple agents trying to minimize conflicting objectives, subject to constraints. This is a highly expressive modeling language that subsumes most of modern machine learning. In this work we propose competitive mirror descent (CMD) a general method for solving such problems based on first order information that can be obtained by automatic differentiation. First, by adding Lagrange multipliers, we obtain a simplified constraint set with an associated Bregman potential. At each iteration, we then solve for the Nash equilibrium of a regularized bilinear approximation of the full problem to obtain a direction of movement of the agents. Finally, we obtain the next iterate by following this direction according to the dual geometry induced by the Bregman potential. By using the dual geometry we obtain feasible iterates despite only solving a linear system at each iteration, eliminating the need for projection steps while still accounting for the global nonlinear structure of the constraint set. As a special case we obtain a novel competitive multiplicative weights algorithm for problems on the positive cone.


Understanding Team Collaboration in Artificial Intelligence from the perspective of Geographic Distance. This paper analyzes team collaboration in the field of Artificial Intelligence (AI) from the perspective of geographic distance. We obtained 1,584,175 AI related publications during 1950 2019 from the Microsoft Academic Graph. Three latitude and longitude based indicators were employed to quantify the geographic distance of collaborations in AI over time at domestic and international levels. The results show team collaborations in AI has been more popular in the field over time with around 42,000 (38.4 ) multiple affiliation AI publications in 2019. The changes in geographic distances of team collaborations indicate the increase of breadth and density for both domestic and international collaborations in AI over time. In addition, the United States produced the largest number of single country and internationally collaborated AI publications, and China has played an important role in international collaborations in AI after 2010.


Downlink Analysis for the Typical Cell in Poisson Cellular Networks. Owing to its unparalleled tractability, the Poisson point process (PPP) has emerged as a popular model for the analysis of cellular networks. Considering a stationary point process of users, which is independent of the base station (BS) point process, it is well known that the typical user does not lie in the typical cell and thus it may not truly represent the typical cell performance. Inspired by this observation, we present a construction that allows a direct characterization of the downlink performance of the typical cell. For this, we present an exact downlink analysis for the 1 D case and a remarkably accurate approximation for the 2 D case. Several useful insights about the differences and similarities in the two viewpoints (typical user vs. typical cell) are also provided.


Comments on "A new additive decomposition of velocity gradient", by B. Sun. Comments on "A new additive decomposition of velocity gradient" Phys. Fluids 31, 061702 (2019), arXiv 1908.01638 is presented


Parabolic Regularity in Geometric Variational Analysis. The paper is mainly devoted to systematic developments and applications of geometric aspects of second order variational analysis that are revolved around the concept of parabolic regularity of sets. This concept has been known in variational analysis for more than two decades while being largely underinvestigated. We discover here that parabolic regularity is the key to derive new calculus rules and computation formulas for major second order generalized differential constructions of variational analysis in connection with some properties of sets that go back to classical differential geometry and geometric measure theory. The established results of second order variational analysis and generalized differentiation, being married to the developed calculus of parabolic regularity, allow us to obtain novel applications to both qualitative and quantitative numerical aspects of constrained optimization including second order optimality conditions, augmented Lagrangians, etc. under weak constraint qualifications.


Parallel Hardware for Faster Morphological Analysis. Morphological analysis in the Arabic language is computationally intensive, has numerous forms and rules, and is intrinsically parallel. The investigation presented in this paper confirms that the effective development of parallel algorithms and the derivation of corresponding processors in hardware enable implementations with appealing performance characteristics. The presented developments of parallel hardware comprise the application of a variety of algorithm modelling techniques, strategies for concurrent processing, and the creation of pioneering hardware implementations that target modern programmable devices. The investigation includes the creation of a linguistic based stemmer for Arabic verb root extraction with extended infix processing to attain high levels of accuracy. The implementations comprise three versions, namely, software, non pipelined processor, and pipelined processor with high throughput. The targeted systems are high performance multi core processors for software implementations and high end Field Programmable Gate Array systems for hardware implementations. The investigation includes a thorough evaluation of the methodology, and performance and accuracy analyses of the developed software and hardware implementations. The pipelined processor achieved a significant speedup of 5571.4 over the software implementation. The developed stemmer for verb root extraction with infix processing attained accuracies of 87 and 90.7 for analyzing the texts of the Holy Quran and its Chapter 29 Surat Al Ankabut.


Some Results about the Index Conjecture for log Calabi Yau Pairs. We show some inductive statements for the index conjecture for log canonical Calabi Yau pairs. Using it, we show that boundedness of log canonical index for log canonical Calabi Yau pairs with rational DCC coefficients in dimension 3. We also show boundedness of log canonical index for klt log Calabi Yau pairs in dimension 4 with B neq 0 .


Liouville type theorems for fractional and higher order fractional H 'enon Lane Emden systems. In this paper, we first establish decay estimates for the fractional and higher order fractional H 'enon Lane Emden systems by using a nonlocal average and integral estimates, which deduce a result of non existence. Next, we apply the method of scaling spheres introduced in cite DQ2 to derive a Liouville type theorem. We also construct an interesting example on super frac alpha 2 harmonic functions (Proposition 1.2).


"Solutocapillary Marangoni flow induced in waterbody by solute source". The aim of this paper is to experimentally and analytically study the solutocapillary flow induced in a waterbody due to the presence of a solute source on its surface and the mixing induced by this flow of the solutes and gases dissolved at and near the surface into the waterbody. According to the analytic solution, the induced flow is analogous to a doublet flow in the sense that the flow is directed towards the source within a conical region with its vertex at the source, and outside the conical region the flow moves away from the source. The half cone angle for a negative source increases from sim 60 degrees with increasing source strength and Schmidt number reaching values greater than 80 degrees. When the cone angle is large, the outflow is restricted to a thin annular boundary layer region. These analytic results are in agreement with our experimental data obtained by the PIV (Particle Image Velocimetry) and PLIF (planar laser induced fluorescence) techniques. As the solute gradient at the surface gives rise to the force that drives the flow, when the solute diffusion coefficient is reduced the flow becomes stronger and persists longer because the solute gradient is maintained for a longer time and distance. In experiments, the flow changes direction into the waterbody and the surface flow stops when the solute induced surface tension gradient driving the flow becomes comparable to the surface tension gradients that exist on the surface due to temperature gradients.


Extended sampling method for inverse elastic scattering problems using one incident wave. We consider the inverse elastic scattering problems using the far field data due to one incident plane wave. A simple method is proposed to reconstruct the location and size of the obstacle using different components of the far field pattern. The method sets up linear ill posed integral equations for sampling points in the domain of interrogation and uses the (approximate) solutions to compute indicators. Using the far field patterns of rigid disks as the kernels of the integral equations and moving the measured data to the right hand side, the method has the ability to process limited aperture data. Numerical examples show that the method can effectively determine the location and approximate the support of the obstacle with little a priori information.


Policy Gradient RL Algorithms as Directed Acyclic Graphs. Meta Reinforcement Learning (RL) methods focus on automating the design of RL algorithms that generalize to a wide range of environments. The framework introduced in (Anonymous, 2020) addresses the problem by representing different RL algorithms as Directed Acyclic Graphs (DAGs), and using an evolutionary meta learner to modify these graphs and find good agent update rules. While the search language used to generate graphs in the paper serves to represent numerous already existing RL algorithms (e.g., DQN, DDQN), it has limitations when it comes to representing Policy Gradient algorithms. In this work we try to close this gap by extending the original search language and proposing graphs for five different Policy Gradient algorithms VPG, PPO, DDPG, TD3, and SAC.


A hybrid stochastic differential reinsurance and investment game with bounded memory. This paper investigates a hybrid stochastic differential reinsurance and investment game between one reinsurer and two insurers, including a stochastic Stackelberg differential subgame and a non zero sum stochastic differential subgame. The reinsurer, as the leader of the Stackelberg game, can price reinsurance premium and invest its wealth in a financial market that contains a risk free asset and a risky asset. The two insurers, as the followers of the Stackelberg game, can purchase proportional reinsurance from the reinsurer and invest in the same financial market. The competitive relationship between two insurers is modeled by the non zero sum game, and their decision making will consider the relative performance measured by the difference in their terminal wealth. We consider wealth processes with delay to characterize the bounded memory feature. This paper aims to find the equilibrium strategy for the reinsurer and insurers by maximizing the expected utility of the reinsurer's terminal wealth with delay and maximizing the expected utility of the combination of insurers' terminal wealth and the relative performance with delay. By using the idea of backward induction and the dynamic programming approach, we derive the equilibrium strategy and value functions explicitly. Then, we provide the corresponding verification theorem. Finally, some numerical examples and sensitivity analysis are presented to demonstrate the effects of model parameters on the equilibrium strategy. We find the delay factor discourages or stimulates investment depending on the length of delay. Moreover, competitive factors between two insurers make their optimal reinsurance investment strategy interact, and reduce reinsurance demand and reinsurance premium price.


New congruences involving Ap 'ery like numbers. In this paper we present many congruences for several Ap 'ery like sequences.


Model Reduction for Multi Scale Transport Problems using Model form Preserving Least Squares Projections with Variable Transformation. A projection based formulation is presented for non linear model reduction of problems with extreme scale disparity. The approach allows for the selection of an arbitrary, but complete, set of solution variables while preserving the structure of the governing equations. Least squares based minimization is leveraged to guarantee symmetrization and discrete consistency with the full order model (FOM). Two levels of scaling are used to achieve the conditioning required to effectively handle problems with extremely disparate physical phenomena, characterized by extreme stiffness in the system of equations. The formulation referred to as model form preserving least squares with variable transformation (MP LSVT) provides global stabilization for both implicit and explicit time integration schemes. To achieve computational efficiency, a pivoted QR decomposition is used with oversampling, and adapted to the MP LSVT method. The framework is demonstrated in representative two and three dimensional reacting flow problems, and the MP LSVT is shown to exhibit improved stability and accuracy over standard projection based ROM techniques. Physical realizability and local stability are promoted by enforcing limiters in both temperature and species mass fractions. These limiters are demonstrated to be important in eliminating regions of spurious burning, thus enabling the ROMs to provide accurate representations of the heat release rate and flame propagation speed. In the 3D application, it is shown that more than two orders of magnitude acceleration in computational efficiency can be achieved, while also providing reasonable future state predictions. A key contribution of this work is the development and demonstration of a comprehensive ROM formulation that targets highly challenging multi scale transport dominated problems.


Constructing Positive Interpolatory Cubature Formulas. Positive interpolatory cubature formulas (CFs) are constructed for quite general integration domains and weight functions. These CFs are exact for general vector spaces of continuous real valued functions that contain constants. At the same time, the number of data points all of which lie inside the domain of integration and cubature weights all positive is less or equal to the dimension of that vector space. The existence of such CFs has been ensured by Tchakaloff in 1957. Yet, to the best of the author's knowledge, this work is the first to provide a procedure to successfully construct them.


A Non Ideal NOMA based mmWave D2D Networks with Hardware and CSI Imperfections. This letter investigates a non orthogonal multiple access (NOMA) assisted millimeter wave device to device (D2D) network practically limited by multiple interference noises, transceiver hardware impairments, imperfect successive interference cancellation, and channel state information mismatch. Generalized outage probability expressions for NOMA D2D users are deduced and achieved results, validated by Monte Carlo simulations, are compared with the orthogonal multiple access to show the superior performance of the proposed network model


Neurons Activation Visualization and Information Theoretic Analysis. Understanding the inner working mechanism of deep neural networks (DNNs) is essential and important for researchers to design and improve the performance of DNNs. In this work, the entropy analysis is leveraged to study the neurons activation behavior of the fully connected layers of DNNs. The entropy of the activation patterns of each layer can provide a performance metric for the evaluation of the network model accuracy. The study is conducted based on a well trained network model. The activation patterns of shallow and deep layers of the fully connected layers are analyzed by inputting the images of a single class. It is found that for the well trained deep neural networks model, the entropy of the neuron activation pattern is monotonically reduced with the depth of the layers. That is, the neuron activation patterns become more and more stable with the depth of the fully connected layers. The entropy pattern of the fully connected layers can also provide guidelines as to how many fully connected layers are needed to guarantee the accuracy of the model. The study in this work provides a new perspective on the analysis of DNN, which shows some interesting results.