Towards a Koopman theory for dynamical systems on completely regular spaces. The Koopman linearization of measure preserving systems or topological dynamical systems on compact spaces has proven to be extremely useful. In this article we look at dynamics given by continuous semiflows on completely regular spaces which arise naturally from solutions of PDEs. We introduce Koopman semigroups for these semiflows on spaces of bounded continuous functions. As a first step we study their continuity properties as well as their infinitesimal generators. We then characterize them algebraically (via derivations) and lattice theoretically (via Kato's equality). Finally, we demonstrate using the example of attractors how this Koopman approach can be used to examine properties of dynamical systems.


Privacy Preserving Image Retrieval Based on Additive Secret Sharing. The rapid growth of digital images motivates individuals and organizations to upload their images to the cloud server. To preserve privacy, image owners would prefer to encrypt the images before uploading, but it would strongly limit the efficient usage of images. Plenty of existing schemes on privacy preserving Content Based Image Retrieval (PPCBIR) try to seek the balance between security and retrieval ability. However, compared to the advanced technologies in CBIR like Convolutional Neural Network (CNN), the existing PPCBIR schemes are far deficient in both accuracy and efficiency. With more cloud service providers, the collaborative secure image retrieval service provided by multiple cloud servers becomes possible. In this paper, inspired by additive secret sharing technology, we propose a series of additive secure computing protocols on numbers and matrices with better efficiency, and then show their application in PPCBIR. Specifically, we extract CNN features, decrease the dimension of features and build the index securely with the help of our protocols, which include the full process of image retrieval in the plaintext domain. The experiments and security analysis demonstrate the efficiency, accuracy, and security of our scheme.


Introducing Astrocytes on a Neuromorphic Processor Synchronization, Local Plasticity and Edge of Chaos. While there is still a lot to learn about astrocytes and their neuromodulatory role in the spatial and temporal integration of neuronal activity, their introduction to neuromorphic hardware is timely, facilitating their computational exploration in basic science questions as well as their exploitation in real world applications. Here, we present an astrocytic module that enables the development of a spiking Neuronal Astrocytic Network (SNAN) into Intel's Loihi neuromorphic chip. The basis of the Loihi module is an end to end biophysically plausible compartmental model of an astrocyte that simulates the intracellular activity in response to the synaptic activity in space and time. To demonstrate the functional role of astrocytes in SNAN, we describe how an astrocyte may sense and induce activity dependent neuronal synchronization, switch on and off spike time dependent plasticity (STDP) to introduce single shot learning, and monitor the transition between ordered and chaotic activity at the synaptic space. Our module may serve as an extension for neuromorphic hardware, by either replicating or exploring the distinct computational roles that astrocytes have in forming biological intelligence.


physics.comp-ph cs.NA math.NA physics.flu-dyn

An Adaptive ALE Scheme for Non Ideal Compressible Fluid Dynamics over Dynamic Unstructured Meshes. This paper investigates the application of mesh adaptation techniques in the Non Ideal Compressible Fluid Dynamic (NICFD) regime, a region near the vapor liquid saturation curve where the flow behavior significantly departs from the ideal gas model, as indicated by a value of the fundamental derivative of gasdynamics less than one. A recent interpolation free finite volume adaptive scheme is exploited to modify the grid connectivity in a conservative way, and the governing equations for compressible inviscid flows are solved within the Arbitrary Lagrangian Eulerian framework by including special fictitious fluxes representing volume modifications due to mesh adaptation.The absence of interpolation of the solution to the new grid prevents spurious oscillations that may make the solution of the flow field in the NICFD regime more difficult and less robust.Non ideal gas effects are taken into account by adopting the polytropic Peng Robinson thermodynamic model. The numerical results focus on the problem of a piston moving in a tube filled with siloxane mathrm MD 4M , a simple configuration which can be the core of experimental research activities aiming at investigating the thermodynamic behavior of NICFD flows. Several numerical tests involving different piston movements and initial states in 2D and 3D assess the capability of the proposed adaption technique to correctly capture compression and expansion waves, as well as the generation and propagation of shock waves, in the NICFD and in the non classical regime.


Topological complexity of visibility manifolds. A recent result of Bader, Gelander and Sauer shows that for manifolds of pinched negative curvature, the torsion part of the homology can be controlled by the volume. This is done by constructing an efficient simplicial model of the thick part, which also provides another proof of the analogous statement for the free part of the homology, a classical theorem due to Gromov. We will extend these results to more general curvature conditions, namely the case where the sectional curvature can get arbitrarily close to zero, but the visibility axiom still holds.


Page Tables Keeping them Flat and Hot (Cached). As memory capacity has outstripped TLB coverage, large data applications suffer from frequent page table walks. We investigate two complementary techniques for addressing this cost reducing the number of accesses required and reducing the latency of each access. The first approach is accomplished by opportunistically "flattening" the page table merging two levels of traditional 4KB page table nodes into a single 2MB node, thereby reducing the table's depth and the number of indirections required to search it. The second is accomplished by biasing the cache replacement algorithm to keep page table entries during periods of high TLB miss rates, as these periods also see high data miss rates and are therefore more likely to benefit from having the smaller page table in the cache than to suffer from increased data cache misses. We evaluate these approaches for both native and virtualized systems and across a range of realistic memory fragmentation scenarios, describe the limited changes needed in our kernel implementation and hardware design, identify and address challenges related to self referencing page tables and kernel memory allocation, and compare results across server and mobile systems using both academic and industrial simulators for robustness. We find that flattening does reduce the number of accesses required on a page walk (to 1.0), but its performance impact ( 2.3 ) is small due to Page Walker Caches (already 1.5 accesses). Prioritizing caching has a larger effect ( 6.8 ), and the combination improves performance by 9.2 . Flattening is more effective on virtualized systems (4.4 to 2.8 accesses, 7.1 performance), due to 2D page walks. By combining the two techniques we demonstrate a state of the art 14.0 performance gain and 8.7 dynamic cache energy and 4.7 dynamic DRAM energy for virtualized execution with very simple hardware and software changes.


Enhanced Spatially Interleaved Techniques for Multi View Distributed Video Coding. This paper presents a multi view distributed video coding framework for independent camera encoding and centralized decoding. Spatio temporal view concealment methods are developed that exploit the interleaved nature of the employed hybrid KEY Wyner Ziv frames for block wise generation of the side information (SI). We study a number of view concealment methods and develop a joint approach that exploits all available correlation for forming the side information. We apply a diversity technique for fusing multiple such predictions thereby achieving more reliable results. We additionally introduce systems enhancements for further improving the rate distortion performance through selective feedback, inter view bitplane projection and frame subtraction. Results show a significant improvement in performance relative to H.264 intra coding of up to 25 reduction in bitrate or equivalently 2.5 dB increase in PSNR.


On a topological counterpart of regularization for holonomic D modules. On a complex manifold, the embedding of the category of regular holonomic D modules into that of holonomic D modules has a left quasi inverse functor mathcal M mapsto mathcal M mathrm reg , called regularization. Recall that mathcal M mathrm reg is reconstructed from the de Rham complex of mathcal M by the regular Riemann Hilbert correspondence. Similarly, on a topological space, the embedding of sheaves into enhanced ind sheaves has a left quasi inverse functor, called here sheafification. Regularization and sheafification are intertwined by the irregular Riemann Hilbert correspondence. Here, we study some of their properties. In particular, we provide a germ formula for the sheafification of enhanced specialization and microlocalization.


The Infinity Laplacian eigenvalue problem reformulation and a numerical scheme. In this work we present an alternative formulation of the higher eigenvalue problem associated to the infinity Laplacian, which opens the door for numerical approximation of eigenfunctions. A rigorous analysis is performed to show the equivalence of the new formulation to the traditional one. We define consistent numerical schemes for approximating infinity ground states and higher eigenfunctions and perform numerical experiments which also shed light on some open conjectures in the field.


Robotic Room Traversal using Optical Range Finding. Consider the goal of visiting every part of a room that is not blocked by obstacles. Doing so efficiently requires both sensors and planning. Our findings suggest a method of inexpensive optical range finding for robotic room traversal. Our room traversal algorithm relies upon the approximate distance from the robot to the nearest obstacle in 360 degrees. We then choose the path with the furthest approximate distance. Since millimeter precision is not required for our problem, we have opted to develop our own laser range finding solution, in lieu of using more common, but also expensive solutions like light detection and ranging (LIDAR). Rather, our solution uses a laser that casts a visible dot on the target and a common camera (an iPhone, for example). Based upon where in the camera frame the laser dot is detected, we may calculate an angle between our target and the laser aperture. Using this angle and the known distance between the camera eye and the laser aperture, we may solve all sides of a trigonometric model which provides the distance between the robot and the target.


Camera Travel for Immersive Colonography. Immersive Colonography allows medical professionals to navigate inside the intricate tubular geometries of subject specific 3D colon images using Virtual Reality displays. Typically, camera travel is performed via Fly Through or Fly Over techniques that enable semi automatic traveling through a constrained, well defined path at user controlled speeds. However, Fly Through is known to limit the visibility of lesions located behind or inside haustral folds, while Fly Over requires splitting the entire colon visualization into two specific halves. In this paper, we study the effect of immersive Fly Through and Fly Over techniques on lesion detection, and introduce a camera travel technique that maintains a fixed camera orientation throughout the entire medial axis path. While these techniques have been studied in non VR desktop environments, their performance is yet not well understood in VR setups. We performed a comparative study to ascertain which camera travel technique is more appropriate for constrained path navigation in Immersive Colonography. To this end, we asked 18 participants to navigate inside a 3D colon to find specific marks. Our results suggest that the Fly Over technique may lead to enhanced lesion detection at the cost of higher task completion times, while the Fly Through method may offer a more balanced trade off between both speed and effectiveness, whereas the fixed camera orientation technique provided seemingly inferior performance results. Our study further provides design guidelines and informs future work.


Local Hadamard well posedness results for the Navier Stokes equations. In this paper we consider classes of initial data that ensure local in time Hadamard well posedness of the associated weak Leray Hopf solutions of the three dimensional Navier Stokes equations. In particular, for any solenodial L 2 initial data u 0 belonging to certain subsets of VMO 1 ( mathbb R 3) , we show that weak Leray Hopf solutions depend continuously with respect to small divergence free L 2 perturbations of the initial data u 0 (on some finite time interval). Our main result is inspired and improves upon previous work of the author cite barker2018 and work of Jean Yves Chemin cite chemin . Our method builds upon cite barker2018 and cite chemin . In particular our method hinges on decomposition results for the initial data inspired by Calder ' o n cite Calderon90 together with use of persistence of regularity results. The persistence of regularity statement presented may be of independent interest, since it does not rely upon the solution or the initial data being in the perturbative regime.


Robust Named Entity Recognition with Truecasing Pretraining. Although modern named entity recognition (NER) systems show impressive performance on standard datasets, they perform poorly when presented with noisy data. In particular, capitalization is a strong signal for entities in many languages, and even state of the art models overfit to this feature, with drastically lower performance on uncapitalized text. In this work, we address the problem of robustness of NER systems in data with noisy or uncertain casing, using a pretraining objective that predicts casing in text, or a truecaser, leveraging unlabeled data. The pretrained truecaser is combined with a standard BiLSTM CRF model for NER by appending output distributions to character embeddings. In experiments over several datasets of varying domain and casing quality, we show that our new model improves performance in uncased text, even adding value to uncased BERT embeddings. Our method achieves a new state of the art on the WNUT17 shared task dataset.


The classification of complex algebraic surfaces. This text grew up from the notes of a graduate course I gave at the University of Roma Tor Vergata'' in the academic year 2018 19. The subject is the classification of complex algebraic surfaces following Mori's theory. It includes the P 12 Theorem, Sarkisov's programme in the surface case and Noether Castelnuovo's Theorem in its classical version.


Large Diffusivity and Rate of Convergence of Attractors in Parabolic Systems. In this paper we are concerned with rate of convergence of parabolic systems with large diffusion. We will exhibit the exact moment that spatial homogenization occurs and estimate the continuity of attractors by a rate of convergence. We will show an example where our estimate is optimal.


Similarity Preserving Knowledge Distillation. Knowledge distillation is a widely applicable technique for training a student neural network under the guidance of a trained teacher network. For example, in neural network compression, a high capacity teacher is distilled to train a compact student in privileged learning, a teacher trained with privileged data is distilled to train a student without access to that data. The distillation loss determines how a teacher's knowledge is captured and transferred to the student. In this paper, we propose a new form of knowledge distillation loss that is inspired by the observation that semantically similar inputs tend to elicit similar activation patterns in a trained network. Similarity preserving knowledge distillation guides the training of a student network such that input pairs that produce similar (dissimilar) activations in the teacher network produce similar (dissimilar) activations in the student network. In contrast to previous distillation methods, the student is not required to mimic the representation space of the teacher, but rather to preserve the pairwise similarities in its own representation space. Experiments on three public datasets demonstrate the potential of our approach.


Effectiveness of Arbitrary Transfer Sets for Data free Knowledge Distillation. Knowledge Distillation is an effective method to transfer the learning across deep neural networks. Typically, the dataset originally used for training the Teacher model is chosen as the "Transfer Set" to conduct the knowledge transfer to the Student. However, this original training data may not always be freely available due to privacy or sensitivity concerns. In such scenarios, existing approaches either iteratively compose a synthetic set representative of the original training dataset, one sample at a time or learn a generative model to compose such a transfer set. However, both these approaches involve complex optimization (GAN training or several backpropagation steps to synthesize one sample) and are often computationally expensive. In this paper, as a simple alternative, we investigate the effectiveness of "arbitrary transfer sets" such as random noise, publicly available synthetic, and natural datasets, all of which are completely unrelated to the original training dataset in terms of their visual or semantic contents. Through extensive experiments on multiple benchmark datasets such as MNIST, FMNIST, CIFAR 10 and CIFAR 100, we discover and validate surprising effectiveness of using arbitrary data to conduct knowledge distillation when this dataset is "target class balanced". We believe that this important observation can potentially lead to designing baselines for the data free knowledge distillation task.


Mixing strategies combined with shape design to enhance productivity of a raceway pond. This paper focuses on mixing strategies and designing shape of the bottom topographies to enhance the growth of the microalgae in raceway ponds. A physical biological coupled model is used to describe the growth of the algae. A simple model of a mixing device such as a paddle wheel is also considered. The complete process model was then included in an optimization problem associated with the maximization of the biomass production. The results show that non trivial topographies can be coupled with some specific mixing strategies to improve the microalgal productivity.


Compressibility effects in a turbulent transport of temperature field. Compressibility effects in a turbulent transport of temperature field are investigated applying the quasi linear approach for small P 'eclet numbers and the spectral tau approach for large P 'eclet numbers. Compressibility of a fluid flow reduces the turbulent diffusivity of the mean temperature field similarly to that for particle number density and magnetic field. However, expressions for the turbulent diffusion coefficient for the mean temperature field in a compressible turbulence are different from those for the mean particle number density and the mean magnetic field. Combined effect of compressibility and inhomogeneity of turbulence causes an increase of the mean temperature in the regions with more intense velocity fluctuations due to a turbulent pumping. Formally, this effect is similar to a phenomenon of compressible turbophoresis found previously J. Plasma Phys. bf 84 , 735840502 (2018) for non inertial particles or gaseous admixtures. Gradient of the mean fluid pressure results in an additional turbulent pumping of the mean temperature field. The latter effect is similar to turbulent barodiffusion of particles and gaseous admixtures. Compressibility of a fluid flow also causes a turbulent cooling of the surrounding fluid due to an additional sink term in the equation for the mean temperature field. There is no analog of this effect for particles.


Complexity bounds on supermesh construction for quasi uniform meshes. Projecting fields between different meshes commonly arises in computational physics. This operation requires a supermesh construction and its computational cost is proportional to the number of cells of the supermesh n . Given any two quasi uniform meshes of n A and n B cells respectively, we show under standard assumptions that n is proportional to n A n B . This result substantially improves on the best currently available upper bound on n and is fundamental for the analysis of algorithms that use supermeshes.


IOCA High Speed I O Aware LLC Management for Network Centric Multi Tenant Platform. In modern server CPUs, last level cache (LLC) is a critical hardware resource that exerts significant influence on the performance of the workloads, and how to manage LLC is a key to the performance isolation and QoS in the cloud with multi tenancy. In this paper, we argue that besides CPU cores, high speed network I O is also important for LLC management. This is because of an Intel architectural innovation Data Direct I O (DDIO) that directly injects the inbound I O traffic to (part of) the LLC instead of the main memory. We summarize two problems caused by DDIO and show that (1) the default DDIO configuration may not always achieve optimal performance, (2) DDIO can decrease the performance of non I O workloads which share LLC with it by as high as 32 . We then present IOCA, the first LLC management mechanism for network centric platforms that treats the I O as the first class citizen. IOCA monitors and analyzes the performance of the cores, LLC, and DDIO using CPU's hardware performance counters, and adaptively adjusts the number of LLC ways for DDIO or the tenants that demand more LLC capacity. In addition, IOCA dynamically chooses the tenants that share its LLC resource with DDIO, to minimize the performance interference by both the tenants and the I O. Our experiments with multiple microbenchmarks and real world applications in two major end host network models demonstrate that IOCA can effectively reduce the performance degradation caused by DDIO, with minimal overhead.


Infinite families of 2 designs from two classes of binary cyclic codes with three nonzeros. Combinatorial t designs have been an interesting topic in combinatorics for decades. It is a basic fact that the codewords of a fixed weight in a code may hold a t design. Till now only a small amount of work on constructing t designs from codes has been done. In this paper, we determine the weight distributions of two classes of cyclic codes one related to the triple error correcting binary BCH codes, and the other related to the cyclic codes with parameters satisfying the generalized Kasami case, respectively. We then obtain infinite families of 2 designs from these codes by proving that they are both affine invariant codes, and explicitly determine their parameters. In particular, the codes derived from the dual of binary BCH codes hold five 3 designs when m 4 .


Realistic Face Reenactment via Self Supervised Disentangling of Identity and Pose. Recent works have shown how realistic talking face images can be obtained under the supervision of geometry guidance, e.g., facial landmark or boundary. To alleviate the demand for manual annotations, in this paper, we propose a novel self supervised hybrid model (DAE GAN) that learns how to reenact face naturally given large amounts of unlabeled videos. Our approach combines two deforming autoencoders with the latest advances in the conditional generation. On the one hand, we adopt the deforming autoencoder to disentangle identity and pose representations. A strong prior in talking face videos is that each frame can be encoded as two parts one for video specific identity and the other for various poses. Inspired by that, we utilize a multi frame deforming autoencoder to learn a pose invariant embedded face for each video. Meanwhile, a multi scale deforming autoencoder is proposed to extract pose related information for each frame. On the other hand, the conditional generator allows for enhancing fine details and overall reality. It leverages the disentangled features to generate photo realistic and pose alike face images. We evaluate our model on VoxCeleb1 and RaFD dataset. Experiment results demonstrate the superior quality of reenacted images and the flexibility of transferring facial movements between identities.


Refraction of fast Ne atoms in the attractive well of LiF(001) surface. Ne atoms with energies up to 3 keV are diffracted under grazing angles of incidence from a LiF(001) surface. For a small momentum component of the incident beam perpendicular to the surface, we observe an increase of the elastic rainbow angle together with a broadening of the inelastic scattering profile. We interpret these two effects as the refraction of the atomic wave in the attractive part of the surface potential. We use a fast, rigorous dynamical diffraction calculation to find a projectile surface potential model that enables a quantitative reproduction of the experimental data for up to ten diffraction orders. This allows us to extract an attractive potential well depth of 10.4 meV. Our results set a benchmark for more refined surface potential models which include the weak Van der Waals region, a long standing challenge in the study of atom surface interactions.


Attention Based Self Supervised Feature Learning for Security Data. While applications of machine learning in cyber security have grown rapidly, most models use manually constructed features. This manual approach is error prone and requires domain expertise. In this paper, we design a self supervised sequence to sequence model with attention to learn an embedding for data routinely used in cyber security applications. The method is validated on two real world public data sets. The learned features are used in an anomaly detection model and perform better than learned features from baseline methods.


Reinforcement Learning Applications. We start with a brief introduction to reinforcement learning (RL), about its successful stories, basics, an example, issues, the ICML 2019 Workshop on RL for Real Life, how to use it, study material and an outlook. Then we discuss a selection of RL applications, including recommender systems, computer systems, energy, finance, healthcare, robotics, and transportation.


Acoustically Driven and Modulation Inducible Radiating Elements. The low propagation loss of electromagnetic radiation below 1 MHz offers significant opportunities for low power, long range communication systems to meet growing demands for IoT applications. Especially in the very low frequency (VLF 3 30 kHz) range and lower, propagation through tens of meters of seawater, hundreds of meters of earth, and hundreds of kilometers of air with only 2 3 dB of loss is possible. However, the fundamental reduction in efficiency as the size of electrical antennas decreases below a wavelength (30 m at 1 MHz) has made portable communication systems in the VLF and low frequency (LF 30 300 kHz) ranges impractical for decades. A paradigm shift from electrical to piezoelectric antennas utilizing strain driven currents at resonant wavelengths up to five orders of magnitude smaller than electrical antennas offers the promise for orders of magnitude efficiency improvement over the electrical state of the art. This work demonstrates a lead zirconate titanate transmitter 6000 times more efficient than a comparably sized electrical antenna and capable of bit rates up to 60 bit s using frequency shift keying. Detailed analysis of design parameters offers a roadmap for significant future improvement in both radiation efficiency and data rate in the new field of acoustically driven antennas.


Automatic Discovery of Families of Network Generative Processes. Designing plausible network models typically requires scholars to form a priori intuitions on the key drivers of network formation. Oftentimes, these intuitions are supported by the statistical estimation of a selection of network evolution processes which will form the basis of the model to be developed. Machine learning techniques have lately been introduced to assist the automatic discovery of generative models. These approaches may more broadly be described as "symbolic regression", where fundamental network dynamic functions, rather than just parameters, are evolved through genetic programming. This chapter first aims at reviewing the principles, efforts and the emerging literature in this direction, which is very much aligned with the idea of creating artificial scientists. Our contribution then aims more specifically at building upon an approach recently developed by us Menezes Roth, 2014 in order to demonstrate the existence of families of networks that may be described by similar generative processes. In other words, symbolic regression may be used to group networks according to their inferred genotype (in terms of generative processes) rather than their observed phenotype (in terms of statistical topological features). Our empirical case is based on an original data set of 238 anonymized ego centered networks of Facebook friends, further yielding insights on the formation of sociability networks.


Parity Checked Strassen Algorithm. To multiply astronomic matrices using parallel workers subject to straggling, we recommend interleaving checksums with some fast matrix multiplication algorithms. Nesting the parity checked algorithms, we weave a product code flavor protection. Two demonstrative configurations are as follows (A) 9 workers multiply two 2 times 2 matrices each worker multiplies two linear combinations of entries therein. Then the entry products sent from any 8 workers suffice to assemble the matrix product. (B) 754 workers multiply two 9 times 9 matrices. With empirical frequency 99.8 , 729 workers suffice, wherein 729 is the complexity of the schoolbook algorithm. In general, we propose probability wisely favorable configurations whose numbers of workers are close to, if not less than, the thresholds of other codes (e.g., entangled polynomial code and PolyDot code). Our proposed scheme applies recursively, respects worker locality, incurs moderate pre and post processes, and extends over small finite fields.


Automatic Weighted Matching Rectifying Rule Discovery for Data Repairing. Data repairing is a key problem in data cleaning which aims to uncover and rectify data errors. Traditional methods depend on data dependencies to check the existence of errors in data, but they fail to rectify the errors. To overcome this limitation, recent methods define repairing rules on which they depend to detect and fix errors. However, all existing data repairing rules are provided by experts which is an expensive task in time and effort. Besides, rule based data repairing methods need an external verified data source or user verifications otherwise they are incomplete where they can repair only a small number of errors. In this paper, we define weighted matching rectifying rules (WMRRs) based on similarity matching to capture more errors. We propose a novel algorithm to discover WMRRs automatically from dirty data in hand. We also develop an automatic algorithm for rules inconsistency resolution. Additionally, based on WMRRs, we propose an automatic data repairing algorithm (WMRR DR) which uncovers a large number of errors and rectifies them dependably. We experimentally verify our method on both real life and synthetic data. The experimental results prove that our method can discover effective WMRRs from the dirty data in hand, and perform dependable and full automatic repairing based on the discovered WMRRs, with higher accuracy than the existing dependable methods.


Elimination of MHD current sheets by modifications to the plasma wall in a fixed boundary model. Models of magnetohydrodynamic (MHD) equilibia that for computational convenience assume the existence of a system of nested magnetic flux surfaces tend to exhibit singular current sheets. These sheets are located on resonant flux surfaces that are associated with rational values of the rotational transform. We study the possibility of eliminating these singularities by suitable modifications of the plasma boundary, which we prescribe in a fixed boundary setting. We find that relatively straightforward iterative procedures can be used to eliminate weak current sheets that are generated at resonant flux surfaces by the nonlinear interactions of resonating wall harmonics. These types of procedures may prove useful in the design of fusion devices with configurations that enjoy improved stability and transport properties.


Improving The Effectiveness of Automatically Generated Test Suites Using Metamorphic Testing. Automated test generation has helped to reduce the cost of software testing. However, developing effective test oracles for these automatically generated test inputs is a challenging task. Therefore, most automated test generation tools use trivial oracles that reduce the fault detection effectiveness of these automatically generated test cases. In this work, we provide results of an empirical study showing that utilizing metamorphic relations can increase the fault detection effectiveness of automatically generated test cases.


A study on Modern Messaging Systems Kafka, RabbitMQ and NATS Streaming. Distributed messaging systems form the core of big data streaming, cloud native applications and microservice architecture. With real time critical applications there is a growing need for well built messaging platform that is scalable, fault tolerant and has low latency. There are multiple modern messaging systems that have come up in the recent past, all with their own pros and cons. This has become problematic for the industry to decide which messaging system is the most suitable for a specific application. An in depth study is required to decide which features of a messaging system meet the needs of the application. This survey paper outlines the modern messaging technologies and delves deep on three popular publisher subscriber systems Apache Kafka, RabbitMQ and NATS Streaming. The paper provides information about messaging systems, the use cases, similarities and differences of features to facilitate users to make an informed decision and also pave way for future research and development.


Semi Lagrangian Exponential Integration with application to the rotating shallow water equations. In this paper we propose a novel way to integrate time evolving partial differential equations that contain nonlinear advection and stiff linear operators, combining exponential integration techniques and semi Lagrangian methods. The general formulation is built from the solution of an integration factor problem with respect to the problem written with a material derivative, so that the exponential integration scheme naturally incorporates the nonlinear advection. Semi Lagrangian techniques are used to treat the dependence of the exponential integrator on the flow trajectories. The formulation is general, as many exponential integration techniques could be combined with different semi Lagrangian methods. This formulation allows an accurate solution of the linear stiff operator, a property inherited by the exponential integration technique. It also provides a sufficiently accurate representation of the nonlinear advection, even with large time step sizes, a property inherited by the semi Lagrangian method. Aiming for application in weather and climate modeling, we discuss possible combinations of well established exponential integration techniques and state of the art semi Lagrangian methods used operationally in the application. We show experiments for the planar rotating shallow water equations. When compared to traditional exponential integration techniques, the experiments reveal that the coupling with semi Lagrangian allows stabler integration with larger time step sizes. From the application perspective, which already uses semi Lagrangian methods, the exponential treatment could improve the solution of wave dispersion when compared to semi implicit schemes.


Bee A 95 mg Four Winged Insect Scale Flying Robot Driven by Twinned Unimorph Actuators. We introduce Bee , a 95 mg four winged microrobot with improved controllability and open loop response characteristics with respect to those exhibited by state of the art two winged microrobots with the same size and similar weight (i.e., the 75 mg Harvard RoboBee). The key innovation that made possible the development of Bee is the introduction of an extremely light (28 mg) pair of twinned unimorph actuators, which enabled the design of a new microrobotic mechanism that flaps four wings independently. A first main advantage of the proposed design, compared to those of two winged flyers, is that by increasing the number of actuators from two to four, the number of direct control inputs increases from three to four when simple sinusoidal excitations are employed. A second advantage of Bee is that its four wing configuration and flapping mode naturally damp the rotational disturbances that commonly affect the yaw degree of freedom of two winged microrobots. In addition, the proposed design greatly reduces the complexity of the associated fabrication process compared to those of other microrobots, as the unimorph actuators are fairly easy to build. Lastly, we hypothesize that given the relatively low wing loading affecting their flapping mechanisms, the life expectancy of Bee s must be considerably higher than those of the two winged counterparts. The functionality and basic capabilities of the robot are demonstrated through a set of simple control experiments.


Low dimensional maximal restriction principles for the Fourier transform. Following the ideas from a paper by the same author, we prove abstract maximal restriction results for the Fourier transform. Our results deal mainly with maximal operators of convolution type and r average maximal functions. As a by product of our techniques we obtain spherical maximal restriction estimates, as well as restriction estimates for 2 average maximal functions, answering thus points left open by V. Kova v c and M "uller, Ricci and Wright.


Evaluating the Impact of COVID 19 on Cyberbullying through Bayesian Trend Analysis. COVID 19's impact has surpassed from personal and global health to our social life. In terms of digital presence, it is speculated that during pandemic, there has been a significant rise in cyberbullying. In this paper, we have examined the hypothesis of whether cyberbullying and reporting of such incidents have increased in recent times. To evaluate the speculations, we collected cyberbullying related public tweets (N 454,046) posted between January 1st, 2020 June 7th, 2020. A simple visual frequentist analysis ignores serial correlation and does not depict changepoints as such. To address correlation and a relatively small number of time points, Bayesian estimation of the trends is proposed for the collected data via an autoregressive Poisson model. We show that this new Bayesian method detailed in this paper can clearly show the upward trend on cyberbullying related tweets since mid March 2020. However, this evidence itself does not signify a rise in cyberbullying but shows a correlation of the crisis with the discussion of such incidents by individuals. Our work emphasizes a critical issue of cyberbullying and how a global crisis impacts social media abuse and provides a trend analysis model that can be utilized for social media data analysis in general.


Artificial Tikkun Olam AI Can Be Our Best Friend in Building an Open Human Computer Society. Technological advances of virtually every kind pose risks to society including fairness and bias. We review a long standing wisdom that a widespread practical deployment of any technology may produce adverse side effects misusing the knowhow. This includes AI but AI systems are not solely responsible for societal risks. We describe some of the common and AI specific risks in health industries and other sectors and propose both broad and specific solutions. Each technology requires very specialized and informed tracking, monitoring and creative solutions. We postulate that AI systems are uniquely poised to produce conceptual and methodological solutions to both fairness and bias in automated decision making systems. We propose a simple intelligent system quotient that may correspond to their adverse societal impact and outline a multi tier architecture for producing solutions of increasing complexity to these risks. We also propose that universities may consider forming interdisciplinary Study of Future Technology Centers to investigate and predict the fuller range of risks posed by technology and seek both common and AI specific solutions using computational, technical, conceptual and ethical analysis


Multi Agent Systems based on Contextual Defeasible Logic considering Focus. In this paper, we extend previous work on distributed reasoning using Contextual Defeasible Logic (CDL), which enables decentralised distributed reasoning based on a distributed knowledge base, such that the knowledge from different knowledge bases may conflict with each other. However, there are many use case scenarios that are not possible to represent in this model. One kind of such scenarios are the ones that require that agents share and reason with relevant knowledge when issuing a query to others. Another kind of scenarios are those in which the bindings among the agents (defined by means of mapping rules) are not static, such as in knowledge intensive and dynamic environments. This work presents a multi agent model based on CDL that not only allows agents to reason with their local knowledge bases and mapping rules, but also allows agents to reason about relevant knowledge (focus) which are not known by the agents a priori in the context of a specific query. We present a use case scenario, some formalisations of the model proposed, and an initial implementation based on the BDI (Belief Desire Intention) agent model.


Non invariance of the Nevanlinna class under the action of the Cesaro and Volterra operators. Using a result of Hayman, we show that the Nevanlinna class of holomorphic functions on the unit disc is not invariant under the action of the Cesaro operator and more generally under the action of Volterra operators on elements g,provided that their derivative's reciprocal belongs to the Nevanlinna class.


Active Space Pair 2 Electron Reduced Density Matrix Theory for Strong Correlation. An active space variational calculation of the 2 electron reduced density matrix (2 RDM) is derived and implemented where the active orbitals are correlated within the pair approximation. The pair approximation considers only doubly occupied configurations of the wavefunction which enables the calculation of the 2 RDM at a computational cost of mathcal O (r 3) . Calculations were performed both with the pair active space configuration interaction (PASCI) method and the pair active space self consistent field (PASSCF) method. The latter includes a mixing of the active and inactive orbitals through unitary transformations. The active space pair 2 RDM method is applied to the nitrogen molecule, the p benzyne diradical, a newly synthesized BisCobalt complex, and the nitrogenase cofactor FeMoco. The FeMoco molecule is treated in a 120,120 active space. Fractional occupations are recovered in each of these systems, indicating the detection and recovery of strong electron correlation.


Interpreting convolutional networks trained on textual data. There have been many advances in the artificial intelligence field due to the emergence of deep learning. In almost all sub fields, artificial neural networks have reached or exceeded human level performance. However, most of the models are not interpretable. As a result, it is hard to trust their decisions, especially in life and death scenarios. In recent years, there has been a movement toward creating explainable artificial intelligence, but most work to date has concentrated on image processing models, as it is easier for humans to perceive visual patterns. There has been little work in other fields like natural language processing. In this paper, we train a convolutional model on textual data and analyze the global logic of the model by studying its filter values. In the end, we find the most important words in our corpus to our models logic and remove the rest (95 ). New models trained on just the 5 most important words can achieve the same performance as the original model while reducing training time by more than half. Approaches such as this will help us to understand NLP models, explain their decisions according to their word choices, and improve them by finding blind spots and biases.


Todxs cuentan cultivating diversity in combinatorics. This article describes the efforts of the SFSU Colombia Combinatorics Initiative to build a research and learning community between California and Colombia. It seeks to broaden and deepen representation in mathematics, based on four underlying principles 1. Mathematical potential is distributed equally among different groups, irrespective of geographic, demographic, and economic boundaries. 2. Everyone can have joyful, meaningful, and empowering mathematical experiences. 3. Mathematics is a powerful, malleable tool that can be shaped and used differently by various communities to serve their needs. 4. Every student deserves to be treated with dignity and respect.


Exploiting Ergonomic Priors in Human to Robot Task Transfer. In recent years, there has been a booming shift in the development of versatile, autonomous robots by introducing means to intuitively teach robots task oriented behaviour by demonstration. In this paper, a method based on programming by demonstration is proposed to learn null space policies from constrained motion data. The main advantage to using this is generalisation of a task by retargeting a systems redundancy as well as the capability to fully replace an entire system with another of varying link number and lengths while still accurately repeating a task subject to the same constraints. The effectiveness of the method has been demonstrated in a 3 link simulation and a real world experiment using a human subject as the demonstrator and is verified through task reproduction on a 7DoF physical robot. In simulation, the method works accurately with even as little as five data points producing errors less than 10 14. The approach is shown to outperform the current state of the art approach in a simulated 3DoF robot manipulator control problem where motions are reproduced using learnt constraints. Retargeting of a systems null space component is also demonstrated in a task where controlling how redundancy is resolved allows for obstacle avoidance. Finally, the approach is verified in a real world experiment using demonstrations from a human subject where the learnt task space trajectory is transferred onto a 7DoF physical robot of a different embodiment.


Synthesizing safe coalition strategies. Concurrent games with a fixed number of agents have been thoroughly studied, with various solution concepts and objectives for the agents. In this paper, we consider concurrent games with an arbitrary number of agents, and study the problem of synthesizing a coalition strategy to achieve a global safety objective. The problem is non trivial since the agents do not know a priori how many they are when they start the game. We prove that the existence of a safe arbitrary large coalition strategy for safety objectives is a PSPACE hard problem that can be decided in exponential space.


A Mathematical Model For the Spread of a Virus. This paper describes a mathematical model for the spread of a virus through an isolated population of a given size. The model uses three, color coded components, called molecules (red for infected and still contagious green for infected, but no longer contagious and blue for uninfected). In retrospect, the model turns out to be a digital analogue for the well known SIR model of Kermac and McKendrick (1927). In our RGB model, the number of accumulated infections goes through three phases, beginning at a very low level, then changing to a transition ramp of rapid growth, and ending in a plateau of final values. Consequently, the differential change or growth rate begins at 0, rises to a peak corresponding to the maximum slope of the transition ramp, and then falls back to 0. The properties of these time variations, including the slope, duration, and height of the transition ramp, and the width and height of the infection rate, depend on a single parameter the time that a red molecule is contagious divided by the average time between collisions of the molecules. Various temporal milestones, including the starting time of the transition ramp, the time that the accumulating number of infections obtains its maximum slope, and the location of the peak of the infection rate depend on the size of the population in addition to the contagious lifetime ratio. Explicit formulas for these quantities are derived and summarized. Finally, Appendix E has been added to describe the effect of vaccinations.


Approximation of random diffusion equation by nonlocal diffusion equation in free boundary problems of one space dimension. We show how the Stefan type free boundary problem with random diffusion in one space dimension can be approximated by the corresponding free boundary problem with nonlocal diffusion. The approximation problem is a slightly modified version of the nonlocal diffusion problem with free boundaries considered in 4,8 . The proof relies on the introduction of several auxiliary free boundary problems and constructions of delicate upper and lower solutions for these problems. As usual, the approximation is achieved by choosing the kernel function in the nonlocal diffusion term of the form J epsilon(x) frac 1 epsilon J( frac x epsilon) for small epsilon 0 , where J(x) has compact support. We also give an estimate of the error term of the approximation by some positive power of epsilon .


Gradient Sparification for Asynchronous Distributed Training. Modern large scale machine learning applications require stochastic optimization algorithms to be implemented on distributed computational architectures. A key bottleneck is the communication overhead for exchanging information, such as stochastic gradients, among different nodes. Recently, gradient sparsification techniques have been proposed to reduce communications cost and thus alleviate the network overhead. However, most of gradient sparsification techniques consider only synchronous parallelism and cannot be applied in asynchronous scenarios, such as asynchronous distributed training for federated learning at mobile devices. In this paper, we present a dual way gradient sparsification approach (DGS) that is suitable for asynchronous distributed training. We let workers download model difference, instead of the global model, from the server, and the model difference information is also sparsified so that the information exchanged overhead is reduced by sparsifying the dual way communication between the server and workers. To preserve accuracy under dual way sparsification, we design a sparsification aware momentum (SAMomentum) to turn sparsification into adaptive batch size between each parameter. We conduct experiments at a cluster of 32 workers, and the results show that, with the same compression ratio but much lower communication cost, our approach can achieve better scalability and generalization ability.


Exact solutions in low rank approximation with zeros. Low rank approximation with zeros aims to find a matrix of fixed rank and with a fixed zero pattern that minimizes the Euclidean distance to a given data matrix. We study the critical points of this optimization problem using algebraic tools. In particular, we describe special linear, affine, and determinantal relations satisfied by the critical points. We also investigate the number of critical points and how this number is related to the complexity of nonnegative matrix factorization problem.


Subsets and Supermajorities Optimal Hashing based Set Similarity Search. We formulate and optimally solve a new generalized Set Similarity Search problem, which assumes the size of the database and query sets are known in advance. By creating polylog copies of our data structure, we optimally solve any symmetric Approximate Set Similarity Search problem, including approximate versions of Subset Search, Maximum Inner Product Search (MIPS), Jaccard Similarity Search and Partial Match. Our algorithm can be seen as a natural generalization of previous work on Set as well as Euclidean Similarity Search, but conceptually it differs by optimally exploiting the information present in the sets as well as their complements, and doing so asymmetrically between queries and stored sets. Doing so we improve upon the best previous work MinHash J. Discrete Algorithms 1998 , SimHash STOC 2002 , Spherical LSF SODA 2016, 2017 and Chosen Path STOC 2017 by as much as a factor n 0.14 in both time and space or in the near constant time regime, in space, by an arbitrarily large polynomial factor. Turning the geometric concept, based on Boolean supermajority functions, into a practical algorithm requires ideas from branching random walks on mathbb Z 2 , for which we give the first non asymptotic near tight analysis. Our lower bounds follow from new hypercontractive arguments, which can be seen as characterizing the exact family of similarity search problems for which supermajorities are optimal. The optimality holds for among all hashing based data structures in the random setting, and by reductions, for 1 cell and 2 cell probe data structures. As a side effect, we obtain new hypercontractive bounds on the directed noise operator T p 1 to p 2 rho .


Face numbers of uniform triangulations of simplicial complexes. A triangulation of a simplicial complex Delta is called uniform if the f vector of its restriction to a face of Delta depends only on the dimension of that face. This paper proves that the entries of the h vector of a uniform triangulation of Delta can be expressed as nonnegative integer linear combinations of those of the h vector of Delta , where the coefficients depend only on the dimension of Delta and the f vectors of the restrictions of the triangulation to simplices of various dimensions. Moreover, it provides information about these coefficients, including formulas, recurrence relations and various interpretations, and gives a criterion for the h polynomial of a uniform triangulation to be real rooted. These results unify and generalize several results in the literature about special types of triangulations, such as barycentric, edgewise and interval subdivisions.


On the implosion of a three dimensional compressible fluid. We consider the compressible three dimensional Navier Stokes and Euler equations. In a suitable regime of barotropic laws, we construct a set of finite energy smooth initial data for which the corresponding solutions to both equations implode (with infinite density) at a later time at a point, and completely describe the associated formation of singularity. Two essential steps of the analysis are the existence of mathcal C infty smooth self similar solutions to the compressible Euler equations for quantized values of the speed and the derivation of spectral gap estimates for the associated linearized flow which are addressed in the companion papers cite MRRSprofile, MRRSdefoc . All blow up dynamics obtained for the Navier Stokes problem are of type II (non self similar).


Towards Business Partnership Recommendation Using User Opinion on Facebook. The identification of strategic business partnerships can potentially provide competitive advantages for businesses however, due to the dynamics and uncertainty present in business environments, this task could be challenging. To help businesses in this task, this study presents a similarity model between businesses that consider the opinions of users on content shared by businesses on social media. Thus, this model captures significant virtual relationships among businesses that are generated by users in the virtual world. Besides, we propose an algorithm for detecting business communities in the considered model. We also propose an algorithm to identify possible business outliers in the detected communities, which could represent an automatic way to identify non obvious relations that might deserve particular attention of business owners. By exploring approximately 280 million user reactions on Facebook, we show that our results could favor the development of, for example, a new strategic business partnership recommendation service.


Surfaces generating the even primal cohomology of an abelian fivefold. Given a very general abelian fivefold A and a principal polarization Theta subset A , we construct surfaces generating the algebraic part of the middle cohomology H 4( Theta, mathbb Q ) , and determine the intersection pairing between these surfaces. In particular, we obtain a new proof of the Hodge conjecture for H 4( Theta, mathbb Q ) and show that it contains a copy of the root lattice of E 6 .


DeepSoCS A Neural Scheduler for Heterogeneous System on Chip (SoC) Resource Scheduling. In this paper, we present a novel scheduling solution for a class of System on Chip (SoC) systems where heterogeneous chip resources (DSP, FPGA, GPU, etc.) must be efficiently scheduled for continuously arriving hierarchical jobs with their tasks represented by a directed acyclic graph. Traditionally, heuristic algorithms have been widely used for many resource scheduling domains, and Heterogeneous Earliest Finish Time (HEFT) has been a dominating state of the art technique across a broad range of heterogeneous resource scheduling domains over many years. Despite their long standing popularity, HEFT like algorithms are known to be vulnerable to a small amount of noise added to the environment. Our Deep Reinforcement Learning (DRL) based SoC Scheduler (DeepSoCS), capable of learning the "best" task ordering under dynamic environment changes, overcomes the brittleness of rule based schedulers such as HEFT with significantly higher performance across different types of jobs. We describe a DeepSoCS design process using a real time heterogeneous SoC scheduling emulator, discuss major challenges, and present two novel neural network design features that lead to outperforming HEFT (i) hierarchical job and task graph embedding and (ii) efficient use of real time task information in the state space. Furthermore, we introduce effective techniques to address two fundamental challenges present in our environment delayed consequences and joint actions. Through an extensive simulation study, we show that our DeepSoCS exhibits the significantly higher performance of job execution time than that of HEFT with a higher level of robustness under realistic noise conditions. We conclude with a discussion of the potential improvements for our DeepSoCS neural scheduler.


Descent of properties of rings and pairs of rings to fixed rings. Let G be a group acting via ring automorphisms on an integral domain R. A ring theoretic property of R is said to be G invariant, if R G also has the property, where R G r in R sigma(r) r text for all sigma in G , the fixed ring of the action. In this paper we prove the following classes of rings are invariant under the operation R rightarrow R G locally pqr domains, Strong G domains, G domains, Hilbert rings, S strong rings and root closed domains. Further let mathscr P be a ring theoretic property and R subseteq S be a ring extension. A pair of rings (R,S) is said to be a mathscr P pair, if T satisfies mathscr P for each intermediate ring R subseteq T subseteq S. We also prove that the property mathscr P descends from (R,S) rightarrow (R G, S G) in several cases. For instance, if mathscr P Going down, Pseudo valuation domain and "finite length of intermediate chains of domains", we show each of these properties successfully transfer from (R,S) rightarrow (R G, S G).


Asymptotic of Cauchy biorthogonal polynomials. We consider sequences of biorthogonal polynomials with respect to a Cauchy type convolution kernel and give the weak and ratio asymptotic of the corresponding sequences of biorthogonal polynomials. The construction is intimately related with a mixed type Hermite Pad 'e approximation problem whose asymptotic properties is also revealed.


Stochastic Camassa Holm equation with convection type noise. We consider a stochastic Camassa Holm equation driven by a one dimensional Wiener process with a first order differential operator as diffusion coefficient. We prove the existence and uniqueness of local strong solutions of this equation. In order to do so, we transform it into a random quasi linear partial differential equation and apply Kato's operator theory methods. Some of the results have potential to find applications to other nonlinear stochastic partial differential equations.


Landscape of Machine Implemented Ethics. This paper surveys the state of the art in machine ethics, that is, considerations of how to implement ethical behaviour in robots, unmanned autonomous vehicles, or software systems. The emphasis is on covering the breadth of ethical theories being considered by implementors, as well as the implementation techniques being used. There is no consensus on which ethical theory is best suited for any particular domain, nor is there any agreement on which technique is best placed to implement a particular theory. Another unresolved problem in these implementations of ethical theories is how to objectively validate the implementations. The paper discusses the dilemmas being used as validating 'whetstones' and whether any alternative validation mechanism exists. Finally, it speculates that an intermediate step of creating domain specific ethics might be a possible stepping stone towards creating machines that exhibit ethical behaviour.


Eigenrays in 3D heterogeneous anisotropic media Part IV Geometric spreading from traveltime Hessian. Considering 3D heterogeneous anisotropic media, in Part III of this study we obtain the finite element solution for the stationary ray path between two fixed endpoints using the finite element approach. It involves computation of the global (all node) traveltime gradient vector and Hessian matrix, with respect to the nodal location and direction components. The global traveltime Hessian of the resolved stationary ray also plays an important role for obtaining the dynamic characteristics along the ray. It is a band matrix that includes the spatial, directional and mixed second derivatives of the traveltime at all nodes and nodal pairs. In Parts V, VI and VII of this study we explicitly use the global traveltime Hessian for solving the dynamic ray tracing equation, to obtain the geometric spreading at each point along the ray. Moreover, the dynamic ray tracing makes it possible to identify classify caustics along the ray. In this part (Part IV) we propose an original two stage approach for computing the relative geometric spreading of the entire ray path without explicitly performing the dynamic ray tracing. The first stage consists of an efficient algorithm for reducing the already computed global traveltime Hessian into a endpoint spatial traveltime Hessian. The second stage involves application of a known workflow for computing the geometrical spreading using the endpoint traveltime Hessian. Note that the method proposed in this part (Part IV) does not deliver information about caustics, nor the geometric spreading at intermediate points of the stationary ray path. Throughout the examples presented in Part VII we demonstrate the accuracy of the method proposed in this part over a set of isotropic and anisotropic examples by comparing the geometric spreading computed from this method based on the traveltime Hessian reduction with the one computed from the dynamic ray tracing.


Excursion Risk. The risk and return profiles of a broad class of dynamic trading strategies, including pairs trading and other statistical arbitrage strategies, may be characterized in terms of excursions of the market price of a portfolio away from a reference level. We propose a mathematical framework for the risk analysis of such strategies, based on a description in terms of price excursions, first in a pathwise setting, without probabilistic assumptions, then in a Markovian setting. We introduce the notion of delta excursion, defined as a path which deviates by delta from a reference level before returning to this level. We show that every continuous path has a unique decomposition into delta excursions, which is useful for the scenario analysis of dynamic trading strategies, leading to simple expressions for the number of trades, realized profit, maximum loss and drawdown. As delta is decreased to zero, properties of this decomposition relate to the local time of the path. When the underlying asset follows a Markov process, we combine these results with Ito's excursion theory to obtain a tractable decomposition of the process as a concatenation of independent delta excursions, whose distribution is described in terms of Ito's excursion measure. We provide analytical results for linear diffusions and give new examples of stochastic processes for flexible and tractable modeling of excursions. Finally, we describe a non parametric scenario simulation method for generating paths whose excursion properties match those observed in empirical data.


Adversarial Attacks Against Deep Learning Systems for ICD 9 Code Assignment. Manual annotation of ICD 9 codes is a time consuming and error prone process. Deep learning based systems tackling the problem of automated ICD 9 coding have achieved competitive performance. Given the increased proliferation of electronic medical records, such automated systems are expected to eventually replace human coders. In this work, we investigate how a simple typo based adversarial attack strategy can impact the performance of state of the art models for the task of predicting the top 50 most frequent ICD 9 codes from discharge summaries. Preliminary results indicate that a malicious adversary, using gradient information, can craft specific perturbations, that appear as regular human typos, for less than 3 of words in the discharge summary to significantly affect the performance of the baseline model.


I2PA, U prove, and Idemix An Evaluation of Memory Usage and Computing Time Efficiency in an IoT Context. The Internet of Things (IoT), in spite of its innumerable advantages, brings many challenges namely issues about users' privacy preservation and constraints about lightweight cryptography. Lightweight cryptography is of capital importance since IoT devices are qualified to be resource constrained. To address these challenges, several Attribute Based Credentials (ABC) schemes have been designed including I2PA, U prove, and Idemix. Even though these schemes have very strong cryptographic bases, their performance in resource constrained devices is a question that deserves special attention. This paper aims to conduct a performance evaluation of these schemes on issuance and verification protocols regarding memory usage and computing time. Recorded results show that both I2PA and U prove present very interesting results regarding memory usage and computing time while Idemix presents very low performance with regard to computing time.


Deep Spiking Neural Networks for Large Vocabulary Automatic Speech Recognition. Artificial neural networks (ANN) have become the mainstream acoustic modeling technique for large vocabulary automatic speech recognition (ASR). A conventional ANN features a multi layer architecture that requires massive amounts of computation. The brain inspired spiking neural networks (SNN) closely mimic the biological neural networks and can operate on low power neuromorphic hardware with spike based computation. Motivated by their unprecedented energyefficiency and rapid information processing capability, we explore the use of SNNs for speech recognition. In this work, we use SNNs for acoustic modeling and evaluate their performance on several large vocabulary recognition scenarios. The experimental results demonstrate competitive ASR accuracies to their ANN counterparts, while require significantly reduced computational cost and inference time. Integrating the algorithmic power of deep SNNs with energy efficient neuromorphic hardware, therefore, offer an attractive solution for ASR applications running locally on mobile and embedded devices.


Dodging DeepFake Detection via Implicit Spatial Domain Notch Filtering. The current high fidelity generation and high precision detection of DeepFake images are at an arms race. We believe that producing DeepFakes that are highly realistic and detection evasive'' can serve the ultimate goal of improving future generation DeepFake detection capabilities. In this paper, we propose a simple yet powerful pipeline to reduce the artifact patterns of fake images without hurting image quality by performing implicit spatial domain notch filtering. We first demonstrate that frequency domain notch filtering, although famously shown to be effective in removing periodic noise in the spatial domain, is infeasible for our task at hand due to manual designs required for the notch filters. We, therefore, resort to a learning based approach to reproduce the notch filtering effects, but solely in the spatial domain. We adopt a combination of adding overwhelming spatial noise for breaking the periodic noise pattern and deep image filtering to reconstruct the noise free fake images, and we name our method DeepNotch. Deep image filtering provides a specialized filter for each pixel in the noisy image, producing filtered images with high fidelity compared to their DeepFake counterparts. Moreover, we also use the semantic information of the image to generate an adversarial guidance map to add noise intelligently. Our large scale evaluation on 3 representative state of the art DeepFake detection methods (tested on 16 types of DeepFakes) has demonstrated that our technique significantly reduces the accuracy of these 3 fake image detection methods, 36.79 on average and up to 97.02 in the best case.


Deciding whether two quadratic surfaces actually intersect. We answer an open question proposed by P ' o lik and Terlaky in 2007 that it how we can decide whether two quadratic surfaces intersect without actually computing the intersections?


From Generic Partition Refinement to Weighted Tree Automata Minimization. Partition refinement is a method for minimizing automata and transition systems of various types. Recently, we have developed a partition refinement algorithm that is generic in the transition type of the given system and matches the run time of the best known algorithms for many concrete types of systems, e.g. deterministic automata as well as ordinary, weighted, and probabilistic (labelled) transition systems. Genericity is achieved by modelling transition types as functors on sets, and systems as coalgebras. In the present work, we refine the run time analysis of our algorithm to cover additional instances, notably weighted automata and, more generally, weighted tree automata. For weights in a cancellative monoid we match, and for non cancellative monoids such as (the additive monoid of) the tropical semiring even substantially improve, the asymptotic run time of the best known algorithms. We have implemented our algorithm in a generic tool that is easily instantiated to concrete system types by implementing a simple refinement interface. Moreover, the algorithm and the tool are modular, and partition refiners for new types of systems are obtained easily by composing pre implemented basic functors. Experiments show that even for complex system types, the tool is able to handle systems with millions of transitions.


Getting a head start the slime mold, Physarum polycephalum, tune foraging decision to motivational asymmetry when faced with competition. Slime mould plasmodia can adjust their behaviour in response to chemical trails left by themselves and other Physarum plasmodia. This simple feedback process increases their foraging efficiency. We still do not know whether other factors influence plasmodium behaviour in realistic competition settings. Here we designed a competition experiment where two plasmodia had to find one food source in a common environment. As previously shown, the time it took plasmodia to find food depended on their hunger motivation. However, the time it took a plasmodium to start looking for food depended on its motivation and the motivation of its competitor. Plasmodia always initiated foraging quicker if they were in the presence of a competitor and the quickest if they were hungry and in the presence of a satiated competitor. The time it took to arrive to the food was not influenced by whether they were alone or with a competitor. Ultimately, this complex competition response benefited the hungry plasmodia as they had a 4 1 chance of finding the food first. The sensory ecology of Physarum polycephalum is more complex than previously thought and yields complex behaviour in a simple organism.


High Gain Harmonic Generation with temporally overlapping seed pulses and application to ultrafast spectroscopy. Collinear double pulse seeding of the High Gain Harmonic Generation (HGHG) process in a free electron laser (FEL) is a promising approach to facilitate various coherent nonlinear spectroscopy schemes in the extreme ultraviolet (XUV) spectral range. However, in collinear arrangements using a single nonlinear medium, temporally overlapping seed pulses may introduce nonlinear mixing signals that compromise the experiment at short time delays. Here, we investigate these effects in detail by extending the analysis described in a recent publication (Wituschek et al., Nat. Commun., 11, 883, 2020). High order fringe resolved autocorrelation and wave packet interferometry experiments at photon energies 23 , eV are performed, accompanied by numerical simulations. It turns out that both the autocorrelation and the wave packet interferometry data are very sensitive to saturation effects and can thus be used to characterize saturation in the HGHG process. Our results further imply that time resolved spectroscopy experiments are feasible even for time delays smaller than the seed pulse duration.


Comparison of Statistical and Machine Learning Techniques for Physical Layer Authentication. In this paper we consider authentication at the physical layer, in which the authenticator aims at distinguishing a legitimate supplicant from an attacker on the basis of the characteristics of a set of parallel wireless channels, which are affected by time varying fading. Moreover, the attacker's channel has a spatial correlation with the supplicant's one. In this setting, we assess and compare the performance achieved by different approaches under different channel conditions. We first consider the use of two different statistical decision methods, and we prove that using a large number of references (in the form of channel estimates) affected by different levels of time varying fading is not beneficial from a security point of view. We then consider classification methods based on machine learning. In order to face the worst case scenario of an authenticator provided with no forged messages during training, we consider one class classifiers. When instead the training set includes some forged messages, we resort to more conventional binary classifiers, considering the cases in which such messages are either labelled or not. For the latter case, we exploit clustering algorithms to label the training set. The performance of both nearest neighbor (NN) and support vector machine (SVM) classification techniques is evaluated. Through numerical examples, we show that under the same probability of false alarm, one class classification (OCC) algorithms achieve the lowest probability of missed detection when a small spatial correlation exists between the main channel and the adversary one, while statistical methods are advantageous when the spatial correlation between the two channels is large.


Modular WSS based OXCs for Large Scale Optical Networks. The explosive growth of broadband applications calls for large scale optical cross connects (OXCs). However, the classical wavelength selective switch (WSS) based OXC is not scalable in terms of the size of employed WSSs and the cabling complexity. To solve this problem, we propose a three phase approach to construct a modular WSS based OXC. In phase 1, we factorize the interconnection network between the input stage and the output stage of the traditional OXC into a set of small size interconnection networks. In phase 2, we decompose each WSS into a two stage cascaded structure of small size WSSs. In phase 3, we combine the small size interconnection networks with the small size WSSs to form a set of small size OXC modules. At last, we obtain a modular OXC, which is a network of small size OXCs. Similar to the classical OXC, the modular OXC is nonblocking at each wavelength and possesses a self routing property. Our analysis shows that the modular OXC has small cabling complexity and acceptable physical layer performance.


The Eichler integral of E 2 and q brackets of t hook functions. For functions f mathcal P rightarrow mathbb C on partitions, Bloch and Okounkov defined a power series langle f rangle q that is the "weighted average" of f . As Fourier series in q e 2 pi i z , such q brackets generate the ring of quasimodular forms, and the modular forms that are powers of Dedekind's eta function. Using work of Berndt and Han, we build modular objects from f t( lambda) t sum h in mathcal H t( lambda) frac 1 h 2 , weighted sums over partition hook numbers that are multiples of t . We find that langle f t rangle q is the Eichler integral of (1 E 2(tz)) 24, which we modify to construct a function M t(z) that enjoys weight 0 modularity properties. As a consequence, the non modular Fourier series H t (z) sum lambda in mathcal P f t( lambda)q lambda frac 1 24 inherits weight 1 2 modularity properties. These are sufficient to imply a Chowla Selberg type result, generalizing the fact that weight k algebraic modular forms evaluated at discriminant D 0 points tau are algebraic multiples of Omega D k, the k th power of the canonical period. If we let Psi( tau) pi i left( frac tau 2 3 tau 1 12 tau right) frac log( tau) 2 , then for t 1 we prove that H 1 ( 1 tau) frac 1 sqrt i tau cdot H 1 ( tau) in overline mathbb Q cdot frac Psi( tau) sqrt Omega D .


Modeling ionic reactions at interstellar temperatures the case of NH2 H2 NH3 H . We present in this paper the main structural features and enthalpy details for the energy profiles of the title reactions, both for the exothermic (forward) path to NH 3 formation and for the endothermic (reverse) reaction to NH 2 formation. Both systems have relevance for the nitrogen chemistry in the interstellar medium (ISM). They are also helpful to document the possible role of H in molecular clouds at temperatures well below room temperature. The structural calculations are carried out using ab initio methods and are further employed to obtain the reaction rates down to the interstellar temperatures detected in earlier experiments. The reaction rates are obtained from the computed Minimum Energy Path (MEP) using the Variational Transition State Theory (VTST) approach. The results indicate very good accord with the experiments at room temperature, while the measured low temperature data down to 8 K are well described once we analyse in detail the physics of the reactions and modify accordingly the VTST approach. This is done by employing a T dependent scaling, from room temperature conditions down to the lower ISM temperatures, which acknowledges the non canonical behavior of the fast, barrierless exothermic reaction. This feature was also suggested in the earlier work discussed below in our main text. The physical reasons for the experimental behavior, and the need for improving on the VTST method when used away from room temperatures, are discussed in detail.


The k interchange constrained diameter of a transit network A connectedness indicator that accounts for travel convenience. We study two variants of the shortest path problem. Given an integer k, the k color constrained and the k interchange constrained shortest path problems, respectively seek a shortest path that uses no more than k colors and one that makes no more than k 1 alternations of colors. We show that the former problem is NP hard, when the latter is tractable. The study of these problems is motivated by some limitations in the use of diameter based metrics to evaluate the topological structure of transit networks. We notably show that indicators such as the diameter or directness of a transit network fail to adequately account for travel convenience in measuring the connectivity of a network and propose a new network indicator, based on solving the k interchange constrained shortest path problem, that aims at alleviating these limitations.


On the Nash problem for terminal threefolds of type cA r . We study Nash valuations and essential valuations of terminal threefolds of type cA r . If r 1 or the given threefold is mathbb Q factorial, then all the Nash valuations and essential valuations can be completely described. We construct non Gorenstein or non mathbb Q factorial counter examples for the Nash problem.


Resource Sharing in the Edge A Distributed Bargaining Theoretic Approach. The growing demand for edge computing resources, particularly due to increasing popularity of Internet of Things (IoT), and distributed machine deep learning applications poses a significant challenge. On the one hand, certain edge service providers (ESPs) may not have sufficient resources to satisfy their applications according to the associated service level agreements. On the other hand, some ESPs may have additional unused resources. In this paper, we propose a resource sharing framework that allows different ESPs to optimally utilize their resources and improve the satisfaction level of applications subject to constraints such as communication cost for sharing resources across ESPs. Our framework considers that different ESPs have their own objectives for utilizing their resources, thus resulting in a multi objective optimization problem. We present an N person emph Nash Bargaining Solution (NBS) for resource allocation and sharing among ESPs with emph Pareto optimality guarantee. Furthermore, we propose a emph distributed , primal dual algorithm to obtain the NBS by proving that the strong duality property holds for the resultant resource sharing optimization problem. Using synthetic and real world data traces, we show numerically that the proposed NBS based framework not only enhances the ability to satisfy applications' resource demands, but also improves utilities of different ESPs.


Information Driven Design for Shock Tube Laser Absorption Studies of Fundamental Rate Constants in Combustion, with Application to Methanol Pyrolysis. Shock tube experiments, paired with precision laser diagnostics, are ideal venues to provide kinetics data critically needed for the development, validation and optimization of modern combustion kinetics models. However, to design sensitive, accurate, feasible and information rich experiments that may yield such data often requires sophisticated planning. This study presents a mathematical framework and quantitative approach to guide such experimental design, namely a method to pin point the optimal conditions for specific experimentation under realistic constraints of the shock tubes and diagnostic tools involved. For demonstration purpose, the current work is focused on a key type of shock tube kinetic experiments direct determination of fundamental reaction rate constants. Specifically, this study utilizes a Bayesian approach to maximize the prior posterior gain in Shannon information of the rate constants to be inferred from the intended experiment. Example application of this method to the experimental determination of the CH 3 OH H (k 1 ) and CH 2 O H (k 2 ) rate constants is demonstrated in shock tube laser absorption studies of the CH 3 OH pyrolysis system, yielding new recommended rate constant expressions (over 1287 K 1537 K) as k 1 2.50 times 10 6 (T K) 2.35 exp( 2975 K T) , cm 3mol 1 s 1 pm 11.4 and k 2 7.06 times 10 7 (T K) 1.9 exp( 1380 K T) , cm 3mol 1 s 1 pm 9.7 . Potential extension to other types of kinetic studies, e.g. prediction of combustion benchmarks such as ignition delay times and species yields, and global uncertainty minimization of generic reaction models, are also briefly discussed.


(k, l) Medians Clustering of Trajectories Using Continuous Dynamic Time Warping. Due to the massively increasing amount of available geospatial data and the need to present it in an understandable way, clustering this data is more important than ever. As clusters might contain a large number of objects, having a representative for each cluster significantly facilitates understanding a clustering. Clustering methods relying on such representatives are called center based. In this work we consider the problem of center based clustering of trajectories. In this setting, the representative of a cluster is again a trajectory. To obtain a compact representation of the clusters and to avoid overfitting, we restrict the complexity of the representative trajectories by a parameter l. This restriction, however, makes discrete distance measures like dynamic time warping (DTW) less suited. There is recent work on center based clustering of trajectories with a continuous distance measure, namely, the Fr 'echet distance. While the Fr 'echet distance allows for restriction of the center complexity, it can also be sensitive to outliers, whereas averaging type distance measures, like DTW, are less so. To obtain a trajectory clustering algorithm that allows restricting center complexity and is more robust to outliers, we propose the usage of a continuous version of DTW as distance measure, which we call continuous dynamic time warping (CDTW). Our contribution is twofold 1. To combat the lack of practical algorithms for CDTW, we develop an approximation algorithm that computes it. 2. We develop the first clustering algorithm under this distance measure and show a practical way to compute a center from a set of trajectories and subsequently iteratively improve it. To obtain insights into the results of clustering under CDTW on practical data, we conduct extensive experiments.


Efficient estimation of a Gromov Hausdorff distance between unweighted graphs. Gromov Hausdorff distances measure shape difference between the objects representable as compact metric spaces, e.g. point clouds, manifolds, or graphs. Computing any Gromov Hausdorff distance is equivalent to solving an NP Hard optimization problem, deeming the notion impractical for applications. In this paper we propose polynomial algorithm for estimating the so called modified Gromov Hausdorff (mGH) distance, whose topological equivalence with the standard Gromov Hausdorff (GH) distance was established in cite memoli12 (M 'emoli, F, textit Discrete Computational Geometry, 48 (2) 416 440, 2012). We implement the algorithm for the case of compact metric spaces induced by unweighted graphs as part of Python library verb scikit tda , and demonstrate its performance on real world and synthetic networks. The algorithm finds the mGH distances exactly on most graphs with the scale free property. We use the computed mGH distances to successfully detect outliers in real world social and computer networks.


Smart City IoT Services Creation through Large Scale Collaboration. Smart cities solutions are often monolithically implemented, from sensors data handling through to the provided services. The same challenges are regularly faced by different developers, for every new solution in a new city. Expertise and know how can be re used and the effort shared. In this article we present the methodologies to minimize the efforts of implementing new smart city solutions and maximizing the sharing of components. The final target is to have a live technical community of smart city application developers. The results of this activity comes from the implementation of 35 city services in 27 cities between Europe and South Korea. To share efforts, we encourage developers to devise applications using a modular approach. Single function components that are re usable by other city services are packaged and published as standalone components, named Atomic Services. We identify 15 atomic services addressing smart city challenges in data analytics, data evaluation, data integration, data validation, and visualization. 38 instances of the atomic services are already operational in several smart city services. We detail in this article, as atomic service examples, some data predictor components. Furthermore, we describe real world atomic services usage in the scenarios of Santander and three Danish cities. The resulting atomic services also generate a side market for smart city solutions, allowing expertise and know how to be re used by different stakeholders.


Farthest Point Problem and Partial Statistical Continuity in Normed Linear Spaces. In this paper, we prove that if E is a uniquely remotal subset of a real normed linear space X such that E has a Chebyshev center c in X and the farthest point map F X rightarrow E restricted to c,F(c) is partially statistically continuous at c , then E is a singleton. We obtain a necessary condition on uniquely remotal subsets of uniformly rotund Banach spaces to be a singleton. Moreover, we show that there exists a remotal set M having a Chebyshev center c such that the farthest point map F mathbb R rightarrow M is not continuous at c but is partially statistically continuous there in the multivalued sense.


Application of Fuzzy Rule based System for Highway Research Board Classification of Soils. Fuzzy rule based model is a powerful tool for imitating the human way of thinking and solving uncertainty related problems as it allows for understandable and interpretable rule bases. The objective of this paper is to study the applicability of fuzzy rule based modelling to quantify soil classification for engineering purposes by qualitatively considering soil index properties. The classification system of the Highway Research Board is considered to illustrate a fuzzy rule based model. The soil's index properties are fuzzified using triangular functions, and the fuzzy membership values are calculated. Fuzzy arithmetical operators are then applied to the membership values obtained for classification. Fuzzy decision tree classification algorithm is used to derive fuzzy if then rules to quantify qualitative soil classification. The proposed system is implemented in MATLAB. The results obtained are checked and the implementation of the proposed model is measured against the outcomes of the laboratory tests.


Seiberg Witten Casson Invariant of Homology S 1 times S 3 with Circle Action. In this paper we shall compute the Mrowka Ruberman Saveliev invariant introduced in 17 for the case when the manifold admits a free circle action.


Blocksequences of k local Words. The locality of words is a relatively young structural complexity measure, introduced by Day et al. in 2017 in order to define classes of patterns with variables which can be matched in polynomial time. The main tool used to compute the locality of a word is called marking sequence an ordering of the distinct letters occurring in the respective order. Once a marking sequence is defined, the letters of the word are marked in steps in the ith marking step, all occurrences of the ith letter of the marking sequence are marked. As such, after each marking step, the word can be seen as a sequence of blocks of marked letters separated by blocks of non marked letters. By keeping track of the evolution of the marked blocks of the word through the marking defined by a marking sequence, one defines the blocksequence of the respective marking sequence. We first show that the words sharing the same blocksequence are only loosely connected, so we consider the stronger notion of extended blocksequence, which stores additional information on the form of each single marked block. In this context, we present a series of combinatorial results for words sharing the extended blocksequence.


Non singular solutions of p Laplace problems, allowing multiple changes of sign in the nonlinearity. For the p Laplace Dirichlet problem (where varphi (t) t t p 2 , p 1 ) varphi(u'(x))' f(u(x)) 0 mbox for 1 x 1 , u( 1) u(1) 0 assume that f'(u) (p 1) frac f(u) u 0 for u gamma 0 , while int u gamma f(t) , dt 0 for all u in (0, gamma) . Then any positive solution, with max ( 1,1) u(x) u(0) gamma , is non singular, no matter how many times f(u) changes sign on (0, gamma) . Uniqueness of solution follows.


Approximating Vertex Cover using Structural Rounding. In this work, we provide the first practical evaluation of the structural rounding framework for approximation algorithms. Structural rounding works by first editing to a well structured class, efficiently solving the edited instance, and "lifting" the partial solution to recover an approximation on the input. We focus on the well studied Vertex Cover problem, and edit to the class of bipartite graphs (where Vertex Cover has an exact polynomial time algorithm). In addition to the naive lifting strategy for Vertex Cover described by Demaine et al., we introduce a suite of new lifting strategies and measure their effectiveness on a large corpus of synthetic graphs. We find that in this setting, structural rounding significantly outperforms standard 2 approximations. Further, simpler lifting strategies are extremely competitive with the more sophisticated approaches. The implementations are available as an open source Python package, and all experiments are replicable.


Fluctuation of eigenvalues of symmetric circulant matrices with independent entries. In this article, we study the fluctuation of linear eigenvalue statistics of symmetric circulant matrices (SC n) with independent entries which satisfy some moment conditions. We show that frac 1 sqrt n Tr phi(SC n) obey the central limit theorem (CLT) type result, where phi is a nice test function.


Interatomic distance dependence of resonant energy transfer phenomena. It is well known that interatomic or intermolecular interactions driven by two center electronic dipole dipole correlations fall off rapidly with the inter site distance. We show, however, that the effective strength of interatomic reaction channels, which are triggered by a resonant field, can exhibit a nonmonotonous distance dependence, being strongly reduced when the atoms come closer. This surprising result is demonstrated by considering resonant two center photoionization as an example. Our findings are supported by available experimental data.


On values of the higher derivatives of the Barnes zeta function at non positive integers. Let x be a complex number which has a positive real part, and w 1, ldots,w N be positive rational numbers. We show that w s zeta N (s, x w 1, ldots, w N) can be expressed as a finite linear combination of the Hurwitz zeta functions over mathbb Q(x) , where zeta N (s,x w 1, ldots, w N) is the Barnes zeta function and w is a positive rational number explicitly determined by w 1, ldots, w N . Furthermore, we give generalizations of Kummer's formula on the gamma function and Koyama Kurokawa's formulae on the multiple gamma functions, and an explicit formula for the values at non positive integers for higher order derivatives of the Barnes zeta function in the case that x is a positive rational number, involving the generalized Stieltjes constants and the values at positive integers of the Riemann zeta function. Our formulae also makes it possible to calculate an approximation in the case that w 1, ldots, w N and x are positive real numbers.


FOCUS Flexible Optimizable Counterfactual Explanations for Tree Ensembles. Model interpretability has become an important problem in machine learning (ML) due to the increased effect that algorithmic decisions have on humans. Counterfactual explanations can help users understand not only why ML models make certain decisions, but also how these decisions can be changed. We frame the problem of finding counterfactual explanations as a gradient based optimization task and extend previous work that could only be applied to differentiable models. In order to accommodate non differentiable models such as tree ensembles, we use probabilistic model approximations in the optimization framework. We introduce an approximation technique that is effective for finding counterfactual explanations for predictions of the original model and show that our counterfactual examples are significantly closer to the original instances than those produced by other methods specifically designed for tree ensembles.