Neverland Lightweight Hardware Extensions for Enforcing Operating System Integrity. The security of applications hinges on the trustworthiness of the operating system, as applications rely on the OS to protect code and data. As a result, multiple protections for safeguarding the integrity of kernel code and data are being continuously proposed and deployed. These existing protections, however, are far from ideal as they either provide partial protection, or require complex and high overhead hardware and software stacks. In this work, we present Neverland a low overhead, hardware assisted, memory protection scheme that safeguards the operating system from rootkits and kernel mode malware. Once the system is done booting, Neverland's hardware takes away the operating system's ability to overwrite certain configuration registers, as well as portions of its own physical address space that contain kernel code and security critical data. Furthermore, it prohibits the CPU from fetching privileged code from any memory region lying outside the physical addresses assigned to the OS kernel and drivers (regardless of virtual page permissions). This combination of protections makes it extremely hard for an attacker to tamper with the kernel or introduce new privileged code into the system even in the presence of kernel vulnerabilities. Our evaluations show that the extra hardware required to support these protections incurs minimal silicon and energy overheads. Neverland enables operating systems to reduce their attack surface without having to rely on complex integrity monitoring software or hardware.


On the counting function of semiprimes. A semiprime is a natural number which can be written as the product of two primes. The asymptotic behaviour of the function pi 2(x) , the number of semiprimes less than or equal to x , is studied. Using a combinatorial argument, asymptotic series of pi 2(x) is determined, with all the terms explicitly given. An algorithm for the calculation of the constants involved in the asymptotic series is presented and the constants are computed to 20 significant digits. The errors of the partial sums of the asymptotic series are investigated. A generalization of this approach to products of k primes, for k geq 3 , is also proposed.


Planning with Selective Physics based Simulation for Manipulation Among Movable Objects. Use of physics based simulation as a planning model enables a planner to reason and generate plans that involve non trivial interactions with the world. For example, grasping a milk container out of a cluttered refrigerator may involve moving a robot manipulator in between other objects, pushing away the ones that are movable and avoiding interactions with certain fragile containers. A physics based simulator allows a planner to reason about the effects of interactions with these objects and to generate a plan that grasps the milk container successfully. The use of physics based simulation for planning however is underutilized. One of the reasons for it being that physics based simulations are typically way too slow for being used within a planning loop that typically requires tens of thousands of actions to be evaluated within a matter of a second or two. In this work, we develop a planning algorithm that tries to address this challenge. In particular, it builds on the observation that only a small number of actions actually need to be simulated using physics, and the remaining set of actions, such as moving an arm around obstacles, can be evaluated using a much simpler internal planning model, e.g., a simple collision checking model. Motivated by this, we develop an algorithm called Planning with Selective Physics based Simulation that automatically discovers what should be simulated with physics and what can utilize an internal planning model for pick and place tasks.


Almost Gorenstein rings arising from fiber products. The purpose of this paper is, as part of the stratification of Cohen Macaulay rings, to investigate the question of when the fiber products are almost Gorenstein rings. We show that the fiber product R times T S of Cohen Macaulay local rings R , S of the same dimension d 0 over a regular local ring T with dim T d 1 is an almost Gorenstein ring if and only if so are R and S . Besides, the other generalizations of Gorenstein properties are also explored.


Aggregation and Finetuning for Clothes Landmark Detection. Landmark detection for clothes is a fundamental problem for many applications. In this paper, a new training scheme for clothes landmark detection textit Aggregation and Finetuning , is proposed. We investigate the homogeneity among landmarks of different categories of clothes, and utilize it to design the procedure of training. Extensive experiments show that our method outperforms current state of the art methods by a large margin. Our method also won the 1st place in the DeepFashion2 Challenge 2020 Clothes Landmark Estimation Track with an AP of 0.590 on the test set, and 0.615 on the validation set. Code will be publicly available at https github.com lzhbrian deepfashion2 kps agg finetune .


When do cross diffusion systems have an entropy structure?. Necessary and sufficient conditions for the existence of an entropy structure for certain classes of cross diffusion systems with diffusion matrix A(u) are derived, based on results from matrix factorization. The entropy structure is important in the analysis for such equations since A(u) is typically neither symmetric nor positive definite. In particular, the normal ellipticity of A(u) for all u and the symmetry of the Onsager matrix implies its positive definiteness and hence an entropy structure. If A is constant or nearly constant in a certain sense, the existence of an entropy structure is equivalent to the normal ellipticity of A . Several applications and examples are presented, including the n species population model of Shigesada, Kawasaki, and Teramoto, a volume filling model, and a fluid mixture model with partial pressure gradients. Furthermore, the normal elipticity of these models is investigated and some extensions are discussed.


Multi Agent Pathfinding Definitions, Variants, and Benchmarks. The MAPF problem is the fundamental problem of planning paths for multiple agents, where the key constraint is that the agents will be able to follow these paths concurrently without colliding with each other. Applications of MAPF include automated warehouses and autonomous vehicles. Research on MAPF has been flourishing in the past couple of years. Different MAPF research papers make different assumptions, e.g., whether agents can traverse the same road at the same time, and have different objective functions, e.g., minimize makespan or sum of agents' actions costs. These assumptions and objectives are sometimes implicitly assumed or described informally. This makes it difficult to establish appropriate baselines for comparison in research papers, as well as making it difficult for practitioners to find the papers relevant to their concrete application. This paper aims to fill this gap and support researchers and practitioners by providing a unifying terminology for describing common MAPF assumptions and objectives. In addition, we also provide pointers to two MAPF benchmarks. In particular, we introduce a new grid based benchmark for MAPF, and demonstrate experimentally that it poses a challenge to contemporary MAPF algorithms.


Understanding the Behaviour of Contrastive Loss. Unsupervised contrastive learning has achieved outstanding success, while the mechanism of contrastive loss has been less studied. In this paper, we concentrate on the understanding of the behaviours of unsupervised contrastive loss. We will show that the contrastive loss is a hardness aware loss function, and the temperature tau controls the strength of penalties on hard negative samples. The previous study has shown that uniformity is a key property of contrastive learning. We build relations between the uniformity and the temperature tau . We will show that uniformity helps the contrastive learning to learn separable features, however excessive pursuit to the uniformity makes the contrastive loss not tolerant to semantically similar samples, which may break the underlying semantic structure and be harmful to the formation of features useful for downstream tasks. This is caused by the inherent defect of the instance discrimination objective. Specifically, instance discrimination objective tries to push all different instances apart, ignoring the underlying relations between samples. Pushing semantically consistent samples apart has no positive effect for acquiring a prior informative to general downstream tasks. A well designed contrastive loss should have some extents of tolerance to the closeness of semantically similar samples. Therefore, we find that the contrastive loss meets a uniformity tolerance dilemma, and a good choice of temperature can compromise these two properties properly to both learn separable features and tolerant to semantically similar samples, improving the feature qualities and the downstream performances.


Rethinking Object Detection in Retail Stores. The convention standard for object detection uses a bounding box to represent each individual object instance. However, it is not practical in the industry relevant applications in the context of warehouses due to severe occlusions among groups of instances of the same categories. In this paper, we propose a new task, ie, simultaneously object localization and counting, abbreviated as Locount, which requires algorithms to localize groups of objects of interest with the number of instances. However, there does not exist a dataset or benchmark designed for such a task. To this end, we collect a large scale object localization and counting dataset with rich annotations in retail stores, which consists of 50,394 images with more than 1.9 million object instances in 140 categories. Together with this dataset, we provide a new evaluation protocol and divide the training and testing subsets to fairly evaluate the performance of algorithms for Locount, developing a new benchmark for the Locount task. Moreover, we present a cascaded localization and counting network as a strong baseline, which gradually classifies and regresses the bounding boxes of objects with the predicted numbers of instances enclosed in the bounding boxes, trained in an end to end manner. Extensive experiments are conducted on the proposed dataset to demonstrate its significance and the analysis discussions on failure cases are provided to indicate future directions. Dataset is available at https isrc.iscas.ac.cn gitlab research locount dataset.


GN Net The Gauss Newton Loss for Multi Weather Relocalization. Direct SLAM methods have shown exceptional performance on odometry tasks. However, they are susceptible to dynamic lighting and weather changes while also suffering from a bad initialization on large baselines. To overcome this, we propose GN Net a network optimized with the novel Gauss Newton loss for training weather invariant deep features, tailored for direct image alignment. Our network can be trained with pixel correspondences between images taken from different sequences. Experiments on both simulated and real world datasets demonstrate that our approach is more robust against bad initialization, variations in day time, and weather changes thereby outperforming state of the art direct and indirect methods. Furthermore, we release an evaluation benchmark for relocalization tracking against different types of weather. Our benchmark is available at https vision.in.tum.de gn net.


How do we drive deep eutectic systems towards an industrial reality?. Deep eutectic systems (DES) have received considerable attention in the past 5 years of research. Up to 2013 little had been explored over these systems both in which concerns fundamentals and applications. The definition of a deep eutectic system is still controversial and in this manuscript we highlight the different definitions proposed in the literature and discuss what, in our opinion, should be pursued in order to have an agreement in the scientific community studying this field. From the definition of DES to its applications also interesting changes have been observed in the topics published. From electrochemistry to newer applications, such as cryopreservation, the field is evolving as new outcomes on DES properties are unraveled. We herein present and discuss new trends on DES research and present some perspectives on what we consider to be the most promising applications of DES at industrial scale.


Physics informed neural networks for inverse problems in nano optics and metamaterials. In this paper we employ the emerging paradigm of physics informed neural networks (PINNs) for the solution of representative inverse scattering problems in photonic metamaterials and nano optics technologies. In particular, we successfully apply mesh free PINNs to the difficult task of retrieving the effective permittivity parameters of a number of finite size scattering systems that involve many interacting nanostructures as well as multi component nanoparticles. Our methodology is fully validated by numerical simulations based on the Finite Element Method (FEM). The development of physics informed deep learning techniques for inverse scattering can enable the design of novel functional nanostructures and significantly broaden the design space of metamaterials by naturally accounting for radiation and finite size effects beyond the limitations of traditional effective medium theories.


Can GAN originate new electronic dance music genres? Generating novel rhythm patterns using GAN with Genre Ambiguity Loss. Since the introduction of deep learning, researchers have proposed content generation systems using deep learning and proved that they are competent to generate convincing content and artistic output, including music. However, one can argue that these deep learning based systems imitate and reproduce the patterns inherent within what humans have created, instead of generating something new and creative. This paper focuses on music generation, especially rhythm patterns of electronic dance music, and discusses if we can use deep learning to generate novel rhythms, interesting patterns not found in the training dataset. We extend the framework of Generative Adversarial Networks(GAN) and encourage it to diverge from the dataset's inherent distributions by adding additional classifiers to the framework. The paper shows that our proposed GAN can generate rhythm patterns that sound like music rhythms but do not belong to any genres in the training dataset. The source code, generated rhythm patterns, and a supplementary plugin software for a popular Digital Audio Workstation software are available on our website.


Investigating the Effect of Emoji in Opinion Classification of Uzbek Movie Review Comments. Opinion mining on social media posts has become more and more popular. Users often express their opinion on a topic not only with words but they also use image symbols such as emoticons and emoji. In this paper, we investigate the effect of emoji based features in opinion classification of Uzbek texts, and more specifically movie review comments from YouTube. Several classification algorithms are tested, and feature ranking is performed to evaluate the discriminative ability of the emoji based features.


DuetSGX Differential Privacy with Secure Hardware. Differential privacy offers a formal privacy guarantee for individuals, but many deployments of differentially private systems require a trusted third party (the data curator). We propose DuetSGX, a system that uses secure hardware (Intel's SGX) to eliminate the need for a trusted data curator. Data owners submit encrypted data that can be decrypted only within a secure enclave running the DuetSGX system, ensuring that sensitive data is never available to the data curator. Analysts submit queries written in the Duet language, which is specifically designed for verifying that programs satisfy differential privacy DuetSGX uses the Duet typechecker to verify that each query satisfies differential privacy before running it. DuetSGX therefore provides the benefits of local differential privacy and central differential privacy simultaneously noise is only added to final results, and there is no trusted third party. We have implemented a proof of concept implementation of DuetSGX and we release it as open source.


Computing Stable Demers Cartograms. Cartograms are popular for visualizing numerical data for map regions. Maintaining correct adjacencies is a primary quality criterion for cartograms. When there are multiple data values per region (over time or different datasets) shown as animated or juxtaposed cartograms, preserving the viewer's mental map in terms of stability between cartograms is another important criterion. We present a method to compute stable Demers cartograms, where each region is shown as a square and similar data yield similar cartograms. We enforce orthogonal separation constraints with linear programming, and measure quality in terms of keeping adjacent regions close (cartogram quality) and using similar positions for a region between the different data values (stability). Our method guarantees ability to connect most lost adjacencies with minimal leaders. Experiments show our method yields good quality and stability.


Decremental Optimization of Dominating Sets Under the Reconfiguration Framework. Given a dominating set, how much smaller a dominating set can we find through elementary operations? Here, we proceed by iterative vertex addition and removal while maintaining the property that the set forms a dominating set of bounded size. This can be seen as the optimization variant of the dominating set reconfiguration problem, where two dominating sets are given and the question is merely whether they can be reached one from another through elementary operations. We show that this problem is PSPACE complete, even if the input graph is a bipartite graph, a split graph, or has bounded pathwidth. On the positive side, we give linear time algorithms for cographs, trees and interval graphs. We also study the parameterized complexity of this problem. More precisely, we show that the problem is W 2 hard when parameterized by the upper bound on the size of an intermediary dominating set. On the other hand, we give fixed parameter algorithms with respect to the minimum size of a vertex cover, or d s where d is the degeneracy and s is the upper bound of output solution.


Block Switching A Stochastic Approach for Deep Learning Security. Recent study of adversarial attacks has revealed the vulnerability of modern deep learning models. That is, subtly crafted perturbations of the input can make a trained network with high accuracy produce arbitrary incorrect predictions, while maintain imperceptible to human vision system. In this paper, we introduce Block Switching (BS), a defense strategy against adversarial attacks based on stochasticity. BS replaces a block of model layers with multiple parallel channels, and the active channel is randomly assigned in the run time hence unpredictable to the adversary. We show empirically that BS leads to a more dispersed input gradient distribution and superior defense effectiveness compared with other stochastic defenses such as stochastic activation pruning (SAP). Compared to other defenses, BS is also characterized by the following features (i) BS causes less test accuracy drop (ii) BS is attack independent and (iii) BS is compatible with other defenses and can be used jointly with others.


Women Want to Learn Tech Lessons from the Czechitas Education Project. While it is understood by women that tech fluency might act as a powerful career accelerator or even a new career direction towards software engineering, this awakening often comes after graduation from a different field, when it is difficult for the women to make the shift towards tech and computing. In this paper, we report on our experience with running a successful education non profit called Czechitas, which shows that women in their 20s and 30s are (maybe surprisingly) highly interested in learning tech, they just need a helping hand and tailored assistance, encouragement and guidance.


Admissibility and generalized nonuniform dichotomies for discrete dynamics. We obtain characterizations of nonuniform dichotomies, defined by general growth rates, based on admissibility conditions. Additionally, we use the obtained characterizations to derive robustness results for the considered dichotomies. As particular cases, we recover several results in the literature concerning nonuniform exponential dichotomies and nonuniform polynomial dichotomies as well as new results for nonuniform dichotomies with logarithmic growth.


An Analytic Center Cutting Plane Method to Determine Complete Positivity of a Matrix. We propose an analytic center cutting plane method to determine if a matrix is completely positive, and return a cut that separates it from the completely positive cone if not. This was stated as an open (computational) problem by Berman, D "ur, and Shaked Monderer Electronic Journal of Linear Algebra, 2015 . Our method optimizes over the intersection of a ball and the copositive cone, where membership is determined by solving a mixed integer linear program suggested by Xia, Vera, and Zuluaga INFORMS Journal on Computing, 2018 . Thus, our algorithm can, more generally, be used to solve any copositive optimization problem, provided one knows the radius of a ball containing an optimal solution. Numerical experiments show that the number of oracle calls (matrix copositivity checks) for our implementation scales well with the matrix size, growing roughly like O(d 2) for d times d matrices. The method is implemented in Julia, and available at https github.com rileybadenbroek CopositiveAnalyticCenter.jl.


Cooperative Pollution Source Localization and Cleanup with a Bio inspired Swarm Robot Aggregation. Using robots for exploration of extreme and hazardous environments has the potential to significantly improve human safety. For example, robotic solutions can be deployed to find the source of a chemical leakage and clean the contaminated area. This paper demonstrates a proof of concept bio inspired exploration method using a swarm robotic system, which is based on a combination of two bio inspired behaviours aggregation, and pheromone tracking. The main idea of the work presented is to follow pheromone trails to find the source of a chemical leakage and then carry out a decontamination task by aggregating at the critical zone. Using experiments conducted by a simulated model of a Mona robot, we evaluate the effects of population size and robot speed on the ability of the swarm in a decontamination task. The results indicate the feasibility of deploying robotic swarms in an exploration and cleaning task in an extreme environment.


When, Where, and What? A New Dataset for Anomaly Detection in Driving Videos. Video anomaly detection (VAD) has been extensively studied. However, research on egocentric traffic videos with dynamic scenes lacks large scale benchmark datasets as well as effective evaluation metrics. This paper proposes traffic anomaly detection with a textit when where what pipeline to detect, localize, and recognize anomalous events from egocentric videos. We introduce a new dataset called Detection of Traffic Anomaly (DoTA) containing 4,677 videos with temporal, spatial, and categorical annotations. A new spatial temporal area under curve (STAUC) evaluation metric is proposed and used with DoTA. State of the art methods are benchmarked for two VAD related tasks.Experimental results show STAUC is an effective VAD metric. To our knowledge, DoTA is the largest traffic anomaly dataset to date and is the first supporting traffic anomaly studies across when where what perspectives. Our code and dataset can be found in https github.com MoonBlvd Detection of Traffic Anomaly


A Qualitative Evaluation of Language Models on Automatic Question Answering for COVID 19. COVID 19 has resulted in an ongoing pandemic and as of 12 June 2020, has caused more than 7.4 million cases and over 418,000 deaths. The highly dynamic and rapidly evolving situation with COVID 19 has made it difficult to access accurate, on demand information regarding the disease. Online communities, forums, and social media provide potential venues to search for relevant questions and answers, or post questions and seek answers from other members. However, due to the nature of such sites, there are always a limited number of relevant questions and responses to search from, and posted questions are rarely answered immediately. With the advancements in the field of natural language processing, particularly in the domain of language models, it has become possible to design chatbots that can automatically answer consumer questions. However, such models are rarely applied and evaluated in the healthcare domain, to meet the information needs with accurate and up to date healthcare data. In this paper, we propose to apply a language model for automatically answering questions related to COVID 19 and qualitatively evaluate the generated responses. We utilized the GPT 2 language model and applied transfer learning to retrain it on the COVID 19 Open Research Dataset (CORD 19) corpus. In order to improve the quality of the generated responses, we applied 4 different approaches, namely tf idf, BERT, BioBERT, and USE to filter and retain relevant sentences in the responses. In the performance evaluation step, we asked two medical experts to rate the responses. We found that BERT and BioBERT, on average, outperform both tf idf and USE in relevance based sentence filtering tasks. Additionally, based on the chatbot, we created a user friendly interactive web application to be hosted online.


Hypergraph k cut for fixed k in deterministic polynomial time. We consider the Hypergraph k cut problem. The input consists of a hypergraph G (V,E) with non negative hyperedge costs c E rightarrow R and a positive integer k . The objective is to find a least cost subset F subseteq E such that the number of connected components in G F is at least k . An alternative formulation of the objective is to find a partition of V into k non empty sets V 1,V 2, ldots,V k so as to minimize the cost of the hyperedges that cross the partition. Graph k cut, the special case of Hypergraph k cut obtained by restricting to graph inputs, has received considerable attention. Several different approaches lead to a polynomial time algorithm for Graph k cut when k is fixed, starting with the work of Goldschmidt and Hochbaum (1988). In contrast, it is only recently that a randomized polynomial time algorithm for Hypergraph k cut was developed (Chandrasekaran, Xu, Yu, 2018) via a subtle generalization of Karger's random contraction approach for graphs. In this work, we develop the first deterministic polynomial time algorithm for Hypergraph k cut for all fixed k . We describe two algorithms both of which are based on a divide and conquer approach. The first algorithm is simpler and runs in n O(k 2) time while the second one runs in n O(k) time. Our proof relies on new structural results that allow for efficient recovery of the parts of an optimum k partition by solving minimum (S,T) terminal cuts. Our techniques give new insights even for Graph k cut.


Flame dynamics during intermittency and secondary bifurcation to longitudinal thermoacoustic instability in a swirl stabilized annular combustor. In this experimental study on a laboratory scale turbulent annular combustor with sixteen swirl stabilized burners, we study the flame flame and flame acoustic interactions during different dynamical states associated with the longitudinal mode of the combustor. We simultaneously measure the acoustic pressure and CH chemiluminescence emission of the flame using a high speed camera. Upon increasing the equivalence ratio, the combustor undergoes the following sequence of transition combustion noise (CN) to low amplitude longitudinal thermoacoustic instability (TAI) through the state of intermittency (INT), and from low amplitude to high amplitude longitudinal TAI through a secondary bifurcation. We report the first evidence of secondary bifurcation from low amplitude TAI to high amplitude TAI for a turbulent thermoacoustic system which allows us to test the flame response at two different amplitude of perturbation in a natural setting. We find a significant difference in the dynamics of the flame interactions during the periodic part of intermittency and low and high amplitude TAI. Specifically, during the periodic part of intermittency, the phase difference between the local heat release rate (HRR) measured from various burners show significant phase slips in time. During low amplitude TAI, there are fewer phase slips among the HRR response of the burners, which result in a state of weak synchronization among the flames. During high amplitude TAI, we find that the flames are in perfect synchrony amongst themselves and with the pressure fluctuations. We then quantify the degree of temporal and spatial synchronization between different flames, and flames and pressure fluctuations using the Kuramoto order parameter and the phase locking value. We show that synchronization theory can be conveniently used to characterize and quantify flame acoustic interactions in an annular combustor.


Multifaceted COVID 19 Outbreak. The time when everyone is struggling in the cruel hands of COVID19, we present the holistic view on the effects of this pandemic in certain aspects of life. A lot of literature exists in COVID 19, but most of them talk about the social and psychological side of the COVID problems. COVID 19 has affected our day to day life and its effects are extensive. Most of the literature presents the adverse effect of the pandemic, but there are very few state of the art approaches that discuss its beneficial effects. We see the multiple faces of the pandemic in this paper. To the best of our knowledge, this is the first review that presents the pros and cons of the pandemic. We present a survey that surrounds over effects on education, environment, and religion. The positive side of COVID 19 raises an alarm for us to wake up and work in that direction.


Error Bounded Foreground and Background Modeling for Moving Object Detection in Satellite Videos. Detecting moving objects from ground based videos is commonly achieved by using background subtraction techniques. Low rank matrix decomposition inspires a set of state of the art approaches for this task. It is integrated with structured sparsity regularization to achieve background subtraction in the developed method of Low rank and Structured Sparse Decomposition (LSD). However, when this method is applied to satellite videos where spatial resolution is poor and targets' contrast to the background is low, its performance is limited as the data no longer fits adequately either the foreground structure or the background model. In this paper, we handle these unexplained data explicitly and address the moving target detection from space as one of the pioneer studies. We propose a technique by extending the decomposition formulation with bounded errors, named Extended Low rank and Structured Sparse Decomposition (E LSD). This formulation integrates low rank background, structured sparse foreground and their residuals in a matrix decomposition problem. We provide an effective solution by introducing an alternative treatment and adopting the direct extension of Alternating Direction Method of Multipliers (ADMM). The proposed E LSD was validated on two satellite videos, and experimental results demonstrate the improvement in background modeling with boosted moving object detection precision over state of the art methods.


A generic ensemble based deep convolutional neural network for semi supervised medical image segmentation. Deep learning based image segmentation has achieved the state of the art performance in many medical applications such as lesion quantification, organ detection, etc. However, most of the methods rely on supervised learning, which require a large set of high quality labeled data. Data annotation is generally an extremely time consuming process. To address this problem, we propose a generic semi supervised learning framework for image segmentation based on a deep convolutional neural network (DCNN). An encoder decoder based DCNN is initially trained using a few annotated training samples. This initially trained model is then copied into sub models and improved iteratively using random subsets of unlabeled data with pseudo labels generated from models trained in the previous iteration. The number of sub models is gradually decreased to one in the final iteration. We evaluate the proposed method on a public grand challenge dataset for skin lesion segmentation. Our method is able to significantly improve beyond fully supervised model learning by incorporating unlabeled data.


Purely cosmetic surgeries and pretzel knots. We show that all pretzel knots satisfy the (purely) cosmetic surgery conjecture, i.e. Dehn surgeries with different slopes along a pretzel knot provide different oriented three manifolds.


High performance cloud computing for exhaustive protein protein docking. Public cloud computing environments, such as Amazon AWS, Microsoft Azure, and the Google Cloud Platform, have achieved remarkable improvements in computational performance in recent years, and are also expected to be able to perform massively parallel computing. As the cloud enables users to use thousands of CPU cores and GPU accelerators casually, and various software types can be used very easily by cloud images, the cloud is beginning to be used in the field of bioinformatics. In this study, we ported the original protein protein interaction prediction (protein protein docking) software, MEGADOCK, into Microsoft Azure as an example of an HPC cloud environment. A cloud parallel computing environment with up to 1,600 CPU cores and 960 GPUs was constructed using four CPU instance types and two GPU instance types, and the parallel computing performance was evaluated. Our MEGADOCK on Azure system showed a strong scaling value of 0.93 for the CPU instance when H16 instance with 100 instances were used compared to 50, and a strong scaling value of 0.89 for the GPU instance when NC24 instance with 20 were used compared to 5. Moreover, the results of the usage fee and total computation time supported that using a GPU instance reduced the computation time of MEGADOCK and the cloud usage fee required for the computation. The developed environment deployed on the cloud is highly portable, making it suitable for applications in which an on demand and large scale HPC environment is desirable.


Modeling Smart Contracts Activities A Tensor Based Approach. Smart contracts are autonomous software executing predefined conditions. Two of the biggest advantages of the smart contracts are secured protocols and transaction costs reduction. On the Ethereum platform, an open source blockchain based platform, smart contracts implement a distributed virtual machine on the distributed ledger. To avoid denial of service attacks and monetize the services, payment transactions are executed whenever code is being executed between contracts. It is thus natural to investigate if predictive analysis is capable to forecast these interactions. We have addressed this issue and propose an innovative application of the tensor decomposition CANDECOMP PARAFAC to the temporal link prediction of smart contracts. We introduce a new approach leveraging stochastic processes for series predictions based on the tensor decomposition that can be used for smart contracts predictive analytics.


Rapid thermal emittance and quantum efficiency mapping of a cesium telluride cathode in an rf photoinjector using multiple laser beamlets. Thermal emittance and quantum efficiency (QE) are key figures of merit of photocathodes, and their uniformity is critical to high performance photoinjectors. Several QE mapping technologies have been successfully developed however, there is still a dearth of information on thermal emittance maps. This is because of the extremely time consuming procedure to gather measurements by scanning a small beam across the cathode with fine steps. To simplify the mapping procedure, and to reduce the time required to take measurements, we propose a new method that requires only a single scan of the solenoid current to simultaneously obtain thermal emittance and QE distribution by using a pattern beam with multiple beamlets. In this paper, its feasibility has been confirmed by both beam dynamics simulation and theoretical analysis. The method has been successfully demonstrated in a proof of principle experiment using an L band radiofrequency photoinjector with a cesium telluride cathode. In the experiment, seven beamlets were generated from a microlens array system and their corresponding thermal emittance and QE varied from 0.93 to 1.14 mu m mm and from 4.6 to 8.7 , respectively. We also discuss the limitations and future improvements of the method in this paper.


AAG Self Supervised Representation Learning by Auxiliary Augmentation with GNT Xent Loss. Self supervised representation learning is an emerging research topic for its powerful capacity in learning with unlabeled data. As a mainstream self supervised learning method, augmentation based contrastive learning has achieved great success in various computer vision tasks that lack manual annotations. Despite current progress, the existing methods are often limited by extra cost on memory or storage, and their performance still has large room for improvement. Here we present a self supervised representation learning method, namely AAG, which is featured by an auxiliary augmentation strategy and GNT Xent loss. The auxiliary augmentation is able to promote the performance of contrastive learning by increasing the diversity of images. The proposed GNT Xent loss enables a steady and fast training process and yields competitive accuracy. Experiment results demonstrate the superiority of AAG to previous state of the art methods on CIFAR10, CIFAR100, and SVHN. Especially, AAG achieves 94.5 top 1 accuracy on CIFAR10 with batch size 64, which is 0.5 higher than the best result of SimCLR with batch size 1024.


Fighting Failures with FIRE Failure Identification to Reduce Expert Burden in Intervention Based Learning. Supervised imitation learning, also known as behavioral cloning, suffers from distribution drift leading to failures during policy execution. One approach to mitigate this issue is to allow an expert to correct the agent's actions during task execution, based on the expert's determination that the agent has reached a point of no return.' The agent's policy is then retrained using this new corrective data. This approach alone can enable high performance agents to be learned, but at a substantial cost the expert must vigilantly observe execution until the policy reaches a specified level of success, and even at that point, there is no guarantee that the policy will always succeed. To address these limitations, we present FIRE (Failure Identification to Reduce Expert Burden in intervention based learning), a system that can predict when a running policy will fail, halt its execution, and request a correction from the expert. Unlike existing approaches that learn only from expert data, our approach learns from both expert and non expert data, akin to adversarial learning. We demonstrate experimentally for a series of challenging manipulation tasks that our method is able to recognize state action pairs that lead to failures. This permits seamless integration into an intervention based learning system, where we show an order of magnitude gain in sample efficiency compared with a state of the art inverse reinforcement learning method and dramatically improved performance over an equivalent amount of data learned with behavioral cloning.


Fluorescence lifetime limited trapping of Rydberg helium atoms on a chip. Metastable (1s)(2s) 3 rm S 1 helium atoms produced in a supersonic beam were excited to Rydberg Stark states (with n in the 27 30 range) in a cryogenic environment and subsequently decelerated by, and trapped above, a surface electrode decelerator. In the trapping experiments, the Rydberg atoms were brought to rest in 75 mu s and over a distance of 33 mm and kept stationary for times t mathrm trap in the 0 525 mu s range, before being re accelerated for detection by pulsed field ionization. The use of a home built valve producing short gas pulses with a duration of about 20 mu s enabled the reduction of losses arising from collisions with atoms in the trailing part of the gas pulses. Cooling the decelerator to 4.7 K further suppressed losses by transitions induced by blackbody radiation and by collisions with atoms desorbing from the decelerator surface. The main contribution (60 ) to the atom loss during deceleration is attributed to the escape out of the decelerator moving traps of atoms having energies higher than the trap saddle point, spontaneous emission and collisions with atoms in the trailing part of the gas pulses causing each only about 20 of the atom loss. At 4.7 K, the atom losses in the trapping phase of the experiments were found to be almost exclusively caused by spontaneous emission and the trap lifetimes were found to correspond to the natural lifetimes of the Rydberg Stark states. Increasing the temperature to 100 K enhanced the trap losses by transitions stimulated by blackbody radiation.


Alternative representations of the normal cone to the domain of supremum functions and subdifferential calculus. The first part of the paper provides new characterizations of the normal cone to the effective domain of the supremum of an arbitrary family of convex functions. These results are applied in the second part to give new formulas for the subdifferential of the supremum function, which use both the active and nonactive functions at the reference point. Only the data functions are involved in these characterizations, the active ones from one side, together with the nonactive functions multiplied by some appropriate parameters. In contrast with previous works in the literature, the main feature of our subdifferential characterization is that the normal cone to the effective domain of the supremum (or to finite dimensional sections of this domain) does not appear. A new type of optimality conditions for convex optimization is established at the end of the paper.


Exact separation of forbidden set cuts associated with redundant parity checks of binary linear codes. In recent years, several integer programming (IP) approaches were developed for maximum likelihood decoding and minimum distance computation for binary linear codes. Two aspects in particular have been demonstrated to improve the performance of IP solvers as well as adaptive linear programming decoders the dynamic generation of forbidden set (FS) inequalities, a family of valid cutting planes, and the utilization of so called redundant parity checks (RPCs). However, to date, it had remained unclear how to solve the exact RPC separation problem (i.e., to determine whether or not there exists any violated FS inequality w.r.t. any known or unknown parity check). In this note, we prove NP hardness of this problem. Moreover, we formulate an IP model that combines the search for most violated FS cuts with the generation of RPCs, and report on computational experiments. Empirically, for various instances of the minimum distance problem, it turns out that while utilizing the exact separation IP does not appear to provide a computational advantage, it can apparently be avoided altogether by combining heuristics to generate RPC based cuts.


Extending Answer Set Programs with Neural Networks. The integration of low level perception with high level reasoning is one of the oldest problems in Artificial Intelligence. Recently, several proposals were made to implement the reasoning process in complex neural network architectures. While these works aim at extending neural networks with the capability of reasoning, a natural question that we consider is can we extend answer set programs with neural networks to allow complex and high level reasoning on neural network outputs? As a preliminary result, we propose NeurASP a simple extension of answer set programs by embracing neural networks where neural network outputs are treated as probability distributions over atomic facts in answer set programs. We show that NeurASP can not only improve the perception accuracy of a pre trained neural network, but also help to train a neural network better by giving restrictions through logic rules. However, training with NeurASP would take much more time than pure neural network training due to the internal use of a symbolic reasoning engine. For future work, we plan to investigate the potential ways to solve the scalability issue of NeurASP. One potential way is to embed logic programs directly in neural networks. On this route, we plan to first design a SAT solver using neural networks, then extend such a solver to allow logic programs.


ResFPN Residual Skip Connections in Multi Resolution Feature Pyramid Networks for Accurate Dense Pixel Matching. Dense pixel matching is required for many computer vision algorithms such as disparity, optical flow or scene flow estimation. Feature Pyramid Networks (FPN) have proven to be a suitable feature extractor for CNN based dense matching tasks. FPN generates well localized and semantically strong features at multiple scales. However, the generic FPN is not utilizing its full potential, due to its reasonable but limited localization accuracy. Thus, we present ResFPN a multi resolution feature pyramid network with multiple residual skip connections, where at any scale, we leverage the information from higher resolution maps for stronger and better localized features. In our ablation study, we demonstrate the effectiveness of our novel architecture with clearly higher accuracy than FPN. In addition, we verify the superior accuracy of ResFPN in many different pixel matching applications on established datasets like KITTI, Sintel, and FlyingThings3D.


Combinatorial Ricci flows with applications to the hyperbolization of cusped 3 manifolds. In this paper, we adopt combinatorial Ricci curvature flow methods to study the existence of cusped hyperbolic structure on 3 manifolds with torus boundary. For general pseudo 3 manifolds, we prove the long time existence and the uniqueness for the extended Ricci flow for decorated hyperbolic polyhedral metrics. We prove that the extended Ricci flow converges to a decorated hyperbolic polyhedral metric if and only if there exists a decorated hyperbolic polyhedral metric of zero Ricci curvature. If it is the case, the flow converges exponentially fast. These results apply for cusped hyperbolic structure on 3 manifolds via ideal triangulation.


Dynamics of disease spread. Effect of the characteristic times. Dynamic properties of spreading infection through a heterogeneous population are studied numerically and analytically using a dynamic variant of Watts and Strogatz Small World Network based stochastic Susceptible Exposed Infectious Removed (SEIR) epidemic model. This model includes the main realistic parameters usually characterizing transmissible diseases, such as the force of infection, latency and infection times. As far as the latency time remains smaller than that of infection, the proportion of infected individuals increases exponentially with time, otherwise an oscillatory behavior appears. This may explain the periodic behaviors in time observed by the health prevention services. It is also shown that periodic epidemiological surveys overestimate or underestimate the dynamics of infection if the survey periods do not exactly correspond to the characteristic times of the infection. Further discussion is provided on the diffusion and relaxation processes involved in this model, and their relation to the infection characteristic time.


Ancient Solution of Mean Curvature Flow in Space Forms. In this paper we investigate the rigidity of ancient solutions of the mean curvature flow with arbitrary codimension in space forms. We first prove that under certain sharp asymptotic pointwise curvature pinching condition the ancient solution in a sphere is either a shrinking spherical cap or a totally geodesic sphere. Then we show that under certain pointwise curvature pinching condition the ancient solution in a hyperbolic space is a family of shrinking spheres. We also obtain a rigidity result for ancient solutions in a nonnegatively curved space form under an asymptotic integral curvature pinching condition.


Few distance sets in ell p spaces and ell p product spaces. Kusner asked if n 1 points is the maximum number of points in mathbb R n such that the ell p distance (1 p infty) between any two points is 1 . We present an improvement to the best known upper bound when p is large in terms of n , as well as a generalization of the bound to s distance sets. We also study equilateral sets in the ell p sums of Euclidean spaces, deriving upper bounds on the size of an equilateral set for when p infty , p is even, and for any 1 le p infty .


EKSTRAKTO A tool to reconstruct Dedukti proofs from TSTP files (extended abstract). Proof assistants often call automated theorem provers to prove subgoals. However, each prover has its own proof calculus and the proof traces that it produces often lack many details to build a complete proof. Hence these traces are hard to check and reuse in proof assistants. Dedukti is a proof checker whose proofs can be translated to various proof assistants Coq, HOL, Lean, Matita, PVS. We implemented a tool that extracts TPTP subproblems from a TSTP file and reconstructs complete proofs in Dedukti using automated provers able to generate Dedukti proofs like ZenonModulo or ArchSAT. This tool is generic it assumes nothing about the proof calculus of the prover producing the trace, and it can use different provers to produce the Dedukti proof. We applied our tool on traces produced by automated theorem provers on the CNF problems of the TPTP library and we were able to reconstruct a proof for a large proportion of them, significantly increasing the number of Dedukti proofs that could be obtained for those problems.


Search for developments of a box having multiple ways of folding by SAT solver. A polyomino is called a development if it can make a box by folding edges of unit squares forming the polyomino. It is known that there are developments that can fold into a box (or boxes) in multiple ways. In this work, we conducted a computer search for finding such developments by using a SAT solver. As a result, we found thousands of such developments including a polyomino of area 52 that can fold into a box of size 1 times 2 times 8 in five different ways.


Porous Lattice based Transformer Encoder for Chinese NER. Incorporating lattices into character level Chinese named entity recognition is an effective method to exploit explicit word information. Recent works extend recurrent and convolutional neural networks to model lattice inputs. However, due to the DAG structure or the variable sized potential word set for lattice inputs, these models prevent the convenient use of batched computation, resulting in serious inefficient. In this paper, we propose a porous lattice based transformer encoder for Chinese named entity recognition, which is capable to better exploit the GPU parallelism and batch the computation owing to the mask mechanism in transformer. We first investigate the lattice aware self attention coupled with relative position representations to explore effective word information in the lattice structure. Besides, to strengthen the local dependencies among neighboring tokens, we propose a novel porous structure during self attentional computation processing, in which every two non neighboring tokens are connected through a shared pivot node. Experimental results on four datasets show that our model performs up to 9.47 times faster than state of the art models, while is roughly on a par with its performance. The source code of this paper can be obtained from https github.com xxx xxx.


Shapley Value as Principled Metric for Structured Network Pruning. Structured pruning is a well known technique to reduce the storage size and inference cost of neural networks. The usual pruning pipeline consists of ranking the network internal filters and activations with respect to their contributions to the network performance, removing the units with the lowest contribution, and fine tuning the network to reduce the harm induced by pruning. Recent results showed that random pruning performs on par with other metrics, given enough fine tuning resources. In this work, we show that this is not true on a low data regime when fine tuning is either not possible or not effective. In this case, reducing the harm caused by pruning becomes crucial to retain the performance of the network. First, we analyze the problem of estimating the contribution of hidden units with tools suggested by cooperative game theory and propose Shapley values as a principled ranking metric for this task. We compare with several alternatives proposed in the literature and discuss how Shapley values are theoretically preferable. Finally, we compare all ranking metrics on the challenging scenario of low data pruning, where we demonstrate how Shapley values outperform other heuristics.


Stable Matchings with Diversity Constraints Affirmative Action is beyond NP. We investigate the following many to one stable matching problem with diversity constraints (SMTI Diverse) Given a set of students and a set of colleges which have preferences over each other, where the students have overlapping types, and the colleges each have a total capacity as well as quotas for individual types (the diversity constraints), is there a matching satisfying all diversity constraints such that no unmatched student college pair has an incentive to deviate? SMTI Diverse is known to be NP hard. However, as opposed to the NP membership claims in the literature Aziz et al., AAMAS 2019 Huang, SODA 2010 , we prove that it is beyond NP it is complete for the complexity class Sigma text P 2 . In addition, we provide a comprehensive analysis of the problem's complexity from the viewpoint of natural restrictions to inputs and obtain new algorithms for the problem.


Predicting Job Hopping Motive of Candidates Using Answers to Open ended Interview Questions. A significant proportion of voluntary employee turnover includes people who frequently move from job to job, known as job hopping. Our work shows that language used in responding to interview questions on past behaviour and situational judgement is predictive of job hopping motive as measured by the Job Hopping Motives (JHM) Scale. The study is based on responses from over 45,000 job applicants who completed an online chat interview and self rated themselves on JHM Scale. Five different methods of text representation were evaluated, namely four open vocabulary approaches (TF IDF, LDA, Glove word embeddings and Doc2Vec document embeddings) and one closed vocabulary approach (LIWC). The Glove embeddings provided the best results with a correlation of r 0.35 between sequences of words used and the JHM Scale. Further analysis also showed a correlation of r 0.25 between language based job hopping motive and the personality trait Openness to experience and a correlation of r 0.09 with the trait Agreeableness.


Physics of Beer Tapping Lower vs. Upper Bottle. "Beer tapping" is a well known prank where a bottle of carbonised liquid strikes another bottle of carbonised liquid from above, with the usual result that the lower bottle foams over whereas the upper one does not. Though the physics leading to the foaming process in the lower bottle has been investigated and well documented, no explanation to date has been provided why the upper bottle produces little to no foam. In this article we describe the reasons for the entirely different behaviours of the two bottles.


A Secure Federated Learning Framework for 5G Networks. Federated Learning (FL) has been recently proposed as an emerging paradigm to build machine learning models using distributed training datasets that are locally stored and maintained on different devices in 5G networks while providing privacy preservation for participants. In FL, the central aggregator accumulates local updates uploaded by participants to update a global model. However, there are two critical security threats poisoning and membership inference attacks. These attacks may be carried out by malicious or unreliable participants, resulting in the construction failure of global models or privacy leakage of FL models. Therefore, it is crucial for FL to develop security means of defense. In this article, we propose a blockchain based secure FL framework to create smart contracts and prevent malicious or unreliable participants from involving in FL. In doing so, the central aggregator recognizes malicious and unreliable participants by automatically executing smart contracts to defend against poisoning attacks. Further, we use local differential privacy techniques to prevent membership inference attacks. Numerical results suggest that the proposed framework can effectively deter poisoning and membership inference attacks, thereby improving the security of FL in 5G networks.


Conservation laws for even order elliptic systems in the critical dimension a new approach. We consider elliptic systems of order 2m in dimension 2m which are generalizations of extrinsic and intrinsic polyharmonic maps. We show the existence of a conservation law for these systems by using a small perturbation of Uhlenbeck's gauge fixing matrix.


Computing the Yield Limit in Three dimensional Flows of a Yield Stress Fluid About a Settling Particle. Calculating the yield limit Y c (the critical ratio of the yield stress to the driving stress), of a viscoplastic fluid flow is a challenging problem, often needing iteration in the rheological parameters to approach this limit, as well as accurate computations that account properly for the yield stress and potentially adaptive meshing. For particle settling flows, in recent years calculating Y c has been accomplished analytically for many antiplane shear flow configurations and also computationally for many geometries, under either two dimensional (2D) or axisymmetric flow restrictions. Here we approach the problem of 3D particle settling and how to compute the yield limit directly, i.e. without iteratively changing the rheology to approach the yield limit. The presented approach develops tools from optimization theory, taking advantage of the fact that Y c is defined via a minimization problem. We recast this minimization in terms of primal and dual variational problems, develop the necessary theory and finally implement a basic but workable algorithm. We benchmark results against accurate axisymmetric flow computations for cylinders and ellipsoids, computed using adaptive meshing. We also make comparisons of accuracy in calculating Y c on comparable fixed meshes. This demonstrates the feasibility and benefits of directly computing Y c in multiple dimensions. Lastly, we present some sample computations for complex 3D particle shapes.


Relations and radicals in abstract lattices and in lattices of subspaces of Banach spaces and ideals of Banach algebras. Amitsur's theory revisited. We refine Amitsur's theory of radicals in complete lattices and apply the obtained results to the theory of radicals in the lattices of subspaces of Banach spaces and in the lattices of ideals of Banach and C algebras and of Banach Lie algebras.


Unnatural Language Processing Bridging the Gap Between Synthetic and Natural Language Data. Large, human annotated datasets are central to the development of natural language processing models. Collecting these datasets can be the most challenging part of the development process. We address this problem by introducing a general purpose technique for simulation to real'' transfer in language understanding problems with a delimited set of target behaviors, making it possible to develop models that can interpret natural utterances without natural training data. We begin with a synthetic data generation procedure, and train a model that can accurately interpret utterances produced by the data generator. To generalize to natural utterances, we automatically find projections of natural language utterances onto the support of the synthetic language, using learned sentence embeddings to define a distance metric. With only synthetic training data, our approach matches or outperforms state of the art models trained on natural language data in several domains. These results suggest that simulation to real transfer is a practical framework for developing NLP applications, and that improved models for transfer might provide wide ranging improvements in downstream tasks.


Weak solutions of McKean Vlasov SDEs with supercritical drifts. Consider the following McKean Vlasov SDE d X t sqrt 2 d W t int mathbb R d K(t,X t y) mu X t (dy)d t, X 0 x, where mu X t stands for the distribution of X t and K(t,x) mathbb R times mathbb R d to mathbb R d is a time dependent divergence free vector field. Under the assumption K in L q t( widetilde L x p) with frac dp frac2q 2 , where widetilde L p x stands for the localized L p space, we show the existence of weak solutions to the above SDE. As an application, we provide a new proof for the existence of weak solutions to 2D Navier Stokes equations with measure as initial vorticity.


Primal and dual algorithms for the minimum covering Euclidean ball of a set of Euclidean balls in mathbb R n . Primal and dual algorithms are developed for solving the n dimensional convex optimization problem of finding the Euclidean ball of minimum radius that covers m given Euclidean balls, each with a given center and radius. Each algorithm is based on a directional search method in which a search path may be a ray or a two dimensional conic section in mathbb R n . At each iteration, a search path is constructed by the intersection of bisectors of pairs of points, where the bisectors are either hyperplanes or n dimensional hyperboloids. The optimal step size along each search path is determined explicitly.


Robust Semantic Parsing with Adversarial Learning for Domain Generalization. This paper addresses the issue of generalization for Semantic Parsing in an adversarial framework. Building models that are more robust to inter document variability is crucial for the integration of Semantic Parsing technologies in real applications. The underlying question throughout this study is whether adversarial learning can be used to train models on a higher level of abstraction in order to increase their robustness to lexical and stylistic variations.We propose to perform Semantic Parsing with a domain classification adversarial task without explicit knowledge of the domain. The strategy is first evaluated on a French corpus of encyclopedic documents, annotated with FrameNet, in an information retrieval perspective, then on PropBank Semantic Role Labeling task on the CoNLL 2005 benchmark. We show that adversarial learning increases all models generalization capabilities both on in and out of domain data.


Unsupervised Paraphrasing via Deep Reinforcement Learning. Paraphrasing is expressing the meaning of an input sentence in different wording while maintaining fluency (i.e., grammatical and syntactical correctness). Most existing work on paraphrasing use supervised models that are limited to specific domains (e.g., image captions). Such models can neither be straightforwardly transferred to other domains nor generalize well, and creating labeled training data for new domains is expensive and laborious. The need for paraphrasing across different domains and the scarcity of labeled training data in many such domains call for exploring unsupervised paraphrase generation methods. We propose Progressive Unsupervised Paraphrasing (PUP) a novel unsupervised paraphrase generation method based on deep reinforcement learning (DRL). PUP uses a variational autoencoder (trained using a non parallel corpus) to generate a seed paraphrase that warm starts the DRL model. Then, PUP progressively tunes the seed paraphrase guided by our novel reward function which combines semantic adequacy, language fluency, and expression diversity measures to quantify the quality of the generated paraphrases in each iteration without needing parallel sentences. Our extensive experimental evaluation shows that PUP outperforms unsupervised state of the art paraphrasing techniques in terms of both automatic metrics and user studies on four real datasets. We also show that PUP outperforms domain adapted supervised algorithms on several datasets. Our evaluation also shows that PUP achieves a great trade off between semantic similarity and diversity of expression.


Partitioned Private User Storages in End to End Encrypted Online Social Networks. In secure Online Social Networks (OSN), often end to end encryption approaches are used. This ensures the privacy of communication between the participants. To manage, store, or transfer the cryptographic keys from one device to another one, encrypted private storages can be used. To gain access to such storages, login credentials, only known to the user, are needed. Losing these credentials results in a permanent loss of cryptographic keys and messages because the storage is encrypted. We present a scheme to split encrypted user storages into multiple storages. Each one can be reconstructed with the help of other participants of the OSN. The more of the storages can be reconstructed, the higher the chance of successfully reconstructing the complete private storage is. Therefore, regaining possession of the cryptographic keys used for communication is increased. We achieve high rates of successful reconstructions, even if a large fraction of the distributed shares are not accessible anymore because the shareholders are inactive or malicious.


Unsupervised Video Decomposition using Spatio temporal Iterative Inference. Unsupervised multi object scene decomposition is a fast emerging problem in representation learning. Despite significant progress in static scenes, such models are unable to leverage important dynamic cues present in video. We propose a novel spatio temporal iterative inference framework that is powerful enough to jointly model complex multi object representations and explicit temporal dependencies between latent variables across frames. This is achieved by leveraging 2D LSTM, temporally conditioned inference and generation within the iterative amortized inference for posterior refinement. Our method improves the overall quality of decompositions, encodes information about the objects' dynamics, and can be used to predict trajectories of each object separately. Additionally, we show that our model has a high accuracy even without color information. We demonstrate the decomposition, segmentation, and prediction capabilities of our model and show that it outperforms the state of the art on several benchmark datasets, one of which was curated for this work and will be made publicly available.


Fubini Type Theorems for the strong McShane and strong Henstock Kurzweil integrals. In this paper, we will prove Fubini type theorems for the strong McShane and strong Henstock Kurzweil integrals of Banach spaces valued functions defined on a closed non degenerate interval a,b a 1 , b 1 times a 2 , b 2 subset mathbb R 2 .


Avoiding Monochromatic Rectangles Using Shift Patterns. Ramsey Theory deals with avoiding certain patterns. When constructing an instance that avoids one pattern, it is observed that other patterns emerge. For example, repetition emerges when avoiding arithmetic progression (Van der Waerden numbers), while reflection emerges when avoiding monochromatic solutions of a b c (Schur numbers). We exploit observed patterns when coloring a grid while avoiding monochromatic rectangles. Like many problems in Ramsey Theory, this problem has a rapidly growing search space that makes computer search difficult. Steinbach et al. obtained a solution of an 18 by 18 grid with 4 colors by enforcing a rotation symmetry. However, that symmetry is not suitable for 5 colors. In this article, we will encode this problem into propositional logic and enforce so called internal symmetries, which preserves satisfiability, to guide SAT solving. We first observe patterns with 2 and 3 colors, among which the "shift pattern" can be easily generalized and efficiently encoded. Using this pattern, we obtain a new solution of the 18 by 18 grid that is non isomorphic to the known solution. We further analyze the pattern and obtain necessary conditions to further trim down the search space. We conclude with our attempts on finding a 5 coloring of a 26 by 26 grid, as well as further open problems on the shift pattern.


IoT Based Traffic Management System for Ambulances. Lack of efficient traffic control can lead to the loss of thousands of lives due to ambulance not being able to reach the hospital in time. Also, with the current annual growth of Vehicles being around 11 while the annual road extension remaining around 4 in developing countries such as India, the problem is further worsening. So, to deal with this problem the paper presents a novel, easy toimplement alternative for traffic management during emergency situations requiring only three main devices Arduino UNO, GPS neo 6M and SIM 900A.


AI Matrix A Deep Learning Benchmark for Alibaba Data Centers. Alibaba has China's largest e commerce platform. To support its diverse businesses, Alibaba has its own large scale data centers providing the computing foundation for a wide variety of software applications. Among these applications, deep learning (DL) has been playing an important role in delivering services like image recognition, objection detection, text recognition, recommendation, and language processing. To build more efficient data centers that deliver higher performance for these DL applications, it is important to understand their computational needs and use that information to guide the design of future computing infrastructure. An effective way to achieve this is through benchmarks that can fully represent Alibaba's DL applications.


Revisiting the Gr "uss Inequality. In this article, we explore the celebrated Gr " u ss inequality, where we present a new approach using the Gr " u ss inequality to obtain new refinements of operator means inequalities. We also present several operator Gr " u ss type inequalities with applications to the numerical radius and entropies.


Assessment of gait normality using a depth camera and mirrors. This paper presents an initial work on assessment of gait normality in which the human body motion is represented by a sequence of enhanced depth maps. The input data is provided by a system consisting of a Time of Flight (ToF) depth camera and two mirrors. This approach proposes two feature types to describe characteristics of localized points of interest and the level of posture symmetry. These two features are processed on a sequence of enhanced depth maps with the support of a sliding window to provide two corresponding scores. The gait assessment is finally performed based on a weighted combination of these two scores. The evaluation is performed by experimenting on 6 simulated abnormal gaits.


Commuting graph of A orbits. Let A be a finite group acting by automorphisms on the finite group G . We introduce the commuting graph Gamma (G,A) of this action and study some questions related to the structure of G under certain graph theoretical conditions on Gamma (G,A) .


Rationality of Fano threefolds with terminal Gorenstein singularities, I. We classify some special classes of non rational Fano threefolds with terminal singularities. In particular, all such hyperelliptic and trigonal varieties are found.


Finite quotients of powers of an elliptic curve. Let E be an elliptic curve. When the symmetric group Sigma g 1 of order (g 1)! acts on E g 1 in the natural way, the subgroup E 0 g 1 , consisting of those (g 1) tuples whose coordinates sum to zero, is stable under the action of Sigma g 1 . It is isomorphic to E g . This paper concerns the structure of the quotient variety E g Sigma when Sigma is a subgroup of Sigma g 1 generated by simple transpositions. In an earlier paper we observed that E g Sigma is a bundle over a suitable power, E N , with fibers that are products of projective spaces. This paper shows that E g Sigma has an 'etale cover by a product of copies of E and projective spaces with an abelian Galois group.


Negative Confidence Aware Weakly Supervised Binary Classification for Effective Review Helpfulness Classification. The incompleteness of positive labels and the presence of many unlabelled instances are common problems in binary classification applications such as in review helpfulness classification. Various studies from the classification literature consider all unlabelled instances as negative examples. However, a classification model that learns to classify binary instances with incomplete positive labels while assuming all unlabelled data to be negative examples will often generate a biased classifier. In this work, we propose a novel Negative Confidence aware Weakly Supervised approach (NCWS), which customises a binary classification loss function by discriminating the unlabelled examples with different negative confidences during the classifier's training. We use the review helpfulness classification as a test case for examining the effectiveness of our NCWS approach. We thoroughly evaluate NCWS by using three different datasets, namely one from Yelp (venue reviews), and two from Amazon (Kindle and Electronics reviews). Our results show that NCWS outperforms strong baselines from the literature including an existing SVM based approach (i.e. SVM P), the positive and unlabelled learning based approach (i.e. C PU) and the positive confidence based approach (i.e. P conf) in addressing the classifier's bias problem. Moreover, we further examine the effectiveness of NCWS by using its classified helpful reviews in a state of the art review based venue recommendation model (i.e. DeepCoNN) and demonstrate the benefits of using NCWS in enhancing venue recommendation effectiveness in comparison to the baselines.


Understanding Application Level Caching in Web Applications A Comprehensive Introduction and Survey of State of the Art. A new form of caching, namely application level caching, has been recently employed in web applications to improve their performance and increase scalability. It consists of the insertion of caching logic into the application base code to temporarily store processed content in memory, and then decrease the response time of web requests by reusing this content. However, caching at this level demands knowledge of the domain and application specificities to achieve caching benefits, given that this information supports decisions such as what and when to cache content. Developers thus must manually manage the cache, possibly with the help of existing libraries and frameworks. Given the increasing popularity of application level caching, we thus provide a survey of approaches proposed in this context. We provide a comprehensive introduction to web caching and application level caching, and present state of the art work on designing, implementing and managing application level caching. Our focus is not only on static solutions but also approaches that adaptively adjust caching solutions to avoid the gradual performance decay that caching can suffer over time. This survey can be used as a start point for researchers and developers, who aim to improve application level caching or need guidance in designing application level caching solutions, possibly with humans out of the loop.


Spectral heat content for alpha stable processes in C1,1 open sets. In this paper we study the asymptotic behavior, as t downarrow 0 , of the spectral heat content Q ( alpha) D (t) for isotropic alpha stable processes, alpha in 1,2) , in bounded C 1,1 open sets D subset R d , d geq 2 . Together with the results from cite Val2017 for d 1 and cite GPS19 for alpha in (0,1) , the main theorem of this paper establishes the asymptotic behavior of the spectral heat content up to the second term for all alpha in (0,2) and d geq1 , and resolves the conjecture raised in cite Val2017 .


Real Time Visual Navigation in Huge Image Sets Using Similarity Graphs. Nowadays stock photo agencies often have millions of images. Non stop viewing of 20 million images at a speed of 10 images per second would take more than three weeks. This demonstrates the impossibility to inspect all images and the difficulty to get an overview of the entire collection. Although there has been a lot of effort to improve visual image search, there is little research and support for visual image exploration. Typically, users start "exploring" an image collection with a keyword search or an example image for a similarity search. Both searches lead to long unstructured lists of result images. In earlier publications, we introduced the idea of graph based image navigation and proposed an efficient algorithm for building hierarchical image similarity graphs for dynamically changing image collections. In this demo we showcase real time visual exploration of millions of images with a standard web browser. Subsets of images are successively retrieved from the graph and displayed as a visually sorted 2D image map, which can be zoomed and dragged to explore related concepts. Maintaining the positions of previously shown images creates the impression of an "endless map". This approach allows an easy visual image based navigation, while preserving the complex image relationships of the graph.


A note on the Fujita exponent in Fractional heat equation involving the Hardy potential. In this work, we are interested on the study of the Fujita exponent and the meaning of the blow up for the Fractional Cauchy problem with the Hardy potential, namely, begin equation u t ( Delta) s u lambda dfrac u x 2s u p inn ren, u(x,0) u 0 (x) inn ren, end equation where N 2s , 0 s 1 , ( Delta) s is the fractional laplacian of order 2s , l 0 , u 0 ge 0 , and 1 p p (s, lambda) , where p ( lambda, s) is the critical existence power found in cite BMP and cite AMPP .


Nonreciprocal Elasticity. Nonreciprocity has been introduced to various fields to realize asymmetric, nonlinear, and or time non revisal physical systems. By virtue of the Maxwell Betti reciprocal theorem, breaking the time reversal symmetry of dynamic mechanical systems is only possible using nonlinear materials. Nonetheless, nonlinear materials should be accompanied by geometrical asymmetries to achieve nonreciprocity in static systems. Here, we further investigate this and demonstrate a novel nonreciprocal elasticity concept. We show that the nonreciprocity of static mechanical systems can be achieved only and only if the material exhibits nonreciprocal elasticity. We experimentally demonstrate linear and nonlinear materials with nonreciprocal elasticities. By means of topological mechanics, we demonstrate that the mechanical nonreciprocity requires nonreciprocal elasticity no matter what the material is linear or nonlinear elastic. We show that linear materials with nonreciprocal elasticity can realize nonreciprocal topological systems. The nonreciprocal elasticity developed here will open new venues of the design of mechanical systems with effective nonreciprocity.


Loghub A Large Collection of System Log Datasets towards Automated Log Analytics. Logs have been widely adopted in software system development and maintenance because of the rich system runtime information they contain. In recent years, the increase of software size and complexity leads to the rapid growth of the volume of logs. To handle these large volumes of logs efficiently and effectively, a line of research focuses on intelligent log analytics powered by AI (artificial intelligence) techniques. However, only a small fraction of these techniques have reached successful deployment in industry because of the lack of public log datasets and necessary benchmarking upon them. To fill this significant gap between academia and industry and also facilitate more research on AI powered log analytics, we have collected and organized loghub, a large collection of log datasets. In particular, loghub provides 17 real world log datasets collected from a wide range of systems, including distributed systems, supercomputers, operating systems, mobile systems, server applications, and standalone software. In this paper, we summarize the statistics of these datasets, introduce some practical log usage scenarios, and present a case study on anomaly detection to demonstrate how loghub facilitates the research and practice in this field. Up to the time of this paper writing, loghub datasets have been downloaded over 15,000 times by more than 380 organizations from both industry and academia.


Heuristic algorithms in Evolutionary Computations and modular organization of biological macromolecules applications to directed evolution. A while ago, the ideas of evolutionary biology inspired computer scientists to develop a thriving nowadays field of evolutionary computation (EC), in general, and genetic algorithms (GA), in particular. At the same time, the directed evolution of biological molecules (in vitro evolution) is reasonably interpreted as an implementation of GA in biochemical experiments. One of the theoretical foundations of GA, justifying the effectiveness of evolutionary search, is the concept of building blocks (BB). In EC, it is reasonable to match these BBs to domains and motifs of macromolecules in evolutionary and synthetic biology. Computer scientists have shown and carefully studied the importance of preserving already found BBs for the effectiveness of evolutionary search. For this purpose, dozens of algorithms have been developed, including heuristic crossover algorithms. On the other hand, the experimental procedures defining and preserving domains remain a poorly developed area in the techniques of evolution in vitro. In this paper, we demonstrate how several simple algorithms preserving the BBs can increase the efficiency of in vitro evolution in numerical experiments by almost an order of magnitude. As test problems, we propose and use such well known problems of synthetic biology as the evolutionary search for strong bacterial promoters (with several motifs) and search for multi domain RNA devices, as compared to the classic GA tests (Royal Road functions). The success of these primary tests with simple algorithms gives us every reason to expect that the implementation and application of more advanced and modern EC procedures will give an even greater increase in efficiency. Such an increase in search efficiency will significantly reduce the cost of in vitro evolution experiments, which will fully cover the costs of developing new experimental procedures based on these algorithms.


A Digital Ecosystem for Animal Movement Science Making animal movement datasets, data linkage techniques, methods, and environmental layers easier to find, interpret, and analyze. Movement is a fundamental aspect of animal life and plays a crucial role in determining the structure of population dynamics, communities, ecosystems, and diversity. In recent years, the recording of animal movements via GPS collars, camera traps, acoustic sensors, and citizen science, along with the abundance of environmental and other ancillary data used by researchers to contextualize those movements, has reached a level of volume, velocity, and variety that puts movement ecology research in the realm of big data science. That data growth has spawned increasingly complex methods for movement analysis. Consequently, animal ecologists need a greater understanding of technical skills such as statistics, geographic information systems (GIS), remote sensing, and coding. Therefore, collaboration has become increasingly crucial, as research requires both domain knowledge and technical expertise. Datasets of animal movement and environmental data are typically available in repositories run by government agencies, universities, and non governmental organizations (NGOs) with methods described in scientific journals. However, there is little connectivity between these entities. The construction of a digital ecosystem for animal movement science is critically important right now. The digital ecosystem represents a setting where movement data, environmental layers, and analysis methods are discoverable and available for efficient storage, manipulation, and analysis. We argue that such a system which will help mature the field of movement ecology by engendering collaboration, facilitating replication, expanding the spatiotemporal range of potential analyses, and limiting redundancy in method development. We describe the key components of the digital ecosystem, the critical challenges that would need addressing, as well as potential solutions to those challenges.


Learning to Compose and Reason with Language Tree Structures for Visual Grounding. Grounding natural language in images, such as localizing "the black dog on the left of the tree", is one of the core problems in artificial intelligence, as it needs to comprehend the fine grained and compositional language space. However, existing solutions rely on the association between the holistic language features and visual features, while neglect the nature of compositional reasoning implied in the language. In this paper, we propose a natural language grounding model that can automatically compose a binary tree structure for parsing the language and then perform visual reasoning along the tree in a bottom up fashion. We call our model RVG TREE Recursive Grounding Tree, which is inspired by the intuition that any language expression can be recursively decomposed into two constituent parts, and the grounding confidence score can be recursively accumulated by calculating their grounding scores returned by sub trees. RVG TREE can be trained end to end by using the Straight Through Gumbel Softmax estimator that allows the gradients from the continuous score functions passing through the discrete tree construction. Experiments on several benchmarks show that our model achieves the state of the art performance with more explainable reasoning.


Building the National Radio Recordings Database A Big Data Approach to Documenting Audio Heritage. This paper traces strategies used by the Radio Preservation Task Force of the Library of Congress's National Recording Preservation Board to develop a publicly searchable database documenting extant radio materials held by collecting institutions throughout the country. Having aggregated metadata on 2,500 unique collections to date, the project has encountered a series of logistical challenges that are not only technical in nature but also institutional and social, raising critical issues involving organizational structure, political representation, and the ethics of data access. As the project continues to expand and evolve, lessons from its early development offer valuable reminders of the human judgment, hidden labor, and interpersonal relations required for successful big data work.


Automatic Microprocessor Performance Bug Detection. Processor design validation and debug is a difficult and complex task, which consumes the lion's share of the design process. Design bugs that affect processor performance rather than its functionality are especially difficult to catch, particularly in new microarchitectures. This is because, unlike functional bugs, the correct processor performance of new microarchitectures on complex, long running benchmarks is typically not deterministically known. Thus, when performance benchmarking new microarchitectures, performance teams may assume that the design is correct when the performance of the new microarchitecture exceeds that of the previous generation, despite significant performance regressions existing in the design. In this work, we present a two stage, machine learning based methodology that is able to detect the existence of performance bugs in microprocessors. Our results show that our best technique detects 91.5 of microprocessor core performance bugs whose average IPC impact across the studied applications is greater than 1 versus a bug free design with zero false positives. When evaluated on memory system bugs, our technique achieves 100 detection with zero false positives. Moreover, the detection is automatic, requiring very little performance engineer time.


Strict singularity of weighted composition operators on derivative Hardy spaces. We prove that the weighted composition operator W phi, varphi fixes an isomorphic copy of ell p if the operator W phi, varphi is not compact on the derivative Hardy space S p . In particular, this implies that the strict singularity of the operator W phi, varphi coincides with the compactness of it on S p . Moreover, when p neq2 , we characterize the conditions for those weighted composition operators W phi, varphi on S p which fix an isomorphic copy of ell 2 .


Groups definable in o minimal structures various properties and a diagram. We present a diagram surveying equivalence or strict implication for properties of different nature (algebraic, model theoretic, topological, etc.) about groups definable in o minimal structures. All results are well known and an extensive bibliography is provided.


Paraphrase Generation as Zero Shot Multilingual Translation Disentangling Semantic Similarity from Lexical and Syntactic Diversity. Recent work has shown that a multilingual neural machine translation (NMT) model can be used to judge how well a sentence paraphrases another sentence in the same language (Thompson and Post, 2020) however, attempting to generate paraphrases from such a model using standard beam search produces trivial copies or near copies. We introduce a simple paraphrase generation algorithm which discourages the production of n grams that are present in the input. Our approach enables paraphrase generation in many languages from a single multilingual NMT model. Furthermore, the amount of lexical diversity between the input and output can be controlled at generation time. We conduct a human evaluation to compare our method to a paraphraser trained on the large English synthetic paraphrase database ParaBank 2 (Hu et al., 2019c) and find that our method produces paraphrases that better preserve meaning and are more gramatical, for the same level of lexical diversity. Additional smaller human assessments demonstrate our approach also works in two non English languages.


Homotopic curve shortening and the affine curve shortening flow. We define and study a discrete process that generalizes the convex layer decomposition of a planar point set. Our process, which we call "homotopic curve shortening" (HCS), starts with a closed curve (which might self intersect) in the presence of a set P subset mathbb R 2 of point obstacles, and evolves in discrete steps, where each step consists of (1) taking shortcuts around the obstacles, and (2) reducing the curve to its shortest homotopic equivalent. We find experimentally that, if the initial curve is held fixed and P is chosen to be either a very fine regular grid or a uniformly random point set, then HCS behaves at the limit like the affine curve shortening flow (ACSF). This connection between ACSF and HCS generalizes the link between ACSF and convex layer decomposition (Eppstein et al., 2017 Calder and Smart, 2020), which is restricted to convex curves. We prove that HCS satisfies some properties analogous to those of ACSF HCS is invariant under affine transformations, preserves convexity, and does not increase the total absolute curvature. Furthermore, the number of self intersections of a curve, or intersections between two curves (appropriately defined), does not increase. Finally, if the initial curve is simple, then the number of inflection points (appropriately defined) does not increase.


Pay Attention when Required. Transformer based models consist of interleaved feed forward blocks that capture content meaning, and relatively more expensive self attention blocks that capture context meaning. In this paper, we explored trade offs and ordering of the blocks to improve upon the current Transformer architecture and proposed PAR Transformer. It needs 35 lower compute time than Transformer XL achieved by replacing 63 of the self attention blocks with feed forward blocks, and retains the perplexity on WikiText 103 language modelling benchmark. We further validated our results on text8 and enwiki8 datasets, as well as on the BERT model.


Environmentally induced exceptional points in elastodynamics. We study the nature of an environment induced exceptional point in a non Hermitian pair of coupled mechanical oscillators. The mechanical oscillators are a pair of pillars carved out of a single isotropic elastodynamic medium made of aluminum and consist of carefully controlled differential losses. The inter oscillator coupling originates exclusively from background modes associated with the "environment", that portion of the structure which, if perfectly rigid, would support the oscillators without coupling. We describe the effective interaction in terms of a coupled mode framework where only one nearby environmental mode can qualitatively reproduce changes to the exceptional point characteristics. Our experimental and numerical demonstrations illustrates new directions utilizing environmental mode control for the implementation of exceptional point degeneracies. Potential applications include a new type of non invasive, dfferential atomic force microscopy and hypersensitive sensors for the structural integrity of surfaces.


Factorization of the translation kernel for fast rigid image alignment. An important component of many image alignment methods is the calculation of inner products (correlations) between an image of n times n pixels and another image translated by some shift and rotated by some angle. For robust alignment of an image pair, the number of considered shifts and angles is typically high, thus the inner product calculation becomes a bottleneck. Existing methods, based on fast Fourier transforms (FFTs), compute all such inner products with computational complexity mathcal O (n 3 log n) per image pair, which is reduced to mathcal O (N n 2) if only N distinct shifts are needed. We propose to use a factorization of the translation kernel (FTK), an optimal interpolation method which represents images in a Fourier Bessel basis and uses a rank H approximation of the translation kernel via an operator singular value decomposition (SVD). Its complexity is mathcal O (Hn(n N)) per image pair. We prove that H mathcal O ((W log(1 epsilon)) 2) , where 2W is the magnitude of the maximum desired shift in pixels and epsilon is the desired accuracy. For fixed W this leads to an acceleration when N is large, such as when sub pixel shift grids are considered. Finally, we present numerical results in an electron cryomicroscopy application showing speedup factors of 3 10 with respect to the state of the art.


The power of pictures using ML assisted image generation to engage the crowd in complex socioscientific problems. Human computer image generation using Generative Adversarial Networks (GANs) is becoming a well established methodology for casual entertainment and open artistic exploration. Here, we take the interaction a step further by weaving in carefully structured design elements to transform the activity of ML assisted imaged generation into a catalyst for large scale popular dialogue on complex socioscientific problems such as the United Nations Sustainable Development Goals (SDGs) and as a gateway for public participation in research.


Nimble Efficiently Compiling Dynamic Neural Networks for Model Inference. Modern deep neural networks increasingly make use of features such as dynamic control flow, data structures and dynamic tensor shapes. Existing deep learning systems focus on optimizing and executing static neural networks which assume a pre determined model architecture and input data shapes assumptions which are violated by dynamic neural networks. Therefore, executing dynamic models with deep learning systems is currently both inflexible and sub optimal, if not impossible. Optimizing dynamic neural networks is more challenging than static neural networks optimizations must consider all possible execution paths and tensor shapes. This paper proposes Nimble, a high performance and flexible system to optimize, compile, and execute dynamic neural networks on multiple platforms. Nimble handles model dynamism by introducing a dynamic type system, a set of dynamism oriented optimizations, and a light weight virtual machine runtime. Our evaluation demonstrates that Nimble outperforms state of the art deep learning frameworks and runtime systems for dynamic neural networks by up to 20x on hardware platforms including Intel CPUs, ARM CPUs, and Nvidia GPUs.


Convergence in Wasserstein Distance for Empirical Measures of Dirichlet Diffusion Processes on Manifolds. Let M be a d dimensional connected compact Riemannian manifold with boundary partial M , let V in C 2(M) such that mu( rm d x) rm e V(x) rm d x is a probability measure, and let X t be the diffusion process generated by L Delta nabla V with tau inf t ge 0 X t in partial M . Consider the empirical measure mu t frac 1 t int 0 t delta X s rm d s under the condition t tau for the diffusion process. If d le 3 , then for any initial distribution not fully supported on partial M , begin align c sum m 1 infty frac 2 ( lambda m lambda 0) 2 le liminf t to infty inf T ge t Big t mathbb E big mathbb W 2( mu t, mu 0) 2 big T tau big Big le limsup t to infty sup T ge t Big t mathbb E big mathbb W 2( mu t, mu 0) 2 big T tau big Big le sum m 1 infty frac 2 ( lambda m lambda 0) 2 end align holds for some constant c in (0,1 with c 1 when partial M is convex, where mu 0 phi 0 2 mu for the first Dirichet eigenfunction phi 0 of L , lambda m m ge 0 are the Dirichlet eigenvalues of L listed in the increasing order counting multiplicities, and the upper bound is finite if and only if d le 3 . When d 4 , sup T ge t mathbb E big mathbb W 2( mu t, mu 0) 2 big T tau big decays in the order t 1 log t , while for d ge 5 it behaves like t frac 2 d 2 , as t to infty .