A Graph Reasoning Network for Multi turn Response Selection via Customized Pre training. We investigate response selection for multi turn conversation in retrieval based chatbots. Existing studies pay more attention to the matching between utterances and responses by calculating the matching score based on learned features, leading to insufficient model reasoning ability. In this paper, we propose a graph reasoning network (GRN) to address the problem. GRN first conducts pre training based on ALBERT using next utterance prediction and utterance order prediction tasks specifically devised for response selection. These two customized pre training tasks can endow our model with the ability of capturing semantical and chronological dependency between utterances. We then fine tune the model on an integrated network with sequence reasoning and graph reasoning structures. The sequence reasoning module conducts inference based on the highly summarized context vector of utterance response pairs from the global perspective. The graph reasoning module conducts the reasoning on the utterance level graph neural network from the local perspective. Experiments on two conversational reasoning datasets show that our model can dramatically outperform the strong baseline methods and can achieve performance which is close to human level.


On the number of point of given order on odd degree hyperelliptic curves. For integers N geq 3 and g geq 1 , we study bounds on the cardinality of the set of points of order dividing N lying on a hyperelliptic curve of genus g embedded in its jacobian using a Weierstrass point as base point. This leads us to revisit division polynomials introduced by Cantor in 1995 and strengthen a divisibility result proved by him. Several examples are discussed.


Exterior powers in Iwasawa theory. The Iwasawa theory of CM fields has traditionally concerned Iwasawa modules that are abelian pro p Galois groups with ramification allowed at a maximal set of primes over p such that the module is torsion. A main conjecture for such an Iwasawa module describes its codimension one support in terms of a p adic L function attached to the primes of ramification. In this paper, we study more general and potentially much smaller Iwasawa modules that are quotients of exterior powers of Iwasawa modules with ramification at a set of primes over p by sums of exterior powers of inertia subgroups. We show that the higher codimension support of such quotients can be measured by finite collections of p adic L functions under the relevant CM main conjectures.


Model Based Estimation of Vortex Shedding in Unsteady Cylinder Wakes. This paper considers single sensor estimation of vortex shedding in cylinder wakes at Re 100 in simulations and at Re 1036 in experiments. A model based on harmonic decomposition is developed to capture the periodic dynamics of vortex shedding. Two model based methods are proposed to estimate time resolved flow fields. First, Linear Estimation (LE) which implements a Kalman Filter to estimate the flow. Second, Linear Trigonometric Estimation (LTE), which utilizes the same Kalman Filter together with a nonlinear relationship between harmonics of the vortex shedding frequency. LTE shows good performance and outperforms LE regarding the reconstruction of vortex shedding. Physically this suggests that, at the Reynolds numbers considered, the higher harmonic motions in the cylinder wake are slave to the fundamental frequency.


On the asymptotic stability of wave equations coupled by velocities of anti symmetric type. In this paper, we study the asymptotic stability of two wave equations coupled by velocities of anti symmetric type via only one damping. We adopt the frequency domain method to prove that the system with smooth initial data is logarithmically stable, provided that the coupling domain and the damping domain intersect each other. Moreover, we show, by an example, that this geometric assumption of the intersection is necessary for 1 D case.


Understanding the Spatio temporal Topic Dynamics of Covid 19 using Nonnegative Tensor Factorization A Case Study. Social media platforms facilitate mankind a data driven world by enabling billions of people to share their thoughts and activities ubiquitously. This huge collection of data, if analysed properly, can provide useful insights into people's behavior. More than ever, now is a crucial time under the Covid 19 pandemic to understand people's online behaviors detailing what topics are being discussed, and where (space) and when (time) they are discussed. Given the high complexity and poor quality of the huge social media data, an effective spatio temporal topic detection method is needed. This paper proposes a tensor based representation of social media data and Non negative Tensor Factorization (NTF) to identify the topics discussed in social media data along with the spatio temporal topic dynamics. A case study on Covid 19 related tweets from the Australia Twittersphere is presented to identify and visualize spatio temporal topic dynamics on Covid 19


Local well posedness of the Euler Korteweg equations on mathbb T d . We consider the Euler Korteweg system with space periodic boundary conditions x in mathbb T d . We prove a local in time existence result of classical solutions for irrotational velocity fields requiring natural minimal regularity assumptions on the initial data.


A property of the spherical derivative of an entire curve in complex projective space. We establish a type of the Picard's theorem for entire curves in P n( mathbb C) whose spherical derivative vanishes on the inverse images of hypersurface targets. Then, as a corollary, we prove that there is an union D of finite number of hypersurfaces in the complex projective space P n( mathbb C) such that for every entire curve f in P n( mathbb C) , if the spherical derivative f of f is bounded on f 1 (D) , then f is bounded on the entire complex plane, and hence, f is a Brody curve.


Estimation Action Reflection Towards Deep Interaction Between Conversational and Recommender Systems. Recommender systems are embracing conversational technologies to obtain user preferences dynamically, and to overcome inherent limitations of their static models. A successful Conversational Recommender System (CRS) requires proper handling of interactions between conversation and recommendation. We argue that three fundamental problems need to be solved 1) what questions to ask regarding item attributes, 2) when to recommend items, and 3) how to adapt to the users' online feedback. To the best of our knowledge, there lacks a unified framework that addresses these problems. In this work, we fill this missing interaction framework gap by proposing a new CRS framework named Estimation Action Reflection, or EAR, which consists of three stages to better converse with users. (1) Estimation, which builds predictive models to estimate user preference on both items and item attributes (2) Action, which learns a dialogue policy to determine whether to ask attributes or recommend items, based on Estimation stage and conversation history and (3) Reflection, which updates the recommender model when a user rejects the recommendations made by the Action stage. We present two conversation scenarios on binary and enumerated questions, and conduct extensive experiments on two datasets from Yelp and LastFM, for each scenario, respectively. Our experiments demonstrate significant improvements over the state of the art method CRM 32 , corresponding to fewer conversation turns and a higher level of recommendation hits.


Deep Representation Learning For Multimodal Brain Networks. Applying network science approaches to investigate the functions and anatomy of the human brain is prevalent in modern medical imaging analysis. Due to the complex network topology, for an individual brain, mining a discriminative network representation from the multimodal brain networks is non trivial. The recent success of deep learning techniques on graph structured data suggests a new way to model the non linear cross modality relationship. However, current deep brain network methods either ignore the intrinsic graph topology or require a network basis shared within a group. To address these challenges, we propose a novel end to end deep graph representation learning (Deep Multimodal Brain Networks DMBN) to fuse multimodal brain networks. Specifically, we decipher the cross modality relationship through a graph encoding and decoding process. The higher order network mappings from brain structural networks to functional networks are learned in the node domain. The learned network representation is a set of node features that are informative to induce brain saliency maps in a supervised manner. We test our framework in both synthetic and real image data. The experimental results show the superiority of the proposed method over some other state of the art deep brain network models.


Self Paced Deep Regression Forests for Facial Age Estimation. Facial age estimation is an important and challenging problem in computer vision. Existing approaches usually employ deep neural networks (DNNs) to fit the mapping from facial features to age, even though there exist some noisy and confusing samples. We argue that it is more desirable to distinguish noisy and confusing facial images from regular ones, and alleviate the interference arising from them. To this end, we propose self paced deep regression forests (SP DRFs) a gradual learning DNNs framework for age estimation. As the model is learned gradually, from simplicity to complexity, it tends to emphasize more on reliable samples and avoid bad local minima. Moreover, the proposed capped likelihood function helps to exclude noisy samples in training, rendering our SP DRFs significantly more robust. We demonstrate the efficacy of SP DRFs on Morph II and FG NET datasets, where our model achieves state of the art performance.


Probing the surface of synthetic opals with the vanadyl containing crude oil by using EPR and ENDOR techniques. Porous silica materials offer wide range of possibilities for enhancement of the productivity of oil reservoirs. However the mechanism of adsorption of polar components of crude oil on silica surface is poorly understood that hinders technological improvement of supports and oil extraction. We have synthesized opal films with the silica microspheres size of about 360 nm, specific surface area of 5.2 m2 g and pore size of 230 nm. We have fractionated and characterized oil and oil asphaltenes from heavy (Ashalchinskoe) oil. By pulsed electron paramagnetic resonance (EPR) and double electron nuclear resonance (ENDOR) in the W band frequency range (microwave frequency of 94 GHz, magnetic field of 3.4 T) we have studied the adsorption of oil asphaltenes on the surface of opal samples using the intrinsic for asphaltenes paramagnetic vanadylporphyrins (VO) complexes. 1H ENDOR spectra are found to be different for initial and the adsorbed samples in their central parts (that is a sign of asphaltenes VO disaggregation) whereas no significant changes in the W band EPR spectra were detected. Contrasting to alumina support, no strong electron proton interaction with the protons on the surface of SiO2 (presumably, silanol groups) was found and infiltration of the oiled opal films with gasoline changes the central part of 1H ENDOR spectra. It shows that the proton containing groups on the surface of amorphous SiO2 sample can significantly change the asphaltene adsorption properties and ENDOR of the intrinsic for oil paramagnetic centers could be used for the characterization of surface state in porous media in situ or operando.


Cephalometric Landmark Detection by AttentiveFeature Pyramid Fusion and Regression Voting. Marking anatomical landmarks in cephalometric radiography is a critical operation in cephalometric analysis. Automatically and accurately locating these landmarks is a challenging issue because different landmarks require different levels of resolution and semantics. Based on this observation, we propose a novel attentive feature pyramid fusion module (AFPF) to explicitly shape high resolution and semantically enhanced fusion features to achieve significantly higher accuracy than existing deep learning based methods. We also combine heat maps and offset maps to perform pixel wise regression voting to improve detection accuracy. By incorporating the AFPF and regression voting, we develop an end to end deep learning framework that improves detection accuracy by 7 11 for all the evaluation metrics over the state of the art method. We present ablation studies to give more insights into different components of our method and demonstrate its generalization capability and stability for unseen data from diverse devices.


Rethinking embedding coupling in pre trained language models. We re evaluate the standard practice of sharing weights between input and output embeddings in state of the art pre trained language models. We show that decoupled embeddings provide increased modeling flexibility, allowing us to significantly improve the efficiency of parameter allocation in the input embedding of multilingual models. By reallocating the input embedding parameters in the Transformer layers, we achieve dramatically better performance on standard natural language understanding tasks with the same number of parameters during fine tuning. We also show that allocating additional capacity to the output embedding provides benefits to the model that persist through the fine tuning stage even though the output embedding is discarded after pre training. Our analysis shows that larger output embeddings prevent the model's last layers from overspecializing to the pre training task and encourage Transformer representations to be more general and more transferable to other tasks and languages. Harnessing these findings, we are able to train models that achieve strong performance on the XTREME benchmark without increasing the number of parameters at the fine tuning stage.


Endomorphism algebras of 2 row permutation modules over characteristic 3. Given r in mathbf N , let lambda be a partition of r with at most two parts. Let mathbf F be a field of characteristic 3. Write M lambda for the mathbf F S r permutation module corresponding to the action of the symmetric group S r on the cosets of the maximal Young subgroup S lambda. We construct a full set of central primitive idempotents in text End mathbf F S r (M lambda) in this case. We also determine the Young module corresponding to each primitive idempotent that we construct.


Learning to Predict Explainable Plots for Neural Story Generation. Story generation is an important natural language processing task that aims to generate coherent stories automatically. While the use of neural networks has proven effective in improving story generation, how to learn to generate an explainable high level plot still remains a major challenge. In this work, we propose a latent variable model for neural story generation. The model treats an outline, which is a natural language sentence explainable to humans, as a latent variable to represent a high level plot that bridges the input and output. We adopt an external summarization model to guide the latent variable model to learn how to generate outlines from training data. Experiments show that our approach achieves significant improvements over state of the art methods in both automatic and human evaluations.


Phase and Intensity Control of Dissipative Kerr Cavity Solitons. Dissipative Kerr cavity solitons are pulses of light that can persist in coherently driven nonlinear optical resonators. They have attracted significant attention over the past decade due to their rich nonlinear dynamics and key role in the generation of coherent microresonator optical frequency combs. Whilst the vast majority of implementations have relied on emph homogeneous continuous wave driving, the soliton's "plasticity" combined with emph inhomogeneous driving offers attractive advantages for a host of applications. Here we review recent studies into the dynamics and applications of Kerr cavity solitons in the presence of inhomogeneous driving fields. In particular, we summarise the salient theoretical developments that allow for the analysis of CS motion in the presence of pump phase or amplitude inhomogeneities, and survey recent experiments that use pulsed driving to realise energy efficient and flexible microresonator optical frequency combs.


If I Hear You Correctly Building and Evaluating Interview Chatbots with Active Listening Skills. Interview chatbots engage users in a text based conversation to draw out their views and opinions. It is, however, challenging to build effective interview chatbots that can handle user free text responses to open ended questions and deliver engaging user experience. As the first step, we are investigating the feasibility and effectiveness of using publicly available, practical AI technologies to build effective interview chatbots. To demonstrate feasibility, we built a prototype scoped to enable interview chatbots with a subset of active listening skills the abilities to comprehend a user's input and respond properly. To evaluate the effectiveness of our prototype, we compared the performance of interview chatbots with or without active listening skills on four common interview topics in a live evaluation with 206 users. Our work presents practical design implications for building effective interview chatbots, hybrid chatbot platforms, and empathetic chatbots beyond interview tasks.


CAT Compression Aware Training for bandwidth reduction. Convolutional neural networks (CNNs) have become the dominant neural network architecture for solving visual processing tasks. One of the major obstacles hindering the ubiquitous use of CNNs for inference is their relatively high memory bandwidth requirements, which can be a main energy consumer and throughput bottleneck in hardware accelerators. Accordingly, an efficient feature map compression method can result in substantial performance gains. Inspired by quantization aware training approaches, we propose a compression aware training (CAT) method that involves training the model in a way that allows better compression of feature maps during inference. Our method trains the model to achieve low entropy feature maps, which enables efficient compression at inference time using classical transform coding methods. CAT significantly improves the state of the art results reported for quantization. For example, on ResNet 34 we achieve 73.1 accuracy (0.2 degradation from the baseline) with an average representation of only 1.79 bits per value. Reference implementation accompanies the paper at https github.com CAT teams CAT


Constitutive model for shear thickening suspensions Predictions for steady shear with superposed transverse oscillations. We recently developed a tensorial constitutive model for dense, shear thickening particle suspensions that combines rate independent microstructural evolution with a stress dependent jamming threshold. This gives a good qualitative account for reversing flows, although it quantitatively over estimates structural anisotropy J. J. J. Gillissen em et al. , Phys. Rev. Lett. bf 123 (21), 214504 (2019) . Here we use the model to predict the unjamming effect of superposed transverse oscillations on a steady shear flow in the thickened regime N. Y. C. Lin em et al. , Proc. Nat. Acad. Sci. USA bf 113 , 10774 (2016) . The model successfully reproduces the oscillation mediated viscosity drop observed experimentally. We compare the time dependent components of the stress and microstructure tensors to discrete element simulations. Although the model correctly captures the main qualitative behaviour, it generally over predicts the microstructural anisotropy in steady shear, and it under predicts the number of particle contacts in oscillating shear. It also does not fully capture the correct variation in phase angle between the transverse component of the microstructure and the shear rate oscillations, as the amplitude of the latter is increased. These discrepancies suggest avenues for future improvements to the model.


Co Optimizing Performance and Memory FootprintVia Integrated CPU GPU Memory Management, anImplementation on Autonomous Driving Platform. Cutting edge embedded system applications, such as self driving cars and unmanned drone software, are reliant on integrated CPU GPU platforms for their DNNs driven workload, such as perception and other highly parallel components. In this work, we set out to explore the hidden performance implication of GPU memory management methods of integrated CPU GPU architecture. Through a series of experiments on micro benchmarks and real world workloads, we find that the performance under different memory management methods may vary according to application characteristics. Based on this observation, we develop a performance model that can predict system overhead for each memory management method based on application characteristics. Guided by the performance model, we further propose a runtime scheduler. By conducting per task memory management policy switching and kernel overlapping, the scheduler can significantly relieve the system memory pressure and reduce the multitasking co run response time. We have implemented and extensively evaluated our system prototype on the NVIDIA Jetson TX2, Drive PX2, and Xavier AGX platforms, using both Rodinia benchmark suite and two real world case studies of drone software and autonomous driving software.


Multidimensional Uncertainty Aware Evidential Neural Networks. Traditional deep neural networks (NNs) have significantly contributed to the state of the art performance in the task of classification under various application domains. However, NNs have not considered inherent uncertainty in data associated with the class probabilities where misclassification under uncertainty may easily introduce high risk in decision making in real world contexts (e.g., misclassification of objects in roads leads to serious accidents). Unlike Bayesian NN that indirectly infer uncertainty through weight uncertainties, evidential NNs (ENNs) have been recently proposed to explicitly model the uncertainty of class probabilities and use them for classification tasks. An ENN offers the formulation of the predictions of NNs as subjective opinions and learns the function by collecting an amount of evidence that can form the subjective opinions by a deterministic NN from data. However, the ENN is trained as a black box without explicitly considering inherent uncertainty in data with their different root causes, such as vacuity (i.e., uncertainty due to a lack of evidence) or dissonance (i.e., uncertainty due to conflicting evidence). By considering the multidimensional uncertainty, we proposed a novel uncertainty aware evidential NN called WGAN ENN (WENN) for solving an out of distribution (OOD) detection problem. We took a hybrid approach that combines Wasserstein Generative Adversarial Network (WGAN) with ENNs to jointly train a model with prior knowledge of a certain class, which has high vacuity for OOD samples. Via extensive empirical experiments based on both synthetic and real world datasets, we demonstrated that the estimation of uncertainty by WENN can significantly help distinguish OOD samples from boundary samples. WENN outperformed in OOD detection when compared with other competitive counterparts.


Finite record sets of chip firing games. A finite graph with an assignment of non negative integers to vertices gives chip firing games. Chip firing games determine languages (sets of words) called the record sets of legal games. Bj "orner, Lov 'asz and Shor found several properties that are satisfied by record sets. In this paper, we will find two more properties of record sets. Under the assumption that the record set is finite and the game fires only two vertices, these properties characterize the record sets of graphs.


Symmetric strong diameter two property in tensor products of Banach spaces. We continue the investigation of the behaviour of diameter two properties in tensor products of Banach spaces. Our main result shows that the symmetric strong diameter two property is stable by taking projective tensor products. We also prove a result for the symmetric strong diameter two property for the injective tensor product.


Human Trajectory Forecasting in Crowds A Deep Learning Perspective. Since the past few decades, human trajectory forecasting has been a field of active research owing to its numerous real world applications evacuation situation analysis, deployment of intelligent transport systems, traffic operations, to name a few. Early works handcrafted this representation based on domain knowledge. However, social interactions in crowded environments are not only diverse but often subtle. Recently, deep learning methods have outperformed their handcrafted counterparts, as they learned about human human interactions in a more generic data driven fashion. In this work, we present an in depth analysis of existing deep learning based methods for modelling social interactions. We propose two knowledge based data driven methods to effectively capture these social interactions. To objectively compare the performance of these interaction based forecasting models, we develop a large scale interaction centric benchmark TrajNet , a significant yet missing component in the field of human trajectory forecasting. We propose novel performance metrics that evaluate the ability of a model to output socially acceptable trajectories. Experiments on TrajNet validate the need for our proposed metrics, and our method outperforms competitive baselines on both real world and synthetic datasets.


Imposing minimum and maximum member size, minimum cavity size, and minimum separation distance between solid members in topology optimization. This paper focuses on density based topology optimization and proposes a combined method to simultaneously impose Minimum length scale in the Solid phase (MinSolid), Minimum length scale in the Void phase (MinVoid) and Maximum length scale in the Solid phase (MaxSolid). MinSolid and MinVoid mean that the size of solid parts and cavities must be greater than the size of a prescribed circle or sphere. This is ensured through the robust design approach based on eroded, intermediate and dilated designs. MaxSolid seeks to restrict the formation of solid parts larger than a prescribed size, which is imposed through local volume restrictions. In the first part of this article, we show that by proportionally restricting the maximum size of the eroded, intermediate and dilated designs, it is possible to obtain optimized designs satisfying, simultaneously, MinSolid, MinVoid and MaxSolid. However, in spite of obtaining designs with crisp boundaries, some results can be difficult to manufacture due to the presence of multiple rounded cavities, which are introduced by the maximum size restriction with the sole purpose of avoiding thick solid members in the structure. To address this issue, in the second part of this article we propose a new geometric constraint that seeks to control the minimum separation distance between two solid members, also called the Minimum Gap (MinGap). Differently from MinVoid, MinGap introduces large void areas that do not necessarily have to be round. 2D and 3D test cases show that simultaneous control of MinSolid, MinVoid, MaxSolid and MinGap can be useful to improve the manufacturability of maximum size constrained designs.


Harmonic theta series and the Kodaira dimension of mathcal A 6 . We construct a basis of the space text S 14 ( text Sp 12 ( mathbb Z )) of Siegel cusp forms of degree 6 and weight 14 consisting of harmonic theta series. One of these functions has vanishing order 2 at the boundary which implies that the Kodaira dimension of mathcal A 6 is non negative.


Burning Geometric Graphs. A procedure called textit graph burning was introduced to facilitate the modelling of spread of an alarm, a social contagion, or a social influence or emotion on graphs and networks. Graph burning runs on discrete time steps (or rounds). At each step t , first (a) an unburned vertex is burned (as a textit fire source ) from "outside", and then (b) the fire spreads to vertices adjacent to the vertices which are burned till step t 1 . This process stops after all the vertices of G have been burned. The aim is to burn all the vertices in a given graph in minimum time steps. The least number of time steps required to burn a graph is called its textit burning number . The less the burning number is, the faster a graph can be burned. Burning a general graph optimally is an NP Complete problem. It has been proved that optimal burning of path forests, spider graphs, and trees with maximum degree three is NP Complete. We study the textit graph burning problem on several sub classes of textit geometric graphs . We show that burning interval graphs (Section 7.1, Theorem 7.1), permutation graphs (Section 7.2, Theorem 7.2) and disk graphs (Section 7.3, Theorem 7.3) optimally is NP Complete. In addition, we opine that optimal burning of general graphs (Section 9.2, Conjecture 9.1) cannot be approximated better than 3 approximation factor.


Inversion of the Weighted Spherical Mean. The paper contains the inversion formula for the weighted spherical mean. The interest to reconstruction a function by its integral by sphere grews tremendously in the last six decades, stimulated by the spectrum of new problems and methods of image reconstruction. We consider a generalization of the classical spherical mean and its inverse in the case when generalized translation acts to function instead of regular. As a particular case this problem includes action of spherical means on radially symmetric functions.


A summation method based on the Fourier series of periodic distributions and an example. A generalised summation method is considered based on the Fourier series of periodic distributions. It is shown that e it 2e 2it 3e 3it 4e 4it cdots mathrm P mathrm f displaystyle frac e it (1 e it ) 2 i pi displaystyle sum n in mathbb Z delta' (2n 1) pi , where mathrm P mathrm f displaystyle frac e it (1 e it ) 2 in mathcal D '( mathbb R ) is the 2 pi periodic distribution given by begin eqnarray left langle mathrm P mathrm f displaystyle frac e it (1 e it ) 2 , varphi right rangle lim epsilon searrow 0 left( int ( delta, pi epsilon) cup( pi epsilon,2 pi delta) frac varphi(t) e it (1 e it ) 2 dt frac varphi( pi) tan ( epsilon 2) right) end eqnarray varphi in mathcal D ( mathbb R ) with support textrm supp ( varphi) subset ( delta,2 pi delta) , where delta in (0, pi) . Applying the generalised summation method, we determine the sum of the divergent series 1 2 3 cdots , and more generally 1 k 2 k 3 k cdots for k in mathbb N .


Fast and Accurate Forecasting of COVID 19 Deaths Using the SIkJ alpha Model. Forecasting the effect of COVID 19 is essential to design policies that may prepare us to handle the pandemic. Many methods have already been proposed, particularly, to forecast reported cases and deaths at country level and state level. Many of these methods are based on traditional epidemiological model which rely on simulations or Bayesian inference to simultaneously learn many parameters at a time. This makes them prone to over fitting and slow execution. We propose an extension to our model SIkJ alpha to forecast deaths and show that it can consider the effect of many complexities of the epidemic process and yet be simplified to a few parameters that are learned using fast linear regressions. We also present an evaluation of our method against seven approaches currently being used by the CDC, based on their two weeks forecast at various times during the pandemic. We demonstrate that our method achieves better root mean squared error compared to these seven approaches during majority of the evaluation period. Further, on a 2 core desktop machine, our approach takes only 3.18s to tune hyper parameters, learn parameters and generate 100 days of forecasts of reported cases and deaths for all the states in the US. The total execution time for 184 countries is 11.83s and for all the US counties ( 3000) is 101.03s.


Softmax Tempering for Training Neural Machine Translation Models. Neural machine translation (NMT) models are typically trained using a softmax cross entropy loss where the softmax distribution is compared against smoothed gold labels. In low resource scenarios, NMT models tend to over fit because the softmax distribution quickly approaches the gold label distribution. To address this issue, we propose to divide the logits by a temperature coefficient, prior to applying softmax, during training. In our experiments on 11 language pairs in the Asian Language Treebank dataset and the WMT 2019 English to German translation task, we observed significant improvements in translation quality by up to 3.9 BLEU points. Furthermore, softmax tempering makes the greedy search to be as good as beam search decoding in terms of translation quality, enabling 1.5 to 3.5 times speed up. We also study the impact of softmax tempering on multilingual NMT and recurrently stacked NMT, both of which aim to reduce the NMT model size by parameter sharing thereby verifying the utility of temperature in developing compact NMT models. Finally, an analysis of softmax entropies and gradients reveal the impact of our method on the internal behavior of NMT models.


The Reactive Beta Model. We present a reactive beta model that includes the leverage effect to allow hedge fund managers to target a near zero beta for market neutral strategies. For this purpose, we derive a metric of correlation with leverage effect to identify the relation between the market beta and volatility changes. An empirical test based on the most popular market neutral strategies is run from 2000 to 2015 with exhaustive data sets including 600 US stocks and 600 European stocks. Our findings confirm the ability of the reactive beta model to withdraw an important part of the bias from the beta estimation and from most popular market neutral strategies.


Large Effects of Particle Size Heterogeneity on Dynamic Saltation Threshold. Reliably predicting the geomorphology and climate of planetary bodies requires knowledge of the dynamic threshold wind shear velocity below which saltation transport ceases. Here we measure this threshold in a wind tunnel for four well sorted and two poorly sorted sand beds by visual means and by a method that exploits a regime shift in the behavior of the surface roughness caused by momentum transfer from the wind to the saltating particles. For our poorly sorted sands, we find that these measurement methods yield different threshold values because, at the smaller visual threshold, relatively coarse particles do not participate in saltation. We further find that both methods yield threshold values that are much larger (60 250 ) for our poorly sorted sands than for our well sorted sands with similar median particle diameter. In particular, even a rescaling of the dynamic saltation threshold based on the 90th percentile particle diameter rather than the median diameter cannot fully capture this difference, suggesting that relatively very coarse particles have a considerable control on the dynamic threshold. Similar findings were previously reported for water driven sediment transport. Our findings have important implications for quantitative predictions of saltation transport related geophysical processes, such as dust aerosol emission.


On the connectedness principle and dual complexes for generalized pairs. Let (X,B) be a pair, and let f colon X rightarrow S be a contraction with (K X B) nef over S . A conjecture, known as the Shokurov Koll ' a r connectedness principle, predicts that f 1 (s) cap mathrm Nklt (X,B) has at most two connected components, where s in S is an arbitrary schematic point and mathrm Nklt (X,B) denotes the non klt locus of (X,B) . In this work, we prove this conjecture, characterizing those cases in which mathrm Nklt (X,B) fails to be connected, and we extend these same results also to the category of generalized pairs. Finally, we apply these results and the techniques to the study of the dual complex for generalized log Calabi Yau pairs, generalizing results of Koll ' a r Xu and Nakamura.


SimBins An information theoretic approach to link prediction in real multiplex networks. The entities of real world networks are connected via different types of connections (i.e. layers). The task of link prediction in multiplex networks is about finding missing connections based on both intra layer and inter layer correlations. Our observations confirm that that in a wide range of real world multiplex networks, from social to biological and technological, a positive correlation exists between connection probability in one layer and similarity in other layers. Accordingly, a similarity based automatic general purpose multiplex link prediction method SimBins is devised that quantifies the amount of connection uncertainty based on observed inter layer correlations in a multiplex network. Moreover, SimBins enhances the prediction quality in the target layer by incorporating the effect of link overlap across layers. Applied to various datasets from different domains, SimBins proves to be robust and superior than compared methods in majority of experimented cases in terms of accuracy of link prediction. Furthermore, it is discussed that SimBins imposes minor computational overhead to the base similarity measures making it a potentially fast method, suitable for large scale multiplex networks.


On the dynamics of a free vortex pair in the presence of a fixed vortex. The dynamics of a constrained three vortex problem, a free point vortex pair in the velocity field of a fixed point vortex, is investigated. The underlying dynamical system is simplified using a coordinate transformation and categorized into two cases based on the zero and non zero values of the constant of angular impulse. For each case, dynamical features of the vortex motion are studied analytically in the transformed plane, in order to completely classify the vortex motions and to understand the boundedness and periodicity of the inter vortex distances. The theoretical predictions are also verified numerically and illustrated for various sets of initial conditions and circulations.


A stochastic maximum principle for partially observed stochastic control systems with delay. This paper deals with partially observed optimal control problems for the state governed by stochastic differential equation with delay. We develop a stochastic maximum principle for this kind of optimal control problems using a variational method and a filtering technique. Also, we establish a sufficient condition without assumption of the concavity. Two examples shed light on the theoretical results are established in the paper. In particular, in the example of an optimal investment problem with delay, its numerical simulation shows the effect of delay via a discretization technique for forward backward stochastic differential equations (FBSDEs) with delay and anticipate terms.


An important excited random walk counter example. In this paper, we give a detailed construction of an example of excited random walk with speed zero in an ergodic random environment that have an infinite average number of cookies in each site. This example confirms that a result of Mountford, Pimentel and Valle (2006), which gives a sufficient condition for excited random walks in deterministic environment to have positive speed, can not be extended to ergodic random environment.


Learning Explainable Interventions to Mitigate HIV Transmission in Sex Workers Across Five States in India. Female sex workers(FSWs) are one of the most vulnerable and stigmatized groups in society. As a result, they often suffer from a lack of quality access to care. Grassroot organizations engaged in improving health services are often faced with the challenge of improving the effectiveness of interventions due to complex influences. This work combines structure learning, discriminative modeling, and grass root level expertise of designing interventions across five different Indian states to discover the influence of non obvious factors for improving safe sex practices in FSWs. A bootstrapped, ensemble averaged Bayesian Network structure was learned to quantify the factors that could maximize condom usage as revealed from the model. A discriminative model was then constructed using XgBoost and random forest in order to predict condom use behavior The best model achieved 83 sensitivity, 99 specificity, and 99 area under the precision recall curve for the prediction. Both generative and discriminative modeling approaches revealed that financial literacy training was the primary influence and predictor of condom use in FSWs. These insights have led to a currently ongoing field trial for assessing the real world utility of this approach. Our work highlights the potential of explainable models for transparent discovery and prioritization of anti HIV interventions in female sex workers in a resource limited setting.


Overview of FPGA deep learning acceleration based on convolutional neural network. In recent years, deep learning has become more and more mature, and as a commonly used algorithm in deep learning, convolutional neural networks have been widely used in various visual tasks. In the past, research based on deep learning algorithms mainly relied on hardware such as GPUs and CPUs. However, with the increasing development of FPGAs, both field programmable logic gate arrays, it has become the main implementation hardware platform that combines various neural network deep learning algorithms This article is a review article, which mainly introduces the related theories and algorithms of convolution. It summarizes the application scenarios of several existing FPGA technologies based on convolutional neural networks, and mainly introduces the application of accelerators. At the same time, it summarizes some accelerators' under utilization of logic resources or under utilization of memory bandwidth, so that they can't get the best performance.


Double ionization mechanisms of magnesium driven by electron impact. We study double ionization of Mg by electron impact through the vantage point of classical mechanics. We consider all electron electron correlations in a Coulomb four body problem, where three electrons belong to the atom and the fourth electron causes the impact ionization. From our model we compute the double ionization probability of Mg for impact energies from 15, to 125 eV. Double ionization occurs through eight double ionization mechanisms, which we classify into four categories inner shell capture, direct, delay and ionized inner shell mechanisms. We show that delay and ionized inner shell mechanisms require electron electron correlations among the four electrons, and are responsible for the second increase in the double ionization probability. Furthermore, we show that our theoretical prediction about the relative prominence of certain double ionization mechanisms is in agreement with experimental results on the relative prominence of non first over first order mechanisms.


Lysine residues control the conformational dynamics of beta 2 glycoprotein I. One of the major problems in the study of the dynamics of proteins is the visualization of changing conformations that are important for processes ranging from enzyme catalysis to signaling. A protein exhibiting conformational dynamics is the soluble blood protein beta 2 glycoprotein I (beta2GPI), which exists in two conformations the closed (circular) form and the open (linear) form. It is hypothesized that an increased proportion of the open conformation leads to the autoimmune disease antiphospholipid syndrome (APS). A characteristic feature of beta2GPI is the high content of lysine residues. However, the potential role of lysine in the conformational dynamics of beta2GPI has been poorly investigated. Here, we report on a strategy to permanently open up the closed protein conformation by chemical acetylation of lysine residues using acetic acid N hydroxysuccinimide ester (NHS Ac). Specific and complete acetylation was demonstrated by the quantification of primary amino groups with fluoraldehyde o phthalaldehyde (OPA) reagent, as well as western blot analysis with an anti acetylated lysine antibody. Our results demonstrate that acetylated beta2GPI preserves its secondary and tertiary structures, as shown by circular dichroism spectroscopy. We found that after lysine acetylation, the majority of proteins are in the open conformation as revealed by atomic force microscopy high resolution images. Using this strategy, we proved that the electrostatic interaction of lysine residues plays a major role in stabilizing the beta2GPI closed conformation, as confirmed by lysine charge distribution calculations. We foresee that our approach will be applied to other lysine rich proteins (e.g. histones) undergoing conformational transitions.


Regularized Estimation of Information via High Dimensional Canonical Correlation Analysis. In recent years, there has been an upswing of interest in estimating information from data emerging in a lot of areas beyond communications. This paper aims at estimating the information between two random phenomena by using consolidated second order statistics tools. The squared loss mutual information is chosen for that purpose as a natural surrogate of Shannon mutual information. The rationale for doing so is developed for i.i.d. discrete sources mapping data onto the simplex space , and for analog sources mapping data onto the characteristic space , highlighting the links with other well known related concepts in the literature based on local approximations of information theoretic measures. The proposed approach gains in interpretability and scalability for its use on large datasets, providing physical interpretation to the free regularization parameters. Moreover, the structure of the proposed mapping allows resorting to Szeg "o's theorem to reduce the complexity for high dimensional mappings, exhibiting strong dualities with spectral analysis. The performance of the proposed estimators is analyzed using Gaussian mixtures.


Principled Frameworks for Evaluating Ethics in NLP Systems. We critique recent work on ethics in natural language processing. Those discussions have focused on data collection, experimental design, and interventions in modeling. But we argue that we ought to first understand the frameworks of ethics that are being used to evaluate the fairness and justice of algorithmic systems. Here, we begin that discussion by outlining deontological ethics, and envision a research agenda prioritized by it.


Decreasing Minimization on M convex Sets Algorithms and Applications. This paper is concerned with algorithms and applications of decreasing minimization on an M convex set, which is the set of integral elements of an integral base polyhedron. Based on a recent characterization of decreasingly minimal (dec min) elements, we develop a strongly polynomial algorithm for computing a dec min element of an M convex set. The matroidal feature of the set of dec min elements makes it possible to compute a minimum cost dec min element, as well. Our second goal is to exhibit various applications in matroid and network optimization, resource allocation, and (hyper)graph orientation. We extend earlier results on semi matchings to a large degree by developing a structural description of dec min in degree bounded orientations of a graph. This characterization gives rise to a strongly polynomial algorithm for finding a minimum edge cost dec min orientation.


Efficient Querying from Weighted Binary Codes. Binary codes are widely used to represent the data due to their small storage and efficient computation. However, there exists an ambiguity problem that lots of binary codes share the same Hamming distance to a query. To alleviate the ambiguity problem, weighted binary codes assign different weights to each bit of binary codes and compare the binary codes by the weighted Hamming distance. Till now, performing the querying from the weighted binary codes efficiently is still an open issue. In this paper, we propose a new method to rank the weighted binary codes and return the nearest weighted binary codes of the query efficiently. In our method, based on the multi index hash tables, two algorithms, the table bucket finding algorithm and the table merging algorithm, are proposed to select the nearest weighted binary codes of the query in a non exhaustive and accurate way. The proposed algorithms are justified by proving their theoretic properties. The experiments on three large scale datasets validate both the search efficiency and the search accuracy of our method. Especially for the number of weighted binary codes up to one billion, our method shows a great improvement of more than 1000 times faster than the linear scan.


On the Geometry and Linear Convergence of Primal Dual Dynamics. The paper proposes a variational inequality based primal dual dynamic that has a globally exponentially stable saddle point solution when applied to solve linear inequality constrained optimization problems. A Riemannian geometric framework is proposed wherein we begin by framing the proposed dynamics in a fiber bundle setting endowed with a Riemannian metric that captures the geometry of the gradient (of the Lagrangian function). A strongly monotone gradient vector field is obtained by using the natural gradient adaptation on the Riemannian manifold. The Lyapunov stability analysis proves that this adaption leads to a globally exponentially stable saddle point solution. Further, with numeric simulations we show that the scaling a key parameter in the Riemannian metric results in an accelerated convergence to the saddle point solution.


The normal shapes of the symplectic and contact forms over algebras of divided powers. This text is the English translation of a 1986 manuscript which gives the classification of the differential forms parametrizing the finite dimensional Lie algebras of hamiltonian and contact Cartan types over fields of positive characteristic. The results of this paper have not been previously published in full.


Learning natural locomotion behaviors for humanoid robots using human knowledge. This paper presents a new learning framework that leverages the knowledge from imitation learning, deep reinforcement learning, and control theories to achieve human style locomotion that is natural, dynamic, and robust for humanoids. We proposed novel approaches to introduce human bias, i.e. motion capture data and a special Multi Expert network structure. We used the Multi Expert network structure to smoothly blend behavioral features, and used the augmented reward design for the task and imitation rewards. Our reward design is composable, tunable, and explainable by using fundamental concepts from conventional humanoid control. We rigorously validated and benchmarked the learning framework which consistently produced robust locomotion behaviors in various test scenarios. Further, we demonstrated the capability of learning robust and versatile policies in the presence of disturbances, such as terrain irregularities and external pushes.


Null Controllability of a nonlinear age, space and two sex structured population dynamics model. In this paper, we study the null controllability of a nonlinear age, space and two sex structured population dynamics model. This model is such that the nonlinearity and the couplage are at birth level. We consider a population with males and females and we are dealing with two cases of null controllability problem. The first problem is related to the total extinction, which means that, we estimate a time T to bring the male and female subpopulation density to zero. The second case concerns null controllability of male or female subpopulation individuals. Here, So if A is the life span of the individuals, at time T A one will get the total extinction of the population. Our method uses first an observability inequality related to the adjoint of an auxiliary system, a null controllability of the linear auxiliary system, and after the Schauder's fixed point theorem.


The fault tolerant cluster sending problem. The development of fault tolerant distributed systems that can tolerate Byzantine behavior has traditionally been focused on consensus protocols, which support fully replicated designs. For the development of more sophisticated high performance Byzantine distributed systems, more specialized fault tolerant communication primitives are necessary, however. In this paper, we identify an essential communication primitive and study it in depth. In specifics, we formalize the cluster sending problem, the problem of sending a message from one Byzantine cluster to another Byzantine cluster in a reliable manner. We not only formalize this fundamental problem, but also establish lower bounds on the complexity of this problem under crash failures and Byzantine failures. Furthermore, we develop practical cluster sending protocols that meet these lower bounds and, hence, have optimal complexity. As such, our work provides a strong foundation for the further exploration of novel designs that address challenges encountered in fault tolerant distributed systems.


Scattering for the quadratic Klein Gordon equations. We study the scattering problems for the quadratic Klein Gordon equations with radial initial data in the energy space. For 3D, we prove small data scattering, and for 4D, we prove large data scattering with mass below the ground state.


Efficient stochastic simulation of rate equations and photon statistics of nanolasers. Based on a rate equation model for single mode two level lasers, two algorithms for stochastically simulating the dynamics and steady state behaviour of micro and nanolasers are described in detail. Both methods lead to steady state photon numbers and statistics characteristic of lasers, but one of the algorithms is shown to be significantly more efficient. This algorithm, known as Gillespie's First Reaction Method (FRM), gives up to a thousandfold reduction in computation time compared to earlier algorithms, while also circumventing numerical issues regarding time increment size and ordering of events. The FRM is used to examine intra cavity photon distributions, and it is found that the numerical results follow the analytics exactly. Finally, the FRM is applied to a set of slightly altered rate equations, and it is shown that both the analytical and numerical results exhibit features that are typically associated with the presence of strong inter emitter correlations in nanolasers.


Monotone solutions for mean field games master equations finite state space and optimal stopping. We present a new notion of solution for mean field games master equations. This notion allows us to work with solutions which are merely continuous. We prove first results of uniqueness and stability for such solutions. It turns out that this notion is helpful to characterize the value function of mean field games of optimal stopping or impulse control and this is the topic of the second half of this paper. The notion of solution we introduce is only useful in the monotone case. We focus in this paper in the finite state space case.


An inverse boundary value problem for certain anisotropic quasilinear elliptic equations. In this paper we prove uniqueness in the inverse boundary value problem for quasilinear elliptic equations whose linear part is the Laplacian and nonlinear part is the divergence of a function analytic in the gradient of the solution. The main novelty in terms of the result is that the coefficients of the nonlinearity are allowed to be "anisotropic". As in previous works, the proof reduces to an integral identity involving the tensor product of the gradients of 3 or more harmonic functions. Employing a construction method using Gaussian quasi modes, we obtain a convenient family of harmonic functions to plug into the integral identity and establish our result.


Cosets of monodromies and quantum representations. We use geometric methods to show that given any 3 manifold M , and g a sufficiently large integer, the mapping class group mathrm Mod ( Sigma g,1 ) contains a coset of an abelian subgroup of rank lfloor frac g 2 rfloor, consisting of pseudo Anosov monodromies of open book decompositions in M. We prove a similar result for rank two free cosets of mathrm Mod ( Sigma g,1 ). These results have applications to a conjecture of Andersen, Masbaum and Ueno about quantum representations of surface mapping class groups. For surfaces with boundary, and large enough genus, we construct cosets of abelian and free subgroups of their mapping class groups consisting of elements that satisfy the conjecture. The mapping tori of these elements are fibered 3 manifolds that satisfy a weak form of the Turaev Viro invariants volume conjecture.


On a BSD type formula for L values of Artin twists of elliptic curves. This is an investigation into the possible existence and consequences of a Birch Swinnerton Dyer type formula for L functions of elliptic curves twisted by Artin representations. We translate expected properties of L functions into purely arithmetic predictions for elliptic curves, and show that these force some peculiar properties of the Tate Shafarevich group, which do not appear to be tractable by traditional Selmer group techniques. In particular we exhibit settings where the different p primary components of the Tate Shafarevich group do not behave independently of one another. We also give examples of "arithmetically identical" settings for elliptic curves twisted by Artin representations, where the associated L values can nonetheless differ, in contrast to the classical Birch Swinnerton Dyer conjecture.


Large, lengthy graphs look locally like lines. We apply the theory of unimodular random rooted graphs to study the metric geometry of large, finite, bounded degree graphs whose diameter is proportional to their volume. We prove that for a positive proportion of the vertices of such a graph, there exists a mesoscopic scale on which the graph looks like mathbb R in the sense that the rescaled ball is close to a line segment in the Gromov Hausdorff metric.


Graph integration of structured, semistructured and unstructured data for data journalism. Digital data is a gold mine for modern journalism. However, datasets which interest journalists are extremely heterogeneous, ranging from highly structured (relational databases), semi structured (JSON, XML, HTML), graphs (e.g., RDF), and text. Journalists (and other classes of users lacking advanced IT expertise, such as most non governmental organizations, or small public administrations) need to be able to make sense of such heterogeneous corpora, even if they lack the ability to define and deploy custom extract transform load workflows, especially for dynamically varying sets of data sources. We describe a complete approach for integrating dynamic sets of heterogeneous datasets along the lines described above the challenges we faced to make such graphs useful, allow their integration to scale, and the solutions we proposed for these problems. Our approach is implemented within the ConnectionLens system we validate it through a set of experiments.


Robustness to Missing Features using Hierarchical Clustering with Split Neural Networks. The problem of missing data has been persistent for a long time and poses a major obstacle in machine learning and statistical data analysis. Past works in this field have tried using various data imputation techniques to fill in the missing data, or training neural networks (NNs) with the missing data. In this work, we propose a simple yet effective approach that clusters similar input features together using hierarchical clustering and then trains proportionately split neural networks with a joint loss. We evaluate this approach on a series of benchmark datasets and show promising improvements even with simple imputation techniques. We attribute this to learning through clusters of similar features in our model architecture. The source code is available at https github.com usarawgi911 Robustness to Missing Features


Webly Supervised Image Classification with Metadata Automatic Noisy Label Correction via Visual Semantic Graph. Webly supervised learning becomes attractive recently for its efficiency in data expansion without expensive human labeling. However, adopting search queries or hashtags as web labels of images for training brings massive noise that degrades the performance of DNNs. Especially, due to the semantic confusion of query words, the images retrieved by one query may contain tremendous images belonging to other concepts. For example, searching tiger cat' on Flickr will return a dominating number of tiger images rather than the cat images. These realistic noisy samples usually have clear visual semantic clusters in the visual space that mislead DNNs from learning accurate semantic labels. To correct real world noisy labels, expensive human annotations seem indispensable. Fortunately, we find that metadata can provide extra knowledge to discover clean web labels in a labor free fashion, making it feasible to automatically provide correct semantic guidance among the massive label noisy web data. In this paper, we propose an automatic label corrector VSGraph LC based on the visual semantic graph. VSGraph LC starts from anchor selection referring to the semantic similarity between metadata and correct label concepts, and then propagates correct labels from anchors on a visual graph using graph neural network (GNN). Experiments on realistic webly supervised learning datasets Webvision 1000 and NUS 81 Web show the effectiveness and robustness of VSGraph LC. Moreover, VSGraph LC reveals its advantage on the open set validation set.


AGDC Automatic Garbage Detection and Collection. Waste management is one of the significant problems throughout the world. Contemporaneous methods find it difficult to manage the volume of solid waste generated by the growing urban population. In this paper, we propose a system which is very hygienic and cheap that uses Artificial Intelligence algorithms for detection of the garbage. Once the garbage is detected the system calculates the position of the garbage by the use of the camera only. The proposed system is capable of distinguishing between valuables and garbage with more than 95 confidence in real time. Finally, a robotic arm controlled by the microcontroller is used to pick up the garbage and places it in the bin. Concluding, the paper explains a system that is capable of working as a human in terms of inspecting and collecting the garbage. The system is able to achieve 3 4 frames per second on the Raspberry Pi, capable of detecting the garbage in real time with 90 confidence.


Vanishing theorems for Shimura varieties at unipotent level. We show that the compactly supported cohomology of Shimura varieties of Hodge type of infinite Gamma 1(p infty) level (defined with respect to a Borel subgroup) vanishes above the middle degree, under the assumption that the group of the Shimura datum splits at p . This generalizes and strengthens the vanishing result proved in "Shimura varieties at level Gamma 1(p infty) and Galois representations". As an application of this vanishing theorem, we prove a result on the codimensions of ordinary completed homology for the same groups, analogous to conjectures of Calegari Emerton for completed (Borel Moore) homology.


An Asynchronous, Decentralized Solution Framework for the Large Scale Unit Commitment Problem. With increased reliance on cyber infrastructure, large scale power networks face new challenges owing to computational scalability. In this paper we focus on developing an asynchronous decentralized solution framework for the Unit Commitment(UC) problem for large scale power networks. We exploit the inherent asynchrony in a region based decomposition arising out of imbalance in regional subproblems to boost computational efficiency. A two phase algorithm is proposed that relies on the convex relaxation and privacy preserving valid inequalities in order to deliver algorithmic improvements. Our algorithm employs a novel interleaved binary mechanism that locally switches from the convex subproblem to its binary counterpart based on consistent local convergent behavior. We develop a high performance computing (HPC) oriented software framework that uses Message Passing Interface (MPI) to drive our benchmark studies. Our simulations performed on the IEEE 3012 bus case are benchmarked against the centralized and a state of the art synchronous decentralized method. The results demonstrate that the asynchronous method improves computational efficiency by a significant amount and provides a competitive solution quality rivaling the benchmark methods.


On the approximation of quasistatic evolutions for the debonding of a thin film via vanishing inertia and viscosity. In this paper we contribute to studying the issue of quasistatic limit in the context of Griffith's theory by investigating a one dimensional debonding model. It describes the evolution of a thin film partially glued to a rigid substrate and subjected to a vertical loading. Taking friction into account and under suitable assumptions on the toughness of the glue, we prove that, in contrast to what happens in the undamped case, dynamic solutions converge to the quasistatic one when inertia and viscosity go to zero, except for a possible discontinuity at the initial time. We then characterise the size of the jump by means of an asymptotic analysis of the debonding front.


Joint Power Allocation and Load Balancing Optimization for Energy Efficient Cell Free Massive MIMO Networks. Large scale distributed antenna systems with many access points (APs) that serve the users by coherent joint transmission is being considered for 5G and beyond networks. The technology is called Cell free Massive MIMO and can provide a more uniform service level to the users than a conventional cellular topology. For a given user set, only a subset of the APs is likely needed to satisfy the users' performance demands, particularly outside the peak traffic hours. To find achieve an energy efficient load balancing, we minimize the total downlink power consumption at the APs, considering both the transmit powers and hardware dissipation. APs can be temporarily turned off to reduce the latter part. The formulated optimization problem is non convex but, nevertheless, a globally optimal solution is obtained by solving a mixed integer second order cone program. Since the computational complexity is prohibitive for real time implementation, we also propose two low complexity algorithms that exploit the inherent group sparsity and the optimized transmit powers in the problem formulation. Numerical results manifest that our optimization algorithms can greatly reduce the power consumption compared to keeping all APs turned on and only minimizing the transmit powers. Moreover, the low complexity algorithms can effectively handle the power allocation and AP activation for large scale networks.


A 2 compact group as a spets. In 1993, Brou ' e , Malle and Michel initiated the study of spetses on the Greek island bearing the same name. These are mysterious objects attached to non real Weyl groups. In algebraic topology, a p compact group mathbf X is a space which is a homotopy theoretic p local analogue of a compact Lie group. A connected p compact group mathbf X is determined by its root datum which in turn determines its Weyl group W mathbf X . In this article we give strong numerical evidence for a connection between these two objects by considering the case when mathbf X is the exotic 2 compact group DI (4) constructed by Dwyer Wilkerson and W mathbf X is the complex reflection group G 24 cong GL 3(2) times C 2 . Inspired by results in Deligne Lusztig theory for classical groups, if q is an odd prime power we propose a set Irr ( mathbf X (q)) of ordinary irreducible characters' associated to the space mathbf X (q) of homotopy fixed points under the unstable Adams operation psi q . Notably Irr ( mathbf X (q)) includes the set of unipotent characters associated to G 24 constructed by Brou ' e , Malle and Michel from the Hecke algebra of G 24 using the theory of spetses. By regarding mathbf X (q) as the classifying space of a Benson Solomon fusion system Sol (q) we formulate and prove an analogue of Robinson's ordinary weight conjecture that the number of characters of defect d in Irr ( mathbf X (q)) can be counted locally.


Rewrite to Reinforce Rewriting the Binary to Apply Countermeasures against Fault Injection. Fault injection attacks can cause errors in software for malicious purposes. Oftentimes, vulnerable points of a program are detected after its development. It is therefore critical for the user of the program to be able to apply last minute security assurance to the executable file without having access to the source code. In this work, we explore two methodologies based on binary rewriting that aid in injecting countermeasures in the binary file. The first approach injects countermeasures by reassembling the disassembly whereas the second approach leverages a full translation to a high level IR and lowering that back to the target architecture.


Characterising Third Party Cookie Usage in the EU after GDPR. The recently introduced General Data Protection Regulation (GDPR) requires that when obtaining information online that could be used to identify individuals, their consents must be obtained. Among other things, this affects many common forms of cookies, and users in the EU have been presented with notices asking their approvals for data collection. This paper examines the prevalence of third party cookies before and after GDPR by using two datasets accesses to top 500 websites according to Alexa.com, and weekly data of cookies placed in users' browsers by websites accessed by 16 UK and China users across one year. We find that on average the number of third parties dropped by more than 10 after GDPR, but when we examine real users' browsing histories over a year, we find that there is no material reduction in long term numbers of third party cookies, suggesting that users are not making use of the choices offered by GDPR for increased privacy. Also, among websites which offer users a choice in whether and how they are tracked, accepting the default choices typically ends up storing more cookies on average than on websites which provide a notice of cookies stored but without giving users a choice of which cookies, or those that do not provide a cookie notice at all. We also find that top non EU websites have fewer cookie notices, suggesting higher levels of tracking when visiting international sites. Our findings have deep implications both for understanding compliance with GDPR as well as understanding the evolution of tracking on the web.


Unsupervised 3D Human Pose Representation with Viewpoint and Pose Disentanglement. Learning a good 3D human pose representation is important for human pose related tasks, e.g. human 3D pose estimation and action recognition. Within all these problems, preserving the intrinsic pose information and adapting to view variations are two critical issues. In this work, we propose a novel Siamese denoising autoencoder to learn a 3D pose representation by disentangling the pose dependent and view dependent feature from the human skeleton data, in a fully unsupervised manner. These two disentangled features are utilized together as the representation of the 3D pose. To consider both the kinematic and geometric dependencies, a sequential bidirectional recursive network (SeBiReNet) is further proposed to model the human skeleton data. Extensive experiments demonstrate that the learned representation 1) preserves the intrinsic information of human pose, 2) shows good transferability across datasets and tasks. Notably, our approach achieves state of the art performance on two inherently different tasks pose denoising and unsupervised action recognition. Code and models are available at url https github.com NIEQiang001 unsupervised human pose.git


Adversarial Music Real World Audio Adversary Against Wake word Detection System. Voice Assistants (VAs) such as Amazon Alexa or Google Assistant rely on wake word detection to respond to people's commands, which could potentially be vulnerable to audio adversarial examples. In this work, we target our attack on the wake word detection system, jamming the model with some inconspicuous background music to deactivate the VAs while our audio adversary is present. We implemented an emulated wake word detection system of Amazon Alexa based on recent publications. We validated our models against the real Alexa in terms of wake word detection accuracy. Then we computed our audio adversaries with consideration of expectation over transform and we implemented our audio adversary with a differentiable synthesizer. Next, we verified our audio adversaries digitally on hundreds of samples of utterances collected from the real world. Our experiments show that we can effectively reduce the recognition F1 score of our emulated model from 93.4 to 11.0 . Finally, we tested our audio adversary over the air, and verified it works effectively against Alexa, reducing its F1 score from 92.5 to 11.0 . We also verified that non adversarial music does not disable Alexa as effectively as our music at the same sound level. To the best of our knowledge, this is the first real world adversarial attack against a commercial grade VA wake word detection system. Our code and demo videos can be accessed at url https www.junchengbillyli.com AdversarialMusic


Convergence and Strong Summability of the Two dimensional Vilenkin Fourier Series. In this paper we investigate convergence and strong summability of the two dimensional Vilenkin Fourier series in the martingale Hardy spaces.


Strongly Stable and Maximum Weakly Stable Noncrossing Matchings. In IWOCA 2019, Ruangwises and Itoh introduced stable noncrossing matchings, where participants of each side are aligned on each of two parallel lines, and no two matching edges are allowed to cross each other. They defined two stability notions, strongly stable noncrossing matching (SSNM) and weakly stable noncrossing matching (WSNM), depending on the strength of blocking pairs. They proved that a WSNM always exists and presented an O(n 2 ) time algorithm to find one for an instance with n men and n women. They also posed open questions of the complexities of determining existence of an SSNM and finding a largest WSNM. In this paper, we show that both problems are solvable in polynomial time. Our algorithms are applicable to extensions where preference lists may include ties, except for one case which we show to be NP complete. This NP completeness holds even if each person's preference list is of length at most two and ties appear in only men's preference lists. To complement this intractability, we show that the problem is solvable in polynomial time if the length of preference lists of one side is bounded by one (but that of the other side is unbounded).


Neutron diffraction strain tomography 2D axisymmetric sample geometry. We consider a method for neutron residual strain stress analysis combining features of transmission strain tomography (e.g. through Braggs edge imaging) and neutron diffraction techniques. Analogous to transmission strain tomography, our approach observes integrals of strain along the path of a beam, however, rather than transmitted beams, we observe a diffracted beam. The practical feasibility of neutron diffraction tomography is demonstrated in case of a 2D axisymmetric sample where the reconstruction of the stress field is determined from the measurement of a strain profile. The reconstruction is compared to a set of measurements made using a traditional neutron stress scanning technique in order to validate the new method. Similar strain accuracy was achieved by the new technique within a reasonable measurement time. The practical and theoretical challenges regarding the technique are also discussed.


Research Note An Open Source Bluespec Compiler. In this Research Note we report on an open source compiler for the Bluespec hardware description language.


DyStaB Unsupervised Object Segmentation via Dynamic Static Bootstrapping. We describe an unsupervised method to detect and segment portions of images of live scenes that, at some point in time, are seen moving as a coherent whole, which we refer to as objects. Our method first partitions the motion field by minimizing the mutual information between segments. Then, it uses the segments to learn object models that can be used for detection in a static image. Static and dynamic models are represented by deep neural networks trained jointly in a bootstrapping strategy, which enables extrapolation to previously unseen objects. While the training process requires motion, the resulting object segmentation network can be used on either static images or videos at inference time. As the volume of seen videos grows, more and more objects are seen moving, priming their detection, which then serves as a regularizer for new objects, turning our method into unsupervised continual learning to segment objects. Our models are compared to the state of the art in both video object segmentation and salient object detection. In the six benchmark datasets tested, our models compare favorably even to those using pixel level supervision, despite requiring no manual annotation.


Compactness of Transfer Operators and Spectral Representation of Ruelle Zeta Functions for Super continuous Functions. Transfer operators and Ruelle zeta functions for super continuous functions on one sided topological Markov shifts are considered. For every super continuous function, we construct a Banach space on which the associated transfer operator is compact. Using this Banach space, we establish the trace formula and spectral representation of Ruelle zeta functions for a certain class of super continuous functions. Our results include, as a special case, the classical trace formula and spectral representation for the class of locally constant functions.


Dynamic Edge Weights in Graph Neural Networks for 3D Object Detection. A robust and accurate 3D detection system is an integral part of autonomous vehicles. Traditionally, a majority of 3D object detection algorithms focus on processing 3D point clouds using voxel grids or bird's eye view (BEV). Recent works, however, demonstrate the utilization of the graph neural network (GNN) as a promising approach to 3D object detection. In this work, we propose an attention based feature aggregation technique in GNN for detecting objects in LiDAR scan. We first employ a distance aware down sampling scheme that not only enhances the algorithmic performance but also retains maximum geometric features of objects even if they lie far from the sensor. In each layer of the GNN, apart from the linear transformation which maps the per node input features to the corresponding higher level features, a per node masked attention by specifying different weights to different nodes in its first ring neighborhood is also performed. The masked attention implicitly accounts for the underlying neighborhood graph structure of every node and also eliminates the need of costly matrix operations thereby improving the detection accuracy without compromising the performance. The experiments on KITTI dataset show that our method yields comparable results for 3D object detection.


Controlled photophoretic levitation of nanostructured thin films for near space flight. We report light driven levitation of macroscopic polymer films whose bottom surface is engineered to maximize the thermal accommodation coefficient. Specifically, we levitated centimeter scale disks made of commercial 0.5 micron thick mylar film coated with carbon nanotubes on one side. When illuminated with light intensity comparable to natural sunlight, the polymer disk heats up and interacts with incident gas molecules differently on the top and bottom sides, producing a net recoil force. This lift force is maximized at gas pressures corresponding to Knudsen number on the order of 0.3, and correspondingly, we observed the levitation of 0.6 cm diameter disks in a vacuum chamber at pressures between 10 and 30 Pa. Moreover, we controlled the flight of the disks using a shaped beam that optically trapped the levitating disks. Our experimentally validated theoretical model predicts that the lift forces can be many times the weight of the films, allowing payloads of up to 10 milligrams for sunlight powered low cost microflyers in the upper atmosphere at altitudes of 50 100 km.


Panoptic Instance Segmentation on Pigs. The behavioural research of pigs can be greatly simplified if automatic recognition systems are used. Especially systems based on computer vision have the advantage that they allow an evaluation without affecting the normal behaviour of the animals. In recent years, methods based on deep learning have been introduced and have shown pleasingly good results. Especially object and keypoint detectors have been used to detect the individual animals. Despite good results, bounding boxes and sparse keypoints do not trace the contours of the animals, resulting in a lot of information being lost. Therefore this work follows the relatively new definition of a panoptic segmentation and aims at the pixel accurate segmentation of the individual pigs. For this a framework of a neural network for semantic segmentation, different network heads and postprocessing methods is presented. With the resulting instance segmentation masks further information like the size or weight of the animals could be estimated. The method is tested on a specially created data set with 1000 hand labeled images and achieves detection rates of around 95 (F1 Score) despite disturbances such as occlusions and dirty lenses.


On pseudo Frobenius elements of submonoids of mathbb N d . In this paper we study those submonoids of mathbb N d which a non trivial pseudo Frobenius set. In the affine case, we prove that they are the affine semigroups whose associated algebra over a field has maximal projective dimension possible. We prove that these semigroups are a natural generalization of numerical semigroups and, consequently, most of their invariants can be generalized. In the last section we introduce a new family of submonoids of mathbb N d and using its pseudo Frobenius elements we prove that the elements in the family are direct limits of affine semigroups.


A note on the refined Strichartz estimates and maximal extension operator. There are two parts for this paper. In the first part, we extend some results in a recent paper by Du, Guth, Li and Zhang to a more general class of phase functions. The main methods are Bourgain Demeter's l 2 decoupling theorem and induction on scales. In the second part, we prove some positive results for the maximal extension operator for hypersurfaces with positive principal curvatures. The main methods are sharp L 2 estimates by Du and Zhang, and the bilinear method by Wolff and Tao.


Take a NAP Non Autoregressive Prediction for Pedestrian Trajectories. Pedestrian trajectory prediction is a challenging task as there are three properties of human movement behaviors which need to be addressed, namely, the social influence from other pedestrians, the scene constraints, and the multimodal (multiroute) nature of predictions. Although existing methods have explored these key properties, the prediction process of these methods is autoregressive. This means they can only predict future locations sequentially. In this paper, we present NAP, a non autoregressive method for trajectory prediction. Our method comprises specifically designed feature encoders and a latent variable generator to handle the three properties above. It also has a time agnostic context generator and a time specific context generator for non autoregressive prediction. Through extensive experiments that compare NAP against several recent methods, we show that NAP has state of the art trajectory prediction performance.


Dynamic Task Allocation for Robotic Network Cloud Systems. Every robotic network cloud system can be seen as a graph with nodes as hardware with independent computational processing powers and edges as data transmissions between nodes. When assigning a task to a node we may change several values corresponding to the node such as distance to other nodes, the time to complete all of its tasks, the energy level of the node, energy consumed while performing all of its tasks, geometrical position, communication with other nodes, and so on. These values can be seen as fingerprints for the current state of the node which can be evaluated as a subspace of a hyperspace. We proposed a theoretical model describing how assigning tasks to a node will change the subspace of the hyperspace, and from that, we show how to obtain the optimal task allocation. We described the communication instability between nodes and the capability of nodes as subspaces of a hyperspace. We translate task scheduling to nodes as finding the maximum volume of the hyperspace.


Frequency up conversion of an infrared image via a flat top pump beam. The infrared imaging detection is an important and promising technology having wide applications. In this work, we report on the frequency up conversion detection of an image based on sum frequency generation in a nonlinear crystal with a flat top beam acting as the pump instead of a Gaussian beam, the up converted image at 525 nm falls in the sensitive band of visible detectors and human eyes. Both theoretical simulations and the experimental results clearly demonstrate that using a flat top beam as a pump can improve the fidelity of an image after the up conversion compared with a Gaussian pump beam. Our scheme will be very promising for infrared image detection based on frequency up conversion.


Coronavirus Covid 19 spreading in Italy optimizing an epidemiological model with dynamic social distancing through Differential Evolution. The aim of this paper consists in the application of a recent epidemiological model, namely SEIR with Social Distancing (SEIR SD), extended here through the definition of a social distancing function varying over time, to assess the situation related to the spreading of the coronavirus Covid 19 in Italy and in two of its most important regions, i.e., Lombardy and Campania. To profitably use this model, the most suitable values of its parameters must be found. The estimation of the SEIR SD model parameters takes place here through the use of Differential Evolution, a heuristic optimization technique. In this way, we are able to evaluate for each of the three above mentioned scenarios the daily number of infectious cases from today until the end of virus spreading, the day(s) in which this number will be at its highest peak, and the day in which the infected cases will become very close to zero.


Are Noisy Sentences Useless for Distant Supervised Relation Extraction?. The noisy labeling problem has been one of the major obstacles for distant supervised relation extraction. Existing approaches usually consider that the noisy sentences are useless and will harm the model's performance. Therefore, they mainly alleviate this problem by reducing the influence of noisy sentences, such as applying bag level selective attention or removing noisy sentences from sentence bags. However, the underlying cause of the noisy labeling problem is not the lack of useful information, but the missing relation labels. Intuitively, if we can allocate credible labels for noisy sentences, they will be transformed into useful training data and benefit the model's performance. Thus, in this paper, we propose a novel method for distant supervised relation extraction, which employs unsupervised deep clustering to generate reliable labels for noisy sentences. Specifically, our model contains three modules a sentence encoder, a noise detector and a label generator. The sentence encoder is used to obtain feature representations. The noise detector detects noisy sentences from sentence bags, and the label generator produces high confidence relation labels for noisy sentences. Extensive experimental results demonstrate that our model outperforms the state of the art baselines on a popular benchmark dataset, and can indeed alleviate the noisy labeling problem.


Remarks on a mean field equation on mathbb S 2 . In this note, we study symmetry of solutions of the elliptic equation begin equation Delta mathbb S 2 u 3 e 2u hbox on mathbb S 2 , end equation that arises in the study of rigidity problem of Hawking mass in general relativity. We provide various conditions under which this equation has only constant solutions, and consequently imply the rigidity of Hawking mass for stable constant mean curvature (CMC) sphere.


Differential Privacy in the 2020 Decennial Census and the Implications for Available Data Products. In early 2021, the US Census Bureau will begin releasing statistical tables based on the decennial census conducted in 2020. Because of significant changes in the data landscape, the Census Bureau is changing its approach to disclosure avoidance. The confidentiality of individuals represented "anonymously" in these statistical tables will be protected by a "formal privacy" technique that allows the Bureau to mathematically assess the risk of revealing information about individuals in the released statistical tables. The Bureau's approach is an implementation of "differential privacy," and it gives a rigorously demonstrated guaranteed level of privacy protection that traditional methods of disclosure avoidance do not. Given the importance of the Census Bureau's statistical tables to democracy, resource allocation, justice, and research, confusion about what differential privacy is and how it might alter or eliminate data products has rippled through the community of its data users, namely demographers, statisticians, and census advocates. The purpose of this primer is to provide context to the Census Bureau's decision to use a technique based on differential privacy and to help data users and other census advocates who are struggling to understand what this mathematical tool is, why it matters, and how it will affect the Bureau's data products.


300 GHz Radar Object Recognition based on Deep Neural Networks and Transfer Learning. For high resolution scene mapping and object recognition, optical technologies such as cameras and LiDAR are the sensors of choice. However, for robust future vehicle autonomy and driver assistance in adverse weather conditions, improvements in automotive radar technology, and the development of algorithms and machine learning for robust mapping and recognition are essential. In this paper, we describe a methodology based on deep neural networks to recognise objects in 300GHz radar images, investigating robustness to changes in range, orientation and different receivers in a laboratory environment. As the training data is limited, we have also investigated the effects of transfer learning. As a necessary first step before road trials, we have also considered detection and classification in multiple object scenes.


A hybrid material point spheropolygon element method for solid and granular material interaction. Capturing the interaction between objects that have an extreme difference in Young s modulus or geometrical scale is a highly challenging topic for numerical simulation. One of the fundamental questions is how to build an accurate multi scale method with optimal computational efficiency. In this work, we develop a material point spheropolygon discrete element method (MPM SDEM). Our approach fully couples the material point method (MPM) and the spheropolygon discrete element method (SDEM) through the exchange of contact force information. It combines the advantage of MPM for accurately simulating elastoplastic continuum materials and the high efficiency of DEM for calculating the Newtonian dynamics of discrete near rigid objects. The MPM SDEM framework is demonstrated with an explicit time integration scheme. Its accuracy and efficiency are further analysed against the analytical and experimental data. Results demonstrate this method could accurately capture the contact force and momentum exchange between materials while maintaining favourable computational stability and efficiency. Our framework exhibits great potential in the analysis of multi scale, multi physics phenomena


Local most probable routes and classic quantum correspondence in strong field two dimensional tunneling ionization. We study ionization of atoms in strong two dimensional (2D) laser fields with various forms, numerically and analytically. We focus on the local most probable tunneling routes (some specific electron trajectories) which are corresponding to the local maxima of photoelectron momentum distributions (PMDs). By making classic quantum correspondence, we obtain a condition for these routes characterized by the electron position at the tunnel exit. With comparing the identified routes with the classical limit and the partial decoupling approximation where it is assumed that tunneling is dominated by the main component of the 2D field, some semiclassical properties of 2D tunneling are addressed. The local maxima of PMD related to the local most probable routes can be used as one of the preferred observables in ultrafast measurements.


"Can you say more about the location?" The Development of a Pedagogical Reference Resolution Agent. In an increasingly globalized world, geographic literacy is crucial. In this paper, we present a collaborative two player game to improve people's ability to locate countries on the world map. We discuss two implementations of the game First, we created a web based version which can be played with the remote controlled agent Nellie. With the knowledge we gained from a large online data collection, we re implemented the game so it can be played face to face with the Furhat robot Neil. Our analysis shows that participants found the game not just engaging to play, they also believe they gained lasting knowledge about the world map.


The Moran forest. Starting from any graph on 1, ldots, n , consider the Markov chain where at each time step a uniformly chosen vertex is disconnected from all of its neighbors and reconnected to another uniformly chosen vertex. This Markov chain has a stationary distribution whose support is the set of non empty forests on 1, ldots, n . The random forest corresponding to this stationary distribution has interesting connections with the uniform rooted labeled tree and the uniform attachment tree. We fully characterize its degree distribution, the distribution of its number of trees, and the limit distribution of the size of a tree sampled uniformly. We also show that the size of the largest tree is asymptotically alpha log n , where alpha (1 log(e 1)) 1 approx 2.18 , and that the degree of the most connected vertex is asymptotically log n log log n .


Does the ratio of Laplace transforms of powers of a function identify the function?. We study the following question if f is a nonzero measurable function on 0, infty) and m and n distinct nonnegative integers, does the ratio widehat f n widehat f m of the Laplace transforms of the powers f n and f m of f uniquely determine f ? The answer is yes if one of m, n is zero, by the inverse Laplace transform. Under some assumptions on the smoothness of f we show that the answer in the general case is also affirmative. The question arose from a problem in economics, specifically in auction theory where f is the cumulative distribution function of a certain random variable. This is also discussed in the paper.


Detecting Opportunities for Differential Maintenance of Extracted Views. Semi structured and unstructured data management is challenging, but many of the problems encountered are analogous to problems already addressed in the relational context. In the area of information extraction, for example, the shift from engineering ad hoc, application specific extraction rules towards using expressive languages such as CPSL and AQL creates opportunities to propose solutions that can be applied to a wide range of extraction programs. In this work, we focus on extracted view maintenance, a problem that is well motivated and thoroughly addressed in the relational setting. In particular, we formalize and address the problem of keeping extracted relations consistent with source documents that can be arbitrarily updated. We formally characterize three classes of document updates, namely those that are irrelevant, autonomously computable, and pseudo irrelevant with respect to a given extractor. Finally, we propose algorithms to detect pseudo irrelevant document updates with respect to extractors that are expressed as document spanners, a model of information extraction inspired by SystemT.


The Next Generation of Human Drone Partnerships Co Designing an Emergency Response System. The use of semi autonomous Unmanned Aerial Vehicles (UAV) to support emergency response scenarios, such as fire surveillance and search and rescue, offers the potential for huge societal benefits. However, designing an effective solution in this complex domain represents a "wicked design" problem, requiring a careful balance between trade offs associated with drone autonomy versus human control, mission functionality versus safety, and the diverse needs of different stakeholders. This paper focuses on designing for situational awareness (SA) using a scenario driven, participatory design process. We developed SA cards describing six common design problems, known as SA demons, and three new demons of importance to our domain. We then used these SA cards to equip domain experts with SA knowledge so that they could more fully engage in the design process. We designed a potentially reusable solution for achieving SA in multi stakeholder, multi UAV, emergency response applications.