A 20 Gbps Beam steered Infrared Wireless Link Enabled by a Passively Field programmable Metasurface. Beam steering is one of the main challenges in energy efficient and high speed infrared light communication. To date, active beam steering schemes based on a spatial light modulator (SLM) or micro electrical mechanical system (MEMS) mirror, as well as the passive ones based on diffractive gratings, have been demonstrated for infrared light communication. Here, for the first time to our knowledge, an infrared beam is steered by 35 deg on one side empowered by a passively field programmable metasurface. By combining the centralized control of wavelength and polarization, a remote passive metasurface can steer the infrared beam in a remote access point. The proposed system keeps scalability to support multiple beams, flexibility to steer the beam, high optical efficiency, simple and cheap devices on remote sides, and centralized control (low maintenance cost), while it avoids disadvantages such as grating loss, a small coverage area, and a bulky size. Based on the proposed beam steering technology, we also demonstrated a proof of concept experiment system with a data rate of 20 Gbps.


A semi small decomposition of the Chow ring of a matroid. We give a semi small orthogonal decomposition of the Chow ring of a matroid M. The decomposition is used to give simple proofs of Poincar 'e duality, the hard Lefschetz theorem, and the Hodge Riemann relations for the Chow ring, recovering the main result of AHK18 . We also show that a similar semi small orthogonal decomposition holds for the augmented Chow ring of M.


Bidirectional electro optic conversion reaching 1 efficiency with thin film lithium niobate. Superconducting cavity electro optics (EO) presents a promising route to coherently convert microwave and optical photons and distribute quantum entanglement between superconducting circuits over long distance through an optical network. High EO conversion efficiency demands transduction materials with strong Pockels effect and excellent optical transparency. Thin film Lithium Niobate (TFLN) offers these desired characteristics however so far has only delivered unidirectional conversion with efficiencies on the order of 10 5 , largely impacted by its prominent photorefractive (PR) effect at cryogenic temperatures. Here we show that, by mitigating the PR effect and associated charge screening effect, the device's conversion efficiency can be enhanced by orders of magnitude while maintaining stable cryogenic operation, thus allowing a demonstration of conversion bidirectionality and accurate quantification of on chip efficiency. With the optimized monolithic integrated superconducting EO device based on TFLN on sapphire substrate, an on chip conversion efficiency of 1.02 (internal efficiency, 15.2 ) is realized. Our demonstration indicates that with further device improvement, it is feasible for TFLN to approach unitary internal conversion efficiency.


Channel Estimation and Passive Beamforming for Intelligent Reflecting Surface Discrete Phase Shift and Progressive Refinement. Prior studies on Intelligent Reflecting Surface (IRS) have mostly assumed perfect channel state information (CSI) available for designing the IRS passive beamforming as well as the continuously adjustable phase shift at each of its reflecting elements, which, however, have simplified two challenging issues for implementing IRS in practice, namely, its channel estimation and passive beamforming designs both under the constraint of discrete phase shifts. To address them, we consider in this paper an IRS aided single user communication system with discrete phase shifts and design the IRS training reflection matrix for channel estimation as well as the passive beamforming for data transmission, both subject to the constraint of discrete phase shifts. We show that the training reflection matrix design for discrete phase shifts greatly differs from that for continuous phase shifts, and thus the corresponding passive beamforming should be optimized by taking into account the correlated channel estimation error due to discrete phase shifts. Specifically, we consider a practical block based transmission, where each block has a finite (insufficient) number of training symbols for channel estimation. A novel hierarchical training reflection design is proposed to progressively estimate IRS elements' channels over multiple blocks by exploiting IRS elements grouping and partition. Based on the resolved IRS channels in each block, we further design the progressive passive beamforming at the IRS with discrete phase shifts to improve the achievable rate for data transmission over the blocks.


IR2Vec LLVM IR based Scalable Program Embeddings. We propose IR2Vec, a Concise and Scalable encoding infrastructure to represent programs as a distributed embedding in continuous space. This distributed embedding is obtained by combining representation learning methods with flow information to capture the syntax as well as the semantics of the input programs. As our infrastructure is based on the Intermediate Representation (IR) of the source code, obtained embeddings are both language and machine independent. The entities of the IR are modeled as relationships, and their representations are learned to form a seed embedding vocabulary. Using this infrastructure, we propose two incremental encodings Symbolic and Flow Aware. Symbolic encodings are obtained from the seed embedding vocabulary, and Flow Aware encodings are obtained by augmenting the Symbolic encodings with the flow information. We show the effectiveness of our methodology on two optimization tasks (Heterogeneous device mapping and Thread coarsening). Our way of representing the programs enables us to use non sequential models resulting in orders of magnitude of faster training time. Both the encodings generated by IR2Vec outperform the existing methods in both the tasks, even while using simple machine learning models. In particular, our results improve or match the state of the art speedup in 11 14 benchmark suites in the device mapping task across two platforms and 53 68 benchmarks in the Thread coarsening task across four different platforms. When compared to the other methods, our embeddings are more scalable, is non data hungry, and has betterOut Of Vocabulary (OOV) characteristics.


Decidability and k Regular Sequences. In this paper we consider a number of natural decision problems involving k regular sequences. Specifically, they arise from lower and upper bounds on growth rate in particular boundedness, images, regularity (recognizability by a deterministic finite automaton) of preimages, and factors, such as squares and palindromes of such sequences. We show that the decision problems are undecidable.


Online Trajectory Generation of a MAV for Chasing a Moving Target in 3D Dense Environments. This work deals with a moving target chasing mission of an aerial vehicle equipped with a vision sensor in a cluttered environment. In contrast to obstacle free or sparse environments, the chaser should be able to handle collision and occlusion simultaneously with flight efficiency. In order to tackle these challenges with real time replanning, we introduce a metric for target visibility and propose a cascaded chasing planner. By means of the graph search methods, we first generate a sequence of chasing corridors and waypoints which ensure safety and optimize visibility. In the following phase, the corridors and waypoints are utilized as constraints and objective in quadratic programming from which we complete a dynamically feasible trajectory for chasing. The proposed algorithm is tested in multiple dense environments. The simulator AutoChaser with full code implementation and GUI can be found in https github.com icsl Jeon traj gen vis


Long length Legal Document Classification. One of the principal tasks of machine learning with major applications is text classification. This paper focuses on the legal domain and, in particular, on the classification of lengthy legal documents. The main challenge that this study addresses is the limitation that current models impose on the length of the input text. In addition, the present paper shows that dividing the text into segments and later combining the resulting embeddings with a BiLSTM architecture to form a single document embedding can improve results. These advancements are achieved by utilising a simpler structure, rather than an increasingly complex one, which is often the case in NLP research. The dataset used in this paper is obtained from an online public database containing lengthy legal documents with highly domain specific vocabulary and thus, the comparison of our results to the ones produced by models implemented on the commonly used datasets would be unjustified. This work provides the foundation for future work in document classification in the legal field.


Quantifying and understanding errors in molecular geometries. Electronic structure calculations are ubiquitous in most branches of chemistry, but all have errors in both energies and equilibrium geometries. Quantifying errors in possibly dozens of bond angles and bond lengths is a Herculean task. A single natural measure of geometric error is introduced, the geometry energy offset (GEO). GEO links many disparate aspects of geometry errors a new ranking of different methods, quantitative insight into errors in specific geometric parameters, and insight into trends with different methods. GEO can also reduce the cost of high level geometry optimizations and shows when geometric errors distort the overall error of a method. Results, including some surprises, are given for both covalent and weak interactions.


Evaluating Mixed Initiative Procedural Level Design Tools using a Triple Blind Mixed Method User Study. Results from a triple blind mixed method user study into the effectiveness of mixed initiative tools for the procedural generation of game levels are presented. A tool which generates levels using interactive evolutionary optimisation was designed for this study which (a) is focused on supporting the designer to explore the design space and (b) only requires the designer to interact with it by designing levels. The tool identifies level design patterns in an initial hand designed map and uses that information to drive an interactive optimisation algorithm. A rigorous user study was designed which compared the experiences of designers using the mixed initiative tool to designers who were given a tool which provided completely random level suggestions. The designers using the mixed initiative tool showed an increased engagement in the level design task, reporting that it was effective in inspiring new ideas and design directions. This provides significant evidence that procedural content generation can be used as a powerful tool to support the human design process.


Dual energy CT imaging using a single energy CT data is feasible via deep learning. In a standard computed tomography (CT) image, pixels having the same Hounsfield Units (HU) can correspond to different materials and it is, therefore, challenging to differentiate and quantify materials. Dual energy CT (DECT) is desirable to differentiate multiple materials, but DECT scanners are not widely available as single energy CT (SECT) scanners. Here we develop a deep learning approach to perform DECT imaging by using standard SECT data. A deep learning model to map low energy image to high energy image using a two stage convolutional neural network (CNN) is developed. The model was evaluated using patients who received contrast enhanced abdomen DECT scan with a popular DE application virtual non contrast (VNC) imaging and contrast quantification. The HU differences between the predicted and original high energy CT images are 3.47, 2.95, 2.38 and 2.40 HU for ROIs on the spine, aorta, liver, and stomach, respectively. The HU differences between VNC images obtained from original DECT and deep learning DECT are 4.10, 3.75, 2.33 and 2.92 HU for the 4 ROIs, respectively. The aorta iodine quantification difference between iodine maps obtained from original DECT and deep learning DECT images is 0.9 , suggesting high consistency between the predicted and the original high energy CT images. This study demonstrates that highly accurate DECT imaging with single low energy data is achievable by using a deep learning approach. The proposed method can significantly simplify the DECT system design, reducing the scanning dose and imaging cost.


Parallel Binary Code Analysis. Binary code analysis is widely used to assess a program's correctness, performance, and provenance. Binary analysis applications often construct control flow graphs, analyze data flow, and use debugging information to understand how machine code relates to source lines, inlined functions, and data types. To date, binary analysis has been single threaded, which is too slow for applications such as performance analysis and software forensics, where it is becoming common to analyze binaries that are gigabytes in size and in large batches that contain thousands of binaries. This paper describes our design and implementation for accelerating the task of constructing control flow graphs (CFGs) from binaries with multithreading. Existing research focuses on addressing challenging code constructs encountered during constructing CFGs, including functions sharing code, jump table analysis, non returning functions, and tail calls. However, existing analyses do not consider the complex interactions between concurrent analysis of shared code, making it difficult to extend existing serial algorithms to be parallel. A systematic methodology to guide the design of parallel algorithms is essential. We abstract the task of constructing CFGs as repeated applications of several core CFG operations regarding to creating functions, basic blocks, and edges. We then derive properties among CFG operations, including operation dependency, commutativity, monotonicity. These operation properties guide our design of a new parallel analysis for constructing CFGs. We achieved as much as 25 times speedup for constructing CFGs on 64 hardware threads. Binary analysis applications are significantly accelerated with the new parallel analysis we achieve 8 times for a performance analysis tool and 7 times for a software forensic tool with 16 hardware threads.


A Survey Study to Understand Industry Vision for Virtual and Augmented Reality Applications in Design and Construction. With advances in Building Information Modeling (BIM), Virtual Reality (VR) and Augmented Reality (AR) technologies have many potential applications in the Architecture, Engineering, and Construction (AEC) industry. However, the AEC industry, relative to other industries, has been slow in adopting AR VR technologies, partly due to lack of feasibility studies examining the actual cost of implementation versus an increase in profit. The main objectives of this paper are to understand the industry trends in adopting AR VR technologies and identifying gaps between AEC research and industry practices. The identified gaps can lead to opportunities for developing new tools and finding new use cases. To achieve these goals, two rounds of a survey at two different time periods (a year apart) were conducted. Responses from 158 industry experts and researchers were analyzed to assess the current state, growth, and saving opportunities for AR VR technologies for the AEC industry. The authors used t test for hypothesis testing. The findings show a significant increase in AR VR utilization in the AEC industry over the past year from 2017 to 2018. The industry experts also anticipate strong growth in the use of AR VR technologies over the next 5 to 10 years.


A zig zag conjecture and local constancy for Galois representations. We make a zig zag conjecture describing the reductions of irreducible crystalline two dimensional representations of G mathbb Q p of half integral slopes and exceptional weights. Such weights are two more than twice the slope mod (p 1) . We show that zig zag holds for half integral slopes at most frac 3 2 . We then explore the connection between zig zag and local constancy results in the weight. First we show that known cases of zig zag force local constancy to fail for small weights. Conversely, we explain how local constancy forces zig zag to fail for some small weights and half integral slopes at least 2 . However, we expect zig zag to be qualitatively true in general. We end with some compatibility results between zig zag and other results.


A species approach to Rota's twelvefold way. An introduction to Joyal's theory of combinatorial species is given and through it an alternative view of Rota's twelvefold way emerges.


Equivalence of the grand canonical ensemble and the canonical ensemble on 1d lattice systems. We consider a one dimensional lattice system of unbounded, real valued spins with arbitrary strong, quadratic, finite range interaction. We show the equivalence of the grand canonical ensemble (gce) and the canonical ensemble (ce), in the sense of observables and correlations. A direct consequence is that the correlations of the ce decay exponentially plus a volume correction term. The volume correction term is uniform in the external field, the mean spin and scales optimally in the system size. This extends prior results of Cancrini Martinelli for bounded discrete spins to unbounded continuous spins. The result is obtained by adapting Cancrini Martinelli's method combined with authors' recent approach on continuous real valued spin systems.


Error estimates for a class of discontinuous Galerkin methods for nonsmooth problems via convex duality relations. We devise and analyze a class of interior penalty discontinuous Galerkin methods for nonlinear and nonsmooth variational problems. Discrete duality relations are derived that lead to optimal error estimates in the case of total variation regularized minimization or obstacle problems. The analysis provides explicit estimates that precisely determine the role of stabilization parameters. Numerical experiments suppport the optimality of the estimates.


Visible emission spectroscopy of highly charged tungsten ions in LHD II. Evaluation of tungsten ion temperature. We demonstrated a polarization resolved high resolution spectroscopy of a visible emission line of highly charged tungsten ions ( lambda 0 668.899 nm, Shinohara et al Phys. Scr. 90 125402) for the large helical device (LHD) plasma, where the tungsten ions were introduced by a pellet injection. Its spectral profile shows broadening and polarization dependence, which are attributed to the Doppler and Zeeman effects, respectively. The tungsten ion temperature was evaluated for the first time from the broadening of visible the emission line, with its emission location determined by the Abel inversion of the chord integrated emission intensities observed with multiple chords. The tungsten ion temperature was found to be close to the helium like argon ion temperature, which is used as an ion temperature monitor in LHD


DPM A Novel Training Method for Physics Informed Neural Networks in Extrapolation. We present a method for learning dynamics of complex physical processes described by time dependent nonlinear partial differential equations (PDEs). Our particular interest lies in extrapolating solutions in time beyond the range of temporal domain used in training. Our choice for a baseline method is physics informed neural network (PINN) Raissi et al., J. Comput. Phys., 378 686 707, 2019 because the method parameterizes not only the solutions but also the equations that describe the dynamics of physical processes. We demonstrate that PINN performs poorly on extrapolation tasks in many benchmark problems. To address this, we propose a novel method for better training PINN and demonstrate that our newly enhanced PINNs can accurately extrapolate solutions in time. Our method shows up to 72 smaller errors than existing methods in terms of the standard L2 norm metric.


Continuous Time Random Walk with correlated waiting times. The crucial role of inter trade times in volatility clustering. In many physical, social or economical phenomena we observe changes of a studied quantity only in discrete, irregularly distributed points in time. The stochastic process used by physicists to describe this kind of variables is the Continuous Time Random Walk (CTRW). Despite the popularity of this type of stochastic processes and strong empirical motivation, models with a long term memory within the sequence of time intervals between observations are missing. Here, we fill this gap by introducing a new family of CTRWs. The memory is introduced to the model by the assumption that many consecutive time intervals can be the same. Surprisingly, in this process we can observe a slowly decaying nonlinear autocorrelation function without a fat tailed distribution of time intervals. Our model applied to high frequency stock market data can successfully describe the slope of decay of nonlinear autocorrelation function of stock market returns. The model achieves this result with no dependence between consecutive price changes. It proves the crucial role of inter event times in the volatility clustering phenomenon observed in all stock markets.


Non contact Real time Eye Gaze Mapping System Based on Deep Convolutional Neural Network. Human Computer Interaction(HCI) is a field that studies interactions between human users and computer systems. With the development of HCI, individuals or groups of people can use various digital technologies to achieve the optimal user experience. Human visual attention and visual intelligence are related to cognitive science, psychology, and marketing informatics, and are used in various applications of HCI. Gaze recognition is closely related to the HCI field because it is meaningful in that it can enhance understanding of basic human behavior. We can obtain reliable visual attention by the Gaze Matching method that finds the area the user is staring at. In the previous methods, the user wears a glasses type device which in the form of glasses equipped with a gaze tracking function and performs gaze tracking within a limited monitor area. Also, the gaze estimation within a limited range is performed while the user's posture is fixed. We overcome the physical limitations of the previous method in this paper and propose a non contact gaze mapping system applicable in real world environments. In addition, we introduce the GIST Gaze Mapping (GGM) dataset, a Gaze mapping dataset created to learn and evaluate gaze mapping.


Linear convergence of dual coordinate descent on non polyhedral convex problems. This paper deals with constrained convex problems, where the objective function is smooth strongly convex and the feasible set is given as the intersection of a large number of closed convex (possibly non polyhedral) sets. In order to deal efficiently with the complicated constraints we consider a dual formulation of this problem. We prove that the corresponding dual function satisfies a quadratic growth property on any sublevel set, provided that the objective function is smooth and strongly convex and the sets verify the Slater's condition. To the best of our knowledge, this work is the first deriving a quadratic growth condition for the dual under these general assumptions. Existing works derive similar quadratic growth conditions under more conservative assumptions, e.g., the sets need to be either polyhedral or compact. Then, for finding the minimum of the dual problem, due to its special composite structure, we propose random (accelerated) coordinate descent algorithms. However, with the existing theory one can prove that such methods converge only sublinearly. Based on our new quadratic growth property derived for the dual, we now show that such methods have faster convergence, that is the dual random (accelerated) coordinate descent algorithms converge linearly. Besides providing a general dual framework for the analysis of randomized coordinate descent schemes, our results resolve an open problem in the literature related to the convergence of Dykstra algorithm on the best feasibility problem for a collection of convex sets. That is, we establish linear convergence rate for the randomized Dykstra algorithm when the convex sets satisfy the Slater's condition and derive also a new accelerated variant for the Dykstra algorithm.


Homogenization of Stokes equations in perforated domains a unified approach. We consider the homogenization of the Stokes equations in a domain perforated with a large number of small holes which are periodically distributed. In 1,2 , Allaire gave a systematic study on this problem. In this paper, we introduce a unified proof for different sizes of holes for the homogenization of the Stokes equations by employing a generalized cell problem inspired by Tartar 17 .


Wakefield excitation by a short laser pulse in ion dielectrics. The process of excitation of Cherenkov electromagnetic radiation by a laser pulse in ion dielectrics is investigated. Nonlinear electric polarization in isotropic ion dielectric medium and, accordingly, polarization charges and currents induced by a ponderomotive force of a laser pulse are determined. Frequency spectra of the excited wakefields in the infrared and microwave frequency ranges are obtained. The spatiotemporal structure of the wakefield in ion dielectric waveguide is obtained and studied. It is shown that the excited field consists of a potential polarization electric field, as well as a set of eigen electromagnetic waves of ion dielectric waveguide.


The level of pairs of polynomials. Given a polynomial f with coefficients in a field of prime characteristic p , it is known that there exists a differential operator that raises 1 f to its p th power. We first discuss a relation between the level' of this differential operator and the notion of stratification' in the case of hyperelliptic curves. Next we extend the notion of level to that of a pair of polynomials. We prove some basic properties and we compute this level in certain special cases. In particular we present examples of polynomials g and f such that there is no differential operator raising g f to its p th power.


Broadband and giant nonreciprocity at the subwavelength scale in magnetoplasmonic materials. We unveil a previously overlooked wave propagation regime in magnetized plasmonic (gyrotropic) materials with comparable plasma and cyclotron frequencies, which enables a giant and broadband (nondispersive) nonreciprocal response. We show that this effect is due to a natural form of dispersion compensation that ultimately originates from the subtle implications of the principle of causality for gyrotropic plasmonic media, which allows the existence of a low loss frequency window with anomalous nonmonotonic dispersion for the extraordinary mode. This is in stark contrast with conventional nongyrotropic passive materials, for which the frequency derivative of the permittivity dispersion function is always positive in low loss regions. These findings pave the way for superior nonreciprocal components in terms of bandwidth of operation and compactness, with orders of magnitude reductions in size. As a relevant example, we consider indium antimonide (InSb) to theoretically demonstrate a deeply subwavelength, broadband, THz isolator operating under moderate magnetic bias and at room temperature.


FaceScape a Large scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Prediction. In this paper, we present a large scale detailed 3D face dataset, FaceScape, and propose a novel algorithm that is able to predict elaborate riggable 3D face models from a single image input. FaceScape dataset provides 18,760 textured 3D faces, captured from 938 subjects and each with 20 specific expressions. The 3D models contain the pore level facial geometry that is also processed to be topologically uniformed. These fine 3D facial models can be represented as a 3D morphable model for rough shapes and displacement maps for detailed geometry. Taking advantage of the large scale and high accuracy dataset, a novel algorithm is further proposed to learn the expression specific dynamic details using a deep neural network. The learned relationship serves as the foundation of our 3D face prediction system from a single image input. Different than the previous methods, our predicted 3D models are riggable with highly detailed geometry under different expressions. The unprecedented dataset and code will be released to public for research purpose.


Exponential convergence to equilibrium for the d dimensional East model. Kinetically constrained models (KCMs) are interacting particle systems on Z d with a continuous time constrained Glauber dynamics, which were introduced by physicists to model the liquid glass transition. One of the most well known KCMs is the one dimensional East model. Its generalization to higher dimension, the d dimensional East model, is much less understood. Prior to this paper, convergence to equilibrium in the d dimensional East model was proven to be at least stretched exponential, by Chleboun, Faggionato and Martinelli in 2015. We show that the d dimensional East model exhibits exponential convergence to equilibrium in all settings for which convergence is possible.


Nearest Neighbor and Contact Distance Distribution for Binomial Point Process on Spherical Surfaces. This letter characterizes the statistics of the contact distance and the nearest neighbor (NN) distance for binomial point processes (BPP) spatially distributed on spherical surfaces. We consider a setup of n concentric spheres, with each sphere S k has a radius r k and N k points that are uniformly distributed on its surface. For that setup, we obtain the cumulative distribution function (CDF) of the distance to the nearest point from two types o observation points (i) the observation point is not a part of the point process and located on a concentric sphere with a radius r e r k forall k , which corresponds to the contact distance distribution, and (ii) the observation point belongs to the point process, which corresponds to the nearest neighbor (NN) distance distribution.


Multi Vehicle Interaction Scenarios Generation with Interpretable Traffic Primitives and Gaussian Process Regression. Generating multi vehicle interaction scenarios can benefit motion planning and decision making of autonomous vehicles when on road data is insufficient. This paper presents an efficient approach to generate varied multi vehicle interaction scenarios that can both adapt to different road geometries and inherit the key interaction patterns in real world driving. Towards this end, the available multi vehicle interaction scenarios are temporally segmented into several interpretable fundamental building blocks, called traffic primitives, via the Bayesian nonparametric learning. Then, the changepoints of traffic primitives are transformed into the desired road to generate collision free interaction trajectories through a sampling based path planning algorithm. The Gaussian process regression is finally introduced to control the variance and smoothness of the generated multi vehicle interaction trajectories. Experiments with simulation results of three typical multi vehicle trajectories at different road conditions are carried out. The experimental results demonstrate that our proposed method can generate a bunch of human like multi vehicle interaction trajectories that can fit different road conditions remaining the key interaction patterns of agents in the provided scenarios, which is import to the development of autonomous vehicles.


Cones from quantum groups to tropical flag varieties. We relate quantum degree cones, parametrizing PBW degenerations of quantized enveloping algebras, to (negative tight monomial) cones introduced by Lusztig in the study of monomials in canonical bases, to K theoretic cones for quiver representations, and to some maximal prime cones in tropical flag varieties.


Quantizing data for distributed learning. We consider machine learning applications that train a model by leveraging data distributed over a trusted network, where communication constraints can create a performance bottleneck. A number of recent approaches propose to overcome this bottleneck through compression of gradient updates. However, as models become larger, so does the size of the gradient updates. In this paper, we propose an alternate approach to learn from distributed data that quantizes data instead of gradients, and can support learning over applications where the size of gradient updates is prohibitive. Our approach leverages the dependency of the computed gradient on data samples, which lie in a much smaller space in order to perform the quantization in the smaller dimension data space. At the cost of an extra gradient computation, the gradient estimate can be refined by conveying the difference between the gradient at the quantized data point and the original gradient using a small number of bits. Lastly, in order to save communication, our approach adds a layer that decides whether to transmit a quantized data sample or not based on its importance for learning. We analyze the convergence of the proposed approach for smooth convex and non convex objective functions and show that we can achieve order optimal convergence rates with communication that mostly depends on the data rather than the model (gradient) dimension. We use our proposed algorithm to train ResNet models on the CIFAR 10 and ImageNet datasets, and show that we can achieve an order of magnitude savings over gradient compression methods. These communication savings come at the cost of increasing computation at the learning agent, and thus our approach is beneficial in scenarios where communication load is the main problem.


Local Grid Rendering Networks for 3D Object Detection in Point Clouds. The performance of 3D object detection models over point clouds highly depends on their capability of modeling local geometric patterns. Conventional point based models exploit local patterns through a symmetric function (e.g. max pooling) or based on graphs, which easily leads to loss of fine grained geometric structures. Regarding capturing spatial patterns, CNNs are powerful but it would be computationally costly to directly apply convolutions on point data after voxelizing the entire point clouds to a dense regular 3D grid. In this work, we aim to improve performance of point based models by enhancing their pattern learning ability through leveraging CNNs while preserving computational efficiency. We propose a novel and principled Local Grid Rendering (LGR) operation to render the small neighborhood of a subset of input points into a low resolution 3D grid independently, which allows small size CNNs to accurately model local patterns and avoids convolutions over a dense grid to save computation cost. With the LGR operation, we introduce a new generic backbone called LGR Net for point cloud feature extraction with simple design and high efficiency. We validate LGR Net for 3D object detection on the challenging ScanNet and SUN RGB D datasets. It advances state of the art results significantly by 5.5 and 4.5 mAP, respectively, with only slight increased computation overhead.


Deep CR MTLR a Multi Modal Approach for Cancer Survival Prediction with Competing Risks. Accurate survival prediction is crucial for development of precision cancer medicine, creating the need for new sources of prognostic information. Recently, there has been significant interest in exploiting routinely collected clinical and medical imaging data to discover new prognostic markers in multiple cancer types. However, most of the previous studies focus on individual data modalities alone and do not make use of recent advances in machine learning for survival prediction. We present Deep CR MTLR a novel machine learning approach for accurate cancer survival prediction from multi modal clinical and imaging data in the presence of competing risks based on neural networks and an extension of the multi task logistic regression framework. We demonstrate improved prognostic performance of the multi modal approach over single modality predictors in a cohort of 2552 head and neck cancer patients, particularly for cancer specific survival, where our approach achieves 2 year AUROC of 0.774 and C index of 0.788.


A Multi Armed Bandit based Approach to Mobile Network Provider Selection. We argue for giving users the ability to lease bandwidth temporarily from any mobile network operator. We propose, prototype, and evaluate a spectrum market for mobile network access, where multiple network operators offer blocks of bandwidth at specified prices for short term leases to users, with autonomous agents on user devices making purchase decisions by trading off price, performance, and budget constraints. We show that the problem of provider selection can be formulated as a so called Bandit problem. For the case where providers change prices synchronously, we approach the problem through contextual multi armed bandits and Reinforcement Learning methods like Q learning either applied directly to the bandit maximization problem or indirectly to approximate the Gittins indices that are known to yield the optimal provider selection policy. For a simulated scenario corresponding to a practical use case, our agent shows a 20 41 QoE improvement over random provider selection under various demand, price and mobility conditions. We implemented a prototype spectrum market using LTE networks and eSIM techology and deployed it on a testbed, using a blockchain to implement the ledger where bandwidth purchase transactions are recorded. Experiments showed that we can learn both user behavior and network performance efficiently, and recorded 25 74 improvements in QoE under various competing agent scenarios.


Investigating Compilation Errors of Students Learning Haskell. While functional programming is an efficient way to express complex software, functional programming languages have a steep learning curve. Haskell can be challenging to learn for students who were only introduced to imperative programming. It is important to look for methods and tools that may reduce the difficulty of learning functional programming. Finding methods to help students requires understanding the errors that students make while learning Haskell. There are several previous studies revealing data about Haskell compiler errors, but they do not focus on the analysis of the compiler errors or they only study a certain kind of compiler errors. This study investigates compilation errors of novice Haskell students and make suggestions on how their learning efficiency can be improved. Unlike previous studies we focus on uncovering the root problems with the student solutions by analysing samples of their submissions.


A Trace Theorem For Sobolev Spaces On The Sierpinski Gasket. We give a discrete characterization of the trace of a class of Sobolev spaces on the Sierpinski gasket to the bottom line. This includes the L2 domain of the Laplacian as a special case. In addition, for Sobolev spaces of low orders, including the domain of the Dirichlet form, the trace spaces are Besov spaces on the line.


MS TCN Multi Stage Temporal Convolutional Network for Action Segmentation. With the success of deep learning in classifying short trimmed videos, more attention has been focused on temporally segmenting and classifying activities in long untrimmed videos. State of the art approaches for action segmentation utilize several layers of temporal convolution and temporal pooling. Despite the capabilities of these approaches in capturing temporal dependencies, their predictions suffer from over segmentation errors. In this paper, we propose a multi stage architecture for the temporal action segmentation task that overcomes the limitations of the previous approaches. The first stage generates an initial prediction that is refined by the next ones. In each stage we stack several layers of dilated temporal convolutions covering a large receptive field with few parameters. While this architecture already performs well, lower layers still suffer from a small receptive field. To address this limitation, we propose a dual dilated layer that combines both large and small receptive fields. We further decouple the design of the first stage from the refining stages to address the different requirements of these stages. Extensive evaluation shows the effectiveness of the proposed model in capturing long range dependencies and recognizing action segments. Our models achieve state of the art results on three datasets 50Salads, Georgia Tech Egocentric Activities (GTEA), and the Breakfast dataset.


On the robustness of bound states in the continuum in waveguides with lateral leakage channels. Bound states in the continuum (BICs) are trapped or guided modes with frequencies in radiation continua. They are associated with high quality factor resonances that give rise to strong local field enhancement and rapid variations in scattering spectra, and have found many valuable applications. A guided mode of an optical waveguide can also be a BIC, if there is a lateral structure supporting compatible waves propagating in the lateral direction, i.e., there is a channel for lateral leakage. A BIC is typically destroyed (becomes a resonant or a leaky mode) if the structure is slightly perturbed, but some BICs are robust with respect to a large family of perturbations. In this paper, we show (analytically and numerically) that a typical BIC in optical waveguides with a left right mirror symmetry and a single lateral leakage channel is robust with respect to any structural perturbation that preserves the left right mirror symmetry. Our study improves the theoretical understanding on BICs and can be useful when applications of BICs in optical waveguides are explored.


High performance silicon graphene hybrid plasmonic waveguide photodetectors beyond 1.55 mu m. A fast silicon graphene hybrid plasmonic waveguide photodetectors beyond 1.55 mu m is proposed and realized by introducing an ultra thin wide silicon on insulator ridge core region with a narrow metal cap. With this novel design, the light absorption in graphene is enhanced while the metal absorption loss is reduced simultaneously, which helps greatly improve the responsivity as well as shorten the absorption region for achieving fast responses. Furthermore, metal graphene metal sandwiched electrodes are introduced to reduce the metal graphene contact resistance, which is also helpful for improving the response speed. When the photodetector operates at 2 mu m, the measured 3dB bandwidth is 20 GHz (which is limited by the experimental setup) while the 3dB bandwith calculated from the equivalent circuit with the parameters extracted from the measured S11 is as high as 100 GHz. To the best of our knowledge, it is the first time to report the waveguide photodetector at 2 mu m with a 3dB bandwidth over 20 GHz. Besides, the present photodetectors also work very well at 1.55 mu m. The measured responsivity is about 0.4 A W under a bias voltage of 0.3 V for an optical power of 0.16 mW, while the measured 3dB bandwidth is over 40 GHz (limited by the test setup) and the 3 dB bandwidth estimated from the equivalent circuit is also as high as 100 GHz, which is one of the best results reported for silicon graphene photodetectors at 1.55 mu m.


The Application of Tridiagonal Matrices in P polynomial Table Algebras. In this paper, we study the characters of two classes of P polynomial table algebras using tridiagonal matrices. To this end, we obtain some results about the eigen structure of special tridiagonal matrices. We also find a recursive relation for the characteristic polynomial of the first intersection matrix of P polynomial table algebras by means of LU factorization.


Computationally Efficient Solutions for Large Scale Security Constrained Optimal Power Flow. In this paper, we discuss our approach and algorithmic framework for solving large scale security constrained optimal power flow (SCOPF) problems. SCOPF is a mixed integer non convex optimization problem that aims to obtain the minimum dispatch cost while maintaining the system N 1 secure. Finding a feasible solution for this problem over large networks is challenging and this paper presents contingency selection, approximation methods, and decomposition techniques to address this challenge in a short period of time. The performance of the proposed methods are verified through large scale synthetic and actual power networks in the Grid Optimization (GO) competition organized by the U.S. Advanced Research Projects Agency Energy (ARPA E). As many prior works focus on small scale systems and are not benchmarked using validated, publicly available datasets, we aim to present a practical solution to SCOPF that has been proven to achieve good performance on realistically sized (30,000 buses) networks.


On the distribution of reducible polynomials. Let Y n(t) denote the set of all polynomials over the ring Z which are reducible over the field Q and of degree n 1 and of height not greater than t. We show that the true order of magnitude of Y n(t) equals t 2 log t in the special case n 2 and it equals t n for each n 2. We also determine the true order of magnitude of the size of certain interesting subsets of Y n(t).


Cut cotorsion pairs. We present the concept of cotorsion pairs cut along subcategories of an abelian category. This provides a generalization of complete cotorsion pairs, and represents a general framework to find approximations restricted to certain subcategories. We also exhibit some connections between cut cotorsion pairs and Auslander Buchweitz approximation theory, by considering relative analogs for Frobenius pairs and Auslander Buchweitz contexts. Several applications are given in the settings of relative Gorenstein homological algebra, chain complexes and quasi coherent sheaves, but also to characterize some important results on the Finitistic Dimension Conjecture, the existence of right adjoints of quotient functors by Serre subcategories, and the description of cotorsion pairs in triangulated categories as co t structures.


Caramel Accelerating Decentralized Distributed Deep Learning with Computation Scheduling. The method of choice for parameter aggregation in Deep Neural Network (DNN) training, a network intensive task, is shifting from the Parameter Server model to decentralized aggregation schemes (AllReduce) inspired by theoretical guarantees of better performance. However, current implementations of AllReduce overlook the interdependence of communication and computation, resulting in significant performance degradation. In this paper, we develop Caramel, a system that accelerates decentralized distributed deep learning through model aware computation scheduling and communication optimizations for AllReduce. Caramel achieves this goal through (a) computation DAG scheduling that expands the feasible window of transfer for each parameter (transfer boundaries), and (b) network optimizations for smoothening of the load including adaptive batching and pipelining of parameter transfers. Caramel maintains the correctness of the dataflow model, is hardware independent, and does not require any user level or framework level changes. We implement Caramel over TensorFlow and show that the iteration time of DNN training can be improved by up to 3.62x in a cloud environment.


Axial Magnetic Field Effect on Vacuum Arc Thruster Performance. The performance gain of co axial vacuum arc thruster in external axial magnetic field is analyzed by power and direct thrust measurements. Thruster geometry is actively controlled and inspected using laser profilometry. Peak performance is shown to be obtained in magnetic induction of 0.1 0.2 T, with measured thrust of 21 uN at arc power of 2.7 W, and thruster efficiency of 4 . The performance gain is attributed to ion beam focusing, increased erosion rate, and ion acceleration due to the axial magnetic field.


Arakelov Nevanlinna inequalities for variations of Hodge structures and applications. We prove a Second Main Theorem type inequality for any log smooth projective pair (X,D) such that X setminus D supports a complex polarized variation of Hodge structures. This can be viewed as a Nevanlinna theoretic analogue of the Arakelov inequalities for variations of Hodge structures due to Deligne, Peters and Jost Zuo. As an application, we obtain in this context a criterion of hyperbolicity that we use to derive a vast generalization of a well known hyperbolicity result of Nadel. The first ingredient of our proof is a Second Main Theorem type inequality for any log smooth projective pair (X,D) such that X setminus D supports a metric whose holomorphic sectional curvature is bounded from above by a negative constant. The second ingredient of our proof is an explicit bound on the holomorphic sectional curvature of the Griffiths Schmid metric constructed from a variation of Hodge structures. As a byproduct of our approach, we also establish a Second Main Theorem type inequality for pairs (X,D) such that X setminus D is hyperbolically embedded in X .


Constructing alternating 2 cocycles on Fourier algebras. Building on recent progress in constructing derivations on Fourier algebras, we provide the first examples of locally compact groups whose Fourier algebras support non zero, alternating 2 cocycles this is the first step in a larger project. Although such 2 cocycles can never be completely bounded, the operator space structure on the Fourier algebra plays a crucial role in our construction, as does the opposite operator space structure. Our construction has two main technical ingredients we observe that certain estimates from H. H. Lee, J. Ludwig, E. Samei, N. Spronk, Weak amenability of Fourier algebras and local synthesis of the anti diagonal, Adv. Math., 292 (2016) arXiv 1502.05214 yield derivations that are "co completely bounded" as maps from various Fourier algebras to their duals and we establish a twisted inclusion result for certain operator space tensor products, which may be of independent interest.


Some combinatorial matrices and their LU decomposition. Three combinatorial matrices are considered and their LU decompositions were found. This is typically done by (creative) guessing, and necessary proofs are more or less routine calculations.


Deep Learning for Face Recognition Pride or Prejudiced?. Do very high accuracies of deep networks suggest pride of effective AI or are deep networks prejudiced? Do they suffer from in group biases (own race bias and own age bias), and mimic the human behavior? Is in group specific information being encoded sub consciously by the deep networks? This research attempts to answer these questions and presents an in depth analysis of bias' in deep learning based face recognition systems. This is the first work which decodes if and where bias is encoded for face recognition. Taking cues from cognitive studies, we inspect if deep networks are also affected by social in and out group effect. Networks are analyzed for own race and own age bias, both of which have been well established in human beings. The sub conscious behavior of face recognition models is examined to understand if they encode race or age specific features for face recognition. Analysis is performed based on 36 experiments conducted on multiple datasets. Four deep learning networks either trained from scratch or pre trained on over 10M images are used. Variations across class activation maps and feature visualizations provide novel insights into the functioning of deep learning systems, suggesting behavior similar to humans. It is our belief that a better understanding of state of the art deep learning networks would enable researchers to address the given challenge of bias in AI, and develop fairer systems.


New bounds on the size of Nearly Perfect Matchings in almost regular hypergraphs. Let H be a k uniform D regular simple hypergraph on N vertices. Based on an analysis of the R "odl nibble, Alon, Kim and Spencer (1997) proved that if k ge 3 , then H contains a matching covering all but at most ND 1 (k 1) o(1) vertices, and asked whether this bound is tight. In this paper we improve their bound by showing that for all k 3 , H contains a matching covering all but at most ND 1 (k 1) eta vertices for some eta Theta(k 3 ) 0 , when N and D are sufficiently large. Our approach consists of showing that the R "odl nibble process not only constructs a large matching but it also produces many well distributed augmenting stars' which can then be used to significantly improve the matching constructed by the R "odl nibble process. Based on this, we also improve the results of Kostochka and R "odl (1998) and Vu (2000) on the size of matchings in almost regular hypergraphs with small codegree. As a consequence, we improve the best known bounds on the size of large matchings in combinatorial designs with general parameters. Finally, we improve the bounds of Molloy and Reed (2000) on the chromatic index of hypergraphs with small codegree (which can be applied to improve the best known bounds on the chromatic index of Steiner triple systems and more general designs).


Screenplay Summarization Using Latent Narrative Structure. Most general purpose extractive summarization models are trained on news articles, which are short and present all important information upfront. As a result, such models are biased on position and often perform a smart selection of sentences from the beginning of the document. When summarizing long narratives, which have complex structure and present information piecemeal, simple position heuristics are not sufficient. In this paper, we propose to explicitly incorporate the underlying structure of narratives into general unsupervised and supervised extractive summarization models. We formalize narrative structure in terms of key narrative events (turning points) and treat it as latent in order to summarize screenplays (i.e., extract an optimal sequence of scenes). Experimental results on the CSI corpus of TV screenplays, which we augment with scene level summarization labels, show that latent turning points correlate with important aspects of a CSI episode and improve summarization performance over general extractive algorithms leading to more complete and diverse summaries.


Inverse Multiobjective Optimization Through Online Learning. We study the problem of learning the objective functions or constraints of a multiobjective decision making model, based on a set of sequentially arrived decisions. In particular, these decisions might not be exact and possibly carry measurement noise or are generated with the bounded rationality of decision makers. In this paper, we propose a general online learning framework to deal with this learning problem using inverse multiobjective optimization. More precisely, we develop two online learning algorithms with implicit update rules which can handle noisy data. Numerical results show that both algorithms can learn the parameters with great accuracy and are robust to noise.


Efficient Least Residual Greedy Algorithms for Sparse Recovery. We present a novel stagewise strategy for improving greedy algorithms for sparse recovery. We demonstrate its efficiency both for synthesis and analysis sparse priors, where in both cases we demonstrate its computational efficiency and competitive reconstruction accuracy. In the synthesis case, we also provide theoretical guarantees for the signal recovery that are on par with the existing perfect reconstruction bounds for the relaxation based solvers and other sophisticated greedy algorithms.


Strong arithmetic property of certain Stern polynomials. Let B n (t) be the n th Stern polynomial, i.e., the n th term of the sequence defined recursively as B 0 (t) 0, B 1 (t) 1 and B 2n (t) tB n (t), B 2n 1 (t) B n (t) B n 1 (t) for n in N . It is well know that i th coefficient in the polynomial B n (t) counts the number of hyperbinary representations of n 1 containing exactly i digits 1. In this note we investigate the existence of odd solutions of the congruence begin equation B n (t) equiv 1 rt frac t e(n) 1 t 1 pmod m , end equation where m in N geq 2 and r in 0, ldots,m 1 are fixed and e(n) op deg B n (t) . We prove that for m 2 and r in 0,1 and for m 3 and r 0 , there are infinitely many odd numbers n satisfying the above congruence. We also present results of some numerical computations.


On biamenability of Banach algebras. In this paper, we introduce the concept of biamenability of Banach algebras and we show that despite the apparent similarities between amenability and biamenability of Banach algebras, they lead to very different, and somewhat opposed, theories. In this regard, we show that commutative Banach algebras such as R and C tend to lack biamenability, while they may be amenable and highly noncommutative Banach algebras such as B(H) for an infinite dimensional Hilbert space H tend to be biamenable, while they are not amenable. Also, we show that although the unconditional unitization of an amenable Banach algebra is amenable but in general unconditional unitization of a Banach algebra is not biamenable. This concept is used for finding the character space of some Banach algebras.


Bias Disparity in Collaborative Recommendation Algorithmic Evaluation and Comparison. Research on fairness in machine learning has been recently extended to recommender systems. One of the factors that may impact fairness is bias disparity, the degree to which a group's preferences on various item categories fail to be reflected in the recommendations they receive. In some cases biases in the original data may be amplified or reversed by the underlying recommendation algorithm. In this paper, we explore how different recommendation algorithms reflect the tradeoff between ranking quality and bias disparity. Our experiments include neighborhood based, model based, and trust aware recommendation algorithms.


Free utility model for explaining the social gravity law. Social gravity law widely exists in human travel, population migration, commodity trade, information communication, scientific collaboration and so on. Why is there such a simple law in many complex social systems is an interesting question. Although scientists from fields of statistical physics, complex systems, economics and transportation science have explained the social gravity law, a theoretical explanation including two dominant mechanisms, namely individual interaction and bounded rationality, is still lacking. Here we present a free utility model, whose objective function is mathematically consistent with the Helmholtz free energy in physics, from the perspective of individual choice behavior to explain the social gravity law. The basic assumption is that bounded rational individuals interacting with each other will trade off the expected utility and information processing cost to maximize their own utility. The previous explanations of the social gravity law including the maximum entropy model, the free cost model, the Logit model and the destination choice game model are all special cases under our model. Further, we extend the free utility model to the network. This model not only helps us to better understand the underlying mechanisms of spatial interaction patterns in complex social systems, but also provides a new perspective for understanding the potential function in game theory and the user equilibrium model in transportation science.


Decomposition of complete tripartite graphs into 5 cycles using the graph adjacency matrix. The problem of decomposing a complete tripartite graph into 5 cycles was first proposed in 1995 by Mahmoodian and Mirzakhani and since then many attempts have been made to decompose such graphs into 5 cycles. Such attempts were partially successful but parts of the problem still remain open. In this paper, we investigate the problem deeper, decompose more tripartite graphs into 5 cycles, and introduce the Graph Adjacency Matrix (GAM) method for cycle decomposition in general. GAM method transforms the cycle decomposition problem to covering squares with certain polygons. This new formulation is easier to solve and enables us to find explicit decompositions for numerous cases that were not decomposed before.


An upper bound for the size of s distance sets in real algebraic sets. In a recent paper Petrov and Pohoata developed a new algebraic method which combines the Croot Lev Pach Lemma from additive combinatorics and Sylvester's Law of Inertia for real quadratic forms. As an application, they gave a simple proof of the Bannai Bannai Stanton bound on the size of s distance sets (subsets mbox cal A subseteq mathbb R n which determine at most s different distances). In this paper we extend their work and prove upper bounds for the size of s distance sets in various real algebraic sets. This way we obtain a novel and short proof for the bound of Delsarte Goethals Seidel on spherical s distance sets and a generalization of a bound by Bannai Kawasaki Nitamizu Sato on s distance sets on unions of spheres. In our arguments we use the method of Petrov and Pohoata together with some Gr "obner basis techniques.


Dual Length Scale Effects in Dielectric Response of Electron Gas. In current research we investigate the dual tone dielectric response of bulk plasmon excitations in a finite temperature electron gas with arbitrary degree of degeneracy and screening effect, using the linear response theory. The dielectric function of electron gas excitations is numerically evaluated within the framework of random phase approximation (RPA) model originally established the Lindhard. The energy loss function, dynamic structure factor and various other physical properties of electron gas response to external linear external perturbations are investigate and compared to the previous findings. The dynamic structure factor reveals some characteristic features such as dul tone scattering and Fano like double resonance effect which are not present in the standard dielectric response theories. The later is found to be due to elaboration of new energy dispersion relation used in current model which accounts for both wave and particle like excitations in the electron gas. While in the standard response theory the electron field interactions are accounted by including a constant effective mass, in this model the effective mass has a momentum dependent character. It is shown that critical values of plasmon wavenumber and frequency play fundamental roles in different aspects of the dielectric response of a free electron gas. It is believed that current approach provides more detailed information on the nature of electromagnetic wave interactions with electron gas.


Automatic clustering of Celtic coins based on 3D point cloud pattern analysis. The recognition and clustering of coins which have been struck by the same die is of interest for archeological studies. Nowadays, this work can only be performed by experts and is very tedious. In this paper, we propose a method to automatically cluster dies, based on 3D scans of coins. It is based on three steps registration, comparison and graph based clustering. Experimental results on 90 coins coming from a Celtic treasury from the II Ith century BC show a clustering quality equivalent to expert's work.


TextDecepter Hard Label Black Box Attack on Text Classifiers. Machine learning has been proven to be susceptible to carefully crafted samples, known as adversarial examples. The generation of these adversarial examples helps to make the models more robust and gives us an insight into the underlying decision making of these models. Over the years, researchers have successfully attacked image classifiers in both, white and black box settings. However, these methods are not directly applicable to texts as text data is discrete. In recent years, research on crafting adversarial examples against textual applications has been on the rise. In this paper, we present a novel approach for hard label black box attacks against Natural Language Processing (NLP) classifiers, where no model information is disclosed, and an attacker can only query the model to get a final decision of the classifier, without confidence scores of the classes involved. Such an attack scenario applies to real world black box models being used for security sensitive applications such as sentiment analysis and toxic content detection.


A Sensorized Multicurved Robot Finger with Data driven Touch Sensing via Overlapping Light Signals. Despite significant advances in touch and force transduction, tactile sensing is still far from ubiquitous in robotic manipulation. Existing methods for building touch sensors have proven difficult to integrate into robot fingers due to multiple challenges, including difficulty in covering multicurved surfaces, high wire count, or packaging constrains preventing their use in dexterous hands. In this paper, we present a multicurved robotic finger with accurate touch localization and normal force detection over complex, three dimensional surfaces. The key to our approach is the novel use of overlapping signals from light emitters and receivers embedded in a transparent waveguide layer that covers the functional areas of the finger. By measuring light transport between every emitter and receiver, we show that we can obtain a very rich signal set that changes in response to deformation of the finger due to touch. We then show that purely data driven deep learning methods are able to extract useful information from such data, such as contact location and applied normal force, without the need for analytical models. The final result is a fully integrated, sensorized robot finger, with a low wire count and using easily accessible manufacturing methods, designed for easy integration into dexterous manipulators.


mathrm GL 2 times mathrm GSp 2 L values and Hecke eigenvalue congruences. We find experimental examples of congruences of Hecke eigenvalues between automorphic representations of groups such as mathrm GSp 2( mathbb A ) , mathrm SO (4,3)( mathbb mathbb A ) and mathrm SO (5,4)( mathbb A ) , where the prime modulus should, for various reasons, appear in the algebraic part of a critical "tensor product" L value associated to cuspidal automorphic representations of mathrm GL 2( mathbb A ) and mathrm GSp 2( mathbb A ) . Using special techniques for evaluating L functions with few known coefficients, we compute sufficiently good approximations to detect the anticipated prime divisors.


Meta Approach to Data Augmentation Optimization. Data augmentation policies drastically improve the performance of image recognition tasks, especially when the policies are optimized for the target data and tasks. In this paper, we propose to optimize image recognition models and data augmentation policies simultaneously to improve the performance using gradient descent. Unlike prior methods, our approach avoids using proxy tasks or reducing search space, and can directly improve the validation performance. Our method achieves efficient and scalable training by approximating the gradient of policies by implicit gradient with Neumann series approximation. We demonstrate that our approach can improve the performance of various image classification tasks, including ImageNet classification and fine grained recognition, without using dataset specific hyperparameter tuning.


Advancing quantitative understanding of self potential signatures in the critical zone through long term monitoring. The self potential (SP) method is a passive geophysical technique, which may offer insights about water and ionic fluxes in the vadose zone. The main obstacles presently prohibiting its routine use in quantitative vadose zone hydrology are the superposition of signals arising from various source mechanisms, difficult to predict electrode polarization effects that depend on electrode design and age, as well as water saturation, pore water chemistry, clay content, and temperature in the immediate vicinity of the electrodes. We present a unique long term SP monitoring experiment focusing on the first four years of data acquired at different depths in the vadose zone within the HOBE hydrological observatory in Denmark. Using state of the art SP theory combined with flow and transport simulations, we attempt to replicate the observed data and suggest reasons for observed discrepancies. The predictions are overall satisfactory during the first six months of monitoring after which both the patterns and magnitudes of the observed data change drastically. Our main observations are (1) that predicted SP magnitudes are strongly sensitive to how the effective excess charge scales with water saturation implying that continued research is needed to build more accurate models of electrokinetic phenomena in unsaturated conditions, (2) that significant changes in electrode polarization occur in the shallowest electrodes at time scales of a year, suggesting that electrode effects cannot be ignored and that explicit electrode modeling should be considered in future monitoring studies, and (3) that multi rate mass transfer and reactive transport modeling are needed to better predict salinity and pore water conductivity. We hope to stimulate other researchers to test new SP modeling approaches and interpretation strategies against these data by making the SP and complimentary data time series available.


Learning Koopman Representations for Hybrid Systems. The Koopman operator lifts nonlinear dynamical systems into a functional space of observables, where the dynamics are linear. In this paper, we provide three different Koopman representations for hybrid systems. The first is specific to switched systems, and the second and third preserve the original hybrid dynamics while eliminating the discrete state variables the second approach is straightforward, and we provide conditions under which the transformation associated with the third holds. Eliminating discrete state variables provides computational benefits when using data driven methods to learn the Koopman operator and its observables. Following this, we use deep learning to implement each representation on two test cases, discuss the challenges associated with those implementations, and propose areas of future work.


Some New Lower Bounds for the Estrada Index. Let G be a graph on n vertices and lambda 1, lambda 2, ldots, lambda n its eigenvalues. The Estrada index of G is an invariant that is calculated from the eigenvalues of the adjacency matrix of a graph. In this paper, we present some new lower bounds obtained for the Estrada Index of graphs and in particular of bipartite graphs that only depend on the number of vertices, the number of edges, Randi 'c index, maximum and minimum degree and diameter.


q-bio.BM physics.bio-ph physics.data-an q-bio.QM

Machine learning a model for RNA structure prediction. RNA function crucially depends on its structure. Thermodynamic models currently used for secondary structure prediction rely on computing the partition function of folding ensembles, and can thus estimate minimum free energy structures and ensemble populations. These models sometimes fail in identifying native structures unless complemented by auxiliary experimental data. Here, we build a set of models that combine thermodynamic parameters, chemical probing data (DMS, SHAPE), and co evolutionary data (Direct Coupling Analysis, DCA) through a network that outputs perturbations to the ensemble free energy. Perturbations are trained to increase the ensemble populations of a representative set of known native RNA structures. In the chemical probing nodes of the network, a convolutional window combines neighboring reactivities, enlightening their structural information content and the contribution of local conformational ensembles. Regularization is used to limit overfitting and improve transferability. The most transferable model is selected through a cross validation strategy that estimates the performance of models on systems on which they are not trained. With the selected model we obtain increased ensemble populations for native structures and more accurate predictions in an independent validation set. The flexibility of the approach allows the model to be easily retrained and adapted to incorporate arbitrary experimental information.


Enumerating number fields. We construct small models of number fields and deduce a better bound for the number of number fields of given degree and bounded discriminant.


Anisotropic relaxation in NADH excited states studied by polarization modulation pump probe transient spectroscopy. We present the results of experimental and theoretical studies of fast anisotropic relaxation and rotational diffusion in the first electron excited state of biological coenzyme NADH in water ethanol solutions. The experiments have been carried out by means of a novel polarization modulation transient method and fluorescence polarization spectroscopy. For interpretation of the experimental results a model of the anisotropic relaxation in terms of scalar and vector properties of transition dipole moments and based on the Born Oppenheimer approximation has been developed. The results obtained suggest that the dynamics of anisotropic rovibronic relaxation in NADH under excitation with 100 fs pump laser pulses can be characterised by a single vibration relaxation time tau v laying in the range 2 15 ps and a single rotation diffusion time tau r laying in the range 100 450 ps a subject of ethanol concentration. The dependence of the times tau v and tau r on the solution polarity (static permittivity) and viscosity has been determined and analyzed. Limiting values of an important parameter langle P 2( cos theta(t)) rangle describing the rotation of the transition dipole moment in the course of vibrational relaxation has been determined from experiment as function of the ethanol concentration and analyzed.


Globally regular varieties and the minimal model program for threefolds in mixed characteristic. We establish the Minimal Model Program for arithmetic threefolds whose residue characteristics are greater than five. In doing this, we generalize the theory of global F regularity to mixed characteristic and identify certain stable sections of adjoint line bundles. Finally, by passing to graded rings, we generalize a special case of Fujita's conjecture to mixed characteristic.


Information Leakage in Encrypted Deduplication via Frequency Analysis Attacks and Defenses. Encrypted deduplication combines encryption and deduplication to simultaneously achieve both data security and storage efficiency. State of the art encrypted deduplication systems mainly build on deterministic encryption to preserve deduplication effectiveness. However, such deterministic encryption reveals the underlying frequency distribution of the original plaintext chunks. This allows an adversary to launch frequency analysis against the ciphertext chunks and infer the content of the original plaintext chunks. In this paper, we study how frequency analysis affects information leakage in encrypted deduplication storage, from both attack and defense perspectives. Specifically, we target backup workloads, and propose a new inference attack that exploits chunk locality to increase the coverage of inferred chunks. We further combine the new inference attack with the knowledge of chunk sizes and show its attack effectiveness against variable size chunks. We conduct trace driven evaluation on both real world and synthetic datasets and show that our proposed attacks infer a significant fraction of plaintext chunks under backup workloads. To defend against frequency analysis, we present two defense approaches, namely MinHash encryption and scrambling. Our trace driven evaluation shows that our combined MinHash encryption and scrambling scheme effectively mitigates the severity of the inference attacks, while maintaining high storage efficiency and incurring limited metadata access overhead.


Families of Multidimensional Arrays with Good Autocorrelation and Asymptotically Optimal Cross correlation. We introduce a construction for families of 2n dimensional arrays with asymptotically optimal pairwise cross correlation. These arrays are constructed using a circulant array of n dimensional Legendre arrays. We also introduce an application of these higher dimensional arrays to high capacity digital watermarking of images and video.


Three Dimensional Route Planning for Multiple Unmanned Aerial Vehicles using Salp Swarm Algorithm. Route planning for multiple Unmanned Aerial Vehicles (UAVs) is a series of translation and rotational steps from a given start location to the destination goal location. The goal of the route planning problem is to determine the most optimal route avoiding any collisions with the obstacles present in the environment. Route planning is an NP hard optimization problem. In this paper, a newly proposed Salp Swarm Algorithm (SSA) is used, and its performance is compared with deterministic and other Nature Inspired Algorithms (NIAs). The results illustrate that SSA outperforms all the other meta heuristic algorithms in route planning for multiple UAVs in a 3D environment. The proposed approach improves the average cost and overall time by 1.25 and 6.035 respectively when compared to recently reported data. Route planning is involved in many real life applications like robot navigation, self driving car, autonomous UAV for search and rescue operations in dangerous ground zero situations, civilian surveillance, military combat and even commercial services like package delivery by drones.


Fekete Szego Inequality For Analytic And Bi univalent Functions Subordinate To (p q) Lucas Polynomials. In the present paper, a subclass of analytic and bi univalent functions by means of (p q) Lucas polynomials is introduced. Certain coefficients bounds for functions belonging to this subclass are obtained. Furthermore, the Fekete Szeg o problem for this subclass is solved.


Mechanism Singularities Revisited from an Algebraic Viewpoint. It has become obvious that certain singular phenomena cannot be explained by a mere investigation of the configuration space, defined as the solution set of the loop closure equations. For example, it was observed that a particular 6R linkage, constructed by a combination of two Goldberg 5R linkages, exhibits kinematic singularities at a smooth point in its configuration space. Such problems are addressed in this paper. To this end, an algebraic framework is used in which the constraints are formulated as polynomial equations using Study parameters. The algebraic object of study is the ideal generated by the constraint equations (the constraint ideal). Using basic tools from commutative algebra and algebraic geometry (primary decomposition, Hilbert's Nullstellensatz), the special phenomenon is related to the fact that the constraint ideal is not a radical ideal. With a primary decomposition of the constraint ideal, the associated prime ideal of one primary ideal contains strictly into the associated prime ideal of another primary ideal which also gives the smooth configuration curve. This analysis is extended to shaky and kinematotropic linkages, for which examples are presented.


On residually finite groups satisfying an Engel type identity. Let n, q be positive integers. We show that if G is a finitely generated residually finite group satisfying the identity x, ny q equiv 1, then there exists a function f(n) such that G has a nilpotent subgroup of finite index of class at most f(n) . We also extend this result to locally graded groups.


A practical review on the measurement tools for cellular adhesion force. Cell cell and cell matrix adhesions are fundamental in all multicellular organisms. They play a key role in cellular growth, differentiation, pattern formation and migration. Cell cell adhesion is substantial in the immune response, pathogen host interactions, and tumor development. The success of tissue engineering and stem cell implantations strongly depends on the fine control of live cell adhesion on the surface of natural or biomimetic scaffolds. Therefore, the quantitative and precise measurement of the adhesion strength of living cells is critical, not only in basic research but in modern technologies, too. Several techniques have been developed or are under development to quantify cell adhesion. All of them have their pros and cons, which has to be carefully considered before the experiments and interpretation of the recorded data. Current review provides a guide to choose the appropriate technique to answer a specific biological question or to complete a biomedical test by measuring cell adhesion.


Regions of Interest Segmentation from LiDAR Point Cloud for Multirotor Aerial Vehicles. We propose a novel filter for segmenting the regions of interest from LiDAR 3D point cloud for multirotor aerial vehicles. It is specially targeted for real time applications and works on sparse LiDAR point clouds without preliminary mapping. We use this filter as a crucial component of fast obstacle avoidance system for agriculture drone operating at low altitude. As the first step, each point cloud is transformed into a depth image and then identify places near to the vehicle (local maxima) by locating areas with high pixel densities. Afterwards, we merge the original depth image with identified locations after maximizing intensities of pixels in which local maxima were obtained. Next step is to calculate the range angle image that represents angles between two consecutive laser beams based on the improved depth image. Once the corresponding range angle image is constructed, smoothing is applied to reduce the noise. Finally, we find out connected components within the improved depth image while incorporating smoothed range angle image. This allows separating the regions of interest. The filter has been tested on various simulated environments as well as an actual drone and provides real time performance. We make our source code, dataset available at https github.com GPrathap hagen.git and real world experiment result can be found on the following link https www.youtube.com watch?v iHd ZkhKPjc available online.


Thirty seven years of relational Hoare logic remarks on its principles and history. Relational Hoare logics extend the applicability of modular, deductive verification to encompass important 2 run properties including dependency requirements such as confidentiality and program relations such as equivalence or similarity between program versions. A considerable number of recent works introduce different relational Hoare logics without yet converging on a core set of proof rules. This paper looks backwards to little known early work. This brings to light some principles that clarify and organize the rules as well as suggesting a new rule and a new notion of completeness.


The Marathon 2 A Navigation System. Developments in mobile robot navigation have enabled robots to operate in warehouses, retail stores, and on sidewalks around pedestrians. Various navigation solutions have been proposed, though few as widely adopted as ROS Navigation. 10 years on, it is still one of the most popular navigation solutions. Yet, ROS Navigation has failed to keep up with modern trends. We propose the new navigation solution, Navigation2, which builds on the successful legacy of ROS Navigation. Navigation2 uses a behavior tree for navigator task orchestration and employs new methods designed for dynamic environments applicable to a wider variety of modern sensors. It is built on top of ROS2, a secure message passing framework suitable for safety critical applications and program lifecycle management. We present experiments in a campus setting utilizing Navigation2 to operate safely alongside students over a marathon as an extension of the experiment proposed in Eppstein et al. The Navigation2 system is freely available at https github.com ros planning navigation2 with a rich community and instructions.


Pairwise based Multi Attribute Decision Making Approach for Wireless Network. In the wireless network applications, such as routing decision, network selection, etc., the Multi Attribute Decision Making (MADM) has been widely used. The MADM approach can address the multi objective decision making issues effectively.However, when the parameters vary greatly, the traditionalMADM algorithm is not effective anymore. To solve this problem,in this paper, we propose the pairwise based MADM algorithm.In the PMADM, only two nodes utilities are calculated and compared each time. The PMADM algorithm is much more accurate than the traditional MADM algorithm. Moreover, we also prove that our PMADM algorithm is sensitive to the parameters which vary seriously and in sensitive to the parameters which change slightly. This property is better than that of the traditional MADM algorithm. Additionally, the PMADM algorithm is more stable than the traditional MADM algorithm. For reducing the computational complexity of the PMADM algorithm, we propose the low complexity PMADM algorithm. For analyzing the computational complexity of the lPMADM algorithm, we propose the tree based decomposing algorithm in this paper. The lPMADM algorithm has the same properties and performances as that of the PMADM algorithm however, it is simpler than the PMADM algorithm. The simulation results show that the PMADM and lPMADM algorithms are much more effective than the traditional MADM algorithm.


Towards Safety Aware Computing System Design in Autonomous Vehicles. Recently, autonomous driving development ignited competition among car makers and technical corporations. Low level automation cars are already commercially available. But high automated vehicles where the vehicle drives by itself without human monitoring is still at infancy. Such autonomous vehicles (AVs) rely on the computing system in the car to to interpret the environment and make driving decisions. Therefore, computing system design is essential particularly in enhancing the attainment of driving safety. However, to our knowledge, no clear guideline exists so far regarding safety aware AV computing system and architecture design. To understand the safety requirement of AV computing system, we performed a field study by running industrial Level 4 autonomous driving fleets in various locations, road conditions, and traffic patterns. The field study indicates that traditional computing system performance metrics, such as tail latency, average latency, maximum latency, and timeout, cannot fully satisfy the safety requirement for AV computing system design. To address this issue, we propose a safety score' as a primary metric for measuring the level of safety in AV computing system design. Furthermore, we propose a perception latency model, which helps architects estimate the safety score of given architecture and system design without physically testing them in an AV. We demonstrate the use of our safety score and latency model, by developing and evaluating a safety aware AV computing system computation hardware resource management scheme.


Bulky Counterions Enhancing the Two Photon Excited Fluorescence of Gold Nanoclusters. Increasing fluorescence quantum yields of ligand protected gold nanoclusters has attracted wide research interest. The strategy consisting in using bulky counterions has been found to dramatically enhance the fluorescence. In this communication, we push forward this concept to the nonlinear optical regime. We show that by an appropriate choice of bulky counterions and of solvent, a 30 fold increase in two photon excited fluorescence (TPEF) signal at 600 nm for gold nanoclusters can be obtained. This would correspond to a TPEF cross section in the range of 0.1 to 1 GM.


Smartphone app with usage of AR technologies SolAR System. The article describes the AR mobile system for Sun system simulation. The main characteristics of AR systems architecture are given. The differences between tracking and without tracking technics are underlined. The architecture of the system of use of complemented reality for the study of astronomy is described. The features of the system and the principles of its work are determined.


Batch Constrained Distributional Reinforcement Learning for Session based Recommendation. Most of the existing deep reinforcement learning (RL) approaches for session based recommendations either rely on costly online interactions with real users, or rely on potentially biased rule based or data driven user behavior models for learning. In this work, we instead focus on learning recommendation policies in the pure batch or offline setting, i.e. learning policies solely from offline historical interaction logs or batch data generated from an unknown and sub optimal behavior policy, without further access to data from the real world or user behavior models. We propose BCD4Rec Batch Constrained Distributional RL for Session based Recommendations. BCD4Rec builds upon the recent advances in batch (offline) RL and distributional RL to learn from offline logs while dealing with the intrinsically stochastic nature of rewards from the users due to varied latent interest preferences (environments). We demonstrate that BCD4Rec significantly improves upon the behavior policy as well as strong RL and non RL baselines in the batch setting in terms of standard performance metrics like Click Through Rates or Buy Rates. Other useful properties of BCD4Rec include i. recommending items from the correct latent categories indicating better value estimates despite large action space (of the order of number of items), and ii. overcoming popularity bias in clicked or bought items typically present in the offline logs.


Efficient p multigrid spectral element model for water waves and marine offshore structures. In marine offshore engineering, cost efficient simulation of unsteady water waves and their nonlinear interaction with bodies are important to address a broad range of engineering applications at increasing fidelity and scale. We consider a fully nonlinear potential flow (FNPF) model discretized using a Galerkin spectral element method to serve as a basis for handling both wave propagation and wave body interaction with high computational efficiency within a single modellingapproach. We design and propose an efficientO(n) scalable computational procedure based on geometric p multigrid for solving the Laplace problem in the numerical scheme. The fluid volume and the geometric features of complex bodies is represented accurately using high order polynomial basis functions and unstructured meshes with curvilinear prism elements. The new p multigrid spectralelement model can take advantage of the high order polynomial basis and thereby avoid generating a hierarchy of geometric meshes with changing number of elements as required in geometric h multigrid approaches. We provide numerical benchmarks for the algorithmic and numerical efficiency of the iterative geometric p multigrid solver. Results of numerical experiments are presented for wave propagation and for wave body interaction in an advanced case for focusing design waves interacting with a FPSO. Our study shows, that the use of iterative geometric p multigrid methods for theLaplace problem can significantly improve run time efficiency of FNPF simulators.


A variational characterization of the optimal exit rate for controlled diffusions. The main result in this paper is a variational formula for the exit rate from a bounded domain for a diffusion process in terms of the stationary law of the diffusion constrained to remain in this domain forever. Related results on the geometric ergodicity of the controlled Q process are also presented.


Ring Laser Gyro Noise Improves Performance. We present a systematic formulation of the performance of a ring laser gyro (RLG) under the influence of a randomized sinusoidal dither. We develop the Fokker Planck equation of such a system and find its steady state solution that we use to find exact equations for the average output rate and its variance. The former determines the RLG's scale factor and the latter its angular random walk. We find a key parameter, called the residual lock in rate, which affects both the scale factor and the random walk of the gyro. We show that when the noise amplitude is much larger than the residual lock in rate the gyro rate output approaches that of an ideal gyro. However, this is at the expense of generating an angular random walk that is proportional to the residual lock in rate. We present a formulation of the statistics of gyro output count and relate the average count and its standard deviation to gyro parameters. For example, we show that the angular random walk, in addition to being proportional to the residual lock in rate, is also proportional to the inverse square root of the dither frequency.


Image Harmonization Dataset iHarmony4 HCOCO, HAdobe5k, HFlickr, and Hday2night. Image composition is an important operation in image processing, but the inconsistency between foreground and background significantly degrades the quality of composite image. Image harmonization, which aims to make the foreground compatible with the background, is a promising yet challenging task. However, the lack of high quality public dataset for image harmonization, which significantly hinders the development of image harmonization techniques. Therefore, we contribute an image harmonization dataset iHarmony4 by generating synthesized composite images based on existing COCO (resp., Adobe5k, day2night) dataset, leading to our HCOCO (resp., HAdobe5k, Hday2night) sub dataset. To enrich the diversity of our dataset, we also generate synthesized composite images based on our collected Flick images, leading to our HFlickr sub dataset. The image harmonization dataset iHarmony4 is released at https github.com bcmi Image Harmonization Datasets.


Reverse Engineering Imperceptible Backdoor Attacks on Deep Neural Networks for Detection and Training Set Cleansing. Backdoor data poisoning is an emerging form of adversarial attack usually against deep neural network image classifiers. The attacker poisons the training set with a relatively small set of images from one (or several) source class(es), embedded with a backdoor pattern and labeled to a target class. For a successful attack, during operation, the trained classifier will 1) misclassify a test image from the source class(es) to the target class whenever the same backdoor pattern is present 2) maintain a high classification accuracy for backdoor free test images. In this paper, we make a break through in defending backdoor attacks with imperceptible backdoor patterns (e.g. watermarks) before during the training phase. This is a challenging problem because it is a priori unknown which subset (if any) of the training set has been poisoned. We propose an optimization based reverse engineering defense, that jointly 1) detects whether the training set is poisoned 2) if so, identifies the target class and the training images with the backdoor pattern embedded and 3) additionally, reversely engineers an estimate of the backdoor pattern used by the attacker. In benchmark experiments on CIFAR 10, for a large variety of attacks, our defense achieves a new state of the art by reducing the attack success rate to no more than 4.9 after removing detected suspicious training images.


Plasmonic antennas with electric, magnetic, and electromagnetic hot spots based on Babinet's principle. We theoretically study plasmonic antennas featuring areas of extremely concentrated electric or magnetic field, known as hot spots. We combine two types of electric magnetic complementarity to increase the degree of freedom for the design of the antennas bow tie and diabolo duality and Babinet's principle. We evaluate the figures of merit for different plasmon enhanced optical spectroscopy methods field enhancement, decay rate enhancement, and quality factor of the plasmon resonances. The role of Babinet's principle in interchanging electric and magnetic field hot spots and its consequences for practical antenna design are discussed. In particular, diabolo antennas exhibit slightly better performance than bow ties in terms of larger field enhancement and larger Q factor. For specific resonance frequency, diabolo antennas are considerably smaller than bow ties which makes them favourable for the integration into more complex devices but also makes their fabrication more demanding in terms of spatial resolution. Finally, we propose Babinet type dimer antenna featuring electromagnetic hot spot with both the electric and magnetic field components treated on equal footing.


Denoising Implicit Feedback for Recommendation. The ubiquity of implicit feedback makes them the default choice to build online recommender systems. While the large volume of implicit feedback alleviates the data sparsity issue, the downside is that they are not as clean in reflecting the actual satisfaction of users. For example, in E commerce, a large portion of clicks do not translate to purchases, and many purchases end up with negative reviews. As such, it is of critical importance to account for the inevitable noises in implicit feedback for recommender training. However, little work on recommendation has taken the noisy nature of implicit feedback into consideration. In this work, we explore the central theme of denoising implicit feedback for recommender training. We find serious negative impacts of noisy implicit feedback,i.e., fitting the noisy data prevents the recommender from learning the actual user preference. Our target is to identify and prune noisy interactions, so as to improve the quality of recommender training. By observing the process of normal recommender training, we find that noisy feedback typically has large loss values in the early stages. Inspired by this observation, we propose a new training strategy namedAdaptive Denoising Training(ADT), which adaptively prunes noisy interactions during training. Specifically, we devise two paradigms for adaptive loss formulation Truncated Loss that discards the large loss samples with a dynamic threshold in each iteration and reweighted Loss that adaptively lowers the weight of large loss samples. We instantiate the two paradigms on the widely used binary cross entropy loss and test the proposed ADT strategies on three representative recommenders. Extensive experiments on three benchmarks demonstrate that ADT significantly improves the quality of recommendation over normal training.