Cycle Contrast for Self Supervised Video Representation Learning. We present Cycle Contrastive Learning (CCL), a novel self supervised method for learning video representation. Following a nature that there is a belong and inclusion relation of video and its frames, CCL is designed to find correspondences across frames and videos considering the contrastive representation in their domains respectively. It is different from recent approaches that merely learn correspondences across frames or clips. In our method, the frame and video representations are learned from a single network based on an R3D architecture, with a shared non linear transformation for embedding both frame and video features before the cycle contrastive loss. We demonstrate that the video representation learned by CCL can be transferred well to downstream tasks of video understanding, outperforming previous methods in nearest neighbour retrieval and action recognition tasks on UCF101, HMDB51 and MMAct.


Coherence effects on estimating two point separation. The quantum Fisher information (FI), when applied to the estimation of the separation of two point sources, has been shown to be non zero in cases where the coherence between the sources are known. Although it has been claimed that ignorance of the coherence causes the quantum FI to vanish (a resurgence of Rayleigh's curse), a more complete analysis including both the magnitude and phase of the coherence parameter is given here. Partial ignorance of the coherence is shown to potentially break Rayleigh's curse, whereas complete ignorance guarantees its resurgence.


The unit equation has no solutions in number fields of degree prime to 3 where 3 splits completely. Let K be a number field with ring of integers mathcal O K . We prove that if 3 does not divide K mathbb Q and 3 splits completely in K , then the unit equation has no solutions in K . In other words, there are no x, y in mathcal O K times with x y 1 . Our elementary p adic proof is inspired by the Skolem Chabauty Coleman method applied to the restriction of scalars of the projective line minus three points. Applying this result to a problem in arithmetic dynamics, we show that if f in mathcal O K x has a finite cyclic orbit in mathcal O K of length n then n in 1, 2, 4 .


Axisymmetric flows on the torus geometry. We present a series of analytically solvable axisymmetric flows on the torus geometry. For the single component flows, we describe the propagation of sound waves for perfect fluids, as well as the viscous damping of shear and longitudinal waves for isothermal and thermal fluids. Unlike the case of planar geometry, the non uniform curvature on a torus necessitates a distinct spectrum of eigenfrequencies and their corresponding basis functions. This has several interesting consequences, including breaking the degeneracy between even and odd modes, a lack of periodicity even in the flows of perfect fluids and the loss of Galilean invariance for flows with velocity components in the poloidal direction. For the multi component flows, we study the equilibrium configurations and relaxation dynamics of axisymmetric fluid stripes, described using the Cahn Hilliard equation. We find a second order phase transition in the equilibrium location of the stripe as a function of its area Delta A . This phase transition leads to a complex dependence of the Laplace pressure on Delta A . We also derive the underdamped oscillatory dynamics as the stripes approach equilibrium. Furthermore, relaxing the assumption of axial symmetry, we derive the conditions under which the stripes become unstable. In all cases, the analytical results are confirmed numerically using a finite difference Navier Stokes solver.


On subcartesian spaces Leibniz' rule implies the chain rule. We show that derivations of the differential structure of a subcartesian space satisfy the chain rule and have maximal integral curves.


Land Cover Semantic Segmentation Using ResUNet. In this paper we present our work on developing an automated system for land cover classification. This system takes a multiband satellite image of an area as input and outputs the land cover map of the area at the same resolution as the input. For this purpose convolutional machine learning models were trained in the task of predicting the land cover semantic segmentation of satellite images. This is a case of supervised learning. The land cover label data were taken from the CORINE Land Cover inventory and the satellite images were taken from the Copernicus hub. As for the model, U Net architecture variations were applied. Our area of interest are the Ionian islands (Greece). We created a dataset from scratch covering this particular area. In addition, transfer learning from the BigEarthNet dataset 1 was performed. In 1 simple classification of satellite images into the classes of CLC is performed but not segmentation as we do. However, their models have been trained into a dataset much bigger than ours, so we applied transfer learning using their pretrained models as the first part of out network, utilizing the ability these networks have developed to extract useful features from the satellite images (we transferred a pretrained ResNet50 into a U Res Net). Apart from transfer learning other techniques were applied in order to overcome the limitations set by the small size of our area of interest. We used data augmentation (cutting images into overlapping patches, applying random transformations such as rotations and flips) and cross validation. The results are tested on the 3 CLC class hierarchy levels and a comparative study is made on the results of different approaches.


Towards a Framework for the Design, Implementation and Reporting of Methodology Scoping Reviews. Background In view of the growth of published papers, there is an increasing need for studies that summarise scientific research. An increasingly common review is a 'Methodology scoping review', which provides a summary of existing analytical methods, techniques and software, proposed or applied in research articles, which address an analytical problem or further an analytical approach. However, guidelines for their design, implementation and reporting are limited. Methods Drawing on the experiences of the authors, which were consolidated through a series of face to face workshops, we summarise the challenges inherent in conducting a methodology scoping review and offer suggestions of best practice to promote future guideline development. Results We identified three challenges of conducting a methodology scoping review. First, identification of search terms one cannot usually define the search terms a priori and the language used for a particular method can vary across the literature. Second, the scope of the review requires careful consideration since new methodology is often not described (in full) within abstracts. Third, many new methods are motivated by a specific clinical question, where the methodology may only be documented in supplementary materials. We formulated several recommendations that build upon existing review guidelines. These recommendations ranged from an iterative approach to defining search terms through to screening and data extraction processes. Conclusion Although methodology scoping reviews are an important aspect of research, there is currently a lack of guidelines to standardise their design, implementation and reporting. We recommend a wider discussion on this topic.


Moderate deviations for the self normalized random walk in random scenery. Let G be an infinite connected graph with vertex set V . Let S n n in mathbb N 0 be the simple random walk on G and let xi(v) v in V be a collection of i.i.d. random variables which are independent of the random walk. Define the random walk in random scenery as T n sum k 0 n xi(S k) , and the normalization variables V n ( sum k 0 n xi 2(S k)) 1 2 and L n,2 ( sum v in V ell 2 n(v)) 1 2 . For G mathbb Z d and G mathbb T d , the d ary tree, we provide large deviations results for the self normalized process T n sqrt n (L n,2 V n) under only finite moment assumptions on the scenery.


PARAM A Microprocessor Hardened for Power Side Channel Attack Resistance. The power consumption of a microprocessor is a huge channel for information leakage. While the most popular exploitation of this channel is to recover cryptographic keys from embedded devices, other applications such as mobile app fingerprinting, reverse engineering of firmware, and password recovery are growing threats. Countermeasures proposed so far are tuned to specific applications, such as crypto implementations. They are not scalable to the large number and variety of applications that typically run on a general purpose microprocessor. In this paper, we investigate the design of a microprocessor, called PARAM with increased resistance to power based side channel attacks. To design PARAM, we start with identifying the most leaking modules in an open source RISC V processor. We evaluate the leakage in these modules and then add suitable countermeasures. The countermeasures depend on the cause of leakage in each module and can vary from simple modifications of the HDL code ensuring secure translation by the EDA tools, to obfuscating data and address lines thus breaking correlation with the processor's power consumption. The resultant processor is instantiated on the SASEBO GIII FPGA board and found to resist Differential Power Analysis even after one million power traces. Compared to contemporary countermeasures for power side channel attacks, overheads in area and frequency are minimal.


Cohen Macaulay homological dimensions. We introduce new homological dimensions, namely the Cohen Macaulay projective, injective and flat dimensions for homologically bounded complexes. Among other things we show that (a) these invariants characterize the Cohen Macaulay property for local rings, (b) Cohen Macaulay flat dimension fits between the Gorenstein flat dimension and the large restricted flat dimension, and (c) Cohen Macaulay injective dimension fits between the Gorenstein injective dimension and the Chouinard invariant.


Generalized Pose and Scale Estimation using 4 Point Congruence Constraints. We present gP4Pc, a new method for computing the absolute pose of a generalized camera with unknown internal scale from four corresponding 3D point and ray pairs. Unlike most pose and scale methods, gP4Pc is based on constraints arising from the congruence of shapes defined by two sets of four points related by an unknown similarity transformation. By choosing a novel parametrization for the problem, we derive a system of four quadratic equations in four scalar variables. The variables represent the distances of 3D points along the rays from the camera centers. After solving this system via Groebner basis based automatic polynomial solvers, we compute the similarity transformation using an efficient 3D point point alignment method. We also propose a specialized variant of our solver for the case of coplanar points, which is computationally very efficient and about 3x faster than the fastest existing solver. Our experiments on real and synthetic datasets, demonstrate that gP4Pc is among the fastest methods in terms of total running time when used within a RANSAC framework, while achieving competitive numerical stability, accuracy, and robustness to noise.


Measurable perfect matchings for acyclic locally countable Borel graphs. We characterize the structural impediments to the existence of Borel perfect matchings for acyclic locally countable Borel graphs admitting a Borel selection of finitely many ends from their connected components. In particular, this yields the existence of Borel matchings for such graphs of degree at least three. As a corollary, it follows that acyclic locally countable Borel graphs of degree at least three generating mu hyperfinite equivalence relations admit mu measurable matchings. We establish the analogous result for Baire measurable matchings in the locally finite case, and provide a counterexample in the locally countable case.


Checkworthiness in Automatic Claim Detection Models Definitions and Analysis of Datasets. Public, professional and academic interest in automated fact checking has drastically increased over the past decade, with many aiming to automate one of the first steps in a fact check procedure the selection of so called checkworthy claims. However, there is little agreement on the definition and characteristics of checkworthiness among fact checkers, which is consequently reflected in the datasets used for training and testing checkworthy claim detection models. After elaborate analysis of checkworthy claim selection procedures in fact check organisations and analysis of state of the art claim detection datasets, checkworthiness is defined as the concept of having a spatiotemporal and context dependent worth and need to have the correctness of the objectivity it conveys verified. This is irrespective of the claim's perceived veracity judgement by an individual based on prior knowledge and beliefs. Concerning the characteristics of current datasets, it is argued that the data is not only highly imbalanced and noisy, but also too limited in scope and language. Furthermore, we believe that the subjective concept of checkworthiness might not be a suitable filter for claim detection.


Asymptotic stability of solitary waves for the 1d NLS with an attractive delta potential. We consider the one dimensional nonlinear Schr "odinger equation with an attractive delta potential and mass supercritical nonlinearity. This equation admits a one parameter family of solitary wave solutions in both the focusing and defocusing cases. We establish asymptotic stability for all solitary waves satisfying a suitable spectral condition, namely, that the linearized operator around the solitary wave has a two dimensional generalized kernel and no other eigenvalues or resonances. In particular, we extend our previous result beyond the regime of small solitary waves and extend the results of Fukuizumi Ohta Ozawa and Kaminaga Ohta from orbital to asymptotic stability for a suitable family of solitary waves.


Learning Efficient Video Representation with Video Shuffle Networks. 3D CNN shows its strong ability in learning spatiotemporal representation in recent video recognition tasks. However, inflating 2D convolution to 3D inevitably introduces additional computational costs, making it cumbersome in practical deployment. We consider whether there is a way to equip the conventional 2D convolution with temporal vision no requiring expanding its kernel. To this end, we propose the video shuffle, a parameter free plug in component that efficiently reallocates the inputs of 2D convolution so that its receptive field can be extended to the temporal dimension. In practical, video shuffle firstly divides each frame feature into multiple groups and then aggregate the grouped features via temporal shuffle operation. This allows the following 2D convolution aggregate the global spatiotemporal features. The proposed video shuffle can be flexibly inserted into popular 2D CNNs, forming the Video Shuffle Networks (VSN). With a simple yet efficient implementation, VSN performs surprisingly well on temporal modeling benchmarks. In experiments, VSN not only gains non trivial improvements on Kinetics and Moments in Time, but also achieves state of the art performance on Something Something V1, Something Something V2 datasets.


FBSDE based Neural Network Algorithms for High Dimensional Quasilinear Parabolic PDEs. In this paper, we propose forward and backward stochastic differential equations (FBSDEs) based deep neural network (DNN) learning algorithms for the solution of high dimensional quasilinear parabolic partial differential equations (PDEs), which are related to the FBSDEs by the Pardoux Peng theory. The algorithms rely on a learning process by minimizing the pathwise difference between two discrete stochastic processes, defined by the time discretization of the FBSDEs and the DNN representation of the PDE solutions, respectively. The proposed algorithms are shown to generate DNN solutions for a 100 dimensional Black Scholes Barenblatt equation, accurate in a finite region in the solution space, and has a convergence rate similar to that of the Euler Maruyama discretization used for the FBSDEs. As a result, a Richardson extrapolation technique over time discretizations can be used to enhance the accuracy of the DNN solutions. For time oscillatory solutions, a multiscale DNN is shown to improve the performance of the FBSDE DNN for high frequencies.


Laptop Theft in a University Setting can be Avoided with Warnings. Laptops have become an indispensable asset in today's digital age. They often contain highly sensitive information, such as credentials and confidential documents. As a result, the value of a laptop is an accumulation of the value of both the physical device itself and the cyber assets it contains, making it a lucrative target for theft. Educational institutions have a large population of potential victims of laptop theft. To mitigate this risk, we investigate whether a simple warning sign can reduce the opportunity for potential offenders. To this end, we have conducted an empirical study to observe the prevalence of students staff leaving their laptops unattended at a university study hall at the Delft University of Technology in the Netherlands, both with and without a warning sign. We observed 148 out of 220 subjects leaving their laptops unattended in just three weeks. The results also showed that without the warning banner, 75.5 (83 out of 110) of subjects left their laptops unattended and with the warning, only 59.1 (65 out of 110) of subjects showed the same behavior, which is a significant reduction of 16.4 . In addition, a qualitative analysis was performed on the responses of subjects who left their laptops unattended after the warning banner was placed. The results showed a mix of convenience, and a blind trust on the safety of the faculty. In conclusion, a simple banner was effective in reducing the opportunity for laptop theft. However, the percentage of laptops left unattended was still high even after the introduction of the banner.


Quality Management of Machine Learning Systems. In the past decade, Artificial Intelligence (AI) has become a part of our daily lives due to major advances in Machine Learning (ML) techniques. In spite of an explosive growth in the raw AI technology and in consumer facing applications on the internet, its adoption in business applications has conspicuously lagged behind. For business mission critical systems, serious concerns about reliability and maintainability of AI applications remain. Due to the statistical nature of the output, software 'defects' are not well defined. Consequently, many traditional quality management techniques such as program debugging, static code analysis, functional testing, etc. have to be reevaluated. Beyond the correctness of an AI model, many other new quality attributes, such as fairness, robustness, explainability, transparency, etc. become important in delivering an AI system. The purpose of this paper is to present a view of a holistic quality management framework for ML applications based on the current advances and identify new areas of software engineering research to achieve a more trustworthy AI.


physics.comp-ph cs.NA math.NA physics.plasm-ph

Moment Preserving and Mesh Adaptive Reweighting Method for Rare Event Sampling in Monte Carlo Algorithms. We present novel roulette schemes for rare event sampling that are both structure preserving and unbiased. The boundaries where Monte Carlo markers are split and deleted are placed automatically and adapted during runtime. Extending existing codes with the new schemes is possible without severe changes because the equation of motion for the markers is not altered. These schemes can also be applied in the presence of nonlinear and nonlocal coupling between markers. As an illustrative application, we have implemented this method in the ASCOT RFOF code, used to simulate fast ion generation by radio frequency waves in fusion plasmas. In this application, with this method the Monte Carlo noise level for typical fast ion energies can be reduced at least of one order of magnitude without increasing the computational effort.


Weyl Law on Asymptotically Euclidean Manifolds. We study the asymptotic behaviour of the eigenvalue counting function for self adjoint elliptic linear operators defined through classical weighted symbols of order (1,1) , on an asymptotically Euclidean manifold. We first prove a two term Weyl formula, improving previously known remainder estimates. Subsequently, we show that under a geometric assumption on the Hamiltonian flow at infinity there is a refined Weyl asymptotics with three terms. The proof of the theorem uses a careful analysis of the flow behaviour in the corner component of the boundary of the double compactification of the cotangent bundle. Finally, we illustrate the results by analysing the operator Q (1 x 2)(1 Delta) on mathbb R d .


On gluing Alexandrov spaces with lower Ricci curvature bounds. In this paper we prove that in the class of metric measure spaces with Alexandrov curvature bounded from below the Riemannian curvature dimension condition RCD(K,N) with K in mathbb R and N in 1, infty) is preserved under doubling and gluing constructions.


Co Attention for Conditioned Image Matching. We propose a new approach to determine correspondences between image pairs in the wild under large changes in illumination, viewpoint, context, and material. While other approaches find correspondences between pairs of images by treating the images independently, we instead condition on both images to implicitly take account of the differences between them. To achieve this, we introduce (i) a spatial attention mechanism (a co attention module, CoAM) for conditioning the learned features on both images, and (ii) a distinctiveness score used to choose the best matches at test time. CoAM can be added to standard architectures and trained using self supervision or supervised data, and achieves a significant performance improvement under hard conditions, e.g. large viewpoint changes. We demonstrate that models using CoAM achieve state of the art or competitive results on a wide range of tasks local matching, camera localization, 3D reconstruction, and image stylization.


Refined height pairing. For a d dimensional smooth projective variety X over the function field of a smooth variety B over a field k and for i ge 0 , we define a subgroup CH i(X) (0) of CH i(X) and construct a "refined height pairing" CH i(X) (0) times CH d 1 i (X) (0) to CH 1(B) in the category of abelian groups modulo isogeny. For i 1,d , CH i(X) (0) is the group of cycles numerically equivalent to 0 . This pairing relates to pairings defined by P. Schneider and A. Beilinson if B is a curve, to a refined height defined by L. Moret Bailly when X is an abelian variety, and to a pairing with values in H 2(B bar k , mathbf Q l(1)) defined by D. R "ossler and T. Szamuely in general. We study it in detail when i 1 .


Robust Adaptive Least Squares Polynomial Chaos Expansions in High Frequency Applications. We present an algorithm for computing sparse, least squares based polynomial chaos expansions, incorporating both adaptive polynomial bases and sequential experimental designs. The algorithm is employed to approximate stochastic high frequency electromagnetic models in a black box way, in particular, given only a dataset of random parameter realizations and the corresponding observations regarding a quantity of interest, typically a scattering parameter. The construction of the polynomial basis is based on a greedy, adaptive, sensitivity related method. The sequential expansion of the experimental design employs different optimality criteria, with respect to the algebraic form of the least squares problem. We investigate how different conditions affect the robustness of the derived surrogate models, that is, how much the approximation accuracy varies given different experimental designs. It is found that relatively optimistic criteria perform on average better than stricter ones, yielding superior approximation accuracies for equal dataset sizes. However, the results of strict criteria are significantly more robust, as reduced variations regarding the approximation accuracy are obtained, over a range of experimental designs. Two criteria are proposed for a good accuracy robustness trade off.


UNION An Unreferenced Metric for Evaluating Open ended Story Generation. Despite the success of existing referenced metrics (e.g., BLEU and MoverScore), they correlate poorly with human judgments for open ended text generation including story or dialog generation because of the notorious one to many issue there are many plausible outputs for the same input, which may differ substantially in literal or semantics from the limited number of given references. To alleviate this issue, we propose UNION, a learnable unreferenced metric for evaluating open ended story generation, which measures the quality of a generated story without any reference. Built on top of BERT, UNION is trained to distinguish human written stories from negative samples and recover the perturbation in negative stories. We propose an approach of constructing negative samples by mimicking the errors commonly observed in existing NLG models, including repeated plots, conflicting logic, and long range incoherence. Experiments on two story datasets demonstrate that UNION is a reliable measure for evaluating the quality of generated stories, which correlates better with human judgments and is more generalizable than existing state of the art metrics.


High Energy and High Quality Ion beams in Light Sail Acceleration. A superintense laser pulse illuminating a thin solid density foil can, in principle, accelerate the entire foil, therefore yielding dense, collimated, and quasi monoenergetic ion beams. These unique features render radiation pressure acceleration in the light sail regime a promising acceleration mechanism suited for applications where dense and high flux ion beams are required. However, the onset of several instabilities typically results into foil deformation and heating, which cause premature termination of the radiation pressure acceleration stage and strong broadening of the ion spectrum. Here we show that (i) a relation between the attainable ion energy per nucleon and the development of instabilities exists, such that increasing the ion energy results into an increase of transverse modulation effects and, (ii) that the above relation can be weakened with proper matching of laser pulse foil parameters, such that high energy dense ion beams with high quality spectral features can be produced.


Visualizing and Understanding Vision System. How the human vision system addresses the object identity preserving recognition problem is largely unknown. Here, we use a vision recognition reconstruction network (RRN) to investigate the development, recognition, learning and forgetting mechanisms, and achieve similar characteristics to electrophysiological measurements in monkeys. First, in network development study, the RRN also experiences critical developmental stages characterized by specificities in neuron types, synapse and activation patterns, and visual task performance from the early stage of coarse salience map recognition to mature stage of fine structure recognition. In digit recognition study, we witness that the RRN could maintain object invariance representation under various viewing conditions by coordinated adjustment of responses of population neurons. And such concerted population responses contained untangled object identity and properties information that could be accurately extracted via high level cortices or even a simple weighted summation decoder. In the learning and forgetting study, novel structure recognition is implemented by adjusting entire synapses in low magnitude while pattern specificities of original synaptic connectivity are preserved, which guaranteed a learning process without disrupting the existing functionalities. This work benefits the understanding of the human visual processing mechanism and the development of human like machine intelligence.


Prescribing Deep Attentive Score Prediction Attracts Improved Student Engagement. Intelligent Tutoring Systems (ITSs) have been developed to provide students with personalized learning experiences by adaptively generating learning paths optimized for each individual. Within the vast scope of ITS, score prediction stands out as an area of study that enables students to construct individually realistic goals based on their current position. Via the expected score provided by the ITS, a student can instantaneously compare one's expected score to one's actual score, which directly corresponds to the reliability that the ITS can instill. In other words, refining the precision of predicted scores strictly correlates to the level of confidence that a student may have with an ITS, which will evidently ensue improved student engagement. However, previous studies have solely concentrated on improving the performance of a prediction model, largely lacking focus on the benefits generated by its practical application. In this paper, we demonstrate that the accuracy of the score prediction model deployed in a real world setting significantly impacts user engagement by providing empirical evidence. To that end, we apply a state of the art deep attentive neural network based score prediction model to Santa, a multi platform English ITS with approximately 780K users in South Korea that exclusively focuses on the TOEIC (Test of English for International Communications) standardized examinations. We run a controlled A B test on the ITS with two models, respectively based on collaborative filtering and deep attentive neural networks, to verify whether the more accurate model engenders any student engagement. The results conclude that the attentive model not only induces high student morale (e.g. higher diagnostic test completion ratio, number of questions answered, etc.) but also encourages active engagement (e.g. higher purchase rate, improved total profit, etc.) on Santa.


The monoid of monotone injective partial selfmaps of the poset ( mathbb N 3 , leqslant) with cofinite domains and images. Let n be a positive integer geqslant 2 and mathbb N n leqslant be the n th power of positive integers with the product order of the usual order on mathbb N . In the paper we study the semigroup of injective partial monotone selfmaps of mathbb N n leqslant with cofinite domains and images. We show that the group of units H( mathbb I ) of the semigroup mathscr P !O ! infty ( mathbb N n leqslant ) is isomorphic to the group mathscr S n of permutations of an n element set, and describe the subsemigroup of idempotents of mathscr P !O ! infty ( mathbb N n leqslant ) . Also in the case n 3 we describe the property of elements of the semigroup mathscr P !O ! infty ( mathbb N 3 leqslant ) as partial bijections of the poset mathbb N 3 leqslant and Green's relations on the semigroup mathscr P !O ! infty ( mathbb N 3 leqslant ) . In particular we show that mathscr D mathscr J in mathscr P !O ! infty ( mathbb N 3 leqslant ) .


Projection Cost Preserving Sketches Proof Strategies and Constructions. In this note we illustrate how common matrix approximation methods, such as random projection and random sampling, yield projection cost preserving sketches, as introduced in FSS13, CEM 15 . A projection cost preserving sketch is a matrix approximation which, for a given parameter k , approximately preserves the distance of the target matrix to all k dimensional subspaces. Such sketches have applications to scalable algorithms for linear algebra, data science, and machine learning. Our goal is to simplify the presentation of proof techniques introduced in CEM 15 and CMM17 so that they can serve as a guide for future work. We also refer the reader to CYD19 , which gives a similar simplified exposition of the proof covered in Section 2.


The integral shuffle algebra and the K theory of the Hilbert scheme of points in mathbb A 2 . We examine the shuffle algebra defined over the ring mathbf R mathbb C q 1 pm 1 , q 2 pm 1 , also called the integral shuffle algebra, which was found by Schiffmann and Vasserot to act on the equivariant K theory of the Hilbert scheme of points in the plane. We find that the modules of 2 and 3 variable elements of the integral shuffle algebra are finitely generated and prove a necessary condition for an element to be in the integral shuffle algebra for arbitrarily many variables.


Modeling Voting for System Combination in Machine Translation. System combination is an important technique for combining the hypotheses of different machine translation systems to improve translation performance. Although early statistical approaches to system combination have been proven effective in analyzing the consensus between hypotheses, they suffer from the error propagation problem due to the use of pipelines. While this problem has been alleviated by end to end training of multi source sequence to sequence models recently, these neural models do not explicitly analyze the relations between hypotheses and fail to capture their agreement because the attention to a word in a hypothesis is calculated independently, ignoring the fact that the word might occur in multiple hypotheses. In this work, we propose an approach to modeling voting for system combination in machine translation. The basic idea is to enable words in hypotheses from different systems to vote on words that are representative and should get involved in the generation process. This can be done by quantifying the influence of each voter and its preference for each candidate. Our approach combines the advantages of statistical and neural methods since it can not only analyze the relations between hypotheses but also allow for end to end training. Experiments show that our approach is capable of better taking advantage of the consensus between hypotheses and achieves significant improvements over state of the art baselines on Chinese English and English German machine translation tasks.


CrowdTSC Crowd based Neural Networks for Text Sentiment Classification. Sentiment classification is a fundamental task in content analysis. Although deep learning has demonstrated promising performance in text classification compared with shallow models, it is still not able to train a satisfying classifier for text sentiment. Human beings are more sophisticated than machine learning models in terms of understanding and capturing the emotional polarities of texts. In this paper, we leverage the power of human intelligence into text sentiment classification. We propose Crowd based neural networks for Text Sentiment Classification (CrowdTSC for short). We design and post the questions on a crowdsourcing platform to collect the keywords in texts. Sampling and clustering are utilized to reduce the cost of crowdsourcing. Also, we present an attention based neural network and a hybrid neural network, which incorporate the collected keywords as human being's guidance into deep neural networks. Extensive experiments on public datasets confirm that CrowdTSC outperforms state of the art models, justifying the effectiveness of crowd based keyword guidance.


A Survey on Software Defined VANETs Benefits, Challenges, and Future Directions. The evolving of Fifth Generation (5G) networks isbecoming more readily available as a major driver of the growthof new applications and business models. Vehicular Ad hocNetworks (VANETs) and Software Defined Networking (SDN)represent the key enablers of 5G technology with the developmentof next generation intelligent vehicular networks and applica tions. In recent years, researchers have focused on the integrationof SDN and VANET, and look at different topics related to thearchitecture, the benefits of software defined VANET servicesand the new functionalities to adapt them. However, securityand robustness of the complete architecture is still questionableand have been largely negleted. Moreover, the deployment andintegration of novel entities and several architectural componentsdrive new security threats and vulnerabilities.In this paper, first we survey the state of the art SDN basedVehicular ad hoc Network (SDVN) architectures for their net working infrastructure design, functionalities, benefits, and chal lenges. Then we discuss these SDVN architectures against majorsecurity threats that violate the key security services such asavailability, confidentiality, authentication, and data integrity.We also propose different countermeasures to these threats.Finally, we discuss the lessons learned with the directions offuture research work towards provisioning stringent security andprivacy solutions in future SDVN architectures. To the best of ourknowledge, this is the first comprehensive work that presents sucha survey and analysis on SDVNs in the era of future generationnetworks (e.g., 5G, and Information centric networking) andapplications (e.g., intelligent transportation system, and IoT enabled advertising in VANETs).


Analytical expressions of non relativistic static polarizabilities for hydrogen like ions. In this work, analytical formulas for the static multipole polarizabilities of hydrogen like ions are derived by using the analytical wave functions and the reduced Green function and by applying a numerical fitting procedure. Our results are then applied to the studies of blackbody radiation shifts to atomic energy levels at different temperatures. Our analytical results can be served as a benchmark for other theoretical methods.


On uniform boundedness of sequential social learning. In the classical herding model, asymptotic learning refers to situations where individuals eventually take the correct action regardless of their private information. Classical results identify classes of information structures for which such learning occurs. Recent papers have argued that typically, even when asymptotic learning occurs, it takes a very long time. In this paper related questions are referred. The paper studies whether there is a natural family of information structures for which the time it takes until individuals learn is uniformly bounded from above. Indeed, we propose a simple bi parametric criterion that defines the information structure, and on top of that compute the time by which individuals learn (with high probability) for any pair of parameters. Namely, we identify a family of information structures where individuals learn uniformly fast. The underlying technical tool we deploy is a uniform convergence result on a newly introduced class of weakly active' supermartingales. This result extends an earlier result of Fudenberg and Levine (1992) on active supermartingales.


Affine category O, Koszul duality and Zuckerman functors. The parabolic category mathcal O for affine mathfrak gl N at level N e admits a structure of a categorical representation of widetilde mathfrak sl e with respect to some endofunctors E and F . This category contains a smaller category mathbf A that categorifies the higher level Fock space. We prove that the functors E and F in the category mathbf A are Koszul dual to Zuckerman functors. The key point of the proof is to show that the functor F for the category mathbf A at level N e can be decomposed in terms of the components of the functor F for the category mathbf A at level N e 1 . To prove this, we use the following fact a category with an action of widetilde mathfrak sl e 1 contains a (canonically defined) subcategory with an action of widetilde mathfrak sl e . We also prove a general statement that says that in some general situation a functor that satisfies a list of axioms is automatically Koszul dual to some sort of Zuckerman functor.


The interval turnpike property for adjoints. In this work we derive an interval turnpike result for adjoints of finite and infinite dimensional nonlinear optimal control problems under the assumption of an interval turnpike on states and controls. We consider stabilizable dynamics governed by a generator of a semigroup with finite dimensional unstable part satisfying a spectral decomposition condition and show the desired turnpike property under continuity assumptions on the first order optimality conditions. We further give stronger estimates for analytic semigroups and provide a numerical example with a boundary controlled semilinear heat equation to illustrate the results.


Training Models to Extract Treatment Plans from Clinical Notes Using Contents of Sections with Headings. Objective Using natural language processing (NLP) to find sentences that state treatment plans in a clinical note, would automate plan extraction and would further enable their use in tools that help providers and care managers. However, as in the most NLP tasks on clinical text, creating gold standard to train and test NLP models is tedious and expensive. Fortuitously, sometimes but not always clinical notes contain sections with a heading that identifies the section as a plan. Leveraging contents of such labeled sections as a noisy training data, we assessed accuracy of NLP models trained with the data. Methods We used common variations of plan headings and rule based heuristics to find plan sections with headings in clinical notes, and we extracted sentences from them and formed a noisy training data of plan sentences. We trained Support Vector Machine (SVM) and Convolutional Neural Network (CNN) models with the data. We measured accuracy of the trained models on the noisy dataset using ten fold cross validation and separately on a set aside manually annotated dataset. Results About 13 of 117,730 clinical notes contained treatment plans sections with recognizable headings in the 1001 longitudinal patient records that were obtained from Cleveland Clinic under an IRB approval. We were able to extract and create a noisy training data of 13,492 plan sentences from the clinical notes. CNN achieved best F measures, 0.91 and 0.97 in the cross validation and set aside evaluation experiments respectively. SVM slightly underperformed with F measures of 0.89 and 0.96 in the same experiments. Conclusion Our study showed that the training supervised learning models using noisy plan sentences was effective in identifying them in all clinical notes. More broadly, sections with informal headings in clinical notes can be a good source for generating effective training data.


A short note on the uniqueness of the trivial solution for the steady state Navier Stokes equations. The uniqueness of the trivial solution (the zero solution) for the steady state Navier Stokes equations is an interesting problem who has known several recent contributions. These results are also known as a Liouville type results for the stationary Navier Stokes equations. In the setting of the Lebesgue spaces with parameter 3 leq p leq 9 2 it is known that the trivial solution of these equations is the unique one. In this note, we extend this previous result to other values of the integration parameter p . More precisely, we prove that the velocity field must be zero provided that it belongs to the L p space with 3 2 p 3 . Moreover, for the large interval of values 9 2 p infty , we also obtain a partial result on the vanishing of the velocity filed under an additional hypothesis in terms of the Sobolev space of negative order dot H 1 . This last result has an interesting corollary when studying the Liouville problem in the natural energy space of these solutions dot H 1 .


From uncountable abelian groups to uncountable nonabelian groups. The present note surveys my research related to generalizing notions of abelian group theory to non commutative case and applying them particularly to investigate fundamental groups.


Nonradiative to Superscattering Switch with Phase Change Materials. Phase change materials (PCMs) can switch between different crystalline states as a function of an external bias, offering a pronounced change of their dielectric function. In order to take full advantage of these features for active photonics and information storage, stand alone PCMs are not sufficient, since the phase transition requires strong pump fields. Here, we explore hybrid metal semiconductor core shell nanoantennas loaded with PCMs, enabling a drastic switch in scattering features as the load changes its phase. Large scattering, beyond the limits of small resonant particles, is achieved by spectrally matching different Mie resonances, while scattering cancellation and cloaking is achieved with out of phase electric dipole oscillations in the PCM shell and Ag core. We show that tuning the PCM crystallinity we can largely vary total ( 15 times) and forward ( 100 times) scattering. Remarkably, a substantial reconfiguration of the scattering pattern from Kerker (zero backward) to antiKerker (almost zero forward) regimes with little change ( 5 ) in crystallinity is predicted, which makes this structure promising low intensity nonlinear photonics.


Learnable Tree Filter for Structure preserving Feature Transform. Learning discriminative global features plays a vital role in semantic segmentation. And most of the existing methods adopt stacks of local convolutions or non local blocks to capture long range context. However, due to the absence of spatial structure preservation, these operators ignore the object details when enlarging receptive fields. In this paper, we propose the learnable tree filter to form a generic tree filtering module that leverages the structural property of minimal spanning tree to model long range dependencies while preserving the details. Furthermore, we propose a highly efficient linear time algorithm to reduce resource consumption. Thus, the designed modules can be plugged into existing deep neural networks conveniently. To this end, tree filtering modules are embedded to formulate a unified framework for semantic segmentation. We conduct extensive ablation studies to elaborate on the effectiveness and efficiency of the proposed method. Specifically, it attains better performance with much less overhead compared with the classic PSP block and Non local operation under the same backbone. Our approach is proved to achieve consistent improvements on several benchmarks without bells and whistles. Code and models are available at https github.com StevenGrove TreeFilter Torch.


Approximation Algorithms for Process Systems Engineering. Designing and analyzing algorithms with provable performance guarantees enables efficient optimization problem solving in different application domains, e.g. communication networks, transportation, economics, and manufacturing. Despite the significant contributions of approximation algorithms in engineering, only limited and isolated works contribute from this perspective in process systems engineering. The current paper discusses three representative, NP hard problems in process systems engineering (i) pooling, (ii) process scheduling, and (iii) heat exchanger network synthesis. We survey relevant results and raise major open questions. Further, we present approximation algorithms applications which are relevant to process systems engineering (i) better mathematical modeling, (ii) problem classification, (iii) designing solution methods, and (iv) dealing with uncertainty. This paper aims to motivate further research at the intersection of approximation algorithms and process systems engineering.


An atlas adapted to the Toda flow. We introduce an atlas adapted to the Toda flow on the manifold of full flags of any non compact real semisimple Lie algebra, and on its Hessenberg type submanifolds. In our local coordinates the Toda flow becomes linear. We use these new coordinates to show that the Toda flow on the manifold of full flags is Morse Smale, which generalizes the main result of cite CSS1 to arbitrary non compact real semisimple Lie algebras. As a byproduct we describe new features of classical constructions in matrix theory.


Cache Aided Interference Management with Subexponential Subpacketization. Consider an interference channel consisting of K T transmitters and K R receivers with AWGN noise and complex channel gains, and with N files in the system. The one shot mathsf DoF for this channel is the maximum number of receivers which can be served simultaneously with vanishing probability of error as the mathsf SNR grows large, under a class of schemes known as textit one shot schemes. Consider that there exists transmitter and receiver side caches which can store fractions frac M T N and frac M R N of the library respectively. Recent work for this cache aided interference channel setup shows that, using a carefully designed prefetching(caching) phase, and a one shot coded delivery scheme combined with a proper choice of beamforming coefficients at the transmitters, we can achieve a mathsf DoF of t T t R , where t T frac M T K T N and t R frac M R K R N , which was shown to be almost optimal. The existing scheme involves splitting the file into F subfiles (the parameter F is called the textit subpacketization ), where F can be extremely large (in fact, with constant cache fractions, it becomes exponential in K R , for large K R ). In this work, our first contribution is a scheme which achieves the same mathsf DoF of t T t R with a smaller subpacketization than prior schemes. Our second contribution is a new coded caching scheme for the interference channel based on projective geometries over finite fields which achieves a one shot mathsf DoF of Theta(log qK R K T) , with a subpacketization F q O(K T (log qK R) 2) (for some prime power q ) that is textit subexponential in K R , for small constant cache fraction at the receivers. To the best of our knowledge, this is the first coded caching scheme with subpacketization subexponential in the number of receivers for this setting.


On the profitability of selfish blockchain mining under consideration of ruin. Mining blocks on a blockchain equipped with a proof of work consensus protocol is well known to be resource consuming. A miner bears the operational cost, mainly electricity consumption and IT gear, of mining, and is compensated by a capital gain when a block is discovered. This paper aims at quantifying the profitability of mining when the possible event of ruin is also considered. This is done by formulating a tractable stochastic model and using tools from applied probability and analysis, including the explicit solution of a certain type of advanced functional differential equation. The expected profit at a future time point is determined for the situation when the miner follows the protocol as well as when he she withholds blocks. The obtained explicit expressions allow to analyze the sensitivity with respect to the different model ingredients and to identify conditions under which selfish mining is a strategic advantage.


An Infrastructure for Faithful Execution of Remote Attestation Protocols. Remote attestation is an emerging technology for establishing trust in a remote computing system. Copland is a domain specific language for specifying layered attestation protocols, characterizing attestation relevant system events, and describing evidence bundling. In this work we formally define and verify a Copland Compiler and Copland Virtual Machine for executing Copland protocols. The compiler translates Copland into instructions that are executed on the virtual machine. The compiler and virtual machine are implemented as monadic, functional programs in the Coq proof assistant and verified with respect to the Copland event and evidence semantics. In addition we introduce the Attestation Manager Monad as an environment for managing Copland term execution providing support for managing nonces, binding results of Copland protocols to variables, and appraising evidence results.


Fixed parameter tractable algorithms for Tracking Shortest Paths. We consider the parameterized complexity of the problem of tracking shortest s t paths in graphs, motivated by applications in security and wireless networks. Given an undirected and unweighted graph with a source s and a destination t, Tracking Shortest Paths asks if there exists a k sized subset of vertices (referred to as tracking set) that intersects each shortest s t path in a distinct set of vertices. We first generalize this problem for set systems, namely Tracking Set System, where given a family of subsets of a universe, we are required to find a subset of elements from the universe that has a unique intersection with each set in the family. Tracking Set System is shown to be fixed parameter tractable due to its relation with a known problem, Test Cover. By a reduction to the well studied d hitting set problem, we give a polynomial (with respect to k) kernel for the case when the set sizes are bounded by d. This also helps solving Tracking Shortest Paths when the input graph diameter is bounded by d. While the results for Tracking Set System help to show that Tracking Shortest Paths is fixed parameter tractable, we also give an independent algorithm by using some preprocessing rules, resulting in an improved running time.


Exploiting Electrical Transients to Reveal Charge Loss Mechanism of Junction Solar Cells. Electrical transients enabled by optical excitation and electric detection provide a distinctive opportunity to study the charge transport, recombination and even the hysteresis of a solar cell in a much wider time window ranging from nanoseconds to seconds. However, controversies on how to exploit these investigations to unravel the charge loss mechanism of the cell have been ongoing. Herein, a new methodology of quantifying the charge loss within the bulk absorber or at the interfaces and the defect properties of junction solar cells has been proposed after the conventional tail state framework is firstly demonstrated to be unreasonable. This methodology has been successfully applied in the study of commercialized silicon and emerging Cu2ZnSn(S, Se)4 and perovskite solar cells herein and should be universal to other photovoltaic device systems with similar structures. Overall, this work provides an alluring route for comprehensive investigation of dynamic physics processes and charge loss mechanism of junction solar cells and possesses potential applications for other optoelectronic devices.


Uncertainty based Traffic Accident Anticipation with Spatio Temporal Relational Learning. Traffic accident anticipation aims to predict accidents from dashcam videos as early as possible, which is critical to safety guaranteed self driving systems. With cluttered traffic scenes and limited visual cues, it is of great challenge to predict how long there will be an accident from early observed frames. Most existing approaches are developed to learn features of accident relevant agents for accident anticipation, while ignoring the features of their spatial and temporal relations. Besides, current deterministic deep neural networks could be overconfident in false predictions, leading to high risk of traffic accidents caused by self driving systems. In this paper, we propose an uncertainty based accident anticipation model with spatio temporal relational learning. It sequentially predicts the probability of traffic accident occurrence with dashcam videos. Specifically, we propose to take advantage of graph convolution and recurrent networks for relational feature learning, and leverage Bayesian neural networks to address the intrinsic variability of latent relational representations. The derived uncertainty based ranking loss is found to significantly boost model performance by improving the quality of relational features. In addition, we collect a new Car Crash Dataset (CCD) for traffic accident anticipation which contains environmental attributes and accident reasons annotations. Experimental results on both public and the newly compiled datasets show state of the art performance of our model. Our code and CCD dataset are available at https github.com Cogito2012 UString.


Derived invariants of the fixed ring of enveloping algebras of semisimple Lie algebras. Let mathfrak g be a semisimple complex Lie algebra, and let W be a finite subgroup of mathbb C algebra automorphisms of the enveloping algebra U( mathfrak g ) . We show that the derived category of U( mathfrak g ) W modules determines isomorphism classes of both mathfrak g and W. Our proofs are based on the geometry of the Zassenhaus variety of the reduction modulo p gg 0 of mathfrak g . Specifically, we use non existence of certain 'etale coverings of its smooth locus


Submodular Clustering in Low Dimensions. We study a clustering problem where the goal is to maximize the coverage of the input points by k chosen centers. Specifically, given a set of n points P subseteq mathbb R d , the goal is to pick k centers C subseteq mathbb R d that maximize the service sum p in P mathsf varphi bigl( mathsf d (p,C) bigr) to the points P , where mathsf d (p,C) is the distance of p to its nearest center in C , and mathsf varphi is a non increasing service function mathsf varphi mathbb R to mathbb R . This includes problems of placing k base stations as to maximize the total bandwidth to the clients indeed, the closer the client is to its nearest base station, the more data it can send receive, and the target is to place k base stations so that the total bandwidth is maximized. We provide an n varepsilon O(d) time algorithm for this problem that achieves a (1 varepsilon) approximation. Notably, the runtime does not depend on the parameter k and it works for an arbitrary non increasing service function mathsf varphi mathbb R to mathbb R .


A Coupling Proof of Convex Ordering for Compound Distributions. In this paper, we give an alternative proof of the fact that, when compounding a nonnegative probability distribution, convex ordering between the distributions of the number of summands implies convex ordering between the resulting compound distributions. Although this is a classical textbook result in risk theory, our proof exhibits a concrete coupling between the compound distributions being compared, using the representation of one period discrete martingale laws as a mixture of the corresponding extremal measures.


Higher derivations of modules and the Hasse Schmidt module. In this paper we revisit Ribenboim's notion of higher derivations of modules and relate it to the recent work of De Fernex and Docampo on the sheaf of differentials of the arc space. In particular, we derive their formula for the K "ahler differentials of the Hasse Schmidt algebra as a consequence of the fact that the Hasse Schmidt algebra functors commute.


Parallel Cut Pursuit For Minimization of the Graph Total Variation. We present a parallel version of the cut pursuit algorithm for minimizing functionals involving the graph total variation. We show that the decomposition of the iterate into constant connected components, which is at the center of this method, allows for the seamless parallelization of the otherwise costly graph cut based refinement stage. We demonstrate experimentally the efficiency of our method in a wide variety of settings, from simple denoising on huge graphs to more complex inverse problems with nondifferentiable penalties. We argue that our approach combines the efficiency of graph cuts based optimizers with the versatility and ease of parallelization of traditional proximal


On Secure Coded Caching via Combinatorial Method. Coded caching is an efficient way to reduce network traffic congestion during peak hours by storing some content at the user's local cache memory without knowledge of later demands. The goal of coded caching design is to minimize the transmission rate and the subpacketization. In practice the demand for each user is sensitive since one can get the other users' preferences when it gets the other users' demands. The first coded caching scheme with private demands was proposed by Wan et al. However the transmission rate and the subpacketization of their scheme increase with the file number stored in the library. In this paper we consider the following secure coded caching prevent the wiretappers from obtaining any information about the files in the server and protect the demands from all the users in the delivery phase. We firstly introduce a combinatorial structure called secure placement delivery array (SPDA in short) to realize a coded caching scheme for our security setting. Then we obtain three classes of secure schemes by constructing SPDAs, where one of them is optimal. It is worth noting that the transmission rates and the subpacketizations of our schemes are independent to the file number. Furthermore, comparing with the previously known schemes with the same security setting, our schemes have significantly advantages on the subpacketizations and for some parameters have the advantage on the transmission rates.


Unipotent Factorization of Vector Bundle Automorphisms. We provide unipotent factorizations of vector bundle automorphisms of real and complex vector bundles over smooth manifolds. This generalises work of Thurston Wasserstein and Wasserstein for trivial vector bundles. We also address two symplectic cases and propose a complex geometric analog of the problem in the setting of holomorphic vector bundles over Stein manifolds.


Finite non metabelian Schur sigma Galois groups of class field towers. For each odd prime p 5, there exist finite p groups G with derived quotient G D(G) C(p)xC(p) and nearly constant transfer kernel type k(G) (1,2,...,2) having two fixed points. It is proved that, for p 7, this type k(G) with the simplest possible case of logarithmic abelian quotient invariants t(G) (11111,111,21,21,21,21,21,21) of the eight maximal subgroups is realized by exactly 98 non metabelian Schur sigma groups S of order 7 11 with fixed derived length dl(S) 3 and metabelianizations S D(D(S)) of order 7 7. For p 5, the type k(G) with t(G) (2111,111,21,21,21,21) leads to infinitely many non metabelian Schur sigma groups S of order at least 5 14 with unbounded derived length dl(S) 3 and metabelianizations S D(D(S)) of fixed order 5 7. These results admit the conclusion that d 159592 is the first known discriminant of an imaginary quadratic field with 7 class field tower of precise length L 3, and d 90868 is a discriminant of an imaginary quadratic field with 5 class field tower of length L 3, whose exact length remains unknown.


On Simple Reactive Neural Networks for Behaviour Based Reinforcement Learning. We present a behaviour based reinforcement learning approach, inspired by Brook's subsumption architecture, in which simple fully connected networks are trained as reactive behaviours. Our working assumption is that a pick and place robotic task can be simplified by leveraging domain knowledge of a robotics developer to decompose and train such reactive behaviours namely, approach, grasp, and retract. Then the robot autonomously learns how to combine them via an Actor Critic architecture. The Actor Critic policy is to determine the activation and inhibition mechanisms of the reactive behaviours in a particular temporal sequence. We validate our approach in a simulated robot environment where the task is picking a block and taking it to a target position while orienting the gripper from a top grasp. The latter represents an extra degree of freedom of which current end to end reinforcement learning fail to generalise. Our findings suggest that robotic learning can be more effective if each behaviour is learnt in isolation and then combined them to accomplish the task. That is, our approach learns the pick and place task in 8,000 episodes, which represents a drastic reduction in the number of training episodes required by an end to end approach and the existing state of the art algorithms.


SJTU NICT's Supervised and Unsupervised Neural Machine Translation Systems for the WMT20 News Translation Task. In this paper, we introduced our joint team SJTU NICT 's participation in the WMT 2020 machine translation shared task. In this shared task, we participated in four translation directions of three language pairs English Chinese, English Polish on supervised machine translation track, German Upper Sorbian on low resource and unsupervised machine translation tracks. Based on different conditions of language pairs, we have experimented with diverse neural machine translation (NMT) techniques document enhanced NMT, XLM pre trained language model enhanced NMT, bidirectional translation as a pre training, reference language based UNMT, data dependent gaussian prior objective, and BT BLEU collaborative filtering self training. We also used the TF IDF algorithm to filter the training set to obtain a domain more similar set with the test set for finetuning. In our submissions, the primary systems won the first place on English to Chinese, Polish to English, and German to Upper Sorbian translation directions.


Daisy Hamming graphs. Daisy graphs of a rooted graph G with the root r were recently introduced as a generalization of daisy cubes, a class of isometric subgraphs of hypercubes. In this paper we first solve the problem posed in cite Taranenko2020 and characterize rooted graphs G with the root r for which all daisy graphs of G with respect to r are isometric in G . We continue the investigation of daisy graphs G (generated by X ) of a Hamming graph H and characterize those daisy graphs generated by X of cardinality 2 that are isometric in H . Finally, we give a characterization of isometric daisy graphs of a Hamming graph K k 1 Box ldots Box K k n with respect to 0 n in terms of an expansion procedure.


High order ADER DG schemes for the simulation of linear seismic waves induced by nonlinear dispersive free surface water waves. In this paper, we propose a unified and high order accurate fully discrete one step ADER Discontinuous Galerkin method for the simulation of linear seismic waves in the sea bottom that are generated by the propagation of free surface water waves. A hyperbolic reformulation of the Serre Green Naghdi model for nonlinear dispersive free surface flows is coupled with a first order velocity stress formulation for linear elastic wave propagation in the sea bottom. Cartesian non conforming meshes are defined and the coupling is achieved by an appropriate time dependent pressure boundary condition in the three dimensional domain for the elastic wave propagation, where the pressure is a combination of hydrostatic and non hydrostatic pressure in the water column above the sea bottom. The use of a first order hyperbolic reformulation of the nonlinear dispersive free surface flow model leads to a straightforward coupling with the linear seismic wave equations, which are also written in first order hyperbolic form. It furthermore allows the use of explicit time integrators with a rather generous CFL type time step restriction associated with the dispersive water waves, compared to numerical schemes applied to classical dispersive models. Since the two systems employed are written in the same form of a first order hyperbolic system they can also be efficiently solved in a unique numerical framework. We choose the family of arbitrary high order accurate discontinuous Galerkin finite element schemes. The developed methodology is carefully assessed by first considering several benchmarks for each system separately showing a good agreement with exact and numerical reference solutions. Finally, also coupled test cases are addressed. Throughout this paper we assume the elastic deformations in the solid to be sufficiently small so that their influence on the free surface water waves can be neglected.


A Single Stream Network for Robust and Real time RGB D Salient Object Detection. Existing RGB D salient object detection (SOD) approaches concentrate on the cross modal fusion between the RGB stream and the depth stream. They do not deeply explore the effect of the depth map itself. In this work, we design a single stream network to directly use the depth map to guide early fusion and middle fusion between RGB and depth, which saves the feature encoder of the depth stream and achieves a lightweight and real time model. We tactfully utilize depth information from two perspectives (1) Overcoming the incompatibility problem caused by the great difference between modalities, we build a single stream encoder to achieve the early fusion, which can take full advantage of ImageNet pre trained backbone model to extract rich and discriminative features. (2) We design a novel depth enhanced dual attention module (DEDA) to efficiently provide the fore back ground branches with the spatially filtered features, which enables the decoder to optimally perform the middle fusion. Besides, we put forward a pyramidally attended feature extraction module (PAFE) to accurately localize the objects of different scales. Extensive experiments demonstrate that the proposed model performs favorably against most state of the art methods under different evaluation metrics. Furthermore, this model is 55.5 lighter than the current lightest model and runs at a real time speed of 32 FPS when processing a 384 times 384 image.


Deformations of unitary Howe dual pairs. We study deformations of the Howe dual pairs ( mathrm U (n), mathfrak u (1,1)) and ( mathrm U (n), mathfrak u (2 1)) to the context of a rational Cherednik algebra H 1,c (G,E) associated with a real reflection group G acting on a real vector space E of even dimension. For each pair, we show that the Lie (super)algebra structure of one partner is preserved under the deformation, which leads to a multiplicity free decomposition of the standard module or its tensor product with a spinor space. For the case where E is two dimensional and G is a dihedral group, we provide complete descriptions for the deformed pair and the relevant joint decomposition.


Context Enhanced Entity and Relation Embedding for Knowledge Graph Completion. Most researches for knowledge graph completion learn representations of entities and relations to predict missing links in incomplete knowledge graphs. However, these methods fail to take full advantage of both the contextual information of entity and relation. Here, we extract contexts of entities and relations from the triplets which they compose. We propose a model named AggrE, which conducts efficient aggregations respectively on entity context and relation context in multi hops, and learns context enhanced entity and relation embeddings for knowledge graph completion. The experiment results show that AggrE is competitive to existing models.


Partially Aligned Data to Text Generation with Distant Supervision. The Data to Text task aims to generate human readable text for describing some given structured data enabling more interpretability. However, the typical generation task is confined to a few particular domains since it requires well aligned data which is difficult and expensive to obtain. Using partially aligned data is an alternative way of solving the dataset scarcity problem. This kind of data is much easier to obtain since it can be produced automatically. However, using this kind of data induces the over generation problem posing difficulties for existing models, which tends to add unrelated excerpts during the generation procedure. In order to effectively utilize automatically annotated partially aligned datasets, we extend the traditional generation task to a refined task called Partially Aligned Data to Text Generation (PADTG) which is more practical since it utilizes automatically annotated data for training and thus considerably expands the application domains. To tackle this new task, we propose a novel distant supervision generation framework. It firstly estimates the input data's supportiveness for each target word with an estimator and then applies a supportiveness adaptor and a rebalanced beam search to harness the over generation problem in the training and generation phases respectively. We also contribute a partially aligned dataset (The data and source code of this paper can be obtained from https github.com fuzihaofzh distant supervision nlg by sampling sentences from Wikipedia and automatically extracting corresponding KB triples for each sentence from Wikidata. The experimental results show that our framework outperforms all baseline models as well as verify the feasibility of utilizing partially aligned data.


Left non degenerate set theoretic solutions of the Yang Baxter equation and dynamical extensions of q cycle sets. A first aim of this paper is to give sufficient conditions on left non degenerate bijective set theoretic solutions of the Yang Baxter equation so that they are non degenerate. In particular, we extend the results on involutive solutions obtained by Rump in 36 and answer in a positive way to a question posed by Ced 'o, Jespers, and Verwimp 19, Question 4.2 . Moreover, we develop a theory of extensions for left non degenerate set theoretic solutions of the Yang Baxter equation that allows one to construct new families of set theoretic solutions.


Summation by parts approximations of the second derivative Pseudoinverses of singular operators and revisiting the sixth order accurate narrow stencil operator. We consider finite difference approximations of the second derivative, exemplified in Poisson's equation, the heat equation and the wave equation. The finite difference operators satisfy a summation by parts property, which mimics the integration by parts. Since the operators approximate the second derivative, they are singular by construction. To impose boundary conditions, these operators are modified using Simultaneous Approximation Terms. This makes the modified matrices non singular, for most choices of boundary conditions. Recently, inverses of such matrices were derived. However, when considering Neumann boundary conditions on both boundaries, the modified matrix is still singular. For such matrices, we have derived an explicit expression for the Moore Penrose pseudoinverse, which can be used for solving elliptic problems and some time dependent problems. The condition for this new pseudoinverse to be valid, is that the modified matrix does not have more than one zero eigenvalue. We have reconstructed the sixth order accurate narrow stencil operator with a free parameter and show that more than one zero eigenvalue can occur. We have performed a detailed analysis on the free parameter to improve the properties of the second derivative operator. We complement the derivations by numerical experiments to demonstrate the improvements of the new second derivative operator.


AIM 2020 Challenge on Video Extreme Super Resolution Methods and Results. This paper reviews the video extreme super resolution challenge associated with the AIM 2020 workshop at ECCV 2020. Common scaling factors for learned video super resolution (VSR) do not go beyond factor 4. Missing information can be restored well in this region, especially in HR videos, where the high frequency content mostly consists of texture details. The task in this challenge is to upscale videos with an extreme factor of 16, which results in more serious degradations that also affect the structural integrity of the videos. A single pixel in the low resolution (LR) domain corresponds to 256 pixels in the high resolution (HR) domain. Due to this massive information loss, it is hard to accurately restore the missing information. Track 1 is set up to gauge the state of the art for such a demanding task, where fidelity to the ground truth is measured by PSNR and SSIM. Perceptually higher quality can be achieved in trade off for fidelity by generating plausible high frequency content. Track 2 therefore aims at generating visually pleasing results, which are ranked according to human perception, evaluated by a user study. In contrast to single image super resolution (SISR), VSR can benefit from additional information in the temporal domain. However, this also imposes an additional requirement, as the generated frames need to be consistent along time.


Electro magneto mechanically response of polycrystalline materials Computational Homogenization via the Virtual Element Method. This work presents a study on the computational homogenization of electro magneto mechanically coupled problems through the Virtual Element Method (VEM). VE approaches have great potential for the homogenization of the physical properties of heterogeneous polycrystalline microstructures with anisotropic grains. The flexibility in element shapes can be exploited for creating VE mesh with a significant lower number of degrees of freedom if compared to finite element (FE) meshes, while maintaining a high accuracy. Evidence that VE approaches outperform FEM are available in the literature, but only addressing purely mechanic problems (i.e. elastic properties) and transversely anisotropic materials. The aim of this work is twofold. On one hand, the study compares VE and FE based numerical homogenization schemes for electro mechanically coupled problems for different crystal lattice structures and degrees of elastic anisotropy. Within all considered materials, the VE approach outperforms the FE approach for the same number of nodes. On the other hand a hybrid microstructure made up by both electro mechanical and magneto mechanical grains is investigated resulting in a electro magneto mechanically coupled microstructure. Again, VEM provides a more accurate solution strategy.


Slopes of links and signature formulas. We present a new invariant, called slope, of a colored link in an integral homology sphere and use this invariant to complete the signature formula for the splice of two links. We develop a number of ways of computing the slope and a few vanishing results. Besides, we discuss the concordance invariance of the slope and establish its close relation to the Conway polynomials, on the one hand, and to the Kojima Yamasaki eta function (in the univariate case) and Cochran invariants, on the other hand.


Bimodules of Banach space nest algebras. We extend to Banach space nest algebras the theory of essential supports and support function pairs of their bimodules, thereby obtaining Banach space counterparts of long established results for Hilbert space nest algebras. Namely, given a Banach space nest algebra mathcal A , we charaterise the maximal and the minimal mathcal A bimodules having a given essential support function or support function pair. These characterisations are complete except for the minimal mathcal A bimodule corresponding to a support function pair, in which case we make some headway. We also show that the weakly closed bimodules of a Banach space nest algebra are exactly those that are reflexive operator spaces. To this end, we crucially prove that reflexive bimodules determine uniquely a certain class of admissible support functions.


On Martingale Transformations of Multidimensional Brownian Motion. We describe the class of functions f R n to R m which transform a vector Brownian Motion into a martingale and use this description to give martingale characterization of the general measurable solution of the multidimensional Cauchy functional equation.


Sentiment Analysis for Arabic in Social Media Network A Systematic Mapping Study. With the expansion in tenders on the Internet and social media, Arabic Sentiment Analysis (ASA) has assumed a significant position in the field of text mining study and has since remained used to explore the sentiments of users about services, various products or topics conversed over the Internet. This mapping paper designs to comprehensively investigate the papers demographics, fertility, and directions of the ASA research domain. Furthermore, plans to analyze current ASA techniques and find movements in the research. This paper describes a systematic mapping study (SMS) of 51 primary selected studies (PSS) is handled with the approval of an evidence based systematic method to ensure handling of all related papers. The analyzed results showed the increase of both the ASA research area and numbers of publications per year since 2015. Three main research facets were found, i.e. validation, solution, and evaluation research, with solution research becoming more treatment than another research type. Therefore numerous contribution facets were singled out. In totality, the general demographics of the ASA research field were highlighted and discussed


Inter Region Affinity Distillation for Road Marking Segmentation. We study the problem of distilling knowledge from a large deep teacher network to a much smaller student network for the task of road marking segmentation. In this work, we explore a novel knowledge distillation (KD) approach that can transfer 'knowledge' on scene structure more effectively from a teacher to a student model. Our method is known as Inter Region Affinity KD (IntRA KD). It decomposes a given road scene image into different regions and represents each region as a node in a graph. An inter region affinity graph is then formed by establishing pairwise relationships between nodes based on their similarity in feature distribution. To learn structural knowledge from the teacher network, the student is required to match the graph generated by the teacher. The proposed method shows promising results on three large scale road marking segmentation benchmarks, i.e., ApolloScape, CULane and LLAMAS, by taking various lightweight models as students and ResNet 101 as the teacher. IntRA KD consistently brings higher performance gains on all lightweight models, compared to previous distillation methods. Our code is available at https github.com cardwing Codes for IntRA KD.


Linear quadratic mean field games with a major player The multi scale approach. This paper considers linear quadratic (LQ) mean field games with a major player and analyzes an asymptotic solvability problem. It starts with a large scale system of coupled dynamic programming equations and applies a re scaling technique introduced in Huang and Zhou (2018a, 2018b) to derive a set of Riccati equations in lower dimensions, the solvability of which determines the necessary and sufficient condition for asymptotic solvability. We next derive the mean field limit of the strategies and the value functions. Finally, we show that the two decentralized strategies can be interpreted as the best responses of a major player and a representative minor player embedded in an infinite population, which have the property of consistent mean field approximations.


Taking the pulse of COVID 19 A spatiotemporal perspective. The sudden outbreak of the Coronavirus disease (COVID 19) swept across the world in early 2020, triggering the lockdowns of several billion people across many countries, including China, Spain, India, the U.K., Italy, France, Germany, and most states of the U.S. The transmission of the virus accelerated rapidly with the most confirmed cases in the U.S., and New York City became an epicenter of the pandemic by the end of March. In response to this national and global emergency, the NSF Spatiotemporal Innovation Center brought together a taskforce of international researchers and assembled implemented strategies to rapidly respond to this crisis, for supporting research, saving lives, and protecting the health of global citizens. This perspective paper presents our collective view on the global health emergency and our effort in collecting, analyzing, and sharing relevant data on global policy and government responses, geospatial indicators of the outbreak and evolving forecasts in developing research capabilities and mitigation measures with global scientists, promoting collaborative research on outbreak dynamics, and reflecting on the dynamic responses from human societies.


Banach limits Some new thoughts and perspectives. The existence of a Banach limit as a translation invariant positive continuous linear functional on the space of bounded scalar sequences which is equal to 1 at the constant sequence (1,1,...,1,...) is proved in a first course on functional analysis as a consequence of the Hahn Banach extension theorem. Whereas its use as an important tool in classical summability theory together with its application in the existence of certain invariant measures on compact (metric) spaces is well known, a renewed interest in the theory of Banach limits has led to certain applications which have opened new vistas in the structure of Banach spaces. The paper is devoted to a discussion of certain developments, both classical and recent, surrounding the theory of Banach limits including the structure of the set of Banach limits with special emphasis on certain aspects of their applications to the existence of certain invariant measures, vector valued analogues of Banach limits, functional equations and in the structure theory of Banach spaces involving the existence of selectors of certain multi valued mappings into the metric space of non empty, convex, closed and bounded subsets of a Banach space with respect to the Hausdorff metric. The paper shall conclude with a brief description of some recent results of the author on the study of simultaneous continuous linear operators (linear selections) involving Hahn Banach extensions on spaces of Lipschitz functions on (subspaces of) Banach spaces. Some open problems that naturally arise in the study have also been included.


WAE Workload Automation Engine for CDN specialized Container Orchestration. Content Delivery Network (CDN) has been emerged as a compelling technology to provide efficient and scalable web services even under high client request. However, this leads to a dilemma between minimum deployment cost and robust service under heavy loads. To solve this problem, we propose the Workload Automation Engine (WAE) which enables dynamic resource management, automated scaling and rapid service deployment with least cost for CDN providers. Our modular design uses an algorithm to calculate the optimal assignment of virtual CDN functions such as streaming, progressive delivering and load balancer. In particular, we study on real CDN data which belongs to Medianova CDN Company in Turkey. Also we use Docker containerization as an underlying system. The results reveal that our containerized design reduces the latency and deployment cost by 45 and by 66 , respectively. Moreover, we obtain roughly 20 more CPU efficiency and 35 more utilized network.


Literal Encoding Text is a first class data encoding. Digital humanities are rooted in text analysis. However, most visualization paradigms use only categoric, ordered or quantitative data. Literal text must be considered a base data type to encode into visualizations. Literal text offers functional, perceptual, cognitive, semantic and operational benefits. These are briefly illustrated with a subset of sample visualizations focused on semantic word sequences, indicating benefits over standard graphs, maps, treemaps, bar charts and narrative layouts.


Immersion of gradient almost Yamabe solitons into warped product manifolds. The purpose of this article is to study the geometry of gradient almost Yamabe solitons immersed into warped product manifolds I times f M n whose potential is given by the height function from the immersion. First, we present some geometric rigidity on compact solitons due to a curvature condition on the warped product manifold. In the sequel, we investigate conditions for the existence of totally geodesic, totally umbilical and minimal solitons. Furthermore, in the scope of constant angle immersions, a classification of rotational gradient almost Yamabe soliton immersed into mathbb R times f mathbb R n is also made.


Almost uniform convergence in Wiener Wintner ergodic theorem. We extend almost everywhere convergence in Wiener Wintner ergodic theorem for sigma finite measure to a generally stronger almost uniform convergence and present a larger, universal, space for which this convergence holds. We then extend this result to the case with Besicovitch weights.


Joint Segmentation and Path Classification of Curvilinear Structures. Detection of curvilinear structures in images has long been of interest. One of the most challenging aspects of this problem is inferring the graph representation of the curvilinear network. Most existing delineation approaches first perform binary segmentation of the image and then refine it using either a set of hand designed heuristics or a separate classifier that assigns likelihood to paths extracted from the pixel wise prediction. In our work, we bridge the gap between segmentation and path classification by training a deep network that performs those two tasks simultaneously. We show that this approach is beneficial because it enforces consistency across the whole processing pipeline. We apply our approach on roads and neurons datasets.


Matroids over Skew Tracts. Matroids over tracts provide an algebraic framework simultaneously generalizing the notions of linear subspaces, matroids, oriented matroids, valuated matroids, phased matroids, and some other "matroids with extra structure", presented by Baker and Bowler. Pendavingh partially extended this theory to skew hyperfields. We extend this theory to matroids over skew tracts, which generalizes both the theory of matroids over tracts and the theory of weak matroids over skew hyperfields developed by Pendavingh. We give several axiom systems for such matroids and also show their cryptomorphism.


Hyper spectral NIR and MIR data and optimal wavebands for detection of apple tree diseases. Plant diseases can lead to dramatic losses in yield and quality of food, becoming a problem of high priority for farmers. Apple scab, moniliasis, and powdery mildew are the most significant apple tree diseases worldwide and may cause between 50 and 60 in yield losses annually they are controlled by fungicide use with huge financial and time expenses. This research proposes a modern approach for analyzing the spectral data in Near Infrared and Mid Infrared ranges of the apple tree diseases at different stages. Using the obtained spectra, we found optimal spectral bands for detecting particular disease and discriminating it from other diseases and healthy trees. The proposed instrument will provide farmers with accurate, real time information on different stages of apple tree diseases, enabling more effective timing, and selecting the fungicide application, resulting in better control and increasing yield. The obtained dataset, as well as scripts in Matlab for processing data and finding optimal spectral bands, are available via the link https yadi.sk d ZqfGaNlYVR3TUA


Finance from the viewpoint of physics. In this note we review the basic mathematical ideas used in finance in the language of modern physics. We focus on discrete time formalism, derive path integral and Green's function formulas for pricing. We also discuss various risk mitigation methods.


Improved energy production of multi rotor wind farms. The multi rotor (MR) wind turbine concept can be used to upscale wind turbines without increasing the rotor diameter, which can be beneficial for transport, manufacture and design of wind turbines blades. The rotor interaction of a MR wind turbine leads to a faster wake recovery compared to an equivalent single rotor (SR) wind turbine wake. In this article, the benefit of the faster wake recovery of MR wind turbines is quantified using Reynolds averaged Navier Stokes simulations of a 4x4 rectangular MR wind farm, for three different inter wind turbine spacings. The simulations predict an increase of 0.3 1.7 in annual energy production for the MR wind farm with respect to an equivalent SR wind farm, where the highest gain is obtained for the tightest inter wind turbine spacing. The gain in AEP is mainly caused by the aligned wind directions for the first downstream wind turbine in a wind turbine row of the MR wind farm, which is verified by an additional large eddy simulation.


A Question of Context Enhancing Intrusion Detection by Providing Context Information. Due to the fourth industrial revolution, and the resulting increase in interconnectivity, industrial networks are more and more opened to publicly available networks. Apart from the huge benefit in manageability and flexibility, the openness also results in a larger attack surface for malicious adversaries. In comparison to office environments, industrial networks have very high volumes of data. In addition to that, every delay will most likely lead to loss of revenue. Hence, intrusion detection systems for industrial applications have different requirements than office based intrusion detection systems. On the other hand, industrial networks are able to provide a lot of contextual information due to manufacturing execution systems and enterprise resource planning. Additionally, industrial networks tend to be more uniform, making it easier to determine outliers. In this work, an abstract simulation of industrial network behaviour is created. Malicious actions are introduced into a set of sequences of valid behaviour. Finally, a context based and context less intrusion detection system is used to find the attacks. The results are compared and commented. It can be seen that context information can help in identifying malicious actions more reliable than intrusion detection with only one source of information, e.g. the network.


A microscopic approach to study the onset of a highly infectious disease spreading. We combine a pedestrian dynamics model with a contact tracing method to simulate the initial spreading of a highly infectious airborne disease in a confined environment. We focus on a medium size population (up to 1000 people) with a small number of infectious people (1 or 2) and the rest of the people is divided between immune and susceptible. We adopt a space continuous model that represents pedestrian dynamics by the forces acting on them, i.e. a microscopic force based model. Once discretized, the model results in a high dimensional system of second order ordinary differential equations. Before adding the contact tracing to the pedestrian dynamics model, we calibrate the model parameters, validate the model against empirical data, and show that pedestrian self organization into lanes can be captured. We consider an explicit approach for contact tracing by introducing a sickness domain around a sick person. A healthy but susceptible person who remains in the sickness domain for a certain amount of time may get infected (with a prescribed probability) and become a so called secondary contact. As a concrete setting to simulate the onset of disease spreading, we consider terminals in two US airports Hobby Airport in Houston and the Atlanta International Airport. We consider different scenarios and we quantify the increase in average number of secondary contacts increases as a given terminal becomes more densely populated, the percentage of immune people decreases, the number of primary contacts increases, and areas of high density (such as the boarding buses) are present.


Adams' cobar construction revisited. We give a short and streamlined proof of the following statement recently proven by the author and M. Zeinalian the cobar construction of the dg coassociative coalgebra of normalized singular chains on a path connected pointed space is naturally quasi isomorphic as a dg associative algebra to the singular chains on the based loop space. This extends a classical theorem of F. Adams originally proven for simply connected spaces. Our proof is based on relating the cobar functor to the left adjoint of the homotopy coherent nerve functor.


Exploiting topology awareness for routing in LEO satellite constellations. Low Earth Orbit (LEO) satellite constellations combine great flexibility and global coverage with short propagation delays when compared to satellites deployed in higher orbits. However, the fast movement of the individual satellites makes inter satellite routing a complex and dynamic problem. In this paper, we investigate the limits of unipath routing in a scenario where ground stations (GSs) communicate with each other through a LEO constellation. For this, we present a lightweight and topology aware routing metric that favors the selection of paths with high data rate inter satellite links (ISLs). Furthermore, we analyze the overall routing latency in terms of propagation, transmission, and queueing times and calculate the maximum traffic load that can be supported by the constellation. In our setup, the traffic is injected by a network of GSs with real locations and is routed through adaptive multi rate inter satellite links (ISLs). Our results illustrate the benefits of exploiting the network topology, as the proposed metric can support up to 53 more traffic when compared to the selected benchmarks, and consistently achieves the shortest queueing times at the satellites and, ultimately, the shortest end to end latency.


High Performance Data Engineering Everywhere. The amazing advances being made in the fields of machine and deep learning are a highlight of the Big Data era for both enterprise and research communities. Modern applications require resources beyond a single node's ability to provide. However this is just a small part of the issues facing the overall data processing environment, which must also support a raft of data engineering for pre and post data processing, communication, and system integration. An important requirement of data analytics tools is to be able to easily integrate with existing frameworks in a multitude of languages, thereby increasing user productivity and efficiency. All this demands an efficient and highly distributed integrated approach for data processing, yet many of today's popular data analytics tools are unable to satisfy all these requirements at the same time. In this paper we present Cylon, an open source high performance distributed data processing library that can be seamlessly integrated with existing Big Data and AI ML frameworks. It is developed with a flexible C core on top of a compact data structure and exposes language bindings to C , Java, and Python. We discuss Cylon's architecture in detail, and reveal how it can be imported as a library to existing applications or operate as a standalone framework. Initial experiments show that Cylon enhances popular tools such as Apache Spark and Dask with major performance improvements for key operations and better component linkages. Finally, we show how its design enables Cylon to be used cross platform with minimum overhead, which includes popular AI tools such as PyTorch, Tensorflow, and Jupyter notebooks.