Propagation of weakly stretched premixed spherical spray flames in localized homogeneous and heterogeneous reactants. Propagation of weakly stretched spherical flames in partially pre vaporized fuel sprays is theoretically investigated in this work. A general theory is developed to describe flame propagation speed, flame temperature, droplet evaporation onset and completion locations. The influences of liquid fuel and gas mixture properties on spherical spray flame propagation are studied. The results indicate that the spray flame propagation speed is enhanced with increased droplet mass loading and or evaporation heat exchange coefficient (or evaporation rate). Opposite trends are found when the latent heat is high, due to strong evaporation heat absorption. Fuel vapor and temperature gradients are observed in the post flame evaporation zone of heterogeneous flames. Evaporation completion front location considerably changes with flame radius, but the evaporation onset location varies little relative to the flame front when the flame propagates. For larger droplet loading and smaller evaporation rate, the fuel droplet tends to complete evaporation behind the flame front. Flame bifurcation occurs with high droplet mass loading under large latent heat, leading to multiplicity of flame propagation speed, droplet evaporation onset and completion fronts. The flame enhancement or weakening effects by the fuel droplet sprays are revealed by enhanced or suppressed heat and mass diffusion process in the pre flame zone. Besides, for heterogeneous flames, heat and mass diffusion in the post flame zone also exists. The mass diffusion for both homogeneous and heterogeneous flames is enhanced with decreased Lewis number. The magnitude of Markstein length is considerably reduced with increased droplet loading. Moreover, post flame droplet burning behind heterogeneous flame influences the flame propagation speed and Markstein length when the liquid fuel loading is relatively low.


Can Multilingual Language Models Transfer to an Unseen Dialect? A Case Study on North African Arabizi. Building natural language processing systems for non standardized and low resource languages is a difficult challenge. The recent success of large scale multilingual pretrained language models provides new modeling tools to tackle this. In this work, we study the ability of multilingual language models to process an unseen dialect. We take user generated North African Arabic as our case study, a resource poor dialectal variety of Arabic with frequent code mixing with French and written in Arabizi, a non standardized transliteration of Arabic to Latin script. Focusing on two tasks, part of speech tagging and dependency parsing, we show in zero shot and unsupervised adaptation scenarios that multilingual language models are able to transfer to such an unseen dialect, specifically in two extreme cases (i) across scripts, using Modern Standard Arabic as a source language, and (ii) from a distantly related language, unseen during pretraining, namely Maltese. Our results constitute the first successful transfer experiments on this dialect, paving thus the way for the development of an NLP ecosystem for resource scarce, non standardized and highly variable vernacular languages.


Critical branching processes in random environment and Cauchy domain of attraction. We are interested in the survival probability of a population modeled by a critical branching process in an i.i.d. random environment. We assume that the random walk associated with the branching process is oscillating and satisfies a Spitzer condition mathbf P (S n 0) rightarrow rho , n rightarrow infty , which is a standard condition in fluctuation theory of random walks. Unlike the previously studied case rho in (0,1) , we investigate the case where the offspring distribution is in the domain of attraction of a stable law with parameter 1 , which implies that rho 0 or 1 . We find the asymptotic behaviour of the survival probability of the population in these two cases.


A steady stratified purely azimuthal flow representing the Antarctic Circumpolar Current. We construct an explicit steady stratified purely azimuthal flow for the governing equations of geophysical fluid dynamics. These equations are considered in a setting that applies to the Antarctic Circumpolar Current, accounting for eddy viscosity and forcing terms.


High Fidelity Video Prediction with Large Stochastic Recurrent Neural Networks. Predicting future video frames is extremely challenging, as there are many factors of variation that make up the dynamics of how frames change through time. Previously proposed solutions require complex inductive biases inside network architectures with highly specialized computation, including segmentation masks, optical flow, and foreground and background separation. In this work, we question if such handcrafted architectures are necessary and instead propose a different approach finding minimal inductive bias for video prediction while maximizing network capacity. We investigate this question by performing the first large scale empirical study and demonstrate state of the art performance by learning large models on three different datasets one for modeling object interactions, one for modeling human motion, and one for modeling car driving.


Upper bounds on the signed edge domination number of a graph. A signed edge domination function (or SEDF) of a simple graph G (V,E) is a function f E rightarrow 1, 1 such that sum e' in N e f(e') ge 1 holds for each edge e in E , where N e is the set of edges in G that share at least one endpoint with e . Let gamma s'(G) denote the minimum value of f(G) among all SEDFs f , where f(G) sum e in E f(e) .In 2005, Xu conjectured that gamma s'(G) le n 1 , where n is the order of G . This conjecture has been proved for the two cases v odd (G) 0 and v even (G) 0 , where v odd (G) (resp. v even (G) ) is the number of odd (resp. even) vertices in G . This article proves Xu's conjecture for v even (G) in 1, 2 . We also show that for any simple graph G of order n , gamma s'(G) le n v odd (G) 2 and gamma s'(G) le n 2 v even (G) when v even (G) 0 , and thus gamma s'(G) le (4n 2) 3 . Our result improves the best current upper bound of gamma s'(G) le lceil 3n 2 rceil .


Sparse Coding Driven Deep Decision Tree Ensembles for Nuclear Segmentation in Digital Pathology Images. In this paper, we propose an easily trained yet powerful representation learning approach with performance highly competitive to deep neural networks in a digital pathology image segmentation task. The method, called sparse coding driven deep decision tree ensembles that we abbreviate as ScD2TE, provides a new perspective on representation learning. We explore the possibility of stacking several layers based on non differentiable pairwise modules and generate a densely concatenated architecture holding the characteristics of feature map reuse and end to end dense learning. Under this architecture, fast convolutional sparse coding is used to extract multi level features from the output of each layer. In this way, rich image appearance models together with more contextual information are integrated by learning a series of decision tree ensembles. The appearance and the high level context features of all the previous layers are seamlessly combined by concatenating them to feed forward as input, which in turn makes the outputs of subsequent layers more accurate and the whole model efficient to train. Compared with deep neural networks, our proposed ScD2TE does not require back propagation computation and depends on less hyper parameters. ScD2TE is able to achieve a fast end to end pixel wise training in a layer wise manner. We demonstrated the superiority of our segmentation technique by evaluating it on the multi disease state and multi organ dataset where consistently higher performances were obtained for comparison against several state of the art deep learning methods such as convolutional neural networks (CNN), fully convolutional networks (FCN), etc.


Reversing Place Transition Nets. Petri nets are a well known model of concurrency and provide an ideal setting for the study of fundamental aspects in concurrent systems. Despite their simplicity, they still lack a satisfactory causally reversible semantics. We develop such semantics for Place Transitions Petri nets (P T nets) based on two observations. Firstly, a net that explicitly expresses causality and conflict among events, for example an occurrence net, can be straightforwardly reversed by adding a reverse transition for each of its forward transitions. Secondly, given a P T net the standard unfolding construction associates with it an occurrence net that preserves all of its computation. Consequently, the reversible semantics of a P T net can be obtained as the reversible semantics of its unfolding. We show that such reversible behaviour can be expressed as a finite net whose tokens are coloured by causal histories. Colours in our encoding resemble the causal memories that are typical in reversible process calculi.


Duality of one variable multiple polylogarithms and their q analogues. The duality relation of one variable multiple polylogarithms was proved by Hirose, Iwaki, Sato and Tasaka by means of iterated integrals. In this paper, we give a new proof using the method of connected sums, which was recently invented by Seki and the author. Interestingly, the connected sum involves the hypergeometric function in its connector. Moreover, we introduce two kinds of q analogues of the one variable multiple polylogarithms and generalize the duality to them.


Sketchformer Transformer based Representation for Sketched Structure. Sketchformer is a novel transformer based representation for encoding free hand sketches input in a vector form, i.e. as a sequence of strokes. Sketchformer effectively addresses multiple tasks sketch classification, sketch based image retrieval (SBIR), and the reconstruction and interpolation of sketches. We report several variants exploring continuous and tokenized input representations, and contrast their performance. Our learned embedding, driven by a dictionary learning tokenization scheme, yields state of the art performance in classification and image retrieval tasks, when compared against baseline representations driven by LSTM sequence to sequence architectures SketchRNN and derivatives. We show that sketch reconstruction and interpolation are improved significantly by the Sketchformer embedding for complex sketches with longer stroke sequences.


The Picone identity A device to get optimal uniqueness results and global dynamics in Population Dynamics. This paper infers from a generalized Picone identity the uniqueness of the stable positive solution for a class of semilinear equations of superlinear indefinite type, as well as the uniqueness and global attractivity of the coexistence state in two generalized diffusive prototypes of the symbiotic and competing species models of Lotka Volterra. The optimality of these uniqueness theorems reveals the tremendous strength of the Picone identity.


Dynamic Graph Embedding via LSTM History Tracking. Many real world networks are very large and constantly change over time. These dynamic networks exist in various domains such as social networks, traffic networks and biological interactions. To handle large dynamic networks in downstream applications such as link prediction and anomaly detection, it is essential for such networks to be transferred into a low dimensional space. Recently, network embedding, a technique that converts a large graph into a low dimensional representation, has become increasingly popular due to its strength in preserving the structure of a network. Efficient dynamic network embedding, however, has not yet been fully explored. In this paper, we present a dynamic network embedding method that integrates the history of nodes over time into the current state of nodes. The key contribution of our work is 1) generating dynamic network embedding by combining both dynamic and static node information 2) tracking history of neighbors of nodes using LSTM 3) significantly decreasing the time and memory by training an autoencoder LSTM model using temporal walks rather than adjacency matrices of graphs which are the common practice. We evaluate our method in multiple applications such as anomaly detection, link prediction and node classification in datasets from various domains.


An elliptic partial differential equations system and its application. This paper deals with the existence of solutions for an elliptic system of partial differential equations. The solution method is based on the sub and super solutions approach. An application to a stochastic control problem is presented. This system seemed not considered before.


Travel Time Estimation without Road Networks An Urban Morphological Layout Representation Approach. Travel time estimation is a crucial task for not only personal travel scheduling but also city planning. Previous methods focus on modeling toward road segments or sub paths, then summing up for a final prediction, which have been recently replaced by deep neural models with end to end training. Usually, these methods are based on explicit feature representations, including spatio temporal features, traffic states, etc. Here, we argue that the local traffic condition is closely tied up with the land use and built environment, i.e., metro stations, arterial roads, intersections, commercial area, residential area, and etc, yet the relation is time varying and too complicated to model explicitly and efficiently. Thus, this paper proposes an end to end multi task deep neural model, named Deep Image to Time (DeepI2T), to learn the travel time mainly from the built environment images, a.k.a. the morphological layout images, and showoff the new state of the art performance on real world datasets in two cities. Moreover, our model is designed to tackle both path aware and path blind scenarios in the testing phase. This work opens up new opportunities of using the publicly available morphological layout images as considerable information in multiple geography related smart city applications.


A Line Search Descent Algorithm for Strict Saddle Functions with Complexity Guarantees. We describe a line search algorithm which achieves the best known worst case complexity results for problems with a certain "strict saddle" property that has been observed to hold in low rank matrix optimization problems. Our algorithm is adaptive, in the sense that it makes use of backtracking line searches and does not require prior knowledge of the parameters that define the strict saddle property.


Ribbon Complexes their Approximate Descriptive Proximities. Ribbon Vortex Nerves, Betti Numbers and Planar Divisions. This article introduces planar ribbons, Vergili ribbon complexes and ribbon nerves in Alexandroff Hopf Whitehead CW (Closure finite Weak) topological spaces. A em planar ribbon (briefly, ribbon ) in a CW space is the closure of a pair of nesting, non concentric filled cycles that includes the boundary but does not include the interior of the inner cycle. Each planar ribbon has its own distinctive shape determined by its outer and inner boundaries and the interior within its boundaries. A Vergili ribbon complex (briefly, ribbon complex) in a CW space is a non void collection of countable planar ribbons. A ribbon nerve is a nonvoid collection of planar ribbons (members of a ribbon complex) that have nonempty intersection. A planar CW space is a non void collection of cells (vertexes, edges and filled triangles) that may or may not be attached to other and which satisfy Alexandroff Hopf Whitehead containment and intersection conditions. In the context of CW spaces, planar ribbons, ribbon complexes and ribbon nerves are characterized by Betti numbers derived from standard Betti numbers mathcal B 0 (cell count), mathcal B 1 (cycle count) and mathcal B 2 (hole count), namely, mathcal B rb and mathcal B rbNrv introduced in this paper. Results are given for collections of ribbons and ribbon nerves in planar CW spaces equipped with an approximate descriptive proximity, division of the plane into three bounded regions by a ribbon and Brouwer fixed points on ribbons. In addition, the homotopy types of ribbons and ribbon nerves are introduced.


Monocular 3D Object Detection via Geometric Reasoning on Keypoints. Monocular 3D object detection is well known to be a challenging vision task due to the loss of depth information attempts to recover depth using separate image only approaches lead to unstable and noisy depth estimates, harming 3D detections. In this paper, we propose a novel keypoint based approach for 3D object detection and localization from a single RGB image. We build our multi branch model around 2D keypoint detection in images and complement it with a conceptually simple geometric reasoning method. Our network performs in an end to end manner, simultaneously and interdependently estimating 2D characteristics, such as 2D bounding boxes, keypoints, and orientation, along with full 3D pose in the scene. We fuse the outputs of distinct branches, applying a reprojection consistency loss during training. The experimental evaluation on the challenging KITTI dataset benchmark demonstrates that our network achieves state of the art results among other monocular 3D detectors.


Lipschitz stability for an inverse source scattering problem at a fixed frequency. This paper is concerned with an inverse source problem for the three dimensional Helmholtz equation by a single boundary measurement at a fixed frequency. We show the Lipschitz stability under the assumption that the source function is piecewise constant on a domain which is made of a union of disjoint convex polyhedral subdomains..


On Lipschitz free spaces over spheres of Banach spaces. We prove that, for each Banach space X which is isomorphic to its hyperplanes, the Lipschitz free spaces over X and over its sphere are isomorphic.


Log canonical 3 fold complements. We expand the theory of log canonical 3 fold complements. We prove that if X rightarrow T is a 3 dimensional contraction of log Calabi Yau type, then we can find B geq 0 on X for which (X,B) is log canonical and n(K X B) sim T 0 , where n is an uniform natural number. This means that every 3 fold of log Calabi Yau type can be turned into a log Calabi Yau pair in an effective way.


Lexicon constrained Copying Network for Chinese Abstractive Summarization. Copy mechanism allows sequence to sequence models to choose words from the input and put them directly into the output, which is finding increasing use in abstractive summarization. However, since there is no explicit delimiter in Chinese sentences, most existing models for Chinese abstractive summarization can only perform character copy, resulting in inefficient. To solve this problem, we propose a lexicon constrained copying network that models multi granularity in both encoder and decoder. On the source side, words and characters are aggregated into the same input memory using a Transformerbased encoder. On the target side, the decoder can copy either a character or a multi character word at each time step, and the decoding process is guided by a word enhanced search algorithm that facilitates the parallel computation and encourages the model to copy more words. Moreover, we adopt a word selector to integrate keyword information. Experiments results on a Chinese social media dataset show that our model can work standalone or with the word selector. Both forms can outperform previous character based models and achieve competitive performances.


Large Scale Deterministic Networking A Simulation Evaluation. The use of Ethernet switched networks usually involves best effort service. A recent effort by the IEEE 802.1 3 TSN group has sought to standardize the Ethernet data link protocol such that it operates on a deterministic service in addition to the best effort service targeting Operational Technology applications, e.g., industrial control systems. This paper investigates the Cyclic Queueing and Forwarding (CQF) and Paternoster scheduling protocols in a typical industrial control loop with varying propagation delays emulating large scale networks. Our main findings for CQF and Paternoster are that CQF has an advantage towards real time streams with hard deadlines whilst Paternoster is for streams with more relaxed deadlines but can operate without time synchronization.


RAUNet Residual Attention U Net for Semantic Segmentation of Cataract Surgical Instruments. Semantic segmentation of surgical instruments plays a crucial role in robot assisted surgery. However, accurate segmentation of cataract surgical instruments is still a challenge due to specular reflection and class imbalance issues. In this paper, an attention guided network is proposed to segment the cataract surgical instrument. A new attention module is designed to learn discriminative features and address the specular reflection issue. It captures global context and encodes semantic dependencies to emphasize key semantic features, boosting the feature representation. This attention module has very few parameters, which helps to save memory. Thus, it can be flexibly plugged into other networks. Besides, a hybrid loss is introduced to train our network for addressing the class imbalance issue, which merges cross entropy and logarithms of Dice loss. A new dataset named Cata7 is constructed to evaluate our network. To the best of our knowledge, this is the first cataract surgical instrument dataset for semantic segmentation. Based on this dataset, RAUNet achieves state of the art performance 97.71 mean Dice and 95.62 mean IOU.


Learning with Average Precision Training Image Retrieval with a Listwise Loss. Image retrieval can be formulated as a ranking problem where the goal is to order database images by decreasing similarity to the query. Recent deep models for image retrieval have outperformed traditional methods by leveraging ranking tailored loss functions, but important theoretical and practical problems remain. First, rather than directly optimizing the global ranking, they minimize an upper bound on the essential loss, which does not necessarily result in an optimal mean average precision (mAP). Second, these methods require significant engineering efforts to work well, e.g. special pre training and hard negative mining. In this paper we propose instead to directly optimize the global mAP by leveraging recent advances in listwise loss formulations. Using a histogram binning approximation, the AP can be differentiated and thus employed to end to end learning. Compared to existing losses, the proposed method considers thousands of images simultaneously at each iteration and eliminates the need for ad hoc tricks. It also establishes a new state of the art on many standard retrieval benchmarks. Models and evaluation scripts have been made available at https europe.naverlabs.com Deep Image Retrieval


Perfect colorings of the infinite square grid coverings and twin colors. A perfect coloring (equivalent concepts are equitable partition and partition design) of a graph G is a function f from the set of vertices onto some finite set (of colors) such that every node of color i has exactly S(i,j) neighbors of color j , where S(i,j) are constants, forming the matrix S called quotient. If S is an adjacent matrix of some simple graph T on the set of colors, then f is called a covering of the target graph T by the cover graph G . We characterize all coverings by the infinite square grid, proving that every such coloring is either orbit (that is, corresponds to the orbit partition under the action of some group of graph automorphisms) or has twin colors (that is, two colors such that identifying them keeps the coloring perfect). The case of twin colors is separately classified. Keywords perfect coloring, equitable partition, square grid, rectangular grid


On the canonical, fpqc, and finite topologies on affine schemes. The state of the art. This is a systematic study of the behaviour of finite coverings of (affine) schemes with regard to two Grothendieck topologies the canonical topology and the fpqc topology. The history of the problem takes roots in the foundations of Grothendieck topologies, passes through main strides in Commutative Algebra and leads to new Mathematics up to perfectoids and prisms. We first review the canonical topology of affine schemes and show, keeping with Olivier's lost work, that it coincides with the effective descent topology covering maps are given by universally injective ring maps, which we discuss in detail. We then give a "catalogue raisonn 'e" of examples of finite coverings which separate the canonical, fpqc and fppf topologies. The key result is that finite coverings of regular schemes are coverings for the canonical topology, and even for the fpqc topology (but not necessarily for the fppf topology). We discuss a "weakly functorial" aspect of this result. "Splinters" are those affine Noetherian schemes for which every finite covering is a covering for the canonical topology. We also investigate their mysterious fpqc analogs, and prove that in prime characteristic, they are all regular. This leads us to the problem of descent of regularity by (non necessarily flat) morphisms f which are coverings for the fpqc topology, which is settled thanks to a recent theorem of Bhatt Iyengar Ma.


Meta Reinforced Synthetic Data for One Shot Fine Grained Visual Recognition. One shot fine grained visual recognition often suffers from the problem of training data scarcity for new fine grained classes. To alleviate this problem, an off the shelf image generator can be applied to synthesize additional training images, but these synthesized images are often not helpful for actually improving the accuracy of one shot fine grained recognition. This paper proposes a meta learning framework to combine generated images with original images, so that the resulting hybrid'' training images can improve one shot learning. Specifically, the generic image generator is updated by a few training instances of novel classes, and a Meta Image Reinforcing Network (MetaIRNet) is proposed to conduct one shot fine grained recognition as well as image reinforcement. The model is trained in an end to end manner, and our experiments demonstrate consistent improvement over baselines on one shot fine grained image classification benchmarks.


Adversarial Incremental Learning. Although deep learning performs really well in a wide variety of tasks, it still suffers from catastrophic forgetting the tendency of neural networks to forget previously learned information upon learning new tasks where previous data is not available. Earlier methods of incremental learning tackle this problem by either using a part of the old dataset, by generating exemplars or by using memory networks. Although, these methods have shown good results but using exemplars or generating them, increases memory and computation requirements. To solve these problems we propose an adversarial discriminator based method that does not make use of old data at all while training on new tasks. We particularly tackle the class incremental learning problem in image classification, where data is provided in a class based sequential manner. For this problem, the network is trained using an adversarial loss along with the traditional cross entropy loss. The cross entropy loss helps the network progressively learn new classes while the adversarial loss helps in preserving information about the existing classes. Using this approach, we are able to outperform other state of the art methods on CIFAR 100, SVHN, and MNIST datasets.


Deep Neural Network Based Real time Kiwi Fruit Flower Detection in an Orchard Environment. In this paper, we present a novel approach to kiwi fruit flower detection using Deep Neural Networks (DNNs) to build an accurate, fast, and robust autonomous pollination robot system. Recent work in deep neural networks has shown outstanding performance on object detection tasks in many areas. Inspired this, we aim for exploiting DNNs for kiwi fruit flower detection and present intensive experiments and their analysis on two state of the art object detectors Faster R CNN and Single Shot Detector (SSD) Net, and feature extractors Inception Net V2 and NAS Net with real world orchard datasets. We also compare those approaches to find an optimal model which is suitable for a real time agricultural pollination robot system in terms of accuracy and processing speed. We perform experiments with dataset collected from different seasons and locations (spatio temporal consistency) in order to demonstrate the performance of the generalized model. The proposed system demonstrates promising results of 0.919, 0.874, and 0.889 for precision, recall, and F1 score respectively on our real world dataset, and the performance satisfies the requirement for deploying the system onto an autonomous pollination robotics system.


SCGDet Malware Detection using Semantic Features Based on Reachability Relation. Recently, with the booming development of software industry, more and more malware variants are designed to perform malicious behaviors. The evolution of malware makes it difficult to detect using traditional signature based methods. Moreover, malware detection has important effect on system security. In this paper, we present SCGDet, which is a novel malware detection method based on system call graph model (SCGM). We first develop a system call pruning method, which can exclude system calls that have little impact on malware detection. Then we propose the SCGM, which can capture the semantic features of run time program by grouping the system calls based on the reachability relation. We aim to obtain the generic representation of malicious behaviors with similar system call patterns. We evaluate the performance of SCGDet using different machine learning algorithms on the dataset including 854 malware samples and 740 benign samples. Compared with the traditional n gram method, the SCGDet has the smaller feature space, the higher detection accuracy and the lower false positives. Experimental results show that SCGDet can reduce the average FPR of 14.75 and improve the average Accuracy of 8.887 , and can obtain a TPR of 97.44 , an FPR of 1.96 and an Accuracy of 97.78 in the best case.


Insights into the shockwave attenuation in miniature shock tubes. Miniature shock tubes are finding growing importance in a variety of interdisciplinary applications. There is a lack of experimental data to validate the existing shock tube flow models that explain the shockwave attenuation in pressure driven miniature shock tubes. This paper gives insights into the shock formation and shock propagation phenomena in miniature shock tubes of 2mm, 6mm, and 10mm square cross sections operated at diaphragm rupture pressure ratios in the range 5 25 and driven section initially at ambient conditions. Pressure measurements and visualization studies are carried out in a new miniature table top shock tube system using nitrogen and helium as driver gases. The experimental findings are validated using a shock tube model explained in terms of two regions (1) The shock formation region, dominated by wave interactions due to the diaphragm's finite rupture time. (2) The shock propagation region, where the shockwave attenuation occurs mainly due to wall effects and boundary layer growth. Correlations to predict the variation of shock Mach number in the shock formation region and shock propagation region work well for the present findings and experimental data reported in the literature. Similar flow features are observed in the shock tubes at the same dimensionless time stamps. The formation of the planar shock front scales proportionally with the diameter of the shock tube. The peak Mach number attained by the shockwave is higher as the shock tube diameter increases.


Comparison of classical reaction paths and tunneling paths studied with the semiclassical instanton theory. Atom tunneling in the hydrogen atom transfer reaction of the 2,4,6 tri tert butylphenyl radical to 3,5 di tert butylneophyl, which has a short but strongly curved reaction path, was investigated using instanton theory. We found the tunneling path to deviate qualitatively from the classical intrinsic reaction coordinate, the steepest descent path in mass weighted Cartesian coordinates. To perform that comparison, we implemented a new variant of the predictor corrector algorithm for the calculation of the intrinsic reaction coordinate. We used the reaction force analysis method as a means to decompose the reaction barrier into structural and electronic components. Due to the narrow energy barrier, atom tunneling is important in the abovementioned reaction, even above room temperature. Our calculated rate constants between 350 K and 100 K agree well with experimental values. We found a H D kinetic isotope effect of almost 106 at 100 K. Tunneling dominates the protium transfer below 400 K and the deuterium transfer below 300 K. We compared the lengths of the tunneling path and the classical path for the hydrogen atom transfer in the reaction HCl Cl and quantified the corner cutting in this reaction. At low temperature, the tunneling path is about 40 shorter than the classical path.


Finite Time Analysis of Stochastic Gradient Descent under Markov Randomness. Motivated by broad applications in reinforcement learning and machine learning, this paper considers the popular stochastic gradient descent (SGD) when the gradients of the underlying objective function are sampled from Markov processes. This Markov sampling leads to the gradient samples being biased and not independent. The existing results for the convergence of SGD under Markov randomness are often established under the assumptions on the boundedness of either the iterates or the gradient samples. Our main focus is to study the finite time convergence of SGD for different types of objective functions, without requiring these assumptions. We show that SGD converges nearly at the same rate with Markovian gradient samples as with independent gradient samples. The only difference is a logarithmic factor that accounts for the mixing time of the Markov chain.


On the worst case error of least squares algorithms for L 2 approximation with high probability. It was recently shown in 4 that, for L 2 approximation of functions from a Hilbert space, function values are almost as powerful as arbitrary linear information, if the approximation numbers are square summable. That is, we showed that e n , lesssim , sqrt frac 1 k n sum j geq k n a j 2 qquad text with quad k n asymp frac n ln(n) , where e n are the sampling numbers and a k are the approximation numbers. In particular, if (a k) in ell 2 , then e n and a n are of the same polynomial order. For this, we presented an explicit (weighted least squares) algorithm based on i.i.d. random points and proved that this works with positive probability. This implies the existence of a good deterministic sampling algorithm. Here, we present a modification of the proof in 4 that shows that the same algorithm works with probability at least 1 n c for all c 0 .


Hypersimplicial subdivisions. Let pi mathbb R n to mathbb R d be any linear projection, let A be the image of the standard basis. Motivated by Postnikov's study of postitive Grassmannians via plabic graphs and Galashin's connection of plabic graphs to slices of zonotopal tilings of 3 dimensional cyclic zonotopes, we study the poset of subdivisions induced by the restriction of pi to the k th hypersimplex, for k 1, dots,n 1 . We show that For arbitrary A and for k le d 1 , the corresponding fiber polytope mathcal F (k) (A) is normally isomorphic to the Minkowski sum of the secondary polytopes of all subsets of A of size max d 2,n k 1 . When A mathbf P n is the vertex set of an n gon, we answer the Baues question in the positive the inclusion of the poset of pi coherent subdivisions into the poset of all pi induced subdivisions is a homotopy equivalence. When A mathbf C (n,d) is the vertex set of a cyclic d polytope with d odd and any n ge d 3 , there are non lifting (and even more so, non separated) pi induced subdivisions for k 2 .


Global solvability, stability and oscillation criteria for systems of two first order pseudo linear ordinary differential equations. In this paper we use the Riccati equation method with other ones to establish global solvability, stability and oscillation criteria for a class of two dimensional nonlinear systems of ordinary differential equations, which is a generalization of wide classes of second order nonlinear ordinary differential equations, studied by many authors. The applicability of some of these criteria are illustrated by examples.


Fast Cartesian Tree Matching. Cartesian tree matching is the problem of finding all substrings of a given text which have the same Cartesian trees as that of a given pattern. So far there is one linear time solution for Cartesian tree matching, which is based on the KMP algorithm. We improve the running time of the previous solution by introducing new representations. We present the framework of a binary filtration method and an efficient verification technique for Cartesian tree matching. Any exact string matching algorithm can be used as a filtration for Cartesian tree matching on our framework. We also present a SIMD solution for Cartesian tree matching suitable for short patterns. By experiments we show that known string matching algorithms combined on our framework of binary filtration and efficient verification produce algorithms of good performances for Cartesian tree matching.


Measurement of Interpersonal Trust in Global Software Development SLR Protocol. The purpose of this protocol is to be useful to identify, evaluate and synthesize reported knowledge about the measurement of interpersonal trust (IpT) in virtual software teams. To achieve this goal we applied a research technique known as Systematic Literature Review (SLR). The aim of a SLR is to be as objective, analytical, and repeatable as possible.


LiPo LCD Combining Lines and Points for Appearance based Loop Closure Detection. Visual SLAM approaches typically depend on loop closure detection to correct the inconsistencies that may arise during the map and camera trajectory calculations, typically making use of point features for detecting and closing the existing loops. In low textured scenarios, however, it is difficult to find enough point features and, hence, the performance of these solutions drops drastically. An alternative for human made scenarios, due to their structural regularity, is the use of geometrical cues such as straight segments, frequently present within these environments. Under this context, in this paper we introduce LiPo LCD, a novel appearance based loop closure detection method that integrates lines and points. Adopting the idea of incremental Bag of Binary Words schemes, we build separate BoW models for each feature, and use them to retrieve previously seen images using a late fusion strategy. Additionally, a simple but effective mechanism, based on the concept of island, groups similar images close in time to reduce the image candidate search effort. A final step validates geometrically the loop candidates by incorporating the detected lines by means of a process comprising a line feature matching stage, followed by a robust spatial verification stage, now combining both lines and points. As it is reported in the paper, LiPo LCD compares well with several state of the art solutions for a number of datasets involving different environmental conditions.


Applications of Siegel's Lemma to a system of linear forms and its minimal points. Consider a real matrix Theta consisting of rows ( theta i,1 , ldots, theta i,n ) , for 1 leq i leq m . The problem of making the system linear forms x 1 theta i,1 cdots x n theta i,n y i for integers x j ,y i small naturally induces an ordinary and a uniform exponent of approximation, denoted by w( Theta) and widehat w ( Theta) respectively. For m 1 , a sharp lower bound for the ratio w( Theta) widehat w ( Theta) was recently established by Marnat and Moshchevitin. We give a short, new proof of this result upon a hypothesis on the best approximation integer vectors associated to Theta . Our conditional result extends to general m 1 (but may not be optimal in this case). Moreover, our hypothesis is always satisfied in particular for m 1, n 2 and thereby unconditionally confirms a previous observation of Jarn 'ik. We formulate our results in the more general context of approximation of subspaces of Euclidean spaces by lattices. We further establish criteria upon which a given number ell of consecutive best approximation vectors are linearly independent. Our method is based on Siegel's Lemma.


Weakly Nuclear Maps on Real C algebras and Quasidiagonality of These Algebras. In this paper, we show that a completely positive linear map is weakly nuclear if and only if its complexification is weakly nuclear. It is shown that a real C algebra is exact if and only if its complexification is exact and similar case is provided for the quasidiaginality.


Compositions with 3 Pairwise Coprime Parts. How many ways can we write n as a sum of 3 positive integers, no pair of which share a common factor? We express this quantity in terms of the number of solutions to a certain class of linear Diophantine equations. This allows us to show that there are prod p mid n left( 1 frac 1 p 2 right) prod q nmid n left( 1 frac 3 q 2 right) frac n 2 2 O(n 3 2 o(1) ) such compositions, where the products are over primes that respectively do and don't divide n . This strengthens the previous result of Bubbolini, Luca, and Spiga (arXiv 1202.1670)


Learning Spoken Language Representations with Neural Lattice Language Modeling. Pre trained language models have achieved huge improvement on many NLP tasks. However, these methods are usually designed for written text, so they do not consider the properties of spoken language. Therefore, this paper aims at generalizing the idea of language model pre training to lattices generated by recognition systems. We propose a framework that trains neural lattice language models to provide contextualized representations for spoken language understanding tasks. The proposed two stage pre training approach reduces the demands of speech data and has better efficiency. Experiments on intent detection and dialogue act recognition datasets demonstrate that our proposed method consistently outperforms strong baselines when evaluated on spoken inputs. The code is available at https github.com MiuLab Lattice ELMo.


Performance Studies of the p spray p stop implanted Si Sensors for the SiD Detector. Silicon Detector (SiD) is one of the proposed detector for future e e Linear colliders, like International Linear Collider (ILC). The estimated neutron background for ILC is around 1 1.6 x 1010 1 MeV equivalent neutrons cm 2 year 1 for the Si micro strip sensors to be used in the innermost vertex detector. The p n n double sided Si strip sensors are supposed to be used as position sensitive sensors for SiD. On the n n side of these sensors, shorting due to electron accumulation leads to uniform spreading of signal over all the n strips. Hence inter strip isolation becomes one of the major technological challenges. One of the attractive methods to achieve the inter strip isolation is the use of uniform p type implant on the silicon surface (p spray). Another alternative is the use of floating p type implants that surround the n strips (p stop). However, the high electric fields at the edge of the p spray p stop have been shown to induce pre breakdown micro discharge. An optimization of the implant dose profile of the p spray and p stop is required to achieve good electrical isolation while ensuring satisfactory breakdown performance of the Si sensors. In the present work, we report the preliminary results of simulation study performed on the n n Si sensors, equipped with p spray and p stops, using SILVACO tools.


Adapting Security Warnings to Counter Online Disinformation. Disinformation is proliferating on the internet, and platforms are responding by attaching warnings to content. There is little evidence, however, that these warnings help users identify or avoid disinformation. In this work, we adapt methods and results from the information security warning literature in order to design and evaluate effective disinformation warnings. In an initial laboratory study, we used a simulated search task to examine contextual and interstitial disinformation warning designs. We found that users routinely ignore contextual warnings, but users notice interstitial warnings and respond by seeking information from alternative sources. We then conducted a follow on crowdworker study with eight interstitial warning designs. We confirmed a significant impact on user information seeking behavior, and we found that a warning's design could effectively inform users or convey a risk of harm. We also found, however, that neither user comprehension nor fear of harm moderated behavioral effects. Our work provides evidence that disinformation warnings can when designed well help users identify and avoid disinformation. We show a path forward for designing effective warnings, and we contribute repeatable methods for evaluating behavioral effects. We also surface a possible dilemma disinformation warnings might be able to inform users and guide behavior, but the behavioral effects might result from user experience friction, not informed decision making.


On the embedding complexity of Liouville manifolds. We define a family of symplectic invariants which obstruct exact symplectic embeddings between Liouville manifolds, using the general formalism of linearized contact homology and its L infinity structure. As our primary application, we investigate embeddings between normal crossing divisor complements in complex projective space, giving a complete characterization in many cases. Our main embedding results are deduced explicitly from pseudoholomorphic curves, without appealing to Hamiltonian or virtual perturbations.


Text classification with pixel embedding. We propose a novel framework to understand the text by converting sentences or articles into video like 3 dimensional tensors. Each frame, corresponding to a slice of the tensor, is a word image that is rendered by the word's shape. The length of the tensor equals to the number of words in the sentence or article. The proposed transformation from the text to a 3 dimensional tensor makes it very convenient to implement an n gram model with convolutional neural networks for text analysis. Concretely, we impose a 3 dimensional convolutional kernel on the 3 dimensional text tensor. The first two dimensions of the convolutional kernel size equal the size of the word image and the last dimension of the kernel size is n . That is, every time when we slide the 3 dimensional kernel over a word sequence, the convolution covers n word images and outputs a scalar. By iterating this process continuously for each n gram along with the sentence or article with multiple kernels, we obtain a 2 dimensional feature map. A subsequent 1 dimensional max over time pooling is applied to this feature map, and three fully connected layers are used for conducting text classification finally. Experiments of several text classification datasets demonstrate surprisingly superior performances using the proposed model in comparison with existing methods.


Brain Connectomes Come of Age. Databases of directed and weighted connectivity for mouse, macaque and marmoset monkeys, have recently become available and begun to be used to build dynamical models. A hierarchical organization can be defined based on laminar patterns of cortical connections, possibly improved by thalamocortical projections. A large scale model of the macaque cortex endowed with a laminar structure accounts for layer dependent and frequency modulated interplays between bottom up and top down processes. Signal propagation in a version of the model with spiking neurons displays a threshold of stimulus amplitude for the activity to gain access to the prefrontal cortex, reminiscent of the ignition phenomenon associated with conscious perception. These two examples illustrate how connectomics may inform theory leading to discoveries. Computational modeling raises open questions for future empirical research, in a back and forth collaboration of experimentalists and theorists.


Simulation of optical lattice trap loading from a cold atomic ensemble. We model the efficiency of loading atoms of various species into a one dimensional optical lattice from a cold ensemble taking into account the initial cloud temperature and size, the lattice laser properties affecting the trapping potential, and atomic parameters. Stochastic sampling and dynamical evolution are used to simulate the transfer, leading to estimates of transfer efficiency for varying trap depth and profile. Tracing the motion of the atoms also enables the evaluation of the equilibrium temperature and site occupancy in the lattice. The simulation compares favourably against a number of experimental results, and is used to compute an optimum lattice waist to cloud radius ratio for a given optical power.


Evolving Academia Industry Relations in Computing Research. In 2015, the CCC co sponsored an industry round table that produced the document "The Future of Computing Research Industry Academic Collaborations". Since then, several important trends in computing research have emerged, and this document considers how those trends impact the interaction between academia and industry in computing fields. We reach the following conclusions In certain computing disciplines, such as currently artificial intelligence, we observe significant increases in the level of interaction between professors and companies, which take the form of extended joint appointments. Increasingly, companies are highly motivated to engage both professors and graduate students working in specific technical areas because companies view computing research and technical talent as a core aspect of their business success. There is also the further potential for principles and values from the academy (e.g., ethics, human centered approaches, etc.) informing products and R D roadmaps in new ways through these unique joint arrangements. This increasing connection between faculty, students, and companies has the potential to change (either positively or negatively) numerous things, including the academic culture in computing research universities, the research topics that faculty and students pursue, the ability of universities to train undergraduate and graduate students, etc. This report is the first step in engaging the broader computing research community, raising awareness of the opportunities, complexities and challenges of this trend but further work is required. We recommend follow up to measure the degree and impact of this trend and to establish best practices that are shared widely among computing research institutions.


Closed Quantum Black Scholes Quantum Drift and the Heisenberg Equation of Motion. In this article we model a financial derivative price as an observable on the market state function. We apply geometric techniques to integrating the Heisenberg Equation of Motion. We illustrate how the non commutative nature of the model introduces quantum interference effects that can act as either a drag or a boost on the resulting return. The ultimate objective is to investigate the nature of quantum drift in the Accardi Boukas quantum Black Scholes framework which involves modelling the financial market as a quantum observable, and introduces randomness through the Hudson Parthasarathy quantum stochastic calculus. In particular we aim to differentiate randomness that is introduced through external noise (quantum stochastic calculus) and randomness that is fundamental to a quantum system (Heisenberg Equation of Motion).


Comparative Bandwidth Analysis of Low Power Wireless IoT Switches. The article presents the research and comparative analysis of the bandwidth of low power wireless IoT devices as wireless switches. The following IoT devices were investigated Raspberry Pi 3 Model B and Raspberry Pi Zero W. The DS18B20 and INA219 sensors investigated and analyzed the dependence of FTP multimedia data transmission speed on wireless Wi Fi network on the temperature of the switch processor, temperature. The environment and the current and voltage consumed by the switch. Advantages of sensors with GPIO interface over analog meters for this experiment are revealed. Much of the work is devoted to the development of automation of results from GPIO interfaces, which helped eliminate human error and get more accurate metrics. Measurement automation was developed using Python 3.7 programming language. Using the INA219 library we were able to obtain current and voltage indicators from the ina219 board. To get temperature indicators sufficiently built into Python libraries to read temperature files in Raspbian. The article focuses on the synchronicity of measurement results records for more accurate analysis. Therefore, an FTP client was developed that measures the download speed of the file from the FTP server and records the results simultaneously with temperature, current and voltage measurements. To this end, attention is drawn to the multithreading in Python programming language and the transmission of commands using TCP sockets in that language. As a result, the dependence of the measured factors was calculated using the Pearson correlation formula. These measurement factors affect the autonomy and energy consumption, which is very important for IoT devices, and therefore, among the devices tested, recommendations were made regarding their choice when used depending on the conditions.


Billion scale semi supervised learning for image classification. This paper presents a study of semi supervised learning with large convolutional networks. We propose a pipeline, based on a teacher student paradigm, that leverages a large collection of unlabelled images (up to 1 billion). Our main goal is to improve the performance for a given target architecture, like ResNet 50 or ResNext. We provide an extensive analysis of the success factors of our approach, which leads us to formulate some recommendations to produce high accuracy models for image classification with semi supervised learning. As a result, our approach brings important gains to standard architectures for image, video and fine grained classification. For instance, by leveraging one billion unlabelled images, our learned vanilla ResNet 50 achieves 81.2 top 1 accuracy on the ImageNet benchmark.


The important consequences of the reversible heat production in nerves and the adiabaticity of the action potential. It has long been known that there is no measurable heat production associated with the nerve pulse. Rather, one finds that heat production is biphasic, and a heat release during the first phase of the action potential is followed by the reabsorption of a similar amount of heat during the second phase. We review the long history the measurement of heat production in nerves and provide a new analysis of these findings focusing on the thermodynamics of adiabatic and isentropic processes. We begin by considering adiabatic oscillations in gases, waves in layers, oscillations of springs and the reversible (or irreversible) charging and discharging of capacitors. We then apply these ideas to the heat signature of nerve pulses. Finally, we compare the temperature changes expected from the Hodgkin Huxley model and the soliton theory for nerves. We demonstrate that heat production in nerves cannot be explained as an irreversible charging and discharging of a membrane capacitor as it is proposed in the Hodgkin Huxley model. Instead, we conclude that it is consistent with an adiabatic pulse. However, if the nerve pulse is adiabatic, completely different physics is required to explain its features. Membrane processes must then be reversible and resemble the oscillation of springs more than resembling "a burning fuse of gunpowder" (quote A. L. Hodgkin). Theories acknowledging the adiabatic nature of the nerve pulse have recently been discussed by various authors. It forms the central core of the soliton model, which considers the nerve pulse as a localized sound pulse.


An Analytical Model for CBAP Allocations in IEEE 802.11ad. The IEEE 802.11ad standard extends WiFi operation to the millimeter wave frequencies, and introduces novel features concerning both the physical (PHY) and Medium Access Control (MAC) layers. However, while there are extensive research efforts to develop mechanisms for establishing and maintaining directional links for mmWave communications, fewer works deal with transmission scheduling and the hybrid MAC introduced by the standard. The hybrid MAC layer provides for two different kinds of resource allocations Contention Based Access Periods (CBAPs) and contention free Service Periods (SPs). In this paper, we propose a Markov Chain model to represent CBAPs, which takes into account operation interruptions due to scheduled SPs and the deafness and hidden node problems that directional communication exacerbates. We also propose a mathematical analysis to assess interference among stations. We derive analytical expressions to assess the impact of various transmission parameters and of the Data Transmission Interval configuration on some key performance metrics such as throughput, delay and packet dropping rate. This information may be used to efficiently design a transmission scheduler that allocates contention based and contention free periods based on the application requirements.


Robust Hierarchical Planning with Policy Delegation. We propose a novel framework and algorithm for hierarchical planning based on the principle of delegation. This framework, the Markov Intent Process, features a collection of skills which are each specialised to perform a single task well. Skills are aware of their intended effects and are able to analyse planning goals to delegate planning to the best suited skill. This principle dynamically creates a hierarchy of plans, in which each skill plans for sub goals for which it is specialised. The proposed planning method features on demand execution skill policies are only evaluated when needed. Plans are only generated at the highest level, then expanded and optimised when the latest state information is available. The high level plan retains the initial planning intent and previously computed skills, effectively reducing the computation needed to adapt to environmental changes. We show this planning approach is experimentally very competitive to classic planning and reinforcement learning techniques on a variety of domains, both in terms of solution length and planning time.


RNASeqR an R package for automated two group RNA Seq analysis workflow. RNA Seq analysis has revolutionized researchers' understanding of the transcriptome in biological research. Assessing the differences in transcriptomic profiles between tissue samples or patient groups enables researchers to explore the underlying biological impact of transcription. RNA Seq analysis requires multiple processing steps and huge computational capabilities. There are many well developed R packages for individual steps however, there are few R Bioconductor packages that integrate existing software tools into a comprehensive RNA Seq analysis and provide fundamental end to end results in pure R environment so that researchers can quickly and easily get fundamental information in big sequencing data. To address this need, we have developed the open source R Bioconductor package, RNASeqR. It allows users to run an automated RNA Seq analysis with only six steps, producing essential tabular and graphical results for further biological interpretation. The features of RNASeqR include six step analysis, comprehensive visualization, background execution version, and the integration of both R and command line software. RNASeqR provides fast, light weight, and easy to run RNA Seq analysis pipeline in pure R environment. It allows users to efficiently utilize popular software tools, including both R Bioconductor and command line tools, without predefining the resources or environments. RNASeqR is freely available for Linux and macOS operating systems from Bioconductor (https bioconductor.org packages release bioc html RNASeqR.html).


Assistive robot operated via P300 based Brain Computer Interface. In this paper we present an architecture for the operation of an assistive robot finally aimed at allowing users with severe motion disabilities to perform manipulation tasks that may help in daily life operations. The robotic system, based on a lightweight robot manipulator, receives high level commands from the user through a Brain Computer Interface based on P300 paradigm. The motion of the manipulator is controlled relying on a closed loop inverse kinematic algorithm that simultaneously manages multiple set based and equality based tasks. The software architecture is developed relying on widely used frameworks to operate BCIs and robots (namely, BCI2000 for the operation of the BCI and ROS for the control of the manipulator) integrating control, perception and communication modules developed for the application at hand. Preliminary experiments have been conducted to show the potentialities of the developed architecture.


Answering Regular Path Queries Over SQ Ontologies. We study query answering in the description logic mathcal SQ supporting qualified number restrictions on both transitive and non transitive roles. Our main contributions are a tree like model property for mathcal SQ knowledge bases and, building upon this, an optimal automata based algorithm for answering positive existential regular path queries in 2ExpTime.


Cancellations in the degree of the colored Jones polynomial. We give an alternate expansion of the colored Jones polynomial of pretzel links which recovers the degree formula in arXiv 1807.00957. As an application, we determine the degrees of the colored Jones polynomials of a new family of 3 tangle pretzel knots.


Solvable systems of two coupled first order ODEs with homogeneous cubic polynomial right hand sides. The solution x n left(t right) , n 1,2, of the textit initial values problem is reported of the textit autonomous system of 2 coupled first order ODEs with textit homogeneous cubic polynomial right hand sides, begin eqnarray dot x n c n1 left(x 1 right) 3 c n2 left( x 1 right) 2 x 2 c n3 x 1 left(x 2 right) 2 c n4 left(x 2 right) 3 , quad n 1,2 , nonumber end eqnarray when the 8 (time independent) coefficients c n ell are appropriately defined in terms of 7 textit arbitrary parameters, which then also identify the solution of this model. The inversion of these relations is also investigated, namely how to obtain, in terms of the 8 coefficients c n ell , the 7 parameters characterizing the solution of this model and 2 textit constraints are textit explicitly identified which, if satisfied by the 8 parameters c n ell , guarantee the textit solvability by algebraic operations of this dynamical system. Also identified is a related, textit appropriately modified , class of (generally textit complex ) systems, reading begin eqnarray dot tilde x n mathbf i omega tilde x n c n1 left( tilde x 1 right) 3 c n2 left( tilde x 1 right) 2 tilde x 2 c n3 tilde x 1 left( tilde x 2 right) 2 c n4 left( tilde x 2 right) 3 , quad n 1,2 , nonumber end eqnarray with mathbf i omega an textit arbitrary imaginary parameter, which feature the remarkable property to be textit isochronous , namely their textit generic solutions are as functions of textit real time textit completely periodic with a period which is, for each of these models, a textit fixed textit integer multiple of the basic period tilde T 2 pi left vert omega right vert .


The Russian Drug Reaction Corpus and Neural Models for Drug Reactions and Effectiveness Detection in User Reviews. The Russian Drug Reaction Corpus (RuDReC) is a new partially annotated corpus of consumer reviews in Russian about pharmaceutical products for the detection of health related named entities and the effectiveness of pharmaceutical products. The corpus itself consists of two parts, the raw one and the labelled one. The raw part includes 1.4 million health related user generated texts collected from various Internet sources, including social media. The labelled part contains 500 consumer reviews about drug therapy with drug and disease related information. Labels for sentences include health related issues or their absence. The sentences with one are additionally labelled at the expression level for identification of fine grained subtypes such as drug classes and drug forms, drug indications, and drug reactions. Further, we present a baseline model for named entity recognition (NER) and multi label sentence classification tasks on this corpus. The macro F1 score of 74.85 in the NER task was achieved by our RuDR BERT model. For the sentence classification task, our model achieves the macro F1 score of 68.82 gaining 7.47 over the score of BERT model trained on Russian data. We make the RuDReC corpus and pretrained weights of domain specific BERT models freely available at https github.com cimm kzn RuDReC


A concatenation construction for propelinear perfect codes from regular subgroups of GA(r,2). A code C is called propelinear if there is a subgroup of Aut(C) of order C acting transitively on the codewords of C . In the paper new propelinear perfect binary codes of any admissible length more than 7 are obtained by a particular case of the Solov'eva concatenation construction 1981 and the regular subgroups of the general affine group of the vector space over GF(2) .


Effect of aggregation morphology on thermal conductivity and viscosity of Al2O3 CO2 nanofluid A Molecular Dynamics approach. CO2 cooling systems are the wave of the future for industrial refrigeration. CO2 refrigeration systems are gaining traction in recent years which involves heat transfer between CO2 and the base fluid. The high viscosity of CO2 is of interest to the oil and gas industry in enhanced oil recovery and well fracturing applications. A need arises to improve the thermal conductivity and viscosity of CO2 to increase the efficiency of these significant applications. Aggregation of nanoparticles is one of the crucial mechanisms to improve the thermal conductivity and viscosity of nanofluids. Since the aggregation morphology of nanoparticles is unclear so far, we have evaluated the stable configurations of the aggregation of nanoparticles by determining the potential energy of the different configurations system. In this paper, Green Kubo formalism is used to calculate the mentioned thermo physical properties of the different aggregated nanofluids. The nanofluid in this study consists of alumina (Al2O3) nanoparticles and CO2 as a base fluid. Results indicate that the enhancement in the thermal conductivity and viscosity of nanofluid is inversely proportional to the potential energy of the system. The results also mark that various morphologies of the aggregated nanoparticles have different enhancements of thermo physical properties of the nanofluid. This study is conducive for the researchers to perceive the importance and influence of aggregation morphology of nanoparticles and their stability on the thermal conductivity and viscosity of nanofluid.


BHAAV A Text Corpus for Emotion Analysis from Hindi Stories. In this paper, we introduce the first and largest Hindi text corpus, named BHAAV, which means emotions in Hindi, for analyzing emotions that a writer expresses through his characters in a story, as perceived by a narrator reader. The corpus consists of 20,304 sentences collected from 230 different short stories spanning across 18 genres such as Inspirational and Mystery. Each sentence has been annotated into one of the five emotion categories anger, joy, suspense, sad, and neutral, by three native Hindi speakers with at least ten years of formal education in Hindi. We also discuss challenges in the annotation of low resource languages such as Hindi, and discuss the scope of the proposed corpus along with its possible uses. We also provide a detailed analysis of the dataset and train strong baseline classifiers reporting their performances.


I Know What You Asked Graph Path Learning using AMR for Commonsense Reasoning. CommonsenseQA is a task in which a correct answer is predicted through commonsense reasoning with pre defined knowledge. Most previous works have aimed to improve the performance with distributed representation without considering the process of predicting the answer from the semantic representation of the question. To shed light upon the semantic interpretation of the question, we propose an AMR ConceptNet Pruned (ACP) graph. The ACP graph is pruned from a full integrated graph encompassing Abstract Meaning Representation (AMR) graph generated from input questions and an external commonsense knowledge graph, ConceptNet (CN). Then the ACP graph is exploited to interpret the reasoning path as well as to predict the correct answer on the CommonsenseQA task. This paper presents the manner in which the commonsense reasoning process can be interpreted with the relations and concepts provided by the ACP graph. Moreover, ACP based models are shown to outperform the baselines.


Symmetry in the system conformed by two blocks connected by a string with variable tension. In this paper we review the system made up by two blocks connected by a string over a smooth pulley with variable tension. One block lies on an horizontal surface and the another block is hanging vertically. We carry out a complete and systematic analysis for the tension of the string as function of the angle and the horizontal distance x, at static equilibrium. We find a simmetry like that corresponds to two different confifigurations with the same tension and obtain the relationship that must satisfy two angles or two horizontal distances to obtain equal tension.


Automatic Pass Annotation from Soccer VideoStreams Based on Object Detection and LSTM. Soccer analytics is attracting increasing interest in academia and industry, thanks to the availability of data that describe all the spatio temporal events that occur in each match. These events (e.g., passes, shots, fouls) are collected by human operators manually, constituting a considerable cost for data providers in terms of time and economic resources. In this paper, we describe PassNet, a method to recognize the most frequent events in soccer, i.e., passes, from video streams. Our model combines a set of artificial neural networks that perform feature extraction from video streams, object detection to identify the positions of the ball and the players, and classification of frame sequences as passes or not passes. We test PassNet on different scenarios, depending on the similarity of conditions to the match used for training. Our results show good classification results and significant improvement in the accuracy of pass detection with respect to baseline classifiers, even when the match's video conditions of the test and training sets are considerably different. PassNet is the first step towards an automated event annotation system that may break the time and the costs for event annotation, enabling data collections for minor and non professional divisions, youth leagues and, in general, competitions whose matches are not currently annotated by data providers.


Robustness of supply chain networks against underload cascading failures. In today's global economy, supply chain (SC) entities have become increasingly interconnected with demand and supply relationships due to the need for strategic outsourcing. Such interdependence among firms not only increases efficiency but also creates more vulnerabilities in the system. Natural and human made disasters such as floods and transport accidents may halt operations and lead to economic losses. Due to the interdependence among firms, the adverse effects of any disruption can be amplified and spread throughout the systems. This paper aims at studying the robustness of SC networks against cascading failures. Considering the upper and lower bound load constraints, i.e., inventory and cost, we examine the fraction of failed entities under load decrease and load fluctuation scenarios. The simulation results obtained from synthetic networks and a European supply chain network 1 both confirm that the recovery strategies of surplus inventory and backup suppliers often adopted in actual SCs can enhance the system robustness, compared with the system without the recovery process. In addition, the system is relatively robust against load fluctuations but is more fragile to demand shocks. For the underload driven model without the recovery process, we found an occurrence of a discontinuous phase transition. Differently from other systems studied under overload cascading failures, this system is more robust for power law distributions than uniform distributions of the lower bound parameter for the studied scenarios.


BiSample Bidirectional Sampling for Handling Missing Data with Local Differential Privacy. Local differential privacy (LDP) has received much interest recently. In existing protocols with LDP guarantees, a user encodes and perturbs his data locally before sharing it to the aggregator. In common practice, however, users would prefer not to answer all the questions due to different privacy preserving preferences for different questions, which leads to data missing or the loss of data quality. In this paper, we demonstrate a new approach for addressing the challenges of data perturbation with consideration of users' privacy preferences. Specifically, we first propose BiSample a bidirectional sampling technique value perturbation in the framework of LDP. Then we combine the BiSample mechanism with users' privacy preferences for missing data perturbation. Theoretical analysis and experiments on a set of datasets confirm the effectiveness of the proposed mechanisms.


Global well posedness and decay of solutions to the Cauchy problem of convective Cahn Hilliard equation. In this paper, we consider the global well posedness and time decay rates of solution to the Cauchy problem for 3D convective Cahn Hilliard equation with double well potential via a refined pure energy method. In particular, the optimal decay rates of the higher order spatial derivatives of the solution are obtained, the dot H s ( 0 s leq frac12 ) negative Sobolev norms is shown to be preserved along time evolution and enhance the decay rates.


Polynomiality of mathbb Z 2 Hurwitz Hodge Integrals. Using Atiyah Bott localization on the space of stable maps to the stack quotient mathbb P 1 mathbb Z 2 , we find recursions that determine all Hodge integrals with descendent insertions at one marked point on the hyperelliptic locus overline mathcal H g, 2g 2 subseteq overline mathcal M g, 2g 2 . The initial conditions required for our recursions are gravitational descendents at one marked point, which are known to be frac 1 2 . We discover a new structure concerning these intersection numbers for a fixed monomial of lambda classes, the resulting family of hyperelliptic Hodge integrals is polynomial in g . We formulate a conjecture concerning the log concavity of the coefficients of these polynomials. Lastly, we turn our recursions into a non linear system of partial differential equations for the generating functions of hyperelliptic Hodge integrals.


A gradient system approach for Hankel structured low rank approximation. Rank deficient Hankel matrices are at the core of several applications. However, in practice, the coefficients of these matrices are noisy due to e.g. measurements errors and computational errors, so generically the involved matrices are full rank. This motivates the problem of Hankel structured low rank approximation. Structured low rank approximation problems, in general, do not have a global and efficient solution technique. In this paper we propose a local optimization approach based on a two levels iteration. Experimental results show that the proposed algorithm usually achieves good accuracy and shows a higher robustness with respect to the initial approximation, compared to alternative approaches.


Infection Kinetics of Covid 19 Is Lockdown a Potent Containment Tool?. Covid 19 is raging a devastating trail with the highest mortality to infected ratio ever for a pandemic. Lack of vaccine and therapeutic has rendered social exclusion through lockdown as the singular mode of containment. Harnessing the predictive powers of Machine Learning within a 6 dimensional infection kinetic model, depicting interactive evolution of 6 infection stages healthy susceptible ( H ), predisposed comorbid susceptible ( P ), infected ( I ), recovered ( R ), herd immunized ( V ) and mortality ( D ) the model, PHIRVD, provides the first accurate mortality prediction of 18 countries at varying stages of strategic lockdown, up to 30 days beyond last data training. PHIRVD establishes mortality to infection ratio as the correct pandemic descriptor, substituting reproduction number, and highlights the importance of early and prolonged but strategic lockdown to contain secondary relapse. Significance Statement 1. Accurate prediction of the day by day mortality profiles of 18 countries, 30 days beyond the last data of data training. 2. Precise quantification of the impact of early vs later lockdown impositions. 3. Accurate prediction of secondary relapse timelines 4. Establishment of mortality to infected ratio as the correct pandemic descriptor substituting the popular choice of reproduction number, a proven failure in predicting future infection kinetics and secondary surge. The outcomes have potential to redefine healthy policy landscape, particularly in light of secondary relapse and possible future SARS COV Ebola group incursion.


Reinforced Axial Refinement Network for Monocular 3D Object Detection. Monocular 3D object detection aims to extract the 3D position and properties of objects from a 2D input image. This is an ill posed problem with a major difficulty lying in the information loss by depth agnostic cameras. Conventional approaches sample 3D bounding boxes from the space and infer the relationship between the target object and each of them, however, the probability of effective samples is relatively small in the 3D space. To improve the efficiency of sampling, we propose to start with an initial prediction and refine it gradually towards the ground truth, with only one 3d parameter changed in each step. This requires designing a policy which gets a reward after several steps, and thus we adopt reinforcement learning to optimize it. The proposed framework, Reinforced Axial Refinement Network (RAR Net), serves as a post processing stage which can be freely integrated into existing monocular 3D detection methods, and improve the performance on the KITTI dataset with small extra computational costs.


A Knowledge Distillation Ensemble Framework for Predicting Short and Long term Hospitalisation Outcomes from Electronic Health Records Data. The ability to perform accurate prognosis of patients is crucial for proactive clinical decision making, informed resource management and personalised care. Existing outcome prediction models suffer from a low recall of infrequent positive outcomes. We present a highly scalable and robust machine learning framework to automatically predict adversity represented by mortality and ICU admission from time series vital signs and laboratory results obtained within the first 24 hours of hospital admission. The stacked platform comprises two components a) an unsupervised LSTM Autoencoder that learns an optimal representation of the time series, using it to differentiate the less frequent patterns which conclude with an adverse event from the majority patterns that do not, and b) a gradient boosting model, which relies on the constructed representation to refine prediction, incorporating static features of demographics, admission details and clinical summaries. The model is used to assess a patient's risk of adversity over time and provides visual justifications of its prediction based on the patient's static features and dynamic signals. Results of three case studies for predicting mortality and ICU admission show that the model outperforms all existing outcome prediction models, achieving PR AUC of 0.891 (95 CI 0.878 0.969) in predicting mortality in ICU and general ward settings and 0.908 (95 CI 0.870 0.935) in predicting ICU admission.


Tate motives on Witt vector affine flag varieties. Relying on recent advances in the theory of motives we develope a general formalism for derived categories of motives with Q coefficients on perfect (ind )schemes. As an application we give a motivic refinement of Zhu's geometric Satake equivalence for Witt vector affine Grassmannians in this set up.


3 manifolds that bound no definite 4 manifold. We produce a rational homology 3 sphere that does not smoothly bound either a positive or negative definite 4 manifold. Such a 3 manifold necessarily cannot be rational homology cobordant to a Seifert fibered space or any 3 manifold obtained by Dehn surgery on a knot. The proof requires an analysis of short characteristic covectors in bimodular lattices.


A 3 categorical perspective on G crossed braided categories. A braided monoidal category may be considered a 3 category with one object and one 1 morphism. In this paper, we show that, more generally, 3 categories with one object and 1 morphisms given by elements of a group G correspond to G crossed braided categories, certain mathematical structures which have emerged as important invariants of low dimensional quantum field theories. More precisely, we show that the 4 category of 3 categories mathcal C equipped with a 3 functor mathrm B G to mathcal C which is essentially surjective on objects and 1 morphisms is equivalent to the 2 category of G crossed braided categories. This provides a uniform approach to various constructions of G crossed braided categories.


A Critical Domain For the First Normalized Nontrivial Steklov Eigenvalue Among Planar Annular Domains. We describe a shape derivative approach to provide a candidate for an optimal domain among non simply connected planar domains with two boundary components. This approach is an adaptation of the work on the extremal eigenvalue problem for the Wentzell Laplace operator developed by Dambrine, Kateb and Lamboley.


Smart Parking IoT and Blockchain. Distributed ledger technology and IoT has revolutionized the world by finding its application in all the domains. It promises to transform the digital infrastructure which powers extensive evolutions and impacts a lot of areas. Vehicle parking is a major problem in major cities around the world in both developed and developing countries. The common problems are unavailability or shortage of parking spaces, no information about tariff and no mean of searching availability of parking space online. The struggle doesn't end even if an individual finds a spot, he is required to pay in cash. This traditional and manual process takes a lot of time and causes a lot of hassle. In this paper, we provide a novel solution to the parking problem using IoT and distributed ledger technology. This system is based on pervasive computing and provides auto check in and check out. The user can control the system and their profile using the app on their smartphone. The major advantage of the system is an easy and online payment method. Users can pay for their parking tickets using their credit cards from their smartphone app. This decreases their hassle of carrying cash and coins for purchasing parking tickets. Smart Parking will optimize the parking mechanism, save time, reduce traffic and pollution, and provide an enhanced user experience. It is robust, secure, scalable and automated using the combination of cutting edge technologies.


GPS Based Vehicle Tracking System on Chip. Modern powerful reconfigurable systems are suited in the implementation of various data stream, data parallel, and other applications. An application that needs real time, fast, and reliable data processing is the global positioning system (GPS) based vehicle tracking system (VTS). In this paper, we build on a recently produced VTS (The Aram Locator) offering a system on chip (SOC) replacement of the current microcontroller based implementation. The proposed SOC is built on a field programmable gate array (FPGA) promising a cheaper design, a more cohesive architecture, a faster processing time and an enhanced system interaction. Different designs, and their hardware implementations, are proposed with different levels of integration. Performance analysis and evaluation of the investigated designs are included.


The Hartree Fock equations in modulation spaces. We establish both a local and a global well posedness theories for the nonlinear Hartree Fock equations and its reduced analog in the setting of the modulation spaces on mathbb R d . In addition, we prove similar results when a harmonic potential is added to the equations. In the process, we prove the boundedeness of certain multilinear operators on products of the modulation spaces which may be of independent interest.


Unsupervised Synthesis of Anomalies in Videos Transforming the Normal. Abnormal activity recognition requires detection of occurrence of anomalous events that suffer from a severe imbalance in data. In a video, normal is used to describe activities that conform to usual events while the irregular events which do not conform to the normal are referred to as abnormal. It is far more common to observe normal data than to obtain abnormal data in visual surveillance. In this paper, we propose an approach where we can obtain abnormal data by transforming normal data. This is a challenging task that is solved through a multi stage pipeline approach. We utilize a number of techniques from unsupervised segmentation in order to synthesize new samples of data that are transformed from an existing set of normal examples. Further, this synthesis approach has useful applications as a data augmentation technique. An incrementally trained Bayesian convolutional neural network (CNN) is used to carefully select the set of abnormal samples that can be added. Finally through this synthesis approach we obtain a comparable set of abnormal samples that can be used for training the CNN for the classification of normal vs abnormal samples. We show that this method generalizes to multiple settings by evaluating it on two real world datasets and achieves improved performance over other probabilistic techniques that have been used in the past for this task.


Algorithms for Computing in Fog Systems principles, algorithms, and Challenges. Fog computing is an architecture that is used to distribute resources such as computing, storage, and memory closer to end user to improve applications and service deployment. The idea behind fog computing is to improve cloud computing and IoT infrastructures by reducing compute power, network bandwidth, and latency as well as storage requirements. This paper presents an overview of what fog computing is, related concepts, algorithms that are present to improve fog computing infrastructure as well as challenges that exist. This paper shows that there is a great advantage of using fog computing to support cloud and IoT systems.


Tangential interpolatory projections for a class of second order index 1 descriptor systems and application to Mechatronics. This paper studies the model order reduction of second order index 1 descriptor systems using a tangential interpolation projection method based on the Iterative Rational Krylov Algorithm (IRKA). Our primary focus is to reduce the system into a second order form so that the structure of the original system can be preserved. For this purpose, the IRKA based tangential interpolatory method is modified to deal with the second order structure of the underlying descriptor system efficiently in an implicit way. The paper also shows that by exploiting the symmetric properties of the system the implementing computational costs can be reduced significantly. Theoretical results are verified for the model reduction of the piezo actuator based adaptive spindle support which is second order index 1 differential algebraic form. The efficiency and accuracy of the method are demonstrated by analyzing the numerical results.


Protonated Clusters of Neon and Krypton. We present a study of cationic and protonated clusters of neon and krypton. Recent studies using argon have shown that protonated rare gas clusters can have very different magic sizes than pure, cationic clusters. Here we find that neon behaves similarly to argon, but that the cationic krypton is more similar to its protonated counterparts than the lighter rare gases are, sharing many of the same magic numbers.


A class of normal dilation matrices affirming the Marcus de Oliveira conjecture. In this article, we prove a class of normal dilation matrices affirming the Marcus de Oliveira conjecture.


Enabling Zero shot Multilingual Spoken Language Translation with Language Specific Encoders and Decoders. Current end to end approaches to Spoken Language Translation (SLT) rely on limited training resources, especially for multilingual settings. On the other hand, Multilingual Neural Machine Translation (MultiNMT) approaches rely on higher quality and more massive data sets. Our proposed method extends a MultiNMT architecture based on language specific encoders decoders to the task of Multilingual SLT (MultiSLT). Our method entirely eliminates the dependency from MultiSLT data and it is able to translate while training only on ASR and MultiNMT data. Our experiments on four different languages show that coupling the speech encoder to the MultiNMT architecture produces similar quality translations compared to a bilingual baseline ( pm 0.2 BLEU) while effectively allowing for zero shot MultiSLT. Additionally, we propose using an Adapter module for coupling the speech inputs. This Adapter module produces consistent improvements up to 6 BLEU points on the proposed architecture and 1 BLEU point on the end to end baseline.


Variations of the Godbillon Vey invariant of transversely parallelizable foliations. We consider a (2q 1) dimensional smooth manifold M equipped with a (q 1) dimensional, a priori non integrable, distribution cal D and a q vector field bf T T 1 wedge ldots wedge T q , where T i are linearly independent vector fields transverse to cal D . Using a q form omega such that cal D ker , omega and omega( bf T ) 1 , we construct a (2q 1) form analogous to that defining the Godbillon Vey class of a (q 1) dimensional foliation, and show how does this form depend on omega and bf T . For a compatible Riemannian metric g on M , we express this (2q 1) form in terms of bf T and extrinsic geometry of cal D and normal distribution cal D bot . We find Euler Lagrange equations of associated functionals for variable ( omega, bf T ) on (M,g) , and for variable metric on (M, cal D ) , when distributions foliations and forms are defined outside a "singularity set" under additional assumption of convergence of certain integrals. We show that for a harmonic distribution cal D bot such ( omega, bf T ) is critical, characterize critical pairs when cal D is integrable and find sufficient conditions for critical pairs when variations are among foliations, calculate the index form and consider examples of critical foliations among twisted products, Reeb foliations and transversely holomorphic flows.


How to read faces without looking at them. Face reading is the most intuitive aspect of emotion recognition. Unfortunately, digital analysis of facial expression requires digitally recording personal faces. As emotional analysis is particularly required in a more poised scenario, capturing faces becomes a gross violation of privacy. In this paper, we use the concept of compressive analysis to conceptualise a system which compressively acquires faces in order to ascertain unusable reconstruction, while allowing for acceptable (and adjustable) accuracy in inference.


Nonaxisymmetric instabilities in turbulent electromagnetic pumps. The stability of annular electromagnetic pumps (EMPs) is investigated through 3D direct numerical simulations. When induction effects dominate dissipative processes, linear induction EMPs become unstable and lead to non axisymmetric states relatively different from what was predicted by previous theoretical models. We show that the 3D destabilization of the flow is deeply connected to the axisymmetric state, and always appears as a secondary bifurcation from a locally stalled flow, even if the applied magnetic field is axisymmetric. Finally, we model a configuration aiming to optimize the efficiency of the pump, by imposing electrical currents on both sides (inner and outer cylinders) of the pump. This configuration increases the efficiency of the pump, but generates a complex dynamics, associated to periodic oscillation of a large vortex flow localized in the active region of the pump. Finally, we demonstrate the existence of an upper bound on the efficiency of such electromagnetic pump, which can never exceed 50 .


EGNet Edge Guidance Network for Salient Object Detection. Fully convolutional neural networks (FCNs) have shown their advantages in the salient object detection task. However, most existing FCNs based methods still suffer from coarse object boundaries. In this paper, to solve this problem, we focus on the complementarity between salient edge information and salient object information. Accordingly, we present an edge guidance network (EGNet) for salient object detection with three steps to simultaneously model these two kinds of complementary information in a single network. In the first step, we extract the salient object features by a progressive fusion way. In the second step, we integrate the local edge information and global location information to obtain the salient edge features. Finally, to sufficiently leverage these complementary features, we couple the same salient edge features with salient object features at various resolutions. Benefiting from the rich edge information and location information in salient edge features, the fused features can help locate salient objects, especially their boundaries more accurately. Experimental results demonstrate that the proposed method performs favorably against the state of the art methods on six widely used datasets without any pre processing and post processing. The source code is available at http mmcheng.net egnet .


Local structure of idempotent algebras II. In this paper we continue the study of edge colored graphs associated with finite idempotent algebras initiated in arXiv 2006.09599. We prove stronger connectivity properties of such graphs that will allows us to demonstrate several useful structural features of subdirect products of idempotent algebras such as rectangularity and 2 decomposition.


The irreducible weak modules for the fixed point subalgebra of the vertex algebra associated to a non degenerate even lattice by an automorphism of order 2 . Let V L be the vertex algebra associated to a non degenerate even lattice L , theta the automorphism of V L induced from the 1 symmetry of L , and V L the fixed point subalgebra of V L under the action of theta . We classify the irreducible weak V L modules and show that any irreducible weak V L module is isomorphic to a weak submodule of some irreducible weak V L module or to a submodule of some irreducible theta twisted V L module.


Some Problems in Logic Applications of Kripke's Notion of Fulfilment. This is a study of S. Kripke's notion of fulfilment. Motivated by Paris Harrington statement, Kripke was looking for a proof of G "odel's Incompleteness Theorem which was model theoretic, natural (without self reference), and easy. Fulfilment gives a versatile tool for both Proof and Model Theory. We begin with short proofs to a number of classical results. With two new results there is an easily definable subring R of the primitive recursive functions such that for any non principal ultrafilter D on omega , R D is a recursively saturated model of Peano arithmetic and for any r.e. theory textsf T and for any given r.e. set, we can feasibly find a Sigma 1 0 formula which semi represents it in textsf T . We then give a version of Herbrand's Theorem, and of the Hilbert Ackermann method of proving consistency, answering a problem of D. Guaspari ulcorner phi urcorner in Pi 0 k phi text is Sigma 0 k text conservative over textsf PA is a complete Pi 0 2 set. We extend H. Friedman's method for results of such as Sigma 1 2 textsf AC is Pi 1 3 conservative over ( Pi 1 1 textsf CA ) varepsilon 0 upharpoonright , along with uniform versions forall alpha varepsilon 0 ( Pi 1 1 textsf CA ) alpha upharpoonright , vdash textsf RFN Pi 1 3 ( Sigma 1 2 textsf AC ) Then there are some model theoretic applications, starting with non omega models. We extend the theorem of D. Scott involving Weak K "onig's Lemma, and describe the order types of elementary initial segments of recursively saturated models. For omega models, we extend Friedman's theorem on minimal models of analysis, and develop indicators for countable fragments of mathcal L infty omega , with some representability results in omega logic. We close with an exposition of the Paris Harrington statement.