FNA Fast Network Adaptation via Parameter Remapping and Architecture Search. Deep neural networks achieve remarkable performance in many computer vision tasks. Most state of the art (SOTA) semantic segmentation and object detection approaches reuse neural network architectures designed for image classification as the backbone, commonly pre trained on ImageNet. However, performance gains can be achieved by designing network architectures specifically for detection and segmentation, as shown by recent neural architecture search (NAS) research for detection and segmentation. One major challenge though is that ImageNet pre training of the search space representation (a.k.a. super network) or the searched networks incurs huge computational cost. In this paper, we propose a Fast Network Adaptation (FNA ) method, which can adapt both the architecture and parameters of a seed network (e.g. an ImageNet pre trained network) to become a network with different depths, widths, or kernel sizes via a parameter remapping technique, making it possible to use NAS for segmentation and detection tasks a lot more efficiently. In our experiments, we apply FNA on MobileNetV2 to obtain new networks for semantic segmentation, object detection, and human pose estimation that clearly outperform existing networks designed both manually and by NAS. We also implement FNA on ResNets and NAS networks, which demonstrates a great generalization ability. The total computation cost of FNA is significantly less than SOTA segmentation and detection NAS approaches 1737x less than DPC, 6.8x less than Auto DeepLab, and 8.0x less than DetNAS. A series of ablation studies are performed to demonstrate the effectiveness, and detailed analysis is provided for more insights into the working mechanism. Codes are available at https github.com JaminFong FNA.


Sound absorption by perforated walls along boundaries. We analyze the Helmholtz equation in a complex domain. A sound absorbing structure at a part of the boundary is modelled by a periodic geometry with periodicity varepsilon 0 . A resonator volume of thickness varepsilon is connected with thin channels (opening varepsilon 3 ) with the main part of the macroscopic domain. For this problem with three different scales we analyze solutions in the limit varepsilon to 0 and find that the effective system can describe sound absorption.


To reorient is easier than to orient an on line algorithm for reorientation of graphs. We define an on line (incremental) algorithm that, given a (possibly infinite) pseudo transitive oriented graph, produces a transitive reorientation. This implies that a theorem of Ghouila Houri is provable in RCA 0 and hence is computably true.


Quadratic soliton mode locked degenerate optical parametric oscillator. By identifying the similarities between the coupled wave equations and the parametrically driven nonlinear Schr "odinger equation, we unveil the existence condition of the quadratic soliton mode locked degenerate optical parametric oscillator in the previously unexplored parameter space of near zero group velocity mismatch. We study the nature of the quadratic solitons and divide their dynamics into two distinctive branches depending on the system parameters. We find the nonlinear interaction between the resonant pump and signal results in phenomena that resemble the dispersive two photon absorption and the dispersive Kerr effect. Origin of the quadratic soliton perturbation is identified and strategy to mitigate its detrimental effect is developed. Terahertz comb bandwidth and femtosecond pulse duration are attainable in an example periodically poled lithium niobate waveguide resonator in the short wave infrared and an example orientation patterned gallium arsenide free space cavity in the long wave infrared. The quadratic soliton mode locking principle can be extended to other material platforms, making it a competitive ultrashort pulse and broadband comb source architecture at the mid infrared.


On Urban Traffic Flow Benefits of Connected and Automated Vehicles. Automated Vehicles are an integral part of Intelligent Transportation Systems (ITSs) and are expected to play a crucial role in the future mobility services. This paper investigates two classes of self driving vehicles (i) Level 4 5 Automated Vehicles (AVs) that rely solely on their on board sensors for environmental perception tasks, and (ii) Connected and Automated Vehicles (CAVs), leveraging connectivity to further enhance perception via driving intention and sensor information sharing. Our investigation considers and quantifies the impact of each vehicle group in large urban road networks in Europe and in the USA. The key performance metrics are the traffic congestion, average speed and average trip time. Specifically, the numerical studies show that the traffic congestion can be reduced by up to a factor of four, while the average flow speeds of CAV group remains closer to the speed limits and can be up to 300 greater than the human driven vehicles. Finally, traffic situations are also studied, indicating that even a small market penetration of CAVs will have a substantial net positive effect on the traffic flows.


Capture and light induced release of antibiotics by an azo dye polymer. The isomerisation of azo dyes can induce conformational change which have potential applications in medicine and environmental protection. We developed an agar diffusion assay to test the capture and release of biologically active molecules from an azo electro optic polymer, Poly (Disperse Red 1 methacrylate) (DR1 PMMA). The assay monitors the growth of bacteria placed in soft agar under a glass coverslip. Antibiotics can then be applied on the coverslip resulting in the clearance of the area under the coverslip due to growth inhibition. This assay demonstrates that DR1 PMMA is able to capture either tetracycline or ampicillin and the relative amount of DR1 PMMA required for capture was determined. Finally, the active antibiotics can be released from DR1 PMMA by exposure to green light but not by exposure to white light or heat.


Weakness Analysis of Cyberspace Configuration Based on Reinforcement Learning. In this work, we present a learning based approach to analysis cyberspace configuration. Unlike prior methods, our approach has the ability to learn from past experience and improve over time. In particular, as we train over a greater number of agents as attackers, our method becomes better at rapidly finding attack paths for previously hidden paths, especially in multiple domain cyberspace. To achieve these results, we pose finding attack paths as a Reinforcement Learning (RL) problem and train an agent to find multiple domain attack paths. To enable our RL policy to find more hidden attack paths, we ground representation introduction an multiple domain action select module in RL. By designing a simulated cyberspace experimental environment to verify our method. Our objective is to find more hidden attack paths, to analysis the weakness of cyberspace configuration. The experimental results show that our method can find more hidden multiple domain attack paths than existing baselines methods.


Gorenstein Objects in Extriangulated Categories. This paper mainly studies the relative Gorenstein objects in the extriangulated category mathcal C ( mathcal C , mathbb E , mathfrak s ) with a proper class xi and the related properties of these objects. In the first part, we define the notion of the xi mathcal G projective resolution, and study the relation between xi projective resolution and xi mathcal G projective resolution for any object A in mathcal C , i.e. A has a mathcal C ( , mathcal P ( xi)) exact xi projective resolution if and only if A has a mathcal C ( , mathcal P ( xi)) exact xi mathcal G projective resolution. In the second part, we define a particular xi Gorenstein projective object in mathcal C which called xi n strongly mathcal G projective object. On this basis, we study the relation between xi m strongly mathcal G projective object and xi n strongly mathcal G projective object whenever m neq n , and give some equivalent characterizations of xi n strongly mathcal G projective objects. What is more, we give some nice propsitions of xi n strongly mathcal G projective objects.


Adiabatic geometric phase in fully nonlinear three wave mixing. In a nonlinear three wave mixing process, the interacting waves can accumulate an adiabatic geometric phase (AGP) if the nonlinear coefficient of the crystal is modulated in a proper manner along the nonlinear crystal. This concept was studied so far only for the case in which the pump wave is much stronger than the two other waves, hence can be assumed to be constant. Here we extend this analysis for the fully nonlinear process, in which all three waves can be depleted and we show that the sign and magnitude of the AGP can be controlled by the period, phase and duty cycle of the nonlinear modulation pattern. In this fully nonlinear interaction, all the states of the system can be mapped onto a closed surface. Specifically, we study a process in which the eigenstate of the system follows a circular rotation on the surface. Our analysis reveals that the AGP equals to the difference between the total phase accumulated along the circular trajectory and that along its vertical projection, which is universal for the undepleted (linear) and depleted (nonlinear) cases. Moreover, the analysis reveals that the AGPs in the processes of sum frequency generation and difference frequency generation have opposite chirality. Finally, we utilize the AGP in the fully nonlinear case for splitting the beam into different diffraction orders in the far field.


Pure entropic regularization for metrical task systems. We show that on every n point HST metric, there is a randomized online algorithm for metrical task systems (MTS) that is 1 competitive for service costs and O( log n) competitive for movement costs. In general, these refined guarantees are optimal up to the implicit constant. While an O( log n) competitive algorithm for MTS on HST metrics was developed by Bubeck et al. (SODA 2019), that approach could only establish an O(( log n) 2) competitive ratio when the service costs are required to be O(1) competitive. Our algorithm can be viewed as an instantiation of online mirror descent with the regularizer derived from a multiscale conditional entropy. In fact, our algorithm satisfies a set of even more refined guarantees we are able to exploit this property to combine it with known random embedding theorems and obtain, for any n point metric space, a randomized algorithm that is 1 competitive for service costs and O(( log n) 2) competitive for movement costs.


About existence and regularity of positive solutions for a Quasilinear Schr "odinger equation with singular nonlinearity. This paper deals with the existence of positive solution for the singular quasilinear Schr "odinger equation Delta u Delta (u 2 )u h(x) u gamma f(x,u) mbox in Omega, where gamma 1 , Omega subset mathbb R N , (N geq 3) is a bounded smooth domain, 0 h in L 1 ( Omega) , f is a measurable function that can change signal and can be sublinear or has critical growth. Inspired by Sun cite Y we derive a compatible condition on the couple (h(x), gamma) , which is optimal for the existence of H 0 1 solution for this problem.


An extension of Koksma's inequality. When applying the quasi Monte Carlo (QMC) method of numerical integration of univariate functions, Koksma's inequality provides a basic estimate of the error in terms of the discrepancy of the used evaluation points and the total variation of the integrated function. We present an extension of Koksma's inequality that is also applicable for functions with infinite total variation.


Moduli of hybrid curves and variations of canonical measures. We introduce the moduli space of hybrid curves as the hybrid compactification of the moduli space of curves thereby refining the one obtained by Deligne and Mumford. As the main theorem of this paper we then show that the universal family of canonically measured hybrid curves over this moduli space varies continuously. On the way to achieve this, we present constructions and results which we hope could be of independent interest. In particular, we introduce higher rank variants of hybrid spaces which refine and combine both the ones considered by Berkovich, Boucksom and Jonsson, and metrized complexes of varieties studied by Baker and the first named author. Furthermore, we introduce canonical measures on hybrid curves which simultaneously generalize the Arakelov Bergman measure on Riemann surfaces, Zhang measure on metric graphs, and Arakelov Zhang measure on metrized curve complexes. This paper is part of our attempt to understand the precise link between the non Archimedean Zhang measure and variations of Arakelov Bergman measures in families of Riemann surfaces, answering a question which has been open since the pioneering work of Zhang on admissible pairing in the nineties.


L p Bernstein inequalities on C 2 domains and applications to discretization. We prove a new Bernstein type inequality in L p spaces associated with the tangential derivatives on the boundary of a general compact C 2 domain. We give two applications Marcinkiewicz type inequality for discretization of L p norm and positive cubature formula. Both results are optimal in the sense that the number of function samples used has the order of the dimension of the corresponding space of algebraic polynomials.


Microwave assisted optical waveguide in Rydberg atoms. We theoretically demonstrate an efficient scheme to build a microwave (MW) assisted optical waveguide in an inhomogeneously broadened vapor medium that is made of active 87 Rb atoms and inactive buffer gas atoms. We exploit the sensitive behaviour of MW field coupled between highly excited Rydberg states to create distinctly responsive and tunable atomic waveguide. The buffer gas induced collision further manipulates the features of the waveguide by widening the spatial transparency window and enhancing the contrast of the refractive index. We numerically solve Maxwell's equations to demonstrate diffractionless propagation of 5 micrometer narrow paraxial light beams of arbitrary mode to several Rayleigh lengths. The presence of the buffer gas significantly enhances output intensity of the diffraction controlled light beam from 10 percent to 54 percent. This efficient diffraction elimination technique has important applications in high resolution imaging and high density optical communication.


A Pebble in the AI Race. Bhutan is sometimes described as a pebble between two boulders", a small country caught between the two most populous nations on earth India and China. This pebble is, however, about to be caught up in a vortex the transformation of our economic, political and social orders by new technologies like Artificial Intelligence. What can a small nation like Bhutan hope to do in the face of such change? What should the nation do, not just to weather this storm, but to become a better place in which to live?


Vision Aided Radio User Identity Match in Radio and Video Domains Using Machine Learning. 5G is designed to be an essential enabler and a leading infrastructure provider in the communication technology industry by supporting the demand for the growing data traffic and a variety of services with distinct requirements. The use of deep learning and computer vision tools has the means to increase the environmental awareness of the network with information from visual data. Information extracted via computer vision tools such as user position, movement direction, and speed can be promptly available for the network. However, the network must have a mechanism to match the identity of a user in both visual and radio systems. This mechanism is absent in the present literature. Therefore, we propose a framework to match the information from both visual and radio domains. This is an essential step to practical applications of computer vision tools in communications. We detail the proposed framework training and deployment phases for a presented setup. We carried out practical experiments using data collected in different types of environments. The work compares the use of Deep Neural Network and Random Forest classifiers and shows that the former performed better across all experiments, achieving classification accuracy greater than 99 .


Explanation Ontology A Model of Explanations for User Centered AI. Explainability has been a goal for Artificial Intelligence (AI) systems since their conception, with the need for explainability growing as more complex AI models are increasingly used in critical, high stakes settings such as healthcare. Explanations have often added to an AI system in a non principled, post hoc manner. With greater adoption of these systems and emphasis on user centric explainability, there is a need for a structured representation that treats explainability as a primary consideration, mapping end user needs to specific explanation types and the system's AI capabilities. We design an explanation ontology to model both the role of explanations, accounting for the system and user attributes in the process, and the range of different literature derived explanation types. We indicate how the ontology can support user requirements for explanations in the domain of healthcare. We evaluate our ontology with a set of competency questions geared towards a system designer who might use our ontology to decide which explanation types to include, given a combination of users' needs and a system's capabilities, both in system design settings and in real time operations. Through the use of this ontology, system designers will be able to make informed choices on which explanations AI systems can and should provide.


First Direct Observations of Gear Changing In A Collider. In this work we perform the first ever demonstration of gear changing in a real world collider. Gear changing refers to a collision scheme where each ring of a collider stores a different harmonic number of bunches. These bunches are kept synchronized using different velocities. Such a system has been theorized, but has now been demonstrated using the Double ElectroStatic Ion Ring ExpEriment (DESIREE) in Stockholm Sweden. The experiment was able to demonstrate a gear changing system, with both four on three bunches and five on four bunches. We determined a measurable parameter that shows a gear changing system out to 37500 turns of the slow beam. We also developed new insights into how to control this type of system, opening up new possibilities for research.


Multiple Sclerosis disease a computational approach for investigating its drug interactions. Multiple Sclerosis (MS) is a chronic and potentially highly disabling disease that can cause permanent damage and deterioration of the central nervous system. In Europe it is the leading cause of non traumatic disabilities in young adults, since more than 700,000 EU people suffer from MS. Although recent studies on MS pathophysiology have been provided, MS remains a challenging disease. In this context, thanks to recent advances in software and hardware technologies, computational models and computer simulations are becoming appealing research tools to support scientists in the study of such disease. Thus, motivated by this consideration we propose in this paper a new model to study the evolution of MS in silico, and the effects of the administration of Daclizumab drug, taking into account also spatiality and temporality of the involved phenomena. Moreover, we show how the intrinsic symmetries of the system can be exploited to drastically reduce the complexity of its analysis.


Accelerating linear solvers for Stokes problems with C metaprogramming. The efficient solution of large sparse saddle point systems is very important in computational fluid mechanics. The discontinuous Galerkin finite element methods have become increasingly popular for incompressible flow problems but their application is limited due to high computational cost. We describe the C programming techniques that may help to accelerate linear solvers for such problems. The approach is based on the policy based design pattern and partial template specialization, and is implemented in the open source AMGCL library. The efficiency is demonstrated with the example of accelerating an iterative solver of a discontinuous Galerkin finite element method for the Stokes problem. The implementation allows selecting algorithmic components of the solver by adjusting template parameters without any changes to the codebase. It is possible to switch the system matrix to use small statically sized blocks to store the nonzero values, or use a mixed precision solution, which results in up to 4 times speedup, and reduces the memory footprint of the algorithm by about 40 . We evaluate both monolithic and composite preconditioning strategies for the 3 benchmark problems. The performance of the proposed solution is compared with a multithreaded direct Pardiso solver and a parallel iterative PETSc solver.


Non Stationary Queues with Batch Arrivals. Motivated by applications that involve setting proper staffing levels for multi server queueing systems with batch arrivals, we present a thorough study of the queue length process Q(t) t geq 0 , departure process D(t) t geq 0 , and the workload process W(t) t geq 0 associated with the M t B t G t infty queueing system, where arrivals occur in batches, with the batch size distribution varying with time. Notably, we first show that both Q(t) and D(t) are equal in distribution to an infinite sum of independent, scaled Poisson random variables. When the batch size distribution has finite support, this sum becomes finite as well. We then derive the finite dimensional distributions of both the queue length process and the departure process, and we use these results to show that these finite dimensional distributions converge weakly under a certain scaling regime, where the finite dimensional distributions of the queue length process converge weakly to a shot noise process driven by a non homogeneous Poisson process. Next, we derive an expression for the joint Laplace Stieltjes transform of W(t) , Q(t) , and D(t) , and we show that these three random variables, under the same scaling regime, converge weakly, where the limit associated with the workload process corresponds to another Poisson driven shot noise process.


Algorithms for Online Matching, Assortment, and Pricing with Tight Weight dependent Competitive Ratios. Motivated by the dynamic assortment offerings and item pricings occurring in e commerce, we study a general problem of allocating finite inventories to heterogeneous customers arriving sequentially. We analyze this problem under the framework of competitive analysis, where the sequence of customers is unknown and does not necessarily follow any pattern. Previous work in this area, studying online matching, advertising, and assortment problems, has focused on the case where each item can only be sold at a single price, resulting in algorithms which achieve the best possible competitive ratio of 1 1 e. In this paper, we extend all of these results to allow for items having multiple feasible prices. Our algorithms achieve the best possible weight dependent competitive ratios, which depend on the sets of feasible prices given in advance. Our algorithms are also simple and intuitive they are based on constructing a class of universal value functions'' which integrate the selection of items and prices offered. Finally, we test our algorithms on the publicly available hotel data set of Bodea et al. (2009), where there are multiple items (hotel rooms) each with multiple prices (fares at which the room could be sold). We find that applying our algorithms, as a hybrid'' with algorithms which attempt to forecast and learn the future transactions, results in the best performance.


Few shot Medical Image Segmentation using a Global Correlation Network with Discriminative Embedding. Despite deep convolutional neural networks achieved impressive progress in medical image computing and analysis, its paradigm of supervised learning demands a large number of annotations for training to avoid overfitting and achieving promising results. In clinical practices, massive semantic annotations are difficult to acquire in some conditions where specialized biomedical expert knowledge is required, and it is also a common condition where only few annotated classes are available. In this work, we proposed a novel method for few shot medical image segmentation, which enables a segmentation model to fast generalize to an unseen class with few training images. We construct our few shot image segmentor using a deep convolutional network trained episodically. Motivated by the spatial consistency and regularity in medical images, we developed an efficient global correlation module to capture the correlation between a support and query image and incorporate it into the deep network called global correlation network. Moreover, we enhance discriminability of deep embedding to encourage clustering of the feature domains of the same class while keep the feature domains of different organs far apart. Ablation Study proved the effectiveness of the proposed global correlation module and discriminative embedding loss. Extensive experiments on anatomical abdomen images on both CT and MRI modalities are performed to demonstrate the state of the art performance of our proposed model.


A Thom isomorphism in foliated de Rham theory. We prove a Thom isomorphism theorem for differential forms in the setting of transverse Lie algebra actions on foliated manifolds and foliated vector bundles.


SpatialSense An Adversarially Crowdsourced Benchmark for Spatial Relation Recognition. Understanding the spatial relations between objects in images is a surprisingly challenging task. A chair may be "behind" a person even if it appears to the left of the person in the image (depending on which way the person is facing). Two students that appear close to each other in the image may not in fact be "next to" each other if there is a third student between them. We introduce SpatialSense, a dataset specializing in spatial relation recognition which captures a broad spectrum of such challenges, allowing for proper benchmarking of computer vision techniques. SpatialSense is constructed through adversarial crowdsourcing, in which human annotators are tasked with finding spatial relations that are difficult to predict using simple cues such as 2D spatial configuration or language priors. Adversarial crowdsourcing significantly reduces dataset bias and samples more interesting relations in the long tail compared to existing datasets. On SpatialSense, state of the art recognition models perform comparably to simple baselines, suggesting that they rely on straightforward cues instead of fully reasoning about this complex task. The SpatialSense benchmark provides a path forward to advancing the spatial reasoning capabilities of computer vision systems. The dataset and code are available at https github.com princeton vl SpatialSense.


NLOptControl A modeling language for solving optimal control problems. Current direct collocation based optimal control software is either easy to use or fast, but not both. This is a major limitation for users that are trying to formulate complex optimal control problems (OCPs) for use in on line applications. This paper introduces NLOptControl, an open source modeling language that allows users to both easily formulate and quickly solve nonlinear OCPs using direct collocation methods. To achieve these attributes, NLOptControl (1) is written in an efficient, dynamically typed computing language called Julia, (2) extends an optimization modeling language called JuMP to provide a natural algebraic syntax for modeling nonlinear OCPs and (3) uses reverse automatic differentiation with the acrylic coloring method to exploit sparsity in the Hessian matrix. This work explores the novel design features of NLOptControl and compares its syntax and speed to those of PROPT. The syntax comparisons shows that NLOptControl models OCPs more concisely than PROPT. The speeds of various collocation methods within PROPT and NLOptControl are benchmarked over a range of collocation points using performance profiles overall, NLOptControl's single, two, and four interval pseudospectral methods are roughly 14 , 26 , and 36 times faster than PROPT's, respectively. NLOptControl is well suited to improve existing off line and on line control systems and to engender new ones.


A Precisely Xtreme Multi Channel Hybrid Approach For Roman Urdu Sentiment Analysis. In order to accelerate the performance of various Natural Language Processing tasks for Roman Urdu, this paper for the very first time provides 3 neural word embeddings prepared using most widely used approaches namely Word2vec, FastText, and Glove. The integrity of generated neural word embeddings is evaluated using intrinsic and extrinsic evaluation approaches. Considering the lack of publicly available benchmark datasets, it provides a first ever Roman Urdu dataset which consists of 3241 sentiments annotated against positive, negative and neutral classes. To provide benchmark baseline performance over the presented dataset, we adapt diverse machine learning (Support Vector Machine Logistic Regression, Naive Bayes), deep learning (convolutional neural network, recurrent neural network), and hybrid approaches. Effectiveness of generated neural word embeddings is evaluated by comparing the performance of machine and deep learning based methodologies using 7, and 5 distinct feature representation approaches respectively. Finally, it proposes a novel precisely extreme multi channel hybrid methodology which outperforms state of the art adapted machine and deep learning approaches by the figure of 9 , and 4 in terms of F1 score. Roman Urdu Sentiment Analysis, Pretrain word embeddings for Roman Urdu, Word2Vec, Glove, Fast Text


PyTorchRL Modular and Distributed Reinforcement Learning in PyTorch. Deep reinforcement learning (RL) has proved successful at solving challenging environments but often requires scaling to large sampling and computing resources. Furthermore, advancing RL requires tools that are flexible enough to easily prototype new methods, yet avoiding impractically slow experimental turnaround times. To this end, we present PyTorchRL, a PyTorch based library for RL with a modular design that allows composing agents from a set of reusable and easily extendable modules. Additionally, PyTorchRL permits the definition of distributed training architectures with flexibility and independence of the Agent components. In combination, these two features can accelerate the pace at which ideas are implemented and tested, simplifying research and enabling to tackle more challenging RL problems. We present several interesting use cases of PyTorchRL and showcase the library by obtaining the highest to date test performance on the Obstacle Tower Unity3D challenge environment.


Frequency Estimation in Data Streams Learning the Optimal Hashing Scheme. We present a novel approach for the problem of frequency estimation in data streams that is based on optimization and machine learning. Contrary to state of the art streaming frequency estimation algorithms, which heavily rely on random hashing to maintain the frequency distribution of the data steam using limited storage, the proposed approach exploits an observed stream prefix to near optimally hash elements and compress the target frequency distribution. We develop an exact mixed integer linear optimization formulation, which enables us to compute optimal or near optimal hashing schemes for elements seen in the observed stream prefix then, we use machine learning to hash unseen elements. Further, we develop an efficient block coordinate descent algorithm, which, as we empirically show, produces high quality solutions, and, in a special case, we are able to solve the proposed formulation exactly in linear time using dynamic programming. We empirically evaluate the proposed approach both on synthetic datasets and on real world search query data. We show that the proposed approach outperforms existing approaches by one to two orders of magnitude in terms of its average (per element) estimation error and by 45 90 in terms of its expected magnitude of estimation error.


Deeply Cascaded U Net for Multi Task Image Processing. In current practice, many image processing tasks are done sequentially (e.g. denoising, dehazing, followed by semantic segmentation). In this paper, we propose a novel multi task neural network architecture designed for combining sequential image processing tasks. We extend U Net by additional decoding pathways for each individual task, and explore deep cascading of outputs and connectivity from one pathway to another. We demonstrate effectiveness of the proposed approach on denoising and semantic segmentation, as well as on progressive coarse to fine semantic segmentation, and achieve better performance than multiple individual or jointly trained networks, with lower number of trainable parameters.


Using wearable proximity sensors to characterize social contact patterns in a village of rural Malawi. Measuring close proximity interactions between individuals can provide key information on social contacts in human communities. With the present study, we report the quantitative assessment of contact patterns in a village in rural Malawi, based on proximity sensors technology that allows for high resolution measurements of social contacts. The system provided information on community structure of the village, on social relationships and social assortment between individuals, and on daily contacts activity within the village. Our findings revealed that the social network presented communities that were highly correlated with household membership, thus confirming the importance of family ties within the village. Contacts within households occur mainly between adults and children, and adults and adolescents. This result suggests that the principal role of adults within the family is the care for the youngest. Most of the inter household interactions occurred among caregivers and among adolescents. We studied the tendency of participants to interact with individuals with whom they shared similar attributes (i.e., assortativity). Age and gender assortativity were observed in inter household network, showing that individuals not belonging to the same family group prefer to interact with people with whom they share similar age and gender. Age disassortativity is observed in intra household networks. Family members congregate in the early morning, during lunch time and dinner time. In contrast, individuals not belonging to the same household displayed a growing contact activity from the morning, reaching a maximum in the afternoon. The data collection infrastructure used in this study seems to be very effective to capture the dynamics of contacts by collecting high resolution temporal data and to give access to the level of information needed to understand the social context of the village.


Relevance Transformer Generating Concise Code Snippets with Relevance Feedback. Tools capable of automatic code generation have the potential to augment programmer's capabilities. While straightforward code retrieval is incorporated into many IDEs, an emerging area is explicit code generation. Code generation is currently approached as a Machine Translation task, with Recurrent Neural Network (RNN) based encoder decoder architectures trained on code description pairs. In this work we introduce and study modern Transformer architectures for this task. We further propose a new model called the Relevance Transformer that incorporates external knowledge using pseudo relevance feedback. The Relevance Transformer biases the decoding process to be similar to existing retrieved code while enforcing diversity. We perform experiments on multiple standard benchmark datasets for code generation including Django, Hearthstone, and CoNaLa. The results show improvements over state of the art methods based on BLEU evaluation. The Relevance Transformer model shows the potential of Transformer based architectures for code generation and introduces a method of incorporating pseudo relevance feedback during inference.


Duality Diagram Similarity a generic framework for initialization selection in task transfer learning. In this paper, we tackle an open research question in transfer learning, which is selecting a model initialization to achieve high performance on a new task, given several pre trained models. We propose a new highly efficient and accurate approach based on duality diagram similarity (DDS) between deep neural networks (DNNs). DDS is a generic framework to represent and compare data of different feature dimensions. We validate our approach on the Taskonomy dataset by measuring the correspondence between actual transfer learning performance rankings on 17 taskonomy tasks and predicted rankings. Computing DDS based ranking for 17 times17 transfers requires less than 2 minutes and shows a high correlation ( 0.86 ) with actual transfer learning rankings, outperforming state of the art methods by a large margin ( 10 ) on the Taskonomy benchmark. We also demonstrate the robustness of our model selection approach to a new task, namely Pascal VOC semantic segmentation. Additionally, we show that our method can be applied to select the best layer locations within a DNN for transfer learning on 2D, 3D and semantic tasks on NYUv2 and Pascal VOC datasets.


Virasoro constraints for moduli of weighted pointed stable curves. We formulate Virasoro constraints for the generating functions of the intersection numbers on Hassett's moduli of weighted pointed curves and show that they are governed by the KdV integrable hierarchy.


Projective dimension and commuting variety of a reductive Lie algebra. The commuting variety of a reductive Lie algebra mathfrak g is the underlying variety of a well defined subscheme of mathfrak g times mathfrak g . In this note, it is proved that this scheme is normal and Cohen Macaulay. In particular, its ideal of definition is a prime ideal. As a matter of fact, this theorem results from a so called Property (P) for a simple Lie algebra. This property says that some cohomology complexes are exact.


Generic Fibers of Parahoric Hitchin Systems. In this paper, we talk about parahoric Hitchin systems over smooth projective curves with structure group a semisimple simply connected group. We describe the geometry of generic fibers of parahoric Hitchin fibrations using root stacks. We work over an algebraically closed field with a mild assumption of the characteristic. All of these can be treated as a generalization of GLn case in SWW19


Coherent structure identification in turbulent channel flow using Latent Dirichlet Allocation. Identification of coherent structures is an essential step to describe and model turbulence generation mechanisms in wall bounded flows. To this end we present a clustering method based on Latent Dirichlet Allocation (LDA), a generative probabilistic model for collections of discrete data. The method is applied for structure identification to the instantaneous Reynolds stress in turbulent channel flow at moderate Reynolds number R tau 590. LDA computes a robust flow description in terms of a hierarchy of vertically connected structure fragments, the characteristics of which scale with the wall distance, in agreement with the wall attached eddy hypothesis of Townsend (1961). We show that the model can be used for field reconstruction with a complexity that can be compared with that of Proper Orthogonal Decomposition (POD). It can also be used to generate synthetic fields, the statistics of which mimic those of the original database. These findings highlight the potential of LDA for data analysis, compression and generation.


The Adoption of Robotics by Government Agencies Evidence from Crime Labs. While firms and factories often adopt technologies like robotics and advanced manufacturing techniques at a fast rate, government agencies are often seen as lagging in their adoption of such tools. We offer evidence about the adoption of robotics from the case of American crime laboratories.


Uniformizing Gromov hyperbolic spaces with Busemann functions. Given a complete Gromov hyperbolic space X that is roughly starlike from a point omega in its Gromov boundary partial G X , we use a Busemann function based at omega to construct an incomplete unbounded uniform metric space X varepsilon whose boundary partial X varepsilon can be canonically identified with the Gromov boundary partial omega X of X relative to omega . This uniformization construction generalizes the procedure used to obtain the Euclidean upper half plane from the hyperbolic plane. Furthermore we show, for an arbitrary metric space Z , that there is a hyperbolic filling X of Z that can be uniformized in such a way that the boundary partial X varepsilon has a biLipschitz identification with the completion bar Z of Z . We also prove that this uniformization procedure can be done at an exponent that is often optimal in the case of CAT ( 1) spaces.


Exact and optimal controllability for scalar conservation laws with discontinuous flux. This paper describes the reachable set and resolves an optimal control problem for the scalar conservation laws with discontinuous flux. We give a necessary and sufficient criteria for the reachable set. A new backward resolution has been described to obtain the reachable set. Regarding the optimal control problem we first prove the existence of a minimizer and then the backward algorithm allows us to compute it. The same method also applies to compute the initial data control for an exact control problem. Our methodology for the proof relies on the explicit formula for the conservation laws with the discontinuous flux and finer properties of the characteristics curves.


Triangle decompositions of lambda K v lambda K w lambda K u . Denote by lambda K v the complete graph of order v with multiplicity lambda . Let lambda K v lambda K w lambda K u be the graph obtained from lambda K v by the removal of the edges of two vertex disjoint complete multi subgraphs with multiplicity lambda of orders w and u , respectively. When lambda is odd, it is shown that there exists a triangle decomposition of lambda K v lambda K w lambda K u if and only if v geq w u max u,w , lambda left( v choose 2 u choose 2 w choose 2 right) equiv 0 pmod 3 and lambda (v w) equiv lambda (v u) equiv lambda (v 1) equiv 0 pmod 2 . When lambda is even, it is shown that for large enough v , the elementary necessary conditions for the existence of a triangle decomposition of lambda K v lambda K w lambda K u are also sufficient.


Improving Person Re identification with Iterative Impression Aggregation. Our impression about one person often updates after we see more aspects of him her and this process keeps iterating given more meetings. We formulate such an intuition into the problem of person re identification (re ID), where the representation of a query (probe) image is iteratively updated with new information from the candidates in the gallery. Specifically, we propose a simple attentional aggregation formulation to instantiate this idea and showcase that such a pipeline achieves competitive performance on standard benchmarks including CUHK03, Market 1501 and DukeMTMC. Not only does such a simple method improve the performance of the baseline models, it also achieves comparable performance with latest advanced re ranking methods. Another advantage of this proposal is its flexibility to incorporate different representations and similarity metrics. By utilizing stronger representations and metrics, we further demonstrate state of the art person re ID performance, which also validates the general applicability of the proposed method.


From Logistic Growth to Exponential Growth in a Population Dynamical Model. Dynamics among central sources (hubs) providing a resource and large number of components enjoying and contributing to this resource describes many real life situations. Modeling, controlling, and balancing this dynamics is a general problem that arises in many scientific disciplines. We analyze a stochastic dynamical system exhibiting this dynamics with a multiplicative noise. We show that this model can be solved exactly by passing to variables that describe the mass ratio between the components and the hub. We derive a deterministic equation for the average mass ratio. This equation describes logistic growth. We derive the full phase diagram of the model and identify three regimes by calculating the sample and moment Lyapunov exponent of the system. The first regime describes full balance between the non hub components and the hub, in the second regime the entire resource is concentrated mainly in the hub, and in the third regime the resource is localized on a few non hub components and the hub. Surprisingly, in the limit of large number of components the transition values do not depend on the amount of resource given by the hub. This model has interesting application in the context of analysis of porous media using Magnetic Resonance (MR) techniques.


Concentrating bounded states for fractional Schr " o dinger Poisson system involving critical Sobolev exponent. In this paper, we study the concentration and multiplicity of solutions to the following fractional Schr " o dinger Poisson system begin equation left begin array ll varepsilon 2s ( Delta) su V(x)u phi u f(u) u 2 s ast 1 hbox in mathbb R 3 , varepsilon 2t ( Delta) t phi u 2, u 0 hbox in mathbb R 3 , end array right. end equation where s frac 3 4 , s,t in(0,1) , varepsilon 0 is a small parameter, f in C 1( mathbb R , mathbb R ) is subcritical, V mathbb R 3 rightarrow mathbb R is a continuous bounded function. We establish a family of positive solutions u varepsilon in H varepsilon which concentrates around the local minima of V in Lambda as varepsilon rightarrow0 . With Ljusternik Schnirelmann theory, we also obtain multiple solutions by employing the topology construct of the set where the potential V attains its minimum.


QUIC (Quick UDP Internet Connections) A Quick Study. Main responsibility of a transport protocol is to support communication between two end to end entities. These entities can be hosts or devices, such as routers, firewalls etc. Transport protocol provides mechanism to have a virtually circuited route between these two end to end devices. Transport protocol are of two types Connection oriented and connection less. As these name suggest, connection oriented requires additional work of setting up connections and provide reliability in terms of packet reordering, congestion control, reliable delivery of packets. On the other hand connectionless transport protocol adapts, sends and forgets mechanism. Its entire purpose is to deliver the datagram without having to worry about its delivery. There are two major protocols, TCP and UDP, used for connection oriented and connection less services respectively. Being a connection oriented protocol, TCP provides a reliable end to end connection and have congestion control mechanisms to avoid buffer overflow at the receiver side.


Personalized, Health Aware Recipe Recommendation An Ensemble Topic Modeling Based Approach. Food choices are personal and complex and have a significant impact on our long term health and quality of life. By helping users to make informed and satisfying decisions, Recommender Systems (RS) have the potential to support users in making healthier food choices. Intelligent users modeling is a key challenge in achieving this potential. This paper investigates Ensemble Topic Modelling (EnsTM) based Feature Identification techniques for efficient user modeling and recipe recommendation. It builds on findings in EnsTM to propose a reduced data representation format and a smart user modeling strategy that makes capturing user preference fast, efficient and interactive. This approach enables personalization, even in a cold start scenario. This paper proposes two different EnsTM based and one Hybrid EnsTM based recommenders. We compared all three EnsTM based variations through a user study with 48 participants, using a large scale,real world corpus of 230,876 recipes, and compare against a conventional Content Based (CB) approach. EnsTM based recommenders performed significantly better than the CB approach. Besides acknowledging multi domain contents such as taste, demographics and cost, our proposed approach also considers user's nutritional preference and assists them finding recipes under diverse nutritional categories. Furthermore, it provides excellent coverage and enables implicit understanding of user's food practices. Subsequent analysis also exposed correlation between certain features and a healthier lifestyle.


Efficient Construction of Behavior Graphs for Uncertain Event Data. The discipline of process mining deals with analyzing execution data of operational processes, extracting models from event data, checking the conformance between event data and normative models, and enhancing all aspects of processes. Recently, new techniques have been developed to analyze event data containing uncertainty these techniques strongly rely on representing uncertain event data through graph based models capturing uncertainty. In this paper we present a novel approach to efficiently compute a graph representation of the behavior contained in an uncertain process trace. We present our new algorithm, analyze its time complexity, and report experimental results showing order of magnitude performance improvements for behavior graph construction.


The Richberg technique for subsolutions. This note adapts the sophisticated Richberg technique for approximation in pluripotential theory to the F potential theory associated to a general nonlinear convex subequation F subset J 2(X) on a manifold X . The main theorem is the following "local to global" result. Suppose u is a continuous strictly F subharmonic function such that each point x in X has a fundamental neighborhood system consisting of domains for which a "quasi" form of C infty approximation holds. Then for any positive h in C(X) there exists a strictly F subharmonic function w in C infty(X) with u w u h . Applications include all convex constant coefficient subequations on bf R n , various nonlinear subequations on complex and almost complex manifolds, and many more.


(Achiral) Lefschetz fibration embeddings of 4 manifolds. In this paper, we prove Lefschetz fibration embeddings of achiral as well as simplified broken (achiral) Lefschetz fibrations of compact, connected, orientable 4 manifolds over D 2 into the trivial Lefschetz fibration of mathbb CP 2 times D 2 over D 2 . These results can be easily extended to achiral as well as simplified broken (achiral) Lefschetz fibrations over mathbb CP 1. From this, it follows that every closed, connected, orientable 4 manifold admits a smooth (simplified broken) Lefschetz fibration embedding in mathbb CP 2 times mathbb CP 1. We provide a huge collection of bordered Lefschetz fibration which admit bordered Lefschetz fibration embeddings into a trivial Lefschetz fibration tilde pi D 4 times D 2 to D 2. We also show that every closed, connected, orientable 4 manifold X admits a smooth embedding into S 4 times S 2 as well as into S 4 tilde times S 2 . From this, we get another proof of a theorem of Hirsch which states that every closed, connected, orientable 4 manifold smoothly embeds in mathbb R 7. We also discuss Lefschetz fibration embedding of non orientable 4 manifolds X , where X does not admit 3 and 4 handles in the handle decomposition, into the trivial Lefschetz fibration of mathbb CP 2 times D 2 over D 2 .


Can Monolingual Pretrained Models Help Cross Lingual Classification?. Multilingual pretrained language models (such as multilingual BERT) have achieved impressive results for cross lingual transfer. However, due to the constant model capacity, multilingual pre training usually lags behind the monolingual competitors. In this work, we present two approaches to improve zero shot cross lingual classification, by transferring the knowledge from monolingual pretrained models to multilingual ones. Experimental results on two cross lingual classification benchmarks show that our methods outperform vanilla multilingual fine tuning.


Performance Impact of Memory Channels on Sparse and Irregular Algorithms. Graph processing is typically considered to be a memory bound rather than compute bound problem. One common line of thought is that more available memory bandwidth corresponds to better graph processing performance. However, in this work we demonstrate that the key factor in the utilization of the memory system for graph algorithms is not necessarily the raw bandwidth or even the latency of memory requests. Instead, we show that performance is proportional to the number of memory channels available to handle small data transfers with limited spatial locality. Using several widely used graph frameworks, including Gunrock (on the GPU) and GAPBS Ligra (for CPUs), we evaluate key graph analytics kernels using two unique memory hierarchies, DDR based and HBM MCDRAM. Our results show that the differences in the peak bandwidths of several Pascal generation GPU memory subsystems aren't reflected in the performance of various analytics. Furthermore, our experiments on CPU and Xeon Phi systems demonstrate that the number of memory channels utilized can be a decisive factor in performance across several different applications. For CPU systems with smaller thread counts, the memory channels can be underutilized while systems with high thread counts can oversaturate the memory subsystem, which leads to limited performance. Finally, we model the potential performance improvements of adding more memory channels with narrower access widths than are found in current platforms, and we analyze performance trade offs for the two most prominent types of memory accesses found in graph algorithms, streaming and random accesses.


Cascaded Multi cycle terahertz driven ultrafast electron acceleration and manipulation. Terahertz (THz) based electron acceleration and manipulation has recently been shown to be feasible and to hold tremendous promise as a technology for the development of next generation, compact electron sources. Previous work has concentrated on structures powered transversely by short, single cycle THz pulses, with mm scale, segmented interaction regions that are ideal for acceleration of electrons in the sub to few MeV range where electron velocities vary significantly. However, in order to extend this technology to the multi MeV range, investigation of approaches supporting longer interaction lengths is needed. Here, we demonstrate first steps in electron acceleration and manipulation using dielectrically lined waveguides powered by temporally long, narrowband, multi cycle THz pulses that co propagate with the electrons. This geometry offers centimeter scale single stage interaction lengths and offers the opportunity to further increase interaction lengths by cascading acceleration stages that recycle the THz energy and rephase the interaction. We prove the feasibility of THz energy recycling for the first time by demonstrating acceleration, compression and focusing in two sequential Al2O3 based dielectric capillary stages powered by the same multi cycle THz pulse. Since the multi cycle energy achievable using laser based sources is currently a limiting factor for the maximum electron acceleration, THz energy recycling provides a key enabling factor for reaching relativistic energies with existing sources.


Cui Prodest? Reciprocity of collaboration measured by Russian Index of Science Citation. Scientific collaboration is often not perfectly reciprocal. Scientifically strong countries institutions laboratories may help their less prominent partners with leading scholars, or finance, or other resources. What is interesting in such type of collaboration is that (1) it may be measured by bibliometrics and (2) it may shed more light on the scholarly level of both collaborating organizations themselves. In this sense measuring institutions in collaboration sometimes may tell more than attempts to assess them as stand alone organizations. Evaluation of collaborative patterns was explained in detail, for example, by Glanzel (2001 2003). Here we combine these methods with a new one, made available by separating 'the best' journals from 'others' on the same platform of Russian Index of Science Citation (RISC). Such sub universes of journals from 'different leagues' provide additional methods to study how collaboration influences the quality of papers published by organizations.


Single photon detection in the mid infrared up to 10 micron wavelength using tungsten silicide superconducting nanowire detectors. We developed superconducting nanowire single photon detectors (SNSPDs) based on tungsten silicide (WSi) that show saturated internal detection efficiency up to a wavelength of 10 um. These detectors are promising for applications in the mid infrared requiring ultra high gain stability, low dark counts, and high efficiency such as chemical sensing, LIDAR, dark matter searches and exoplanet spectroscopy.


ORCSolver An Efficient Solver for Adaptive GUI Layout with OR Constraints. OR constrained (ORC) graphical user interface layouts unify conventional constraint based layouts with flow layouts, which enables the definition of flexible layouts that adapt to screens with different sizes, orientations, or aspect ratios with only a single layout specification. Unfortunately, solving ORC layouts with current solvers is time consuming and the needed time increases exponentially with the number of widgets and constraints. To address this challenge, we propose ORCSolver, a novel solving technique for adaptive ORC layouts, based on a branch and bound approach with heuristic preprocessing. We demonstrate that ORCSolver simplifies ORC specifications at runtime and our approach can solve ORC layout specifications efficiently at near interactive rates.


Keeping Track of User Steering Actions in Dynamic Workflows. In long lasting scientific workflow executions in HPC machines, computational scientists (the users in this work) often need to fine tune several workflow parameters. These tunings are done through user steering actions that may significantly improve performance (e.g., reduce execution time) or improve the overall results. However, in executions that last for weeks, users can lose track of what has been adapted if the tunings are not properly registered. In this work, we build on provenance data management to address the problem of tracking online parameter fine tuning in dynamic workflows steered by users. We propose a lightweight solution to capture and manage provenance of the steering actions online with negligible overhead. The resulting provenance database relates tuning data with data for domain, dataflow provenance, execution, and performance, and is available for analysis at runtime. We show how users may get a detailed view of the execution, providing insights to determine when and how to tune. We discuss the applicability of our solution in different domains and validate its ability to allow for online capture and analyses of parameter fine tunings in a real workflow in the Oil and Gas industry. In this experiment, the user could determine which tuned parameters influenced simulation accuracy and performance. The observed overhead for keeping track of user steering actions at runtime is less than 1 of total execution time.


Tensor Completion Made Practical. Tensor completion is a natural higher order generalization of matrix completion where the goal is to recover a low rank tensor from sparse observations of its entries. Existing algorithms are either heuristic without provable guarantees, based on solving large semidefinite programs which are impractical to run, or make strong assumptions such as requiring the factors to be nearly orthogonal. In this paper we introduce a new variant of alternating minimization, which in turn is inspired by understanding how the progress measures that guide convergence of alternating minimization in the matrix setting need to be adapted to the tensor setting. We show strong provable guarantees, including showing that our algorithm converges linearly to the true tensors even when the factors are highly correlated and can be implemented in nearly linear time. Moreover our algorithm is also highly practical and we show that we can complete third order tensors with a thousand dimensions from observing a tiny fraction of its entries. In contrast, and somewhat surprisingly, we show that the standard version of alternating minimization, without our new twist, can converge at a drastically slower rate in practice.


Mask guided Style Transfer Network for Purifying Real Images. Recently, the progress of learning by synthesis has proposed a training model for synthetic images, which can effectively reduce the cost of human and material resources. However, due to the different distribution of synthetic images compared with real images, the desired performance cannot be achieved. To solve this problem, the previous method learned a model to improve the realism of the synthetic images. Different from the previous methods, this paper try to purify real image by extracting discriminative and robust features to convert outdoor real images to indoor synthetic images. In this paper, we first introduce the segmentation masks to construct RGB mask pairs as inputs, then we design a mask guided style transfer network to learn style features separately from the attention and bkgd(background) regions and learn content features from full and attention region. Moreover, we propose a novel region level task guided loss to restrain the features learnt from style and content. Experiments were performed using mixed studies (qualitative and quantitative) methods to demonstrate the possibility of purifying real images in complex directions. We evaluate the proposed method on various public datasets, including LPW, COCO and MPIIGaze. Experimental results show that the proposed method is effective and achieves the state of the art results.


Assessing differentially private deep learning with Membership Inference. Attacks that aim to identify the training data of public neural networks represent a severe threat to the privacy of individuals participating in the training data set. A possible protection is offered by anonymization of the training data or training function with differential privacy. However, data scientists can choose between local and central differential privacy and need to select meaningful privacy parameters epsilon which is challenging for non privacy experts. We empirically compare local and central differential privacy mechanisms under white and black box membership inference to evaluate their relative privacy accuracy trade offs. We experiment with several datasets and show that this trade off is similar for both types of mechanisms. This suggests that local differential privacy is a sound alternative to central differential privacy for differentially private deep learning, since small epsilon in central differential privacy and large epsilon in local differential privacy result in similar membership inference attack risk.


PSTGF time independent R Matrix atomic electron impact code. STGF is a community code employed for outer region R matrix calculations, describing electron impact collisional processes. It is widely recognised that the original version of STGF was written by M. J. Seaton in 1983, but through constant refinement over the next decades by worldwide contributors has evolved into its current form that more reflects modern coding practice and current computer architectures. Despite its current wide acceptance, it was never formally published. Therefore, we present an updated high performance parallel version of PSTGF, that balances the requirements of small university clusters, yet can exploit the computational power of cutting edge supercomputers. There are many improvements over the original STGF, but most noticeably, the full introduction of MQDT options that provide subsequent integration with ICFT (Intermediate Coupling Frame Transformation) codes, and for either Breit Pauli DARC (Dirac Atomic R matrix Codes), better load balancing, high levels of vectorisation and simplified output. Semantically, the program is full fortran 90 in conjunction with MPI (Message Passing Interface) though has CUDA fortran options for the most numerically intensive code sections.


Divine Emanation as Cosmic Origin Ibn Sina and His Critics. The question of cosmic beginning has always attracted considerable attention from serious thinkers past and present. This article examines Ibn Sina's proposed solution to the vexed problem that given an eternally existing world and one eternally existing God, how the two necessarily can possibly co exist without having the perfect, simple unity of God destroyed by contact with the multiplicity of material things. Both Ibn Sina's arguments as well as the counter arguments of his critics are analyzed and assessed.


Counting monochromatic solutions to diagonal Diophantine equations. We show how to adapt the Hardy Littlewood circle method to count monochromatic solutions to diagonal Diophantine equations. This delivers a lower bound which is optimal up to absolute constants. The method is illustrated on equations obtained by setting a diagonal quadratic form equal to a linear form. As a consequence, we determine an algebraic criterion for when such equations are partition regular. Our methods involve discrete harmonic analysis and require a number of mixed' restriction estimates, which may be of independent interest.


Dirty Road Can Attack Security of Deep Learning based Automated Lane Centering under Physical World Attack. Automated Lane Centering (ALC) systems are convenient and widely deployed today, but also highly security and safety critical. In this work, we are the first to systematically study the security of state of the art deep learning based ALC systems in their designed operational domains under physical world adversarial attacks. We formulate the problem with a safety critical attack goal, and a novel and domain specific attack vector dirty road patches. To systematically generate the attack, we adopt an optimization based approach and overcome domain specific design challenges such as camera frame inter dependencies due to attack influenced vehicle control, and the lack of objective function design for lane detection models. We evaluate our attack on a production ALC using 80 scenarios from real world driving traces. The results show that our attack is highly effective with over 97.5 success rates and less than 0.903 sec average success time, which is substantially lower than the average driver reaction time. This attack is also found (1) robust to various real world factors such as lighting conditions and view angles, (2) general to different model designs, and (3) stealthy from the driver's view. To understand the safety impacts, we conduct experiments using software in the loop simulation and attack trace injection in a real vehicle. The results show that our attack can cause a 100 collision rate in different scenarios, including when tested with common safety features such as automatic emergency braking. We also evaluate and discuss defenses.


Unique maximum independent sets in graphs on monomials of a fixed degree. We consider graphs on monomials in n variables of a fixed degree d where two monomials are adjacent if and only if their least common multiple has degree d 1 . We prove that when n 3 and d is divisible by 3 as well as when n 4 and d is even that these graphs have a unique maximum independent set. Domination in these graphs is also considered, and we conjecture that there is equality of the domination number and independent domination number in all cases.


Self Supervised Gait Encoding with Locality Aware Attention for Person Re Identification. Gait based person re identification (Re ID) is valuable for safety critical applications, and using only 3D skeleton data to extract discriminative gait features for person Re ID is an emerging open topic. Existing methods either adopt hand crafted features or learn gait features by traditional supervised learning paradigms. Unlike previous methods, we for the first time propose a generic gait encoding approach that can utilize unlabeled skeleton data to learn gait representations in a self supervised manner. Specifically, we first propose to introduce self supervision by learning to reconstruct input skeleton sequences in reverse order, which facilitates learning richer high level semantics and better gait representations. Second, inspired by the fact that motion's continuity endows temporally adjacent skeletons with higher correlations ("locality"), we propose a locality aware attention mechanism that encourages learning larger attention weights for temporally adjacent skeletons when reconstructing current skeleton, so as to learn locality when encoding gait. Finally, we propose Attention based Gait Encodings (AGEs), which are built using context vectors learned by locality aware attention, as final gait representations. AGEs are directly utilized to realize effective person Re ID. Our approach typically improves existing skeleton based methods by 10 20 Rank 1 accuracy, and it achieves comparable or even superior performance to multi modal methods with extra RGB or depth information. Our codes are available at https github.com Kali Hac SGE LA.


Understanding and Improving Lexical Choice in Non Autoregressive Translation. Knowledge distillation (KD) is essential for training non autoregressive translation (NAT) models by reducing the complexity of the raw data with an autoregressive teacher model. In this study, we empirically show that as a side effect of this training, the lexical choice errors on low frequency words are propagated to the NAT model from the teacher model. To alleviate this problem, we propose to expose the raw data to NAT models to restore the useful information of low frequency words, which are missed in the distilled data. To this end, we introduce an extra Kullback Leibler divergence term derived by comparing the lexical choice of NAT model and that embedded in the raw data. Experimental results across language pairs and model architectures demonstrate the effectiveness and universality of the proposed approach. Extensive analyses confirm our claim that our approach improves performance by reducing the lexical choice errors on low frequency words. Encouragingly, our approach pushes the SOTA NAT performance on the WMT14 English German and WMT16 Romanian English datasets up to 27.8 and 33.8 BLEU points, respectively. The source code will be released.


RoboCup 2019 AdultSize Winner NimbRo Deep Learning Perception, In Walk Kick, Push Recovery, and Team Play Capabilities. Individual and team capabilities are challenged every year by rule changes and the increasing performance of the soccer teams at RoboCup Humanoid League. For RoboCup 2019 in the AdultSize class, the number of players (2 vs. 2 games) and the field dimensions were increased, which demanded for team coordination and robust visual perception and localization modules. In this paper, we present the latest developments that lead team NimbRo to win the soccer tournament, drop in games, technical challenges and the Best Humanoid Award of the RoboCup Humanoid League 2019 in Sydney. These developments include a deep learning vision system, in walk kicks, step based push recovery, and team play strategies.


Learning to segment from misaligned and partial labels. To extract information at scale, researchers increasingly apply semantic segmentation techniques to remotely sensed imagery. While fully supervised learning enables accurate pixel wise segmentation, compiling the exhaustive datasets required is often prohibitively expensive. As a result, many non urban settings lack the ground truth needed for accurate segmentation. Existing open source infrastructure data for these regions can be inexact and non exhaustive. Open source infrastructure annotations like OpenStreetMaps (OSM) are representative of this issue while OSM labels provide global insights to road and building footprints, noisy and partial annotations limit the performance of segmentation algorithms that learn from them. In this paper, we present a novel and generalizable two stage framework that enables improved pixel wise image segmentation given misaligned and missing annotations. First, we introduce the Alignment Correction Network to rectify incorrectly registered open source labels. Next, we demonstrate a segmentation model the Pointer Segmentation Network that uses corrected labels to predict infrastructure footprints despite missing annotations. We test sequential performance on the AIRS dataset, achieving a mean intersection over union score of 0.79 more importantly, model performance remains stable as we decrease the fraction of annotations present. We demonstrate the transferability of our method to lower quality data, by applying the Alignment Correction Network to OSM labels to correct building footprints we also demonstrate the accuracy of the Pointer Segmentation Network in predicting cropland boundaries in California from medium resolution data. Overall, our methodology is robust for multiple applications with varied amounts of training data present, thus offering a method to extract reliable information from noisy, partial data.


Ramsey numbers and monotone colorings. For positive integers N and r geq 2 , an r monotone coloring of binom 1, dots,N r is a 2 coloring by 1 and 1 that is monotone on the lexicographically ordered sequence of r tuples of every (r 1) tuple from binom 1, dots,N r 1 . Let overline R mon (n r) be the minimum N such that every r monotone coloring of binom 1, dots,N r contains a monochromatic copy of binom 1, dots,n r . For every r geq 3 , it is known that overline R mon (n r) leq tow r 1 (O(n)) , where tow h(x) is the tower function of height h 1 defined as tow 1(x) x and tow h(x) 2 tow h 1 (x) for h geq 2 . The Erd H o s Szekeres Lemma and the Erd H o s Szekeres Theorem imply overline R mon (n 2) (n 1) 2 1 and overline R mon (n 3) binom 2n 4 n 2 1 , respectively. It follows from a result of Eli ' a v s and Matou v s ek that overline R mon (n 4) geq tow 3( Omega(n)) . We show that overline R mon (n r) geq tow r 1 ( Omega(n)) for every r geq 3 . This, in particular, solves an open problem posed by Eli ' a v s and Matou v s ek and by Moshkovitz and Shapira. Using two geometric interpretations of monotone colorings, we show connections between estimating overline R mon (n r) and two Ramsey type problems that have been recently considered by several researchers. Namely, we show connections with higher order Erd H o s Szekeres theorems and with Ramsey type problems for order type homogeneous sequences of points. We also prove that the number of r monotone colorings of binom 1, dots,N r is 2 N r 1 r Theta(r) for N geq r geq 3 , which generalizes the well known fact that the number of simple arrangements of N pseudolines is 2 Theta(N 2) .


Regularity of global solutions of partial differential equations in non isotropic ultradifferentiable spaces via time frequency methods. In this paper we study regularity of partial differential equations with polynomial coefficients in non isotropic Beurling spaces of ultradifferentiable functions of global type. We study the action of transformations of Gabor and Wigner type in such spaces and we prove that a suitable representation of Wigner type allows to prove regularity for classes of operators that do not have classical hypoellipticity properties.


Trajectory Based Urban Air Mobility (UAM) Operations Simulator (TUS). Nowadays, the demand for optimized services in urban environments to provide better society wellness is increasing. In this sense, ground transportation in dense urban environments has been facing challenges for many years (e.g., congestion and resilience). One import outcome of the effort made toward the creation of new concepts for enhancing urban transportation is the Urban Air Mobility (UAM) concept. UAM aims at enhancing city transportation services using manned and unmanned vehicles. However, these operations bring many challenges to be faced, e.g., the interaction between the controller agent and autonomous vehicles. Furthermore, trajectory planning is not a simple task due to several factors. Firstly, the trajectories must consider a reduced minimum separation as eVTOL vehicle are expected to operate in complex urban environments. This leads the trajectory planning process to observe safety primitives more restrictively once the airspace is expected to comport many vehicles that follow small minimum separation standards. Thereupon, the main goal of the Trajectory Based UAM Operations Simulator (TUS) is to simulate the Trajectory Based UAM operations in urban environments considering the presence of both manned and unmanned eVTOL vehicles. For this, a Discrete Event Simulation (DES) approach is adopted, which considers an input (i.e., the eVTOL vehicles, their origin and destination, and their respective trajectories) and produces an output (which describes if the trajectories are safe and the elapsed operation time). The main contribution of this simulation tool is to provide a simulated environment for testing and measuring the effectiveness (e.g., flight duration) of trajectories planned for eVTOL vehicles.


A combinatorial bijection on di sk trees. A di sk tree is a rooted binary tree whose nodes are labeled by oplus or ominus , and no node has the same label as its right child. The di sk trees are in natural bijection with separable permutations. We construct a combinatorial bijection on di sk trees proving the two quintuples ( LMAX, LMIN, DESB, iar, comp) and ( LMAX, LMIN, DESB, comp, iar) have the same distribution over separable permutations. Here for a permutation pi , LMAX( pi) LMIN( pi) is the set of values of the left to right maxima minima of pi and DESB( pi) is the set of descent bottoms of pi , while comp( pi) and iar( pi) are respectively the number of components of pi and the length of initial ascending run of pi . Interestingly, our bijection specializes to a bijection on 312 avoiding permutations, which provides (up to the classical em Knuth Richards bijection ) an alternative approach to a result of Rubey (2016) that asserts the two triples ( LMAX, iar, comp) and ( LMAX, comp, iar) are equidistributed on 321 avoiding permutations. Rubey's result is a symmetric extension of an equidistribution due to Adin Bagno Roichman, which implies the class of 321 avoiding permutations with a prescribed number of components is Schur positive. Some equidistribution results for various statistics concerning tree traversal are presented in the end.


Fast Reliability Ranking of Matchstick Minimal Networks. In this article, we take a closer look at the reliability of large minimal networks constructed by repeated compositions of the simplest possible networks. For a given number of devices n 2 m we define the set of all the possible compositions of series and parallel networks of two devices. We then define several partial orders over this set and study their properties. As far as we know the ranking problem has not been addressed before in this context, and this article establishes the first results in this direction. The usual approach when dealing with reliability of two terminal networks is to determine existence or non existence of uniformly most reliable networks. The problem of ranking two terminal networks is thus more complex, but by restricting our study to the set of compositions we manage to determine and demonstrate the existence of a poset.


Adaptive Low level Storage of Very Large Knowledge Graphs. The increasing availability and usage of Knowledge Graphs (KGs) on the Web calls for scalable and general purpose solutions to store this type of data structures. We propose Trident, a novel storage architecture for very large KGs on centralized systems. Trident uses several interlinked data structures to provide fast access to nodes and edges, with the physical storage changing depending on the topology of the graph to reduce the memory footprint. In contrast to single architectures designed for single tasks, our approach offers an interface with few low level and general purpose primitives that can be used to implement tasks like SPARQL query answering, reasoning, or graph analytics. Our experiments show that Trident can handle graphs with 10 11 edges using inexpensive hardware, delivering competitive performance on multiple workloads.


Social and Scene Aware Trajectory Prediction in Crowded Spaces. Mimicking human ability to forecast future positions or interpret complex interactions in urban scenarios, such as streets, shopping malls or squares, is essential to develop socially compliant robots or self driving cars. Autonomous systems may gain advantage on anticipating human motion to avoid collisions or to naturally behave alongside people. To foresee plausible trajectories, we construct an LSTM (long short term memory) based model considering three fundamental factors people interactions, past observations in terms of previously crossed areas and semantics of surrounding space. Our model encompasses several pooling mechanisms to join the above elements defining multiple tensors, namely social, navigation and semantic tensors. The network is tested in unstructured environments where complex paths emerge according to both internal (intentions) and external (other people, not accessible areas) motivations. As demonstrated, modeling paths unaware of social interactions or context information, is insufficient to correctly predict future positions. Experimental results corroborate the effectiveness of the proposed framework in comparison to LSTM based models for human path prediction.


Approximating Quasi Stationary Distributions with Interacting Reinforced Random Walks. We propose two numerical schemes for approximating quasi stationary distributions (QSD) of finite state Markov chains with absorbing states. Both schemes are described in terms of certain interacting chains in which the interaction is given in terms of the total time occupation measure of all particles in the system and has the impact of reinforcing transitions, in an appropriate fashion, to states where the collection of particles has spent more time. The schemes can be viewed as combining the key features of the two basic simulation based methods for approximating QSD originating from the works of Fleming and Viot (1979) and Aldous, Flannery and Palacios (1998), respectively. The key difference between the two schemes studied here is that in the first method one starts with a(n) particles at time 0 and number of particles stays constant over time whereas in the second method we start with one particle and at most one particle is added at each time instant in such a manner that there are a(n) particles at time n . We prove almost sure convergence to the unique QSD and establish Central Limit Theorems for the two schemes under the key assumption that a(n) o(n) . When a(n) sim n , the fluctuation behavior is expected to be non standard. Some exploratory numerical results are presented to illustrate the performance of the two approximation schemes.


On incidences of lines in regular complexes. A regular linear line complex is a three parameter set of lines in space, whose Pl "ucker vectors lie in a hyperplane, which is not tangent to the Klein quadric. Our main result is a bound O(n 1 2 m 3 4 m n) for the number of incidences between n lines in a complex and m points in mathbb F 3 , where mathbb F is a field, and n leq char( mathbb F) 4 3 in positive characteristic. Zahl has recently observed that bichromatic pairwise incidences of lines coming from two distinct line complexes account for the nonzero single distance problem for a set of n points in mathbb F 3 . This implied the new bound O(n 3 2 ) for the number of realisations of the distance, which is a square, for mathbb F , where 1 is not a square in the mathbb F analogue of the Erd H os single distance problem in mathbb R 3 . Our incidence bound yields, under a natural constraint, a weaker bound O(n 1.6 ) , which holds for any distance, including zero, over any mathbb F .


Wireless Avionics Intra Communications A Survey of Benefits, Challenges, and Solutions. In the aeronautics industry, wireless avionics intra communications have a tremendous potential to improve efficiency and flexibility while reducing the weight, fuel consumption, and maintenance costs over traditional wired avionics systems. This survey starts with an overview of the major benefits and opportunities in the deployment of wireless technologies for critical applications of an aircraft. The current state of art is presented in terms of system classifications based on data rate demands and transceiver installation locations. We then discuss major technical challenges in the design and realization of the envisioned aircraft applications. Although wireless avionics intra communication has aspects and requirements similar to mission critical applications of industrial automation, it also has specific issues such as complex structures, operations, and safety of the aircraft that make this area of research self standing and challenging. To support the critical operations of an aircraft, existing wireless standards for mission critical industrial applications are briefly discussed to investigate the applicability of the current solutions. Specifically, IEEE 802.15.4 based protocols and Bluetooth are discussed for low data rate applications, whereas IEEE 802.11 based standards are considered for high data rate applications. Eventually, we propose fundamental schemes in terms of network architecture, protocol, and resource management to support the critical avionics applications and discuss the research directions in this emerging area.


Story Ending Prediction by Transferable BERT. Recent advances, such as GPT and BERT, have shown success in incorporating a pre trained transformer language model and fine tuning operation to improve downstream NLP systems. However, this framework still has some fundamental problems in effectively incorporating supervised knowledge from other related tasks. In this study, we investigate a transferable BERT (TransBERT) training framework, which can transfer not only general language knowledge from large scale unlabeled data but also specific kinds of knowledge from various semantically related supervised tasks, for a target task. Particularly, we propose utilizing three kinds of transfer tasks, including natural language inference, sentiment classification, and next action prediction, to further train BERT based on a pre trained model. This enables the model to get a better initialization for the target task. We take story ending prediction as the target task to conduct experiments. The final result, an accuracy of 91.8 , dramatically outperforms previous state of the art baseline methods. Several comparative experiments give some helpful suggestions on how to select transfer tasks. Error analysis shows what are the strength and weakness of BERT based models for story ending prediction.


Optimal convergence of a second order low regularity integrator for the KdV equation. In this paper, we establish the optimal convergence result of a second order exponential type integrator from (136, Numer. Math., 2017) for solving the KdV equation under rough initial data. The scheme is explicit and efficient to implement. By rigorous error analysis, we show that the scheme provides the second order accuracy in H gamma for initial data in H gamma 4 for any gamma geq0 , where the regularity requirement is lower than the classical methods. The result is confirmed by numerical experiments and comparisons are made with the Strang splitting scheme.


The Boundary Element Method of Peridynamics. The peridynamic theory brings advantages in dealing with discontinuities, dynamic loading, and non locality. The integro differential formulation of peridynamics poses challenges to numerical solutions of complicated and practical problems. Some important issues attract much attention, such as the computation of infinite domains, the treatment of softening of boundaries due to an incomplete horizon, and time error accumulation in dynamic processes. In this work, we develop the textit peridynamic boundary element method (PD BEM). The numerical examples demonstrate that the PD BEM exhibits several features. First, for non destructive cases, the PD BEM can be one to two orders of magnitude faster than the peridynamic meshless particle method (PD MPM) that directly discretizes the computational domains second, it eliminates the time accumulation error, and thus conserves the total energy much better than the PD MPM third, it does not exhibit spurious boundary softening phenomena. For destructive cases where new boundaries emerge during the loading process, we propose a coupling scheme where the PD MPM is applied to the cracked region and the PD BEM is applied to the un cracked region such that the time of computation can be significantly reduced.


HMPO Human Motion Prediction in Occluded Environments for Safe Motion Planning. We present a novel approach to generate collision free trajectories for a robot operating in close proximity with a human obstacle in an occluded environment. The self occlusions of the robot can significantly reduce the accuracy of human motion prediction, and we present a novel deep learning based prediction algorithm. Our formulation uses CNNs and LSTMs and we augment human action datasets with synthetically generated occlusion information for training. We also present an occlusion aware planner that uses our motion prediction algorithm to compute collision free trajectories. We highlight performance of the overall approach (HMPO) in complex scenarios and observe upto 68 performance improvement in motion prediction accuracy, and 38 improvement in terms of error distance between the ground truth and the predicted human joint positions.


Multi View Region Adaptive Multi temporal DMM and RGB Action Recognition. Human action recognition remains an important yet challenging task. This work proposes a novel action recognition system. It uses a novel Multiple View Region Adaptive Multi resolution in time Depth Motion Map (MV RAMDMM) formulation combined with appearance information. Multiple stream 3D Convolutional Neural Networks (CNNs) are trained on the different views and time resolutions of the region adaptive Depth Motion Maps. Multiple views are synthesised to enhance the view invariance. The region adaptive weights, based on localised motion, accentuate and differentiate parts of actions possessing faster motion. Dedicated 3D CNN streams for multi time resolution appearance information (RGB) are also included. These help to identify and differentiate between small object interactions. A pre trained 3D CNN is used here with fine tuning for each stream along with multiple class Support Vector Machines (SVM)s. Average score fusion is used on the output. The developed approach is capable of recognising both human action and human object interaction. Three public domain datasets including MSR 3D Action,Northwestern UCLA multi view actions and MSR 3D daily activity are used to evaluate the proposed solution. The experimental results demonstrate the robustness of this approach compared with state of the art algorithms.


Explicit positive solutions to G heat equations and the application to G capacities. In this paper, we study a class of explicit positive solutions to G heat equations by solving second order nonlinear ordinary differential equations. Based on the positive solutions, we give the sharp order of G capacity c sigma left( left varepsilon, varepsilon right right) when varepsilon rightarrow0 .


Recent Advances in Imitation Learning from Observation. Imitation learning is the process by which one agent tries to learn how to perform a certain task using information generated by another, often more expert agent performing that same task. Conventionally, the imitator has access to both state and action information generated by an expert performing the task (e.g., the expert may provide a kinesthetic demonstration of object placement using a robotic arm). However, requiring the action information prevents imitation learning from a large number of existing valuable learning resources such as online videos of humans performing tasks. To overcome this issue, the specific problem of imitation from observation (IfO) has recently garnered a great deal of attention, in which the imitator only has access to the state information (e.g., video frames) generated by the expert. In this paper, we provide a literature review of methods developed for IfO, and then point out some open research problems and potential future work.


Sketch and test picture centered research with p5.js assisted crowdsourcing. Relating human judgements to pictures is central to a wide variety of scientific disciplines. Pictures are used to evoke and study faculties of the human mind, while human input is used to label, understand and model pictorial representations. Human input is often collected through online crowdsourcing experiments. This paper discusses the usage of crowdsourcing in two major branches of picture centered research, human and computer vision, and identifies novel directions such as art history and design. We demonstrate that a wide variety of experiments can be conducted by using p5.js, a library originally intended to facilitate visual creation. We report five complementary experimental paradigms to illustrated the accessibility and versatility of p5.js Change blindness, BubbleView, 3D shape perception, Composition, and Perspective reconstruction. Results reveal that literature findings can be reproduced and novel insights can easily be achieved with the p5.js library. The creative freedom of p5.js combined with low threshold access to crowdsourcing seems like a powerful combination for all picture centred research areas perception, design, art history, communication, and beyond.


On Docile Spaces, Mackey First Countable Spaces, and Sequentially Mackey First Countable Spaces. In this article we discuss the relationship between three types of locally convex spaces docile spaces, Mackey first countable spaces, and sequentially Mackey first countable spaces. More precisely, we show that docile spaces are sequentially Mackey first countable. We also show the existence of sequentially Mackey first countable spaces that are not Mackey first countable, and we characterize Mackey first countable spaces in terms of normability of certain inductive limits.


Spatially Adapted First and Second Order Regularization for Image Reconstruction From an Image Surface Perspective. In this paper, we propose a new variational model for image reconstruction by minimizing the L 1 norm of the emph Weingarten map of image surface (x,y,f(x,y)) for a given image f mathrm Omega rightarrow mathbb R . We analytically prove that the Weingarten map minimization model can not only keep the greyscale intensity contrasts of images, but also preserve edges and corners of objects. The alternating direction method of multiplier (ADMM) based algorithm is developed, where one subproblem needs to be solved by gradient descent. In what follows, we derive a hybrid nonlinear first and second order regularization from the Weingarten map, and present an efficient ADMM based algorithm by regarding the nonlinear weights as known. By comparing with several state of the art methods on synthetic and real image reconstruction problems, it confirms that the proposed models can well preserve image contrasts and features, especially the spatially adapted first and second order regularization economizing much computational cost.


Generalizable Model agnostic Semantic Segmentation via Target specific Normalization. Semantic segmentation in a supervised learning manner has achieved significant progress in recent years. However, its performance usually drops dramatically due to the data distribution discrepancy between seen and unseen domains when we directly deploy the trained model to segment the images of unseen (or new coming) domains. To this end, we propose a novel domain generalization framework for the generalizable semantic segmentation task, which enhances the generalization ability of the model from two different views, including the training paradigm and the test strategy. Concretely, we exploit the model agnostic learning to simulate the domain shift problem, which deals with the domain generalization from the training scheme perspective. Besides, considering the data distribution discrepancy between seen source and unseen target domains, we develop the target specific normalization scheme to enhance the generalization ability. Furthermore, when images come one by one in the test stage, we design the image based memory bank (Image Bank in short) with style based selection policy to select similar images to obtain more accurate statistics of normalization. Extensive experiments highlight that the proposed method produces state of the art performance for the domain generalization of semantic segmentation on multiple benchmark segmentation datasets, i.e., Cityscapes, Mapillary.


Unramified Whittaker functions for certain Brylinski Deligne covering groups. For a Brylinski Deligne covering group of a general linear group, we calculate some values of unramified Whittaker functions for certain representations that are analogous to the theta representations.


Sums of Integral Squares In Certain Complex Bi quadratic Fields. Let K be an algebraic number field and O K be its ring of integers. Let S K be the set of elements in O K which are sums of squares in O K and s(O K) the minimal number of squares necessary to represent 1in O K. Let g( S K ) be the smallest positive integer t such that every element in S K is a sum of t squares in O K. Here K is generated over field of rational number by square root of m and n , where m congruent 3 mod 4 and n congruent 1 mod 4 are two distinct positive square free integers, we prove that S K O K. We also prove that g(O K) less or equals to s(O K) 1 or s(O K) 2. Applying this, we shows that if s(O K) 2, then g(O K) 3. This work is continuation of a recent study initiated by Zhang and Ji .