Maximal dissipative solutions for incompressible fluid dynamics. We introduce the new concept of maximal dissipative solutions for a general class of isothermal GENERIC systems. Under certain assumption, we show that maximal dissipative solutions are well posed as long as the bigger class of dissipative solutions is non empty. Applying this result to the Navier Stokes and Euler equations, we infer global well posedness of maximal dissipative solutions for these systems. The concept of maximal dissipative solutions coincides with the concept of weak solutions as long as the weak solutions inherits enough regularity to be unique.


Transfer Learning for Aided Target Recognition Comparing Deep Learning to other Machine Learning Approaches. Aided target recognition (AiTR), the problem of classifying objects from sensor data, is an important problem with applications across industry and defense. While classification algorithms continue to improve, they often require more training data than is available or they do not transfer well to settings not represented in the training set. These problems are mitigated by transfer learning (TL), where knowledge gained in a well understood source domain is transferred to a target domain of interest. In this context, the target domain could represents a poorly labeled dataset, a different sensor, or an altogether new set of classes to identify. While TL for classification has been an active area of machine learning (ML) research for decades, transfer learning within a deep learning framework remains a relatively new area of research. Although deep learning (DL) provides exceptional modeling flexibility and accuracy on recent real world problems, open questions remain regarding how much transfer benefit is gained by using DL versus other ML architectures. Our goal is to address this shortcoming by comparing transfer learning within a DL framework to other ML approaches across transfer tasks and datasets. Our main contributions are 1) an empirical analysis of DL and ML algorithms on several transfer tasks and domains including gene expressions and satellite imagery, and 2) a discussion of the limitations and assumptions of TL for aided target recognition both for DL and ML in general. We close with a discussion of future directions for DL transfer.


Dogfooding use IBM Cloud services to monitor IBM Cloud infrastructure. The stability and performance of Cloud platforms are essential as they directly impact customers' satisfaction. Cloud service providers use Cloud monitoring tools to ensure that rendered services match the quality of service requirements indicated in established contracts such as service level agreements. Given the enormous number of resources that need to be monitored, highly scalable and capable monitoring tools are designed and implemented by Cloud service providers such as Amazon, Google, IBM, and Microsoft. Cloud monitoring tools monitor millions of virtual and physical resources and continuously generate logs for each one of them. Considering that logs magnify any technical issue, they can be used for disaster detection, prevention, and recovery. However, logs are useless if they are not assessed and analyzed promptly. Thus, we argue that the scale of Cloud generated logs makes it impossible for DevOps teams to analyze them effectively. This implies that one needs to automate the process of monitoring and analysis (e.g., using machine learning and artificial intelligence). If the automation will witness an anomaly in the logs it will alert DevOps staff. The automatic anomaly detectors require a reliable and scalable platform for gathering, filtering, and transforming the logs, executing the detector models, and sending out the alerts to the DevOps staff. In this work, we report on implementing a prototype of such a platform based on the 7 layered architecture pattern, which leverages micro service principles to distribute tasks among highly scalable, resources efficient modules. The modules interact with each other via an instance of the Publish Subscribe architectural pattern. The platform is deployed on the IBM Cloud service infrastructure and is used to detect anomalies in logs emitted by the IBM Cloud services, hence the dogfooding.


Preference Neural Network. This paper proposes a preference neural network (PNN) to address the problem of indifference preferences orders with new activation function. PNN also solves the Multi label ranking problem, where labels may have indifference preference orders or subgroups are equally ranked. PNN follows a multi layer feedforward architecture with fully connected neurons. Each neuron contains a novel smooth stairstep activation function based on the number of preference orders. PNN inputs represent data features and output neurons represent label indexes. The proposed PNN is evaluated using new preference mining dataset that contains repeated label values which have not experimented before. PNN outperforms five previously proposed methods for strict label ranking in terms of accurate results with high computational efficiency.


Detection of Face Recognition Adversarial Attacks. Deep Learning methods have become state of the art for solving tasks such as Face Recognition (FR). Unfortunately, despite their success, it has been pointed out that these learning models are exposed to adversarial inputs images to which an imperceptible amount of noise for humans is added to maliciously fool a neural network thus limiting their adoption in real world applications. While it is true that an enormous effort has been spent in order to train robust models against this type of threat, adversarial detection techniques have recently started to draw attention within the scientific community. A detection approach has the advantage that it does not require to re train any model, thus it can be added on top of any system. In this context, we present our work on adversarial samples detection in forensics mainly focused on detecting attacks against FR systems in which the learning model is typically used only as a features extractor. Thus, in these cases, train a more robust classifier might not be enough to defence a FR system. In this frame, the contribution of our work is four fold i) we tested our recently proposed adversarial detection approach against classifier attacks, i.e. adversarial samples crafted to fool a FR neural network acting as a classifier ii) using a k Nearest Neighbor (kNN) algorithm as a guidance, we generated deep features attacks against a FR system based on a DL model acting as features extractor, followed by a kNN which gives back the query identity based on features similarity iii) we used the deep features attacks to fool a FR system on the 1 1 Face Verification task and we showed their superior effectiveness with respect to classifier attacks in fooling such type of system iv) we used the detectors trained on classifier attacks to detect deep features attacks, thus showing that such approach is generalizable to different types of offensives.


Uncertainty Quantification in density estimation from Background Oriented Schlieren (BOS) measurements. We present an uncertainty quantification methodology for density estimation from Background Oriented Schlieren (BOS) measurements, in order to provide local, instantaneous, a posteriori uncertainty bounds on each density measurement in the field of view. Displacement uncertainty quantification algorithms from cross correlation based Particle Image Velocimetry (PIV) are used to estimate the uncertainty in the dot pattern displacements obtained from cross correlation for BOS and assess their feasibility. In order to propagate the displacement uncertainty through the density integration procedure, we also develop a novel methodology via the Poisson solver using sparse linear operators. Testing the method using synthetic images of a Gaussian density field showed agreement between the propagated density uncertainties and the true uncertainty. Subsequently the methodology is experimentally demonstrated for supersonic flow over a wedge, showing that regions with sharp changes in density lead to an increase in density uncertainty throughout the field of view, even in regions without these sharp changes. The uncertainty propagation is influenced by the density integration scheme, and for the Poisson solver the density uncertainty increases monotonically on moving away from the regions where the Dirichlet boundary conditions are specified.


Data driven Competitive Algorithms for Online Knapsack and Set Cover. The design of online algorithms has tended to focus on algorithms with worst case guarantees, e.g., bounds on the competitive ratio. However, it is well known that such algorithms are often overly pessimistic, performing sub optimally on non worst case inputs. In this paper, we develop an approach for data driven design of online algorithms that maintain near optimal worst case guarantees while also performing learning in order to perform well for typical inputs. Our approach is to identify policy classes that admit global worst case guarantees, and then perform learning using historical data within the policy classes. We demonstrate the approach in the context of two classical problems, online knapsack and online set cover, proving competitive bounds for rich policy classes in each case. Additionally, we illustrate the practical implications via a case study on electric vehicle charging.


Tool Substitution with Shape and Material Reasoning Using Dual Neural Networks. This paper explores the problem of tool substitution, namely, identifying substitute tools for performing a task from a given set of candidate tools. We introduce a novel approach to tool substitution, that unlike prior work in the area, combines both shape and material reasoning to effectively identify substitute tools. Our approach combines the use of visual and spectral reasoning using dual neural networks. It takes as input, the desired action to be performed, and outputs a ranking of the available candidate tools based on their suitability for performing the action. Our results on a test set of 30 real world objects show that our approach is able to effectively match shape and material similarities, with improved tool substitution performance when combining both.


Morphological Skip Gram Using morphological knowledge to improve word representation. Natural language processing models have attracted much interest in the deep learning community. This branch of study is composed of some applications such as machine translation, sentiment analysis, named entity recognition, question and answer, and others. Word embeddings are continuous word representations, they are an essential module for those applications and are generally used as input word representation to the deep learning models. Word2Vec and GloVe are two popular methods to learn word embeddings. They achieve good word representations, however, they learn representations with limited information because they ignore the morphological information of the words and consider only one representation vector for each word. This approach implies that Word2Vec and GloVe are unaware of the word inner structure. To mitigate this problem, the FastText model represents each word as a bag of characters n grams. Hence, each n gram has a continuous vector representation, and the final word representation is the sum of its characters n grams vectors. Nevertheless, the use of all n grams character of a word is a poor approach since some n grams have no semantic relation with their words and increase the amount of potentially useless information. This approach also increases the training phase time. In this work, we propose a new method for training word embeddings, and its goal is to replace the FastText bag of character n grams for a bag of word morphemes through the morphological analysis of the word. Thus, words with similar context and morphemes are represented by vectors close to each other. To evaluate our new approach, we performed intrinsic evaluations considering 15 different tasks, and the results show a competitive performance compared to FastText.


Discrete effect on the anti bounce back boundary condition of lattice Bhatnagar Gross Krook model for convection diffusion equations. The discrete effect on the boundary condition has been a fundamental topic for the lattice Boltzmann method in simulating heat and mass transfer problems. In previous works based on the halfway anti bounce back (ABB) boundary condition for convection diffusion equations (CDEs), it is reported that the discrete effect cannot be commonly removed in the Bhatnagar Gross Krook (BGK) model except for a special value of relaxation time. Targeting this point in the present paper, we still proceed within the framework of BGK model for two dimensional CDEs, and analyze the discrete effect on a non halfway ABB boundary condition which incorporates the effect of the distance ratio. By analyzing an unidirectional diffusion problem with a parabolic distribution, the theoretical derivations with three different discrete velocity models show that the numerical slip is a combined function of the relaxation time and the distance ratio. Different from previous works, we definitely find that the relaxation time can be freely adjusted by the distance ratio in a proper range to eliminate the numerical slip. Some numerical simulations are carried out to validate the theoretical derivations, and the numerical results for the cases of straight and curved boundaries confirm our theoretical analysis. Finally, it should be noted that the present analysis can be extended from the BGK model to other lattice Boltzmann (LB) collision models for CDEs, which can broaden the parameter range of the relaxation time to approach 0.5.


Optimal Rank 1 Hankel Approximation of Matrices Frobenius Norm, Spectral Norm, and Cadzow's Algorithm. We characterize optimal rank 1 matrix approximations with Hankel or Toeplitz structure with regard to two different norms, the Frobenius norm and the spectral norm, in a new way. More precisely, we show that these rank 1 matrix approximation problems can be solved by maximizing special rational functions. Our approach enables us to show that the optimal solutions with respect to these two norms have completely different structure and only coincide in the trivial case when the singular value decomposition already provides an optimal rank 1 approximation with the desired Hankel or Toeplitz structure. We also prove that the Cadzow algorithm for structured low rank approximations always converges to a fixed point in the rank 1 case. However, it usually does not converge to the optimal solution, neither with regard to the Frobenius norm nor the spectral norm.


ALP KD Attention Based Layer Projection for Knowledge Distillation. Knowledge distillation is considered as a training and compression strategy in which two neural networks, namely a teacher and a student, are coupled together during training. The teacher network is supposed to be a trustworthy predictor and the student tries to mimic its predictions. Usually, a student with a lighter architecture is selected so we can achieve compression and yet deliver high quality results. In such a setting, distillation only happens for final predictions whereas the student could also benefit from teacher's supervision for internal components. Motivated by this, we studied the problem of distillation for intermediate layers. Since there might not be a one to one alignment between student and teacher layers, existing techniques skip some teacher layers and only distill from a subset of them. This shortcoming directly impacts quality, so we instead propose a combinatorial technique which relies on attention. Our model fuses teacher side information and takes each layer's significance into consideration, then performs distillation between combined teacher layers and those of the student. Using our technique, we distilled a 12 layer BERT (Devlin et al. 2019) into 6 , 4 , and 2 layer counterparts and evaluated them on GLUE tasks (Wang et al. 2018). Experimental results show that our combinatorial approach is able to outperform other existing techniques.


Construction of the Moduli Space of Higgs Bundles using Analytic Methods. It is a folklore theorem that the Kuranishi slice method can be used to construct the moduli space of semistable Higgs bundles on a closed Riemann surface as a complex space. The purpose of this paper is to provide a proof in detail. We also give a direct proof that the moduli space is locally modeled on an affine GIT quotient of a quadratic cone by a complex reductive group.


Simulating coliform transport and decay from 3D hydrodynamics model and in situ observation in Nice area. In coastal area, raw wastewater can be directly discharged in the sea during extreme rain events or failure of the sewage network. The highly urbanized and touristic area of Nice is directly exposed to this risk. In order to protect the bathing population and to apply the European regulation (DCE, 2000), Nice municipality has decided to work on a forecasting tool of transport and fate of fecal bacterial indicators such as Escherichia Coli. This paper deals with the first step of this approach which consists in developing a three dimensional hydrodynamic simulation coupled with water quality parameters. The model used is based on Reynolds Averaged Navier Stokes's equations for the calculation of the velocities and water depth (TELEMAC3D), and wave energy balance equation to account for the wave induced current (TOMAWAC). Two field measurements were conducted on a real wastewater pollution coming from a sewage pipe located at 38m depth. The first campaign has validated the vertical diffusion of the effluent through the water column by the means of variable depth samples and has stressed the hourly variability of sewage bacterial quality. Due to the lack of data regarding this last point, the model could not be fully validated. The second campaign has been designed to overcome this issue and to gather all the data needed to proceed to the validation of our hydro ecological simulation. The comparison of the field measurements and the simulations has successfully demonstrated the accuracy of the model. But the uncertainty associated with the laboratory analysis (MPN) are high, making the calibration and validation processes a complex task. Nevertheless, further research needs to be done regarding the variability of microbial quality in order to develop an operational tool allowing the forecast of bacterial pollution. The next step of this study will be to establish the hourly variation of microbial quality in the wastewater during dry and raining periods.


Finite dimensional modules of the universal Racah algebra and the universal additive DAHA of type (C 1 vee,C 1) . Assume that mathbb F is an algebraically closed field with characteristic zero. The universal Racah algebra Re is a unital associative mathbb F algebra defined by generators and relations. The generators are A,B, C, D and the relations state that A,B B,C C,A 2D and each of begin gather A,D AC BA, qquad B,D BA CB, qquad C,D CB AC end gather is central in Re . The universal additive DAHA (double affine Hecke algebra) mathfrak H of type (C 1 vee,C 1) is a unital associative mathbb F algebra generated by t 0,t 1,t 0 vee,t 1 vee and the relations state that t 0 t 1 t 0 vee t 1 vee 1 and each of t 0 2, t 1 2, t 0 vee 2 , t 1 vee 2 is central in mathfrak H . Each mathfrak H module is an Re module by pulling back via the algebra homomorphism Re to mathfrak H given by begin eqnarray A mapsto frac (t 1 vee t 0 vee)(t 1 vee t 0 vee 2) 4 , B mapsto frac (t 1 t 1 vee)(t 1 t 1 vee 2) 4 , C mapsto frac (t 0 vee t 1)(t 0 vee t 1 2) 4 . end eqnarray Let V denote any finite dimensional irreducible mathfrak H module. The set of Re submodules of V forms a lattice under the inclusion partial order. We classify the lattices that arise by this construction. As a consequence, the Re module V is completely reducible if and only if t 0 is diagonalizable on V .


End to End Neural Word Alignment Outperforms GIZA . Word alignment was once a core unsupervised learning task in natural language processing because of its essential role in training statistical machine translation (MT) models. Although unnecessary for training neural MT models, word alignment still plays an important role in interactive applications of neural machine translation, such as annotation transfer and lexicon injection. While statistical MT methods have been replaced by neural approaches with superior performance, the twenty year old GIZA toolkit remains a key component of state of the art word alignment systems. Prior work on neural word alignment has only been able to outperform GIZA by using its output during training. We present the first end to end neural word alignment method that consistently outperforms GIZA on three data sets. Our approach repurposes a Transformer model trained for supervised translation to also serve as an unsupervised word alignment model in a manner that is tightly integrated and does not affect translation quality.


Universal Hardy Sobolev inequalities on hypersurfaces of Euclidean space. In this paper we study Hardy Sobolev inequalities on hypersurfaces of mathbb R n 1 , all of them involving a mean curvature term and having universal constants independent of the hypersurface. We first consider the celebrated Sobolev inequality of Michael Simon and Allard, in our codimension one framework. Using their ideas, but simplifying their presentations, we give a quick and easy to read proof of the inequality. Next, we establish two new Hardy inequalities on hypersurfaces. One of them originates from an application to the regularity theory of stable solutions to semilinear elliptic equations. The other one, which we prove by exploiting a "ground state" substitution, improves the Hardy inequality of Carron. With this same method, we also obtain an improved Hardy or Hardy Poincar 'e inequality.


On L p Markov type inequality for some cuspidal domains in mathbb R 2 . The purpose of this paper is to study a Markov type inequality for algebraic polynomials in L p norm on two dimensional cuspidal domains.


A Matrix in matrix Neural Network for Image Super Resolution. In recent years, deep learning methods have achieved impressive results with higher peak signal to noise ratio in single image super resolution (SISR) tasks by utilizing deeper layers. However, their application is quite limited since they require high computing power. In addition, most of the existing methods rarely take full advantage of the intermediate features which are helpful for restoration. To address these issues, we propose a moderate size SISR net work named matrixed channel attention network (MCAN) by constructing a matrix ensemble of multi connected channel attention blocks (MCAB). Several models of different sizes are released to meet various practical requirements. Conclusions can be drawn from our extensive benchmark experiments that the proposed models achieve better performance with much fewer multiply adds and parameters. Our models will be made publicly available.


Multi Modal Learning of Keypoint Predictive Models for Visual Object Manipulation. Humans have impressive generalization capabilities when it comes to manipulating objects and tools in completely novel environments. These capabilities are, at least partially, a result of humans having internal models of their bodies and any grasped object. How to learn such body schemas for robots remains an open problem. In this work, we develop an self supervised approach that can extend a robot's kinematic model when grasping an object from visual latent representations. Our framework comprises two components (1) we present a multi modal keypoint detector an autoencoder architecture trained by fusing proprioception and vision to predict visual key points on an object (2) we show how we can use our learned keypoint detector to learn an extension of the kinematic chain by regressing virtual joints from the predicted visual keypoints. Our evaluation shows that our approach learns to consistently predict visual keypoints on objects in the manipulator's hand, and thus can easily facilitate learning an extended kinematic chain to include the object grasped in various configurations, from a few seconds of visual data. Finally we show that this extended kinematic chain lends itself for object manipulation tasks such as placing a grasped object and present experiments in simulation and on hardware.


The Active Flux scheme for nonlinear problems. The Active Flux scheme is a finite volume scheme with additional point values distributed along the cell boundary. It is third order accurate and does not require a Riemann solver. Instead, given a reconstruction, the initial value problem at the location of the point value is solved. The intercell flux is then obtained from the evolved values along the cell boundary by quadrature. Whereas for linear problems an exact evolution operator is available, for nonlinear problems one needs to resort to approximate evolution operators. This paper presents such approximate operators for nonlinear hyperbolic systems in one dimension and nonlinear scalar equations in multiple spatial dimensions. They are obtained by estimating the wave speeds to sufficient order of accuracy. Additionally, an entropy fix is introduced and a new limiting strategy is proposed. The abilities of the scheme are assessed on a variety of smooth and discontinuous setups.


Learning Lenient Parsing Typing via Indirect Supervision. Both professional coders and teachers frequently deal with imperfect (fragmentary, incomplete, ill formed) code. Such fragments are common in STACKOVERFLOW students also frequently produce ill formed code, for which instructors, TAs (or students themselves) must find repairs. In either case, the developer experience could be greatly improved if such code could somehow be parsed typed this makes such code more amenable to use within IDEs and allows early detection and repair of potential errors. We introduce a lenient parser, which can parse type fragments, even ones with simple errors. Training a machine learner to leniently parse and type imperfect code requires a large training set including many pairs of imperfect code and its repair such training sets are limited by human effort and curation. In this paper, we present a novel, indirectly supervised, approach to train a lenient parser, without access to such human curated training data. We leverage the huge corpus of mostly correct code available on Github, and the massive, efficient learning capacity of Transformer based NN architectures. Using GitHub data, we first create a large dataset of fragments of code and corresponding tree fragments and type annotations we then randomly corrupt the input fragments by seeding errors that mimic corruptions found in STACKOVERFLOW and student data. Using this data, we train high capacity transformer models to overcome both fragmentation and corruption. With this novel approach, we can achieve reasonable performance on parsing typing STACKOVERFLOW fragments we also demonstrate that our approach performs well on shorter student error program and achieves best in class performance on longer programs that have more than 400 tokens. We also show that by blending Deepfix and our tool, we could achieve 77 accuracy, which outperforms all previously reported student error correction tools.


An 'alise de Seguran c c a Baseada em Roles para F 'abricas de Software. Most software factories contain applications with sensitive information that needs to be protected against breaches of confidentiality and integrity, which can have serious consequences. In the context of large factories with complex applications, it is not feasible to manually analyze accesses to sensitive information without some form of safety mechanisms. This article presents a static analysis technique for software factories, based on role based security policies. We start by synthesising a graph representation of the relevant software factories, based on the security policy defined by the user. Later the graph model is analysed to find access information where the security policy is breached, ensuring that all possible execution states are analysed. A proof of concept of our technique has been developed for the analysis of OutSystems software factories. The security reports generated by the tool allows developers to find and prioritise security breaches in their factories. The prototype was evaluated using large software factories, with strong safety requirements. Several security flaws were found, some serious ones that would be hard to be detected without our analysis.


On 3 Coloring of (2P 4,C 5) Free Graphs. The 3 coloring of hereditary graph classes has been a deeply researched problem in the last decade. A hereditary graph class is characterized by a (possibly infinite) list of minimal forbidden induced subgraphs H 1,H 2, ldots the graphs in the class are called (H 1,H 2, ldots) free. The complexity of 3 coloring is far from being understood, even for classes defined by a few small forbidden induced subgraphs. For H free graphs, the complexity is settled for any H on up to seven vertices. There are only two unsolved cases on eight vertices, namely 2P 4 and P 8 . For P 8 free graphs, some partial results are known, but to the best of our knowledge, 2P 4 free graphs have not been explored yet. In this paper, we show that the 3 coloring problem is polynomial time solvable on (2P 4,C 5) free graphs.


Characterisation of the b 3 Sigma , v 0 State and Its Interaction with the A 1 Pi State in Aluminium Monofluoride. Recently, we determined the detailed energy level structure of the X 1 Sigma , A 1 Pi and a 3 Pi states of AlF that are relevant to laser cooling and trapping experiments. Here, we investigate the b 3 Sigma , v 0 state of the AlF molecule. A rotationally resolved (1 2) REMPI spectrum of the b 3 Sigma , v' 0 leftarrow a 3 Pi, v'' 0 band is presented and the lifetime of the b 3 Sigma , v 0 state is measured to be 190(2) ns. Hyperfine resolved, laser induced fluorescence spectra of the b 3 Sigma , v' 0 leftarrow X 1 Sigma , v'' 1 and the b 3 Sigma , v' 0 leftarrow a 3 Pi, v'' 0 bands are recorded to determine fine and hyperfine structure parameters. The interaction between the b 3 Sigma , v 0 and the nearby A 1 Pi state is studied and the magnitude of the spin orbit coupling between the two electronic states is derived using three independent methods to give a consistent value of 10(1) cm 1 . The triplet character of the A state causes an A rightarrow a loss from the main A X laser cooling cycle below the 10 6 level.


A Joint Optimization Approach of LiDAR Camera Fusion for Accurate Dense 3D Reconstructions. Fusing data from LiDAR and camera is conceptually attractive because of their complementary properties. For instance, camera images are higher resolution and have colors, while LiDAR data provide more accurate range measurements and have a wider Field Of View (FOV). However, the sensor fusion problem remains challenging since it is difficult to find reliable correlations between data of very different characteristics (geometry vs. texture, sparse vs. dense). This paper proposes an offline LiDAR camera fusion method to build dense, accurate 3D models. Specifically, our method jointly solves a bundle adjustment (BA) problem and a cloud registration problem to compute camera poses and the sensor extrinsic calibration. In experiments, we show that our method can achieve an averaged accuracy of 2.7mm and resolution of 70 points per square cm by comparing to the ground truth data from a survey scanner. Furthermore, the extrinsic calibration result is discussed and shown to outperform the state of the art method.


Some Useful Integral Representations for Information Theoretic Analyses. This work is an extension of our earlier article, where a well known integral representation of the logarithmic function was explored, and was accompanied with demonstrations of its usefulness in obtaining compact, easily calculable, exact formulas for quantities that involve expectations of the logarithm of a positive random variable. Here, in the same spirit, we derive an exact integral representation (in one or two dimensions) of the moment of a nonnegative random variable, or the sum of such independent random variables, where the moment order is a general positive noninteger real (also known as fractional moments). The proposed formula is applied to a variety of examples with an information theoretic motivation, and it is shown how it facilitates their numerical evaluations. In particular, when applied to the calculation of a moment of the sum of a large number, n , of nonnegative random variables, it is clear that integration over one or two dimensions, as suggested by our proposed integral representation, is significantly easier than the alternative of integrating over n dimensions, as needed in the direct calculation of the desired moment.


Generating Natural Questions from Images for Multimodal Assistants. Generating natural, diverse, and meaningful questions from images is an essential task for multimodal assistants as it confirms whether they have understood the object and scene in the images properly. The research in visual question answering (VQA) and visual question generation (VQG) is a great step. However, this research does not capture questions that a visually abled person would ask multimodal assistants. Recently published datasets such as KB VQA, FVQA, and OK VQA try to collect questions that look for external knowledge which makes them appropriate for multimodal assistants. However, they still contain many obvious and common sense questions that humans would not usually ask a digital assistant. In this paper, we provide a new benchmark dataset that contains questions generated by human annotators keeping in mind what they would ask multimodal digital assistants. Large scale annotations for several hundred thousand images are expensive and time consuming, so we also present an effective way of automatically generating questions from unseen images. In this paper, we present an approach for generating diverse and meaningful questions that consider image content and metadata of image (e.g., location, associated keyword). We evaluate our approach using standard evaluation metrics such as BLEU, METEOR, ROUGE, and CIDEr to show the relevance of generated questions with human provided questions. We also measure the diversity of generated questions using generative strength and inventiveness metrics. We report new state of the art results on the public and our datasets.


Descent Data and Absolute Kan Extensions. The fundamental construction underlying descent theory, the lax descent category, comes with a functor that forgets the descent data. We prove that, in any 2 category mathfrak A with lax descent objects, the forgetful morphisms create all Kan extensions that are preserved by certain morphisms. As a consequence, in the case mathfrak A mathsf Cat , we get a monadicity theorem which says that a right adjoint functor is monadic if and only if it is, up to the composition with an equivalence, (naturally isomorphic to) a functor that forgets descent data. In particular, within the classical context of descent theory, we show that, in a fibred category, the forgetful functor between the category of internal actions of a precategory a and the category of internal actions of the underlying discrete precategory is monadic if and only if it has a left adjoint. More particularly, this shows that one of the implications of the celebrated Benabou Roubaud theorem does not depend on the so called Beck Chevalley condition. Namely, we prove that, in indexed categories, whenever an effective descent morphism induces a right adjoint functor, the induced functor is monadic.


Self Enhanced Convolutional Network for Facial Video Hallucination. As a domain specific super resolution problem, facial image hallucination has enjoyed a series of breakthroughs thanks to the advances of deep convolutional neural networks. However, the direct migration of existing methods to video is still difficult to achieve good performance due to its lack of alignment and consistency modelling in temporal domain. Taking advantage of high inter frame dependency in videos, we propose a self enhanced convolutional network for facial video hallucination. It is implemented by making full usage of preceding super resolved frames and a temporal window of adjacent low resolution frames. Specifically, the algorithm first obtains the initial high resolution inference of each frame by taking into consideration a sequence of consecutive low resolution inputs through temporal consistency modelling. It further recurrently exploits the reconstructed results and intermediate features of a sequence of preceding frames to improve the initial super resolution of the current frame by modelling the coherence of structural facial features across frames. Quantitative and qualitative evaluations demonstrate the superiority of the proposed algorithm against state of the art methods. Moreover, our algorithm also achieves excellent performance in the task of general video super resolution in a single shot setting.


Correction to A dual iterative substructuring method with a small penalty parameter. In this corrigendum, we offer a correction to J. Korean. Math. Soc., 54 (2017), pp. 461 477 . We construct a counterexample for the strengthened Cauchy Schwarz inequality used in the original paper. In addition, we provide a new proof for Lemma 5 of the original paper, an estimate for the extremal eigenvalues of the standard unpreconditioned FETI DP dual operator.


Neural Models of the Psychosemantics of Most'. How are the meanings of linguistic expressions related to their use in concrete cognitive tasks? Visual identification tasks show human speakers can exhibit considerable variation in their understanding, representation and verification of certain quantifiers. This paper initiates an investigation into neural models of these psycho semantic tasks. We trained two types of network a convolutional neural network (CNN) model and a recurrent model of visual attention (RAM) on the "most" verification task from citet Pietroski2009 , manipulating the visual scene and novel notions of task duration. Our results qualitatively mirror certain features of human performance (such as sensitivity to the ratio of set sizes, indicating a reliance on approximate number) while differing in interesting ways (such as exhibiting a subtly different pattern for the effect of image type). We conclude by discussing the prospects for using neural models as cognitive models of this and other psychosemantic tasks.


Big Fish, Little Fish, Critical Infrastructure An Analysis of Phineas Fisher and the 'Hacktivist' Threat to Critical Infrastructure. The hacktivist threat actor is listed in many risk decision documents. Yet their tactics and techniques often remain a mystery. We create a MITRE ATT CK (ATT CK) model of a well known hacktivist who goes under the pseudonym of Phineas Fisher, and map that threat to critical infrastructure. The analysis is derived from hacker manifestos, journalist reporting, and official government documentation. This analysis fills a gap in current threat models, to better define what skills and methods a determined hacker might employ. This paper also identifies seven essential mitigations which can be deployed by critical infrastructure operations and asset owners, to prevent such intrusions by hacktivists. We are in the process of contributing this threat actor into the ATT CK knowledge base.


Accelerating Deep Unsupervised Domain Adaptation with Transfer Channel Pruning. Deep unsupervised domain adaptation (UDA) has recently received increasing attention from researchers. However, existing methods are computationally intensive due to the computation cost of Convolutional Neural Networks (CNN) adopted by most work. To date, there is no effective network compression method for accelerating these models. In this paper, we propose a unified Transfer Channel Pruning (TCP) approach for accelerating UDA models. TCP is capable of compressing the deep UDA model by pruning less important channels while simultaneously learning transferable features by reducing the cross domain distribution divergence. Therefore, it reduces the impact of negative transfer and maintains competitive performance on the target task. To the best of our knowledge, TCP is the first approach that aims at accelerating deep UDA models. TCP is validated on two benchmark datasets Office 31 and ImageCLEF DA with two common backbone networks VGG16 and ResNet50. Experimental results demonstrate that TCP achieves comparable or better classification accuracy than other comparison methods while significantly reducing the computational cost. To be more specific, in VGG16, we get even higher accuracy after pruning 26 floating point operations (FLOPs) in ResNet50, we also get higher accuracy on half of the tasks after pruning 12 FLOPs. We hope that TCP will open a new door for future research on accelerating transfer learning models.


On Linear Boundary Value Problems for Differential Systems in Sobolev spaces. We consider the Fredholm one dimensional boundary value problems in Sobolev spaces.We have obtained several important results about the indixes of functional operators, the criterion of their correct well posedness, the criterion of the continuous dependence of the solutions of these problems on the parameter, the degree of convergence of these solutions, and sufficient constructive conditions under which the solutions of the most general class of multipoint boundary value problems are continuous with respect to the parameter. Eeach of these boundary value problems corresponds to a certain rectangular numerical characteristic matrix with kernel and cokernel of the same dimension as the kernel and cokernel of the boundary value problem. The conditions for the sequence of characteristic matrices to converge are found.


A Globally Convergent Proximal Newton Type Method in Nonsmooth Convex Optimization. The paper proposes and justifies a new algorithm of the proximal Newton type to solve a broad class of nonsmooth composite convex optimization problems without strong convexity assumptions. Based on advanced notions and techniques of variational analysis, we establish implementable results on the global convergence of the proposed algorithm as well as its local convergence with superlinear and quadratic rates. For certain structured problems, the obtained local convergence conditions do not require the local Lipschitz continuity of the corresponding Hessian mappings that is a crucial assumption used in the literature to ensure a superlinear convergence of other algorithms of the proximal Newton type. The conducted numerical experiments of solving the l 1 regularized logistic regression model illustrate the possibility of applying the proposed algorithm to deal with practically important problems.


An SMT Based Approach for Verifying Binarized Neural Networks. Deep learning has emerged as an effective approach for creating modern software systems, with neural networks often surpassing hand crafted systems. Unfortunately, neural networks are known to suffer from various safety and security issues. Formal verification is a promising avenue for tackling this difficulty, by formally certifying that networks are correct. We propose an SMT based technique for verifying Binarized Neural Networks a popular kind of neural network, where some weights have been binarized in order to render the neural network more memory and energy efficient, and quicker to evaluate. One novelty of our technique is that it allows the verification of neural networks that include both binarized and non binarized components. Neural network verification is computationally very difficult, and so we propose here various optimizations, integrated into our SMT procedure as deduction steps, as well as an approach for parallelizing verification queries. We implement our technique as an extension to the Marabou framework, and use it to evaluate the approach on popular binarized neural network architectures.


A stochastic Prekopa Leindler inequality for log concave functions. The Brunn Minkowski and Pr ' e kopa Leindler inequalities admit a variety of proofs that are inspired by convexity. Nevertheless, the former holds for compact sets and the latter for integrable functions so it seems that convexity has no special signficance. On the other hand, it was recently shown that the Brunn Minkowski inequality, specialized to convex sets, follows from a local stochastic dominance for naturally associated random polytopes. We show that for the subclass of log concave functions and associated stochastic approximations, a similar stochastic dominance underlies the Pr ' e kopa Leindler inequality.


On stability of exactness properties under the pro completion. In this paper we formulate and prove a general theorem of stability of exactness properties under the pro completion, which unifies several such theorems in the literature and gives many more. The theorem depends on a formal approach to exactness properties proposed in this paper, which is based on the theory of sketches. Our stability theorem has applications in proving theorems that establish links between exactness properties, as well as in establishing embedding (representation) theorems for classes of categories defined by exactness properties.


Lower and upper bounds for some generalized arcs. Let mathbb F q be a field with q elements. In this note, we study some generalized arcs, that is, sets of mathbb F q points in the projective plane mathbb P 2( mathbb F q) such that no six of them are on a conic. First, we consider the geometric configurations of such generalized arcs for small values of q and then we give some upper and lower bounds for the cardinality of complete generalized arcs, i.e. generalized arcs which are not contained in a bigger one.


A practical algorithm for volume estimation based on billiard trajectories and simulated annealing. We tackle the problem of efficiently approximating the volume of convex polytopes, when these are given in three different representations H polytopes, which have been studied extensively, V polytopes, and zonotopes (Z polytopes). We design a novel practical Multiphase Monte Carlo algorithm that leverages random walks based on billiard trajectories, as well as new empirical convergence tests and a simulated annealing schedule of adaptive convex bodies. We present a detailed experimental evaluation of our algorithm using a rich dataset containing Birkhoff polytopes and polytopes from structural biology. Our open source implementation tackles problems that have been intractable so far, offering the first software to scale up in thousands of dimensions for H polytopes and in the hundreds for V and Z polytopes on moderate hardware. Last, we illustrate our software in evaluating Z polytope approximations.


Rectifiability of the reduced boundary for sets of finite perimeter over RCD (K,N) spaces. This note is devoted to the study of sets of finite perimeter over RCD (K,N) metric measure spaces. Its aim is to complete the picture about the generalization of De Giorgi's theorem within this framework. Starting from the results of 2 we obtain uniqueness of tangents and rectifiability for the reduced boundary of sets of finite perimeter. As an intermediate tool, of independent interest, we develop a Gauss Green integration by parts formula tailored to this setting. These results are new and non trivial even in the setting of Ricci limits.


Vanishing diffusion limits and long time behaviour of a class of forced active scalar equations. We investigate the properties of an abstract family of advection diffusion equations in the context of the fractional Laplacian. Two independent diffusion parameters enter the system, one via the constitutive law for the drift velocity and one as the prefactor of the fractional Laplacian. We obtain existence and convergence results in certain parameter regimes and limits. We study the long time behaviour of solutions to the general problem and prove the existence of a unique global attractor. We apply results to two particular active scalar equations arising in geophysical fluid dynamics, namely the surface quasigeostrophic equation and the magnetogeostrophic equation.


Inhomogeneities in chainable continua. We study a class of chainable continua which contains, among others, all inverse limit spaces generated by a single interval bonding map which is piecewise monotone and locally eventually onto. Such spaces are realized as attractors of non hyperbolic surface homeomorphisms. Using dynamical properties of the bonding map, we give conditions for existence of endpoints, characterize the set of local inhomogeneities, and determine when it consists only of endpoints. As a side product we also obtain a characterization of arcs as inverse limits for piecewise monotone bonding maps, which is interesting in its own right.


Topological spaces induced by homotopic distance. Homotopic distance D as introduced in cite MVML can be realized as a pseudometric on mathrm Map (X,Y) . In this paper, we study the topology induced by the pseudometric D . In particular, we consider the space mathrm Map (S 1,S 1) and show that homotopic distance between any two maps in this space is 1. Moreover, while a general proof of the non compactness of the space mathrm Map (X,Y) is still an open problem, it can be shown that mathrm Map (S 1,S 1) is not compact.


Recurrent Neural Networks for Stochastic Control in Real Time Bidding. Bidding in real time auctions can be a difficult stochastic control task especially if underdelivery incurs strong penalties and the market is very uncertain. Most current works and implementations focus on optimally delivering a campaign given a reasonable forecast of the market. Practical implementations have a feedback loop to adjust and be robust to forecasting errors, but no implementation, to the best of our knowledge, uses a model of market risk and actively anticipates market shifts. Solving such stochastic control problems in practice is actually very challenging. This paper proposes an approximate solution based on a Recurrent Neural Network (RNN) architecture that is both effective and practical for implementation in a production environment. The RNN bidder provisions everything it needs to avoid missing its goal. It also deliberately falls short of its goal when buying the missing impressions would cost more than the penalty for not reaching it.


Arbitrary Lagrangian Eulerian hybridizable discontinuous Galerkin methods for incompressible flow with moving boundaries and interfaces. We present a class of Arbitrary Lagrangian Eulerian hybridizable discontinuous Galerkin methods for the incompressible flow with moving boundaries and interfaces including two phase flow with surface tension.


physics.soc-ph physics.bio-ph physics.flu-dyn physics.pop-ph

Airflows inside passenger cars and implications for airborne disease transmission. Transmission of highly infectious respiratory diseases, including SARS CoV 2 are facilitated by the transport of tiny droplets and aerosols (harboring viruses, bacteria, etc.) that are breathed out by individuals and can remain suspended in air for extended periods of time in confined environments. A passenger car cabin represents one such situation in which there exists an elevated risk of pathogen transmission. Here we present results from numerical simulations of the potential routes of airborne transmission within a model car geometry, for a variety of ventilation configurations representing different combinations of open and closed windows. We estimate relative concentrations and residence times of a non interacting, passive scalar a proxy for infectious pathogenic particles that are advected and diffused by the turbulent airflows inside the cabin. Our findings reveal that creating an airflow pattern that travels across the cabin, entering and existing farthest from the occupants can potentially reduce the transmission.


On collisional free free photon absorption in warm dense matter. The rate of photon absorption in warm dense matter (WDM) induced by free free electron ion collisions is derived from Sommerfeld's cross section for non relativistic bremsstrahlung emission, making use of detailed balance relations. Warm dense matter is treated as a metal like state in the approximation of a uniform degenerate electron gas and a uniform ion background. Total absorption rates are averaged over the electron Fermi distribution. A closed expression is obtained for the absorption rate, depending on temperature, density, and photon energy, that scales with ion charge Z. It is evaluated numerically for the full parameter space, which requires different representations of the hypergeometric functions involved. The results are valid for photon frequencies larger than the plasma frequency of the medium. They are compared with approximate formulas in various asymptotic regions.


Sensitivity Factors based Transmission Network Topology Control for Violation Relief. Transmission networks consist of thousands of branches for large scale real power systems. They are built with a high degree of redundancy for reliability concern. Thus, it is very likely that there exist various network topologies that can deliver continuous power supply to consumers. The optimal transmission network topology could be very different for different system conditions. Transmission network topology control (TNTC) can provide the operator with an additional option to manage network congestion, reduce losses, relieve violation, and achieve cost saving. This paper examines the benefits of TNTC in reducing post contingency overloads that are identified by real time contingency analysis (RTCA). The procedure of RTCA with TNTC is presented and two algorithms are proposed to determine the candidate switching solutions. Both algorithms use available system data sensitivity factors or shifting factors. The proposed two TNTC approaches are based on the transmission switching distribution factor (TSDF) and flow transfer distribution factor (FTDF) respectively. FTDF based TNTC approach is an enhanced version of TSDF based TNTC approach by considering network flow distribution. Numerical simulations demonstrate that both methods can effectively relieve flow violations and FTDF outperforms TSDF.


Asymptotic convergence for modified scalar curvature flow. In this paper, we study the flow of closed, starshaped hypersurfaces in mathbb R n 1 with speed r alpha sigma 2 1 2 , where sigma 2 1 2 is the normalized square root of the scalar curvature, alpha geq 2, and r is the distance from points on the hypersurface to the origin. We prove that the flow exists for all time and the starshapedness is preserved. Moreover, after normalization, we show that the flow converges exponentially fast to a sphere centered at origin. When alpha 2, a counterexample is given for the above convergence.


Quadratic and cubic Newton maps of rational functions. The dynamics of all quadratic Newton maps of rational functions are completely described. The Julia set of such a map is found to be either a Jordan curve or totally disconnected. It is proved that no Newton map with degree at least three of any rational function is conformally conjugate to a unicritical polynomial(i.e., with exactly one finite critical point). However, there are cubic Newton maps which are conformally conjugate to other polynomials. The Julia set of such a Newton map is shown to be a closed curve. It is a Jordan curve whenever the Newton map has two attracting fixed points.


On the Existence of Closed Biconservative Surfaces in Space Forms. Biconservative surfaces of Riemannian 3 space forms N 3( rho) , are either constant mean curvature (CMC) surfaces or rotational linear Weingarten surfaces verifying the relation 3 kappa 1 kappa 2 0 between their principal curvatures kappa 1 and kappa 2 . We characterise the profile curves of the non CMC biconservative surfaces as the critical curves for a suitable curvature energy. Moreover, using this characterisation, we prove the existence of a discrete biparametric family of closed, i.e. compact without boundary, non CMC biconservative surfaces in the round 3 sphere, S 3( rho) . However, none of these closed surfaces is embedded in S 3( rho) .


Directed branch width A directed analogue of tree width. We introduce a new digraph width measure called directed branch width. To do this, we generalize a characterization of graph classes of bounded tree width in terms of their line graphs to digraphs. Under parameterizations by directed branch width we obtain linear time algorithms for many problems, such as directed Hamilton path and Max Cut, which are hard when parameterized by other known directed width measures. More generally, we obtain an algorithmic meta theorem for the model checking problem for a restricted variant of MSO 2 logic on classes of bounded directed branch width.


GPA A GPU Performance Advisor Based on Instruction Sampling. Developing efficient GPU kernels can be difficult because of the complexity of GPU architectures and programming models. Existing performance tools only provide coarse grained suggestions at the kernel level, if any. In this paper, we describe GPA, a performance advisor for NVIDIA GPUs that suggests potential code optimization opportunities at a hierarchy of levels, including individual lines, loops, and functions. To relieve users of the burden of interpreting performance counters and analyzing bottlenecks, GPA uses data flow analysis to approximately attribute measured instruction stalls to their root causes and uses information about a program's structure and the GPU to match inefficiency patterns with suggestions for optimization. To quantify each suggestion's potential benefits, we developed PC sampling based performance models to estimate its speedup. Our experiments with benchmarks and applications show that GPA provides an insightful report to guide performance optimization. Using GPA, we obtained speedups on a Volta V100 GPU ranging from 1.01 times to 3.53 times , with a geometric mean of 1.22 times .


A hyperbolic elliptic parabolic PDE model describing chemotactic E. coli colonies. We study a modified version of an initial boundary value problem describing the formation of colony patterns of bacteria textit Escherichia Coli . The original system of three parabolic equations was studied numerically and analytically and gave insights into the underlying mechanisms of chemotaxis. We focus here on the parabolic elliptic parabolic approximation and the hyperbolic elliptic parabolic limiting system which describes the case of pure chemotactic movement without random diffusion. We first construct local in time solutions for the parabolic elliptic parabolic system. Then we prove uniform textit a priori estimates and we use them along with a compactness argument in order to construct local in time solutions for the hyperbolic elliptic parabolic limiting system. Finally, we prove that some initial conditions give rise to solutions which blow up in finite time in the L infty norm in all space dimensions. This last result violet is true even in space dimension 1, which is not the case for the full parabolic or parabolic elliptic Keller Segel systems.


Extreme learning machine based model for Solubility estimation of hydrocarbon gases in electrolyte solutions. Calculating hydrocarbon components solubility of natural gases is known as one of the important issues for operational works in petroleum and chemical engineering. In this work, a novel solubility estimation tool has been proposed for hydrocarbon gases including methane, ethane, propane, and butane in aqueous electrolyte solutions based on extreme learning machine (ELM) algorithm. Comparing the ELM outputs with a comprehensive real databank which has 1175 solubility points concluded to R squared values of 0.985 and 0.987 for training and testing phases respectively. Furthermore, the visual comparison of estimated and actual hydrocarbon solubility led to confirm the ability of the proposed solubility model. Additionally, sensitivity analysis has been employed on the input variables of the model to identify their impacts on hydrocarbon solubility. Such a comprehensive and reliable study can help engineers and scientists to successfully determine the important thermodynamic properties which are key factors in optimizing and designing different industrial units such as refineries and petrochemical plants.


Decoding CNN based Object Classifier Using Visualization. This paper investigates how working of Convolutional Neural Network (CNN) can be explained through visualization in the context of machine perception of autonomous vehicles. We visualize what type of features are extracted in different convolution layers of CNN that helps to understand how CNN gradually increases spatial information in every layer. Thus, it concentrates on region of interests in every transformation. Visualizing heat map of activation helps us to understand how CNN classifies and localizes different objects in image. This study also helps us to reason behind low accuracy of a model helps to increase trust on object detection module.


RIMAX Ranking Semantic Rhymes by calculating Definition Similarity. This paper presents RIMAX, a new system for detecting semantic rhymes, using a Comprehensive Mexican Spanish Dictionary (DEM) and its Rhyming Dictionary (REM). We use the Vector Space Model to calculate the similarity of the definition of a query with the definitions corresponding to the assonant and consonant rhymes of the query. The preliminary results using a manual evaluation are very encouraging.


Patch wise Attack for Fooling Deep Neural Network. By adding human imperceptible noise to clean images, the resultant adversarial examples can fool other unknown models. Features of a pixel extracted by deep neural networks (DNNs) are influenced by its surrounding regions, and different DNNs generally focus on different discriminative regions in recognition. Motivated by this, we propose a patch wise iterative algorithm a black box attack towards mainstream normally trained and defense models, which differs from the existing attack methods manipulating pixel wise noise. In this way, without sacrificing the performance of white box attack, our adversarial examples can have strong transferability. Specifically, we introduce an amplification factor to the step size in each iteration, and one pixel's overall gradient overflowing the epsilon constraint is properly assigned to its surrounding regions by a project kernel. Our method can be generally integrated to any gradient based attack methods. Compared with the current state of the art attacks, we significantly improve the success rate by 9.2 for defense models and 3.7 for normally trained models on average. Our code is available at url https github.com qilong zhang Patch wise iterative attack


On Free Polyadic Groups. In this article, for a polyadic group(G,f),derived from group G by automorphism G and element b, we give a necessary and sufficient condition in terms of the group, the automorphism G, and the element b, in order that the polyadic group becomes free.


OUTBREAK A user friendly georeferencing online tool for disease surveillance. The current COVID 19 pandemic has already claimed more than 100,000 victims and it will cause more deaths in the coming months. Tools that can track the number and locations of cases are critical for surveillance and can help in making policy decisions for controlling the outbreak. The current surveillance web based dashboards run on proprietary platforms, which are often expensive and require specific computational knowledge. We present a new tool (OUTBREAK) for studying and visualizing epidemiological data. It permits even non specialist users to input data most conveniently and track outbreaks in real time. This tool has the potential to guide and help health authorities to intervene and minimize the effects of the outbreaks. It is freely available at http outbreak.sysbio.tools .


Solving Optical Tomography with Deep Learning. This paper presents a neural network approach for solving two dimensional optical tomography (OT) problems based on the radiative transfer equation. The mathematical problem of OT is to recover the optical properties of an object based on the albedo operator that is accessible from boundary measurements. Both the forward map from the optical properties to the albedo operator and the inverse map are high dimensional and nonlinear. For the circular tomography geometry, a perturbative analysis shows that the forward map can be approximated by a vectorized convolution operator in the angular direction. Motivated by this, we propose effective neural network architectures for the forward and inverse maps based on convolution layers, with weights learned from training datasets. Numerical results demonstrate the efficiency of the proposed neural networks.


Representation of n abelian categories in abelian categories. Let mathcal M be a small n abelian category. We show that the category of absolutely pure group valued functors over mathcal M , denote by mathcal L 2( mathcal M , mathcal G ) , is an abelian category and mathcal M is equivalent to a full subcategory of mathcal L 2( mathcal M , mathcal G ) in such a way that n kernels and n cokernels are precisely exact sequences of mathcal L 2( mathcal M , mathcal G ) with terms in mathcal M . This gives a higher dimensional version of the Freyd Mitchell embedding theorem for n abelian categories.


V2CNet A Deep Learning Framework to Translate Videos to Commands for Robotic Manipulation. We propose V2CNet, a new deep learning framework to automatically translate the demonstration videos to commands that can be directly used in robotic applications. Our V2CNet has two branches and aims at understanding the demonstration video in a fine grained manner. The first branch has the encoder decoder architecture to encode the visual features and sequentially generate the output words as a command, while the second branch uses a Temporal Convolutional Network (TCN) to learn the fine grained actions. By jointly training both branches, the network is able to model the sequential information of the command, while effectively encodes the fine grained actions. The experimental results on our new large scale dataset show that V2CNet outperforms recent state of the art methods by a substantial margin, while its output can be applied in real robotic applications. The source code and trained models will be made available.


Groups Acting on Trees With Prescribed Local Action. We extend Burger Mozes theory of closed, non discrete, locally quasiprimitive automorphism groups of locally finite, connected graphs to the semiprimitive case, and develop a generalization of Burger Mozes universal groups acting on the regular tree T d of degree d in mathbb N ge 3 . Three applications are given First, we characterize the automorphism types which the quasi center of a non discrete subgroup of mathrm Aut (T d ) may feature in terms of the group's local action. In doing so, we explicitly construct closed, non discrete, compactly generated subgroups of mathrm Aut (T d ) with non trivial quasi center, and see that Burger Mozes theory does not extend further to the transitive case. We then characterize the (P k ) closures of locally transitive subgroups of mathrm Aut (T d ) containing an involutive inversion, and thereby partially answer two questions by Banks Elder Willis. Finally, we offer a new view on the Weiss conjecture.


k means few more steps yield constant approximation. The k means algorithm of Arthur and Vassilvitskii (SODA 2007) is a state of the art algorithm for solving the k means clustering problem and is known to give an O(log k) approximation in expectation. Recently, Lattanzi and Sohler (ICML 2019) proposed augmenting k means with O(k log log k) local search steps to yield a constant approximation (in expectation) to the k means clustering problem. In this paper, we improve their analysis to show that, for any arbitrarily small constant eps 0 , with only eps k additional local search steps, one can achieve a constant approximation guarantee (with high probability in k), resolving an open problem in their paper.


On the geometry of nearly orthogonal lattices. Nearly orthogonal lattices were formally defined in 4 , where their applications to image compression were also discussed. The idea of near orthogonality" in 2 dimensions goes back to the work of Gauss. In this paper, we focus on well rounded nearly orthogonal lattices in mathbb R n and investigate their geometric and optimization properties. Specifically, we prove that the sphere packing density function on the space of well rounded lattices in dimension n geq 3 does not have any local maxima on the nearly orthogonal set and has only one local minimum there at the integer lattice mathbb Z n . Further, we show that the nearly orthogonal set cannot contain any perfect lattices for n geq 3 , although it contains multiple eutactic (and even strongly eutactic) lattices in every dimension. This implies that eutactic lattices, while always critical points of the packing density function, are not necessarily local maxima or minima even among the well rounded lattices. We also prove that a (weakly) nearly orthogonal lattice in mathbb R n contains no more than 4n 2 minimal vectors (with any smaller even number possible) and establish some bounds on coherence of these lattices.


Frieze patterns with coefficients. Frieze patterns, as introduced by Coxeter in the 1970's, are closely related to cluster algebras without coefficients. A suitable generalization of frieze patterns, linked to cluster algebras with coefficients, has only briefly appeared in an unpublished manuscript by Propp. In this paper we study these frieze patterns with coefficients systematically and prove various fundamental results, generalizing classic results for frieze patterns. As a consequence we see how frieze patterns with coefficients can be obtained from classic frieze patterns by cutting out subpolygons from the triangulated polygons associated to classic Conway Coxeter frieze patterns. We address the question of which frieze patterns with coefficients can be obtained in this way and solve this problem completely for triangles. Finally, we prove a finiteness result for frieze patterns with coefficients by showing that for a given boundary sequence there are only finitely many (non zero) frieze patterns with coefficients with entries in a discrete subset of the complex numbers.


Using BibTeX to Automatically Generate Labeled Data for Citation Field Extraction. Accurate parsing of citation reference strings is crucial to automatically construct scholarly databases such as Google Scholar or Semantic Scholar. Citation field extraction (CFE) is precisely this task given a reference label which tokens refer to the authors, venue, title, editor, journal, pages, etc. Most methods for CFE are supervised and rely on training from labeled datasets that are quite small compared to the great variety of reference formats. BibTeX, the widely used reference management tool, provides a natural method to automatically generate and label training data for CFE. In this paper, we describe a technique for using BibTeX to generate, automatically, a large scale 41M labeled strings), labeled dataset, that is four orders of magnitude larger than the current largest CFE dataset, namely the UMass Citation Field Extraction dataset Anzaroot and McCallum, 2013 . We experimentally demonstrate how our dataset can be used to improve the performance of the UMass CFE using a RoBERTa based Liu et al., 2019 model. In comparison to previous SoTA, we achieve a 24.48 relative error reduction, achieving span level F1 scores of 96.3 .


The Multiplicative Jordan Decomposition in the Integral Group Ring mathbb Z Q 8 times C p . Let p be a prime such that the multiplicative order m of 2 modulo p is even. We prove that the integral group ring mathbb Z Q 8 times C p has the multiplicative Jordan decomposition property when m is congruent to 2 modulo 4 . There are infinitely many such primes and these primes include the case p equiv 3 pmod 4 . We also prove that mathbb Z Q 8 times C 5 has the multiplicative Jordan decomposition property in a new way.


Optimizations to the Parallel Breath First Search on Distributed Memory. Graphs and their traversal is becoming significant as it is applicable to various areas of mathematics, science and technology. Various problems in fields as varied as biochemistry (genomics), electrical engineering (communication networks), computer science (algorithms and computation) can be modeled as Graph problems. Real world scenarios including communities their interconnections and related properties can be studied using graphs. So fast, scalable, low cost execution of parallel graph algorithms is very important. In this implementation of parallel breadth first search of graphs, we implemented Parallel BFS algorithm with 1 D partitioning of graph as described in 2 and have reduced execution time by optimizing communication for local buffers.


The role of continuity and expansiveness on leo and periodic specification properties. In this short note we prove that a continuous map which is locally eventually onto and is expansive satisfies the periodic specification property. We also discuss the role of continuity as a key condition in the previous characterization. We include several examples to illustrate the relation between these concepts.


Design research, eHealth, and the convergence revolution. The Quadruple Aim is a framework which prioritizes four aims, or dimensions of performance, for innovating in the healthcare domain, respectively 1) enhancing the individual experience of care 2) improving the work life of health care clinicians and staff 3) improving the health of populations and 4) reducing the per capita cost of care. In this contribution, recent literature providing examples of design research in the eHealth domain is reviewed to answer the research question in which measure has design research contributed to each of the four aims of eHealth innovation in the past five years?. The results of the review are presented and employed to draw three main observations 1) design researchers in eHealth seem to be largely focused on improving experiences of care, either patients' or health professionals 2) design researchers' contribution on reducing per capita costs of care appears to be less pronounced, which is outlined as a point for improvement and 3) in a considerable amount of reviewed contributions, design researchers appear to be contributing to multiple aims at once. In this sub group of reviewed contributions, several disciplinary areas and types of stakeholders interact and integrate through design research activities. The latter observation leads to a reflection on the strategic role of design research in the contexts of the convergence revolution and of the non communicable disease crisis. Implications of this reflection for design researchers are recognized in the opportunity and timeliness to develop eHealth specific ways to orchestrate design integration. A direction for further research in this sense is identified in the use of sensory and self monitored data as a boundary object for eHealth innovation. The prospective value of this direction is finally exemplified through the case of blood pressure.


Some results on almost L weakly and almost M weakly compact operators. In this paper, we present some necessary and sufficient conditions for semi compact operators being almost L weakly compact (resp. almost M weakly compact) and the converse. Mainly, we prove that if X is a nonzero Banach space, then every semi compact operator T X rightarrow E is almost L weakly compact if and only if the norm of E is order continuous. And every positive semi compact operator T E rightarrow F is almost M weakly compact if and only if the norm of E' is order continuous. Moreover, we investigate the relationships between almost L weakly compact operators and Dunford Pettis (resp. almost Dunford Pettis) operators.


An adaptive sparse grid local discontinuous Galerkin method for Hamilton Jacobi equations in high dimensions. We are interested in numerically solving the Hamilton Jacobi (HJ) equations, which arise in optimal control and many other applications. Oftentimes, such equations are posed in high dimensions, and this poses great numerical challenges. This work proposes a class of adaptive sparse grid (also called adaptive multiresolution) local discontinuous Galerkin (DG) methods for solving Hamilton Jacobi equations in high dimensions. By using the sparse grid techniques, we can treat moderately high dimensional cases. Adaptivity is incorporated to capture kinks and other local structures of the solutions. Two classes of multiwavelets are used to achieve multiresolution, which are the orthonormal Alpert's multiwavelets and the interpolatory multiwavelets. Numerical tests in up to four dimensions are provided to validate the performance of the method.


Generative Low bitwidth Data Free Quantization. Neural network quantization is an effective way to compress deep models and improve their execution latency and energy efficiency, so that they can be deployed on mobile or embedded devices. Existing quantization methods require original data for calibration or fine tuning to get better performance. However, in many real world scenarios, the data may not be available due to confidential or private issues, thereby making existing quantization methods not applicable. Moreover, due to the absence of original data, the recently developed generative adversarial networks (GANs) cannot be applied to generate data. Although the full precision model may contain rich data information, such information alone is hard to exploit for recovering the original data or generating new meaningful data. In this paper, we investigate a simple yet effective method called Generative Low bitwidth Data Free Quantization (GDFQ) to remove the data dependence burden. Specifically, we propose a knowledge matching generator to produce meaningful fake data by exploiting classification boundary knowledge and distribution information in the pre trained model. With the help of generated data, we can quantize a model by learning knowledge from the pre trained model. Extensive experiments on three data sets demonstrate the effectiveness of our method. More critically, our method achieves much higher accuracy on 4 bit quantization than the existing data free quantization method. Code is available at https github.com xushoukai GDFQ.


Trained Quantization Thresholds for Accurate and Efficient Fixed Point Inference of Deep Neural Networks. We propose a method of training quantization thresholds (TQT) for uniform symmetric quantizers using standard backpropagation and gradient descent. Contrary to prior work, we show that a careful analysis of the straight through estimator for threshold gradients allows for a natural range precision trade off leading to better optima. Our quantizers are constrained to use power of 2 scale factors and per tensor scaling of weights and activations to make it amenable for hardware implementations. We present analytical support for the general robustness of our methods and empirically validate them on various CNNs for ImageNet classification. We are able to achieve near floating point accuracy on traditionally difficult networks such as MobileNets with less than 5 epochs of quantized (8 bit) retraining. Finally, we present Graffitist, a framework that enables automatic quantization of TensorFlow graphs for TQT (available at https github.com Xilinx graffitist ).


High efficiency water window x ray generation from nanowire array targets irradiated with femtosecond laser pulses. We demonstrate the high efficiency generation of water window soft x ray emissions from polyethylene nanowire array targets irradiated by femtosecond laser pulses at the intensity of 4 10 19 W cm 2. The experimental results indicate more than one order of magnitude enhancement of the water window x ray emissions from the nanowire array targets compared to the planar targets. The highest energy conversion efficiency from laser to water window x rays is measured as 0.5 sr, which comes from the targets with the longest nanowires. Supported by particle in cell simulations and atomic kinetic codes, the physics that leads to the high conversion efficiency is discussed.


Emotion and Sentiment Lexicon Impact on Sentiment Analysis Applied to Book Reviews. Consumers are used to consulting posted reviews on the Internet before buying a product. But it's difficult to know the global opinion considering the important number of those reviews. Sentiment analysis afford detecting polarity (positive, negative, neutral) in a expressed opinion and therefore classifying those reviews. Our purpose is to determine the influence of emotions on the polarity of books reviews. We define "bag of words" representation models of reviews which use a lexicon containing emotional (anticipation, sadness, fear, anger, joy, surprise, trust, disgust) and sentimental (positive, negative) words. This lexicon afford measuring felt emotions types by readers. The implemented supervised learning used is a Random Forest type. The application concerns Amazon platform's reviews. Mots cl 'e s Analyse de sentiments, Analyse d' 'e motions (texte), Classification de polarit 'e de sentiments


Derivations of group rings. Let R G be the group ring of a group G over an associative ring R with unity such that all prime divisors of orders of elements of G are invertible in R. If R is finite and G is a Chernikov (torsion FC ) group, then each R derivation of R G is inner. Similar results also are obtained for other classes of groups G and rings R.


Zeros of mathrm GL 2 L functions on the critical line. We use Levinson's method and the work of Blomer and Harcos on the mathrm GL 2 shifted convolution problem to prove that at least 6.96 of the zeros of the L function of any holomorphic or Maass cusp form lie on the critical line.


PI Net A Deep Learning Approach to Extract Topological Persistence Images. Topological features such as persistence diagrams and their functional approximations like persistence images (PIs) have been showing substantial promise for machine learning and computer vision applications. This is greatly attributed to the robustness topological representations provide against different types of physical nuisance variables seen in real world data, such as view point, illumination, and more. However, key bottlenecks to their large scale adoption are computational expenditure and difficulty incorporating them in a differentiable architecture. We take an important step in this paper to mitigate these bottlenecks by proposing a novel one step approach to generate PIs directly from the input data. We design two separate convolutional neural network architectures, one designed to take in multi variate time series signals as input and another that accepts multi channel images as input. We call these networks Signal PI Net and Image PI Net respectively. To the best of our knowledge, we are the first to propose the use of deep learning for computing topological features directly from data. We explore the use of the proposed PI Net architectures on two applications human activity recognition using tri axial accelerometer sensor data and image classification. We demonstrate the ease of fusion of PIs in supervised deep learning architectures and speed up of several orders of magnitude for extracting PIs from data. Our code is available at https github.com anirudhsom PI Net.


Dual representations for systemic risk measures based on acceptance sets. We establish dual representations for systemic risk measures based on acceptance sets in a general setting. We deal with systemic risk measures of both "first allocate, then aggregate" and "first aggregate, then allocate" type. In both cases, we provide a detailed analysis of the corresponding systemic acceptance sets and their support functions. The same approach delivers a simple and self contained proof of the dual representation of utility based risk measures for univariate positions.


A complete characterization of (f 0, f 1) pairs of 6 polytopes. We completely characterize the first two entries, namely the (f 0, f 1) vector pairs, for 6 dimension polytopes. We also find the characterization for 7 dimension polytopes with excess degree greater than 11 and, we conjecture bounds fulfilled by (f 0, f 1) vector pairs for any d polytope having an excess degree greater than 3d 10 .


A Finite Memory Interacting P ' o lya Contagion Network and its Approximating Dynamical Systems. We introduce a new model for contagion spread using a network of interacting finite memory two color P ' o lya urns, which we refer to as the finite memory interacting P ' o lya contagion network. The urns interact in the sense that the probability of drawing a red ball (which represents an infection state) for a given urn, not only depends on the ratio of red balls in that urn but also on the ratio of red balls in the other urns in the network, hence accounting for the effect of spatial contagion. The resulting network wide contagion process is a discrete time finite memory ( M th order) Markov process, whose transition probability matrix is determined. The stochastic properties of the network contagion Markov process are analytically examined, and for homogeneous system parameters, we characterize the limiting state of infection in each urn. For the non homogeneous case, given the complexity of the stochastic process, and in the same spirit as the well studied SIS models, we use a mean field type approximation to obtain a discrete time dynamical system for the finite memory interacting P ' o lya contagion network. Interestingly, for M 1 , we obtain a linear dynamical system which exactly represents the corresponding Markov process. For M 1 , we use mean field approximation to obtain a nonlinear dynamical system. Furthermore, noting that the latter dynamical system admits a linear variant (realized by retaining its leading linear terms), we study the asymptotic behavior of the linear systems for both memory modes and characterize their equilibrium. Finally, we present simulation studies to assess the quality of the approximation purveyed by the linear and non linear dynamical systems.


On the boundary condition and related instability in the Smoothed Particle Hydrodynamics. In this work, we explore various relevant aspects of the Smoothed Particle Hydrodynamics regarding Burger's equation. The stability, precision, and efficiency of the algorithm are investigated in terms of different implementations. In particular, we argue that the boundary condition plays an essential role in the stability of numerical implementation. Besides, the issue is shown to be closely associated with the initial particle distribution and the interpolation scheme. Among others, we introduce an interpolation scheme termed symmetrized finite particle method. The main advantage of the scheme is that its implementation does not involve any derivative of the kernel function. Concerning the equation of motion, the calculations are carried out using two distinct scenarios where the particles are chosen to be either stationary or dynamically evolved. The obtained results are compared with those obtained by using the standard finite difference method for spatial derivatives. Our numerical results indicate subtle differences between different schemes regarding the choice of boundary condition. In particular, a novel type of instability is observed where the regular distribution is compromised as the particles start to traverse each other. Implications and further discussions of the present study are also addressed.


An algorithm to solve optimal stopping problems for one dimensional diffusions. Considering a real valued diffusion, a real valued reward function and a positive discount rate, we provide an algorithm to solve the optimal stopping problem consisting in finding the optimal expected discounted reward and the optimal stopping time at which it is attained. Our approach is based on Dynkin's characterization of the value function. The combination of Riesz's representation of alpha excessive functions and the inversion formula gives the density of the representing measure, being only necessary to determine its support. This last task is accomplished through an algorithm. The proposed method always arrives to the solution, thus no verification is needed, giving, in particular, the shape of the stopping region. Generalizations to diffusions with atoms in the speed measure and to non smooth payoffs are analyzed.


Brain Neurological Constructs The Neuronal Computational Schemes for Resolution of Life's Complexities. For complex life to evolve, a sophisticated nervous system for handling its complexities was fundamental. The demand resulted in the emergence of brain's computational facility, the neuronal network. This facet of the brain is attested solidly by its inspired scientific computational neural nets which (mathematically) resolve and solve many complex problems. The presumptive general semblance of the computational operation between the two systems allows for the inference that the process in brain's neural domain also renders complexities for solution, as sets of parametric equations, like the basic implicit algorithmic formalisms underlying the operations of the scientific neural nets. This parallel is based on the fact that such devices resolve complex problems for which no declarative logical formulation is deployed. The mathematically resolved neural net problem formalism also resembled that of any theoretically known and formulated complexities which are algorithmized, in their discretized solution domains, within the context of initial and boundary value problems for direct or iterative solution by computers. The brain neuronal net algorithmization of complexities delineate the governing equations of life and living, solutions of which are achieved by trial and error learning, deploying rest of the nervous system and other faculties of living beings. The computational operations of the brain delineate two mental states consciousness and the unconscious the aware and unaware states which describes the interactive living processes involved in charting life's path.


On the Boundary Harnack Principle in Holder domains. We investigate the Boundary Harnack Principle in H "older domains of exponent alpha 0 by the analytical method developed in our previous work "A short proof of Boundary Harnack Principle".


Towards Inconsistency Measurement in Business Rule Bases. We investigate the application of inconsistency measures to the problem of analysing business rule bases. Due to some intricacies of the domain of business rule bases, a straightforward application is not feasible. We therefore develop some new rationality postulates for this setting as well as adapt and modify existing inconsistency measures. We further adapt the notion of inconsistency values (or culpability measures) for this setting and give a comprehensive feasibility study.


Prime Ideals in Infinite Products of Commutative Rings. In this work we present descriptions of prime ideals and in particular of maximal ideals in products R prod D lambda of families (D lambda) lambda in Lambda of commutative rings. We show that every maximal ideal is induced by an ultrafilter on the Boolean algebra prod mathcal P ( max(D lambda)) . If every D lambda is in a certain class of rings including finite character domains and one dimensional domains, then this leads to a characterization of the maximal ideals of R . If every D lambda is a Pr "ufer domain, we depict all prime ideals of R . Moreover, we give an example of a (optionally non local or local) Pr "ufer domain such that every non zero prime ideal is of infinite height.


Statistical and Machine Learning based Decision Techniques for Physical Layer Authentication. In this paper we assess the security performance of key less physical layer authentication schemes in the case of time varying fading channels, considering both partial and no channel state information (CSI) on the receiver's side. We first present a generalization of a well known protocol previously proposed for flat fading channels and we study different statistical decision methods and the corresponding optimal attack strategies in order to improve the authentication performance in the considered scenario. We then consider the application of machine learning techniques in the same setting, exploiting different one class nearest neighbor (OCNN) classification algorithms. We observe that, under the same probability of false alarm, one class classification (OCC) algorithms achieve the lowest probability of missed detection when a low spatial correlation exists between the main channel and the adversary one, while statistical methods are advantageous when the spatial correlation between the two channels is higher.


The size of t cores and hook lengths of random cells in random partitions. Fix t geq 2 . We first give an asymptotic formula for certain sums of the number of t cores. We then use this result to compute the distribution of the size of the t core of a uniformly random partition of an integer n . We show that this converges weakly to a gamma distribution after dividing by sqrt n . As a consequence, we find that the size of the t core is of the order of sqrt n in expectation. We then apply this result to show that the probability that t divides the hook length of a uniformly random cell in a uniformly random partition equals 1 t in the limit. Finally, we extend this result to all modulo classes of t using abacus representations for cores and quotients.


Event triggered Online Proactive Network Association to Mobile Edge Computing for IoT. Ultra low latency communication for mobile machines emerges as a critical technology in Internet of Things (IoT). Proactive network association has been suggested to support ultra low latency communication with the assistance of mobile edge computing. To resolve system dynamics and uncertainty, in this paper, an online proactive network association is proposed to minimize average task delay while considering time average energy consumption constraints. Under distributed computing and networking environments, we formulate an event triggered proactive network association model by semi Markov task states and independent identically distributed (i.i.d.) random events. Then we facilitate the mobility aware anticipatory network association to predictively consider handover effects caused by the mobility. Based on the Markov decision processes (MDP) and Lyapunov optimization, the two stage online proactive network association (TOPNA) decision algorithm is proposed without the knowledge nor distribution of random events. Simulation results exhibit the effectiveness of the proposed algorithm.


Structure Tags Improve Text Classification for Scholarly Document Quality Prediction. Training recurrent neural networks on long texts, in particular scholarly documents, causes problems for learning. While hierarchical attention networks (HANs) are effective in solving these problems, they still lose important information about the structure of the text. To tackle these problems, we propose the use of HANs combined with structure tags which mark the role of sentences in the document. Adding tags to sentences, marking them as corresponding to title, abstract or main body text, yields improvements over the state of the art for scholarly document quality prediction. The proposed system is applied to the task of accept reject prediction on the PeerRead dataset and compared against a recent BiLSTM based model and joint textual visual model as well as against plain HANs. Compared to plain HANs, accuracy increases on all three domains. On the computation and language domain our new model works best overall, and increases accuracy 4.7 over the best literature result. We also obtain improvements when introducing the tags for prediction of the number of citations for 88k scientific publications that we compiled from the Allen AI S2ORC dataset. For our HAN system with structure tags we reach 28.5 explained variance, an improvement of 1.8 over our reimplementation of the BiLSTM based model as well as 1.0 improvement over plain HANs.


HyperFaceNet A Hyperspectral Face Recognition Method Based on Deep Fusion. Face recognition has already been well studied under the visible light and the infrared,in both intra spectral and cross spectral cases. However, how to fuse different light bands, i.e., hyperspectral face recognition, is still an open research problem, which has the advantages of richer information retaining and all weather functionality over single band face recognition. Among the very few works for hyperspectral face recognition, traditional non deep learning techniques are largely used. Thus, we in this paper bring deep learning into the topic of hyperspectral face recognition, and propose a new fusion model (termed HyperFaceNet) especially for hyperspectral faces. The proposed fusion model is characterized by residual dense learning, a feedback style encoder and a recognition oriented loss function. During the experiments, our method is proved to be of higher recognition rates than face recognition using either visible light or the infrared. Moreover, our fusion model is shown to be superior to other general purposed image fusion methods including state of the arts, in terms of both image quality and recognition performance.