Exploring Micro Services for Enhancing Internet QoS. With the enhancements in the field of software defined networking and virtualization technologies, novel networking paradigms such as network function virtualization (NFV) and the Internet of things (IoT) are rapidly gaining ground. Development of IoT as well as 5G networks and explosion in online services has resulted in an exponential growth of devices connected to the network. As a result, application service providers (ASPs) and Internet service providers (ISPs) are being confronted with the unprecedented challenge of accommodating increasing service and traffic demands from the geographically distributed users. To tackle this problem, many ASPs and ISPs, such as Netflix, Facebook, AT T and others are increasingly adopting micro services (MS) application architecture. Despite the success of MS in the industry, there is no specific standard or research work for service providers as guidelines, especially from the perspective of basic micro service operations. In this work, we aim to bridge this gap between industry and academia and discuss different micro service deployment, discovery and communication options for service providers as a means to forming complete service chains. In addition, we address the problem of scheduling micro services across multiple clouds, including micro clouds. We consider different user level SLAs, such as latency and cost, while scheduling such services. We aim to reduce overall turnaround time as well as costs for the deployment of complete end to end service. In this work, we present a novel affinity based fair weighted scheduling heuristic to solve this problem. We also compare the results of proposed solution with standard greedy scheduling algorithms presented in the literature and observe significant improvements.


Curved Schemes for SDEs on Manifolds. Given a stochastic differential equation (SDE) in mathbb R n whose solution is constrained to lie in some manifold M subset mathbb R n , we propose a class of numerical schemes for the SDE whose iterates remain close to M to high order. Our schemes are geometrically invariant, and can be chosen to give perfect solutions for any SDE which is diffeomorphic to n dimensional Brownian motion. Unlike projection based methods, our schemes may be implemented without explicit knowledge of M. Our approach does not require simulating any iterated It o interals beyond those needed to implement the Euler Maryuama scheme. We prove that the schemes converge under a standard set of assumptions, and illustrate their practical advantages by considering a stochastic version of the Kepler problem.


INetCEP In Network Complex Event Processing for Information Centric Networking. Emerging network architectures like Information centric Networking (ICN) offer simplicity in the data plane by addressing named data. Such flexibility opens up the possibility to move data processing inside network elements for high performance computation, known as in network processing. However, existing ICN architectures are limited in terms of data plane programmability due to the lack of (i) in network processing and (ii) data plane programming abstractions. Such architectures can benefit from Complex Event Processing (CEP), an in network processing paradigm to efficiently process data inside the data plane. Yet, it is extremely challenging to integrate CEP because the current communication model of ICN is limited to consumer initiated interaction that comes with significant overhead in a number of requests to process continuous data streams. In contrast, a change to producer initiated interaction, as favored by CEP, imposes severe limitations for request reply interactions. In this paper, we propose an in network CEP architecture, INetCEP that supports unified interaction patterns (consumer and producer initiated). In addition, we provide a CEP query language and facilitate CEP operations while increasing the range of applications that can be supported by ICN. We provide an open source implementation and evaluation of INetCEP over an ICN architecture, Named Function Networking, and two applications energy forecasting in smart homes and a disaster scenario.


On the Evaluation of Generative Adversarial Networks By Discriminative Models. Generative Adversarial Networks (GANs) can accurately model complex multi dimensional data and generate realistic samples. However, due to their implicit estimation of data distributions, their evaluation is a challenging task. The majority of research efforts associated with tackling this issue were validated by qualitative visual evaluation. Such approaches do not generalize well beyond the image domain. Since many of those evaluation metrics are proposed and bound to the vision domain, they are difficult to apply to other domains. Quantitative measures are necessary to better guide the training and comparison of different GANs models. In this work, we leverage Siamese neural networks to propose a domain agnostic evaluation metric (1) with a qualitative evaluation that is consistent with human evaluation, (2) that is robust relative to common GAN issues such as mode dropping and invention, and (3) does not require any pretrained classifier. The empirical results in this paper demonstrate the superiority of this method compared to the popular Inception Score and are competitive with the FID score.


On spin structures and orientations for gauge theoretic moduli spaces. Let X be a compact manifold, G a Lie group, P to X a principal G bundle, and mathcal B P the infinite dimensional moduli space of connections on P modulo gauge. For a real elliptic operator E bullet we previously studied orientations on the real determinant line bundle over mathcal B P . These are used to construct orientations in the usual sense on smooth gauge theory moduli spaces, and have been extensively studied since the work of Donaldson. Here we consider complex elliptic operators F bullet and introduce the idea of spin structures, square roots of the complex determinant line bundle of F bullet . These may be used to construct spin structures in the usual sense on smooth complex gauge theory moduli spaces. We study the existence and classification of such spin structures. Our main result identifies spin structures on X with orientations on X times S 1 . Thus, if P to X and Q to X times S 1 are principal G bundles with Q X times 1 cong P , we relate spin structures on ( mathcal B P,F bullet) to orientations on ( mathcal B Q,E bullet) for a certain class of operators F bullet on X and E bullet on X times S 1 . Combined with arXiv 1811.02405, we obtain canonical spin structures for positive Diracians on spin 6 manifolds and gauge groups G U(m), SU(m) . In a sequel arXiv 2001.00113 we apply this to define canonical orientation data for all Calabi Yau 3 folds X over the complex numbers, as in Kontsevich Soibelman arXiv 0811.2435, solving a long standing problem in Donaldson Thomas theory.


Fine Grained Grounding for Multimodal Speech Recognition. Multimodal automatic speech recognition systems integrate information from images to improve speech recognition quality, by grounding the speech in the visual context. While visual signals have been shown to be useful for recovering entities that have been masked in the audio, these models should be capable of recovering a broader range of word types. Existing systems rely on global visual features that represent the entire image, but localizing the relevant regions of the image will make it possible to recover a larger set of words, such as adjectives and verbs. In this paper, we propose a model that uses finer grained visual information from different parts of the image, using automatic object proposals. In experiments on the Flickr8K Audio Captions Corpus, we find that our model improves over approaches that use global visual features, that the proposals enable the model to recover entities and other related words, such as adjectives, and that improvements are due to the model's ability to localize the correct proposals.


Benders Cut Classification via Support Vector Machines for Solving Two stage Stochastic Programs. We consider Benders decomposition for solving two stage stochastic programs with complete recourse based on finite samples of the uncertain parameters. We define the Benders cuts binding at the final optimal solution or the ones significantly improving bounds over iterations as valuable cuts. We propose a learning enhanced Benders decomposition (LearnBD) algorithm, which adds a cut classification step in each iteration to selectively generate cuts that are more likely to be valuable cuts. The LearnBD algorithm includes two phases (i) sampling cuts and collecting information from training problems and (ii) solving testing problems with a support vector machine (SVM) cut classifier. We run the LearnBD algorithm on instances of capacitated facility location and multi commodity network design under uncertain demand. Our results show that SVM cut classifier works effectively for identifying valuable cuts, and the LearnBD algorithm reduces the total solving time of all instances for different problems with various sizes and complexities.


Local Variables and Quantum Relational Hoare Logic. We add local variables to quantum relational Hoare logic (Unruh, POPL 2019). We derive reasoning rules for supporting local variables (including an improved "adversary rule"). We extended the qrhl tool for computer aided verification of qRHL to support local variables and our new reasoning rules.


Voting of predictive models for clinical outcomes consensus of algorithms for the early prediction of sepsis from clinical data and an analysis of the PhysioNet Computing in Cardiology Challenge 2019. Although there has been significant research in boosting of weak learners, there has been little work in the field of boosting from strong learners. This latter paradigm is a form of weighted voting with learned weights. In this work, we consider the problem of constructing an ensemble algorithm from 70 individual algorithms for the early prediction of sepsis from clinical data. We find that this ensemble algorithm outperforms separate algorithms, especially on a hidden test set on which most algorithms failed to generalize.


Shape CD Change Point Detection in Time Series Data with Shapes and Neurons. Change point detection in a time series aims to discover the time points at which some unknown underlying physical process that generates the time series data has changed. We found that existing approaches become less accurate when the underlying process is complex and generates large varieties of patterns in the time series. To address this shortcoming, we propose Shape CD, a simple, fast, and accurate change point detection method. Shape CD uses shape based features to model the patterns and a conditional neural field to model the temporal correlations among the time regions. We evaluated the performance of Shape CD using four highly dynamic time series datasets, including the ExtraSensory dataset with up to 2000 classes. Shape CD demonstrated improved accuracy (7 60 higher in AUC) and faster computational speed compared to existing approaches. Furthermore, the Shape CD model consists of only hundreds of parameters and require less data to train than other deep supervised learning models.


Predicting in vivo escape dynamics of HIV 1 from a broadly neutralizing antibody. Broadly neutralizing antibodies are promising candidates for treatment and prevention of HIV 1 infections. Such antibodies can temporarily suppress viral load in infected individuals however, the virus often rebounds by escape mutants that have evolved resistance. In this paper, we map an in vivo fitness landscape of HIV 1 interacting with broadly neutralizing antibodies, using data from a recent clinical trial. We identify two fitness factors, antibody dosage and viral load, that determine viral reproduction rates reproducibly across different hosts. The model successfully predicts the escape dynamics of HIV 1 in the course of an antibody treatment, including a characteristic frequency turnover between sensitive and resistant strains. This turnover is governed by a dosage dependent fitness ranking, resulting from an evolutionary tradeoff between antibody resistance and its collateral cost in drug free growth. Our analysis suggests resistance cost tradeoff curves as a measure of antibody performance in the presence of resistance evolution.


Vector bundles on Fano threefolds and K3 surfaces. Let X be a Fano threefold, and let S be a K3 surface in X . Any moduli space M of simple vector bundles on S carries a holomorphic symplectic structure. Following an idea of Tyurin, we show that in some cases, those vector bundles which come from X form a Lagrangian subvariety of M . We illustrate this with a number of concrete examples.


Continuous solutions to Monge Amp ere equations on Hermitian manifolds for measures dominated by capacity. We prove the existence of a continuous quasi plurisubharmonic solution to the Monge Amp ere equation on a compact Hermitian manifold for a very general measre on the right hand side. We admit measures dominated by capacity in a certain manner, in particular, moderate measures studied by Dinh Nguyen Sibony. As a consequence, we give a characterization of measures admitting H "older continuous quasi plurisubharmonic potential, inspired by the work of Dinh Nguyen.


Graph Convolutions over Constituent Trees for Syntax Aware Semantic Role Labeling. Semantic role labeling (SRL) is the task of identifying predicates and labeling argument spans with semantic roles. Even though most semantic role formalisms are built upon constituent syntax and only syntactic constituents can be labeled as arguments (e.g., FrameNet and PropBank), all the recent work on syntax aware SRL relies on dependency representations of syntax. In contrast, we show how graph convolutional networks (GCNs) can be used to encode constituent structures and inform an SRL system. Nodes in our SpanGCN correspond to constituents. The computation is done in 3 stages. First, initial node representations are produced by composing' word representations of the first and the last word in the constituent. Second, graph convolutions relying on the constituent tree are performed, yielding syntactically informed constituent representations. Finally, the constituent representations are decomposed' back into word representations which in turn are used as input to the SRL classifier. We evaluate SpanGCN against alternatives, including a model using GCNs over dependency trees, and show its effectiveness on standard CoNLL 2005, CoNLL 2012, and FrameNet benchmarks.


The conditional Gaussian multiplicative chaos structure underlying a critical continuum random polymer model on a diamond fractal. We discuss a Gaussian multiplicative chaos (GMC) structure underlying a family of random measures mathbf M r , indexed by r in mathbb R , on a space Gamma of directed pathways crossing a diamond fractal with Hausdorff dimension two. The laws of these random continuum path measures arise in a critical weak disorder limiting regime for discrete directed polymers on disordered hierarchical graphs. For the analogous subcritical continuum polymer model in which the diamond fractal has Hausdorff dimension less than two, the random path measures can be constructed as subcritical GMCs through couplings to a spatial Gaussian white noise. This construction fails in the critical dimension two where, formally, an infinite coupling strength to the environmental noise would be required to generate the disorder. We prove, however, that there is a conditional GMC interrelationship between the random measures ( mathbf M r) r in mathbb R such that the law of mathbf M r can be constructed as a subcritical GMC with random reference measure mathbf M R for any choice of R in ( infty, r) . A similar GMC structure plausibly would hold for a critical continuum (2 1) dimensional directed polymer model.


Falling Through the Cracks Modeling the Formation of Social Category Boundaries. Social categorizations divide people into "us" and "them," often along continuous attributes such as political ideology or skin color. This division results in both positive consequences, such as a sense of community, and negative ones, such as group conflict. Further, individuals in the middle of the spectrum can fall through the cracks of this categorization process and are seen as out group by individuals on either side of the spectrum, becoming inbetweeners. Here, we propose a quantitative, dynamical system model that studies the joint influence of cognitive and social processes. We model where two social groups draw the boundaries between "us" and "them" on a continuous attribute. Our model predicts that both groups tend to draw a more restrictive boundary than the middle of the spectrum. As a result, each group sees the individuals in the middle of the attribute space as an out group. We test this prediction using U.S. political survey data on how political independents are perceived by registered party members as well as existing experiments on the perception of racially ambiguous faces, and find support.


Powerfully solvable and powerfully simple groups. We introduce the notion of a powerfully solvable group. These are powerful groups possessing an abelian series of a special kind. These groups include in particular the class of powerfully nilpotent groups. We will also see that for a certain rich class of powerful groups we can naturally introduce the term powerfully simple group and prove a Jordan H "older type theorem that justifies the term.


A Survey of Knowledge Enhanced Text Generation. The goal of text generation is to make machines express in human language. It is one of the most important yet challenging tasks in natural language processing (NLP). Since 2014, various neural encoder decoder models pioneered by Seq2Seq have been proposed to achieve the goal by learning to map input text to output text. However, the input text alone often provides limited knowledge to generate the desired output, so the performance of text generation is still far from satisfaction in many real world scenarios. To address this issue, researchers have considered incorporating various forms of knowledge beyond the input text into the generation models. This research direction is known as knowledge enhanced text generation. In this survey, we present a comprehensive review of the research on knowledge enhanced text generation over the past five years. The main content includes two parts (i) general methods and architectures for integrating knowledge into text generation (ii) specific techniques and applications according to different forms of knowledge data. This survey can have broad audiences, researchers and practitioners, in academia and industry.


Compact almost automorphic solutions for semilinear parabolic evolution equations. In this paper, using the subvariant functional method due to Favard cite Favard , we prove the existence of aunique compact almost automorphic solution for a class of semilinear evolution equations in Banach spaces. More specifically, we improve the assumptions in cite CieuEzz , we show that the almost automorphy of the coefficients in a weaker sense (Stepanov almost automorphy of order 1 leq p infty ) is enough to obtain solutions that are almost automorphic in a strong sense (Bochner almost automorphy). We distinguish two cases, p 1 and p 1 . Moreover, we propose to study a class of reaction diffusion problems.


Energy efficiency of Massive Random Access with Individual Codebook. The massive machine type communication has been one of the most representative services for future wireless networks. It aims to support massive connectivity of user equipments (UEs) which sporadically transmit packets with small size. In this work, we assume the number of UEs grows linearly and unboundedly with blocklength and each UE has an individual codebook. Among all UEs, an unknown subset of UEs are active and transmit a fixed number of data bits to a base station over a shared spectrum radio link. Under these settings, we derive the achievability and converse bounds on the minimum energy per bit for reliable random access over quasi static fading channels with and without channel state information (CSI) at the receiver. These bounds provide energy efficiency guidance for new schemes suited for massive random access. Simulation results indicate that the orthogonalization scheme TDMA is energy inefficient for large values of UE density mu . Besides, the multi user interference can be perfectly cancelled when mu is below a critical threshold. In the case of no CSI, the energy per bit for random access is only a bit more than that with the knowledge UE activity.


In Vitro Electron Density Refinement from Solution X ray Scattering in the Wide Angle Regime. We present Frequency Marching, FM, an algorithm that refines three dimensional electron density distributions from solution X ray scattering data in both the small and wide angle regimes. This algorithm is based on a series of optimization steps, marching along the frequency (reciprocal) space and refining detailed periodic structures with the corresponding real space resolution. Buffer subtraction and excluded volumes, key factors in extracting the signatures of the biomolecule of interest from the sample, are accounted for using implicit density models. We provide the numerical and analytical basis of the FM algorithm. We demonstrate this technique by application to structured and unstructured nucleic acid systems, where higher resolution features are carved out of low resolution reconstructions as the algorithm marches into wider angles.


Aligning Visual Regions and Textual Concepts for Semantic Grounded Image Representations. In vision and language grounding problems, fine grained representations of the image are considered to be of paramount importance. Most of the current systems incorporate visual features and textual concepts as a sketch of an image. However, plainly inferred representations are usually undesirable in that they are composed of separate components, the relations of which are elusive. In this work, we aim at representing an image with a set of integrated visual regions and corresponding textual concepts, reflecting certain semantics. To this end, we build the Mutual Iterative Attention (MIA) module, which integrates correlated visual features and textual concepts, respectively, by aligning the two modalities. We evaluate the proposed approach on two representative vision and language grounding tasks, i.e., image captioning and visual question answering. In both tasks, the semantic grounded image representations consistently boost the performance of the baseline models under all metrics across the board. The results demonstrate that our approach is effective and generalizes well to a wide range of models for image related applications. (The code is available at https github.com fenglinliu98 MIA)


Entity Centric Contextual Affective Analysis. While contextualized word representations have improved state of the art benchmarks in many NLP tasks, their potential usefulness for social oriented tasks remains largely unexplored. We show how contextualized word embeddings can be used to capture affect dimensions in portrayals of people. We evaluate our methodology quantitatively, on held out affect lexicons, and qualitatively, through case examples. We find that contextualized word representations do encode meaningful affect information, but they are heavily biased towards their training data, which limits their usefulness to in domain analyses. We ultimately use our method to examine differences in portrayals of men and women.


Reversible Data Hiding in Encrypted Images based on Pixel Prediction and Bit plane Compression. Reversible data hiding in encrypted images (RDHEI) receives growing attention because it protects the content of the original image while the embedded data can be accurately extracted and the original image can be reconstructed lossless. To make full use of the correlation of the adjacent pixels, this paper proposes an RDHEI scheme based on pixel prediction and bit plane compression. Firstly, to vacate room for data embedding, the prediction error of the original image is calculated and used for bit plane rearrangement and compression. Then, the image after vacating room is encrypted by a stream cipher. Finally, the additional data is embedded in the vacated room by multi LSB substitution. Experimental results show that the embedding capacity of the proposed method outperforms the state of the art methods.


GSN A Graph Structured Network for Multi Party Dialogues. Existing neural models for dialogue response generation assume that utterances are sequentially organized. However, many real world dialogues involve multiple interlocutors (i.e., multi party dialogues), where the assumption does not hold as utterances from different interlocutors can occur "in parallel." This paper generalizes existing sequence based models to a Graph Structured neural Network (GSN) for dialogue modeling. The core of GSN is a graph based encoder that can model the information flow along the graph structured dialogues (two party sequential dialogues are a special case). Experimental results show that GSN significantly outperforms existing sequence based models.


Complex Sequential Understanding through the Awareness of Spatial and Temporal Concepts. Understanding sequential information is a fundamental task for artificial intelligence. Current neural networks attempt to learn spatial and temporal information as a whole, limited their abilities to represent large scale spatial representations over long range sequences. Here, we introduce a new modeling strategy called Semi Coupled Structure (SCS), which consists of deep neural networks that decouple the complex spatial and temporal concepts learning. Semi Coupled Structure can learn to implicitly separate input information into independent parts and process these parts respectively. Experiments demonstrate that a Semi Coupled Structure can successfully annotate the outline of an object in images sequentially and perform video action recognition. For sequence to sequence problems, a Semi Coupled Structure can predict future meteorological radar echo images based on observed images. Taken together, our results demonstrate that a Semi Coupled Structure has the capacity to improve the performance of LSTM like models on large scale sequential tasks.


Improving Proton Dose Calculation Accuracy by Using Deep Learning. Accurate dose calculation is vitally important for proton therapy. Pencil beam (PB) model based dose calculation is fast but inaccurate due to the approximation when dealing with inhomogeneities. Monte Carlo (MC) dose calculation is the most accurate method, but it is time consuming. We hypothesize that deep learning methods can boost the accuracy of PB dose calculation to the level of MC. In this work, we developed a deep learning model that converts PB to MC doses for different tumor sites. The proposed model is based on our newly developed hierarchically densely connected U Net (HD U Net) network, and it uses the PB dose and patient CT image as inputs to generate the MC dose. We used 290 patients (90 with head and neck, 93 with liver, 75 with prostate, and 32 with lung cancer) to train, validate, and test the model. For each tumor site, we performed four numerical experiments to explore various combinations of training datasets. Training the model on data from all tumor sites together and using the dose distribution of each individual beam as input yielded the best performance for all four tumor sites. The average gamma index (1mm 1 criteria) between the converted dose and the MC dose was 92.8 , 92.7 , 89.7 and 99.6 for head and neck, liver, lung, and prostate test patients, respectively. The average time for dose conversion for a single field was less than 4 seconds. In conclusion, our deep learning based approach can quickly boost the accuracy of proton PB dose distributions to that of MC dose distributions. The trained model can be readily adapted to new datasets for different tumor sites and from different hospitals through transfer learning. This model can be added as a plug in to the clinical workflow of proton therapy treatment planning to improve the accuracy of proton dose calculation.


Joint Diacritization, Lemmatization, Normalization, and Fine Grained Morphological Tagging. Semitic languages can be highly ambiguous, having several interpretations of the same surface forms, and morphologically rich, having many morphemes that realize several morphological features. This is further exacerbated for dialectal content, which is more prone to noise and lacks a standard orthography. The morphological features can be lexicalized, like lemmas and diacritized forms, or non lexicalized, like gender, number, and part of speech tags, among others. Joint modeling of the lexicalized and non lexicalized features can identify more intricate morphological patterns, which provide better context modeling, and further disambiguate ambiguous lexical choices. However, the different modeling granularity can make joint modeling more difficult. Our approach models the different features jointly, whether lexicalized (on the character level), where we also model surface form normalization, or non lexicalized (on the word level). We use Arabic as a test case, and achieve state of the art results for Modern Standard Arabic, with 20 relative error reduction, and Egyptian Arabic (a dialectal variant of Arabic), with 11 reduction.


Stability of Traveling wave solutions of Nonlinear Dispersive equations of NLS type. In this paper we present a rigorous modulational stability theory for periodic traveling wave solutions to equations of nonlinear Schr "odinger (NLS) type. We first argue that, for Hamiltonian dispersive equations with a non singular symplectic form and d conserved quantities (in addition to the Hamiltonian), one expects that generically mathcal L , the linearization around a periodic traveling wave, will have a 2d dimensional generalized kernel, with a particular Jordan structure The kernel of mathcal L is expected to be d dimensional, the first generalized kernel is expected to be d dimensional, and there are expected to be no higher generalized kernels. The breakup of this 2d dimensional kernel under perturbations arising from a change in boundary conditions dictates the modulational stability or instability of the underlying periodic traveling wave. This general picture is worked out in detail for the case of equations of NLS type. We give explicit genericity conditions that guarantee that the Jordan form is the generic one these take the form of non vanishing determinants of certain matrices whose entries can be expressed in terms of a finite number of moments of the traveling wave solution. Assuming that these genericity conditions are met we give a normal form for the small eigenvalues that result from the break up of the generalized kernel, in the form of the eigenvalues of a quadratic matrix pencil. We compare these results to direct numerical simulation in a number of cases of interest the cubic and quintic NLS equations, for focusing and defocusing nonlinearities, subject to both longitudinal and transverse perturbations. The longitudinal stability of traveling waves of the cubic NLS has been previously studied using the integrability in this case our results agree with those in the literature. All of the remaining cases appear to be new.


Personalized PageRank to a Target Node, Revisited. Personalized PageRank (PPR) is a widely used node proximity measure in graph mining and network analysis. Given a source node s and a target node t , the PPR value pi(s,t) represents the probability that a random walk from s terminates at t , and thus indicates the bidirectional importance between s and t . The majority of the existing work focuses on the single source queries, which asks for the PPR value of a given source node s and every node t in V . However, the single source query only reflects the importance of each node t with respect to s . In this paper, we consider the em single target PPR query , which measures the opposite direction of importance for PPR. Given a target node t , the single target PPR query asks for the PPR value of every node s in V to a given target node t . We propose RBS, a novel algorithm that answers approximate single target queries with optimal computational complexity. We show that RBS improves three concrete applications heavy hitters PPR query, single source SimRank computation, and scalable graph neural networks. We conduct experiments to demonstrate that RBS outperforms the state of the art algorithms in terms of both efficiency and precision on real world benchmark datasets.


Views on Quality Requirements in Academia and Practice Commonalities, Differences, and Context Dependent Grey Areas. Context Quality requirements (QRs) are a topic of constant discussions both in industry and academia. Debates entwine around the definition of quality requirements, the way how to handle them, or their importance for project success. While many academic endeavors contribute to the body of knowledge about QRs, practitioners may have different views. In fact, we still lack a consistent body of knowledge on QRs since much of the discussion around this topic is still dominated by observations that are strongly context dependent. This holds for both academic and practitioners' views. Our assumption is that, in consequence, those views may differ. Objective We report on a study to better understand the extent to which available research statements on quality requirements, as found in exemplary peer reviewed and frequently cited publications, are reflected in the perception of practitioners. Our goal is to analyze differences, commonalities, and context dependent grey areas in the views of academics and practitioners to allow a discussion on potential misconceptions (on either sides) and opportunities for future research. Method We conducted a survey with 109 practitioners to assess whether they agree with research statements about QRs reflected in the literature. Based on a statistical model, we evaluate the impact of a set of context factors to the perception of research statements. Results Our results show that a majority of the statements is well respected by practitioners however, not all of them. When examining the different groups and backgrounds of respondents, we noticed interesting deviations of perceptions within different groups that may lead to new research questions. Conclusions Our results help identifying prevalent context dependent differences about how academics and practitioners view QRs and pinpointing statements where further research might be useful.


On a curious variant of the S n module Lie n . We introduce a variant of the much studied Lie representation of the symmetric group S n , which we denote by Lie n (2) . Our variant gives rise to a decomposition of the regular representation as a sum of exterior powers of modules Lie n (2) . This is in contrast to the theorems of Poincar 'e Birkhoff Witt and Thrall which decompose the regular representation into a sum of symmetrised Lie modules. We show that nearly every known property of Lie n has a counterpart for the module Lie n (2) , suggesting connections to the cohomology of configuration spaces via the character formulas of Sundaram and Welker, to the Eulerian idempotents of Gerstenhaber and Schack, and to the Hodge decomposition of the complex of injective words arising from Hochschild homology, due to Hanlon and Hersh.


Pacific shallow lagoon high resolution temperature observations. The daily cycle of heating and cooling of the near surface ocean may be quite different in a shallow lagoon with a few meters deep seafloor that can be heated directly by the sun. If important, the solar radiation will affect the local benthic communities. To study the physical processes associated with the daily cycle of south Pacific lagoon Bora Bora, a vertical string of five high resolution temperature sensors was moored at a 2 m deep site for 3 weeks. Besides the standard ocean warming (approximately during daytime) and cooling (approximately nighttime), the sensors show relatively highest temperature near the lagoon floor during the warming phase and a weakly stable stratification towards the end of the cooling phase. During the warming phase, highly variable stratification is observed extending into the water column under calm weather and turbid waters, otherwise not. Under trade wind and clear waters, the lowest sensor(s) show(s) consistently higher temperature variability than sensors higher up with spectral slopes indicative of shear and or convective turbulence. During the cooling phase, the lower sensor shows consistently very low variance (non turbulent), while other sensors show a spectral slope around the buoyancy frequency evidencing weakly stratified waters supporting internal waves. These observations contrast with open ocean near surface observations of stable stratification during the warming phase and of turbulent free convection during the cooling phase. Thus, lagoons seem to more resemble the atmosphere than the ocean in daytime thermodynamics and possibly act as a natural solar pond with bottom conductive heating (when salinity compensates for unstable temperature variations).


A q queens problem. VII. Combinatorial types of nonattacking chess riders. On a convex polygonal chessboard, the number of combinatorial types of nonattacking configuration of three identical chess riders with r moves, such as queens, bishops, or nightriders, equals r(r 2 3r 1) 3 , as conjectured by Chaiken, Hanusa, and Zaslavsky (2019). Similarly, for any number of identical 3 move riders the number of combinatorial types is independent of the actual moves.


An Interaction Framework for Studying Co Creative AI. Machine learning has been applied to a number of creative, design oriented tasks. However, it remains unclear how to best empower human users with these machine learning approaches, particularly those users without technical expertise. In this paper we propose a general framework for turn based interaction between human users and AI agents designed to support human creativity, called co creative systems . The framework can be used to better understand the space of possible designs of co creative systems and reveal future research directions. We demonstrate how to apply this framework in conjunction with a pair of recent human subject studies, comparing between the four human AI systems employed in these studies and generating hypotheses towards future studies.


On an example concerning the second rigidity theorem. In this paper we revisit an example of Celikbas and Takahashi concerning the reflexivity of tensor products of modules. We study Tor rigidity and the Hochster Huneke graph with vertices consisting of minimal prime ideals, and determine a condition with which the aforementioned example cannot occur. Our result, in particular, corroborates the Second Rigidity Theorem of Huneke and Wiegand.


Learning Disentangled Latent Factors from Paired Data in Cross Modal Retrieval An Implicit Identifiable VAE Approach. We deal with the problem of learning the underlying disentangled latent factors that are shared between the paired bi modal data in cross modal retrieval. Our assumption is that the data in both modalities are complex, structured, and high dimensional (e.g., image and text), for which the conventional deep auto encoding latent variable models such as the Variational Autoencoder (VAE) often suffer from difficulty of accurate decoder training or realistic synthesis. A suboptimally trained decoder can potentially harm the model's capability of identifying the true factors. In this paper we propose a novel idea of the implicit decoder, which completely removes the ambient data decoding module from a latent variable model, via implicit encoder inversion that is achieved by Jacobian regularization of the low dimensional embedding function. Motivated from the recent Identifiable VAE (IVAE) model, we modify it to incorporate the query modality data as conditioning auxiliary input, which allows us to prove that the true parameters of the model can be identified under some regularity conditions. Tested on various datasets where the true factors are fully partially available, our model is shown to identify the factors accurately, significantly outperforming conventional encoder decoder latent variable models. We also test our model on the Recipe1M, the large scale food image recipe dataset, where the learned factors by our approach highly coincide with the most pronounced food factors that are widely agreed on, including savoriness, wateriness, and greenness.


Which convex polyhedra can be made by gluing regular hexagons?. Which convex 3D polyhedra can be obtained by gluing several regular hexagons edge to edge? It turns out that there are only 15 possible types of shapes, 5 of which are doubly covered 2D polygons. We give examples for most of them, including all simplicial and all flat shapes, and give a characterization for the latter ones. It is open whether the remaining can be realized.


Modeling Human Visual Search Performance on Realistic Webpages Using Analytical and Deep Learning Methods. Modeling visual search not only offers an opportunity to predict the usability of an interface before actually testing it on real users, but also advances scientific understanding about human behavior. In this work, we first conduct a set of analyses on a large scale dataset of visual search tasks on realistic webpages. We then present a deep neural network that learns to predict the scannability of webpage content, i.e., how easy it is for a user to find a specific target. Our model leverages both heuristic based features such as target size and unstructured features such as raw image pixels. This approach allows us to model complex interactions that might be involved in a realistic visual search task, which can not be easily achieved by traditional analytical models. We analyze the model behavior to offer our insights into how the salience map learned by the model aligns with human intuition and how the learned semantic representation of each target type relates to its visual search performance.


Rethinking Trajectory Evaluation for SLAM a Probabilistic, Continuous Time Approach. Despite the existence of different error metrics for trajectory evaluation in SLAM, their theoretical justifications and connections are rarely studied, and few methods handle temporal association properly. In this work, we propose to formulate the trajectory evaluation problem in a probabilistic, continuous time framework. By modeling the groundtruth as random variables, the concepts of absolute and relative error are generalized to be likelihood. Moreover, the groundtruth is represented as a piecewise Gaussian Process in continuous time. Within this framework, we are able to establish theoretical connections between relative and absolute error metrics and handle temporal association in a principled manner.


DIRV Dense Interaction Region Voting for End to End Human Object Interaction Detection. Recent years, human object interaction (HOI) detection has achieved impressive advances. However, conventional two stage methods are usually slow in inference. On the other hand, existing one stage methods mainly focus on the union regions of interactions, which introduce unnecessary visual information as disturbances to HOI detection. To tackle the problems above, we propose a novel one stage HOI detection approach DIRV in this paper, based on a new concept called interaction region for the HOI problem. Unlike previous methods, our approach concentrates on the densely sampled interaction regions across different scales for each human object pair, so as to capture the subtle visual features that is most essential to the interaction. Moreover, in order to compensate for the detection flaws of a single interaction region, we introduce a novel voting strategy that makes full use of those overlapped interaction regions in place of conventional Non Maximal Suppression (NMS). Extensive experiments on two popular benchmarks V COCO and HICO DET show that our approach outperforms existing state of the arts by a large margin with the highest inference speed and lightest network architecture. We achieved 56.1 mAP on V COCO without addtional input. Our code is publicly available at https github.com MVIG SJTU DIRV


One dimensional singular Cucker Smale model uniform in time mean field limit and contractivity. We analyze the one dimensional Cucker Smale (in short CS) model with a weak singular communication weight psi(x) x beta with beta in (0,1) . We first establish a global in time existence of measure valued solutions to the kinetic CS equation. For this, we use a proper change of variable to reformulate the particle CS model as a first order particle system and provide the uniform in time stability for that particle system. We then extend this stability estimate for the singular CS particle system. By using that stability estimate, we construct the measure valued solutions to the kinetic CS equation globally in time. Moreover, as a direct application of the uniform in time stability estimate, we show the quantitative uniform in time mean field limit from the particle system to that kinetic CS equation in p Wasserstein distance with p in 1, infty . Our result gives the uniqueness of measure valued solution in the sense of mean field limits, i.e., the measure valued solutions, approximated by the empirical measures associated to the particle system, uniquely exist. Similar results for the first order model also follow as a by product. We also reformulate the continuity type equation, which is derived from the first order model, as an integro differential equation by employing the pseudo inverse of the accumulative particle distribution. By making use of a modified p Wasserstein distance, we provide the contractivity estimate for absolutely continuous solutions of the continuum equation.


SEEK Segmented Embedding of Knowledge Graphs. In recent years, knowledge graph embedding becomes a pretty hot research topic of artificial intelligence and plays increasingly vital roles in various downstream applications, such as recommendation and question answering. However, existing methods for knowledge graph embedding can not make a proper trade off between the model complexity and the model expressiveness, which makes them still far from satisfactory. To mitigate this problem, we propose a lightweight modeling framework that can achieve highly competitive relational expressiveness without increasing the model complexity. Our framework focuses on the design of scoring functions and highlights two critical characteristics 1) facilitating sufficient feature interactions 2) preserving both symmetry and antisymmetry properties of relations. It is noteworthy that owing to the general and elegant design of scoring functions, our framework can incorporate many famous existing methods as special cases. Moreover, extensive experiments on public benchmarks demonstrate the efficiency and effectiveness of our framework. Source codes and data can be found at url https github.com Wentao Xu SEEK .


Real Time Sign Language Detection using Human Pose Estimation. We propose a lightweight real time sign language detection model, as we identify the need for such a case in videoconferencing. We extract optical flow features based on human pose estimation and, using a linear classifier, show these features are meaningful with an accuracy of 80 , evaluated on the DGS Corpus. Using a recurrent model directly on the input, we see improvements of up to 91 accuracy, while still working under 4ms. We describe a demo application to sign language detection in the browser in order to demonstrate its usage possibility in videoconferencing applications.


Authentication and Key Management Automation in Decentralized Secure Email and Messaging via Low Entropy Secrets. We revisit the problem of entity authentication in decentralized end to end encrypted email and secure messaging to propose a practical and self sustaining cryptographic solution based on password authenticated key exchange (PAKE). This not only allows users to authenticate each other via shared low entropy secrets, e.g., memorable words, without a public key infrastructure or a trusted third party, but it also paves the way for automation and a series of cryptographic enhancements improves security by minimizing the impact of human error and potentially improves usability. First, we study a few vulnerabilities in voice based out of band authentication, in particular a combinatorial attack against lazy users, which we analyze in the context of a secure email solution. Next, we propose solving the problem of secure equality test using PAKE to achieve entity authentication and to establish a shared high entropy secret key. Our solution lends itself to offline settings, compatible with the inherently asynchronous nature of email and modern messaging systems. The suggested approach enables enhancements in key management such as automated key renewal and future key pair authentications, multi device synchronization, secure secret storage and retrieval, and the possibility of post quantum security as well as facilitating forward secrecy and deniability in a primarily symmetric key setting. We also discuss the use of auditable PAKEs for mitigating a class of online guess and abort attacks in authentication protocols.


Dynamic evaluation of exponential polynomial curves and surfaces via basis transformation. It is shown in "SIAM J. Sci. Comput. 39 (2017) B424 B441" that free form curves used in computer aided geometric design can usually be represented as the solutions of linear differential systems and points and derivatives on the curves can be evaluated dynamically by solving the differential systems numerically. In this paper we present an even more robust and efficient algorithm for dynamic evaluation of exponential polynomial curves and surfaces. Based on properties that spaces spanned by general exponential polynomials are translation invariant and polynomial spaces are invariant with respect to a linear transform of the parameter, the transformation matrices between bases with or without translated or linearly transformed parameters are explicitly computed. Points on curves or surfaces with equal or changing parameter steps can then be evaluated dynamically from a start point using a pre computed matrix. Like former dynamic evaluation algorithms, the newly proposed approach needs only arithmetic operations for evaluating exponential polynomial curves and surfaces. Unlike conventional numerical methods that solve a linear differential system, the new method can give robust and accurate evaluation results for any chosen parameter steps. Basis transformation technique also enables dynamic evaluation of polynomial curves with changing parameter steps using a constant matrix, which reduces time costs significantly than computing each point individually by classical algorithms.


SCOUT Self aware Discriminant Counterfactual Explanations. The problem of counterfactual visual explanations is considered. A new family of discriminant explanations is introduced. These produce heatmaps that attribute high scores to image regions informative of a classifier prediction but not of a counter class. They connect attributive explanations, which are based on a single heat map, to counterfactual explanations, which account for both predicted class and counter class. The latter are shown to be computable by combination of two discriminant explanations, with reversed class pairs. It is argued that self awareness, namely the ability to produce classification confidence scores, is important for the computation of discriminant explanations, which seek to identify regions where it is easy to discriminate between prediction and counter class. This suggests the computation of discriminant explanations by the combination of three attribution maps. The resulting counterfactual explanations are optimization free and thus much faster than previous methods. To address the difficulty of their evaluation, a proxy task and set of quantitative metrics are also proposed. Experiments under this protocol show that the proposed counterfactual explanations outperform the state of the art while achieving much higher speeds, for popular networks. In a human learning machine teaching experiment, they are also shown to improve mean student accuracy from chance level to 95 .


A Statistical Real Time Prediction Model for Recommender System. Recommender system has become an inseparable part of online shopping and its usability is increasing with the advancement of these e commerce sites. An effective and efficient recommender system benefits both the seller and the buyer significantly. We considered user activities and product information for the filtering process in our proposed recommender system. Our model has achieved inspiring result (approximately 58 true positive and 13 false positive) for the data set provided by RecSys Challenge 2015. This paper aims to describe a statistical model that will help to predict the buying behavior of a user in real time during a session.


Non polyhedral effective cones from the moduli space of curves. We show that the pseudoeffective cone of divisors overline text Eff 1( overline mathcal M g,n ) for g geq 2 and n geq 2 is not polyhedral by showing that the class of the fibre of the morphism forgetting one point forms an extremal ray of the dual nef cone of curves overline text Nef 1( overline mathcal M g,n ) and the cone at this ray is not polyhedral.


Zinc Sulphide Overlayer Two Dimensional Photonic Crystal for Enhanced Extraction of Light from a Micro Cavity Light Emitting Diode. A two dimensional (2D) ZnS photonic crystal was deposited on the surface of a one dimensional (1D) III nitride micro cavity light emitting diode (LED), to intermix the light extraction features of both structures (1D 2D). The deposition of an ideal micro cavity optical thickness of lambda 2 is impractical for III nitride LEDs, and in realistic multi mode devices a large fraction of the light is lost to internal refraction as guided light. Therefore, a 2D photonic crystal on the surface of the LED was used to diffract and thus redirect this guided light out of the semiconductor over several hundred microns. Additionally, the employment of a post epitaxy ZnS 2D photonic crystal avoided the typical etching into the GaN Mg contact layer, a procedure which can cause damage to the near surface.


On the realization of symplectic algebras and rational homotopy types by closed symplectic manifolds. We answer a question of Oprea Tralle on the realizability of symplectic algebras by symplectic manifolds in dimensions divisible by four, along with a question of Lupton Oprea in all even dimensions. This will also allow us to address, in all even dimensions six and higher, another question of Oprea Tralle on the possibility of algebraic conditions on the rational homotopy minimal model of a closed smooth manifold implying the existence of a symplectic structure on the manifold.


Proving two conjectural series for zeta(7) and discovering more series for zeta(7) . We give a proof of two identities involving binomial sums at infinity conjectured by Z W Sun. In order to prove these identities, we use a recently presented method i.e. we view the series as specializations of generating series and derive integral representations. Using substitutions, we express these integral representations in terms of cyclotomic harmonic polylogarithms. Finally, by applying known relations among the cyclotomic harmonic polylogarithms, we derive the results. These methods are implemented in the computer algebra package HarmonicSums.


Deep Modeling of Growth Trajectories for Longitudinal Prediction of Missing Infant Cortical Surfaces. Charting cortical growth trajectories is of paramount importance for understanding brain development. However, such analysis necessitates the collection of longitudinal data, which can be challenging due to subject dropouts and failed scans. In this paper, we will introduce a method for longitudinal prediction of cortical surfaces using a spatial graph convolutional neural network (GCNN), which extends conventional CNNs from Euclidean to curved manifolds. The proposed method is designed to model the cortical growth trajectories and jointly predict inner and outer cortical surfaces at multiple time points. Adopting a binary flag in loss calculation to deal with missing data, we fully utilize all available cortical surfaces for training our deep learning model, without requiring a complete collection of longitudinal data. Predicting the surfaces directly allows cortical attributes such as cortical thickness, curvature, and convexity to be computed for subsequent analysis. We will demonstrate with experimental results that our method is capable of capturing the nonlinearity of spatiotemporal cortical growth patterns and can predict cortical surfaces with improved accuracy.


A novel centroid update approach for clustering based superpixel methods and superpixel based edge detection. Superpixel is widely used in image processing. And among the methods for superpixel generation, clustering based methods have a high speed and a good performance at the same time. However, most clustering based superpixel methods are sensitive to noise. To solve these problems, in this paper, we first analyze the features of noise. Then according to the statistical features of noise, we propose a novel centroid update approach to enhance the robustness of clustering based superpixel methods. Besides, we propose a novel superpixel based edge detection method. The experiments on BSD500 dataset show that our approach can significantly enhance the performance of clustering based superpixel methods in noisy environment. Moreover, we also show that our proposed edge detection method outperforms other classical methods.


Duality of capacities and Sobolev extendability in the plane. We reveal relations between the duality of capacities and the duality between Sobolev extendability of Jordan domains in the plane, and explain how to read the curve conditions involvd in the Sobolev extendability of Jordan domains via the duality of capacities. Finally as an application, we give an alternative proof of the necessary condition for a Jordan planar domain to be W 1, q extension domain when 2 q infty .


Versality in toric geometry. We study deformations of affine toric varieties. The entire deformation theory of these singularities is encoded by the so called versal deformation. The main goal of our paper is to construct the homogeneous part of some degree R of this, i.e. a maximal deformation with prescribed tangent space T 1( R) for a given character R. To this aim we use the polyhedron obtained by cutting the rational cone defining the affine singularity with the hyperplane defined by R 1 . Under some length assumptions on the edges of this polyhedron, we provide the versal deformation for primitive degrees R.


Powers are easy to avoid. Suppose that widetilde mathbb R is an o minimal expansion of the real field in which restricted power functions are definable. We show that if widehat mathbb R is both a reduct (in the sense of definability) of the expansion widetilde mathbb R mathbb R of widetilde mathbb R by all real power functions and an expansion (again in the sense of definability) of widetilde mathbb R , then, provided that widetilde mathbb R and widehat mathbb R have the same field of exponents, they define the same sets. This can be viewed as a polynomially bounded version of an old conjecture of van den Dries and Miller.


Genetic Programming for Evolving Similarity Functions for Clustering Representations and Analysis. Clustering is a difficult and widely studied data mining task, with many varieties of clustering algorithms proposed in the literature. Nearly all algorithms use a similarity measure such as a distance metric (e.g. Euclidean distance) to decide which instances to assign to the same cluster. These similarity measures are generally pre defined and cannot be easily tailored to the properties of a particular dataset, which leads to limitations in the quality and the interpretability of the clusters produced. In this paper, we propose a new approach to automatically evolving similarity functions for a given clustering algorithm by using genetic programming. We introduce a new genetic programming based method which automatically selects a small subset of features (feature selection) and then combines them using a variety of functions (feature construction) to produce dynamic and flexible similarity functions that are specifically designed for a given dataset. We demonstrate how the evolved similarity functions can be used to perform clustering using a graph based representation. The results of a variety of experiments across a range of large, high dimensional datasets show that the proposed approach can achieve higher and more consistent performance than the benchmark methods. We further extend the proposed approach to automatically produce multiple complementary similarity functions by using a multi tree approach, which gives further performance improvements. We also analyse the interpretability and structure of the automatically evolved similarity functions to provide insight into how and why they are superior to standard distance metrics.


Human Action Recognition and Assessment via Deep Neural Network Self Organization. The robust recognition and assessment of human actions are crucial in human robot interaction (HRI) domains. While state of the art models of action perception show remarkable results in large scale action datasets, they mostly lack the flexibility, robustness, and scalability needed to operate in natural HRI scenarios which require the continuous acquisition of sensory information as well as the classification or assessment of human body patterns in real time. In this chapter, I introduce a set of hierarchical models for the learning and recognition of actions from depth maps and RGB images through the use of neural network self organization. A particularity of these models is the use of growing self organizing networks that quickly adapt to non stationary distributions and implement dedicated mechanisms for continual learning from temporally correlated input.


Lattice points in spherical segments. We study lattice points in d dimensional spheres, and count their number in thin spherical segments. We found an upper bound depending only on the radius of the sphere and opening angle of the segment. To obtain this bound we slice the segment by hyperplanes of rational direction, and then cover an arbitrary segment with one having rational direction. Diophantine approximation can be used to obtain the best rational direction possible.


Archimedean Choice Functions an Axiomatic Foundation for Imprecise Decision Making. If uncertainty is modelled by a probability measure, decisions are typically made by choosing the option with the highest expected utility. If an imprecise probability model is used instead, this decision rule can be generalised in several ways. We here focus on two such generalisations that apply to sets of probability measures E admissibility and maximality. Both of them can be regarded as special instances of so called choice functions, a very general mathematical framework for decision making. For each of these two decision rules, we provide a set of necessary and sufficient conditions on choice functions that uniquely characterises this rule, thereby providing an axiomatic foundation for imprecise decision making with sets of probabilities. A representation theorem for Archimedean choice functions in terms of coherent lower previsions lies at the basis of both results.


Scattering for the mass super critical perturbations of the mass critical nonlinear Schr "odinger equations. We consider the Cauchy problem for the nonlinear Schr "odinger equation with double nonlinearities with opposite sign, with one term is mass critical and the other term is mass supercritical and energy subcritical, which includes the famous two dimensional cubic quintic nonlinear Schr "odinger equaton. We prove global wellposedness and scattering in H 1( mathbb R d) below the threshold for non radial data when 1 le d le 4 .


Higher order operators on networks hyperbolic and parabolic theory. We study higher order elliptic operators on one dimensional ramified structures (networks). We introduce a general variational framework for fourth order operators that allows us to study features of both hyperbolic and parabolic equations driven by this class of operators. We observe that they extend to the higher order case and discuss well posedness and conservation of energy of beam equations, along with regularizing properties of polyharmonic heat kernels. A noteworthy finding is the discovery of a new class of well posed evolution equations with Wentzell type boundary conditions.


Emotional Avatars The Interplay between Affect and Ownership of a Virtual Body. Human bodies influence the owners' affect through posture, facial expressions, and movement. It remains unclear whether similar links between virtual bodies and affect exist. Such links could present design opportunities for virtual environments and advance our understanding of fundamental concepts of embodied VR. An initial outside the lab between subjects study using commodity equipment presented 207 participants with seven avatar manipulations, related to posture, facial expression, and speed. We conducted a lab based between subjects study using high end VR equipment with 41 subjects to clarify affect's impact on body ownership. The results show that some avatar manipulations can subtly influence affect. Study I found that facial manipulations emerged as most effective in this regard, particularly for positive affect. Also, body ownership showed a moderating influence on affect in Study I body ownership varied with valence but not with arousal, and Study II showed body ownership to vary with positive but not with negative affect.


Decoder Ties Do Not Affect the Error Exponent of the Memoryless Binary Symmetric Channel. The generalized Poor Verdu error lower bound established in 1 for multihypothesis testing is studied in the classical channel coding context. It is proved that for any sequence of block codes sent over the memoryless binary symmetric channel (BSC), the minimum probability of error (under maximum likelihood decoding) has a relative deviation from the generalized bound that grows at most linearly in blocklength. This result directly implies that for arbitrary codes used over the BSC, decoder ties can only affect the subexponential behavior of the minimum probability of error.


Efficient Estimation of Graph Trussness. A k truss is an edge induced subgraph H such that each of its edges belongs to at least k 2 triangles of H . This notion has been introduced around ten years ago in social network analysis and security, as a form of cohesive subgraph that is rich of triangles and less stringent than the clique. The emph trussness of a graph is the maximum k such that a k truss exists. The problem of computing k trusses has been largely investigated from the practical and engineering point of view. On the other hand, the theoretical side of the problem has received much less attention, despite presenting interesting challenges. The existing methods share a common design, based on iteratively removing the edge with smallest support, where the support of an edge is the number of triangles containing it. The aim of this paper is studying algorithmic aspects of graph trussness. While it is possible to show that the time complexity of computing exactly the graph trussness and that of counting listing all triangles is inherently the same, we provide efficient algorithms for estimating its value, under suitable conditions, with significantly lower complexity than the exact approach. In particular, we provide a (1 pm epsilon) approximation algorithm that is asymptotically faster than the exact approach, on graphs which contain omega(m , polylog(n)) triangles, and has the same running time on graphs that do not. For the latter case, we also show that it is impossible to obtain an approximation algorithm with faster running time than the one of the exact approach when the number of triangles is O(m) , unless well known conjectures on triangle freeness and Boolean matrix multiplication are false.


PowerNorm Rethinking Batch Normalization in Transformers. The standard normalization method for neural network (NN) models used in Natural Language Processing (NLP) is layer normalization (LN). This is different than batch normalization (BN), which is widely adopted in Computer Vision. The preferred use of LN in NLP is principally due to the empirical observation that a (naive vanilla) use of BN leads to significant performance degradation for NLP tasks however, a thorough understanding of the underlying reasons for this is not always evident. In this paper, we perform a systematic study of NLP transformer models to understand why BN has a poor performance, as compared to LN. We find that the statistics of NLP data across the batch dimension exhibit large fluctuations throughout training. This results in instability, if BN is naively implemented. To address this, we propose Power Normalization (PN), a novel normalization scheme that resolves this issue by (i) relaxing zero mean normalization in BN, (ii) incorporating a running quadratic mean instead of per batch statistics to stabilize fluctuations, and (iii) using an approximate backpropagation for incorporating the running statistics in the forward pass. We show theoretically, under mild assumptions, that PN leads to a smaller Lipschitz constant for the loss, compared with BN. Furthermore, we prove that the approximate backpropagation scheme leads to bounded gradients. We extensively test PN for transformers on a range of NLP tasks, and we show that it significantly outperforms both LN and BN. In particular, PN outperforms LN by 0.4 0.6 BLEU on IWSLT14 WMT14 and 5.6 3.0 PPL on PTB WikiText 103. We make our code publicly available at url https github.com sIncerass powernorm .


Mikhail Aleksandrovich Shubin. December 19, 1944 May 13, 2020. The article is dedicated to thye memory of a distinguished mathematician Professor Misha Shubin


Design Paradigms Based on Spring Agonists for Underactuated Robot Hands Concepts and Application. In this paper, we focus on a rarely used paradigm in the design of underactuated robot hands the use of springs as agonists and tendons as antagonists. We formalize this approach in a design matrix also considering its interplay with the underactuation method used (one tendon for multiple joints vs. multiple tendons on one motor shaft). We then show how different cells in this design matrix can be combined in order to facilitate the implementation of desired postural synergies with a single motor. Furthermore, we show that when agonist and antagonist tendons are combined on the same motor shaft, the resulting spring force cancellation can be leveraged to produce multiple desirable behaviors, which we demonstrate in a physical prototype.


Effective Capacity of NOMA with Finite Blocklength for Low Latency Communications. In this paper, we investigate the link layer rate of a two users non orthogonal multiple access (NOMA) network in finite blocklength (short packet communications) regime, where the two users are paired from a set of V users. The overall reliability consists of the transmission error probability and the queuing delay violation probability. The performance of the two users NOMA network in finite blocklength is verified for achieving latency and reliability, using the effective capacity (EC) framework. Specifically, we derive closed form expressions for the EC of the two users NOMA network in finite blocklength regime, considering transmissions over Rayleigh fading channels. We also study a multiuser NOMA network and derive the total EC of two users NOMA subsets, and show that the NOMA set with users having distinct channel conditions achieve maximum total EC. Focusing on a two users NOMA network, we study the impact of the transmit signal to noise ratio, delay exponent, and transmission error probability, on the achievable EC of each user. The analysis shows that when the delay exponent is high, the delay violation probability does not improve below a certain value due to the dominant factor of the transmission error probability. The accuracy of the proposed closed form expressions for the individual EC of a two users NOMA is verified using the Monte Carlo simulations.


Privacy Shadow Measuring Node Predictability and Privacy Over Time. The structure of network data enables simple predictive models to leverage local correlations between nodes to high accuracy on tasks such as attribute and link prediction. While this is useful for building better user models, it introduces the privacy concern that a user's data may be re inferred from the network structure, after they leave the application. We propose the privacy shadow for measuring how long a user remains predictive from an arbitrary time within the network. Furthermore, we demonstrate that the length of the privacy shadow can be predicted for individual users in three real world datasets.


Topics in Hilbert Spaces, Spectral Theory, and Harmonic Analysis. General expository paper concerning topics in Hilbert spaces, spectral theory, and harmonic analysis. The preliminary section includes basic Banach algebra and Hilbert space theory with a digression on Riesz bases. The second and third sections are focused on deriving the spectral theorem for Hilbert spaces in finite and arbitrary dimension, respectively. The fourth and fifth sections present applications of the general theory first to finite abelian groups, then to the space L 2(S 1, mu) .


TraceSecure Towards Privacy Preserving Contact Tracing. Contact tracing is being widely employed to combat the spread of COVID 19. Many apps have been developed that allow for tracing to be done automatically based off location and interaction data generated by users. There are concerns, however, regarding the privacy and security of users data when using these apps. These concerns are paramount for users who contract the virus, as they are generally required to release all their data. Motivated by the need to protect users privacy we propose two solutions to this problem. Our first solution builds on current "message based" methods and our second leverages ideas from secret sharing and additively homomorphic encryption.


MediaPipe Hands On device Real time Hand Tracking. We present a real time on device hand tracking pipeline that predicts hand skeleton from single RGB camera for AR VR applications. The pipeline consists of two models 1) a palm detector, 2) a hand landmark model. It's implemented via MediaPipe, a framework for building cross platform ML solutions. The proposed model and pipeline architecture demonstrates real time inference speed on mobile GPUs and high prediction quality. MediaPipe Hands is open sourced at https mediapipe.dev.


Analyzing the Performance of Smart Industry 4.0 Applications on Cloud Computing Systems. Cloud based Deep Neural Network (DNN) applications that make latency sensitive inference are becoming an indispensable part of Industry 4.0. Due to the multi tenancy and resource heterogeneity, both inherent to the cloud computing environments, the inference time of DNN based applications are stochastic. Such stochasticity, if not captured, can potentially lead to low Quality of Service (QoS) or even a disaster in critical sectors, such as Oil and Gas industry. To make Industry 4.0 robust, solution architects and researchers need to understand the behavior of DNN based applications and capture the stochasticity exists in their inference times. Accordingly, in this study, we provide a descriptive analysis of the inference time from two perspectives. First, we perform an application centric analysis and statistically model the execution time of four categorically different DNN applications on both Amazon and Chameleon clouds. Second, we take a resource centric approach and analyze a rate based metric in form of Million Instruction Per Second (MIPS) for heterogeneous machines in the cloud. This non parametric modeling, achieved via Jackknife and Bootstrap re sampling methods, provides the confidence interval of MIPS for heterogeneous cloud machines. The findings of this research can be helpful for researchers and cloud solution architects to develop solutions that are robust against the stochastic nature of the inference time of DNN applications in the cloud and can offer a higher QoS to their users and avoid unintended outcomes.


Text Mining over Curriculum Vitae of Peruvian Professionals using Official Scientific Site DINA. During the last decade, Peruvian government started to invest and promote Science and Technology through Concytec(National Council of Science and Technology). Many programs are oriented to support research projects, expenses for paper presentation, organization of conferences events and more. Concytec created a National Directory of Researchers(DINA) where professionals can create and add curriculum vitae, Concytec can provide official title of Researcher following some criterion for the evaluation. The actual paper aims to conduct an exploratory analysis over the curriculum vitae of Peruvian Professionals using Data Mining Approach to understand Peruvian context.


Existence and Continuation of Solutions of Hilfer Katugampola Type Fractional Differential Equations. This article contains a new discussion for the generalized fractional Cauchy type problem involving Hilfer Katugampola type fractional derivative. We study an existence and continuation of its solution. Firstly, we establish a new theorems of local existence. Then, we deduce a continuation theorems for a general fractional differential equations. By applying continuation theorems deduced in this article, we present several global existence results. Moreover, the examples are given to illustrate our main results.


Contact network models matching the dynamics of the COVID 19 spreading. We study the epidemic spreading on spatial networks where the probability that two nodes are connected decays with their distance as a power law. As the exponent of the distance dependence grows, model networks smoothly transition from the random network limit to the regular lattice limit. We show that despite keeping the average number of contacts constant, the increasing exponent hampers the epidemic spreading by making long distance connections less frequent. The spreading dynamics is influenced by the distance dependence exponent as well and changes from exponential growth to power law growth. The observed power law growth is compatible with recent analyses of empirical data on the spreading of COVID 19 in numerous countries.


Poincar 'e Inequalities and Uniform Rectifiability. We show that any d Ahlfors regular subset of mathbb R n supporting a weak (1,d) Poincar 'e inequality with respect to surface measure is uniformly rectifiable.


Barycentric cuts through a convex body. Let K be a convex body in mathbb R n (i.e., a compact convex set with nonempty interior). Given a point p in the interior of K , a hyperplane h passing through p is called barycentric if p is the barycenter of K cap h . In 1961, Gr " u nbaum raised the question whether, for every K , there exists an interior point p through which there are at least n 1 distinct barycentric hyperplanes. Two years later, this was seemingly resolved affirmatively by showing that this is the case if p p 0 is the point of maximal depth in K . However, while working on a related question, we noticed that one of the auxiliary claims in the proof is incorrect. Here, we provide a counterexample this re opens Gr "unbaum's question. It follows from known results that for n geq 2 , there are always at least three distinct barycentric cuts through the point p 0 in K of maximal depth. Using tools related to Morse theory we are able to improve this bound four distinct barycentric cuts through p 0 are guaranteed if n geq 3 .


Evolving complexity how tinkering shapes cells, software and ecological networks. A common trait of complex systems is that they can be represented by means of a network of interacting parts. It is, in fact, the network organisation (more than the parts) what largely conditions most higher level properties, which are not reducible to the properties of the individual parts. Can the topological organisation of these webs provide some insight into their evolutionary origins? Both biological and artificial networks share some common architectural traits. They are often heterogeneous and sparse, and most exhibit the small world property or the presence of modular or hierarchical patterns. These properties have often been attributed to the selection of functionally meaningful traits. However, the proper formulation of generative network models suggests a rather different picture. Against the standard selection optimisation argument, some networks reveal the inevitable generation of complex patterns resulting from reuse and can be modelled using duplication rewiring rules. These give rise to the heterogeneous, scale free and modular architectures observed in the real case studies. Tinkering is a universal mechanism that drives not only biological evolution but also the large scale dynamics of some technological designs. Here we examine the evidence for tinkering in cellular, technological and ecological webs and its impact in shaping their architecture and deeply affecting their functional properties. Our analysis suggests to seriously reconsider the role played by selection forces or design principles as main drivers of network evolution.


Extreme Flow Decomposition for Multi Source Multicast with Intra Session Network Coding. Network coding (NC), when combined with multipath routing, enables a linear programming (LP) formulation for a multi source multicast with intra session network coding (MISNC) problem. However, it is still hard to solve using conventional methods due to the enormous scale of variables or constraints. In this paper, we try to solve this problem in terms of throughput maximization from an algorithmic perspective. We propose a novel formulation based on the extereme flow decomposition technique, which facilitates the design and analysis of approximation and online algorithms. For the offline scenario, we develop a fully polynomial time approximation scheme (FPTAS) which can find a (1 omega ) approximation solution for any specified omega 0 . For the online scenario, we develop an online primal dual algorithm which proves O(1) competitive and violates link capacities by a factor of O( log m) , where m is the link number. The proposed algorithms share an elegant primal dual form and thereby have inherent advantages of simplicity, efficiency, and scalability. To better understand the advantages of the extereme flow decomposition approach, we devise delicate numerical examples on an extended butterfly network. We validate the effects of algorithmic parameters and make an interesting comparison between the proposed FPTAS and online algorithm. The results show that the online algorithm has satisfactory performance while keeping the overall link utilization acceptable compared with the FPTAS.


Global existence theorem for a model governing the motion of two cell populations. This article is concerned with the existence of a weak solution to the initial boundary problem for a cross diffusion system which arises in the study of two cell population growth. The mathematical challenge is due to the fact that the coefficient matrix is non symmetric and degenerate in the sense that its determinant is 0 . Existence assertion is established by exploring the fact that the total population density satisfies a porous media equation.


SecureIT using Firebase, Google map and Node.Js. This paper is about describing the features of a software that was developed for its user safety which we called SecureIT is a android based soft ware using Android SDK along with Firebase and Google map SDK along with Node.Js. The aim of developing this project was to make sure and taking its users safety to a next level. Actually now a days some crime incidents like rapes, fire accidents and snatchings are very common and we believe many of those can be prevented if victim got support at the right time. According to the well known daily news paper of Bangladesh The Daily Star there were about 1413 women was rapped where 76 women were dead in 2019. On the same pa per it also said that in 2018 and 2017 the number of rapes were 732 and 818 where we can easily get that the number increases to almost double in 2019. Where we get a point that if those girls get support or get people known about their location at the right time they might get rid of the situation and the number of rapes could be reduced a lot because we all know that now a days using mo bile smartphone is too easy for people. Although leading Chinese mobile phone company Xiaomi introduced a new feature Emergency SOS service in their mobile phones at the end of 2018 with a MIUI 10 update but this feature is only limited to the Xiaomi phones and it was well advertised as well. This paper will briefly describe all the features of our software and its usages.


Highly nonlinear functions over finite fields. We consider a generalisation of a conjecture by Patterson and Wiedemann from 1983 on the Hamming distance of a function from mathbb F q n to mathbb F q to the set of affine functions from mathbb F q n to mathbb F q . We prove the conjecture for each q such that the characteristic of mathbb F q lies in a subset of the primes with density 1 and we prove the conjecture for all q by assuming the generalised Riemann hypothesis. Roughly speaking, we show the existence of functions for which the distance to the affine functions is maximised when n tends to infinity. This also determines the asymptotic behaviour of the covering radius of the q n,n 1 Reed Muller code over mathbb F q and so answers a question raised by Leducq in 2013. Our results extend the case q 2 , which was recently proved by the author and which corresponds to the original conjecture by Patterson and Wiedemann. Our proof combines evaluations of Gauss sums in the semiprimitive case, probabilistic arguments, and methods from discrepancy theory.


Shape of synth to come Why we should use synthetic data for English surface realization. The Surface Realization Shared Tasks of 2018 and 2019 were Natural Language Generation shared tasks with the goal of exploring approaches to surface realization from Universal Dependency like trees to surface strings for several languages. In the 2018 shared task there was very little difference in the absolute performance of systems trained with and without additional, synthetically created data, and a new rule prohibiting the use of synthetic data was introduced for the 2019 shared task. Contrary to the findings of the 2018 shared task, we show, in experiments on the English 2018 dataset, that the use of synthetic data can have a substantial positive effect an improvement of almost 8 BLEU points for a previously state of the art system. We analyse the effects of synthetic data, and we argue that its use should be encouraged rather than prohibited so that future research efforts continue to explore systems that can take advantage of such data.


Local in time solution to Kolmogorov's two equation model of turbulence. We prove the existence of local in time solution to Kolmogorov's two equation model of turbulence in three dimensional domain with periodic boundary conditions. We apply Galerkin method for appropriate truncated problem. Next, we obtain estimates for a limit of approximate solutions to ensure that it satisfies the original problem.


Development of a robotic system for automatic organic chemistry synthesis. Automated chemical synthesis carries great promises of safety, efficiency and reproducibility for both research and industry laboratories. Current approaches are based on specifically designed automation systems, which present two major drawbacks (i) existing apparatus must be modified to be integrated into the automation systems (ii) such systems are not flexible and would require substantial re design to handle new reactions or procedures. In this paper, we propose a system based on a robot arm which, by mimicking the motions of human chemists, is able to perform complex chemical reactions without any modifications to the existing setup used by humans. The system is capable of precise liquid handling, mixing, filtering, and is flexible new skills and procedures could be added with minimum effort. We show that the robot is able to perform a Michael reaction, reaching a yield of 34 , which is comparable to that obtained by a junior chemist (undergraduate student in Chemistry).


Structure preserving algorithms for multi dimensional fractional Klein Gordon Schr " o dinger equation. This paper aims to construct structure preserving numerical schemes for multi dimensional space fractional Klein Gordon Schr " o dinger equation, which are based on the newly developed partitioned averaged vector field methods. First, we derive an equivalent equation, and reformulate the equation as a canonical Hamiltonian system by virtue of the variational derivative of the functional with fractional Laplacian. Then, we develop a semi discrete conservative scheme via using the Fourier pseudo spectral method to discrete the equation in space direction. Further applying the partitioned averaged vector field methods on the temporal direction gives a class of fully discrete schemes that can preserve the mass and energy exactly. Numerical examples are provided to confirm our theoretical analysis results at last.


Contracting axially symmetric hypersurfaces by powers of the sigma k curvature. In this paper, we investigate the contracting curvature flow of closed, strictly convex axially symmetric hypersurfaces in mathbb R n 1 and mathbb S n 1 by sigma k alpha , where sigma k is the k th elementary symmetric function of the principal curvatures and alpha ge 1 k . We prove that for any n geq3 and any fixed k with 1 leq k leq n , there exists a constant c(n,k) 1 k such that that if alpha lies in the interval 1 k,c(n,k) , then we have a nice curvature pinching estimate involving the ratio of the biggest principal curvature to the smallest principal curvature of the flow hypersurface, and we prove that the properly rescaled hypersurfaces converge exponentially to the unit sphere. In the case 1 k le n le k 2 , we can choose c(n,k) frac 1 k 1 . Our results provide an evidence for the general convergence result without initial curvature pinching conditions.


Recent Theoretical Advances in Non Convex Optimization. Motivated by recent increased interest in optimization algorithms for non convex optimization in application to training deep neural networks and other optimization problems in data analysis, we give an overview of recent theoretical results on global performance guarantees of optimization algorithms for non convex optimization. We start with classical arguments showing that general non convex problems could not be solved efficiently in a reasonable time. Then we give a list of problems that can be solved efficiently to find the global minimizer by exploiting the structure of the problem as much as it is possible. Another way to deal with non convexity is to relax the goal from finding the global minimum to finding a stationary point or a local minimum. For this setting, we first present known results for the convergence rates of deterministic first order methods, which are then followed by a general theoretical analysis of optimal stochastic and randomized gradient schemes, and an overview of the stochastic first order methods. After that, we discuss quite general classes of non convex problems, such as minimization of alpha weakly quasi convex functions and functions that satisfy Polyak Lojasiewicz condition, which still allow obtaining theoretical convergence guarantees of first order methods. Then we consider higher order and zeroth order derivative free methods and their convergence rates for non convex optimization problems.


( phi, tau) modules diff 'erentiels et repr 'esentations potentiellement semi stables. Soit K un corps p adique et soit V une repr 'esentation p adique de mathcal G K mathrm Gal ( bar K K) . La surconvergence des ( phi, tau) modules nous permet d'attacher a V un phi module diff 'erentiel a connexion D tau, mathrm rig dagger(V) sur l'anneau de Robba mathbf B tau, mathrm rig ,K dagger . On montre dans cet article comment retrouver les invariants D mathrm cris (V) et D mathrm st (V) a partir de D tau, mathrm rig dagger(V) , et comment caract 'eriser les repr 'esentations potentiellement semi stables, ainsi que celles de E hauteur finie, a partir de la connexion. Let K be a p adic field and let V be a p adic representation of mathcal G K mathrm Gal ( bar K K) . The overconvergence of ( phi, tau) modules allows us to attach to V a differential phi module D tau, mathrm rig dagger(V) on the Robba ring mathbf B tau, mathrm rig ,K dagger that comes equipped with a connection. We show in this paper how to recover the invariants D mathrm cris (V) and D mathrm st (V) from D tau, mathrm rig dagger(V) , and give a characterization of both potentially semi stable representations of mathcal G K and finite E height representations in terms of the connection operator.


Recursive Scheme for Angles of Random Simplices, and Applications to Random Polytopes. Consider a random simplex X 1, ldots,X n defined as the convex hull of independent identically distributed random points X 1, ldots,X n in mathbb R n 1 with the following beta density f n 1, beta (x) propto (1 x 2) beta 1 x 1 , qquad x in mathbb R n 1 , quad beta 1. Let J n,k ( beta) be the expected internal angle of the simplex X 1, ldots,X n at its face X 1, ldots,X k . Define tilde J n,k ( beta) analogously for i.i.d. random points distributed according to the beta' density tilde f n 1, beta (x) propto (1 x 2) beta , qquad x in mathbb R n 1 , quad beta frac n 1 2 . We derive formulae for J n,k ( beta) and tilde J n,k ( beta) which make it possible to compute these quantities symbolically, in finitely many steps, for any integer or half integer value of beta . For J n,1 ( pm 1 2) we even provide explicit formulae in terms of products of Gamma functions. We give applications of these results to two seemingly unrelated problems of stochastic geometry. (i) We compute the expected f vectors of the typical Poisson Voronoi cells in dimensions up to 10 . (ii) Consider the random polytope K n,d U 1, ldots,U n where U 1, ldots,U n are i.i.d. random points sampled uniformly inside some d dimensional convex body K with smooth boundary and unit volume. M. Reitzner proved the existence of the limit of the normalized expected f vector of K n,d lim n to infty n frac d 1 d 1 mathbb E mathbf f(K n,d ) mathbf c d cdot Omega(K), where Omega(K) is the affine surface area of K , and mathbf c d is an unknown vector not depending on K . We compute mathbf c d explicitly in dimensions up to d 10 and also solve the analogous problem for random polytopes with vertices distributed uniformly on the sphere.


Beyond just "flattening the curve" Optimal control of epidemics with purely non pharmaceutical interventions. When effective medical treatment and vaccination are not available, non pharmaceutical interventions such as social distancing, home quarantine and far reaching shutdown of public life are the only available strategies to prevent the spread of epidemics. Based on an extended SEIR (susceptible exposed infectious recovered) model and continuous time optimal control theory, we compute the optimal non pharmaceutical intervention strategy for the case that a vaccine is never found and complete containment (eradication of the epidemic) is impossible. In this case, the optimal control must meet competing requirements First, the minimization of disease related deaths, and, second, the establishment of a sufficient degree of natural immunity at the end of the measures, in order to exclude a second wave. Moreover, the socio economic costs of the intervention shall be kept at a minimum. The numerically computed optimal control strategy is a single intervention scenario that goes beyond heuristically motivated interventions and simple "flattening of the curve." Careful analysis of the computed control strategy reveals, however, that the obtained solution is in fact a tightrope walk close to the stability boundary of the system, where socio economic costs and the risk of a new outbreak must be constantly balanced against one another. The model system is calibrated to reproduce the initial exponential growth phase of the COVID 19 pandemic in Germany.


Modifying a Graph's Degree Sequence and the Testablity of Degree Sequence Properties. We show that if the degree sequence of a graph G is close in ell 1 distance to a given realizable degree sequence (d 1, dots,d n) , then G is close in edit distance to a graph with degree sequence (d 1, dots,d n) . We then use this result to prove that every graph property defined in terms of the degree sequence is testable in the dense graph model with query complexity independent of n .


Exact minimum codegree thresholds for K 4 covering and K 5 covering. Given two 3 graphs F and H , an F covering of H is a collection of copies of F in H such that each vertex of H is contained in at least one copy of them. Let c 2(n,F) be the maximum integer t such that every 3 graph with minimum codegree greater than t has an F covering. In this note, we answer an open problem of Falgas Ravry and Zhao (SIAM J. Discrete Math., 2016) by determining the exact value of c 2(n, K 4 ) and c 2(n, K 5 ) , where K t is the complete 3 graph on t vertices with one edge removed.