To Filter Prune, or to Layer Prune, That Is The Question. Recent advances in pruning of neural networks have made it possible to remove a large number of filters or weights without any perceptible drop in accuracy. The number of parameters and that of FLOPs are usually the reported metrics to measure the quality of the pruned models. However, the gain in speed for these pruned models is often overlooked in the literature due to the complex nature of latency measurements. In this paper, we show the limitation of filter pruning methods in terms of latency reduction and propose LayerPrune framework. LayerPrune presents a set of layer pruning methods based on different criteria that achieve higher latency reduction than filter pruning methods on similar accuracy. The advantage of layer pruning over filter pruning in terms of latency reduction is a result of the fact that the former is not constrained by the original model's depth and thus allows for a larger range of latency reduction. For each filter pruning method we examined, we use the same filter importance criterion to calculate a per layer importance score in one shot. We then prune the least important layers and fine tune the shallower model which obtains comparable or better accuracy than its filter based pruning counterpart. This one shot process allows to remove layers from single path networks like VGG before fine tuning, unlike in iterative filter pruning, a minimum number of filters per layer is required to allow for data flow which constraint the search space. To the best of our knowledge, we are the first to examine the effect of pruning methods on latency metric instead of FLOPs for multiple networks, datasets and hardware targets. LayerPrune also outperforms handcrafted architectures such as Shufflenet, MobileNet, MNASNet and ResNet18 by 7.3 , 4.6 , 2.8 and 0.5 respectively on similar latency budget on ImageNet dataset.


Min max Minimal Hypersurfaces with Obstacle. We study min max theory for area functional among hypersurfaces constrained in a smooth manifold with boundary. A Schoen Simon type regularity result is proved for integral varifolds which satisfy a variational inequality and restrict to a stable minimal hypersurface in the interior. Based on this, we show that for any admissible family of sweepouts Pi in a compact manifold with boundary, there always exists a closed C 1,1 hypersurface with codimension geq 7 singular set in the interior and having mean curvature pointing outward along boundary realizing the width textbf L ( Pi) .


Classification of Rank 6 Modular Categories with Galois Group langle (012)(345) rangle . Modular Tensor Categories (MTC's) arise in the study of certain condensed matter systems. There is an ongoing program to classify MTC's of low rank, up to modular data. We present an overview of the methods to classify modular tensor categories of low rank, applied to the specific case of a rank 6 category with Galois group langle(012)(345) rangle , and show that certain symmetries in this case imply nonunitarizable (hence, nonphysical) MTC's. We show that all the rank 6 MTC's with this Galois group have modular data conjugate to either the product of the semion category with (A 1, 5) frac 1 2 or a certain modular subcategory of mathcal C ( mathfrak so 5, 9, e j pi i 9 ) with gcd (18, j) 1 .


DeepAbstract Neural Network Abstraction for Accelerating Verification. While abstraction is a classic tool of verification to scale it up, it is not used very often for verifying neural networks. However, it can help with the still open task of scaling existing algorithms to state of the art network architectures. We introduce an abstraction framework applicable to fully connected feed forward neural networks based on clustering of neurons that behave similarly on some inputs. For the particular case of ReLU, we additionally provide error bounds incurred by the abstraction. We show how the abstraction reduces the size of the network, while preserving its accuracy, and how verification results on the abstract network can be transferred back to the original network.


Improving Multispectral Pedestrian Detection by Addressing Modality Imbalance Problems. Multispectral pedestrian detection is capable of adapting to insufficient illumination conditions by leveraging color thermal modalities. On the other hand, it is still lacking of in depth insights on how to fuse the two modalities effectively. Compared with traditional pedestrian detection, we find multispectral pedestrian detection suffers from modality imbalance problems which will hinder the optimization process of dual modality network and depress the performance of detector. Inspired by this observation, we propose Modality Balance Network (MBNet) which facilitates the optimization process in a much more flexible and balanced manner. Firstly, we design a novel Differential Modality Aware Fusion (DMAF) module to make the two modalities complement each other. Secondly, an illumination aware feature alignment module selects complementary features according to the illumination conditions and aligns the two modality features adaptively. Extensive experimental results demonstrate MBNet outperforms the state of the arts on both the challenging KAIST and CVC 14 multispectral pedestrian datasets in terms of the accuracy and the computational efficiency. Code is available at https github.com CalayZhou MBNet.


False positives using social cognitive mapping to identify childrens' peer groups. Children and adolescents interact in peer groups, which are known to influence a range of psychological and behavioral outcomes. In developmental psychology and related disciplines, social cognitive mapping (SCM), as implemented with the SCM 4.0 software, is the most commonly used method for identifying peer groups from peer report data. However, in a series of four studies, we demonstrate that SCM has an unacceptably high risk of false positives. Specifically, we show that SCM will identify peer groups even when applied to random data. We introduce backbone extraction and community detection as one promising alternative to SCM, and offer several recommendations for researchers seeking to identify peer groups from peer report data.


Visual Perception and Modelling in Unstructured Orchard for Apple Harvesting Robots. Vision perception and modelling are the essential tasks of robotic harvesting in the unstructured orchard. This paper develops a framework of visual perception and modelling for robotic harvesting of fruits in the orchard environments. The developed framework includes visual perception, scenarios mapping, and fruit modelling. The Visual perception module utilises a deep learning model to perform multi purpose visual perception task within the working scenarios The scenarios mapping module applies OctoMap to represent the multiple classes of objects or elements within the environment The fruit modelling module estimates the geometry property of objects and estimates the proper access pose of each fruit. The developed framework is implemented and evaluated in the apple orchards. The experiment results show that visual perception and modelling algorithm can accurately detect and localise the fruits, and modelling working scenarios in real orchard environments. The F 1 score and mean intersection of union of visual perception module on fruit detection and segmentation are 0.833 and 0.852, respectively. The accuracy of the fruit modelling in terms of centre localisation and pose estimation are 0.955 and 0.923, respectively. Overall, an accurate visual perception and modelling algorithm are presented in this paper.


Tvarak Software managed hardware offload for DAX NVM storage redundancy. Tvarak efficiently implements system level redundancy for direct access (DAX) NVM storage. Production storage systems complement device level ECC (which covers media errors) with system checksums and cross device parity. This system level redundancy enables detection of and recovery from data corruption due to device firmware bugs (e.g., reading data from the wrong physical location). Direct access to NVM penalizes software only implementations of system level redundancy, forcing a choice between lack of data protection or significant performance penalties. Offloading the update and verification of system level redundancy to Tvarak, a hardware controller co located with the last level cache, enables efficient protection of data from such bugs in memory controller and NVM DIMM firmware. Simulation based evaluation with seven data intensive applications shows Tvarak's performance and energy efficiency. For example, Tvarak reduces Redis set only performance by only 3 , compared to 50 reduction for a state of the art software only approach.


SpotFast Networks with Memory Augmented Lateral Transformers for Lipreading. This paper presents a novel deep learning architecture for word level lipreading. Previous works suggest a potential for incorporating a pretrained deep 3D Convolutional Neural Networks as a front end feature extractor. We introduce a SpotFast networks, a variant of the state of the art SlowFast networks for action recognition, which utilizes a temporal window as a spot pathway and all frames as a fast pathway. We further incorporate memory augmented lateral transformers to learn sequential features for classification. We evaluate the proposed model on the LRW dataset. The experiments show that our proposed model outperforms various state of the art models and incorporating the memory augmented lateral transformers makes a 3.7 improvement to the SpotFast networks.


Language (Re)modelling Towards Embodied Language Understanding. While natural language understanding (NLU) is advancing rapidly, today's technology differs from human like language understanding in fundamental ways, notably in its inferior efficiency, interpretability, and generalization. This work proposes an approach to representation and learning based on the tenets of embodied cognitive linguistics (ECL). According to ECL, natural language is inherently executable (like programming languages), driven by mental simulation and metaphoric mappings over hierarchical compositions of structures and schemata learned through embodied interaction. This position paper argues that the use of grounding by metaphoric inference and simulation will greatly benefit NLU systems, and proposes a system architecture along with a roadmap towards realizing this vision.


Value assigned pulse shape discrimination for neutron detectors. Using the waveforms from a digital electronic system, an offline analysis technique on pulse shape discrimination (PSD) has been developed to improve the neutron gamma separation in a bar shaped NE 213 scintillator that couples to a photomultiplier tube (PMT) at each end. The new improved method, called the valued assigned PSD'' (VPSD), assigns a normalized fitting residual to every waveform as the PSD value. This procedure then facilitates the incorporation of longitudinal position dependence of the scintillator, which further enhances the PSD capability of the detector system. In this paper, we use radiation emitted from an AmBe neutron source to demonstrate that the resulting neutron gamma identification has been much improved when compared to the traditional technique that uses the geometric mean of light outputs from both PMTs. The new method has also been modified and applied to a recent experiment at the National Superconducting Cyclotron Laboratory (NSCL) that uses an analog electronic system.


Small but Mighty New Benchmarks for Split and Rephrase. Split and Rephrase is a text simplification task of rewriting a complex sentence into simpler ones. As a relatively new task, it is paramount to ensure the soundness of its evaluation benchmark and metric. We find that the widely used benchmark dataset universally contains easily exploitable syntactic cues caused by its automatic generation process. Taking advantage of such cues, we show that even a simple rule based model can perform on par with the state of the art model. To remedy such limitations, we collect and release two crowdsourced benchmark datasets. We not only make sure that they contain significantly more diverse syntax, but also carefully control for their quality according to a well defined set of criteria. While no satisfactory automatic metric exists, we apply fine grained manual evaluation based on these criteria using crowdsourcing, showing that our datasets better represent the task and are significantly more challenging for the models.


On the Integrality Gap of Binary Integer Programs with Gaussian Data. For a binary integer program (IP) rm max c mathsf T x, Ax leq b, x in 0,1 n , where A in mathbb R m times n and c in mathbb R n have independent Gaussian entries and the right hand side b in mathbb R m satisfies that its negative coordinates have ell 2 norm at most n 10 , we prove that the gap between the value of the linear programming relaxation and the IP is upper bounded by operatorname poly (m)( log n) 2 n with probability at least 1 2 n 7 2 operatorname poly (m) . Our results give a Gaussian analogue of the classical integrality gap result of Dyer and Frieze (Math. of O.R., 1989) in the case of random packing IPs. In constrast to the packing case, our integrality gap depends only polynomially on m instead of exponentially. Building upon recent breakthrough work of Dey, Dubey and Molinaro (SODA, 2021), we show that the integrality gap implies that branch and bound requires n operatorname poly (m) time on random Gaussian IPs with good probability, which is polynomial when the number of constraints m is fixed. We derive this result via a novel meta theorem, which relates the size of branch and bound trees and the integrality gap for random logconcave IPs.


Surreal numbers, exponentiation and derivations. We give a presentation of Conway's surreal numbers focusing on the connections with transseries and Hardy fields and trying to simplify when possible the existing treatments.


Synthesizing the Unseen for Zero shot Object Detection. The existing zero shot detection approaches project visual features to the semantic domain for seen objects, hoping to map unseen objects to their corresponding semantics during inference. However, since the unseen objects are never visualized during training, the detection model is skewed towards seen content, thereby labeling unseen as background or a seen class. In this work, we propose to synthesize visual features for unseen classes, so that the model learns both seen and unseen objects in the visual domain. Consequently, the major challenge becomes, how to accurately synthesize unseen objects merely using their class semantics? Towards this ambitious goal, we propose a novel generative model that uses class semantics to not only generate the features but also to discriminatively separate them. Further, using a unified model, we ensure the synthesized features have high diversity that represents the intra class differences and variable localization precision in the detected bounding boxes. We test our approach on three object detection benchmarks, PASCAL VOC, MSCOCO, and ILSVRC detection, under both conventional and generalized settings, showing impressive gains over the state of the art methods. Our codes are available at https github.com nasir6 zero shot detection.


Accurate and Scalable Matching of Translators to Displaced Persons for Overcoming Language Barriers. Residents of developing countries are disproportionately susceptible to displacement as a result of humanitarian crises. During such crises, language barriers impede aid workers in providing services to those displaced. To build resilience, such services must be flexible and robust to a host of possible languages. textit Tarjimly aims to overcome the barriers by providing a platform capable of matching bilingual volunteers to displaced persons or aid workers in need of translating. However, Tarjimly's large pool of translators comes with the challenge of selecting the right translator per request. In this paper, we describe a machine learning system that matches translator requests to volunteers at scale. We demonstrate that a simple logistic regression, operating on easily computable features, can accurately predict and rank translator response. In deployment, this lightweight system matches 82 of requests with a median response time of 59 seconds, allowing aid workers to accelerate their services supporting displaced persons.


Food Recommendation Framework, Existing Solutions and Challenges. A growing proportion of the global population is becoming overweight or obese, leading to various diseases (e.g., diabetes, ischemic heart disease and even cancer) due to unhealthy eating patterns, such as increased intake of food with high energy and high fat. Food recommendation is of paramount importance to alleviate this problem. Unfortunately, modern multimedia research has enhanced the performance and experience of multimedia recommendation in many fields such as movies and POI, yet largely lags in the food domain. This article proposes a unified framework for food recommendation, and identifies main issues affecting food recommendation including building the personal model, analyzing unique food characteristics, incorporating various context and domain knowledge. We then review existing solutions for these issues, and finally elaborate research challenges and future directions in this field. To our knowledge, this is the first survey that targets the study of food recommendation in the multimedia field and offers a collection of research studies and technologies to benefit researchers in this field.


Transformation optics based on metasurfaces. Recently, new artificial material has been proposed to control an electromagnetic wave metasurface, a two dimensional metamaterial. Compared with a three dimensional bulky metamaterial, this artificial plane material with sub wavelength thickness greatly reduces fabrication time and mitigates fabrication complexity. Additionally, traditional metamaterials usually control the wavefront of an electromagnetic wave by accumulating the phase through propagating at a distance far larger than the wavelength. However, a metasurface can efficiently manipulate the wavefront of an incident electromagnetic wave through just the subwavelength propagation distance. Therefore, this can largely alleviate the propagation loss. Given the fact that a metasurface has high manipulation efficiency for an electromagnetic wave in the near filed regime, our group investigated experimental work on the analogy of gravity using a metasurface.


The Effect of Social Information in the Dictator Game with a Taking Option. We experimentally study how redistribution choices are affected by positive and negative information regarding the behaviour of a previous participant in a dictator game with a taking option. We use the strategy method to identify behavioural "types", and thus distinguish "conformists" from "counter conformists", and unconditional choosers. Unconditional choosers make up the greatest proportion of types (about 80 ) while only about 20 of subjects condition their responses to social information. We find that both conformity and counter conformity are driven by a desire to be seen as moral (the "symbolization" dimension of moral identity). The main difference is that, conformity is also driven by a sensitivity to what others think ("attention to social comparison"). Unconditional giving (about 30 of players) on the other hand is mainly driven by the centrality of moral identity to the self (the "internalization" dimension of moral identity). Social information thus seems to mainly affect those who care about being seen to be moral. The direction of effect however depends on how sensitive one is to what others think.


Generating Knowledge Graphs by Employing Natural Language Processing and Machine Learning Techniques within the Scholarly Domain. The continuous growth of scientific literature brings innovations and, at the same time, raises new challenges. One of them is related to the fact that its analysis has become difficult due to the high volume of published papers for which manual effort for annotations and management is required. Novel technological infrastructures are needed to help researchers, research policy makers, and companies to time efficiently browse, analyse, and forecast scientific research. Knowledge graphs i.e., large networks of entities and relationships, have proved to be effective solution in this space. Scientific knowledge graphs focus on the scholarly domain and typically contain metadata describing research publications such as authors, venues, organizations, research topics, and citations. However, the current generation of knowledge graphs lacks of an explicit representation of the knowledge presented in the research papers. As such, in this paper, we present a new architecture that takes advantage of Natural Language Processing and Machine Learning methods for extracting entities and relationships from research publications and integrates them in a large scale knowledge graph. Within this research work, we i) tackle the challenge of knowledge extraction by employing several state of the art Natural Language Processing and Text Mining tools, ii) describe an approach for integrating entities and relationships generated by these tools, iii) show the advantage of such an hybrid system over alternative approaches, and vi) as a chosen use case, we generated a scientific knowledge graph including 109,105 triples, extracted from 26,827 abstracts of papers within the Semantic Web domain. As our approach is general and can be applied to any domain, we expect that it can facilitate the management, analysis, dissemination, and processing of scientific knowledge.


A locality based approach for coded computation. Modern distributed computation infrastructures are often plagued by unavailabilities such as failing or slow servers. These unavailabilities adversely affect the tail latency of computation in distributed infrastructures. The simple solution of replicating computation entails significant resource overhead. Coded computation has emerged as a resource efficient alternative, wherein multiple units of data are encoded to create parity units and the function to be computed is applied to each of these units on distinct servers. A decoder can use the available function outputs to decode the unavailable ones. Existing coded computation approaches are resource efficient only for simple variants of linear functions such as multilinear, with even the class of low degree polynomials requiring the same multiplicative overhead as replication for practically relevant straggler tolerance. In this paper, we present a new approach to model coded computation via the lens of locality of codes. We introduce a generalized notion of locality, denoted computational locality, building upon the locality of an appropriately defined code. We show that computational locality is equivalent to the required number of workers for coded computation and leverage results from the well studied locality of codes to design coded computation schemes. We show that recent results on coded computation of multivariate polynomials can be derived using local recovering schemes for Reed Muller codes. We present coded computation schemes for multivariate polynomials that adaptively exploit locality properties of input data an inadmissible technique under existing frameworks. These schemes require fewer workers than the lower bound under existing coded computation frameworks, showing that the existing multiplicative overhead on the number of servers is not fundamental for coded computation of nonlinear functions.


Systemic Risk in Financial Networks A Survey. We provide an overview of the relationship between financial networks and systemic risk. We present a taxonomy of different types of systemic risk, differentiating between direct externalities between financial organizations (e.g., defaults, correlated portfolios and firesales), and perceptions and feedback effects (e.g., bank runs, credit freezes). We also discuss optimal regulation and bailouts, measurements of systemic risk and financial centrality, choices by banks' regarding their portfolios and partnerships, and the changing nature of financial networks.


Learning nonlocal constitutive models with neural networks. Constitutive and closure models play important roles in computational mechanics and computational physics in general. Classical constitutive models for solid and fluid materials are typically local, algebraic equations or flow rules describing the dependence of stress on the local strain and or strain rate. Closure models such as those describing Reynolds stress in turbulent flows and laminar turbulent transition can involve transport PDEs (partial differential equations). Such models play similar roles to constitutive relation, but they are often more challenging to develop and calibrate as they describe nonlocal mappings and often contain many submodels. Inspired by the structure of the exact solutions to linear transport PDEs, we propose a neural network representing a region to point mapping to describe such nonlocal constitutive models. The range of nonlocal dependence and the convolution structure are derived from the formal solution to transport equations. The neural network based nonlocal constitutive model is trained with data. Numerical experiments demonstrate the predictive capability of the proposed method. Moreover, the proposed network learned the embedded submodel without using data from that level, thanks to its interpretable mathematical structure, which makes it a promising alternative to traditional nonlocal constitutive models.


Exploring the SARS CoV 2 virus host drug interactome for drug repurposing. Coronavirus Disease 2019 (COVID 19) is an infectious disease caused by the SARS CoV 2 virus. It was first identified in Wuhan, China, and has since spread causing a global pandemic. Various studies have been performed to understand the molecular mechanisms of viral infection for predicting drug repurposing candidates. However, such information is spread across many publications and it is very time consuming to access, integrate, explore, and exploit. We developed CoVex, the first interactive online platform for SARS CoV 2 and SARS CoV 1 host interactome exploration and drug (target) identification. CoVex integrates 1) experimentally validated virus human protein interactions, 2) human protein protein interactions and 3) drug target interactions. The web interface allows user friendly visual exploration of the virus host interactome and implements systems medicine algorithms for network based prediction of drugs. Thus, CoVex is an important resource, not only to understand the molecular mechanisms involved in SARS CoV 2 and SARS CoV 1 pathogenicity, but also in clinical research for the identification and prioritization of candidate therapeutics. We apply CoVex to investigate recent hypotheses on a systems biology level and to systematically explore the molecular mechanisms driving the virus life cycle. Furthermore, we extract and discuss drug repurposing candidates involved in these mechanisms. CoVex renders COVID 19 drug research systems medicine ready by giving the scientific community direct access to network medicine algorithms integrating virus host drug interactions. It is available at https exbio.wzw.tum.de covex .


Inverting Spectrogram Measurements via Aliased Wigner Distribution Deconvolution and Angular Synchronization. We propose a two step approach for reconstructing a signal bf x in mathbb C d from subsampled short time Fourier transform magnitude (spectogram) measurements First, we use an aliased Wigner distribution deconvolution approach to solve for a portion of the rank one matrix bf widehat bf x bf widehat bf x . Second, we use angular syncrhonization to solve for bf widehat bf x (and then for bf x by Fourier inversion). Using this method, we produce two new efficient phase retrieval algorithms that perform well numerically in comparison to standard approaches and also prove two theorems, one which guarantees the recovery of discrete, bandlimited signals bf x in mathbb C d from fewer than d STFT magnitude measurements and another which establishes a new class of deterministic coded diffraction pattern measurements which are guaranteed to allow efficient and noise robust recovery.


AdaCos Adaptively Scaling Cosine Logits for Effectively Learning Deep Face Representations. The cosine based softmax losses and their variants achieve great success in deep learning based face recognition. However, hyperparameter settings in these losses have significant influences on the optimization path as well as the final recognition performance. Manually tuning those hyperparameters heavily relies on user experience and requires many training tricks. In this paper, we investigate in depth the effects of two important hyperparameters of cosine based softmax losses, the scale parameter and angular margin parameter, by analyzing how they modulate the predicted classification probability. Based on these analysis, we propose a novel cosine based softmax loss, AdaCos, which is hyperparameter free and leverages an adaptive scale parameter to automatically strengthen the training supervisions during the training process. We apply the proposed AdaCos loss to large scale face verification and identification datasets, including LFW, MegaFace, and IJB C 1 1 Verification. Our results show that training deep neural networks with the AdaCos loss is stable and able to achieve high face recognition accuracy. Our method outperforms state of the art softmax losses on all the three datasets.


Which Factors Impact Engagement on News Articles on Facebook?. Social media is increasingly being used as a news platform. To reach their intended audience, newspapers need for their articles to be well ranked by Facebook's news feed algorithm. The number of likes, shares and other reactions determine the lead scoring criteria. This paper will try to assess how the reaction volume is impacted by the following criteria (1) Delay between event and post release (2) Time of the day the post is published and (3) Post format video, photo or text. To isolate the effect of the publication time and post format on a post, we need to control for the news event and the publishing newspaper. For that end, a news aggregator is designed and implemented, to group together posts that relate to the same news event. This tool gave some spin off results, allowing the ability to map newspapers by similarity and to detect some topic omissions.


Exact spatial and temporal balance of energy exchanges within a horizontally explicit vertically implicit non hydrostatic atmosphere. A new horizontally explicit vertically implicit (HEVI) time splitting scheme for atmospheric modelling is introduced, for which the horizontal divergence terms are applied within the implicit vertical substep. The new HEVI scheme is implemented in conjunction with a mixed mimetic spectral element spatial discretisation and semi implicit vertical time stepping scheme that both preserve the skew symmetric structure of the non canonical Hamiltonian form of the equations of motion. Within this context the new HEVI scheme allows for the exact balance of all energetic exchanges in space and time. However since the choice of horizontal fluxes for which this balance is satisfied is not consistent with the horizontal velocity at the end of the time level the scheme still admits a temporal energy conservation error. Linearised eigenvalue analysis shows that similar to a fully implicit method, the new HEVI scheme is neutrally stable for all buoyancy modes, and unlike a second order trapezoidal HEVI scheme is stable for all acoustic modes below a certain horizontal CFL number. The scheme is validated against standard test cases for both planetary and nonhydrostatic regimes. For the planetary scale baroclinic instability test case, the new formulation exhibits a secondary oscillation in the potential to kinetic energy power exchanges, with a temporal frequency approximately four times that exhibited by a horizontally third order, vertically second order trapezoidal scheme. For the nonhydrostatic test case, the vertical upwinding of the potential temperature diagnostic equation is shown to reduce spurious oscillations without altering the energetics of the solution, since this upwinding is performed in an energetically consistent manner. For this test case, which is configured on an affine geometry, the exact balance of energy exchanges allows the model to run stably without any form of dissipation.


REA, Triple Entry Accounting and Blockchain Converging Paths to Shared Ledger Systems. The concept of shared ledger systems offering a single source of truth has repeatedly called traditional bookkeeping into question. Improving upon the long standing double entry system, solutions such as the Resource Event Agent (REA) accounting framework, triple entry accounting (TEA) and blockchain have been advanced. However, to date, the historical development of these concepts remains murky. This paper conducts a genealogical analysis of shared ledger systems, in particular tracing the development of REA, TEA and blockchain. We show how the REA framework has had a distinct influence on independent streams of research in the field of TEA, and how this interaction may be traced to the present incarnation of shared ledger systems in blockchain. In doing so, we duly acknowledge the influence of key individuals contributing to this development, correct common misconceptions and map out how the paths of REA, TEA and blockchain overlap in the realm of shared ledger systems.


The Second Type of Uncertainty in Monte Carlo Tree Search. Monte Carlo Tree Search (MCTS) efficiently balances exploration and exploitation in tree search based on count derived uncertainty. However, these local visit counts ignore a second type of uncertainty induced by the size of the subtree below an action. We first show how, due to the lack of this second uncertainty type, MCTS may completely fail in well known sparse exploration problems, known from the reinforcement learning community. We then introduce a new algorithm, which estimates the size of the subtree below an action, and leverages this information in the UCB formula to better direct exploration. Subsequently, we generalize these ideas by showing that loops, i.e., the repeated occurrence of (approximately) the same state in the same trace, are actually a special case of subtree depth variation. Testing on a variety of tasks shows that our algorithms increase sample efficiency, especially when the planning budget per timestep is small.


Time Series Domain Adaptation via Sparse Associative Structure Alignment. Domain adaptation on time series data is an important but challenging task. Most of the existing works in this area are based on the learning of the domain invariant representation of the data with the help of restrictions like MMD. However, such extraction of the domain invariant representation is a non trivial task for time series data, due to the complex dependence among the timestamps. In detail, in the fully dependent time series, a small change of the time lags or the offsets may lead to difficulty in the domain invariant extraction. Fortunately, the stability of the causality inspired us to explore the domain invariant structure of the data. To reduce the difficulty in the discovery of causal structure, we relax it to the sparse associative structure and propose a novel sparse associative structure alignment model for domain adaptation. First, we generate the segment set to exclude the obstacle of offsets. Second, the intra variables and inter variables sparse attention mechanisms are devised to extract associative structure time series data with considering time lags. Finally, the associative structure alignment is used to guide the transfer of knowledge from the source domain to the target one. Experimental studies not only verify the good performance of our methods on three real world datasets but also provide some insightful discoveries on the transferred knowledge.


A Strategic Cyber Crime and Security Awareness Information System using a Dedicated Portal. A real time portal (www.ganamoscybersecure.org) to enlighten people on how to protect their data in the web, the strategies adopted by cyber criminals to succeed in exploiting their victims as well as the mistakes made by people and organizations that make them prone to the menace of cyber crime has been designed in this paper. Critical observations were made over time on the degree of awareness and attitudes of people and organizations in some parts of South Africa and Nigeria towards information security. Interviews were conducted using structured questionnaire to elicit information. The outcome showed that most individuals and organizations lack adequate awareness on strategies adopted by cyber criminals, and pay little attention to securing their online data. The application of the services provided by the portal designed would be a sine qua non for contending with the menace of cyber crime.act


Precise high moment asymptotics for parabolic Anderson model with log correlated Gaussian field. In this paper, we consider the continuous parabolic Anderson model (PAM) driven by a time independent log correlated Gaussian field (LGF). We obtain an asymptotic result of mathbb E exp Bigg frac 1 2 sum limits j,k 1 N int 0 t int 0 t gamma(B j(s) B k(r))drds Bigg qquad(N rightarrow infty) which is composed of the independent Brownian motions B j(s) and the function gamma approximating to a logarithmic potential at 0 , such as the covariances of massive free field and Bessel field. Based on the asymptotic result, we get the precise high moment asymptotics for Feynman Kac formula of the PAM with LGF.


Persistently foliar composite knots. A knot kappa in S 3 is persistently foliar if, for each non trivial boundary slope, there is a co oriented taut foliation meeting the boundary of the knot complement transversely in a foliation by curves of that slope. For rational slopes, these foliations may be capped off by disks to obtain a co oriented taut foliation in every manifold obtained by non trivial Dehn surgery on that knot. We show that any composite knot with a persistently foliar summand is persistently foliar and that any nontrivial connected sum of fibered knots is persistently foliar. As an application, it follows that any composite knot in which each of two summands is fibered or at least one summand is nontorus alternating or Montesinos is persistently foliar. We note that, in constructing foliations in the complements of fibered summands, we build branched surfaces whose complementary regions agree with those of Gabai's product disk decompositions, except for the one containing the boundary of the knot complement. It is this boundary region which provides for persistence.


Analysis and optimal control of a malaria mathematical model under resistance and population movement. In this work, two mathematical models for malaria under resistance are presented. More precisely, the first model shows the interaction between humans and mosquitoes inside a patch under infection of malaria when the human population is resistant to antimalarial drug and mosquitoes population is resistant to insecticides. For the second model, human mosquitoes population movements in two patches is analyzed under the same malaria transmission dynamic established in one patch. For a single patch, existence and stability conditions for the equilibrium solutions in terms of the local basic reproductive number are developed. These results reveal the existence of a forward bifurcation and the global stability of disease free equilibrium. In the case of two patches, a theoretical and numerical framework on sensitivity analysis of parameters is presented. After that, the use of antimalarial drugs and insecticides are incorporated as control strategies and an optimal control problem is formulated. Numerical experiments are carried out in both models to show the feasibility of our theoretical results.


Characterization of 4 critical triangle free toroidal graphs. We give an exact characterization of 3 colorability of triangle free graphs drawn in the torus, in the form of 186 "templates" (graphs with certain faces filled by arbitrary quadrangulations) such that a graph from this class is not 3 colorable if and only if it contains a subgraph matching one of the templates. As a consequence, we show every triangle free graph drawn in the torus with edge width at least six is 3 colorable, a key property used in an efficient 3 colorability algorithm for triangle free toroidal graphs.


Insights from the Future for Continual Learning. Continual learning aims to learn tasks sequentially, with (often severe) constraints on the storage of old learning samples, without suffering from catastrophic forgetting. In this work, we propose prescient continual learning, a novel experimental setting, to incorporate existing information about the classes, prior to any training data. Usually, each task in a traditional continual learning setting evaluates the model on present and past classes, the latter with a limited number of training samples. Our setting adds future classes, with no training samples at all. We introduce Ghost Model, a representation learning based model for continual learning using ideas from zero shot learning. A generative model of the representation space in concert with a careful adjustment of the losses allows us to exploit insights from future classes to constraint the spatial arrangement of the past and current classes. Quantitative results on the AwA2 and aP Y datasets and detailed visualizations showcase the interest of this new setting and the method we propose to address it.


Excluded minors for the Klein Bottle I. Low connectivity case. Graphs that are critical (minimal excluded minors) for embeddability in surfaces are studied. In Part I we consider the structure of graphs with a 2 vertex cut that are critical with respect to the Euler genus. A general theorem describing the building blocks is presented. These constituents, called hoppers and cascades, are classified for the case when Euler genus is small. As a consequence, the complete list of obstructions of connectivity 2 for embedding graphs into the Klein bottle is obtained. This is the first complete result about obstructions for embeddability of graphs in the Klein bottle, and the outcome is somewhat surprising in the sense that there are considerably fewer excluded minors than expected.


Optimal Trajectory Planning for Flexible Robots with Large Deformation. Robot arms with lighter weight can reduce unnecessary energy consumption which is desirable in robotic industry. However, lightweight arms undergo undesirable elastic deformation. In this paper, the planar motion of a lightweight flexible arm is investigated. In order to obtain a precise mathematical model, the axial displacement and nonlinear curvature of flexible arm arising from large bending deformation is taken into consideration. An in extensional condition, the axial displacement is related to transverse displacement of the flexible beam, is applied. This leads to a robotic model with three rigid modes and one elastic mode. The elastic mode depends on time and position. An Assume Mode Method is used to remove the spatial dependence. The governing equations is derived using Lagrange Method. The effects of nonlinear terms due to the large deformation, gravity, and tip mass are considered. Control inputs include forces and moment exerted at the joint between slider and arm (see Fig. 1). The conventional computed torque control laws cannot stabilize the system, since there are not as many control inputs as states of the system. A Particle Swarm Optimization (PSO) technique is then used to obtain a suitable trajectory with the aim of minimizing excitations of the elastic mode. Two methods are considered for generating a trajectory function, either to use a three layer Artificial Neural Network (ANN) or to use spline interpolation. A sliding mode control strategy is proposed in which the sliding surfaces include elastic mode in order to guarantee robustness. The simulations show that the three layer ANN technique provides arbitrary small settling time, and also the optimization algorithm converges faster and generates smooth trajectories unlike spline function technique.


A compact sequence encoding scheme for online human activity recognition in HRI applications. Human activity recognition and analysis has always been one of the most active areas of pattern recognition and machine intelligence, with applications in various fields, including but not limited to exertion games, surveillance, sports analytics and healthcare. Especially in Human Robot Interaction, human activity understanding plays a crucial role as household robotic assistants are a trend of the near future. However, state of the art infrastructures that can support complex machine intelligence tasks are not always available, and may not be for the average consumer, as robotic hardware is expensive. In this paper we propose a novel action sequence encoding scheme which efficiently transforms spatio temporal action sequences into compact representations, using Mahalanobis distance based shape features and the Radon transform. This representation can be used as input for a lightweight convolutional neural network. Experiments show that the proposed pipeline, when based on state of the art human pose estimation techniques, can provide a robust end to end online action recognition scheme, deployable on hardware lacking extreme computing capabilities.


On the exceptional sets of integral quadratic forms. A collection mathcal S of equivalence classes of positive definite integral quadratic forms in n variables is called an n exceptional set if there exists a positive definite integral quadratic form which represents all equivalence classes of positive definite integral quadratic forms in n variables except those in mathcal S . We show that, among other results, for any given positive integers m and n , there is always an n exceptional set of size m and there are only finitely many of them.


Learning to Navigate from Simulation via Spatial and Semantic Information Synthesis with Noise Model Embedding. While training an end to end navigation network in the real world is usually of high cost, simulation provides a safe and cheap environment in this training stage. However, training neural network models in simulation brings up the problem of how to effectively transfer the model from simulation to the real world (sim to real). In this work, we regard the environment representation as a crucial element in this transfer process and propose a visual information pyramid (VIP) model to systematically investigate a practical environment representation. A novel representation composed of spatial and semantic information synthesis is then established accordingly, where noise model embedding is particularly considered. To explore the effectiveness of this representation, we compared the performance with representations popularly used in the literature in both simulated and real world scenarios. Results suggest that our environment representation stands out. Furthermore, an analysis on the feature map is implemented to investigate the effectiveness through inner reaction, which could be irradiative for future researches on end to end navigation.


Compartmental model with loss of immunity analysis and parameters estimation for Covid 19. The outbreak of Covid 19 led the world to an unprecedent health and economical crisis. In an attempt to responde to this emergency researchers worldwide are intensively studying the Covid 19 pandemic dynamics. In this work, a SIRSi compartmental model is proposed, which is a modification of the known classical SIR model. The proposed SIRSi model considers differences in the immunization within a population, and the possibility of unreported or asymptomatic cases. The model is adjusted to three major cities of S ao Paulo State, in Brazil, namely, S ao Paulo, Santos and Campinas, providing estimates on the duration and peaks of the outbreak.


Distribution of laser shot noise energy delivered to a levitated nanoparticle. This paper quantifies the rate at which laser shot noise energy is delivered to a nanoparticle for the various scenarios commonly encountered in levitated optomechanics. While previous articles have the same form and dependencies, the proportionality constants often differ in the literature. This paper resolves these discrepancies. The rate at which energy is delivered to an optically trapped particle's respective degrees of freedom depends on the radiation pattern of scattered light as well as the direction of laser propagation. For a traveling plane wave with linearly polarized light, in the Rayleigh regime this leads the translational shot noise heating rate to be proportional to 1 10 of the total rate in the laser polarization direction, 7 10 in the laser propagation direction, and 2 10 in the direction perpendicular to both. Analytical expressions for the shot noise heating rate are provided in the Rayleigh limit as well as numerical calculations for particles in the Mie regime for silica and diamond. For completeness, numerical calculations of the shot noise heating for silica Mie particles at the focus of a strongly focused laser beam are calculated for varying numerical aperture and common laser wavelengths. Both numerical calculations show that the Rayleigh expression generally gives an overestimate of the shot noise heating especially for larger radii, but is still a good approximation even for incident focal fields. The exception to the relative decrease is when a Mie resonance is reached which was found for diamond. Lastly, Rayleigh expressions for the rotational shot noise heating for a symmetric top like particle for linear, elliptically, and unpolarized light are also provided.


Instability threshold in a large balanced magneto optical trap. Large clouds of cold atoms prepared in a magneto optical trap can develop spatio temporal instabilities when the frequency of the trapping lasers is brought close to the atomic resonance. This system bears close similarities with trapped plasmas, whereby effective Coulomb interactions are induced by the exchange of scattered photons and lead to collective nonlinear dynamics of the trapped atoms. We report in this paper a detailed experimental study of the instability threshold, and comparisons with three dimensional simulations of the interacting, laser driven cloud.


Twisting of affine algebraic groups, II. We use cite G to study the algebra structure of twisted cotriangular Hopf algebras J mathcal O (G) J , where J is a Hopf 2 cocycle for a connected nilpotent algebraic group G over mathbb C . In particular, we show that J mathcal O (G) J is an affine Noetherian domain with Gelfand Kirillov dimension dim(G) , and that if G is unipotent and J is supported on G , then J mathcal O (G) J cong U( g) as algebras, where g rm Lie (G) . We also determine the finite dimensional irreducible representations of J mathcal O (G) J , by analyzing twisted function algebras on (H,H) double cosets of the support H subset G of J . Finally, we work out several examples to illustrate our results.


Bayesian Verification of Chemical Reaction Networks. We present a data driven verification approach that determines whether or not a given chemical reaction network (CRN) satisfies a given property, expressed as a formula in a modal logic. Our approach consists of three phases, integrating formal verification over models with learning from data. First, we consider a parametric set of possible models based on a known stoichiometry and classify them against the property of interest. Secondly, we utilise Bayesian inference to update a probability distribution of the parameters within a parametric model with data gathered from the underlying CRN. In the third and final stage, we combine the results of both steps to compute the probability that the underlying CRN satisfies the given property. We apply the new approach to a case study and compare it to Bayesian statistical model checking.


Generalized zeta integrals on certain real prehomogeneous vector spaces. Let X be a real prehomogeneous vector space under a reductive group G , such that X is an absolutely spherical G variety with affine open orbit. We define local zeta integrals that involve the integration of Schwartz Bruhat functions on X against generalized matrix coefficients of admissible representations of G( mathbb R ) , twisted by complex powers of relative invariants. We establish the convergence of these integrals in some range, the meromorphic continuation as well as a functional equation in terms of abstract gamma factors. This subsumes the Archimedean zeta integrals of Godement Jacquet, those of Sato Shintani (in the spherical case), and the previous works of Bopp Rubenthaler. The proof of functional equations is based on Knop's results on Capelli operators.


Perspective Taking in Deep Reinforcement Learning Agents. Perspective taking is the ability to take the point of view of another agent. This skill is not unique to humans as it is also displayed by other animals like chimpanzees. It is an essential ability for social interactions, including efficient cooperation, competition, and communication. Here we present our progress toward building artificial agents with such abilities. We implemented a perspective taking task inspired by experiments done with chimpanzees. We show that agents controlled by artificial neural networks can learn via reinforcement learning to pass simple tests that require perspective taking capabilities. We studied whether this ability is more readily learned by agents with information encoded in allocentric or egocentric form for both their visual perception and motor actions. We believe that, in the long run, building better artificial agents with perspective taking ability can help us develop artificial intelligence that is more human like and easier to communicate with.


An extension of the Siegel Walfisz theorem. We extend the Siegel Walfisz theorem to a family of integer sequences that are characterized by constraints on the size of the prime factors. Besides prime powers, this family includes smooth numbers, almost primes and practical numbers.


Stable and efficient Petrov Galerkin methods for a kinetic Fokker Planck equation. We propose a stable Petrov Galerkin discretization of a kinetic Fokker Planck equation constructed in such a way that uniform inf sup stability can be inferred directly from the variational formulation. Inspired by well posedness results for parabolic equations, we derive a lower bound for the dual inf sup constant of the Fokker Planck bilinear form by means of stable pairs of trial and test functions. The trial function of such a pair is constructed by applying the kinetic transport operator and the inverse velocity Laplace Beltrami operator to a given test function. For the Petrov Galerkin projection we choose an arbitrary discrete test space and then define the discrete trial space using the same application of transport and inverse Laplace Beltrami operator. As a result, the spaces replicate the stable pairs of the continuous level and we obtain a well posed numerical method with a discrete inf sup constant identical to the inf sup constant of the continuous problem independently of the mesh size. We show how the specific basis functions can be efficiently computed by low dimensional elliptic problems, and confirm the practicability and performance of the method with numerical experiments.


Development and Performance of a Sealed Liquid Xenon Time Projection Chamber. The liquid xenon (LXe) time projection chamber (TPC) technology is probing a wide range of dark matter masses from sub GeV to a few TeV. To further improve its sensitivity to sub GeV dark matter and its application in reactor neutrino monitoring via coherent elastic neutrino nucleus scattering (CEvNS), more understanding and suppression of single few electrons background rate are needed. Here we report on the design and performance of a sealed LXeTPC with a graphene coated fused silica window as the cathode. The purpose of the sealed TPC is for isolating the liquid xenon target volume from the majority of out gassing materials in the detector vessel, thus improving the liquid xenon purification efficiency and reducing the impurity induced single few electrons background. We investigated the out gassing rate and purification efficiency using the data from the sealed TPC with a simple purification model. The single electron signals from the photoionization of impurities in LXe are obtained and their correlation with the LXe purity is investigated. The photo electron emission rate on the graphene coated electrode is compared to that from stainless steel, the electrode material typically used in LXe detectors. We discuss the possible further improvement and potential applications of the sealed TPC for the next generation liquid xenon experiments for dark matter and neutrino physics.


Probabilistic Zero Forcing on Random Graphs. Zero forcing is a deterministic iterative graph coloring process in which vertices are colored either blue or white, and in every round, any blue vertices that have a single white neighbor force these white vertices to become blue. Here we study probabilistic zero forcing, where blue vertices have a non zero probability of forcing each white neighbor to become blue. We explore the propagation time for probabilistic zero forcing on the Erd H o s R 'eyni random graph Gnp when we start with a single vertex colored blue. We show that when p log o(1) n , then with high probability it takes (1 o(1)) log 2 log 2n rounds for all the vertices in Gnp to become blue, and when log n n ll p leq log O(1) n , then with high probability it takes Theta( log(1 p)) rounds.


Qatten A General Framework for Cooperative Multiagent Reinforcement Learning. In many real world tasks, multiple agents must learn to coordinate with each other given their private observations and limited communication ability. Deep multiagent reinforcement learning (Deep MARL) algorithms have shown superior performance in such challenging settings. One representative class of work is multiagent value decomposition, which decomposes the global shared multiagent Q value Q tot into individual Q values Q i to guide individuals' behaviors, i.e. VDN imposing an additive formation and QMIX adopting a monotonic assumption using an implicit mixing method. However, most of the previous efforts impose certain assumptions between Q tot and Q i and lack theoretical groundings. Besides, they do not explicitly consider the agent level impact of individuals to the whole system when transforming individual Q i s into Q tot . In this paper, we theoretically derive a general formula of Q tot in terms of Q i , based on which we can naturally implement a multi head attention formation to approximate Q tot , resulting in not only a refined representation of Q tot with an agent level attention mechanism, but also a tractable maximization algorithm of decentralized policies. Extensive experiments demonstrate that our method outperforms state of the art MARL methods on the widely adopted StarCraft benchmark across different scenarios, and attention analysis is further conducted with valuable insights.


A survey on Kornia an Open Source Differentiable Computer Vision Library for PyTorch. This work presents Kornia, an open source computer vision library built upon a set of differentiable routines and modules that aims to solve generic computer vision problems. The package uses PyTorch as its main backend, not only for efficiency but also to take advantage of the reverse auto differentiation engine to define and compute the gradient of complex functions. Inspired by OpenCV, Kornia is composed of a set of modules containing operators that can be integrated into neural networks to train models to perform a wide range of operations including image transformations,camera calibration, epipolar geometry, and low level image processing techniques, such as filtering and edge detection that operate directly on high dimensional tensor representations on graphical processing units, generating faster systems. Examples of classical vision problems implemented using our framework are provided including a benchmark comparing to existing vision libraries.


Folding Bilateral Backstepping Output Feedback Control Design For an Unstable Parabolic PDE. We present a novel methodology for designing output feedback backstepping boundary controllers for an unstable 1 D diffusion reaction partial differential equation with spatially varying reaction. Using "folding" transforms the parabolic PDE into a 2X2 coupled parabolic PDE system with coupling via folding boundary conditions. The folding approach is novel in the sense that the design of bilateral controllers can be generalized to centering around arbitrary points, which admit additional design parameters for both the state feedback controller and the state observer. The design can be selectively biased to achieve different performance indicies (e.g. energy, boundedness, etc). A first backstepping transformation is designed to map the unstable system into a strict feedback intermediate target system. A second backstepping transformation is designed to stabilize the intermediate target system. The invertibility of the two transformations guarantees that the derived state feedback controllers exponentially stabilize the trivial solution of the parabolic PDE system in the L 2 norm sense. A complementary state observer is likewise designed for the dual problem, where two collocated measurements are considered at an arbitrary point in the interior of the domain. The observer generates state estimates which converge to the true state exponentially fast in the L 2 sense. Finally, the output feedback control law is formulated by composing the state feedback controller with the state estimates from the observer, and the resulting dynamic feedback is shown to stabilize the trivial solution of the interconnected system in the L 2 norm sense. Some analysis on how the selection of these points affect the responses of the controller and observer are discussed, with simulations illustrating various choices of folding points and their effect on the stabilization.


The Polycentric Dynamics of Melbourne and Sydney Suburb attractiveness divides a city at the home ownership level. Urban dynamics in large metropolitan areas result from complex interactions across social, economic, and political factors, including population distribution, flows of wealth, and infrastructure requirements. We develop a Census calibrated model of urban dynamics for the Greater Sydney and Melbourne areas for 2011 and 2016, highlighting the evolution of population distributions and the housing market structure in these two cities in terms of their mortgage and rent distributions. We show that there is a tendency to homophily between renters and mortgage holders renters tend to cluster nearer commercial centres, whereas mortgagors tend to populate the outskirts of these centres. We also identify a critical threshold at which the long term evolution of these two cities will bifurcate between a sprawling' and a polycentric' configuration, showing that both cities lie on the polycentric side of the critical point in the long run. Importantly, there is a divergence of these centric tendencies between the renters and mortgage holders. The polycentric patterns characterising the mortgagors are focused around commercial centres, and we show that the emergent housing patterns follow the major transport routes through the cities.


Certain residual properties of generalized Baumslag Solitar groups. Let G be a generalized Baumslag Solitar group and mathcal C be a class of groups containing at least one non unit group and closed under taking subgroups, extensions, and Cartesian products of the form prod y in Y X y , where X, Y in mathcal C and X y is an isomorphic copy of X for every y in Y . We give a criterion for G to be residually a mathcal C group provided mathcal C consists only of periodic groups. We also prove that G is residually a torsion free mathcal C group if mathcal C contains at least one non periodic group and is closed under taking homomorphic images. These statements generalize and strengthen some known results. Using the first of them, we provide criteria for a GBS group to be a) residually nilpotent b) residually torsion free nilpotent c) residually free.


Uncertainty Aware Consistency Regularization for Cross Domain Semantic Segmentation. Unsupervised domain adaptation (UDA) aims to adapt existing models of the source domain to a new target domain with only unlabeled data. Most existing methods suffer from noticeable negative transfer resulting from either the error prone discriminator network or the unreasonable teacher model. Besides, the local regional consistency in UDA has been largely neglected, and only extracting the global level pattern information is not powerful enough for feature alignment due to the abuse use of contexts. To this end, we propose an uncertainty aware consistency regularization method for cross domain semantic segmentation. Firstly, we introduce an uncertainty guided consistency loss with a dynamic weighting scheme by exploiting the latent uncertainty information of the target samples. As such, more meaningful and reliable knowledge from the teacher model can be transferred to the student model. We further reveal the reason why the current consistency regularization is often unstable in minimizing the domain discrepancy. Besides, we design a ClassDrop mask generation algorithm to produce strong class wise perturbations. Guided by this mask, we propose a ClassOut strategy to realize effective regional consistency in a fine grained manner. Experiments demonstrate that our method outperforms the state of the art methods on four domain adaptation benchmarks, i.e., GTAV rightarrow Cityscapes and SYNTHIA rightarrow Cityscapes, Virtual KITTI rightarrow KITTI and Cityscapes rightarrow KITTI.


Transparency's Influence on Human Collective Interactions. Collective robotic systems are biologically inspired and advantageous due to their apparent global intelligence and emergent behaviors. Many applications can benefit from the incorporation of collectives, including environmental monitoring, disaster response missions, and infrastructure support. Transparency research has primarily focused on how the design of the models, visualizations, and control mechanisms influence human collective interactions. Traditionally most evaluations have focused only on one particular system design element, evaluating its respective transparency. This manuscript analyzed two models and visualizations to understand how the system design elements impacted human collective interactions, to quantify which model and visualization combination provided the best transparency, and provide design guidance, based on remote supervision of collectives. The consensus decision making and baseline models, as well as an individual agent and abstract visualizations, were analyzed for sequential best of n decision making tasks involving four collectives, composed of 200 entities each. Both models and visualizations provided transparency and influenced human collective interactions differently. No single combination provided the best transparency.


The calculation of the Mittag Leffler function. The problem of calculating the Mittag Leffler function E rho, mu (z) is considered in the paper. To solve this problem integral representations for the function E rho, mu (z) are transformed in such a way that they could not contain complex variables and parameters. Integral representations written in this form allow one to use standard methods of numerical integration to calculate integrals contained in them. To verify the correctness of the integral representations obtained the function E rho, mu (z) was calculated both with the use of obtained formulas and with the use of known representations of the Mittag Leffler function. The calculation results demonstrate their exact matching. This fact is indicative of the correctness of new integral representations of the function E rho, mu (z) that were obtained.


Sparse bounds on variational norms along monomial curves. Consider a monomial curve gamma mathbb R to mathbb R d and a family of truncated Hilbert transforms along gamma , mathcal H gamma . This paper addresses the possibility of the pointwise sparse domination of the r variation of mathcal H gamma namely, whether the following is true begin equation V r circ mathcal H gamma f(x) lesssim mathcal S f(x) end equation where f is a nonnegative measurable function, r 2 and mathcal S f(x) sum Q in mathcal Q langle f rangle Q,p chi Q (x) for some p and some sparse collection mathcal Q depending on f,p .


Multi Scale Networks for 3D Human Pose Estimation with Inference Stage Optimization. Estimating 3D human poses from a monocular video is still a challenging task. Many existing methods' performance drops when the target person is occluded by other objects, or the motion is too fast slow relative to the scale and speed of the training data. Moreover, many of these methods are not designed or trained under severe occlusion explicitly, making their performance on handling occlusion compromised. Addressing these problems, we introduce a spatio temporal network for robust 3D human pose estimation. As humans in videos may appear in different scales and have various motion speeds, we apply multi scale spatial features for 2D joints or keypoints prediction in each individual frame, and multi stride temporal convolutional networks (TCNs) to estimate 3D joints or keypoints. Furthermore, we design a spatio temporal discriminator based on body structures as well as limb motions to assess whether the predicted pose forms a valid pose and a valid movement. During training, we explicitly mask out some keypoints to simulate various occlusion cases, from minor to severe occlusion, so that our network can learn better and becomes robust to various degrees of occlusion. As there are limited 3D ground truth data, we further utilize 2D video data to inject a semi supervised learning capability to our network. Moreover, we observe that there is a discrepancy between 3D pose prediction and 2D pose estimation due to different pose variations between video and image training datasets. We, therefore propose a confidence based inference stage optimization to adaptively enforce 3D pose projection to match 2D pose estimation to further improve final pose prediction accuracy. Experiments on public datasets validate the effectiveness of our method, and our ablation studies show the strengths of our network's individual submodules.


Feature Fusion Detector for Semantic Cognition of Remote Sensing. The value of remote sensing images is of vital importance in many areas and needs to be refined by some cognitive approaches. The remote sensing detection is an appropriate way to achieve the semantic cognition. However, such detection is a challenging issue for scale diversity, diversity of views, small objects, sophisticated light and shadow backgrounds. In this article, inspired by the state of the art detection framework FPN, we propose a novel approach for constructing a feature fusion module that optimizes feature context utilization in detection, calling our system LFFN for Layer weakening Feature Fusion Network. We explore the inherent relevance of different layers to the final decision, and the incentives of higher level features to lower level features. More importantly, we explore the characteristics of different backbone networks in the mining of basic features and the correlation utilization of convolutional channels, and call our upgraded version as advanced LFFN. Based on experiments on the remote sensing dataset from Google Earth, our LFFN has proved effective and practical for the semantic cognition of remote sensing, achieving 89 mAP which is 4.1 higher than that of FPN. Moreover, in terms of the generalization performance, LFFN achieves 79.9 mAP on VOC 2007 and achieves 73.0 mAP on VOC 2012 test, and advacned LFFN obtains the mAP values of 80.7 and 74.4 on VOC 2007 and 2012 respectively, outperforming the comparable state of the art SSD and Faster R CNN models.


Graph based Nearest Neighbor Search Promises and Failures. Recently, graph based nearest neighbor search gets more and more popular on large scale retrieval tasks. The attractiveness of this type of approaches lies in its superior performance over most of the known nearest neighbor search approaches as well as its genericness to various metrics. In this paper, the role of two strategies, namely hierarchical structure and graph diversification that are adopted as the key steps in the graph based approaches, is investigated. We find the hierarchical structure could not achieve "much better logarithmic complexity scaling" as it was claimed in the original paper, particularly on high dimensional cases. Moreover, we find that similar high search speed efficiency as the one with hierarchical structure could be achieved with the support of flat k NN graph after graph diversification. Finally, we point out the difficulty, that is faced by most of the graph based search approaches, is directly linked to "curse of dimensionality".


Weakly Supervised Semantic Point Cloud Segmentation Towards 10X Fewer Labels. Point cloud analysis has received much attention recently and segmentation is one of the most important tasks. The success of existing approaches is attributed to deep network design and large amount of labelled training data, where the latter is assumed to be always available. However, obtaining 3d point cloud segmentation labels is often very costly in practice. In this work, we propose a weakly supervised point cloud segmentation approach which requires only a tiny fraction of points to be labelled in the training stage. This is made possible by learning gradient approximation and exploitation of additional spatial and color smoothness constraints. Experiments are done on three public datasets with different degrees of weak supervision. In particular, our proposed method can produce results that are close to and sometimes even better than its fully supervised counterpart with 10 times fewer labels.


A logical based corpus for cross lingual evaluation. At present, different deep learning models are presenting high accuracy on popular inference datasets such as SNLI, MNLI, and SciTail. However, there are different indicators that those datasets can be exploited by using some simple linguistic patterns. This fact poses difficulties to our understanding of the actual capacity of machine learning models to solve the complex task of textual inference. We propose a new set of syntactic tasks focused on contradiction detection that require specific capacities over linguistic logical forms such as Boolean coordination, quantifiers, definite description, and counting operators. We evaluate two kinds of deep learning models that implicitly exploit language structure recurrent models and the Transformer network BERT. We show that although BERT is clearly more efficient to generalize over most logical forms, there is space for improvement when dealing with counting operators. Since the syntactic tasks can be implemented in different languages, we show a successful case of cross lingual transfer learning between English and Portuguese.


Hom left symmetric color dialgebras, Hom tridendriform color algebras and Yau's twisting generalizations. The goal of this paper is to introduce and give some constructions and study properties of Hom left symmetric color dialgebras and Hom tridendriform color algebras. Next, we study their connection with Hom associative color algebra, Hom post Lie color algebra and Hom Poisson color dialgebras. Finally, we generalize Yau's twisting to a class of color Hom algebras and used endomorphisms or elements of centroids to produce other color Hom algebras from given one.


Observations of Energized Electrons in the Martian Magnetosheath. This observational study demonstrates that the magnitude and location of energization of electrons in the Martian magnetosheath is more complex than previous studies suggest. Electrons in Mars's magnetosheath originate in the solar wind and are accelerated by an electric field when they cross the bow shock. Assuming that this acceleration is localized solely to the shock, the field aligned electron distributions in the sheath are expected to be highly asymmetric. However, such an asymmetry is not observed in this study. Based on the analysis here, it is suggested that an additional parallel acceleration takes place downstream of the Martian bow shock. This additional acceleration suppresses the expected asymmetry of the electron distribution. Consequently, along a flux tube in the magnetosheath that is tied on both ends to the bow shock the difference in energization between parallel and anti parallel electrons is less than about 20 eV. Where this energization difference is expected to be maximal, we find the energization difference to be at most 25 of the predicted value.


Chen Khovanov spectra for tangles. We note that our stable homotopy refinements of Khovanov's arc algebras and tangle invariants induce refinements of Chen Khovanov and Stroppel's platform algebras and tangle invariants, and discuss the topological Hochschild homology of these refinements.


Complete symplectic quadrics and Kontsevich spaces of conics in Lagrangian Grassmannians. A wonderful compactification of an orbit under the action of a semi simple and simply connected group is a smooth projective variety containing the orbit as a dense open subset, and where the added boundary divisor is simple normal crossing. We construct the wonderful compactification of the space of symmetric and symplectic matrices, and investigate its geometry. As an application, we describe the birational geometry of the Kontsevich spaces parametrizing conics in Lagrangian Grassmannians.


CASIA SURF CeFA A Benchmark for Multi modal Cross ethnicity Face Anti spoofing. Ethnic bias has proven to negatively affect the performance of face recognition systems, and it remains an open research problem in face anti spoofing. In order to study the ethnic bias for face anti spoofing, we introduce the largest up to date CASIA SURF Cross ethnicity Face Anti spoofing (CeFA) dataset (briefly named CeFA), covering 3 ethnicities, 3 modalities, 1,607 subjects, and 2D plus 3D attack types. Four protocols are introduced to measure the affect under varied evaluation conditions, such as cross ethnicity, unknown spoofs or both of them. To the best of our knowledge, CeFA is the first dataset including explicit ethnic labels in current published released datasets for face anti spoofing. Then, we propose a novel multi modal fusion method as a strong baseline to alleviate these bias, namely, the static dynamic fusion mechanism applied in each modality (i.e., RGB, Depth and infrared image). Later, a partially shared fusion strategy is proposed to learn complementary information from multiple modalities. Extensive experiments demonstrate that the proposed method achieves state of the art results on the CASIA SURF, OULU NPU, SiW and the CeFA dataset.


Linear sets and MRD codes arising from a class of scattered linearized polynomials. A class of scattered linearized polynomials covering infinitely many field extensions is exhibited. More precisely, the q polynomial over mathbb F q 6 , q equiv 1 pmod 4 described in arXiv 1906.05611, arXiv 1910.02278 is generalized for any even n ge6 to an mathbb F q linear automorphism psi(x) of mathbb F q n of order n . Such psi(x) and some functional powers of it are proved to be scattered. In particular this provides new maximum scattered linear sets of the projective line mathrm PG (1,q n) for n 8,10 . The polynomials described in this paper lead to a new infinite family of MRD codes in mathbb F q n times n with minimum distance n 1 for any odd q if n equiv0 pmod4 and any q equiv1 pmod4 if n equiv2 pmod4 .


Selmer groups of elliptic curves over the PGL(2) extension. Iwasawa theory of elliptic curves over noncommutative extensions has been a fruitful area of research. The central object of this paper is to use Iwasawa theory over the GL(2) extension to study the dual Selmer group over the PGL(2) extension.


Throughput Analysis in Cache enabled Millimeter Wave HetNets with Access and Backhaul Integration. Recently, a mmWave based access and backhaul integration heterogeneous networks (HetNets) architecture (mABHetNets) has been envisioned to provide high wireless capacity.Since the access link and the backhaul link share the same mmwave spectral resource, a large spectrum bandwidth is occupied by the backhaul link, which hinders the wireless access capacity improvement. To overcome the backhaul spectrum occupation problem and improve the network throughput in the existing mABHetNets, we introduce the cache at base stations (BSs). In detail, by caching popular files at small base stations (SBSs),mABHetNets can offload the backhaul link traffic and transfer the redundant backhaul spectrum to the access link to increase the network throughout. However, introducing cache in SBSs will also incur additional power consumption and reduce the transmission power, which can lower the network throughput.In this paper, we investigate spectrum partition between the access link and the backhaul link as well as cache allocation to improve the network throughput in mABHetNets. With the stochastic geometry tool, we develop an analytical framework to characterize cache enabled mABHetNets and obtain the signal to interference plus noise ratio (SINR) distributions in line of sight (LoS) and non line of sight (NLoS) paths. Then we utilize the SINR distribution to derive the average potential throughput(APT). Extensive numerical results show that introducing cache can bring up to 80 APT gain to the existing mABHetNets.


Holomorphic pre symplectic form on the nested Hilbert scheme mbox Hilb 3,4 ( mathbb C 2) . We regard the pre hyperk "ahler structure on the moduli space of framed flags of sheaves mathcal F (1,3,1) on the projective plane mathbb P 2 via an adaptation of the ADHM construction of framed sheaves. Then, we study and categorize the degenerate points of the holomorphic pre symplectic form presented in the moduli space.


A Novel Column Generation Heuristic for Airline Crew Pairing Optimization with Large scale Complex Flight Networks. Crew Pairing Optimization (CPO) is critical for an airlines' business viability, given that the crew operating cost is second only to the fuel cost. CPO aims at generating a set of flight sequences (crew pairings) to cover all scheduled flights, at minimum cost, while satisfying several legality constraints. The state of the art heavily relies on relaxing the underlying Integer Programming Problem into a Linear Programming Problem, which in turn is solved through the Column Generation (CG) technique. However, with the alarmingly expanding airlines' operations, CPO is marred by the curse of dimensionality, rendering the exact CG implementations obsolete, and necessitating the heuristic based CG implementations. Yet, in literature, the much prevalent large scale complex flight networks involving multiple crew bases and or hub and spoke sub networks, largely remain uninvestigated. This paper proposes a novel CG heuristic, which has enabled the in house development of an Airline Crew Pairing Optimizer (AirCROP). The efficacy of the heuristic AirCROP has been tested on real world, large scale, complex network instances with over 4,200 flights, 15 crew bases, and multiple hub and spoke sub networks (resulting in billion plus possible pairings). Notably, this paper has a dedicated focus on the proposed CG heuristic (not the entire AirCROP framework) based on balancing random exploration of pairings exploitation of domain knowledge (on optimal solution features) and utilization of the past computational search effort through archiving. Though this paper has an airline context, the proposed CG heuristic may find wider applications across different domains, by serving as a template on how to utilize domain knowledge to better tackle combinatorial optimization problems.


A KK theoretic perspective of quantization commutes with reduction. We reframe Paradan Vergne's approach to quantization commutes with reduction in KK theory through a recent formalism introduced by Kasparov, focusing more especially the index theoretic parts that lead to their "Witten non abelian localization formula". While our method uses the same ingredients as their's in spirit, interesting conceptual simplifications occur, and the relationship to the Ma Tian Zhang analytic approach becomes quite transparent.


Representation Learning with Ordered Relation Paths for Knowledge Graph Completion. Incompleteness is a common problem for existing knowledge graphs (KGs), and the completion of KG which aims to predict links between entities is challenging. Most existing KG completion methods only consider the direct relation between nodes and ignore the relation paths which contain useful information for link prediction. Recently, a few methods take relation paths into consideration but pay less attention to the order of relations in paths which is important for reasoning. In addition, these path based models always ignore nonlinear contributions of path features for link prediction. To solve these problems, we propose a novel KG completion method named OPTransE. Instead of embedding both entities of a relation into the same latent space as in previous methods, we project the head entity and the tail entity of each relation into different spaces to guarantee the order of relations in the path. Meanwhile, we adopt a pooling strategy to extract nonlinear and complex features of different paths to further improve the performance of link prediction. Experimental results on two benchmark datasets show that the proposed model OPTransE performs better than state of the art methods.


An Algorithm for Automatically Updating a Forsyth Edwards Notation String Without an Array Board Representation. We present an algorithm that correctly updates the Forsyth Edwards Notation (FEN) chessboard character string after any move is made without the need for an intermediary array representation of the board. In particular, this relates to software that have to do with chess, certain chess variants and possibly even similar board games with comparable position representation. Even when performance may be equal or inferior to using arrays, the algorithm still provides an accurate and viable alternative to accomplishing the same thing, or when there may be a need for additional or side processing in conjunction with arrays. Furthermore, the end result (i.e. an updated FEN string) is immediately ready for export to any other internal module or external program, unlike with an intermediary array which needs to be first converted into a FEN string for export purposes. The algorithm is especially useful when there are no existing array based modules to represent a visual board as it can do without them entirely. We provide examples that demonstrate the correctness of the algorithm given a variety of positions involving castling, en passant and pawn promotion.


Rotation Invariant Point Convolution With Multiple Equivariant Alignments. Recent attempts at introducing rotation invariance or equivariance in 3D deep learning approaches have shown promising results, but these methods still struggle to reach the performances of standard 3D neural networks. In this work we study the relation between equivariance and invariance in 3D point convolutions. We show that using rotation equivariant alignments, it is possible to make any convolutional layer rotation invariant. Furthermore, we improve this simple alignment procedure by using the alignment themselves as features in the convolution, and by combining multiple alignments together. With this core layer, we design rotation invariant architectures which improve state of the art results in both object classification and semantic segmentation and reduces the gap between rotation invariant and standard 3D deep learning approaches.


Eight years of homicide evolution in Monterrey, Mexico a network approach. Homicide is without doubt one of Mexico's most important security problems, with data showing that this dismal kind of violence sky rocketed shortly after the war on drugs was declared in 2007. Since then, violent war like zones have appeared and disappeared throughout Mexico, causing unfathomable human, social and economic losses. One of the most emblematic of these zones is the city of Monterrey, a central scenario in the narco war. To better understand the underlying mechanisms by which violence has evolved and spread through the city, here we propose a network based approach. For this purpose, we define a homicide network where nodes are geographical entities that are connected through spatial proximity and crime similarity. Data is taken from a crime database spanning 86 months in the Monterrey metropolitan area, containing manually curated geo located and dated homicides, as well as from Open Street Map for urban environment. Under this approach, we first identify independent crime sectors corresponding to different connected components. Each of these clusters of crime presents crime evolution similar to the one at state and national levels. We then show how crime spread from neighborhood to adjacent neighborhoods when violence was mainly cartel related and how it was chiefly static at a different time. Finally, we show a relation between homicidal crime and urban landscape by studying the distance of safe and violent neighborhoods to the closest highway and by studying the evolution of highway and crime distance over the cartel related years and the following period. With this approach, we are able to describe more accurately the evolution of homicidal crime in a metropolitan area.


An Efficient Neighborhood based Interaction Model for Recommendation on Heterogeneous Graph. There is an influx of heterogeneous information network (HIN) based recommender systems in recent years since HIN is capable of characterizing complex graphs and contains rich semantics. Although the existing approaches have achieved performance improvement, while practical, they still face the following problems. On one hand, most existing HIN based methods rely on explicit path reachability to leverage path based semantic relatedness between users and items, e.g., metapath based similarities. These methods are hard to use and integrate since path connections are sparse or noisy, and are often of different lengths. On the other hand, other graph based methods aim to learn effective heterogeneous network representations by compressing node together with its neighborhood information into single embedding before prediction. This weakly coupled manner in modeling overlooks the rich interactions among nodes, which introduces an early summarization issue. In this paper, we propose an end to end Neighborhood based Interaction Model for Recommendation (NIRec) to address the above problems. Specifically, we first analyze the significance of learning interactions in HINs and then propose a novel formulation to capture the interactive patterns between each pair of nodes through their metapath guided neighborhoods. Then, to explore complex interactions between metapaths and deal with the learning complexity on large scale networks, we formulate interaction in a convolutional way and learn efficiently with fast Fourier transform. The extensive experiments on four different types of heterogeneous graphs demonstrate the performance gains of NIRec comparing with state of the arts. To the best of our knowledge, this is the first work providing an efficient neighborhood based interaction model in the HIN based recommendations.


Rethinking Attribute Representation and Injection for Sentiment Classification. Text attributes, such as user and product information in product reviews, have been used to improve the performance of sentiment classification models. The de facto standard method is to incorporate them as additional biases in the attention mechanism, and more performance gains are achieved by extending the model architecture. In this paper, we show that the above method is the least effective way to represent and inject attributes. To demonstrate this hypothesis, unlike previous models with complicated architectures, we limit our base model to a simple BiLSTM with attention classifier, and instead focus on how and where the attributes should be incorporated in the model. We propose to represent attributes as chunk wise importance weight matrices and consider four locations in the model (i.e., embedding, encoding, attention, classifier) to inject attributes. Experiments show that our proposed method achieves significant improvements over the standard approach and that attention mechanism is the worst location to inject attributes, contradicting prior work. We also outperform the state of the art despite our use of a simple base model. Finally, we show that these representations transfer well to other tasks. Model implementation and datasets are released here https github.com rktamplayo CHIM.


Maximal nonassociativity via fields. We say that (x,y,z) in Q 3 is an associative triple in a quasigroup Q( ) if (x y) z x (y z) . Let a(Q) denote the number of associative triples in Q . It is easy to show that a(Q) ge Q , and we call the quasigroup maximally nonassociative if a(Q) Q . It was conjectured that maximally nonassociative quasigroups do not exist when Q 1 . Dr 'apal and Lison v e k recently refuted this conjecture by proving the existence of maximally nonassociative quasigroups for a certain infinite set of orders Q . In this paper we prove the existence of maximally nonassociative quasigroups for a much larger set of orders Q . Our main tools are finite fields and the Weil bound on quadratic character sums. Unlike in the previous work, our results are to a large extent constructive.


Information Maximizing Visual Question Generation. Though image to sequence generation models have become overwhelmingly popular in human computer communications, they suffer from strongly favoring safe generic questions ("What is in this picture?"). Generating uninformative but relevant questions is not sufficient or useful. We argue that a good question is one that has a tightly focused purpose one that is aimed at expecting a specific type of response. We build a model that maximizes mutual information between the image, the expected answer and the generated question. To overcome the non differentiability of discrete natural language tokens, we introduce a variational continuous latent space onto which the expected answers project. We regularize this latent space with a second latent space that ensures clustering of similar answers. Even when we don't know the expected answer, this second latent space can generate goal driven questions specifically aimed at extracting objects ("what is the person throwing"), attributes, ("What kind of shirt is the person wearing?"), color ("what color is the frisbee?"), material ("What material is the frisbee?"), etc. We quantitatively show that our model is able to retain information about an expected answer category, resulting in more diverse, goal driven questions. We launch our model on a set of real world images and extract previously unseen visual concepts.


Aggregate Power Control of Heterogeneous TCL Populations Governed by Fokker Planck Equations. This paper addresses the modeling and control of heterogeneous populations of thermostatically controlled loads (TCLs) operated by model predictive control (MPC) schemes at level of each TCL. It is shown that the dynamics of such TCLs populations can be described by a pair of Fokker Planck equations coupled via the actions in the domain. The technique of input output feedback linearization is used in the design of aggregate power control, which leads to a nonlinear system in closed loop. Well posedness analysis is carried out to validate the developed control scheme. The closed loop stability of the system is assessed by a rigorous analysis. A simulation study is contacted, and the obtained results confirm the validity and the effectiveness of the proposed approach.


Volumes of Line Bundles on Schemes. Volumes of line bundles are known to exist as limits on generically reduced projective schemes. However, it is not known if they always exist as limits on more general projective schemes. We show that they do always exist as a limit on a codimension one subscheme of a nonsingular projective variety.


Contrast modes in a 3D ion transmission approach at keV energies. We present options for visualizing contrast maps in 3D ion transmission experiments. Simultaneous measurement of angular distributions and flight time of ions transmitted through self supporting, single crystalline silicon foils allows for mapping of intensity and different energy loss moments. The transmitted projectiles were detected mainly for random beam sample orientation using pulsed beams of He ions and protons with incident energies 50 and 200 keV. Differences in contrast, observed when varying the projectile type and energy, can be attributed to sample nuclear and electronic structure and bear witness to impact parameter dependent energy loss processes. Our results provide a base for interpretation of data obtained in prospective transmission studies when for example using a helium ion microscope.


A neuro mathematical model for size and context related illusions. We provide here a mathematical model of size context illusions, inspired by the functional architecture of the visual cortex. We first recall previous models of scale and orientation, in particular the one in (Sarti et al., 2008), and simplify it, only considering the feature of scale. Then we recall the deformation model of illusion, introduced by (Franceschiello et al. 2017), to describe orientation related GOIs, and adapt it to size illusions. We finally apply the model to the Ebbinghaus and Delboeuf illusions, validating the results by comparing with experimental data from (Massaro et al., 1971) and (Roberts et al., 2005).