A data-dependent weighted LASSO under Poisson noise

Sparse linear inverse problems appear in a variety of settings, but often the noise contaminating observations cannot accurately be described as bounded by or arising from a Gaussian distribution. Poisson observations in particular are a characteristic feature of several real-world applications. Previous work on sparse Poisson inverse problems encountered several limiting technical hurdles. This paper describes a novel alternative analysis approach for sparse Poisson inverse problems that (a) sidesteps the technical challenges present in previous work, (b) admits estimators that can readily be computed using off-the-shelf LASSO algorithms, and (c) hints at a general weighted LASSO framework for broad classes of problems. At the heart of this new approach lies a weighted LASSO estimator for which data-dependent weights are based on Poisson concentration inequalities. Unlike previous analyses of the weighted LASSO, the proposed analysis depends on conditions which can be checked or shown to hold in general settings with high probability.

Bayesian GARMA Models for Count Data

Generalized autoregressive moving average (GARMA) models are a class of models that was developed for extending the univariate Gaussian ARMA time series model to a flexible observation-driven model for non-Gaussian time series data. This work presents Bayesian approach for GARMA models with Poisson, binomial and negative binomial distributions. A simulation study was carried out to investigate the performance of Bayesian estimation and Bayesian model selection criteria. Also three real datasets were analysed using the Bayesian approach on GARMA models.

Bayesian model averaging: A systematic review and conceptual classification

Bayesian Model Averaging (BMA) is an application of Bayesian inference to the problems of model selection, combined estimation and prediction that produces a straightforward model choice criteria and less risky predictions. However, the application of BMA is not always straightforward, leading to diverse assumptions and situational choices on its different aspects. Despite the widespread application of BMA in the literature, there were not many accounts of these differences and trends besides a few landmark revisions in the late 1990s and early 2000s, therefore not taking into account any advancements made in the last 15 years. In this work, we present an account of these developments through a careful content analysis of 587 articles in BMA published between 1996 and 2014. We also develop a conceptual classification scheme to better describe this vast literature, understand its trends and future directions and provide guidance for the researcher interested in both the application and development of the methodology. The results of the classification scheme and content review are then used to discuss the present and future of the BMA literature.

CARMA: Collective Adaptive Resource-sharing Markovian Agents

In this paper we present CARMA, a language recently defined to support specification and analysis of collective adaptive systems. CARMA is a stochastic process algebra equipped with linguistic constructs specifically developed for modelling and programming systems that can operate in open-ended and unpredictable environments. This class of systems is typically composed of a huge number of interacting agents that dynamically adjust and combine their behaviour to achieve specific goals. A CARMA model, termed a collective, consists of a set of components, each of which exhibits a set of attributes. To model dynamic aggregations, which are sometimes referred to as ensembles, CARMA provides communication primitives that are based on predicates over the exhibited attributes. These predicates are used to select the participants in a communication. Two communication mechanisms are provided in the CARMA language: multicast-based and unicast-based. In this paper, we first introduce the basic principles of CARMA and then we show how our language can be used to support specification with a simple but illustrative example of a socio-technical collective adaptive system.

Compression of Deep Neural Networks on the Fly

Because of their performance, deep neural networks are increasingly used for object recognition. They are particularly attractive because of their ability to ‘absorb’ great quantities of labeled data through millions of parameters. However, as the accuracy and the model sizes increase, so does the memory requirements of the classifiers. This prohibits their usage on resource limited hardware, including cell phones or other embedded devices. We introduce a novel compression method for deep neural networks that performs during the learning phase. It consists in adding an extra regularization term to the cost function of fully-connected layers. We combine this method with Product Quantization (PQ) of the trained weights for higher savings in memory and storage consumption. We evaluate our method on two data sets (MNIST and CIFAR10), on which we achieve significantly larger compression than state-of-the-art methods.

How to Formulate and Solve Statistical Recognition and Learning Problems

We formulate problems of statistical recognition and learning in a common framework of complex hypothesis testing. Based on arguments from multi-criteria optimization, we identify strategies that are improper for solving these problems and derive a common form of the remaining strategies. We show that some widely used approaches to recognition and learning are improper in this sense. We then propose a generalized formulation of the recognition and learning problem which embraces the whole range of sizes of the learning sample, including the zero size. Learning becomes a special case of recognition without learning. We define the concept of closest to optimal strategy, being a solution to the formulated problem, and describe a technique for finding such a strategy. On several illustrative cases, the strategy is shown to be superior to the widely used learning methods based on maximal likelihood estimation.

Towards Unveiling the Ontology Key Features Altering Reasoner Performances

Reasoning with ontologies is one of the core fields of research in Description Logics. A variety of efficient reasoner with highly optimized algorithms have been developed to allow inference tasks on expressive ontology languages such as OWL(DL). However, reasoner reported computing times have exceeded and sometimes fall behind the expected theoretical values. From an empirical perspective, it is not yet well understood, which particular aspects in the ontology are reasoner performance degrading factors. In this paper, we conducted an investigation about state of art works that attempted to portray potential correlation between reasoner empirical behaviour and particular ontological features. These works were analysed and then broken down into categories. Further, we proposed a set of ontology features covering a broad range of structural and syntactic ontology characteristics. We claim that these features are good indicators of the ontology hardness level against reasoning tasks.

A Bayesian length-based population dynamics model for northern shrimp (Pandalus Borealis)

A green perspective on capacitated time-dependent vehicle routing problem with time windows

A method of finding the asymptotics of q-series based on the convolution of generating functions

A Nonmonotone Projected Gradient Method for Optimization over Sparse Symmetric Sets

A Semi-Supervised Method for Predicting Cancer Survival Using Incomplete Clinical Data

An Independent Process Approximation to Sparse Random Graphs with a Prescribed Number of Edges and Triangles

Another generalization of the colorful Carathéodory theorem

Automatically Segmenting Oral History Transcripts

Boolean Matrix Factorization and Completion via Message Passing

Building Subject-aligned Comparable Corpora and Mining it for Truly Parallel Sentence Pairs

Censoring Diffusion for Harvesting WSNs

Chaotic Weak Chimeras and their Persistence in Coupled Populations of Phase Oscillators

Commutation relations for quantum root vectors of cominuscole parabolics

Conformal invariance of boundary touching loops of FK Ising model

Coronoids, Patches and Generalised Altans

Coupling and exponential ergodicity for stochastic differential equations driven by Lévy processes

‘Creeping conductance’ in nonstationary granular systems and artificial arrays

Error Bounds for Sequential Monte Carlo Samplers for Multimodal Distributions

Estimating network edge probabilities by neighborhood smoothing

Extremes of some Gaussian random interfaces

Foundations of Coupled Nonlinear Dimensionality Reduction

Free infinite divisibility for powers of random variables

Free probability of type B and asymptotics of finite-rank perturbations of random matrices

Gibbs Flow for Approximate Transport with Applications to Bayesian Computation

Global Fibonacci Nim

Heuristic methods for the Traveling Salesman Problem with Drone

Learning dynamic Boltzmann machines with spike-timing dependent plasticity

Links between deterministic and stochastic approaches for invasion in growth-fragmentation-death models

Maximum likelihood estimators for a jump-type Heston model

Mid-concavity of survival probability for isotropic Levy processes

Multi-chimera states in the Leaky Integrate-and-Fire model

Neural-based machine translation for medical text domain. Based on European Medicines Agency leaflet texts

On a Conjecture of Cusick Concerning the Sum of Digits of n and n + t

On initial direction, orientation and discreteness in the analysis of circular variables

On Postnikov-Shapiro Algebras and their generalizations

On uncrossing games for skew-supermodular functions

Online and Random Domination of Graphs

Parameterized Lower Bounds and Dichotomy Results for the NP-completeness of $H$-free Edge Modification Problems

Polish – English Speech Statistical Machine Translation Systems for the IWSLT 2014

Polish -English Statistical Machine Translation of Medical Texts

Posterior Exploration based Sequential Monte Carlo for Global Optimization

Probabilistic Threshold Indexing for Uncertain Strings

Reasoning in Infinitely Valued G-IALCQ

Refinement of some moment inequalities

Semantics, Representations and Grammars for Deep Learning

Sharp value for the Hausdorff dimension of the range and the graph of stable-like processes

Spectral analysis of random-to-random Markov chains

The Chaotic Representation Property of Compensated-Covariation Stable Families of Martingales

The combinatorics of Green’s functions in planar field theories

The structural origin of the hard-sphere glass transition in granular packing

Thermodynamics of a two-dimensional dipolar Bose gas with correlated disorder in the roton regime

Tractable Fully Bayesian Inference via Convex Optimization and Optimal Transport Theory

Tuned and GPU-accelerated parallel data mining from comparable corpora

Variational Information Maximisation for Intrinsically Motivated Reinforcement Learning