• A data-dependent weighted LASSO under Poisson noise
Sparse linear inverse problems appear in a variety of settings, but often the noise contaminating observations cannot accurately be described as bounded by or arising from a Gaussian distribution. Poisson observations in particular are a characteristic feature of several real-world applications. Previous work on sparse Poisson inverse problems encountered several limiting technical hurdles. This paper describes a novel alternative analysis approach for sparse Poisson inverse problems that (a) sidesteps the technical challenges present in previous work, (b) admits estimators that can readily be computed using off-the-shelf LASSO algorithms, and (c) hints at a general weighted LASSO framework for broad classes of problems. At the heart of this new approach lies a weighted LASSO estimator for which data-dependent weights are based on Poisson concentration inequalities. Unlike previous analyses of the weighted LASSO, the proposed analysis depends on conditions which can be checked or shown to hold in general settings with high probability.
• Bayesian GARMA Models for Count Data
Generalized autoregressive moving average (GARMA) models are a class of models that was developed for extending the univariate Gaussian ARMA time series model to a flexible observation-driven model for non-Gaussian time series data. This work presents Bayesian approach for GARMA models with Poisson, binomial and negative binomial distributions. A simulation study was carried out to investigate the performance of Bayesian estimation and Bayesian model selection criteria. Also three real datasets were analysed using the Bayesian approach on GARMA models.
• Bayesian model averaging: A systematic review and conceptual classification
Bayesian Model Averaging (BMA) is an application of Bayesian inference to the problems of model selection, combined estimation and prediction that produces a straightforward model choice criteria and less risky predictions. However, the application of BMA is not always straightforward, leading to diverse assumptions and situational choices on its different aspects. Despite the widespread application of BMA in the literature, there were not many accounts of these differences and trends besides a few landmark revisions in the late 1990s and early 2000s, therefore not taking into account any advancements made in the last 15 years. In this work, we present an account of these developments through a careful content analysis of 587 articles in BMA published between 1996 and 2014. We also develop a conceptual classification scheme to better describe this vast literature, understand its trends and future directions and provide guidance for the researcher interested in both the application and development of the methodology. The results of the classification scheme and content review are then used to discuss the present and future of the BMA literature.
• CARMA: Collective Adaptive Resource-sharing Markovian Agents
In this paper we present CARMA, a language recently defined to support specification and analysis of collective adaptive systems. CARMA is a stochastic process algebra equipped with linguistic constructs specifically developed for modelling and programming systems that can operate in open-ended and unpredictable environments. This class of systems is typically composed of a huge number of interacting agents that dynamically adjust and combine their behaviour to achieve specific goals. A CARMA model, termed a collective, consists of a set of components, each of which exhibits a set of attributes. To model dynamic aggregations, which are sometimes referred to as ensembles, CARMA provides communication primitives that are based on predicates over the exhibited attributes. These predicates are used to select the participants in a communication. Two communication mechanisms are provided in the CARMA language: multicast-based and unicast-based. In this paper, we first introduce the basic principles of CARMA and then we show how our language can be used to support specification with a simple but illustrative example of a socio-technical collective adaptive system.
• Compression of Deep Neural Networks on the Fly
Because of their performance, deep neural networks are increasingly used for object recognition. They are particularly attractive because of their ability to ‘absorb’ great quantities of labeled data through millions of parameters. However, as the accuracy and the model sizes increase, so does the memory requirements of the classifiers. This prohibits their usage on resource limited hardware, including cell phones or other embedded devices. We introduce a novel compression method for deep neural networks that performs during the learning phase. It consists in adding an extra regularization term to the cost function of fully-connected layers. We combine this method with Product Quantization (PQ) of the trained weights for higher savings in memory and storage consumption. We evaluate our method on two data sets (MNIST and CIFAR10), on which we achieve significantly larger compression than state-of-the-art methods.
• How to Formulate and Solve Statistical Recognition and Learning Problems
We formulate problems of statistical recognition and learning in a common framework of complex hypothesis testing. Based on arguments from multi-criteria optimization, we identify strategies that are improper for solving these problems and derive a common form of the remaining strategies. We show that some widely used approaches to recognition and learning are improper in this sense. We then propose a generalized formulation of the recognition and learning problem which embraces the whole range of sizes of the learning sample, including the zero size. Learning becomes a special case of recognition without learning. We define the concept of closest to optimal strategy, being a solution to the formulated problem, and describe a technique for finding such a strategy. On several illustrative cases, the strategy is shown to be superior to the widely used learning methods based on maximal likelihood estimation.
• Towards Unveiling the Ontology Key Features Altering Reasoner Performances
Reasoning with ontologies is one of the core fields of research in Description Logics. A variety of efficient reasoner with highly optimized algorithms have been developed to allow inference tasks on expressive ontology languages such as OWL(DL). However, reasoner reported computing times have exceeded and sometimes fall behind the expected theoretical values. From an empirical perspective, it is not yet well understood, which particular aspects in the ontology are reasoner performance degrading factors. In this paper, we conducted an investigation about state of art works that attempted to portray potential correlation between reasoner empirical behaviour and particular ontological features. These works were analysed and then broken down into categories. Further, we proposed a set of ontology features covering a broad range of structural and syntactic ontology characteristics. We claim that these features are good indicators of the ontology hardness level against reasoning tasks.
• A Bayesian length-based population dynamics model for northern shrimp (Pandalus Borealis)
• A green perspective on capacitated time-dependent vehicle routing problem with time windows
• A method of finding the asymptotics of q-series based on the convolution of generating functions
• A Nonmonotone Projected Gradient Method for Optimization over Sparse Symmetric Sets
• A Semi-Supervised Method for Predicting Cancer Survival Using Incomplete Clinical Data
• An Independent Process Approximation to Sparse Random Graphs with a Prescribed Number of Edges and Triangles
• Another generalization of the colorful Carathéodory theorem
• Automatically Segmenting Oral History Transcripts
• Boolean Matrix Factorization and Completion via Message Passing
• Building Subject-aligned Comparable Corpora and Mining it for Truly Parallel Sentence Pairs
• Censoring Diffusion for Harvesting WSNs
• Chaotic Weak Chimeras and their Persistence in Coupled Populations of Phase Oscillators
• Commutation relations for quantum root vectors of cominuscole parabolics
• Conformal invariance of boundary touching loops of FK Ising model
• Coronoids, Patches and Generalised Altans
• Coupling and exponential ergodicity for stochastic differential equations driven by Lévy processes
• ‘Creeping conductance’ in nonstationary granular systems and artificial arrays
• Error Bounds for Sequential Monte Carlo Samplers for Multimodal Distributions
• Estimating network edge probabilities by neighborhood smoothing
• Extremes of some Gaussian random interfaces
• Foundations of Coupled Nonlinear Dimensionality Reduction
• Free infinite divisibility for powers of random variables
• Free probability of type B and asymptotics of finite-rank perturbations of random matrices
• Gibbs Flow for Approximate Transport with Applications to Bayesian Computation
• Global Fibonacci Nim
• Heuristic methods for the Traveling Salesman Problem with Drone
• Learning dynamic Boltzmann machines with spike-timing dependent plasticity
• Links between deterministic and stochastic approaches for invasion in growth-fragmentation-death models
• Maximum likelihood estimators for a jump-type Heston model
• Mid-concavity of survival probability for isotropic Levy processes
• Multi-chimera states in the Leaky Integrate-and-Fire model
• Neural-based machine translation for medical text domain. Based on European Medicines Agency leaflet texts
• On a Conjecture of Cusick Concerning the Sum of Digits of n and n + t
• On initial direction, orientation and discreteness in the analysis of circular variables
• On Postnikov-Shapiro Algebras and their generalizations
• On uncrossing games for skew-supermodular functions
• Online and Random Domination of Graphs
• Parameterized Lower Bounds and Dichotomy Results for the NP-completeness of $H$-free Edge Modification Problems
• Polish – English Speech Statistical Machine Translation Systems for the IWSLT 2014
• Polish -English Statistical Machine Translation of Medical Texts
• Posterior Exploration based Sequential Monte Carlo for Global Optimization
• Probabilistic Threshold Indexing for Uncertain Strings
• Reasoning in Infinitely Valued G-IALCQ
• Refinement of some moment inequalities
• Semantics, Representations and Grammars for Deep Learning
• Sharp value for the Hausdorff dimension of the range and the graph of stable-like processes
• Spectral analysis of random-to-random Markov chains
• The Chaotic Representation Property of Compensated-Covariation Stable Families of Martingales
• The combinatorics of Green’s functions in planar field theories
• The structural origin of the hard-sphere glass transition in granular packing
• Thermodynamics of a two-dimensional dipolar Bose gas with correlated disorder in the roton regime
• Tractable Fully Bayesian Inference via Convex Optimization and Optimal Transport Theory
• Tuned and GPU-accelerated parallel data mining from comparable corpora
• Variational Information Maximisation for Intrinsically Motivated Reinforcement Learning
Like this:
Like Loading...