The Great Time Series Classification Bake Off: An Experimental Evaluation of Recently Proposed Algorithms. Extended Version

In the last five years there have been a large number of new time series classification algorithms proposed in the literature. These algorithms have been evaluated on subsets of the 47 data sets in the University of California, Riverside time series classification archive. The archive has recently been expanded to 85 data sets, over half of which have been donated by researchers at the University of East Anglia. Aspects of previous evaluations have made comparisons between algorithms difficult. For example, several different programming languages have been used, experiments involved a single train/test split and some used normalised data whilst others did not. The relaunch of the archive provides a timely opportunity to thoroughly evaluate algorithms on a larger number of datasets. We have implemented 18 recently proposed algorithms in a common Java framework and compared them against two standard benchmark classifiers (and each other) by performing 100 resampling experiments on each of the 85 datasets. We use these results to test several hypotheses relating to whether the algorithms are significantly more accurate than the benchmarks and each other. Our results indicate that only 9 of these algorithms are significantly more accurate than both benchmarks and that one classifier, the Collective of Transformation Ensembles, is significantly more accurate than all of the others. All of our experiments and results are reproducible: we release all of our code, results and experimental details and we hope these experiments form the basis for more rigorous testing of new algorithms in the future.


Asynchronous Methods for Deep Reinforcement Learning

We propose a conceptually simple and lightweight framework for deep reinforcement learning that uses asynchronous gradient descent for optimization of deep neural network controllers. We present asynchronous variants of four standard reinforcement learning algorithms and show that parallel actor-learners have a stabilizing effect on training allowing all four methods to successfully train neural network controllers. The best performing method, an asynchronous variant of actor-critic, surpasses the current state-of-the-art on the Atari domain while training for half the time on a single multi-core CPU instead of a GPU. Furthermore, we show that asynchronous actor-critic succeeds on a wide variety of continuous motor control problems as well as on a new task involving finding rewards in random 3D mazes using a visual input.


Rational Mixed Tate Motivic Graphs

Knots and Links from Random Projections

Epidemics on networks with heterogeneous population and stochastic infection rates

Geometry of the uniform spanning forest components in high dimensions

Level-set methods for convex optimization

Unsupervised Regenerative Learning of Hierarchical Features in Spiking Deep Networks for Object Recognition

Risk estimation for high-dimensional lasso regression

An ensemble diversity approach to supervised binary hashing

Online energy efficient packet scheduling for a common deadline with and without energy harvesting

$k$-geometric graphs

A Factorized Recurrent Neural Network based architecture for medium to large vocabulary Language Modelling

Long-term Planning by Short-term Prediction

On the Construction of High Dimensional Simple Games

SDCA without Duality, Regularization, and Individual Convexity

Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering

One Parser, Many Languages

Wallach sets and squared Bessel particle systems

Mittag-Leffler Lévy Processes

Generalized Pickands constants and stationary max-stable processes

Fpga Based Implementation of Deep Neural Networks Using On-chip Memory Only

The intricate labyrinth of Collatz sequences

Fuzzy Object-Oriented Dynamic Networks. II

A Generalised Quantifier Theory of Natural Language in Categorical Compositional Distributional Semantics with Bialgebras

Orientations of Simplices Determined by Orderings on the Coordinates of their Vertices

Bayesian Nonparametric System Reliability using Sets of Priors

Explosive Crump-Mode-Jagers branching processes

Accelerating Local Search for the Maximum Independent Set Problem

Improved Query Topic Models via Pseudo-Relevant Pólya Document Models

The Generalised Isolation-With-Migration Model: a Maximum-Likelihood Implementation for Multilocus Data Sets

Minimizing the Maximal Loss: How and Why?

Domination in 3-tournaments

The large deviations of the whitening process in random constraint satisfaction problems

The structure of fluctuations in stochastic homogenization

Formal Verification of Autonomous Vehicle Platooning

$L^2$-Stability of Traveling Wave Solutions to Nonlocal Evolution Equations

Correntropy Maximization via ADMM – Application to Robust Hyperspectral Unmixing

The deterministic Kermack-McKendrick model bounds the general stochastic epidemic

$L^q$ norms of Fekete and related polynomials

Contagious Sets in Random Graphs

Quenched invariance principle for random walks with time-dependent ergodic degenerate weights

On Betti numbers of flag complexes with forbidden induced subgraphs

A game theoretic bound for minmax regret optimization problems with interval data

Randomized Quasi-Newton Updates are Linearly Convergent Matrix Inversion Algorithms

Hypergraph Versals

Scalable Isocontour Visualization in Road Networks via Minimum-Link Paths

Efficient Estimation of Semiparametric Transformation Models for the Cumulative Incidence of Competing Risks

Semiparametric Regression Analysis of Interval-Censored Competing Risks Data

Free skew Boolean intersection algebras and set partitions

Random Forest DBSCAN for USPTO Inventor Name Disambiguation

Conformity-Driven Agents Support Ordered Phases in the Spatial Public Goods Game

Random Feature Maps via a Layered Random Projection (LaRP) Framework for Object Classification

A short note on Merlin-Arthur protocols for subset sum