Physics-informed Machine Learning Method for Forecasting and Uncertainty Quantification of Partially Observed and Unobserved States in Power Grids

We present a physics-informed Gaussian Process Regression (GPR) model to predict the phase angle, angular speed, and wind mechanical power from a limited number of measurements. In the traditional data-driven GPR method, the form of the Gaussian Process covariance matrix is assumed and its parameters are found from measurements. In the physics-informed GPR, we treat unknown variables (including wind speed and mechanical power) as a random process and compute the covariance matrix from the resulting stochastic power grid equations. We demonstrate that the physics-informed GPR method is significantly more accurate than the standard data-driven one for immediate forecasting of generators’ angular velocity and phase angle. We also show that the physics-informed GPR provides accurate predictions of the unobserved wind mechanical power, phase angle, or angular velocity when measurements from only one of these variables are available. The immediate forecast of observed variables and predictions of unobserved variables can be used for effectively managing power grids (electricity market clearing, regulation actions) and early detection of abnormal behavior and faults. The physics-based GPR forecast time horizon depends on the combination of input (wind power, load, etc.) correlation time and characteristic (relaxation) time of the power grid and can be extended to short and medium-range times.

Smart Grid Monitoring Using Power Line Modems: Effect of Anomalies on Signal Propagation

The aim of the present work is to provide the theoretical fundamentals needed to monitor power grids using high frequency sensors. In our context, network monitoring refers to the harvesting of different kinds of information: topology of the grid, load changes, presence of faults and cable degradation. We rely on transmission line theory to carry out a thorough analysis of how high frequency signals, such those produced by power line modems, propagate through multi-conductor power networks. We also consider the presence of electrical anomalies on the network and analyze how they affect the signal propagation. In this context, we propose two models that rely on reflectometric and end-to-end measurements to extrapolate information about possible anomalies. A thorough discussion is carried out to explain the properties of each model and measurement method, in order to enable the development of appropriate anomaly detection and location algorithms.

An Introduction to Animal Movement Modeling with Hidden Markov Models using Stan for Bayesian Inference

Hidden Markov models (HMMs) are popular time series model in many fields including ecology, economics and genetics. HMMs can be defined over discrete or continuous time, though here we only cover the former. In the field of movement ecology in particular, HMMs have become a popular tool for the analysis of movement data because of their ability to connect observed movement data to an underlying latent process, generally interpreted as the animal’s unobserved behavior. Further, we model the tendency to persist in a given behavior over time. Notation presented here will generally follow the format of Zucchini et al. (2016) and cover HMMs applied in an unsupervised case to animal movement data, specifically positional data. We provide Stan code to analyze movement data of the wild haggis as presented first in Michelot et al. (2016).

The Stochastic Score Classification Problem

Consider the following Stochastic Score Classification Problem. A doctor is assessing a patient’s risk of developing a certain disease, and can perform n tests on the patient. Each test has a binary outcome, positive or negative. A positive test result is an indication of risk, and a patient’s score is the total number of positive test results. The doctor needs to classify the patient into one of B risk classes, depending on the score (e.g., LOW, MEDIUM, and HIGH risk). Each of these classes corresponds to a contiguous range of scores. Test i has probability p_i of being positive, and it costs c_i to perform the test. To reduce costs, instead of performing all tests, the doctor will perform them sequentially and stop testing when it is possible to determine the risk category for the patient. The problem is to determine the order in which the doctor should perform the tests, so as to minimize the expected testing cost. We provide approximation algorithms for adaptive and non-adaptive versions of this problem, and pose a number of open questions.

DeepTag: inferring all-cause diagnoses from clinical notes in under-resourced medical domain

In many under-resourced settings, clinicians lack time and expertise to annotate patients with standard medical diagnosis codes. Veterinary medicine is an example of this and clinical encounters are largely captured in free text notes which are not labeled with diagnosis code. The lack of such standard coding makes it challenging to apply data science to improve patient care. It is also a major impediment to translational research, where, for example, we would like to leverage veterinary data to inform drug development for humans. We develop a deep learning algorithm, DeepTag, to automatically infer diagnosis codes from veterinarian free text notes. DeepTag is trained on a newly curated dataset of 112,558 veterinary notes manually annotated by experts. DeepTag extends multi-task LSTM with an improved hierarchical objective that captures structures between diseases. To foster human-machine collaboration, DeepTag also learns to abstain in examples when it is uncertain and defer them to human experts, resulting in improved performance of the model. DeepTag accurately infers disease codes from free text even in challenging out-of-domain settings where the text comes from different clinics than the ones used for training. It enables automated disease annotation across a broad range of clinical diagnoses with minimal pre-processing. The technical framework in this work can be applied in other medical domains that currently lack medical coding infrastructure.

First-order optimal sequential subspace change-point detection

We consider the sequential change-point detection problem of detecting changes that are characterized by a subspace structure. Such changes are frequent in high-dimensional streaming data altering the form of the corresponding covariance matrix. In this work we present a Subspace-CUSUM procedure and demonstrate its first-order asymptotic optimality properties for the case where the subspace structure is unknown and needs to be simultaneously estimated. To achieve this goal we develop a suitable analytical methodology that includes a proper parameter optimization for the proposed detection scheme. Numerical simulations corroborate our theoretical findings.

Automatic Exploration of Machine Learning Experiments on OpenML

Understanding the influence of hyperparameters on the performance of a machine learning algorithm is an important scientific topic in itself and can help to improve automatic hyperparameter tuning procedures. Unfortunately, experimental meta data for this purpose is still rare. This paper presents a large, free and open dataset addressing this problem, containing results on 38 OpenML data sets, six different machine learning algorithms and many different hyperparameter configurations. Result where generated by an automated random sampling strategy, termed the OpenML Random Bot. Each algorithm was cross-validated up to 20.000 times per dataset with different hyperparameters settings, resulting in a meta dataset of around 2.5 million experiments overall.

A depth-based method for functional time series forecasting

An approach is presented for making predictions about functional time series. The method is applied to data coming from periodically correlated processes and electricity demand, obtaining accurate point forecasts and narrow prediction bands that cover high proportions of the forecasted functional datum, for a given confidence level. The method is computationally efficient and substantially different to other functional time series methods, offering a new insight for the analysis of these data structures.

Bootstrap Based Inference for Sparse High-Dimensional Time Series Models

Fitting sparse models to high dimensional time series is an important area of statistical inference. In this paper we consider sparse vector autoregressive models and develop appropriate bootstrap methods to infer properties of such processes, like the construction of confidence intervals and of tests for individual or for groups of model parameters. Our bootstrap methodology generates pseudo time series using a model-based bootstrap procedure which involves an estimated, sparsified version of the underlying vector autoregressive model. Inference is performed using so-called de-sparsified or de-biased estimators of the autoregressive model parameters. We derive the asymptotic distribution of such estimators in the time series context and establish asymptotic validity of the bootstrap procedure proposed for estimation and, appropriately modified, for testing purposes. In particular we focus on testing that a group of autoregressive coefficients equals zero. Our theoretical results are complemented by simulations which investigate the finite sample performance of the bootstrap methodology proposed. A real-life data application is also presented.

Gradient Similarity: An Explainable Approach to Detect Adversarial Attacks against Deep Learning

Deep neural networks are susceptible to small-but-specific adversarial perturbations capable of deceiving the network. This vulnerability can lead to potentially harmful consequences in security-critical applications. To address this vulnerability, we propose a novel metric called \emph{Gradient Similarity} that allows us to capture the influence of training data on test inputs. We show that \emph{Gradient Similarity} behaves differently for normal and adversarial inputs, and enables us to detect a variety of adversarial attacks with a near perfect ROC-AUC of 95-100\%. Even white-box adversaries equipped with perfect knowledge of the system cannot bypass our detector easily. On the MNIST dataset, white-box attacks are either detected with a high ROC-AUC of 87-96\%, or require very high distortion to bypass our detector.

A Two-Step Pre-Processing for Semidefinite Programming

In semidefinite programming (SDP), some of the most commonly used pre-processing techniques for exploiting sparsity result in non-trivial numerical issues. We show that further pre-processing, based on the so called facial reduction, can resolve the issues. In computational experiments on SDP instances from the SDPLib, a benchmark, and structured instances from polynomial and binary quadratic optimisation, we show that combining the two-step pre-processing with a standard interior-point method outperforms the interior point method, with or without the traditional pre-processing, by a considerable margin.

TopoReg: A Topological Regularizer for Classifiers

Regularization plays a crucial role in supervised learning. A successfully regularized model strikes a balance between a perfect description of the training data and the ability to generalize to unseen data. Most existing methods enforce a global regularization in a structure agnostic manner. In this paper, we initiate a new direction and propose to enforce the structural simplicity of the classification boundary by regularizing over its topological complexity. In particular, our measurement of topological complexity incorporates the importance of topological features (e.g., connected components, handles, and so on) in a meaningful manner, and provides a direct control over spurious topological structures. We incorporate the new measurement as a topological loss in training classifiers. We also propose an efficient algorithm to compute the gradient. Our method provides a novel way to topologically simplify the global structure of the model, without having to sacrifice too much of the flexibility of the model. We demonstrate the effectiveness of our new topological regularizer on a range of synthetic and real-world datasets.

Feature Selection for Unsupervised Domain Adaptation using Optimal Transport

In this paper, we propose a new feature selection method for unsupervised domain adaptation based on the emerging optimal transportation theory. We build upon a recent theoretical analysis of optimal transport in domain adaptation and show that it can directly suggest a feature selection procedure leveraging the shift between the domains. Based on this, we propose a novel algorithm that aims to sort features by their similarity across the source and target domains, where the order is obtained by analyzing the coupling matrix representing the solution of the proposed optimal transportation problem. We evaluate our method on a well-known benchmark data set and illustrate its capability of selecting correlated features leading to better classification performances. Furthermore, we show that the proposed algorithm can be used as a pre-processing step for existing domain adaptation techniques ensuring an important speed-up in terms of the computational time while maintaining comparable results. Finally, we validate our algorithm on clinical imaging databases for computer-aided diagnosis task with promising results.

Deep learning in business analytics and operations research: Models, applications and managerial implications

Business analytics refers to methods and practices that create value through data for individuals, firms, and organizations. This field is currently experiencing a radical shift due to the advent of deep learning: deep neural networks promise improvements in prediction performance as compared to models from traditional machine learning. However, our research into the existing body of literature reveals a scarcity of research works utilizing deep learning in our discipline. Accordingly, the objectives of this work are as follows: (1) we motivate why researchers and practitioners from business analytics should utilize deep neural networks and review potential use cases, necessary requirements, and benefits. (2) We investigate the added value to operations research in different case studies with real data from entrepreneurial undertakings. All such cases demonstrate a higher prediction performance in comparison to traditional machine learning and thus direct value gains. (3) We provide guidelines and implications for researchers, managers and practitioners in operations research who want to advance their capabilities for business analytics with regard to deep learning. (4) We finally discuss directions for future research in the field of business analytics.

fc: A Package for Generalized Function Composition Using Standard Evaluation

In this article, we present a new R package fc that provides a streamlined, standard evaluation-based approach to function composition. Using fc, a sequence of functions can be composed together such that returned objects from composed functions are used as intermediate values directly passed to the next function. Unlike with magrittr and purrr, no intermediate values need to be stored. When benchmarked, functions composed using fc achieve favorable runtimes in comparison to other implementations.

Vehicles as sensors: high-accuracy rainfall maps from windshield wiper measurements
Climate entropy production recorded in a deep Antarctic ice core
Multi-core parallel tempering Bayeslands for basin and landscape evolution
On intelligent energy harvesting
I2C Management Based on IPbus
Multimodal Image Denoising based on Coupled Dictionary Learning
Record Linkage to Match Customer Names: A Probabilistic Approach
A Decomposition-Based Many-Objective Evolutionary Algorithm with Local Iterative Update
Weight distributions of all irreducible $μ$-constacyclic codes of length $\ell^n$
Amortized Analysis of Asynchronous Price Dynamics
Towards the Existential Control of Boolean Networks: A Preliminary Report (Extended Abstract)
Framework for High-performance Video Acquisition and Processing in MTCA.4 Form Factor
Sublinear-Time Quadratic Minimization via Spectral Decomposition of Matrices
Efficient representation and approximation of model predictive control laws via deep learning
Uncoupled isotonic regression via minimum Wasserstein deconvolution
Generalized chart constraints for efficient PCFG and TAG parsing
An Optimal Experimental Design Framework for Adaptive Inflation and Covariance Localization for Ensemble Filters
Typical long time behaviour of ground state-transformed jump processes
Limit theorems for invariant distributions
Author-Based Analysis of Conference versus Journal Publication in Computer Science
Dynamic texture analysis with diffusion in networks
Price-Based Market Clearing with V2G Integration Using Generalized Benders Decomposition
The existence of a giant cluster for percolation on large Crump-Mode-Jagers trees
A Hybrid Framework for Tumor Saliency Estimation
A comparative study of artificial intelligence and human doctors for the purpose of triage and diagnosis
Empirical Risk Minimization and Stochastic Gradient Descent for Relational Data
Numerical Simulation of 2.5-Set of Multiple Stratonovich Stochastic Integrals of Multiplicities 1 to 5
Global jump filters and quasi likelihood analysis for volatility
Dynamic traffic resources allocation under elastic demand of users with space-time prism constraints
Deep CNN Denoiser and Multi-layer Neighbor Component Embedding for Face Hallucination
Hierarchical (Deep) Echo State Networks with Uncertainty Quantification for Spatio-Temporal Forecasting
Procedural Level Generation Improves Generality of Deep Reinforcement Learning
Prototype of a multi-host type DAQ front-end system for RI-beam experiments
Risk-averse estimation, an axiomatic approach to inference, and Wallace-Freeman without MML
Robust Neural Malware Detection Models for Emulation Sequence Learning
Contextual bandits with surrogate losses: Margin bounds and efficient algorithms
Two-layer Lossless HDR Coding considering Histogram Sparseness with Backward Compatibility to JPEG
Towards automatic initialization of registration algorithms using simulated endoscopy images
On Optimality of Adaptive Linear-Quadratic Regulators
A Computational Theory for Life-Long Learning of Semantics
Robust Fuzzy-Learning For Partially Overlapping Channels Allocation In UAV Communication Networks
Evaluating Feature Importance Estimates
State-aware Anti-drift Robust Correlation Tracking
Survey of multifidelity methods in uncertainty propagation, inference, and optimization
Estimate of time-scale for the current relaxation of percolative Random Resistor cum Tunneling Network model
Rich Character-Level Information for Korean Morphological Analysis and Part-of-Speech Tagging
Decremental SPQR-trees for Planar Graphs
Successive Convex Approximation Algorithms for Sparse Signal Estimation with Nonconvex Regularizations
Monte Carlo simulations for the optimization and data analysis of experiments with ultracold neutrons
Differentiable Learning-to-Normalize via Switchable Normalization
Accurate and efficient video de-fencing using convolutional neural networks and temporal information
How To Extract Fashion Trends From Social Media A Robust Object Detector With Support For Unsupervised Learning
Truncated Sparse Approximation Property and Truncated $q$-Norm Minimization
Signal Recovery under Cumulative Coherence
Hierarchical Reinforcement Learning with Abductive Planning
Quantitative analysis on the disparity of regional economic development in China and its evolution from 1952 to 2000
$\mathcal{H}_2(t_f)$ Optimality Conditions for a Finite-time Horizon
Concentration bounds for two time scale stochastic approximation
Signal Recovery under Mutual Incoherence Property and Oracle Inequalities
Matrix Recovery from Rank-One Projection Measurements via Nonconvex Minimization
Beyond One-hot Encoding: lower dimensional target embedding
Cyberattack Detection in Intelligent Grids Using Non-linear Filtering
Impact of the Query Set on the Evaluation of Expert Finding Systems
Risk Measures and Credit Risk Under the Beta-Kotz Distribution
Unstable dynamics of model vicinal crystal surfaces: Initial and intermediate stages
Automatic Rank Selection for High-Speed Convolutional Neural Network
Harmonic dynamics of the Abelian sandpile
Deep Learning-Aided Iterative Detector for Massive Overloaded MIMO Channels
An agent-based framework of active matter with applications in biological and social systems
Grassmannian Discriminant Maps (GDM) for Manifold Dimensionality Reduction with Application to Image Set Classification
Coreness of Cooperative Games with Truncated Submodular Profit Functions
CT Image Registration in Acute Stroke Monitoring
Training Discriminative Models to Evaluate Generative Ones
On Lagrangians of $3$-uniform hypergraphs
DeepSDCS: Dissecting cancer proliferation heterogeneity in Ki67 digital whole slide images
The Kazhdan-Lusztig polynomials of uniform matroids
Generalization of LRU Cache Replacement Policy with Applications to Video Streaming
Product matrix processes as limits of random plane partitions
WaveComBox: a Matlab Toolbox for Communications using New Waveforms
Expolring Architectures for CNN-Based Word Spotting
Stochastic approximations to the Pitman-Yor process
Beyond Precision: A Study on Recall of Initial Retrieval with Neural Representations
Weak convergence of the number of vertices at intermediate levels of random recursive trees
Spatiotemporal Prediction of Ambulance Demand using Gaussian Process Regression
Entanglement-assisted quantum error-correcting codes from units
Efficient CNN Implementation for Eye-Gaze Estimation on Low-Power/Low-Quality Consumer Imaging Systems
A supercongruence involving cubes of Catalan numbers
On Low-Complexity Decoding of Product Codes for High-Throughput Fiber-Optic Systems
From clusters to queries: exploiting uncertainty in the modularity landscape of complex networks
ResNet with one-neuron hidden layers is a Universal Approximator
Comparison of the global dynamics for two chemostat-like models: random temporal variation versus spatial heterogeneity
Deep learning for dehazing: Comparison and analysis
Dissipative Linear Stochastic Hamiltonian Systems
When Can a Distributed Ledger Replace a Trusted Third Party
Quantum scarred eigenstates in a Rydberg atom chain: entanglement, breakdown of thermalization, and stability to perturbations
Extremely efficient permutation and bootstrap hypothesis tests using R
Condensation in preferential attachment models with location-based choice
Graphs without $2$-community structures
Effective Wireless Scheduling via Hypergraph Sketches
Performance of Massive MIMO Self-Backhauling for Ultra-Dense Small Cell Deployments
Analysis and Performance of the Barzilai-Borwein Step-Size Rules for Optimization Problems in Hilbert Spaces
A variant of the Erdos-Renyi random graph process
Sparse Sampling for Inverse Problems with Tensors
Semi-automatically optimized calibration of internal combustion engines
High Diversity Attribute Guided Face Generation with GANs
Moderate deviation and central limit theorem for SDDEs with plynomial growth
Learning Implicit Generative Models with the Method of Learned Moments
Modeling Spatio-Temporal Human Track Structure for Action Localization
Decomposing Claw-free Subcubic Graphs and $4$-Chordal Subcubic Graphs
Robust pose tracking with a joint model of appearance and shape
Unscented Kalman Filters for Riemannian State-Space Systems
Typology of phase transitions in Bayesian inference problems
Bayesian optimization of the PC algorithm for learning Gaussian Bayesian networks
Constructing sampling schemes via coupling: Markov semigroups and optimal transport
A Simple Stochastic Variance Reduced Algorithm with Fast Convergence Rates
Semigroup identities of tropical matrices through matrix ranks
Scaling limits for a random boxes model
Deep Semi Supervised Generative Learning for Automated PD-L1 Tumor Cell Scoring on NSCLC Tissue Needle Biopsies
A hierarchical heteroclinic network: Controlling the time evolution along its paths
A Refined Algorithm for Curve Fitting by Segmented Straight Lines
Direct Acceleration of SAGA using Sampled Negative Momentum
Uniqueness in Harper’s vertex-isoperimetric theorem
Optimizing Service Restoration in Distribution Systems with Uncertain Repair Time and Demand
A probabilistic constrained clustering for transfer learning and image category discovery
Decomposable twofold triple systems with non-Hamiltonian 2-block intersection graphs
Mutual-Excitation of Cryptocurrency Market Returns and Social Media Topics
Recovering Trees with Convex Clustering
Predicting CEFRL levels in learner English on the basis of metrics and full texts