Model assessment for time series dynamics using copula spectral densities: a graphical tool

Finding parametric models that accurately describe the dependence structure of observed data is a central task in the analysis of time series. Classical frequency domain methods provide a popular set of tools for fitting and diagnostics of time series models, but their applicability is seriously impacted by the limitations of covariances as a measure of dependence. Motivated by recent developments of frequency domain methods that are based on copulas instead of covariances, we propose a novel graphical tool that allows to access the quality of time series models for describing dependencies that go beyond linearity. We provide a thorough theoretical justification of our approach and show in simulations that it can successfully distinguish between subtle differences of time series dynamics, including non-linear dynamics which result from GARCH and EGARCH models.

Online Multi-Label Classification: A Label Compression Method

Many modern applications deal with multi-label data, such as functional categorizations of genes, image labeling and text categorization. Classification of such data with a large number of labels and latent dependencies among them is a challenging task, and it becomes even more challenging when the data is received online and in chunks. Many of the current multi-label classification methods require a lot of time and memory, which make them infeasible for practical real-world applications. In this paper, we propose a fast linear label space dimension reduction method that transforms the labels into a reduced encoded space and trains models on the obtained pseudo labels. Additionally, it provides an analytical method to update the decoding matrix which maps the labels into the original space and is used during the test phase. Experimental results show the effectiveness of this approach in terms of running times and the prediction performance over different measures.

Robust Verification of Numerical Software

Numerical software are widely used in safety-critical systems such as aircrafts, satellites, car engines and so on, facilitating dynamics control of such systems in real time, it is therefore absolutely necessary to verify their correctness. It is a long standing challenge to guarantee verified properties of numerical software are indeed satisfied by their real behaviours, because most of these verifications are conducted under ideal mathematical models, but their real executions could be influenced essentially by uncertain inputs accounting for round-off errors and additive perturbations from real-world phenomena to hardware, which are abstracted away in these ideal mathematical models. In this paper, we attempt to address this issue focusing on nontermination analysis of numerical software, where nontermination is often an unexpected behaviour of computer programs and may be problematic for applications such as real-time systems having hard deadlines on transaction execution time, and propose a control-theoretic framework for robust conditional nontermination analysis, which can be used to under-approximate the maximal robust nontermination input set for a given program, from which the program never terminates, regardless of the aforementioned disturbances.

Vanlearning: A Machine Learning SaaS Application for People Without Programming Backgrounds

Although we have tons of machine learning tools to analyze data, most of them require users have some programming backgrounds. Here we introduce a SaaS application which allows users analyze their data without any coding and even without any knowledge of machine learning. Users can upload, train, predict and download their data by simply clicks their mouses. Our system uses data pre-processor and validator to relieve the computational cost of our server. The simple architecture of Vanlearning helps developers can easily maintain and extend it.

Designing a Micro-Benchmark Suite to Evaluate gRPC for TensorFlow: Early Experiences

Remote procedure call (RPC) is the backbone of many modern distributed systems. Google’s gRPC is one of the most popular open source RPC frameworks available in the community. gRPC is the main communication engine for Google’s Deep Learning framework TensorFlow. TensorFlow primarily uses gRPC for communicating tensors and administrative tasks among different processes. Tensor updates during the training phase are communication intensive and thus TensorFlow’s performance is heavily dependent on the underlying network and the efficacy of the communication engine. Training deep learning models on TensorFlow can take significant time ranging from several minutes to several hours, even several days. Thus system researchers need to devote a lot of time to understand the impact of communication on the overall performance. Clearly, there is lack of benchmarks available for system researchers. Therefore, we propose TF-gRPC-Bench micro-benchmark suite that enables system researchers to quickly understand the impact of the underlying network and communication runtime on deep learning workloads. To achieve this, we first analyze the characteristics of TensorFlow workload over gRPC by training popular deep learning models. Then, we propose three micro-benchmarks that take account these workload characteristics. In addition, we comprehensively evaluate gRPC with TF-gRPC-Bench micro-benchmark suite on different clusters over Ethernet, IPoIB, and RDMA, and present the results.

Artificial Intelligence and its Role in Near Future

AI technology has a long history which is actively and constantly changing and growing. It focuses on intelligent agents, which contain devices that perceive the environment and based on which takes actions in order to maximize goal success chances. In this paper, we will explain the modern AI basics and various representative applications of AI. In the context of the modern digitalized world, AI is the property of machines, computer programs, and systems to perform the intellectual and creative functions of a person, independently find ways to solve problems, be able to draw conclusions and make decisions. Most artificial intelligence systems have the ability to learn, which allows people to improve their performance over time. The recent research on AI tools, including machine learning, deep learning and predictive analysis intended toward increasing the planning, learning, reasoning, thinking and action taking ability. Based on which, the proposed research intends towards exploring on how the human intelligence differs from the artificial intelligence. Moreover, we critically analyze what AI of today is capable of doing, why it still cannot reach human intelligence and what are the open challenges existing in front of AI to reach and outperform human level of intelligence. Furthermore, it will explore the future predictions for artificial intelligence and based on which potential solution will be recommended to solve it within next decades.

Renewal Monte Carlo: Renewal theory based reinforcement learning

In this paper, we present an online reinforcement learning algorithm, called Renewal Monte Carlo (RMC), for infinite horizon Markov decision processes with a designated start state. RMC is a Monte Carlo algorithm and retains the advantages of Monte Carlo methods including low bias, simplicity, and ease of implementation while, at the same time, circumvents their key drawbacks of high variance and delayed (end of episode) updates. The key ideas behind RMC are as follows. First, under any reasonable policy, the reward process is ergodic. So, by renewal theory, the performance of a policy is equal to the ratio of expected discounted reward to the expected discounted time over a regenerative cycle. Second, by carefully examining the expression for performance gradient, we propose a stochastic approximation algorithm that only requires estimates of the expected discounted reward and discounted time over a regenerative cycle and their gradients. We propose two unbiased estimators for evaluating performance gradients—a likelihood ratio based estimator and a simultaneous perturbation based estimator—and show that for both estimators, RMC converges to a locally optimal policy. We generalize the RMC algorithm to post-decision state models and also present a variant that converges faster to an approximately optimal policy. We conclude by presenting numerical experiments on a randomly generated MDP, event-triggered communication, and inventory management.

Feature selection in weakly coherent matrices

A problem of paramount importance in both pure (Restricted Invertibility problem) and applied mathematics (Feature extraction) is the one of selecting a submatrix of a given matrix, such that this submatrix has its smallest singular value above a specified level. Such problems can be addressed using perturbation analysis. In this paper, we propose a perturbation bound for the smallest singular value of a given matrix after appending a column, under the assumption that its initial coherence is not large, and we use this bound to derive a fast algorithm for feature extraction.

The Logical Essentials of Bayesian Reasoning

This chapter offers an accessible introduction to the channel-based approach to Bayesian probability theory. This framework rests on algebraic and logical foundations, inspired by the methodologies of programming language semantics. It offers a uniform, structured and expressive language for describing Bayesian phenomena in terms of familiar programming concepts, like channel, predicate transformation and state transformation. The introduction also covers inference in Bayesian networks, which will be modelled by a suitable calculus of string diagrams.

Pure gaps on curves with many rational places
Estimation of Channel Parameters in a Multipath Environment via Optimizing Highly Oscillatory Error-Functions Using a Genetic Algorithm
Patch-based Face Recognition using a Hierarchical Multi-label Matcher
Triameter of Graphs
Unsupervised Semantic-based Aggregation of Deep Convolutional Features
A study of Inverse Ultra-discretization of cellular automata
Unsupervised Geometry-Aware Representation for 3D Human Pose Estimation
Visual Object Categorization Based on Hierarchical Shape Motifs Learned From Noisy Point Cloud Decompositions
Synthesizing Programs for Images using Reinforced Adversarial Learning
Probing Physics Knowledge Using Tools from Developmental Psychology
A Modified Image Comparison Algorithm Using Histogram Features
Self-Organization and Artificial Life: A Review
Socioeconomic Dependencies of Linguistic Patterns in Twitter: A Multivariate Analysis
Crystal Loss and Quality Pooling for Unconstrained Face Verification and Recognition
Bohr sets in triple products of large sets in amenable groups
Applying Computer Algebra Systems and SAT Solvers to the Williamson Conjecture
Towards Deep Learning based Hand Keypoints Detection for Rapid Sequential Movements from RGB Images
Looking at Hands in Autonomous Vehicles: A ConvNet Approach using Part Affinity Fields
Steering Random Spin Systems to Speed up the Quantum Adiabatic Algorithm
Query Shortest Paths Amidst Growing Discs
Predictive and Prescriptive Analytics for Location Selection of Add-on Retail Products
A Mixture Model to Detect Edges in Sparse Co-expression Graphs
Neural-Guided Deductive Search for Real-Time Program Synthesis from Examples
On the Existence of Uniformly Most Powerful Bayesian Tests With Application to Non-Central Chi-Squared Tests
Hospital Readmission Prediction – Applying Hierarchical Sparsity Norms for Interpretable Models
Real-Time Prediction of the Duration of Distribution System Outages
A Fixed Point Theorem for Iterative Random Contraction Operators over Banach Spaces
Determinants of Binomial-Related Circulant Matrices
Variable selection using pseudo-variables
An integration of fast alignment and maximum-likelihood methods for electron subtomogram averaging and classification
Remarks on singular Cayley graphs and vanishing elements of simple groups
Interval partition evolutions with emigration related to the Aldous diffusion
A Euclidean Algorithm for Binary Cycles with Minimal Variance
Should We Condition on the Test for Pre-trends in Difference-in-Difference Designs?
A Segmentation-aware Deep Fusion Network for Compressed Sensing MRI
Constructions for optimal Ferrers diagram rank-metric codes
A duality for labeled graphs and factorizations with applications to graph embeddings and Hurwitz enumeration
Rigidity of the $\operatorname{Sine}_β$ process
Tight Query Complexity Lower Bounds for PCA via Finite Sample Deformed Wigner Law
Self-Supervised Adversarial Hashing Networks for Cross-Modal Retrieval
The noise barrier and the large signal bias of the Lasso and other convex estimators
Discriminative Cross-View Binary Representation Learning
Information Maximizing Exploration with a Latent Dynamics Model
Decompositions of $n$-Cube into $2^mn$-Cycles
NegPSpan: efficient extraction of negative sequential patterns with embedding constraints
A degree sum condition on the order, the connectivity and the independence number for Hamiltonicity
Building Efficient CNN Architecture for Offline Handwritten Chinese Character Recognition
Robust Discrimination between Long-Range Dependence and a Change in Mean
On approximate least squares estimators of parameters on one-dimensional chirp signal
Phase-response analysis of synchronization for periodic flows
Maintenance of Strongly Connected Component in Shared-memory Graph
Mechanism of solitary state appearance in an ensemble of nonlocally coupled Lozi maps
Nonexistence of generalized bent functions and the quadratic norm form equations
Enumeration of Łukasiewicz paths modulo some patterns
Gaussian Process Uncertainty in Age Estimation as a Measure of Brain Abnormality
Permutation trinomials over $\mathbb{F}_{q^3}$
A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimation
Btrfly Net: Vertebrae Labelling with Energy-based Adversarial Learning of Local Spine Prior
A Deterministic Distributed $2$-Approximation for Weighted Vertex Cover in $O(\log n\logΔ/ \log^2\logΔ)$ Rounds
Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Cars
Heat kernels of non-symmetric Lévy-type operators
When Hypermutations and Ageing Enable Artificial Immune Systems to Outperform Evolutionary Algorithms
Rainbow triangles and the Caccetta-Häggkvist conjecture
A Multi-Stage Multi-Task Neural Network for Aerial Scene Interpretation and Geolocalization
Resistance matrices of graphs with matrix weights
Irreducible infeasible subsystems of semidefinite systems
An Imprecise Probabilistic Estimator for the Transition Rate Matrix of a Continuous-Time Markov Chain
Generalized Burgers equation with rough transport noise
Normalized Cut Loss for Weakly-supervised CNN Segmentation
Sub-exponential convergence to equilibrium for Gaussian driven Stochastic Differential Equations with semi-contractive drift
Binary Signaling under Subjective Priors and Costs as a Game
Distributed interpolatory algorithms for set membership estimation
Bayesian model selection with fractional Brownian motion
Losing Treewidth by Separating Subsets
A latent variable model to measure exposure diversification in the Austrian interbank market
Optimal Rendezvous ${\mathcal L}$-Algorithms for Asynchronous Mobile Robots with External-Lights
Fine-grained Video Attractiveness Prediction Using Multimodal Deep Learning on a Large Real-world Dataset
Efficient Algorithm for Model Predictive Control of System of Systems via Parametric Optimization
Derangement action digraphs and graphs
SketchMate: Deep Hashing for Million-Scale Human Sketch Retrieval
R2RML Mappings in OBDA Systems: Enabling Comparison among OBDA Tools
Random walks in hypergeometric random environments
The maximal degree in a Poisson-Delaunay graph
Dynamic modeling of enzyme controlled metabolic networks using a receding time horizon
A note on exponential decay in the random field Ising model
Representing Videos based on Scene Layouts for Recognizing Agent-in-Place Actions
Controllable Identifier Measurements for Private Authentication with Secret Keys
Posterior Inference for Sparse Hierarchical Non-stationary Models
Learning Discriminative Features with Multiple Granularities for Person Re-Identification
The Cone of Cyclic Sieving Phenomena
Jointly Discovering Visual Objects and Spoken Words from Raw Sensory Input
Beta regression control chart for monitoring fractions and proportions
Shape-Constrained Univariate Density Estimation
Gaussian Process Subset Scanning for Anomalous Pattern Detection in Non-iid Data
Cost-Benefit Analysis of Moving-Target Defense in Power Grids
Hypergraph Laplace Operators for Chemical Reaction Networks
Personal Volunteer Computing
Clinical Concept Embeddings Learned from Massive Sources of Medical Data
Predicting neural network dynamics via graphical analysis
Sparse non-negative super-resolution – simplified and stabilised
Density Adaptive Point Set Registration
A Tutte polynomial for maps II: the non-orientable case
The Capacity of Anonymous Communications
Abstractive Tabular Dataset Summarization via Knowledge BaseSemantic Embeddings
The Tsetlin Machine – A Game Theoretic Bandit Driven Approach to Optimal Pattern Recognition with Propositional Logic
Stochastic Adversarial Video Prediction