Recommender Systems with Random Walks: A Survey

Recommender engines have become an integral component in today’s e-commerce systems. From recommending books in Amazon to finding friends in social networks such as Facebook, they have become omnipresent. Generally, recommender systems can be classified into two main categories: content based and collaborative filtering based models. Both these models build relationships between users and items to provide recommendations. Content based systems achieve this task by utilizing features extracted from the context available, whereas collaborative systems use shared interests between user-item subsets. There is another relatively unexplored approach for providing recommendations that utilizes a stochastic process named random walks. This study is a survey exploring use cases of random walks in recommender systems and an attempt at classifying them.

Semi-Supervised Learning via New Deep Network Inversion

We exploit a recently derived inversion scheme for arbitrary deep neural networks to develop a new semi-supervised learning framework that applies to a wide range of systems and problems. The approach outperforms current state-of-the-art methods on MNIST reaching 99.14\% of test set accuracy while using 5 labeled examples per class. Experiments with one-dimensional signals highlight the generality of the method. Importantly, our approach is simple, efficient, and requires no change in the deep network architecture.

Randomized Near Neighbor Graphs, Giant Components, and Applications in Data Science

If we pick n random points uniformly in [0,1]^d and connect each point to its k-nearest neighbors, then it is well known that there exists a giant connected component with high probability. We prove that in [0,1]^d it suffices to connect every point to c_{d,1} \log{\log{n}} points chosen randomly among its c_{d,2} \log{n}-nearest neighbors to ensure a giant component of size n - o(n) with high probability. This construction yields a much sparser random graph with \sim n \log\log{n} instead of \sim n \log{n} edges that has comparable connectivity properties. This result has nontrivial implications for problems in data science where an affinity matrix is constructed: instead of picking the k-nearest neighbors, one can often pick k' \ll k random points out of the k-nearest neighbors without sacrificing efficiency. This can massively simplify and accelerate computation, we illustrate this with several numerical examples.

ADaPTION: Toolbox and Benchmark for Training Convolutional Neural Networks with Reduced Numerical Precision Weights and Activation

Deep Neural Networks (DNNs) and Convolutional Neural Networks (CNNs) are useful for many practical tasks in machine learning. Synaptic weights, as well as neuron activation functions within the deep network are typically stored with high-precision formats, e.g. 32 bit floating point. However, since storage capacity is limited and each memory access consumes power, both storage capacity and memory access are two crucial factors in these networks. Here we present a method and present the ADaPTION toolbox to extend the popular deep learning library Caffe to support training of deep CNNs with reduced numerical precision of weights and activations using fixed point notation. ADaPTION includes tools to measure the dynamic range of weights and activations. Using the ADaPTION tools, we quantized several CNNs including VGG16 down to 16-bit weights and activations with only 0.8% drop in Top-1 accuracy. The quantization, especially of the activations, leads to increase of up to 50% of sparsity especially in early and intermediate layers, which we exploit to skip multiplications with zero, thus performing faster and computationally cheaper inference.

A Robust Variable Step Size Fractional Least Mean Square (RVSS-FLMS) Algorithm

In this paper, we propose an adaptive framework for the variable step size of the fractional least mean square (FLMS) algorithm. The proposed algorithm named the robust variable step size-FLMS (RVSS-FLMS), dynamically updates the step size of the FLMS to achieve high convergence rate with low steady state error. For the evaluation purpose, the problem of system identification is considered. The experiments clearly show that the proposed approach achieves better convergence rate compared to the FLMS and adaptive step-size modified FLMS (AMFLMS).

Dynamic Principal Projection for Cost-Sensitive Online Multi-Label Classification

We study multi-label classification (MLC) with three important real-world issues: online updating, label space dimensional reduction (LSDR), and cost-sensitivity. Current MLC algorithms have not been designed to address these three issues simultaneously. In this paper, we propose a novel algorithm, cost-sensitive dynamic principal projection (CS-DPP) that resolves all three issues. The foundation of CS-DPP is an online LSDR framework derived from a leading LSDR algorithm. In particular, CS-DPP is equipped with an efficient online dimension reducer motivated by matrix stochastic gradient, and establishes its theoretical backbone when coupled with a carefully-designed online regression learner. In addition, CS-DPP embeds the cost information into label weights to achieve cost-sensitivity along with theoretical guarantees. Experimental results verify that CS-DPP achieves better practical performance than current MLC algorithms across different evaluation criteria, and demonstrate the importance of resolving the three issues simultaneously.

Robust Matrix Elastic Net based Canonical Correlation Analysis: An Effective Algorithm for Multi-View Unsupervised Learning

This paper presents a robust matrix elastic net based canonical correlation analysis (RMEN-CCA) for multiple view unsupervised learning problems, which emphasizes the combination of CCA and the robust matrix elastic net (RMEN) used as coupled feature selection. The RMEN-CCA leverages the strength of the RMEN to distill naturally meaningful features without any prior assumption and to measure effectively correlations between different ‘views’. We can further employ directly the kernel trick to extend the RMEN-CCA to the kernel scenario with theoretical guarantees, which takes advantage of the kernel trick for highly complicated nonlinear feature learning. Rather than simply incorporating existing regularization minimization terms into CCA, this paper provides a new learning paradigm for CCA and is the first to derive a coupled feature selection based CCA algorithm that guarantees convergence. More significantly, for CCA, the newly-derived RMEN-CCA bridges the gap between measurement of relevance and coupled feature selection. Moreover, it is nontrivial to tackle directly the RMEN-CCA by previous optimization approaches derived from its sophisticated model architecture. Therefore, this paper further offers a bridge between a new optimization problem and an existing efficient iterative approach. As a consequence, the RMEN-CCA can overcome the limitation of CCA and address large-scale and streaming data problems. Experimental results on four popular competing datasets illustrate that the RMEN-CCA performs more effectively and efficiently than do state-of-the-art approaches.

Deep Rewiring: Training very sparse deep networks

Neuromorphic hardware tends to pose limits on the connectivity of deep networks that one can run on them. But also generic hardware and software implementations of deep learning run more efficiently on sparse networks. Several methods exist for pruning connections of a neural network after it was trained without connectivity constraints. We present an algorithm, DEEP R, that enables us to train directly a sparsely connected neural network. DEEP R automatically rewires the network during supervised training so that connections are there where they are most needed for the task, while its total number is all the time strictly bounded. We demonstrate that DEEP R can be used to train very sparse feedforward and recurrent neural networks on standard benchmark tasks with just a minor loss in performance. DEEP R is based on a rigorous theoretical foundation that views rewiring as stochastic sampling of network configurations from a posterior.

Conditional Autoencoders with Adversarial Information Factorization

Generative models, such as variational auto-encoders (VAE) and generative adversarial networks (GAN), have been immensely successful in approximating image statistics in computer vision. VAEs are useful for unsupervised feature learning, while GANs alleviate supervision by penalizing inaccurate samples using an adversarial game. In order to utilize benefits of these two approaches, we combine the VAE under an adversarial setup with auxiliary label information. We show that factorizing the latent space to separate the information needed for reconstruction (a continuous space) from the information needed for image attribute classification (a discrete space), enables the capability to edit specific attributes of an image.

A superpolynomial lower bound for the size of non-deterministic complement of an unambiguous automaton
Distances from points to planes
Metric dimension of dual polar graphs
How fragile are information cascades?
On the smallest parallel quadrangulation with minimum degree 3
Speed of convergence to the quasi-stationary distribution for Lévy input fluid queues
One-Bit ExpanderSketch for One-Bit Compressed Sensing
On The Time Constant for Last Passage Percolation on Complete Graph
Communication Complexity of Discrete Fair Division
Symmetric weighted odd-power variations of fractional Brownian motion and applications
The energy change of the complete multipartite graph
On aggregation of multitype Galton-Watson branching processes with immigration
Optimal Two-Stage Programming for Integration of PHEV Parking Lots in Industrial Microgrids
On the minimum distance of intertwining codes
Large polaron evolution in anatase TiO2 due to carrier and temperature dependence of electron-phonon coupling
Disjoint covering systems and the reversion of the Möbius series
From randomness in two symbols to randomness in three symbols
A Mean Field Games approach for multi-lane traffic management
Disease Prediction from Electronic Health Records Using Generative Adversarial Networks
Interpretable probabilistic embeddings: bridging the gap between topic models and neural networks
End-to-end Video-Level Representation Learning for Action Recognition
CUR Decompositions, Similarity Matrices, and Subspace Clustering
A counterexample for equivalence result between tails behavior and Grand Lebesgue Spaces norms
A Constructive Lower Bound on Szemerédi’s Theorem
A distributed system for SearchOnMath based on the Microsoft BizSpark program
An efficient streaming algorithm for spectral proper orthogonal decomposition
Building machines that adapt and compute like brains
Rationality of Poincaré Series for a Family of Lattice Simplices
Practical Scalability for Stackelberg Security Games
On the favorite points of symmetric Lévy processes
Pairs of disjoint cycles
Higher dimensional electrical circuits and the matroid dual of a nonplanar graph
Linking Sequences of Events with Sparse or No Common Occurrence across Data Sets
On the Synthesis of Guaranteed-Quality Plans for Robot Fleets in Logistics Scenarios via Optimization Modulo Theories
Evaluation of trackers for Pan-Tilt-Zoom Scenarios
Meagerness of the set of subsequences preserving cluster and limit points
Do cells sense time by number of divisions?
Covariance structure behind breaking of ensemble equivalence in random graphs
Absolute regularity of semi-contractive GARCH-type processes
On the ERM Principle with Networked Data
On the stabilization of a hyperbolic Stokes system under geometric control condition
Self-Regulating Artificial General Intelligence
Extremely Large Minibatch SGD: Training ResNet-50 on ImageNet in 15 Minutes
The SPDE approach for Gaussian random fields with general smoothness
An inverse theorem for the Kemperman inequality
Alpha-Divergences in Variational Dropout
Deep Networks tag the location of bird vocalisations on audio spectrograms
Hypergraph encodings of arbitrary toric ideals
On k-Total Dominating Graphs
Longest Alignment with Edits in Data Streams
Should You Derive, Or Let the Data Drive? An Optimization Framework for Hybrid First-Principles Data-Driven Modeling
Networks of infinite-server queues with multiplicative transitions
Uniform Inference for Conditional Factor Models with Instrumental and Idiosyncratic Betas
Circularly-Coupled Markov Chain Sampling
A Refutation of Guinea’s ‘Understanding SAT is in P’
On semiregularity of mappings
Grothendieck constant is norm of Strassen matrix multiplication tensor
Visual Concepts and Compositional Voting
Word, Subword or Character? An Empirical Study of Granularity in Chinese-English NMT
On the boundary between qualitative and quantitative methods for causal inference
Tight Cell Probe Bounds for Succinct Boolean Matrix-Vector Multiplication
Persuasion with limited communication resources
Stable project allocation under distributional constraints
Information Design for Strategic Coordination of Autonomous Devices with Non-Aligned Utilities
Linear-Time Algorithms for Maximum-Weight Induced Matchings and Minimum Chain Covers in Convex Bipartite Graphs
Consensus Halving is PPA-Complete
Tilings with noncongruent triangles
A Supervised Learning Concept for Reducing User Interaction in Passenger Cars
Lah numbers and Lindström’s lemma
Vertebral body segmentation with GrowCut: Initial experience, workflow and practical application
Early warning signal for interior crises in excitable systems
Folding Phenomenon of Major-balance Identities on Restricted Involutions
Smaller parameters for vertex cover kernelization
Provably efficient neural network representation for image classification
Preserving Reliability to Heterogeneous Ultra-Dense Distributed Networks in Unlicensed Spectrum
Three Factors Influencing Minima in SGD
Configuration Graph Cohomology
Scaling of sub-ballistic 1D Random Walks among biased Random Conductances
Integer quantum Hall transition in a $\textit{fraction}$ of a Landau level
Localization of the continuous Anderson Hamiltonian in $1$-d
Stampery Blockchain Timestamping Architecture (BTA) – Version 6
Towards a Converse for the Nearest Lattice Point Problem
Cheating by Duplication: Equilibrium Requires Global Knowledge
Zero-Shot Style Transfer in Text Using Recurrent Neural Networks
Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice
An insertion algorithm over staircase tableaux compatible with the ASEP’s matrix ansatz
Partitioning $2$-coloured complete $k$-uniform hypergraphs into monochromatic $\ell$-cycles
Quasirandomness in hypergraphs
ACtuAL: Actor-Critic Under Adversarial Learning
Machine Learning Meets Microeconomics: The Case of Decision Trees and Discrete Choice
Improving Factor-Based Quantitative Investing by Forecasting Company Fundamentals
Cooperative data-driven distributionally robust optimization
Invariances and Data Augmentation for Supervised Music Transcription
Denoising Imaging Polarimetry by Adapted BM3D Method
Modeling Human Categorization of Natural Images Using Deep Feature Representations
Random Coxeter Groups
Packing degenerate graphs
Convergence of uniform noncrossing partitions toward the Brownian triangulation
Equilibrium phases of dipolar lattice bosons in the presence of random diagonal disorder
On Partial Covering For Geometric Set Systems
Accelerating HPC codes on Intel(R) Omni-Path Architecture networks: From particle physics to Machine Learning
pyLEMMINGS: Large Margin Multiple Instance Classification and Ranking for Bioinformatics Applications
Adversarial Symmetric Variational Autoencoder
Anomalous vibrational properties in the continuum limit of glasses
Poisson Statistics in the Non-Homogeneous Hierarchical Anderson Model
Tree-Based Unrooted Nonbinary Phylogenetic Networks
Sparse High-Dimensional Linear Regression. Algorithmic Barriers and a Local Search Algorithm
Impartial Triangular Chocolate Bar Games
Classical Structured Prediction Losses for Sequence to Sequence Learning
Towards Human-level Machine Reading Comprehension: Reasoning and Inference with Multiple Strategies
Near-optimal sample complexity for convex tensor completion
Coherent wave transmission in quasi-one-dimensional systems with Lévy disorder
Straggler Mitigation in Distributed Optimization Through Data Encoding
DataVizard: Recommending Visual Presentations for Structured Data
Robust Online Speed Scaling With Deadline Uncertainty
Quantum transport senses community structure in networks
SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring
A generalised Euler-Poincaré formula for associahedra
Unified Pragmatic Models for Generating and Following Instructions
Concurrent Pump Scheduling and Storage Level Optimization Using Meta-Models and Evolutionary Algorithms
Morphology of Critically-Sized Crystalline Nuclei at Shear-Induced Crystal Nucleation in Amorphous Solid
Strong consistency and optimality for generalized estimating equations with stochastic covariates
Feature importance scores and lossless feature pruning using Banzhaf power indices
Prediction Under Uncertainty with Error-Encoding Networks
A criterion for the differential flatness of a nonlinear control system
Weak uniqueness for SDEs driven by supercritical stable processes with Holder drifts
Combinatorial Wall Crossing and the Mullineux Involution
Quasi-independence for nodal lines
The critical threshold for Bargmann-Fock percolation
The $r$-matching sequencibility of complete graphs
A note on Tamari intervals
Joint Large Deviation principle for empirical measures of the d-regular random graphs
Energy-Delay-Distortion Problem
Grundy Numbers of Impartial Chocolate Bar Games
Multiple-Source Adaptation for Regression Problems
A detectability criterion and data assimilation for non-linear differential equations
Influence of a range of interaction among agents on efficiency and effectiveness of knowledge transfer within an organisation
Learning an Executable Neural Semantic Parser
DuReader: a Chinese Machine Reading Comprehension Dataset from Real-world Applications
Symmetric Decomposition of Asymmetric Games
A unified decision making framework for supply and demand management in microgrid networks
TripletGAN: Training Generative Model with Triplet Loss
The mixability of elliptical distributions with supermodular functions
Efficiency Analysis of ASP Encodings for Sequential Pattern Mining Tasks
How long is a piece of string? An exploration of multi-winner approval voting and ballot-length restrictions
Web Robot Detection in Academic Publishing
Fixing Weight Decay Regularization in Adam
The Multi-layer Information Bottleneck Problem
An optimized shape descriptor based on structural properties of networks
An Empirical Study of the Effects of Spurious Transitions on Abstraction-based Heuristics
Weak Convergence of Sequential Empirical Processes under Weak Dependence
A Hierarchical Contextual Attention-based GRU Network for Sequential Recommendation
Evidence Aggregation for Answer Re-Ranking in Open-Domain Question Answering
GOE and ${\rm Airy}_{2\to 1}$ marginal distribution via symplectic Schur functions
Preconditioned proximal point methods and notions of partial subregularity
Grab, Pay and Eat: Semantic Food Detection for Smart Restaurants
Coexistence of stable limit cycles in a generalized Curie-Weiss model with dissipation
Similarity-Aware Spectral Sparsification by Edge Filtering
A Note on the Quasi-Stationary Distribution of the Shiryaev Martingale on the Positive Half-Line
XGAN: Unsupervised Image-to-Image Translation for many-to-many Mappings
Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness
Restoration by Compression
Fast and reliable inference algorithm for hierarchical stochastic block models
A note on the complexity of Feedback Vertex Set parameterized by mim-width
Saliency-based Sequential Image Attention with Multiset Prediction
Robust Keyframe-based Dense SLAM with an RGB-D Camera
On Extending Neural Networks with Loss Ensembles for Text Classification
Near-Optimal Discrete Optimization for Experimental Design: A Regret Minimization Approach
False Positive and Cross-relation Signals in Distant Supervision Data
Dynamic Zoom-in Network for Fast Object Detection in Large Images
CryptoDL: Deep Neural Networks over Encrypted Data
Restricted power domination and zero forcing problems