Estimation of Change-point Models

We consider the testing and estimation of change-points, locations where the distribution abruptly changes, in a sequence of observations. Motivated by this problem, in this contribution we first investigate the extremes of Gaussian fields with trend which then help us give asymptotic p-value approximations of the likelihood ratio statistics from change-point models.

How Robust are Deep Neural Networks?

Convolutional and Recurrent, deep neural networks have been successful in machine learning systems for computer vision, reinforcement learning, and other allied fields. However, the robustness of such neural networks is seldom apprised, especially after high classification accuracy has been attained. In this paper, we evaluate the robustness of three recurrent neural networks to tiny perturbations, on three widely used datasets, to argue that high accuracy does not always mean a stable and a robust (to bounded perturbations, adversarial attacks, etc.) system. Especially, normalizing the spectrum of the discrete recurrent network to bound the spectrum (using power method, Rayleigh quotient, etc.) on a unit disk produces stable, albeit highly non-robust neural networks. Furthermore, using the \epsilon-pseudo-spectrum, we show that training of recurrent networks, say using gradient-based methods, often result in non-normal matrices that may or may not be diagonalizable. Therefore, the open problem lies in constructing methods that optimize not only for accuracy but also for the stability and the robustness of the underlying neural network, a criterion that is distinct from the other.

How convolutional neural network see the world – A survey of convolutional neural network visualization methods

Nowadays, the Convolutional Neural Networks (CNNs) have achieved impressive performance on many computer vision related tasks, such as object detection, image recognition, image retrieval, etc. These achievements benefit from the CNNs outstanding capability to learn the input features with deep layers of neuron structures and iterative training process. However, these learned features are hard to identify and interpret from a human vision perspective, causing a lack of understanding of the CNNs internal working mechanism. To improve the CNN interpretability, the CNN visualization is well utilized as a qualitative analysis method, which translates the internal features into visually perceptible patterns. And many CNN visualization works have been proposed in the literature to interpret the CNN in perspectives of network structure, operation, and semantic concept. In this paper, we expect to provide a comprehensive survey of several representative CNN visualization methods, including Activation Maximization, Network Inversion, Deconvolutional Neural Networks (DeconvNet), and Network Dissection based visualization. These methods are presented in terms of motivations, algorithms, and experiment results. Based on these visualization methods, we also discuss their practical applications to demonstrate the significance of the CNN interpretability in areas of network design, optimization, security enhancement, etc.

Explainable Recommendation: A Survey and New Perspectives

Explainable Recommendation refers to the personalized recommendation algorithms that address the problem of why — they not only provide the user with the recommendations, but also make the user aware why such items are recommended by generating recommendation explanations, which help to improve the effectiveness, efficiency, persuasiveness, and user satisfaction of recommender systems. In recent years, a large number of explainable recommendation approaches — especially model-based explainable recommendation algorithms — have been proposed and adopted in real-world systems. In this survey, we review the work on explainable recommendation that has been published in or before the year of 2018. We first high-light the position of explainable recommendation in recommender system research by categorizing recommendation problems into the 5W, i.e., what, when, who, where, and why. We then conduct a comprehensive survey of explainable recommendation itself in terms of three aspects: 1) We provide a chronological research line of explanations in recommender systems, including the user study approaches in the early years, as well as the more recent model-based approaches. 2) We provide a taxonomy for explainable recommendation algorithms, including user-based, item-based, model-based, and post-model explanations. 3) We summarize the application of explainable recommendation in different recommendation tasks, including product recommendation, social recommendation, POI recommendation, etc. We devote a chapter to discuss the explanation perspectives in the broader IR and machine learning settings, as well as their relationship with explainable recommendation research. We end the survey by discussing potential future research directions to promote the explainable recommendation research area.

Internal node bagging: an explicit ensemble learning method in neural network training

We introduce a novel view to understand how dropout works as an inexplicit ensemble learning method, which do not point out how many and which nodes to learn a certain feature. We propose a new training method named internal node bagging, this method explicitly force a group of nodes to learn a certain feature in training time, and combine those nodes to be one node in inference time. It means we can use much more parameters to improve model’s fitting ability in training time while keeping model small in inference time. We test our method on several benchmark datasets and find it significantly more efficiency than dropout on small model.

Privately Learning High-Dimensional Distributions

We design nearly optimal differentially private algorithms for learning two fundamental families of high-dimensional distributions in total variation distance: multivariate Gaussians in \mathbb{R}^{d} and product distributions on the hypercube. The sample complexity of both our algorithms approaches the sample complexity of non-private learners up to a small multiplicative factor and an additional additive term that is lower order for a wide range of parameters, showing that privacy comes essentially for free for these problems. Our algorithms use a novel technical approach to reducing the sensitivity of the estimation procedure that we call recursive private preconditioning and may find additional applications.

Efficient Graph Computation for Node2Vec

Node2Vec is a state-of-the-art general-purpose feature learning method for network analysis. However, current solutions cannot run Node2Vec on large-scale graphs with billions of vertices and edges, which are common in real-world applications. The existing distributed Node2Vec on Spark incurs significant space and time overhead. It runs out of memory even for mid-sized graphs with millions of vertices. Moreover, it considers at most 30 edges for every vertex in generating random walks, causing poor result quality. In this paper, we propose Fast-Node2Vec, a family of efficient Node2Vec random walk algorithms on a Pregel-like graph computation framework. Fast-Node2Vec computes transition probabilities during random walks to reduce memory space consumption and computation overhead for large-scale graphs. The Pregel-like scheme avoids space and time overhead of Spark’s read-only RDD structures and shuffle operations. Moreover, we propose a number of optimization techniques to further reduce the computation overhead for popular vertices with large degrees. Empirical evaluation show that Fast-Node2Vec is capable of computing Node2Vec on graphs with billions of vertices and edges on a mid-sized machine cluster. Compared to Spark-Node2Vec, Fast-Node2Vec achieves 7.7–122x speedups.

A Taxonomy for Neural Memory Networks

In this paper, a taxonomy for memory networks is proposed based on their memory organization. The taxonomy includes all the popular memory networks: vanilla recurrent neural network (RNN), long short term memory (LSTM ), neural stack and neural Turing machine and their variants. The taxonomy puts all these networks under a single umbrella and shows their relative expressive power , i.e. vanilla RNN <=LSTM<=neural stack<=neural RAM. The differences and commonality between these networks are analyzed. These differences are also connected to the requirements of different tasks which can give the user instructions of how to choose or design an appropriate memory network for a specific task. As a conceptual simplified class of problems, four tasks of synthetic symbol sequences: counting, counting with interference, reversing and repeat counting are developed and tested to verify our arguments. And we use two natural language processing problems to discuss how this taxonomy helps choosing the appropriate neural memory networks for real world problem.

Boosting Self-Supervised Learning via Knowledge Transfer

In self-supervised learning, one trains a model to solve a so-called pretext task on a dataset without the need for human annotation. The main objective, however, is to transfer this model to a target domain and task. Currently, the most effective transfer strategy is fine-tuning, which restricts one to use the same model or parts thereof for both pretext and target tasks. In this paper, we present a novel framework for self-supervised learning that overcomes limitations in designing and comparing different tasks, models, and data domains. In particular, our framework decouples the structure of the self-supervised model from the final task-specific fine-tuned model. This allows us to: 1) quantitatively assess previously incompatible models including handcrafted features; 2) show that deeper neural network models can learn better representations from the same pretext task; 3) transfer knowledge learned with a deep model to a shallower one and thus boost its learning. We use this framework to design a novel self-supervised task, which achieves state-of-the-art performance on the common benchmarks in PASCAL VOC 2007, ILSVRC12 and Places by a significant margin. Our learned features shrink the mAP gap between models trained via self-supervised learning and supervised learning from 5.9% to 2.6% in object detection on PASCAL VOC 2007.

Postmortem Analysis of Decayed Online Social Communities: Cascade Pattern Analysis and Prediction

Recently, many online social networks, such as MySpace, Orkut, and Friendster, have faced inactivity decay of their members, which contributed to the collapse of these networks. The reasons, mechanics, and prevention mechanisms of such inactivity decay are not fully understood. In this work, we analyze decayed and alive sub-websites from the StackExchange platform. The analysis mainly focuses on the inactivity cascades that occur among the members of these communities. We provide measures to understand the decay process and statistical analysis to extract the patterns that accompany the inactivity decay. Additionally, we predict cascade size and cascade virality using machine learning. The results of this work include a statistically significant difference of the decay patterns between the decayed and the alive sub-websites. These patterns are mainly: cascade size, cascade virality, cascade duration, and cascade similarity. Additionally, the contributed prediction framework showed satisfactory prediction results compared to a baseline predictor. Supported by empirical evidence, the main findings of this work are: (1) the decay process is not governed by only one network measure; it is better described using multiple measures; (2) the expert members of the StackExchange sub-websites were mainly responsible for the activity or inactivity of the StackExchange sub-websites; (3) the Statistics sub-website is going through decay dynamics that may lead to it becoming fully-decayed; and (4) decayed sub-websites were originally less resilient to inactivity decay, unlike the alive sub-websites.

Convolutional neural network for Fourier ptychography video reconstruction: learning temporal dynamics from spatial ensembles
Hardware Implementation of A Non-RLL Soft-decoding Beacon-based Visible Light Communication Receiver
Customized Image Narrative Generation via Interactive Visual Question Generation and Answering
PRBS-free optical compressive sampling for broadband microwave spectrum measurement
Impact of Vehicle-to-Vehicle Communication Reliability on Safety Applications: An Experimental Study
Exclusion of GNSS NLOS Receptions Caused by Dynamic Objects in Heavy Traffic Urban Scenarios Using Real-Time 3D Point Cloud: An Approach without 3D Maps
Deep Co-attention based Comparators For Relative Representation Learning in Person Re-identification
A New Nonconvex Strategy to Affine Matrix Rank Minimization Problem
Towards Deeper Generative Architectures for GANs using Dense connections
Engineering non-equilibrium quantum phase transitions via causally gapped Hamiltonians
Prospects for Declarative Mathematical Modeling of Complex Biological Systems
Automatic Documentation of ICD Codes with Far-Field Speech Recognition
A Multi-State Diagnosis and Prognosis Framework with Feature Learning for Tool Condition Monitoring
Scale-free Resilience of Real Traffic Jams
Non-Intrusive Signature Extraction for Major Residential Loads
Relational to RDF Data Exchange in Presence of a Shape Expression Schema
optimParallel: an R Package Providing Parallel Versions of the Gradient-Based Optimization Methods of optim()
Dimensional reduction in driven disordered systems
Learning Optimal Reserve Price against Non-myopic Bidders
Summation formulas for Fox-Wright function
Equivalent Lipschitz surrogates for zero-norm and rank optimization problems
Ergodicity, Entanglement and Many-Body Localization
Staircase Network: structural language identification via hierarchical attentive units
Explaining Constraint Interaction: How to Interpret Estimated Model Parameters under Alternative Scaling Methods
Stochastic Model Predictive Control for Autonomous Mobility on Demand
A Subquadratic Algorithm for 3XOR
Imputation of mixed data with multilevel singular value decomposition
Fundamentals of Parameterized Complexity Revisited
Colouring (P_r+P_s)-Free Graphs
Connectivity and edge-bipancyclicity of hamming shell
VLC Systems with Fixed-Rate Transmissions under Statistical Queueing Constraints
A complexity dichotomy for Matching Cut in (bipartite) graphs of fixed diameter
Fast and scalable learning of neuro-symbolic representations of biomedical knowledge
Demand-Weighted Completeness Prediction for a Knowledge Base
A Merit Function Approach for Evolution Strategies
Deterministic walks in random environment
OMG – Emotion Challenge Solution
Experimental Verification and Analysis of Dynamic Loop Scheduling in Scientific Applications
Investigations on End-to-End Audiovisual Fusion
Optimal Neural Network Feature Selection for Spatial-Temporal Forecasting
Clustering Meets Implicit Generative Models
Author-topic profiles for academic search
Hyperspectral unmixing with spectral variability using adaptive bundles and double sparsity
A Non-parametric Multi-stage Learning Framework for Cognitive Spectrum Access in IoT Networks
Proof of spending in block-chain systems
Evolution of Visual Odometry Techniques
Cross-Modal Retrieval in the Cooking Context: Learning Semantic Text-Image Embeddings
Q-Map: clinical concept mining with phrase sense disambiguation
On the Stability of Gradient Based Turbulent Flow Control without Regularization
Fast sampling of parameterised Gaussian random fields
Learning Explicit Deep Representations from Deep Kernel Networks
$q$-analogs of group divisible designs
The clustered Sparrow algorithm
Sketch-a-Classifier: Sketch-based Photo Classifier Generation
The idemetric property: when most distances are (almost) the same
Magic squares with empty cells
An Anti-fraud System for Car Insurance Claim Based on Visual Evidence
Distributed deterministic asynchronous algorithms in time-varying graphs through Dykstra splitting
eggCounts: a Bayesian hierarchical toolkit to model faecal egg count reductions
Automatic Metric Validation for Grammatical Error Correction
Decoupling Respiratory and Angular Variation in Rotational X-ray Scans Using a Prior Bilinear Model
DTR-GAN: Dilated Temporal Relational Adversarial Network for Video Summarization
On factor-free Dyck words with half-integer slope
BomJi at SemEval-2018 Task 10: Combining Vector-, Pattern- and Graph-based Information to Identify Discriminative Attributes
Global solutions to elliptic and parabolic $Φ^4$ models in Euclidean space
On the Feasibility of Real-Time 3D Hand Tracking using Edge GPGPU Acceleration
Towards Diverse Text Generation with Inverse Reinforcement Learning
Interpreting weight maps in terms of cognitive or clinical neuroscience: nonsense?
Nonparametric Bayesian inference for Lévy subordinators
Improving Performance of Iterative Methods by Lossy Checkponting
Two extremal problems on intersecting families
Gaussian Process Behaviour in Wide Deep Neural Networks
4D Temporally Coherent Light-field Video
On the Interaction between Autonomous Mobility-on-Demand and Public Transportation Systems
Newsroom: A Dataset of 1.3 Million Summaries with Diverse Extractive Strategies
A Data-Dependent Distance for Regression
Adversarially Robust Generalization Requires More Data
Stack-U-Net: Refinement Network for Image Segmentation on the Example of Optic Disc and Cup
Sampling strategies in Siamese Networks for unsupervised speech representation learning
Improved bounds for the Erdős-Rogers function
SIT measures and Transience
Hybrid Forests for Left Ventricle Segmentation using only the first slice label
Non-smooth optimization for robust control of infinite-dimensional systems
Accelerating NMT Batched Beam Decoding with LMBR Posteriors for Deployment
Supervised learning with quantum enhanced feature spaces
A large deviation principle for the Erdős-Rényi uniform random graph
Multi-Class Management with Sub-Class Service for Autonomous Electric Mobility On-Demand Systems
Optimal error estimates of Galerkin finite element methods for stochastic Allen-Cahn equation with additive noise
On the iterative refinement of densely connected representation levels for semantic segmentation
Ultra Power-Efficient CNN Domain Specific Accelerator with 9.3TOPS/Watt for Mobile and Embedded Applications
Local laws for polynomials of Wigner matrices
Linear maps on graphs preserving a given independence number
A Portuguese Native Language Identification Dataset
Constraining Effective Field Theories with Machine Learning
A Guide to Constraining Effective Field Theories with Machine Learning
Vanishing density of states in weakly disordered Weyl semimetals
Jacobian matrices of Y-seed mutations
Probing many-body localization in the presence of a quantum bath
Identifying Effects of Multivalued Treatments
On improving the approximation ratio of the r-shortest common superstring problem
Machine Learning for Predictive On-Demand Deployment of UAVs for Wireless Communications
Improved Image Captioning with Adversarial Semantic Alignment
Counterfactual Learning-to-Rank for Additive Metrics and Deep Models
Several Topics in Experimental Mathematics
Coherence, entanglement and quantumness in closed and open systems with conserved charge, with an application to many-body localisation
Measuring uncertainty during respiratory rate estimation using pressure-sensitive mats
Comparing time and frequency domain estimation of neonatal respiratory rate using pressure-sensitive mats
Implementation of Artifact Detection in Critical Care: A Methodological Review
Concolic Testing for Deep Neural Networks
Using Multi Expression Programming in Software Effort Estimation
New Methods of Studying Valley Fitness Landscapes
Syntactic Patterns Improve Information Extraction for Medical Search
Non-Simultaneous Charging and Discharging Guarantees in Energy Storage System Models for Home Energy Management Systems
FPGA Acceleration of Short Read Alignment
MV-YOLO: Motion Vector-aided Tracking by Semantic Object Detection
Conditional molecular design with deep generative models
Viability analysis of the first-order mean field games
Identities from representation theory
Counting tropical rational curves with cross-ratio constraints
A Canonical Image Set for Examining and Comparing Image Processing Algorithms
Fixation probabilities for the Moran process in evolutionary games with two strategies: graph shapes and large population asymptotics
Risk-Averse Classification
A Missing Information Loss function for implicit feedback datasets
CrowdHuman: A Benchmark for Detecting Human in a Crowd
Semantic Binary Segmentation using Convolutional Networks without Decoders
URLLC-eMBB Slicing to Support VR Multimodal Perceptions over Wireless Cellular Systems
Dialog-based Interactive Image Retrieval
LED Selection and MAP Detection for Generalized LED Index Modulation
State Diagrams of a Class of Singular LFSR and Their Applications to the Construction of de Bruijn Cycles
Cayley graphs of order kp are hamiltonian for k < 48
Memory-augmented Dialogue Management for Task-oriented Dialogue Systems
On the Equivalence of Generative and Discriminative Formulations of the Sequential Dependence Model
Consensus-based Distributed Quantile Estimation in Sensor Networks
The chromatic number of the plane is at least 5 – a new proof
Detecting Galaxy-Filament Alignments in the Sloan Digital Sky Survey III
Affine Multiplexing Networks: System Analysis, Learning, and Computation
Convolutional Neural Networks Architectures for Signals Supported on Graphs
Multi-Step Knowledge-Aided Iterative ESPRIT for Direction Finding
Low-complexity separable beamformers for massive antenna array systems
Dynamic Sentence Sampling for Efficient Training of Neural Machine Translation
Characteristic quasi-polynomials of ideals and signed graphs of classical root systems
Spectrally Robust Graph Isomorphism
Compact Factorization of Matrices Using Generalized Round-Rank
Phylotastic: An Experiment in Creating, Manipulating, and Evolving Phylogenetic Biology Workflows Using Logic Programming
Response Ranking with Deep Matching Networks and External Knowledge in Information-seeking Conversation Systems
Exploring the Accuracy of MIRT Scale Linking Procedures for Mixed-format Tests
Generic Single Edge Fault Tolerant Exact Distance Oracle
Fixation Data Analysis for High Resolution Satellite Images
Tie-decay temporal networks in continuous time and eigenvector-based centralities
Intrinsic Complexity And Scaling Laws: From Random Fields to Random Vectors
An Annotated Corpus for Machine Reading of Instructions in Wet Lab Protocols
Falsification of Cyber-Physical Systems Using Deep Reinforcement Learning
Controlled Tracking in Urban Terrain: Closing the Loop
Nearly Optimal Distinct Elements and Heavy Hitters on Sliding Windows
Matching on a line
On The Active Input Output Feedback Linearization of Single Link Flexible Joint Manipulator, An Extended State Observer Approach
Locate, Segment and Match: A Pipeline for Object Matching and Registration
Elevation Beamforming with Full Dimension MIMO Architectures in 5G Systems: A Tutorial
The complement of a subspace in a classical polar space
Randomly weighted CNNs for (music) audio classification
Learning to Sketch with Shortcut Cycle Consistency
Nugget Proposal Networks for Chinese Event Detection
Adaptive Scaling for Sparse Detection in Information Extraction
Conditional Image-to-Image Translation
Characterizing Efficient Referrals in Social Networks
Joint Bootstrapping Machines for High Confidence Relation Extraction
A combinatorial proof of the Murnaghan–Nakayama rule
Explicit shading strategies for repeated truthful auctions
On The Design of a Novel Finite-Time Nonlinear Extended State Observer for Class of Nonlinear Systems with Mismatch Disturbances and Uncertainties
Object Activity Scene Description, Construction and Recognition
Some results on the palette index of graphs
Fast and Efficient Depth Map Estimation from Light Fields
Performance Analysis of Distributed Radio Interferometric Calibration
Quantifying macroeconomic expectations in stock markets using Google Trends
Capturing Ambiguity in Crowdsourcing Frame Disambiguation
Multiobjective Optimization Differential Evolution Enhanced with Principle Component Analysis for Constrained Optimization
Stable cylindrical Lévy processes and the stochastic Cauchy problem
A general procedure for detector-response correction of higher order cumulants
Multitask Parsing Across Semantic Representations
Python Framework for HP Adaptive Discontinuous Galerkin Method for Two Phase Flow in Porous Media
Existence of efficient and properly efficient solutions to problems of constrained vector optimization
Macroscopic dynamics of oscillator communities with different frequency distributions
Modeling Risk and Return using Dirichlet Process Prior
Versatile Auxiliary Classifier + Generative Adversarial Network (VAC+GAN); Training Conditional Generators
Separable correlation and maximum likelihood
Diffusive Search with spatially dependent Resetting
Kruskal-Katona type Problem
A Feedback Neural Network for Small Target Motion Detection in Cluttered Backgrounds
Decomposition of tensor products of Demazure crystals
Word2Vec and Doc2Vec in Unsupervised Sentiment Analysis of Clinical Discharge Summaries
Sample-to-Sample Correspondence for Unsupervised Domain Adaptation
Deep Factorization Machines for Knowledge Tracing
Twitter Reveals: Using Twitter Analytics to Predict Public Protests
Which Facial Expressions Can Reveal Your Gender? A Study With 3D Faces
Adaptive group-regularized logistic elastic net regression
Updating Content in Cache-Aided Coded Multicast
Robust Face Recognition with Deeply Normalized Depth Images
Cooperative system of emission source localization based on SDF
A Discrete View of the Indian Monsoon to Identify Spatial Patterns of Rainfall
Non-existence of optimal transport maps for the multi-marginal repulsive harmonic cost
Spatio-temporal Patterns of Indian Monsoon Rainfall
Erdős-Pósa property for labelled minors: 2-connected minors
A Physical Layer Network Coding Design for 5G Network MIMO
An Optimization Approach to the Ordering Phase of an Attended Home Delivery Service
Classification on convex sets in the presence of missing covariates
Coupling and Convergence for Hamiltonian Monte Carlo
Multi-representation Ensembles and Delayed SGD Updates Improve Syntax-based NMT
Viscovery: Trend Tracking in Opinion Forums based on Dynamic Topic Models