Causal effects based on distributional distances

We develop a novel framework for estimating causal effects based on the discrepancy between unobserved counterfactual distributions. In our setting a causal effect is defined in terms of the L_1 distance between different counterfactual outcome distributions, rather than a mean difference in outcome values. Directly comparing counterfactual outcome distributions can provide more nuanced and valuable information about causality than a simple comparison of means. We consider single- and multi-source randomized studies, as well as observational studies, and analyze error bounds and asymptotic properties of the proposed estimators. We further propose methods to construct confidence intervals for the unknown mean distribution distance. Finally, we illustrate the new methods and verify their effectiveness in empirical studies.

Data-driven Analytics for Business Architectures: Proposed Use of Graph Theory

Business Architecture (BA) plays a significant role in helping organizations understand enterprise structures and processes, and align them with strategic objectives. However, traditional BAs are represented in fixed structure with static model elements and fail to dynamically capture business insights based on internal and external data. To solve this problem, this paper introduces the graph theory into BAs with aim of building extensible data-driven analytics and automatically generating business insights. We use IBM’s Component Business Model (CBM) as an example to illustrate various ways in which graph theory can be leveraged for data-driven analytics, including what and how business insights can be obtained. Future directions for applying graph theory to business architecture analytics are discussed.

Orbital Petri Nets: A Novel Petri Net Approach

Petri Nets is very interesting tool for studying and simulating different behaviors of information systems. It can be used in different applications based on the appropriate class of Petri Nets whereas it is classical, colored or timed Petri Nets. In this paper we introduce a new approach of Petri Nets called orbital Petri Nets (OPN) for studying the orbital rotating systems within a specific domain. The study investigated and analyzed OPN with highlighting the problem of space debris collision problem as a case study. The mathematical investigation results of two OPN models proved that space debris collision problem can be prevented based on the new method of firing sequence in OPN. By this study, new smart algorithms can be implemented and simulated by orbital Petri Nets for mitigating the space debris collision problem as a next work.

Temporal Difference Variational Auto-Encoder

One motivation for learning generative models of environments is to use them as simulators for model-based reinforcement learning. Yet, it is intuitively clear that when time horizons are long, rolling out single step transitions is inefficient and often prohibitive. In this paper, we propose a generative model that learns state representations containing explicit beliefs about states several time steps in the future and that can be rolled out directly in these states without executing single step transitions. The model is trained on pairs of temporally separated time points, using an analogue of temporal difference learning used in reinforcement learning, taking the belief about possible futures at one time point as a bootstrap for training the belief at an earlier time. While we focus purely on the study of the model rather than its use in reinforcement learning, the model architecture we design respects agents’ constraints as it builds the representation online.

DeepFirearm: Learning Discriminative Feature Representation for Fine-grained Firearm Retrieval

There are great demands for automatically regulating inappropriate appearance of shocking firearm images in social media or identifying firearm types in forensics. Image retrieval techniques have great potential to solve these problems. To facilitate research in this area, we introduce Firearm 14k, a large dataset consisting of over 14,000 images in 167 categories. It can be used for both fine-grained recognition and retrieval of firearm images. Recent advances in image retrieval are mainly driven by fine-tuning state-of-the-art convolutional neural networks for retrieval task. The conventional single margin contrastive loss, known for its simplicity and good performance, has been widely used. We find that it performs poorly on the Firearm 14k dataset due to: (1) Loss contributed by positive and negative image pairs is unbalanced during training process. (2) A huge domain gap exists between this dataset and ImageNet. We propose to deal with the unbalanced loss by employing a double margin contrastive loss. We tackle the domain gap issue with a two-stage training strategy, where we first fine-tune the network for classification, and then fine-tune it for retrieval. Experimental results show that our approach outperforms the conventional single margin approach by a large margin (up to 88.5% relative improvement) and even surpasses the strong triplet-loss-based approach.

JointGAN: Multi-Domain Joint Distribution Learning with Generative Adversarial Nets

A new generative adversarial network is developed for joint distribution matching. Distinct from most existing approaches, that only learn conditional distributions, the proposed model aims to learn a joint distribution of multiple random variables (domains). This is achieved by learning to sample from conditional distributions between the domains, while simultaneously learning to sample from the marginals of each individual domain. The proposed framework consists of multiple generators and a single softmax-based critic, all jointly trained via adversarial learning. From a simple noise source, the proposed framework allows synthesis of draws from the marginals, conditional draws given observations from a subset of random variables, or complete draws from the full joint distribution. Most examples considered are for joint analysis of two domains, with examples for three domains also presented.

BSN: Boundary Sensitive Network for Temporal Action Proposal Generation

Temporal action proposal generation is an important yet challenging problem, since temporal proposals with rich action content are indispensable for analysing real-world videos with long duration and high proportion irrelevant content. This problem requires methods not only generating proposals with precise temporal boundaries, but also retrieving proposals to cover truth action instances with high recall and high overlap using relatively fewer proposals. To address these difficulties, we introduce an effective proposal generation method, named Boundary-Sensitive Network (BSN), which adopts ‘local to global’ fashion. Locally, BSN first locates temporal boundaries with high probabilities, then directly combines these boundaries as proposals. Globally, with Boundary-Sensitive Proposal feature, BSN retrieves proposals by evaluating the confidence of whether a proposal contains an action within its region. We conduct experiments on two challenging datasets: ActivityNet-1.3 and THUMOS14, where BSN outperforms other state-of-the-art temporal action proposal generation methods with high recall and high temporal precision. Finally, further experiments demonstrate that by combining existing action classifiers, our method significantly improves the state-of-the-art temporal action detection performance.

Representation Learning of Entities and Documents from Knowledge Base Descriptions

In this paper, we describe TextEnt, a neural network model that learns distributed representations of entities and documents directly from a knowledge base (KB). Given a document in a KB consisting of words and entity annotations, we train our model to predict the entity that the document describes and map the document and its target entity close to each other in a continuous vector space. Our model is trained using a large number of documents extracted from Wikipedia. The performance of the proposed model is evaluated using two tasks, namely fine-grained entity typing and multiclass text classification. The results demonstrate that our model achieves state-of-the-art performance on both tasks. The code and the trained representations are made available online for further academic research.

The Case for Full-Matrix Adaptive Regularization

Adaptive regularization methods come in diagonal and full-matrix variants. However, only the former have enjoyed widespread adoption in training large-scale deep models. This is due to the computational overhead of manipulating a full matrix in high dimension. In this paper, we show how to make full-matrix adaptive regularization practical and useful. We present GGT, a truly scalable full-matrix adaptive optimizer. At the heart of our algorithm is an efficient method for computing the inverse square root of a low-rank matrix. We show that GGT converges to first-order local minima, providing the first rigorous theoretical analysis of adaptive regularization in non-convex optimization. In preliminary experiments, GGT trains faster across a variety of synthetic tasks and standard deep learning benchmarks.

SupportNet: solving catastrophic forgetting in class incremental learning with support data

A plain well-trained deep learning model often does not have the ability to learn new knowledge without forgetting the previously learned knowledge, which is known as the catastrophic forgetting. Here we propose a novel method, SupportNet, to solve the catastrophic forgetting problem in class incremental learning scenario efficiently and effectively. SupportNet combines the strength of deep learning and support vector machine (SVM), where SVM is used to identify the support data from the old data, which are fed to the deep learning model together with the new data for further training so that the model can review the essential information of the old data when learning the new information. Two powerful consolidation regularizers are applied to ensure the robustness of the learned model. Comprehensive experiments on various tasks, including enzyme function prediction, subcellular structure classification and breast tumor classification, show that SupportNet drastically outperforms the state-of-the-art incremental learning methods and even reaches similar performance as the deep learning model trained from scratch on both old and new data. Our program is accessible at: https://…/SupportNet

GAIN: Missing Data Imputation using Generative Adversarial Nets

We propose a novel method for imputing missing data by adapting the well-known Generative Adversarial Nets (GAN) framework. Accordingly, we call our method Generative Adversarial Imputation Nets (GAIN). The generator (G) observes some components of a real data vector, imputes the missing components conditioned on what is actually observed, and outputs a completed vector. The discriminator (D) then takes a completed vector and attempts to determine which components were actually observed and which were imputed. To ensure that D forces G to learn the desired distribution, we provide D with some additional information in the form of a hint vector. The hint reveals to D partial information about the missingness of the original sample, which is used by D to focus its attention on the imputation quality of particular components. This hint ensures that G does in fact learn to generate according to the true data distribution. We tested our method on various datasets and found that GAIN significantly outperforms state-of-the-art imputation methods.

Policy Gradient as a Proxy for Dynamic Oracles in Constituency Parsing
Slalom: Fast, Verifiable and Private Execution of Neural Networks in Trusted Hardware
Nonparametric Regression with Comparisons: Escaping the Curse of Dimensionality with Ordinal Information
Pricing Engine: Estimating Causal Impacts in Real World Business Settings
Blind Justice: Fairness with Encrypted Sensitive Attributes
Multilingual Neural Machine Translation with Task-Specific Attention
Conversational Recommender System
Approximate Message Passing for Amplitude Based Optimization
DMCNN: Dual-Domain Multi-Scale Convolutional Neural Network for Compression Artifacts Removal
PatchFCN for Intracranial Hemorrhage Detection
Automatic View Planning with Multi-scale Deep Reinforcement Learning Agents
An Information-Percolation Bound for Spin Synchronization on General Graphs
Intelligently-automated facilities expansion with the HEPCloud Decision Engine
ChangeMyView Through Concessions: Do Concessions Increase Persuasion
A Proof the Functional Equation Conjecture
A Scenario Decomposition Algorithm for Strategic Time Window Assignment Vehicle Routing Problems
Data-driven model for the identification of the rock type at a drilling bit
Peak positions of strongly unimodal sequences
The landscape of NeuroImage-ing research
Does The Cloud Need Stabilizing
Prediction of the FIFA World Cup 2018 – A random forest approach with an emphasis on estimated team ability parameters
Learning in Integer Latent Variable Models with Nested Automatic Differentiation
Low-Complexity Multiuser QAM Detection for Uplink 1-bit Massive MIMO
How long does the surplus stay close to its historical high
A neural network catalyzer for multi-dimensional similarity search
Obtaining fairness using optimal transport theory
Hearst Patterns Revisited: Automatic Hypernym Detection from Large Text Corpora
The Well Tempered Lasso
Wave-U-Net: A Multi-Scale Neural Network for End-to-End Audio Source Separation
On Critical Threshold Value for Simple Games
A spatial likelihood analysis for MAGIC telescope data
The characterization of perfect Roman domination stable trees
A Publish/Subscribe QoS-aware Framework for Massive IoT Traffic Orchestration
Evaluating CBR Similarity Functions for BAM Switching in Networks with Dynamic Traffic Profile
Several recent developments in estimation and robust control of quantum systems
Neural Message Passing with Edge Updates for Predicting Properties of Molecules and Materials
Fidelity-based Probabilistic Q-learning for Control of Quantum Systems
Automatic Identification of Research Fields in Scientific Papers
Black Box FDR
Semi-parametric estimation of the variogram of a Gaussian process with stationary increments
On Minimal Sets to Destroy the $k$-Core in Random Networks
Periodic P{ó}lya urns and an application to Young tableaux
Text Classification based on Word Subspace with Term-Frequency
Efficient Resource Allocation for On-Demand Mobile-Edge Cloud Computing
Machine Learning CICY Threefolds
Variational inference for sparse network reconstruction from count data
Comparing Approximate Relaxations of Envy-Freeness
Performance Limits of Lattice Reduction over Imaginary Quadratic Fields with Applications to Compute-and-Forward
VTrails: Inferring Vessels with Geodesic Connectivity Trees
Multi-Code-Rate Correction Technique with IR-QC-LDPC: An application to QKD
Ergodic Mean-Payoff Games for the Analysis of Attacks in Crypto-Currencies
Uncertainty-driven Sanity Check: Application to Postoperative Brain Tumor Cavity Segmentation
An Explicit Construction of Systematic MDS Codes with Small Sub-packetization for All-Node Repair
Compressed Communication Complexity of Longest Common Prefixes
m-Order Time Optimal Control Synthesis Function of Discrete System and Its Application
Load-dependent machine failures in production network models
Quantum Penny Flip game with unawareness
Estimation of marginal model with subgroup auxiliary information
A Stein variational Newton method
Unifying Identification and Context Learning for Person Recognition
Model of an oscillatory neural network with multilevel neurons for pattern recognition
Deep multi-scale architectures for monocular depth estimation
On sound-based interpretation of neonatal EEG
Heart Rate Variability during Periods of Low Blood Pressure as a Predictor of Short-Term Outcome in Preterms
System Level Framework for Assessing the Accuracy of Neonatal EEG Acquisition
Investigating the Impact of CNN Depth on Neonatal Seizure Detection Performance
On Interference Dynamics in Matérn Networks
On exponential convergence of adaptive importance sampling algorithms
Unsupervised Feature Learning Toward a Real-time Vehicle Make and Model Recognition
Generating Image Sequence from Description with LSTM Conditional GAN
Combinatorial identities involving harmonic numbers
3D FCN Feature Driven Regression Forest-Based Pancreas Localization and Segmentation
Large-scale Bisample Learning on ID vs. Spot Face Recognition
A linear programming approach to inverse planning in radiosurgery
Machine learning-based colon deformation estimation method for colonoscope tracking
Domain Adaptive Generation of Aircraft on Satellite Imagery via Simulated and Unsupervised Learning
Noise-adding Methods of Saliency Map as Series of Higher Order Partial Derivative
Logarithmic Mathematical Morphology: a new framework robust to illumination changes
q-Space Novelty Detection with Variational Autoencoders
Resilience of Majorana Fermions in the face of Disorder
Towards Binary-Valued Gates for Robust LSTM Training
A Systematic Evaluation of Recent Deep Learning Architectures for Fine-Grained Vehicle Classification
Continuous-time Value Function Approximation in Reproducing Kernel Hilbert Spaces
Monge beats Bayes: Hardness Results for Adversarial Training
Novel Sparse-Coded Ambient Backscatter Communication for Massive IoT Connectivity
Fingerprint liveness detection using local quality features
Robust Node Generation for Meshfree Discretizations on Irregular Domains and Surfaces
PAC Ranking from Pairwise and Listwise Queries: Lower Bounds and Upper Bounds
List-decoding homomorphism codes with arbitrary codomains
Locating the boundaries of Pareto fronts: A Many-Objective Evolutionary Algorithm Based on Corner Solution Search
Extremes of Spherical Fractional Brownian Motion
A Deep Neural Network Surrogate for High-Dimensional Random Partial Differential Equations
Large deviation principles for first-order scalar conservation laws with stochastic forcing
Using Social Network Information in Bayesian Truth Discovery
Asynchronous Downlink Massive MIMO Networks: A Stochastic Geometry Approach
RGCNN: Regularized Graph CNN for Point Cloud Segmentation
On self-dual and LCD double circulant and double negacirculant codes over $\mathbb{F}_q + u\mathbb{F}_q$
Boolean product polynomials and Schur-positivity
Findings of the Second Workshop on Neural Machine Translation and Generation
Flexible Load Balancing with Multi-dimensional State-space Collapse: Throughput and Heavy-traffic Delay Optimality
Coverage Probability of 3D Mobile UAV Networks
Learn from Your Neighbor: Learning Multi-modal Mappings from Sparse Annotations
Program Synthesis Through Reinforcement Learning Guided Tree Search
Maximizing the Number of Satisfied L-clauses
Lightweight Stochastic Optimization for Minimizing Finite Sums with Infinite Data
A Spectral Approach to Gradient Estimation for Implicit Distributions
On Adversarial Risk and Training
Multimodal Relational Tensor Network for Sentiment and Emotion Classification
Feature selection in functional data classification with recursive maxima hunting
Non-Local Recurrent Network for Image Restoration
Color Sails: Discrete-Continuous Palettes for Deep Color Exploration
The reciprocal Mahler ensembles of random polynomials
Affine processes under parameter uncertainty
Is preprocessing of text really worth your time for online comment classification
Copy Move Forgery using Hus Invariant Moments and Log Polar Transformations
Tensor network factorizations: Relationships between brain structural connectomes and traits
A Sharp Threshold for Bootstrap Percolation in a Random Hypergraph
Probabilistic FastText for Multi-Sense Word Embeddings
Optimal Design of Process Flexibility for General Production Systems
Training Faster by Separating Modes of Variation in Batch-normalized Models
Revisiting the Importance of Individual Units in CNNs via Ablation
A Comprehensive Framework for Dynamic Bike Rebalancing in a Large Bike Sharing Network
Correspondence of Deep Neural Networks and the Brain for Visual Textures
Residual Unfairness in Fair Machine Learning from Prejudiced Data
Learning Tasks for Multitask Learning: Heterogenous Patient Populations in the ICU
In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking
An Exploration of Unreliable News Classification in Brazil and The U.S
Direct Optimization through $\arg \max$ for Discrete Variational Auto-Encoder
Accommodating new flights into an existing airline flight schedule
Kernel Machines With Missing Responses
Semi-supervised and Transfer learning approaches for low resource sentiment classification
Hybrid Precoding Architecture for Massive Multiuser MIMO with Dissipation: Sub-Connected or Fully-Connected Structures
Disorder and dephasing as control knobs for light transport in optical fiber cavity networks
Scalable Natural Gradient Langevin Dynamics in Practice
Model-based active learning to detect isometric deformable objects in the wild with deep architectures
A Simple Method for Commonsense Reasoning
On Turán exponents of bipartite graphs
Soliton decomposition of the Box-Ball System
Assessing the impact of machine intelligence on human behaviour: an interdisciplinary endeavour
Randomized Optimal Transport on a Graph: Framework and New Distance Measures
A Generalized Matrix Splitting Algorithm
Global stability of epidemic models with imperfect vaccination and quarantine on scale-free networks
A Unified View of Diffusion Maps and Signal Processing on Graphs
Mixed integer nonlinear programming for Joint Coordination of Plug-in Electrical Vehicles Charging and Smart Grid Operations
Local law and Tracy-Widom limit for sparse sample covariance matrices
Estimating Train Delays in a Large Rail Network Using a Zero Shot Markov Model
Deep learning based inverse method for layout design
Incorporating Features Learned by an Enhanced Deep Knowledge Tracing Model for STEM/Non-STEM Job Prediction
Medical Concept Embedding with Time-Aware Attention
Driving by the Elderly and their Awareness of their Driving Difficulties (Hebrew)
Impact of End-User Behavior on User/Network Association in HetNets