Fast and Accurate Image Super-Resolution with Deep Laplacian Pyramid Networks

Convolutional neural networks have recently demonstrated high-quality reconstruction for single image super-resolution. However, existing methods often require a large number of network parameters and entail heavy computational loads at runtime for generating high-accuracy super-resolution results. In this paper, we propose the deep Laplacian Pyramid Super-Resolution Network for fast and accurate image super-resolution. The proposed network progressively reconstructs the sub-band residuals of high-resolution images at multiple pyramid levels. In contrast to existing methods that involve the bicubic interpolation for pre-processing (which results in large feature maps), the proposed method directly extracts features from the low-resolution input space and thereby entails low computational loads. We train the proposed network with deep supervision using the robust Charbonnier loss functions and achieve high-quality image reconstruction. Furthermore, we utilize the recursive layers to share parameters across as well as within pyramid levels, and thus drastically reduce the number of parameters. Extensive quantitative and qualitative evaluations on benchmark datasets show that the proposed algorithm performs favorably against the state-of-the-art methods in terms of run-time and image quality.

Syntactic and Semantic Features For Code-Switching Factored Language Models

This paper presents our latest investigations on different features for factored language models for Code-Switching speech and their effect on automatic speech recognition (ASR) performance. We focus on syntactic and semantic features which can be extracted from Code-Switching text data and integrate them into factored language models. Different possible factors, such as words, part-of-speech tags, Brown word clusters, open class words and clusters of open class word embeddings are explored. The experimental results reveal that Brown word clusters, part-of-speech tags and open-class words are the most effective at reducing the perplexity of factored language models on the Mandarin-English Code-Switching corpus SEAME. In ASR experiments, the model containing Brown word clusters and part-of-speech tags and the model also including clusters of open class word embeddings yield the best mixed error rate results. In summary, the best language model can significantly reduce the perplexity on the SEAME evaluation set by up to 10.8% relative and the mixed error rate by up to 3.4% relative.

Neural Task Programming: Learning to Generalize Across Hierarchical Tasks

In this work, we propose a novel robot learning framework called Neural Task Programming (NTP), which bridges the idea of few-shot learning from demonstration and neural program induction. NTP takes as input a task specification (e.g., video demonstration of a task) and recursively decomposes it into finer sub-task specifications. These specifications are fed to a hierarchical neural program, where bottom-level programs are callable subroutines that interact with the environment. We validate our method in three robot manipulation tasks. NTP achieves strong generalization across sequential tasks that exhibit hierarchal and compositional structures. The experimental results show that NTP learns to generalize well to- wards unseen tasks with increasing lengths, variable topologies, and changing objectives.

InfiniViz: Interactive Visual Exploration using Progressive Bin Refinement

Interactive visualizations can accelerate the data analysis loop through near-instantaneous feedback. To achieve interactivity, techniques such as data cubes and sampling are typically employed. While data cubes can speedup querying for moderate-sized datasets, they are ineffective at doing so at a larger scales due to the size of the materialized data cubes. On the other hand, while sampling can help scale to large datasets, it adds sampling error and the associated issues into the process. While increasing accuracy by looking at more data may sometimes be valuable, providing result minutiae might not be necessary if they do not impart additional significant information. Indeed, such details not only incur a higher \emph{computational} cost, but also tax the \emph{cognitive} load of the analyst with worthless trivia. To reduce both the computational and cognitive expenses, we introduce \emph{InfiniViz}. Through a novel result refinement-based querying paradigm, \emph{InfiniViz} provides error-free results for large datasets by increasing bin resolutions progressively over time. Through real and simulated workloads over real and benchmark datasets, we evaluate and demonstrate \emph{InfiniViz}’s utility at reducing both cognitive and computational costs, while minimizing information loss.

McDiarmid Drift Detection Methods for Evolving Data Streams

Increasingly, Internet of Things (IoT) domains, such as sensor networks, smart cities, and social networks, generate vast amounts of data. Such data are not only unbounded and rapidly evolving. Rather, the content thereof dynamically evolves over time, often in unforeseen ways. These variations are due to so-called concept drifts, caused by changes in the underlying data generation mechanisms. In a classification setting, concept drift causes the previously learned models to become inaccurate, unsafe and even unusable. Accordingly, concept drifts need to be detected, and handled, as soon as possible. In medical applications and military zones, for example, change in behaviors should be detected in near real-time, to avoid potential loss of life. To this end, we introduce the McDiarmid Drift Detection Method (MDDM), which utilizes McDiarmid’s inequality in order to detect concept drift. The MDDM approach proceeds by sliding a window over prediction results, and associate window entries with weights. Higher weights are assigned to the most recent entries, in order to emphasize their importance. As instances are processed, the detection algorithm compares a weighted mean of elements inside the sliding window with the maximum weighted mean observed so far. A significant difference between the two weighted means, upper-bounded by the McDiarmid inequality, implies a concept drift. Our extensive experimentation against synthetic and real-world data streams show that our novel method outperforms the state-of-the-art. Specifically, MDDM yields shorter detection delays as well as lower false negative rates, while maintaining high classification accuracies.

Machine Translation Evaluation with Neural Networks

We present a framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. In this framework, lexical, syntactic and semantic information from the reference and the two hypotheses is embedded into compact distributed vector representations, and fed into a multi-layer neural network that models nonlinear interactions between each of the hypotheses and the reference, as well as between the two hypotheses. We experiment with the benchmark datasets from the WMT Metrics shared task, on which we obtain the best results published so far, with the basic network configuration. We also perform a series of experiments to analyze and understand the contribution of the different components of the network. We evaluate variants and extensions, including fine-tuning of the semantic embeddings, and sentence-based representations modeled with convolutional and recurrent neural networks. In summary, the proposed framework is flexible and generalizable, allows for efficient learning and scoring, and provides an MT evaluation metric that correlates with human judgments, and is on par with the state of the art.

Learning Graphical Models from a Distributed Stream

A current challenge for data management systems is to support the construction and maintenance of machine learning models over data that is large, multi-dimensional, and evolving. While systems that could support these tasks are emerging, the need to scale to distributed, streaming data requires new models and algorithms. In this setting, as well as computational scalability and model accuracy, we also need to minimize the amount of communication between distributed processors, which is the chief component of latency. We study Bayesian networks, the workhorse of graphical models, and present a communication-efficient method for continuously learning and maintaining a Bayesian network model over data that is arriving as a distributed stream partitioned across multiple processors. We show a strategy for maintaining model parameters that leads to an exponential reduction in communication when compared with baseline approaches to maintain the exact MLE (maximum likelihood estimation). Meanwhile, our strategy provides similar prediction errors for the target distribution and for classification tasks.

Tiered Sampling: An Efficient Method for Approximate Counting Sparse Motifs in Massive Graph Streams

We introduce Tiered Sampling, a novel technique for approximate counting sparse motifs in massive graphs whose edges are observed in a stream. Our technique requires only a single pass on the data and uses a memory of fixed size M, which can be magnitudes smaller than the number of edges. Our methods addresses the challenging task of counting sparse motifs – sub-graph patterns that have low probability to appear in a sample of M edges in the graph, which is the maximum amount of data available to the algorithms in each step. To obtain an unbiased and low variance estimate of the count we partition the available memory to tiers (layers) of reservoir samples. While the base layer is a standard reservoir sample of edges, other layers are reservoir samples of sub-structures of the desired motif. By storing more frequent sub-structures of the motif, we increase the probability of detecting an occurrence of the sparse motif we are counting, thus decreasing the variance and error of the estimate. We demonstrate the advantage of our method in the specific applications of counting sparse 4 and 5-cliques in massive graphs. We present a complete analytical analysis and extensive experimental results using both synthetic and real-world data. Our results demonstrate the advantage of our method in obtaining high-quality approximations for the number of 4 and 5-cliques for large graphs using a very limited amount of memory, significantly outperforming the single edge sample approach for counting sparse motifs in large scale graphs.

Differential dissipativity theory for dominance analysis
Resolution of the ‘exponent puzzle’ for the Anderson transition in doped semiconductors
Semantic 3D Reconstruction with Finite Element Bases
Distributed Multiple Access with an Enhanced Physical-Link Layer Interface, Part I: Single Transmission Option
Accelerating CS in Parallel Imaging Reconstructions Using an Efficient and Effective Circulant Preconditioner
DeepLesion: Automated Deep Mining, Categorization and Detection of Significant Radiology Image Findings using Large-Scale Clinical Lesion Annotations
Eigenspace-Based Minimum Variance Adaptive Beamformer Combined with Delay Multiply and Sum: Experimental Study
Privacy-Preserving Deep Inference for Rich User Data on The Cloud
Conditional Equivalence Testing: an alternative remedy for publication bias
Building a Web-Scale Dependency-Parsed Corpus from CommonCrawl
Asymptotics of signed Bernoulli convolutions scaled by multinacci numbers
On the Tree Conjecture for the Network Creation Game
Some facts on Permanents in Finite Characteristics
Kelly Betting Can Be Too Conservative
On Kelly Betting: Some Limitations
Multitask Learning using Task Clustering with Applications to Predictive Modeling and GWAS of Plant Varieties
Enhanced Neural Machine Translation by Learning from Draft
A Comparative Analysis of Materialized Views Selection and Concurrency Control Mechanisms in NoSQL Databases
Abstract Cauchy Problems in separable Banach Spaces driven by random Measures: Asymptotic Results in the finite extinction Case
Abstract Cauchy Problems in separable Banach Spaces driven by random Measures: Existence and Uniqueness
Counterfactual Language Model Adaptation for Suggesting Phrases
The Energy Complexity of Broadcast
FOCAN: A Fog-supported Smart City Network Architecture for Management of Applications in the Internet of Everything Environments
Certifying unstability of Switched Systems using Sum of Squares Programming
Source Coding Optimization for Distributed Average Consensus
Energy-Based Spherical Sparse Coding
Classification of Local Field Potentials using Gaussian Sequence Model
Automatic Taxonomy Generation – A Use-Case in the Legal Domain
Quantum Brègman distances and categories
Latent Tree Approximation in Linear Model
Exponential convergence rate of ruin probabilities for level-dependent Lévy-driven risk processes
Finite Time Identification in Unstable Linear Systems
Improved Schemes for Asymptotically Optimal Repair of MDS Codes
On the validity of the formal Edgeworth expansion for posterior densities
Explicit MDS Codes with Complementary Duals
Efficiently repairing algebraic geometry codes
To prune, or not to prune: exploring the efficacy of pruning for model compression
Diffusion Based Cooperative Molecular Communication in Nano-Networks
Nonseparating trees in 2-connected graphs and oriented trees in strongly connected digraphs
Emergence of Lévy walks from second order stochastic optimization
A Correlated Random Effects Model for Nonignorable Missing Data in Value-Added Assessment of Teacher Effects
Dismantling DivSufSort
Jackknife variance estimation for common mean estimators under ordered variances and general two-sample statistics
Deformation Cones of nested Braid fans
Inferring gene expression networks with hubs using a degree weighted Lasso approach
A self-organizing neural network architecture for learning human-object interactions
On Highly-regular graphs
Can Early Joining Participants Contribute More? – Timeliness Sensitive Incentivization for Crowdsensing
Doubly exponentially many Ingleton matroids
Plane-extraction from depth-data using a Gaussian mixture regression model
Data Augmentation of Spectral Data for Convolutional Neural Network (CNN) Based Deep Chemometrics
Forecasting Player Behavioral Data and Simulating in-Game Events
Model-Theoretic Characterizations of Boolean and Arithmetic Circuit Classes of Small Depth
Minimum number of additive tuples in groups of prime order
Feedback vertex number of Sierpiński-type graphs
Semantic keyword spotting by learning from images and speech
Efficient Compression and Indexing of Trajectories
A Unified Approach to the Global Exactness of Penalty and Augmented Lagrangian Functions II: Extended Exactness
Max flow vitality in general and planar graphs
Memetic Multilevel Hypergraph Partitioning
Simultaneous Multiparty Communication Complexity of Composed Functions
On the stochastic Cahn-Hilliard equation with a singular double-well potential
Machine Learning Based Detection of Clickbait Posts in Social Media
Fast Sketch-based Recovery of Correlation Outliers
Job Management and Task Bundling
Alternating Iteratively Reweighted Minimization Algorithms for Low-Rank Matrix Factorization
A User-Centric System for Verified Identities on the Bitcoin Blockchain
Stable arithmetic regularity in the finite-field model
Triadic closure in configuration models with unbounded degree fluctuations
Weight = nonlinearity for all small weight Boolean functions
Integrating Boundary and Center Correlation Filters for Visual Tracking with Aspect Ratio Variation
A comparison of control strategies applied to a pricing problem in retail
Parameter Uncertainty in the Kalman-Bucy Filter
Tightness of a new and enhanced semidefinite relaxation for MIMO detection
Rank theorem in infinite dimension and lagrange multipliers
Skyline Computation with Noisy Comparisons
Graphs with equal domination and certified domination numbers
Connectivity Properties of Factorization Posets in Generated Groups
Codes Endowed With the Rank Metric
On tropical and nonnegative factorization ranks of band matrices
On the Effective Use of Pretraining for Natural Language Inference
Inference of forex and stock-index financial networks based on the normalised mutual information rate
Online Photometric Calibration for Auto Exposure Video for Realtime Visual Odometry and SLAM
Topological indices of k-th subdivision and semi total point graphs
Indowordnets help in Indian Language Machine Translation
A Bayesian spatial hierarchical model for extreme precipitation in Great Britain
Compression of data streams down to their information content
Morphology Generation for Statistical Machine Translation
The use of neural networks in the analysis of sleep stages and the diagnosis of narcolepsy
The Tail expansion of Gaussian multiplicative chaos and the Liouville reflection coefficient
Phrase Pair Mappings for Hindi-English Statistical Machine Translation
Reliable Learning of Bernoulli Mixture Models
Anatomical Pattern Analysis for decoding visual stimuli in human brains
Multiframe Scene Flow with Piecewise Rigid Motion
Intervention On Default Contagion Under Partial Information
DiffuserCam: Lensless Single-exposure 3D Imaging
Tracking Persons-of-Interest via Unsupervised Representation Adaptation