Conflict-free Replicated Data Types: An Overview

Internet-scale distributed systems often replicate data at multiple geographic locations to provide low latency and high availability, despite node and network failures. Geo-replicated systems that adopt a weak consistency model allow replicas to temporarily diverge, requiring a mechanism for merging concurrent updates into a common state. Conflict-free Replicated Data Types (CRDT) provide a principled approach to address this problem. This document presents an overview of Conflict-free Replicated Data Types research and practice, organizing the presentation in the aspects relevant for the application developer, the system developer and the CRDT developer.

MONAS: Multi-Objective Neural Architecture Search using Reinforcement Learning

Recent studies on neural architecture search have shown that automatically designed neural networks perform as good as human-designed architectures. While most existing works on neural architecture search aim at finding architectures that optimize for prediction accuracy. These methods may generate complex architectures consuming excessively high energy consumption, which is not suitable for computing environment with limited power budgets. We propose MONAS, a Multi-Objective Neural Architecture Search with novel reward functions that consider both prediction accuracy and power consumption when exploring neural architectures. MONAS effectively explores the design space and searches for architectures satisfying the given requirements. The experimental results demonstrate that the architectures found by MONAS achieve accuracy comparable to or better than the state-of-the-art models, while having better energy efficiency.

A Tunable Particle Swarm Size Optimization Algorithm for Feature Selection

Feature selection is the process of identifying statistically most relevant features to improve the predictive capabilities of the classifiers. To find the best features subsets, the population based approaches like Particle Swarm Optimization(PSO) and genetic algorithms are being widely employed. However, it is a general observation that not having right set of particles in the swarm may result in sub-optimal solutions, affecting the accuracies of classifiers. To address this issue, we propose a novel tunable swarm size approach to reconfigure the particles in a standard PSO, based on the data sets, in real time. The proposed algorithm is named as Tunable Particle Swarm Size Optimization Algorithm (TPSO). It is a wrapper based approach wherein an Alternating Decision Tree (ADT) classifier is used for identifying influential feature subset, which is further evaluated by a new objective function which integrates the Classification Accuracy (CA) with a modified F-Score, to ensure better classification accuracy over varying population sizes. Experimental studies on bench mark data sets and Wilcoxon statistical test have proved the fact that the proposed algorithm (TPSO) is efficient in identifying optimal feature subsets that improve classification accuracies of base classifiers in comparison to its standalone form.

Modular meta-learning

Many prediction problems, such as those that arise in the context of robotics, have a simplifying underlying structure that could accelerate learning. In this paper, we present a strategy for learning a set of neural network modules that can be combined in different ways. We train different modular structures on a set of related tasks and generalize to new tasks by composing the learned modules in new ways. We show this improves performance in two robotics-related problems.

Deep Feature Factorization For Concept Discovery

We propose Deep Feature Factorization (DFF), a method capable of localizing similar semantic concepts within an image or a set of images. We use DFF to gain insight into a deep convolutional neural network’s learned features, where we detect hierarchical cluster structures in feature space. This is visualized as heat maps, which highlight semantically matching regions across a set of images, revealing what the network `perceives’ as similar. DFF can also be used to perform co-segmentation and co-localization, and we report state-of-the-art results on these tasks.

Guided evolutionary strategies: escaping the curse of dimensionality in random search

Many applications in machine learning require optimizing a function whose true gradient is unknown, but where surrogate gradient information (directions that may be correlated with, but not necessarily identical to, the true gradient) is available instead. This arises when an approximate gradient is easier to compute than the full gradient (e.g. in meta-learning or unrolled optimization), or when a true gradient is intractable and is replaced with a surrogate (e.g. in certain reinforcement learning applications, or when using synthetic gradients). We propose Guided Evolutionary Strategies, a method for optimally using surrogate gradient directions along with random search. We define a search distribution for evolutionary strategies that is elongated along a guiding subspace spanned by the surrogate gradients. This allows us to estimate a descent direction which can then be passed to a first-order optimizer. We analytically and numerically characterize the tradeoffs that result from tuning how strongly the search distribution is stretched along the guiding subspace, and we use this to derive a setting of the hyperparameters that works well across problems. Finally, we apply our method to example problems including truncated unrolled optimization and a synthetic gradient problem, demonstrating improvement over both standard evolutionary strategies and first-order methods that directly follow the surrogate gradient. We provide a demo of Guided ES at: https://…/guided-evolutionary-strategies.

A Generalized Data Representation for Deep Learning-Based Communications Systems

Deep learning (DL)-based autoencoder is a potential architecture to implement end-to-end communication systems. In this letter, we first give a brief introduction to the autoencoder-represented communication system. Then, we propose a novel generalized data representation (GDR) aiming to improve the data rate of DL-based communication systems. Finally, simulation results show that the proposed GDR scheme has lower training complexity, comparable block error rate performance and higher channel capacity than the conventional one-hot vector scheme. Furthermore, we investigate the effect of signal-to-noise ratio (SNR) in DL-based communication systems and prove that training at a high SNR could produce a good training performance for autoencoder.

Quantile-based clustering

A new cluster analysis method, K-quantiles clustering, is introduced. K-quantiles clustering can be computed by a simple greedy algorithm in the style of the classical Lloyd’s algorithm for K-means. It can be applied to large and high-dimensional datasets. It allows for within-cluster skewness and internal variable scaling based on within-cluster variation. Different versions allow for different levels of parsimony and computational efficiency. Although K-quantiles clustering is conceived as nonparametric, it can be connected to a fixed partition model of generalized asymmetric Laplace-distributions. The consistency of K-quantiles clustering is proved, and it is shown that K-quantiles clusters correspond to well separated mixture components in a nonparametric mixture. In a simulation, K-quantiles clustering is compared with a number of popular clustering methods with good results. A high-dimensional microarray dataset is clustered by K-quantiles.

Neural Machine Translation for Query Construction and Composition

Research on question answering with knowledge base has recently seen an increasing use of deep architectures. In this extended abstract, we study the application of the neural machine translation paradigm for question parsing. We employ a sequence-to-sequence model to learn graph patterns in the SPARQL graph query language and their compositions. Instead of inducing the programs through question-answer pairs, we expect a semi-supervised approach, where alignments between questions and queries are built through templates. We argue that the coverage of language utterances can be expanded using late notable works in natural language generation.

Employee Attrition Prediction
A low power DAQ system with high-speed storage for submersible buoy
Physics-based Scene-level Reasoning for Object Pose Estimation in Clutter
A Proof of the Front-Door Adjustment Formula
Request-and-Reverify: Hierarchical Hypothesis Testing for Concept Drift Detection with Expensive Labels
$r$-strongly vertex-distinguishing total coloring of graphs
The normalized Laplacian spectra of subdivision vertex-edge neighbourhood vertex(edge)-corona for graphs
Joint Beam and Channel Tracking for Two-dimensional Phased Antenna Arrays
The challenge of realistic music generation: modelling raw audio at scale
Reversibility Checking for Markov Chains
A CutFEM method for two-phase flow problems
Flexible Multiple Testing with the FACT Algorithm
Probing quantum thermalization of a disordered dipolar spin ensemble with discrete time-crystalline order
Detection of Alzheimers Disease from MRI using Convolutional Neural Network with Tensorflow
Improving Pursuit Algorithms Using Stochastic Resonance
Hypoelliptic diffusions with singular drift on nilpotent Lie groups
Do Political Detachment Users Receive Various Political Information on Social Media
Semantically Enhanced Dynamic Bayesian Network for Detecting Sepsis Mortality Risk in ICU Patients with Infection
The Sparse Recovery Autoencoder
Practical Access to Dynamic Programming on Tree Decompositions
Multi-Merge Budget Maintenance for Stochastic Gradient Descent SVM Training
Speeding Up Budgeted Stochastic Gradient Descent SVM Training with Precomputed Golden Section Search
Unsupervised Learning by Competing Hidden Units
Dual SVM Training on a Budget
Generalized Reversible Computing
How to Assess the Impact of Quality and Patient Safety Interventions with Routinely Collected Longitudinal Data
A Tight Convergence Analysis for Stochastic Gradient Descent with Delayed Updates
The bootstrap in kernel regression for stationary ergodic data when both response and predictor are functions
Linearly convergent nonlinear conjugate gradient methods for a parameter identification problems
Network-level Cooperation in Random Access IoT Networks with Aggregators
Neural Cross-Lingual Coreference Resolution and its Application to Entity Linking
Listing All Maximal k-Plexes in Temporal Graphs
Contextual ASR Adaptation for Conversational Agents
Conditional Sparse $\ell_p$-norm Regression With Optimal Probability
An Improved Algorithm for Counting Graphical Degree Sequences
Tightness and Weak Convergence of Probabilities on the Skorokhod Space of Càdlàg Functions Taking Values in the Dual of a Nuclear Space and Applications
Scalable Gaussian Process Inference with Finite-data Mean and Variance Guarantees
Vector OFDM Transmission over Non-Gaussian Power Line Communication Channels
Phase transition in the knapsack problem
Hierarchical Coded Computation
Exploitation of Stragglers in Coded Computation
Learning a Saliency Evaluation Metric Using Crowdsourced Perceptual Judgments
Well-quasi-ordering in lattice path matroids
BDDs Naturally Represent Boolean Functions, and ZDDs Naturally Represent Sets of Sets
Collaborative Annotation of Semantic Objects in Images with Multi-granularity Supervisions
Piecewise Approximations of Black Box Models for Model Interpretation
A Resilient Convex Combination for consensus-based distributed algorithms
von Mises Tapering: A Circular Data Windowing
Primary Object Segmentation in Aerial Videos via Hierarchical Temporal Slicing and Co-Segmentation
Feature-less Stitching of Cylindrical Tunnel
Efficient Neural Architecture Search with Network Morphism
Optimal Scheduling of Electrolyzer in Power Market with Dynamic Prices
Attention to Head Locations for Crowd Counting
QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulation
Corrective control: stability analysis of Unified Controller combining frequency control and congestion management
Determinants containing powers of polynomial sequences
Unsupervised and Efficient Vocabulary Expansion for Recurrent Neural Network Language Models in ASR
Matrix Completion from Non-Uniformly Sampled Entries
Adversarial Distillation of Bayesian Neural Network Posteriors
Exploiting Spatial-Temporal Modelling and Multi-Modal Fusion for Human Action Recognition
The Virtuous Machine – Old Ethics for New Technology
Online Matching in a Ride-Sharing Platform
3D RoI-aware U-Net for Accurate and Efficient Colorectal Tumor Segmentation
A Multi-Task Learning Approach for Meal Assessment
Learning Visually-Grounded Semantics from Contrastive Adversarial Samples
Quantum-chemical insights from interpretable atomistic neural networks
Disparity Image Segmentation For ADAS
On limit theory for functionals of stationary increments Levy driven moving averages
A combinatorial-topological shape category for polygraphs
Learn-to-Score: Efficient 3D Scene Exploration by Predicting View Utility
Deriving the Variance of the Discrete Fourier Transform Test Using Parseval’s Theorem
Context Proposals for Saliency Detection
Intervals of permutations and the principal Möbius function
400 Gbps Dual-polarisation Non-linear Frequency-division Multiplexed Transmission with b-Modulation
Algorithmic Building Blocks for Asymmetric Memories
Computing the metric dimension by decomposing graphs into extended biconnected components
On limiting characteristics for a non-stationary two-processor heterogeneous system
Imprecise Monte Carlo simulation and iterative importance sampling for the estimation of lower previsions
Subgraphs in preferential attachment models
Dynamic Assortment Selection under the Nested Logit Models
Filtering Procedures for Sensor Data in Basketball
Divergence-Free Shape Interpolation and Correspondence
Generalized maximum principle in optimal control
MTBI Identification From Diffusion MR Images Using Bag of Adversarial Visual Features
Two Examples of Convex-Programming-Based High-Dimensional Econometric Estimators
On the maximum number of maximum independent sets in connected graphs
On $K_{2,t}$-bootstrap percolation
An Itô Formula for rough partial differential equations. Application to the maximum principle
Deep Steganalysis: End-to-End Learning with Supervisory Information beyond Class Labels
LPRNet: License Plate Recognition via Deep Neural Networks
Stochastic-Geometry Based Characterization of Aggregate Interference in TVWS Cognitive Radio Networks
On Coalitional Manipulation for Multiwinner Elections: Shortlisting
Game-Theoretic Spectrum Trading in RF Relay-Assisted Free-Space Optical Communications
Plug-in Estimation in High-Dimensional Linear Inverse Problems: A Rigorous Analysis
Two-dimensional Anisotropic KPZ growth and limit shapes
Homogeneity of a region in the logarithmic image processing framework: application to region growing algorithms
Random sections of line bundles over real Riemann surfaces
A Robustified posterior for Bayesian inference on a large number of parallel effects
Distribution regression model with a Reproducing Kernel Hilbert Space approach
Impact of predictor measurement heterogeneity across settings on performance of prediction models: a measurement error perspective
Customizing an Adversarial Example Generator with Class-Conditional GANs
Dynamic Trees with Almost-Optimal Access Cost
Product irregularity strength of graphs with small clique cover number
Computing the Chromatic Number Using Graph Decompositions via Matrix Rank
Belief Propagation List Decoding of Polar Codes
Multiple zeta star values on 3-2-1 indices
Lower Bounds for Dynamic Programming on Planar Graphs of Bounded Cutwidth
$2$-Neighbour-Transitive Codes with Small Blocks of Imprimitivity
Knowledge-Driven Wireless Networks with Artificial Intelligence: Design, Challenges and Opportunities
Subgroup growth of virtually cyclic right-angled Coxeter groups and their free products
Advanced Scenario Creation Strategies for Stochastic Economic Dispatch with Renewables
A generalization of the spherical ensemble to even-dimensional spheres
Evaluating author name disambiguation for digital libraries: A case of DBLP
Social media metrics for new research evaluation
Comments on David Aldous and Persi Diaconis’ ‘Longest increasing subsequences: from patience sorting to the Baik-Deift-Johansson theorem’
Online optimal task offloading with one-bit feedback
Every Pixel Counts: Unsupervised Geometry Learning with Holistic 3D Motion Understanding
Asymptotic behavior of projections of supercritical multi-type continuous state and continuous time branching processes with immigration
Knowledge Compilation in Multi-Agent Epistemic Logics
Non normal amplification of stochastic quasi-cycles
This looks like that: deep learning for interpretable image recognition
Adult content in Social Live Streaming Services: Characterizing deviant users and relationships
A functional approach to estimation of the parameters of generalized negative binomial and gamma distributions
On the Error in Phase Transition Computations for Compressed Sensing
Approximability of Discriminators Implies Diversity in GANs
Supercritical causal maps : geodesics and simple random walk