A Feature-Based Comparison of Evolutionary Computing Techniques for Constrained Continuous Optimisation

Evolutionary algorithms have been frequently applied to constrained continuous optimisation problems. We carry out feature based comparisons of different types of evolutionary algorithms such as evolution strategies, differential evolution and particle swarm optimisation for constrained continuous optimisation. In our study, we examine how sets of constraints influence the difficulty of obtaining close to optimal solutions. Using a multi-objective approach, we evolve constrained continuous problems having a set of linear and/or quadratic constraints where the different evolutionary approaches show a significant difference in performance. Afterwards, we discuss the features of the constraints that exhibit a difference in performance of the different evolutionary approaches under consideration.

A review of learning vector quantization classifiers

In this work we present a review of the state of the art of Learning Vector Quantization (LVQ) classifiers. A taxonomy is proposed which integrates the most relevant LVQ approaches to date. The main concepts associated with modern LVQ approaches are defined. A comparison is made among eleven LVQ classifiers using one real-world and two artificial datasets.

Bandit Label Inference for Weakly Supervised Learning

The scarcity of data annotated at the desired level of granularity is a recurring issue in many applications. Significant amounts of effort have been devoted to developing weakly supervised methods tailored to each individual setting, which are often carefully designed to take advantage of the particular properties of weak supervision regimes, form of available data and prior knowledge of the task at hand. Unfortunately, it is difficult to adapt these methods to new tasks and/or forms of data, which often require different weak supervision regimes or models. We present a general-purpose method that can solve any weakly supervised learning problem irrespective of the weak supervision regime or the model. The proposed method turns any off-the-shelf strongly supervised classifier into a weakly supervised classifier and allows the user to specify any arbitrary weakly supervision regime via a loss function. We apply the method to several different weak supervision regimes and demonstrate competitive results compared to methods specifically engineered for those settings.

Deep Temporal Sigmoid Belief Networks for Sequence Modeling

Deep dynamic generative models are developed to learn sequential dependencies in time-series data. The multi-layered model is designed by constructing a hierarchy of temporal sigmoid belief networks (TSBNs), defined as a sequential stack of sigmoid belief networks (SBNs). Each SBN has a contextual hidden state, inherited from the previous SBNs in the sequence, and is used to regulate its hidden bias. Scalable learning and inference algorithms are derived by introducing a recognition model that yields fast sampling from the variational posterior. This recognition model is trained jointly with the generative model, by maximizing its variational lower bound on the log-likelihood. Experimental results on bouncing balls, polyphonic music, motion capture, and text streams show that the proposed approach achieves state-of-the-art predictive performance, and has the capacity to synthesize various sequences.

Design and Implementation of Domain based Semantic Hidden Web Crawler

Web is a wide term which mainly consists of surface web and hidden web. One can easily access the surface web using traditional web crawlers, but they are not able to crawl the hidden portion of the web. These traditional crawlers retrieve contents from web pages, which are linked by hyperlinks ignoring the information hidden behind form pages, which cannot be extracted using simple hyperlink structure. Thus, they ignore large amount of data hidden behind search forms. This paper emphasizes on the extraction of hidden data behind html search forms. The proposed technique makes use of semantic mapping to fill the html search form using domain specific database. Using semantics to fill various fields of a form leads to more accurate and qualitative data extraction.

Fast k-NN search

Random projection trees have proven to be effective for approximate nearest neighbor searches in high dimensional spaces where conventional methods are not applicable due to excessive usage of memory and computational time. We show that building multiple trees on the same data can improve the performance even further, without significantly increasing the total computational cost of queries when executed in a modern parallel computing environment. Our experiments identify suitable parameter values to achieve accurate searches with extremely fast query times, while also retaining a feasible complexity for index construction.

Learning Wake-Sleep Recurrent Attention Models

Despite their success, convolutional neural networks are computationally expensive because they must examine all image locations. Stochastic attention-based models have been shown to improve computational efficiency at test time, but they remain difficult to train because of intractable posterior inference and high variance in the stochastic gradient estimates. Borrowing techniques from the literature on training deep generative models, we present the Wake-Sleep Recurrent Attention Model, a method for training stochastic attention networks which improves posterior inference and which reduces the variability in the stochastic gradients. We show that our method can greatly speed up the training time for stochastic attention networks in the domains of image classification and caption generation.

Minimum Weight Perfect Matching via Blossom Belief Propagation

Max-product Belief Propagation (BP) is a popular message-passing algorithm for computing a Maximum-A-Posteriori (MAP) assignment over a distribution represented by a Graphical Model (GM). It has been shown that BP can solve a number of combinatorial optimization problems including minimum weight matching, shortest path, network flow and vertex cover under the following common assumption: the respective Linear Programming (LP) relaxation is tight, i.e., no integrality gap is present. However, when LP shows an integrality gap, no model has been known which can be solved systematically via sequential applications of BP. In this paper, we develop the first such algorithm, coined Blossom-BP, for solving the minimum weight matching problem over arbitrary graphs. Each step of the sequential algorithm requires applying BP over a modified graph constructed by contractions and expansions of blossoms, i.e., odd sets of vertices. Our scheme guarantees termination in O(n^2) of BP runs, where n is the number of vertices in the original graph. In essence, the Blossom-BP offers a distributed version of the celebrated Edmonds’ Blossom algorithm by jumping at once over many sub-steps with a single BP. Moreover, our result provides an interpretation of the Edmonds’ algorithm as a sequence of LPs.

A coloring of the square of the 8-cube with 13 colors

A Novel Pre-processing Scheme to Improve the Prediction of Sand Fraction from Seismic Attributes using Neural Networks

A stochastic model for competing growth on $\mathbb{R}^d$

Absence of superconcentration for the free energy in the mixed $p$-spin models with external field

Analyticity of the entropy and the escape rate of random walks in hyperbolic groups

Asymptotic shape in a continuum growth model

Automatic Dialect Detection in Arabic Broadcast Speech

Boolean Hedonic Games

Branch: An interactive, web-based tool for testing hypotheses and developing predictive models

Coexistence in a two-type continuum growth model

Copulas in Hilbert spaces

Density Estimation via Discrepancy

Designing Behaviour in Bio-inspired Robots Using Associative Topologies of Spiking-Neural-Networks

Dynamic concurrent van Emde Boas array

Efficient reconstruction of transmission probabilities in a spreading process from partial observations

Expectile Asymptotics

Extended Plefka Expansion for Stochastic Dynamics

Fast Parallel Fixed-Parameter Algorithms via Color Coding

Finding Perfect Matchings in Bipartite Hypergraphs

Fully automatic multi-language translation with a catalogue of phrases – successful employment for the Swiss avalanche bulletin

Generating simple random graphs with prescribed degree distribution

Generating stationary random graphs on $\mathbb{Z}$ with prescribed i.i.d.\ degrees

Growing networks with preferential addition and deletion of edges

Implementing Parareal – OpenMP or MPI?

Learning Deep Control Policies for Autonomous Aerial Vehicles with MPC-Guided Policy Search

Local law of addition of random matrices on optimal scale

Many-body localization and mobility edge in a disordered Heisenberg spin ladder

Model-based Reinforcement Learning with Parametrized Physical Models and Optimism-Driven Exploration

Nonmonotonic coexistence regions for the two-type Richardson model

Numerical methods for solution of the stochastic differential equations equivalent to the non-stationary Parker’s transport equation

On invariant Gibbs measures for the generalized KdV equations

On The Direct Maximization of Quadratic Weighted Kappa

On the distribution of cumulative Parisian ruin

One-Shot Learning of Manipulation Skills with Online Dynamics Adaptation and Neural Network Priors

Parameter uncertainty in forecast recalibration

Practical Concurrent Priority Queues

Predicting Climate Variability over the Indian Region Using Data Mining Strategies

Quantification of sand fraction from seismic attributes using Neuro-Fuzzy approach

Quasi equilibrium construction for the long time limit of glassy dynamics

Random intersection graphs with tunable degree distribution and clustering

Random networks with preferential growth and vertex death

Sparse polynomial approximation of parametric elliptic PDEs. Part II: lognormal coefficients

Stationary random graphs on $\mathbb{Z}$ with prescribed iid degrees and finite mean connections

Stationary random graphs with prescribed iid degrees on a spatial Poisson process

Statistical mechanics models for multimode lasers and random lasers

Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hours

Symmetric Chain Decompositions and the Strong Sperner Property for Noncrossing Partition Lattices

Telegraph process in the bounded domain with absorbing lower boundary and reflecting with delay upper boundary

Testing separability of space–time functional processes

The 95256-cap in PG(12; 4) is complete

The Delta Conjecture

The Hadwiger-Nelson problem over certain fields

The initial configuration is irrelevant for the possibility of mutual unbounded growth in the two-type Richardson model

The pleasures and pains of studying the two-type Richardson model

The Z-cubes: a hypercube variant with small diameter

Universal Outlying sequence detection For Continuous Observations

Well Tops Guided Prediction of Reservoir Properties using Modular Neural Network Concept A Case Study from Western Onshore, India