Lexical Disambiguation in Natural Language Questions (NLQs)

Question processing is a fundamental step in a question answering (QA) application, and its quality impacts the performance of QA application. The major challenging issue in processing question is how to extract semantic of natural language questions (NLQs). A human language is ambiguous. Ambiguity may occur at two levels; lexical and syntactic. In this paper, we propose a new approach for resolving lexical ambiguity problem by integrating context knowledge and concepts knowledge of a domain, into shallow natural language processing (SNLP) techniques. Concepts knowledge is modeled using ontology, while context knowledge is obtained from WordNet, and it is determined based on neighborhood words in a question. The approach will be applied to a university QA system.

Veto Interval Graphs and Variations

We introduce a variation of interval graphs, called veto interval (VI) graphs. A VI graph is represented by a set of closed intervals, each containing a point called a veto mark. The edge ab is in the graph if the intervals corresponding to the vertices a and b intersect, and neither contains the veto mark of the other. We find families of graphs which are VI graphs, and prove results towards characterizing the maximum chromatic number of a VI graph. We define and prove similar results about several related graph families, including unit VI graphs, midpoint unit VI (MUVI) graphs, and single and double approval graphs. We also highlight a relationship between approval graphs and a family of tolerance graphs.

FSL-BM: Fuzzy Supervised Learning with Binary Meta-Feature for Classification

This paper introduces a novel real-time Fuzzy Supervised Learning with Binary Meta-Feature (FSL-BM) for big data classification task. The study of real-time algorithms addresses several major concerns, which are namely: accuracy, memory consumption, and ability to stretch assumptions and time complexity. Attaining a fast computational model providing fuzzy logic and supervised learning is one of the main challenges in the machine learning. In this research paper, we present FSL-BM algorithm as an efficient solution of supervised learning with fuzzy logic processing using binary meta-feature representation using Hamming Distance and Hash function to relax assumptions. While many studies focused on reducing time complexity and increasing accuracy during the last decade, the novel contribution of this proposed solution comes through integration of Hamming Distance, Hash function, binary meta-features, binary classification to provide real time supervised method. Hash Tables (HT) component gives a fast access to existing indices; and therefore, the generation of new indices in a constant time complexity, which supersedes existing fuzzy supervised algorithms with better or comparable results. To summarize, the main contribution of this technique for real-time Fuzzy Supervised Learning is to represent hypothesis through binary input as meta-feature space and creating the Fuzzy Supervised Hash table to train and validate model.

Symbolic Analysis-based Reduced Order Markov Modeling of Time Series Data

This paper presents a technique for reduced-order Markov modeling for compact representation of time-series data. In this work, symbolic dynamics-based tools have been used to infer an approximate generative Markov model. The time-series data are first symbolized by partitioning the continuous measurement space of the signal and then, the discrete sequential data are modeled using symbolic dynamics. In the proposed approach, the size of temporal memory of the symbol sequence is estimated from spectral properties of the resulting stochastic matrix corresponding to a first-order Markov model of the symbol sequence. Then, hierarchical clustering is used to represent the states of the corresponding full-state Markov model to construct a reduced-order or size Markov model with a non-deterministic algebraic structure. Subsequently, the parameters of the reduced-order Markov model are identified from the original model by making use of a Bayesian inference rule. The final model is selected using information-theoretic criteria. The proposed concept is elucidated and validated on two different data sets as examples. The first example analyzes a set of pressure data from a swirl-stabilized combustor, where controlled protocols are used to induce flame instabilities. Variations in the complexity of the derived Markov model represent how the system operating condition changes from a stable to an unstable combustion regime. In the second example, the data set is taken from NASA’s data repository for prognostics of bearings on rotating shafts. We show that, even with a very small state-space, the reduced-order models are able to achieve comparable performance and that the proposed approach provides flexibility in the selection of a final model for representation and learning.

A Simple Reinforcement Learning Mechanism for Resource Allocation in LTE-A Networks with Markov Decision Process and Q-Learning

Resource allocation is still a difficult issue to deal with in wireless networks. The unstable channel condition and traffic demand for Quality of Service (QoS) raise some barriers that interfere with the process. It is significant that an optimal policy takes into account some resources available to each traffic class while considering the spectral efficiency and other related channel issues. Reinforcement learning is a dynamic and effective method to support the accomplishment of resource allocation properly maintaining QoS levels for applications. The technique can track the system state as feedback to enhance the performance of a given task. Herein, it is proposed a simple reinforcement learning mechanism introduced in LTE-A networks and aimed to choose and limit the number of resources allocated for each traffic class, regarding the QoS Class Identifier (QCI), at each Transmission Time Interval (TTI) along the scheduling procedure. The proposed mechanism implements a Markov Decision Process (MDP) solved by the Q-Learning algorithm to find an optimal action-state decision policy. The results obtained from simulation exhibit good performance, especially for the real-time Video application.

Cold-Start Reinforcement Learning with Softmax Policy Gradients

Policy-gradient approaches to reinforcement learning have two common and undesirable overhead procedures, namely warm-start training and sample variance reduction. In this paper, we describe a reinforcement learning method based on a softmax policy that requires neither of these procedures. Our method combines the advantages of policy-gradient methods with the efficiency and simplicity of maximum-likelihood approaches. We apply this new cold-start reinforcement learning method in training sequence generation models for structured output prediction problems. Empirical evidence validates this method on automatic summarization and image captioning tasks.

Generative Adversarial Networks with Inverse Transformation Unit

In this paper we introduce a new structure to Generative Adversarial Networks by adding an inverse transformation unit behind the generator. We present two theorems to claim the convergence of the model, and two conjectures to nonideal situations when the transformation is not bijection. A general survey on models with different transformations was done on the MNIST dataset and the Fashion-MNIST dataset, which shows the transformation does not necessarily need to be bijection. Also, with certain transformations that blurs an image, our model successfully learned to sharpen the images and recover blurred images, which was additionally verified by our measurement of sharpness.

On Categorical Time Series Models With Covariates

We study the problem of stationarity and ergodicity for autoregressive multinomial logistic time series models which possibly include a latent process and are defined by a GARCH-type recursive equation. We improve considerably upon the existing results related to stationarity and ergodicity conditions of such models. Proofs are based on theory developed for chains with complete connections. This approach is based on a useful coupling technique which is utilized for studying ergodicity of more general finite-state stochastic processes. Such processes generalize finite-state Markov chains by assuming infinite order models of past values. For finite order Markov chains, we also discuss ergodicity properties when some strongly exogenous covariates are considered in the dynamics of the process.

A Bimodal Network Approach to Model Topic Dynamics

This paper presents an intertemporal bimodal network to analyze the evolution of the semantic content of a scientific field within the framework of topic modeling, namely using the Latent Dirichlet Allocation (LDA). The main contribution is the conceptualization of the topic dynamics and its formalization and codification into an algorithm. To benchmark the effectiveness of this approach, we propose three indexes which track the transformation of topics over time, their rate of birth and death, and the novelty of their content. Applying the LDA, we test the algorithm both on a controlled experiment and on a corpus of several thousands of scientific papers over a period of more than 100 years which account for the history of the economic thought.

Change-point detection for Piecewise Deterministic Markov Processes

We consider a change-point detection problem for a simple class of Piecewise Deterministic Markov Processes (PDMPs). A continuous-time PDMP is observed in discrete time and through noise, and the aim is to propose a numerical method to accurately detect both the date of the change of dynamics and the new regime after the change. To do so, we state the problem as an optimal stopping problem for a partially observed discrete-time Markov decision process taking values in a continuous state space and provide a discretization of the state space based on quantization to approximate the value function and build a tractable stopping policy. We provide error bounds for the approximation of the value function and numerical simulations to assess the performance of our candidate policy.

Replicability Analysis for Natural Language Processing: Testing Significance with Multiple Datasets

With the ever-growing amounts of textual data from a large variety of languages, domains, and genres, it has become standard to evaluate NLP algorithms on multiple datasets in order to ensure consistent performance across heterogeneous setups. However, such multiple comparisons pose significant challenges to traditional statistical analysis methods in NLP and can lead to erroneous conclusions. In this paper, we propose a Replicability Analysis framework for a statistically sound analysis of multiple comparisons between algorithms for NLP tasks. We discuss the theoretical advantages of this framework over the current, statistically unjustified, practice in the NLP literature, and demonstrate its empirical value across four applications: multi-domain dependency parsing, multilingual POS tagging, cross-domain sentiment classification and word similarity prediction.

Inference for Impulse Responses under Model Uncertainty

In many macroeconomic applications, impulse responses and their (bootstrap) confidence intervals are constructed by estimating a VAR model in levels – thus ignoring uncertainty regarding the true (unknown) cointegration rank. While it is well known that using a wrong cointegration rank leads to invalid (bootstrap) inference, we demonstrate that even if the rank is consistently estimated, ignoring uncertainty regarding the true rank can make inference highly unreliable for sample sizes encountered in macroeconomic applications. We investigate the effects of rank uncertainty in a simulation study, comparing several methods designed for handling model uncertainty. We propose a new method – Weighted Inference by Model Plausibility (WIMP) – that takes rank uncertainty into account in a fully data-driven way and outperforms all other methods considered in the simulation study. The WIMP method is shown to deliver intervals that are robust to rank uncertainty, yet allow for meaningful inference, approaching fixed rank intervals when evidence for a particular rank is strong. We study the potential ramifications of rank uncertainty on applied macroeconomic analysis by re-assessing the effects of fiscal policy shocks based on a variety of identification schemes that have been considered in the literature. We demonstrate how sensitive the results are to the treatment of the cointegration rank, and show how formally accounting for rank uncertainty can affect the conclusions.

DeepTransport: Learning Spatial-Temporal Dependency for Traffic Condition Forecasting

Predicting traffic conditions has been recently explored as a way to relieve traffic congestion. Several pioneering approaches have been proposed based on traffic observations of the target location as well as its adjacent regions, but they obtain somewhat limited accuracy due to lack of mining road topology. To address the effect attenuation problem, we propose to take account of the traffic of surrounding locations(wider than adjacent range). We propose an end-to-end framework called DeepTransport, in which Convolutional Neural Networks (CNN) and Recurrent Neural Networks (RNN) are utilized to obtain spatial-temporal traffic information within a transport network topology. In addition, attention mechanism is introduced to align spatial and temporal information. Moreover, we constructed and released a real-world large traffic condition dataset with 5-minute resolution. Our experiments on this dataset demonstrate our method captures the complex relationship in temporal and spatial domain. It significantly outperforms traditional statistical methods and a state-of-the-art deep learning method.

How regularization affects the critical points in linear networks

This paper is concerned with the problem of representing and learning a linear transformation using a linear neural network. In recent years, there has been a growing interest in the study of such networks in part due to the successes of deep learning. The main question of this body of research and also of this paper pertains to the existence and optimality properties of the critical points of the mean-squared loss function. The primary concern here is the robustness of the critical points with regularization of the loss function. An optimal control model is introduced for this purpose and a learning algorithm (regularized form of backprop) derived for the same using the Hamilton’s formulation of optimal control. The formulation is used to provide a complete characterization of the critical points in terms of the solutions of a nonlinear matrix-valued equation, referred to as the characteristic equation. Analytical and numerical tools from bifurcation theory are used to compute the critical points via the solutions of the characteristic equation. The main conclusion is that the critical point diagram can be fundamentally different even with arbitrary small amounts of regularization.

Pattern Colored Hamilton Cycles in Random Graphs
Recognizing Weak Embeddings of Graphs
Understanding Infographics through Textual and Visual Tag Prediction
PASS-GLM: polynomial approximate sufficient statistics for scalable Bayesian GLM inference
A Centralized Power Control and Management Method for Grid-Connected Photovoltaic (PV)-Battery Systems
Dataset Construction via Attention for Aspect Term Extraction with Distant Supervision
Optimizing PID parameters with machine learning
Dose Prediction with U-net: A Feasibility Study for Predicting Dose Distributions from Contours using Deep Learning on Prostate IMRT Patients
Predicting Disease-Gene Associations using Cross-Document Graph-based Features
Learning to Explain Non-Standard English Words and Phrases
Data-Driven Analysis of Mass-Action Kinetics
Large deviations of Markov chains with multiple time-scales
From Blind deconvolution to Blind Super-Resolution through convex programming
Particle rolling MCMC with double block sampling: conditional SMC update approach
Fast Shadow Detection from a Single Image Using a Patched Convolutional Neural Network
SURGE: Continuous Detection of Bursty Regions Over a Stream of Spatial Objects
Dynamic Label Graph Matching for Unsupervised Video Re-Identification
An Empirical approach to Survival Density Estimation for randomly-censored data using Wavelets
Multi-way Interacting Regression via Factorization Machines
A Structural Characterization of Market Power in Power Markets
Effective Image Retrieval via Multilinear Multi-index Fusion
Strong-Feller property for Navier-Stokes equations driven by space-time white noise
On the construction of converging hierarchies for polynomial optimization based on certificates of global positivity
Two-phase framework for optimal multi-target Lambert rendezvous
Pareto front generation with knee-point based pruning for mixed discrete multi-objective optimization
Global multivariate point pattern models for rain type occurrence
Pseudo-labels for supervised learning on event-based data
Augmented Robust PCA For Foreground-Background Separation on Noisy, Moving Camera Video
Antichain toggling and rowmotion
Second-generation p-values: improved rigor, reproducibility, & transparency in statistical analyses
A Read-Write Memory Network for Movie Story Understanding
Signature Verification Approach using Fusion of Hybrid Texture Features
Large deviations for cascades of diffusions arising in oscillating systems of interacting Hawkes processes
Learning Distributions of Meant Color
Research on several key technologies in practical speech emotion recognition
Influence of the regularity of the test functions for weak convergence in numerical discretization of SPDEs
Masked Toeplitz covariance estimation
Poisson-Delaunay Mosaics of Order $k$
Gaussian process modelling using UQLab
Globally-Optimal Inlier Set Maximisation for Simultaneous Camera Pose and Feature Correspondence
Human Detection for Night Surveillance using Adaptive Background Subtracted Image
Slim-DP: A Light Communication Data Parallelism for DNN
Low-Complexity Iterative Detection for Orthogonal Time Frequency Space Modulation
Very fat geometric galton-watson trees
A Preliminary Study for Building an Arabic Corpus of Pair Questions-Texts from the Web: AQA-Webcorp
Berry-Esseen bounds for the chi-square distance in the Central Limit Theorem
A discrete choice model for solving conflict situations between pedestrians and vehicles in shared space
Light field super resolution through controlled micro-shifts of light field sensor
Leveraging Weakly Annotated Data for Fashion Image Retrieval and Label Prediction
3-coloring triangle-free planar graphs with a precolored 9-cycle
FoodNet: Recognizing Foods Using Ensemble of Deep Networks
Free electron screening mechanism of the shallow impurity breakdown in n-GaAs: evidences from the photoelectric Zeeman and cyclotron resonance spectroscopies
Scene learning, recognition and similarity detection in a fuzzy ontology via human examples
Prosodic Features from Large Corpora of Child-Directed Speech as Predictors of the Age of Acquisition of Words
Information processing features can detect behavioral regimes of dynamical systems
A Literature Based Approach to Define the Scope of Biomedical Ontologies: A Case Study on a Rehabilitation Therapy Ontology
Combining Prediction of Human Decisions with ISMCTS in Imperfect Information Games
Necessary and sufficient conditions for a nonnegative matrix to be strongly R-positive
Hamilton decompositions of one-ended Cayley graphs
The Elephant Quantum Walk
High-dimensional limit theorems for random vectors in $\ell_p^n$-balls
Diversified Coherent Core Search on Multi-Layer Graphs
Random Overlapping Communities: Approximating Motif Densities of Large Graphs
Fast Convolutional Sparse Coding in the Dual Domain
A Benchmark Environment Motivated by Industrial Control Problems
Weighted distances in scale-free configuration models
Surjective H-Colouring over Reflexive Digraphs
Scene Parsing by Weakly Supervised Learning with Image Descriptions
Approximations of Stochastic Navier-Stokes Equations
Dykstra splitting and an approximate proximal point algorithm for minimizing the sum of convex functions
Modeling the Resource Requirements of Convolutional Neural Networks on Mobile Devices
A general framework for parallelizing Dyskstra splitting
Simultaneous-equation Estimation without Instrumental Variables
Estimation of a Continuous Distribution on a Real Line by Discretization Methods — Complete Version–
Introducing machine learning for power system operation support
ANSAC: Adaptive Non-minimal Sample and Consensus
Entrywise Eigenvector Analysis of Random Matrices with Low Expected Rank
Traffic Optimization For a Mixture of Self-interested and Compliant Agents
Fillable arrays with constant time operations and a single bit of redundancy
Self-Organization in Networks: A Data-Driven Koopman Approach
Neural networks for topology optimization
Continuous attractor-based clocks are unreliable phase estimators
Connectivity Learning in Multi-Branch Networks
Case Study: Explaining Diabetic Retinopathy Detection Deep CNNs via Integrated Gradients
Multi-Label Classification of Patient Notes a Case Study on ICD Code Assignment
On the maximum number of integer colourings with forbidden monochromatic sums
An attentive neural architecture for joint segmentation and parsing and its application to real estate ads
Extremality of graph entropy based on degrees of uniform hypergraphs with few edges
Privacy-Preserving Platform for Transactive Energy Systems
The Nu Class of Low-Degree-Truncated Rational Multifunctions. Ic. IMSPE-optimal designs with circular-disk prediction domains
On the Design of Communication and Transaction Anonymity in Blockchain-Based Transactive Microgrids
Riemannian approach to batch normalization
Bayesian Dynamic Tensor Regression
A Policy Search Method For Temporal Logic Specified Reinforcement Learning Tasks
PlaTIBART: a Platform for Transactive IoT Blockchain Applications with Repeatable Testing
The size of the boundary in first-passage percolation
Providing Privacy, Safety, and Security in IoT-Based Transactive Energy Systems using Distributed Ledgers
Selling to Cournot oligopolists: pricing under uncertainty & generalized mean residual life
A study of ancient Khmer ephemerides
Independence in generic incidence structures
Weighted Sum-Throughput Maximization for Energy Harvesting Powered MIMO Multi-Access Channels
Optimal stopping of marked point processes and reflected backward stochastic differential equations
Randomized experiments to detect and estimate social influence in networks
Neural Multi-Atlas Label Fusion: Application to Cardiac MR Images
On the Circuit Diameter of some Combinatorial Polytopes
Statistical Challenges of Big Brain Network Data
Exploring the subsurface atomic structure of the epitaxially grown phase change material Ge$_2$Sb$_2$Te$_5$
Scaling Author Name Disambiguation with CNF Blocking
A note on the grid Ramsey problem
Pointless Continuous Spatial Surface Reconstruction