Graph-based Preconditioning Conjugate Gradient Algorithm for N-1 Contingency Analysis
Contingency analysis (CA) plays a critical role to guarantee operation security in the modern power systems. With the high penetration of renewable energy, a real-time and comprehensive N-1 CA is needed as a power system analysis tool to ensure system security. In this paper, a graph-based preconditioning conjugate gradient (GPCG) approach is proposed for the nodal parallel computing in N-1 CA. To pursue a higher performance in the practical application, the coefficient matrix of the base case is used as the incomplete LU (ILU) preconditioner for each N-1 scenario. Additionally, the re-dispatch strategy is employed to handle the islanding issues in CA. Finally, computation performance of the proposed GPCG approach is tested on a real provincial system in China.
Learning Deep Generative Models of Graphs
Graphs are fundamental data structures which concisely capture the relational structure in many important real-world domains, such as knowledge graphs, physical and social interactions, language, and chemistry. Here we introduce a powerful new approach for learning generative models over graphs, which can capture both their structure and attributes. Our approach uses graph neural networks to express probabilistic dependencies among a graph’s nodes and edges, and can, in principle, learn distributions over any arbitrary graph. In a series of experiments our results show that once trained, our models can generate good quality samples of both synthetic graphs as well as real molecular graphs, both unconditionally and conditioned on data. Compared to baselines that do not use graph-structured representations, our models often perform far better. We also explore key challenges of learning generative models of graphs, such as how to handle symmetries and ordering of elements during the graph generation process, and offer possible solutions. Our work is the first and most general approach for learning generative models over arbitrary graphs, and opens new directions for moving away from restrictions of vector- and sequence-like knowledge representations, toward more expressive and flexible relational data structures.
Learning Approximate Inference Networks for Structured Prediction
Structured prediction energy networks (SPENs; Belanger & McCallum 2016) use neural network architectures to define energy functions that can capture arbitrary dependencies among parts of structured outputs. Prior work used gradient descent for inference, relaxing the structured output to a set of continuous variables and then optimizing the energy with respect to them. We replace this use of gradient descent with a neural network trained to approximate structured argmax inference. This ‘inference network’ outputs continuous values that we treat as the output structure. We develop large-margin training criteria for joint training of the structured energy function and inference network. On multi-label classification we report speed-ups of 10-60x compared to (Belanger et al, 2017) while also improving accuracy. For sequence labeling with simple structured energies, our approach performs comparably to exact inference while being much faster at test time. We then demonstrate improved accuracy by augmenting the energy with a ‘label language model’ that scores entire output label sequences, showing it can improve handling of long-distance dependencies in part-of-speech tagging. Finally, we show how inference networks can replace dynamic programming for test-time inference in conditional random fields, suggestive for their general use for fast inference in structured settings.
A Bias Aware News Recommendation System
In this era of fake news and political polarization, it is desirable to have a system to enable users to access balanced news content. Current solutions focus on top down, server based approaches to decide whether a news article is fake or biased, and display only trusted news to the end users. In this paper, we follow a different approach to help the users make informed choices about which news they want to read, making users aware in real time of the bias in news articles they were browsing and recommending news articles from other sources on the same topic with different levels of bias. We use a recent Pew research report to collect news sources that readers with varying political inclinations prefer to read. We then scrape news articles on a variety of topics from these varied news sources. After this, we perform clustering to find similar topics of the articles, as well as calculate a bias score for each article. For a news article the user is currently reading, we display the bias score and also display other articles on the same topic, out of the previously collected articles, from different news sources. This we present to the user. This approach, we hope, would make it possible for users to access more balanced articles on given news topics. We present the implementation details of the system along with some preliminary results on news articles.
Bayesian Optimization for Dynamic Problems
We propose practical extensions to Bayesian optimization for solving dynamic problems. We model dynamic objective functions using spatiotemporal Gaussian process priors which capture all the instances of the functions over time. Our extensions to Bayesian optimization use the information learnt from this model to guide the tracking of a temporally evolving minimum. By exploiting temporal correlations, the proposed method also determines when to make evaluations, how fast to make those evaluations, and it induces an appropriate budget of steps based on the available information. Lastly, we evaluate our technique on synthetic and real-world problems.
Ripple Network: Propagating User Preferences on the Knowledge Graph for Recommender Systems
To address the sparsity and cold start problem of collaborative filtering, researchers usually make use of side information, such as social networks or item attributes, to improve recommendation performance. This paper considers the knowledge graph as the source of side information. To address the limitations of existing embedding-based and path-based methods for knowledge-graph-aware recommendation, we propose Ripple Network, an end-to-end framework that naturally incorporates the knowledge graph into recommender systems. Similar to actual ripples propagating on the surface of water, Ripple Network stimulates the propagation of user preferences over the set of knowledge entities by automatically and iteratively extending a user’s potential interests along links in the knowledge graph. The multiple ‘ripples’ activated by a user’s historically clicked items are thus superposed to form the preference distribution of the user with respect to a candidate item, which could be used for predicting the final clicking probability. Through extensive experiments on real-world datasets, we demonstrate that Ripple Network achieves substantial gains in a variety of scenarios, including movie, book and news recommendation, over several state-of-the-art baselines.
Valuing knowledge, information and agency in Multi-agent Reinforcement Learning: a case study in smart buildings
Increasing energy efficiency in buildings can reduce costs and emissions substantially. Historically, this has been treated as a local, or single-agent, optimization problem. However, many buildings utilize the same types of thermal equipment e.g. electric heaters and hot water vessels. During operation, occupants in these buildings interact with the equipment differently thereby driving them to diverse regions in the state-space. Reinforcement learning agents can learn from these interactions, recorded as sensor data, to optimize the overall energy efficiency. However, if these agents operate individually at a household level, they can not exploit the replicated structure in the problem. In this paper, we demonstrate that this problem can indeed benefit from multi-agent collaboration by making use of targeted exploration of the state-space allowing for better generalization. We also investigate trade-offs between integrating human knowledge and additional sensors. Results show that savings of over 40% are possible with collaborative multi-agent systems making use of either expert knowledge or additional sensors with no loss of occupant comfort. We find that such multi-agent systems comfortably outperform comparable single agent systems.
Collaborative Filtering with Graph-based Implicit Feedback
Introducing consumed items as users’ implicit feedback in matrix factorization (MF) method, SVD++ is one of the most effective collaborative filtering methods for personalized recommender systems. Though powerful, SVD++ has two limitations: (i). only user-side implicit feedback is utilized, whereas item-side implicit feedback, which can also enrich item representations, is not leveraged;(ii). in SVD++, the interacted items are equally weighted when combining the implicit feedback, which can not reflect user’s true preferences accurately. To tackle the above limitations, in this paper we propose Graph-based collaborative filtering (GCF) model, Weighted Graph-based collaborative filtering (W-GCF) model and Attentive Graph-based collaborative filtering (A-GCF) model, which (i). generalize the implicit feedback to item side based on the user-item bipartite graph; (ii). flexibly learn the weights of individuals in the implicit feedback hence improve the model’s capacity. Comprehensive experiments show that our proposed models outperform state-of-the-art models.For sparse implicit feedback scenarios, additional improvement is further achieved by leveraging the step-two implicit feedback information.
The Lottery Ticket Hypothesis: Training Pruned Neural Networks
Recent work on neural network pruning indicates that, at training time, neural networks need to be significantly larger in size than is necessary to represent the eventual functions that they learn. This paper articulates a new hypothesis to explain this phenomenon. This conjecture, which we term the ‘lottery ticket hypothesis,’ proposes that successful training depends on lucky random initialization of a smaller subcomponent of the network. Larger networks have more of these ‘lottery tickets,’ meaning they are more likely to luck out with a subcomponent initialized in a configuration amenable to successful optimization. This paper conducts a series of experiments with XOR and MNIST that support the lottery ticket hypothesis. In particular, we identify these fortuitously-initialized subcomponents by pruning low-magnitude weights from trained networks. We then demonstrate that these subcomponents can be successfully retrained in isolation so long as the subnetworks are given the same initializations as they had at the beginning of the training process. Initialized as such, these small networks reliably converge successfully, often faster than the original network at the same level of accuracy. However, when these subcomponents are randomly reinitialized or rearranged, they perform worse than the original network. In other words, large networks that train successfully contain small subnetworks with initializations conducive to optimization. The lottery ticket hypothesis and its connection to pruning are a step toward developing architectures, initializations, and training strategies that make it possible to solve the same problems with much smaller networks.
• Covering relations of k-Grassmannian permutations of type B
• Massive UAV-to-Ground Communication and its Stable Movement Control: A Mean-Field Approach
• Atomic motion in solids with dimpled potentials
• The Noise-Sensitivity Phase Transition in Spectral Group Synchronization Over Compact Groups
• Random walk in cooling random environment: ergodic limits and concentration inequalities
• Exploration of Graph Computing in Power System State Estimation
• A model of reward-modulated motor learning with parallelcortical and basal ganglia pathways
• Join-the-Shortest Queue Diffusion Limit in Halfin-Whitt Regime: Tail Asymptotics and Scaling of Extrema
• Criticality and covered area fraction in confetti percolation
• Generalization in Metric Learning: Should the Embedding Layer be the Embedding Layer?
• Theory for the conditioned spectral density of non-invariant random matrices
• The class of $(P_7,C_4,C_5)$-free graphs: decomposition, algorithms, and $χ$-boundedness
• Embedding rainbow trees with applications to graph labelling and decomposition
• Analysis of Hand Segmentation in the Wild
• Efficient Loss-Based Decoding On Graphs For Extreme Classification
• A New Efficient Stochastic Energy Management Technique for Interconnected AC Microgrids
• A New Bandwidth Selection Criterion for Analyzing Hyperspectral Data Using SVDD
• Motion deblurring of faces
• Nonparametric estimation of the first order Sobol indices with bootstrap bandwidth
• Adversarial Training for Adverse Conditions: Robust Metric Localisation using Appearance Transfer
• Robust MCMC Sampling with Non-Gaussian and Hierarchical Priors in High Dimensions
• Deep Semantic Face Deblurring
• Tracking by Prediction: A Deep Generative Model for Mutli-Person localisation and Tracking
• Joint Estimation and Inference for Data Integration Problems based on Multiple Multi-layered Gaussian Graphical Models
• Expansion for the product of matrices in groups
• Indoor Scene Understanding in 2.5/3D: A Survey
• Task Specific Visual Saliency Prediction with Memory Augmented Conditional Generative Adversarial Networks
• Exceedance probability for parameter estimates
• A Polynomial Kernel for Diamond-Free Editing
• Learning a Discriminative Prior for Blind Image Deblurring
• Efficient Pricing of Barrier Options on High Volatility Assets using Subset Simulation
• Expert Finding in Heterogeneous Bibliographic Networks with Locally-trained Embeddings
• Accurate and Efficient Estimation of Small P-values with the Cross-Entropy Method: Applications in Genomic Data Analysis
• Neural Fine-Grained Entity Type Classification with Hierarchy-Aware Loss
• A Phase Model Approach for Thermostatically Controlled Load Demand Response
• Fast Decoding in Sequence Models using Discrete Latent Variables
• High-Accuracy Low-Precision Training
• Review of Visual Saliency Detection with Comprehensive Information
• New results on $k$-independence of hypergraphs
• Maximum Sum Rate of Slotted Aloha with Successive Interference Cancellation
• Cross-View Image Synthesis using Conditional GANs
• Institutional Metaphors for Designing Large-Scale Distributed AI versus AI Techniques for Running Institutions
• Fusing Hierarchical Convolutional Features for Human Body Segmentation and Clothing Fashion Classification
• Robust Landmark Detection for Alignment of Mouse Brain Section Images
• Interference-Aware Flexible TDD Design for Massive MIMO 5G Systems
• Solving Fourier ptychographic imaging problems via neural network modeling and TensorFlow
• Recurrence and transience of continuous-time open quantum walks
• An Adaptive Nature-inspired Fog Architecture
• The Greek Parliament of 2012: Coalition Formations & Power Indices in Context
• On frequentist coverage errors of Bayesian credible sets in high dimensions
• Upstream Demand Uncertainty in a Two-Echelon Supply Chain: Comparative Statics via Stochastic Orderings
• The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communities
• Exploring the Numerics of Branch-and-Cut for Mixed Integer Linear Optimization
• A user-friendly condition for exponential ergodicity in randomly switched environments
• Maximal commutative subalgebras of a Grassmann algebra
• A Class of Solvable Stationary Singular Stochastic Control Problems
• A Stochastic Semismooth Newton Method for Nonsmooth Nonconvex Optimization
• Monotone Matrix Estimation via Robust Deconvolution
• Single Shot TextSpotter with Explicit Alignment and Attention
• An Unsupervised Model with Attention Autoencoders for Question Retrieval
• Highly Automated Learning for Improved Active Safety of Vulnerable Road Users
• SpCoSLAM 2.0: An Improved and Scalable Online Learning of Spatial Concepts and Language Models with Mapping
• Cooperative Starting Movement Detection of Cyclists Using Convolutional Neural Networks and a Boosted Stacking Ensemble
• Nonlinear Bilateral Output-Feedback Control for a Class of Viscous Hamilton-Jacobi PDEs
• The Szegö-Asymptotics for Doubly-Dispersive Gaussian Channels
• Modelos de Resposta para Experimentos Randomizados em Redes Sociais de Larga Escala
• Controlled viscosity in dense granular materials
• Construction of neural networks for realization of localized deep learning
• Generalised Operations in Free Harmonic Analysis
• A Unified Form of EVENODD and RDP Codes and Their Efficient Decoding
• The nonparametric location-scale mixture cure model
• Generalized distance domination problems and their complexity on graphs of bounded mim-width
• Improving lifecycle query in integrated toolchains using linked data and MQTT-based data warehousing
• Predicting antimicrobial drug consumption using web search data
• Explaining Black-box Android Malware Detection
• On a limiting point process related to modified permutation matrices
• Constrained hierarchical networked optimization for energy markets
• Breast Tumor Classification Based on Decision Information Genes and Inverse Projection Sparse Representation
• The Herzog-Schönheim Conjecture for small groups and harmonic subgroups
• City-wide Analysis of Electronic Health Records Reveals Gender and Age Biases in the Administration of Known Drug-Drug Interactions
• Intentions of Vulnerable Road Users – Detection and Forecasting by Means of Machine Learning
• The Importance of Being Recurrent for Modeling Hierarchical Structure
• Towards Erdos-Hajnal for graphs with no 5-hole
• A feedback control algorithm to steer networks to a Cournot-Nash equilibrium
• Resolution Limits for Detecting Community Changes in Multilayer Networks
• A theory of NP-completeness and ill-conditioning for approximate real computations
• Learning local, quenched disorder in plasticity and other crackling noise phenomena
• On Generation of Adversarial Examples using Convex Programming
• On The Uplink Throughput of Zero-Forcing in Cell-Free Massive MIMO with Coarse Quantization
• Random Access Schemes in Wireless Systems With Correlated User Activity
• The Trade-off between Privacy and Fidelity via Ehrhart Theory
• Shell Mapping for Distribution matching
• A Dynamic Jamming Game for Real-Time Status Updates
• Stable and Consistent Membership at Scale with Rapid
• Virtual Network Embedding Approximations: Leveraging Randomized Rounding
• Hourly-Similarity Based Solar Forecasting Using Multi-Model Machine Learning Blending
• A local depth measure for general data
• The Electric Two-echelon Vehicle Routing Problem
• Spin systems from loop soups
Like this:
Like Loading...