Publications

Detailed Information

Bayesian evolutionary hypernetworks for interpretable learning from high-dimensional data

Cited 2 time in Web of Science Cited 2 time in Scopus
Authors

Kim, Soo-Jin; Ha, Jung-Woo; Kim, Heebal; Zhang, Byoung-Tak

Issue Date
2019-08
Publisher
Elsevier BV
Citation
Applied Soft Computing Journal, Vol.81, p. 105477
Abstract
Higher-order representation is suitable for the complicated relationships among many factors. However, existing higher-order classification models have difficulties in learning from high-dimensional data due to their large combinatorial hypothesis spaces. The interpretability of models is also significant for causality analysis. Here we propose a Bayesian evolutionary method to learn a higher-order graphical model for high-dimensional data, called Bayesian evolutionary hypernetwork (BEHN). Our method represents the combinatorial feature space using a generalized graph, hypernetwork. A hypernetwork contains a large population of hyperedges encoding higher-order relationships among feature variables, and is optimized by an evolutionary algorithm formulated as sequential Bayesian sampling. This Bayesian evolutionary approach allows for probabilistic search through the higher-order feature space while satisfying soft constraints defined by the priors. We show that two information-theoretic and complexity-related priors are effective to balance model accuracy and parsimony. Also, BEHN provides interpretable representations to investigate feature interactions. Using two benchmarking and three real-world datasets we demonstrate that BEHN outperforms baseline classification models while tackling large-scale data of dimensionality up to O(10(4)). We also analyze the stability and the scalability of the proposed method with respect to accuracy, computational cost, and the interpretability of the model structures. (C) 2019 Published by Elsevier B.V.
ISSN
1568-4946
URI
https://hdl.handle.net/10371/196070
DOI
https://doi.org/10.1016/j.asoc.2019.05.004
Files in This Item:
There are no files associated with this item.
Appears in Collections:

Altmetrics

Item View & Download Count

  • mendeley

Items in S-Space are protected by copyright, with all rights reserved, unless otherwise indicated.

Share