Publications
Detailed Information
ALBERT with Knowledge Graph Encoder Utilizing Semantic Similarity for Commonsense Question Answering
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Byeongmin Choi | - |
dc.contributor.author | YongHyun Lee | - |
dc.contributor.author | Yeunwoong Kyung | - |
dc.contributor.author | Eunchan Kim | - |
dc.date.accessioned | 2022-11-09T09:46:36Z | - |
dc.date.available | 2022-11-09T09:46:36Z | - |
dc.date.issued | 2022-09 | - |
dc.identifier.citation | Intelligent Automation & Soft Computing, Vol.36, No.1, pp.71-82 | ko_KR |
dc.identifier.issn | 1079-8587 | - |
dc.identifier.uri | https://hdl.handle.net/10371/187033 | - |
dc.description.abstract | Recently, pre-trained language representation models such as bidirec tional encoder representations from transformers (BERT) have been performing well in commonsense question answering (CSQA). However, there is a problem that the models do not directly use explicit information of knowledge sources existing outside. To augment this, additional methods such as knowledge-aware graph network (KagNet) and multi-hop graph relation network (MHGRN) have been proposed. In this study, we propose to use the latest pre-trained language model a lite bidirectional encoder representations from transformers (ALBERT) with knowledge graph information extraction technique. We also propose to applying the novel method, schema graph expansion to recent language models. Then, we analyze the effect of applying knowledge graph-based knowledge extraction techniques to recent pre-trained language models and confirm that schema graph expansion is effective in some extent. Furthermore, we show that our proposed model can achieve better performance than existing KagNet and MHGRN models in CommonsenseQA dataset. | ko_KR |
dc.description.sponsorship | This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea Government (MSIT) (No.2020R1G1A1100493). | ko_KR |
dc.language.iso | en | ko_KR |
dc.publisher | Tech Science Press | ko_KR |
dc.subject | Commonsense reasoning | - |
dc.subject | question answering | - |
dc.subject | knowledge graph | - |
dc.subject | language representation model | - |
dc.title | ALBERT with Knowledge Graph Encoder Utilizing Semantic Similarity for Commonsense Question Answering | ko_KR |
dc.type | Article | ko_KR |
dc.identifier.doi | https://doi.org/10.32604/iasc.2023.032783 | ko_KR |
dc.citation.journaltitle | Intelligent Automation & Soft Computing | ko_KR |
dc.citation.endpage | 82 | ko_KR |
dc.citation.number | 1 | ko_KR |
dc.citation.startpage | 71 | ko_KR |
dc.citation.volume | 36 | ko_KR |
- Appears in Collections:
Item View & Download Count
Items in S-Space are protected by copyright, with all rights reserved, unless otherwise indicated.