請用此 Handle URI 來引用此文件:
http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/90569
完整後設資料紀錄
DC 欄位 | 值 | 語言 |
---|---|---|
dc.contributor.advisor | 王釧茹 | zh_TW |
dc.contributor.advisor | Chuan-Ju Wang | en |
dc.contributor.author | 劉謦瑄 | zh_TW |
dc.contributor.author | Ching-Hsuan Liu | en |
dc.date.accessioned | 2023-10-03T16:40:29Z | - |
dc.date.available | 2023-11-09 | - |
dc.date.copyright | 2023-10-03 | - |
dc.date.issued | 2023 | - |
dc.date.submitted | 2023-08-08 | - |
dc.identifier.citation | P. Bojanowski, E. Grave, A. Joulin, and T. Mikolov. Enriching word vectors with subword information. Transactions of the Association for Computational Linguistics, 5:135–146, 2017.
A. Bordes, N. Usunier, A. Garcia-Duran, J. Weston, and O. Yakhnenko. Translating embeddings for modeling multi-relational data. In Proceedings of the International Conference on Neural Information Processing Systems, page 2787–2795, 2013. M. Brede. Networks: An Introduction. Oxford University Press, 2010. T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, et al. Language models are few-shot learners. In Proceedings of the International Conference on Neural Information Processing Systems, pages 1877–1901, 2020. Y. Cao, Z. Liu, C. Li, J. Li, and T.-S. Chua. Multi-channel graph neural network for entity alignment. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 1452–1461, 2019. M. Chen, Y. Tian, K.-W. Chang, S. Skiena, and C. Zaniolo. Co-training embeddings of knowledge graphs and entity descriptions for cross-lingual entity alignment. In Proceedings of the 27th International Joint Conference on Artificial Intelligence, page 3998–4004, 2018. M. Chen, Y. Tian, M. Yang, and C. Zaniolo. Multilingual knowledge graph embeddings for cross-lingual knowledge alignment. In Proceedings of the 26th International Joint Conference on Artificial Intelligence, page 1511-1517, 2017. J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 4171–4186, 2018. M. Fey, J. E. Lenssen, C. Morris, J. Masci, and N. M. Kriege. Deep graph matching consensus. In Proceedings of International Conference on Learning Representations, 2020. J. Gasteiger, A. Bojchevski, and S. Günnemann. Predict then propagate: Graph neural networks meet personalized pagerank. In Proceedings of International Conference on Learning Representations, 2019. L. Guo, Y. Han, Q. Zhang, and H. Chen. Deep reinforcement learning for entity alignment. In Findings of the Association for Computational Linguistics, pages 2754–2765, 2022. L. Guo, Z. Sun, and W. Hu. Learning to exploit long-term relational dependen-cies in knowledge graphs. In Proceedings of International Conference on Machine Learning, pages 2505–2514, 2019. G. Ji, S. He, L. Xu, K. Liu, and J. Zhao. Knowledge graph embedding via dynamic mapping matrix. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, pages 687–696, 2015. T. N. Kipf and M. Welling. Semi-supervised classification with graph convolutional networks. In Proceedings of International Conference on Learning Representations, 2017. C.Li, Y.Cao, L.Hou, J.Shi, J.Li, and T.-S.Chua. Semi-supervised entity alignment via joint knowledge embedding model and cross-graph model. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pages 2723–2732, 2019. X. Lin, H. Yang, J. Wu, C. Zhou, and B. Wang. Guiding cross-lingual entity alignment via adversarial knowledge embedding. In Proceedings of 2019 IEEE International Conference on Data Mining, pages 429–438, 2019. Y. Lin, Z. Liu, M. Sun, Y. Liu, and X. Zhu. Learning entity and relation embeddings for knowledge graph completion. In Proceedings of the 29th AAAI Conference on Artificial Intelligence, page 2181–2187, 2015. F. Liu, M. Chen, D. Roth, and N. Collier. Visual pivoting for (unsupervised) entity alignment. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 4257–4266, 2021. Z. Liu, Y. Cao, L. Pan, J. Li, and T.-S. Chua. Exploring and evaluating attributes, values, and structures for entity alignment. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, pages 6355–6364, 2020. F. Mahdisoltani, J. Biega, and F. Suchanek. YAGO3: A knowledge base from multilingual wikipedias. In Proceedings of the 7th Biennial Conference on Innovative Data Systems Research, 2014. X. Mao, W. Wang, Y. Wu, and M. Lan. Boosting the speed of entity alignment 10 ×: Dual attention matching network with normalized hard sample mining. In Proceedings of the Web Conference, pages 821–832, 2021. X. Mao, W. Wang, H. Xu, M. Lan, and Y. Wu. Mraea: An efficient and robust entity alignment approach for cross-lingual knowledge graph. In Proceedings of the 13th International Conference on Web Search and Data Mining, pages 420–428, 2020. X. Mao, W. Wang, H. Xu, Y. Wu, and M. Lan. Relational reflection entity alignment. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management, pages 1095–1104, 2020. H.Nie, X.Han, L.Sun, C.M.Wong, Q.Chen, S.Wu, and W.Zhang. Global structure and local semantics-preserved embeddings for entity alignment. In Proceedings of the 29th International Joint Conference on Artificial Intelligence, pages 3658–3664, 2021. S. Pei, L. Yu, R. Hoehndorf, and X. Zhang. Semi-supervised entity alignment via knowledge graph embedding with awareness of degree difference. In Proceedings of The World Wide Web Conference, pages 3130–3136, 2019. S. Pei, L. Yu, and X. Zhang. Improving cross-lingual entity alignment via optimal transport. In Proceedings of the 28th International Joint Conference on Artificial Intelligence, page 3231–3237, 2019. J. Pennington, R. Socher, and C. Manning. GloVe: Global vectors for word representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, pages 1532–1543, 2014. C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, and P. J. Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(1):1–67, 2020. N. Reimers and I. Gurevych. Sentence-BERT: Sentence embeddings using Siamese BERT-networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pages 3982–3992, 2019. Z.Sun, M.Chen, W.Hu, C.Wang, J.Dai, and W.Zhang. Knowledge association with hyperbolic knowledge graph embeddings. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, pages 5704–5716, 2020. Z. Sun, W. Hu, and C. Li. Cross-lingual entity alignment via joint attribute- preserving embedding. In Proceedings of the Semantic Web–ISWC 2017: The 16th International Semantic Web Conference, pages 628–644, 2017. Z.Sun, W.Hu, Q.Zhang, and Y.Qu. Bootstrapping entity alignment with knowledge graph embedding. In Proceedings of the 27th International Joint Conference on Artificial Intelligence, page 4396–4402, 2018. Z. Sun, J. Huang, W. Hu, M. Chen, L. Guo, and Y. Qu. Transedge: Translating relation-contextualized embeddings for knowledge graphs. In Proceedings of The Semantic Web –ISWC 2019: 18th International Semantic Web Conference, pages 612–629, 2019. Z. Sun, C. Wang, W. Hu, M. Chen, J. Dai, W. Zhang, and Y. Qu. Knowledge graph alignment network with gated multi-hop neighborhood aggregation. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 222–229, 2020. X. Tang, J. Zhang, B. Chen, Y. Yang, H. Chen, and C. Li. Bert-int: A bert-based interaction model for knowledge graph alignment. In Proceedings of the 29th Inter- national Joint Conference on Artificial Intelligence, pages 3174–3180, 2020. B. D. Trisedya, J. Qi, and R. Zhang. Entity alignment between knowledge graphs using attribute embeddings. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 297–304, 2019. D.Vrandečić and M.Krötzsch. Wikidata: A free collaborative knowledge base. Communications of the Association for Computing Machinery, 57(10):78–85, 2014. Z.Wang, Q.Lv, X.Lan, and Y.Zhang. Cross-lingual knowledge graph alignment via graph convolutional networks. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 349–357, 2018. Z. Wang, J. Yang, and X. Ye. Knowledge graph alignment with entity-pair em- bedding. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, pages 1672–1680, 2020. Z. Wang, J. Zhang, J. Feng, and Z. Chen. Knowledge graph embedding by translating on hyperplanes. In Proceedings of the 28th AAAI Conference on Artificial Intelligence, page 1112–1119, 2014. Y. Wu, X. Liu, Y. Feng, Z. Wang, R. Yan, and D. Zhao. Relation-aware entity alignment for heterogeneous knowledge graphs. In Proceedings of the 28th International Joint Conference on Artificial Intelligence, pages 5278–5284, 2019. H.-W.Yang, Y.Zou, P.Shi, W.Lu, J.Lin, and X.Sun. Aligning cross-lingual entities with multi-aspect information. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pages 4431–4441, 2019. S. W.-t. Yih, M.-W. Chang, X. He, and J. Gao. Semantic parsing via staged query graph generation: Question answering with knowledge base. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, pages 1321–1331, 2015. W. Zeng, X. Zhao, J. Tang, and C. Fan. Reinforced active entity alignment. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management, page 2477–2486, 2021. W. Zeng, X. Zhao, J. Tang, and X. Lin. Collective entity alignment via adaptive features. In Proceedings of 2020 IEEE 36th International Conference on Data Engineerings, pages 1870–1873, 2020. W. Zeng, X. Zhao, W. Wang, J. Tang, and Z. Tan. Degree-aware alignment for entities in tail. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, page 811–820, 2020. F. Zhang, N. J. Yuan, D. Lian, X. Xie, and W.-Y. Ma. Collaborative knowledge base embedding for recommender systems. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 353– 362, 2016. Q. Zhang, Z. Sun, W. Hu, M. Chen, L. Guo, and Y. Qu. Multi-view knowledge graph embedding for entity alignment. In Proceedings of the 28th International Joint Conference on Artificial Intelligence, pages 5429–5435, 2019. T. Zhang, F. Wu, A. Katiyar, K. Q. Weinberger, and Y. Artzi. Revisiting few-sample bert fine-tuning. In Proceedings of International Conference on Learning Representations, 2021. X. Zhao, W. Zeng, J. Tang, W. Wang, and F. M. Suchanek. An experimental study of state-of-the-art entity alignment approaches. IEEE Transactions on Knowledge and Data Engineering, 34(6):2610–2625, 2022. Z. Zhong, M. Zhang, J. Fan, and C. Dou. Semantics driven embedding learning for effective entity alignment. In Proceedings of 2022 IEEE 38th International Conference on Data Engineering, pages 2127–2140, 2022. H. Zhu, R. Xie, Z. Liu, and M. Sun. Iterative entity alignment via joint knowledge embeddings. In Proceedings of the 26th International Joint Conference on Artificial Intelligence, pages 4258–4264, 2017. Q. Zhu, X. Zhou, J. Wu, J. Tan, and L. Guo. Neighborhood-aware attentional representation for multilingual knowledge graphs. In Proceedings of the 28th International Joint Conference on Artificial Intelligence, pages 1943–1949, 2019. Y.Zhuang, G.Li, Z.Zhong, and J.Feng. Hike: A hybrid human-machine method for entity alignment in large-scale knowledge bases. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, page 1917–1926, 2017. | - |
dc.identifier.uri | http://tdr.lib.ntu.edu.tw/jspui/handle/123456789/90569 | - |
dc.description.abstract | 本篇論文提出了一個名為 SARA 的框架,它是一種語義輔助的增強式主動學習框架,用於在有限監督場景下增強實體對齊(EA)。SARA 解決了許多現實世界場景中 EA 的挑戰,例如:知識圖譜的異質性以及訓練數據的有限性。SARA 透過結合增強式主動學習與語義訊息,有效地在有限的標記數據中選擇有價值的實體對,並利用提出的 Sentence-BERT based 的成對語言模型來學習能夠捕捉實體名稱語義的實體名稱嵌入。透過將實體名稱嵌入與結構嵌入相結合,並使用一種新穎的語義輔助對齊損失進行模型的訓練。我們在基準數據集和現實世界的數據集上進行了大量的實驗,證明了SARA相對於現有方法的優越性能,特別是在標記數據有限的情況下,表現更為突出。我們還提供了有關微調策略的深入見解,展示了消融研究,並進行了敏感性分析,以從不同面向驗證SARA的有效性。 | zh_TW |
dc.description.abstract | This paper introduces SARA, a semantic-assisted reinforced active learning framework for enhancing entity alignment (EA) under limited supervision scenarios. SARA addresses the challenges of EA in real-world scenarios, including knowledge graph heterogeneity and limited training ground truth. SARA effectively selects valuable entity pairs with limited labeled data by combining reinforced active learning and semantic information. It utilizes a pair-wise language model based on Sentence-BERT to learn informative name embeddings that capture entity name semantics. These embeddings are combined with structural embeddings and trained using a novel semantic-assisted alignment loss. Extensive experiments on benchmark datasets and a real-world dataset demonstrate the superiority of SARA over existing approaches, particularly in limited labeled data scenarios. The paper also provides insights into fine-tuning strategies, presents ablation studies, and conducts sensitivity analyses to validate the effectiveness of SARA. | en |
dc.description.provenance | Submitted by admin ntu (admin@lib.ntu.edu.tw) on 2023-10-03T16:40:28Z No. of bitstreams: 0 | en |
dc.description.provenance | Made available in DSpace on 2023-10-03T16:40:29Z (GMT). No. of bitstreams: 0 | en |
dc.description.tableofcontents | 口試委員審定書 i
誌謝 ii 摘要 iii Abstract iv Contents v List of Figures vii List of Tables viii 1 Introduction 1 2 Related Work 5 3 Preliminary 8 3.1 Problem Formulation 8 3.2 Notations 8 4 Methodology 10 4.1 Preliminaries: Reinforced Active Learning 10 4.1.1 Query Strategies 11 4.1.2 Reinforced active entity selection via CMAB 12 4.2 Semantic-assisted Model Training 12 4.2.1 Title similarity Sentence-BERT for learning name embeddings 13 4.2.2 Unsupervised encoders for learning structural embeddings 14 4.2.3 Semantic-assisted alignment loss (SAL) 15 4.2.4 Combining the structural and SAL losses 17 4.3 Alignment Inference 17 4.4 Iterative Model Training and Inference Procedures 17 5 Experiment 20 5.1 Experimental settings 21 5.1.1 Datasets 21 5.1.2 Evaluation metrics 22 5.1.3 Implementation details 22 5.1.4 Pre-trained language models 23 5.1.5 Compared methods 24 5.2 Main Results (RQ1) 27 5.3 Different Fine-tuning Strategies (RQ2) 28 5.4 Effects of the Semantic-assisted Loss (RQ3) 31 5.4.1 Ablation Study (RQ4) 33 6 Conclusions and Future Work 35 References 37 | - |
dc.language.iso | en | - |
dc.title | SARA:應用語義輔助之強化主動學習策略提升知識圖譜於實體對齊之效能 | zh_TW |
dc.title | SARA: Semantic-assisted Reinforced Active Learning for Entity Alignment | en |
dc.type | Thesis | - |
dc.date.schoolyear | 111-2 | - |
dc.description.degree | 碩士 | - |
dc.contributor.coadvisor | 黃俊郎 | zh_TW |
dc.contributor.coadvisor | Chin-Lang Huang | en |
dc.contributor.oralexamcommittee | 蔡銘峰;黃瀚萱 | zh_TW |
dc.contributor.oralexamcommittee | Ming-Feng Tsai;Hen-Hsen Huang | en |
dc.subject.keyword | 知識圖譜,實體對齊,對比式學習,主動學習,語義訊息, | zh_TW |
dc.subject.keyword | Knowledge Graph,Entity Alignment,Contrastive Learning,Active Learning,Semantic Information, | en |
dc.relation.page | 44 | - |
dc.identifier.doi | 10.6342/NTU202302241 | - |
dc.rights.note | 同意授權(限校園內公開) | - |
dc.date.accepted | 2023-08-09 | - |
dc.contributor.author-college | 電機資訊學院 | - |
dc.contributor.author-dept | 資料科學學位學程 | - |
顯示於系所單位: | 資料科學學位學程 |
文件中的檔案:
檔案 | 大小 | 格式 | |
---|---|---|---|
ntu-111-2.pdf 目前未授權公開取用 | 2.83 MB | Adobe PDF | 檢視/開啟 |
系統中的文件,除了特別指名其著作權條款之外,均受到著作權保護,並且保留所有的權利。