Volume 7, Issue 10 (October 2020), Pages: 1-11

----------------------------------------------

 Original Research Paper

 Title: Markov logic for statistical relation extraction

 Author(s): M. D. S. Seneviratne ^1, *, K. S. D. Fernando ², D. D. Karunaratne ¹

 Affiliation(s):

 ¹University of Colombo School of Computing, Colombo, Sri Lanka
 ²Faculty of Information Technology, University of Moratuwa, Moratuwa, Sri Lanka

  Full Text - PDF          XML

 * Corresponding Author. 

  Corresponding author's ORCID profile: https://orcid.org/0000-0003-3362-8550

 Digital Object Identifier: 

 https://doi.org/10.21833/ijaas.2020.10.001

 Abstract:

In today’s world, the Internet has become a fast and efficient information provider, although the relevancy or accuracy of the information found is not guaranteed. The web itself presents numerous problems in finding a required piece of information, mainly due to its heterogeneous nature. Therefore, extracting information from the web is still a challenging task despite the fact that numerous work has been cited in the literature. Extracting information in the form of entities and relations has been addressed by various techniques such as machine learning, natural language processing, and statistical methods, etc. In this paper, we present a rule-based method which is hybridized by machine learning and statistical techniques for accurate performance in domain-specific relation extraction. The rules are modeled in Markov Logic Network to enable statistical performance. Our results on two test domains show overall high values in precision. 

 © 2020 The Authors. Published by IASE.

 This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).

 Keywords: Entity, Relation, Relation extraction, Language dependencies, Markov logic network

 Article History: Received 15 February 2020, Received in revised form 7 June 2020, Accepted 8 June 2020

 Acknowledgment:

No Acknowledgment.

 Compliance with ethical standards

 Conflict of interest: The authors declare that they have no conflict of interest.

 Citation:

 Seneviratne MDS, Fernando KSD, and Karunaratne DD (2020). Markov logic for statistical relation extraction. International Journal of Advanced and Applied Sciences, 7(10): 1-11

 Permanent Link to this page

 Figures

 Fig. 1 Fig. 2 Fig. 3 Fig. 4 Fig. 5 Fig. 6

 Tables

 Table 1 Table 2 Table 3 Table 4

----------------------------------------------

 References (37)

1. Aitken JS (2002). Learning information extraction rules: An inductive logic programming approach. In the 15^th European Conference on Artificial Intelligence (ECAI), IOS Press, Lyon France: 355-359.   [Google Scholar]
2. Aljamel A, Osman T, and Acampora G (2015). Domain-specific relation extraction: Using distant supervision machine learning. In the 7^th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management, IEEE, Lisbon, Portugal, 1: 92-103. https://doi.org/10.5220/0005615100920103   [Google Scholar]
3. Barrière C (2016). Pattern-based relation extraction. In: Barrière C (Ed.), Natural language understanding in a semantic web context: 205-229. Springer, Cham, Switzerland. https://doi.org/10.1007/978-3-319-41337-2_11   [Google Scholar]
4. Carlson A, Betteridge J, Kisiel B, Settles B, Hruschka ER, and Mitchell TM (2010). Toward an architecture for never-ending language learning. In the 24^th AAAI Conference on Artificial Intelligence, AAAI Press, Atlanta, USA: 1306-1313.   [Google Scholar]
5. Celjuska D and Vargas-Vera M (2004). Ontosophie: A semi-automatic system for ontology population from text. In the International Conference on Natural Language Processing, Hainan Island, China.   [Google Scholar]
6. Chiticariu L, Li Y, and Reiss F (2013). Rule-based information extraction is dead! Long live rule-based information extraction systems! In the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, USA: 827-832.   [Google Scholar]
7. Cimiano P and Völker J (2005). Text2Onto. In the International Conference on Application of Natural Language to Information Systems, Springer, Alicante, Spain: 227-238. https://doi.org/10.1007/11428817_21   [Google Scholar]
8. Ciravenga F and Wills Y (2003). Designing adaptive information extraction for the semantic web in Amilcare; annotation for the semantic web. In: Handschuh S and Staab S (Eds.), Frontiers in artificial intelligence and applications: 112-127. IOS Press, Amsterdam, Netherlands.   [Google Scholar]
9. Craven M, DiPasquo D, Freitag D, McCallum A, Mitchell T, Nigam K, and Slattery S (2000). Learning to construct knowledge bases from the World Wide Web. Artificial Intelligence, 118(1-2): 69-113. https://doi.org/10.1016/S0004-3702(00)00004-7   [Google Scholar]
10. Cunningham H, Maynard D, Bontcheva K, Maynard HD, and Tablan V (2002). GATE: A framework and graphical development environment for robust NLP tools and applications. In the 40^th Anniversary Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Philadelphia, USA: 168-175.   [Google Scholar]
11. Doddington GR, Mitchell A, Przybocki MA, Ramshaw LA, Strassel SM, and Weischedel RM (2004). The automatic content extraction (ace) program-tasks, data, and evaluation. In the Proceedings of the 4th International Conference on Language Resources and Evaluation (LREC 2004), 2(1): 837-840.   [Google Scholar]
12. Domingos P and Richardson M (2006). Markov logic networks. Machine Learning, 62(1-2): 107-136. https://doi.org/10.1007/s10994-006-5833-1   [Google Scholar]
13. Drumond L and Girardi R (2009). An experiment using Markov logic networks to extract ontology concepts from text. In the Proceedings of the 2010 ACM Symposium on Applied Computing (ACM, 2010): 1354–1358.   [Google Scholar]
14. Dzeroski S and Lavrac N (1994). Inductive logic programming: Techniques and applications. Ellis Horwood, New York, USA.   [Google Scholar]
15. Eom JH and Zhang BT (2004). PubMiner: Machine learning-based text mining system for biomedical information mining. In the International Conference on Artificial Intelligence: Methodology, Systems, and Applications, Springer, Varna, Bulgaria: 216-225. https://doi.org/10.1007/978-3-540-30106-6_22   [Google Scholar]
16. Etzioni O, Fader A, Christensen J, and Soderland S (2011). Open information extraction: The second generation. In the 22^nd International Joint Conference on Artificial Intelligence, AAAI Press, Barcelona, Spain: 3-10.   [Google Scholar]
17. Fader A, Soderland S, and Etzioni O (2011). Identifying relations for open information extraction. In the Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Edinburgh, UK: 1535-1545.   [Google Scholar]
18. Hong G (2005). Relation extraction using support vector machine. In the International Conference on Natural Language Processing, Springer, Jeju Island, Korea: 366-377. https://doi.org/10.1007/11562214_33   [Google Scholar]
19. Ji G, Liu K, He S, and Zhao J (2017). Distant supervision for relation extraction with sentence-level attention and entity descriptions. In the 31^st AAAI Conference on Artificial Intelligence, AAAI Press, San Francisco, USA: 3060-3066.   [Google Scholar]
20. Li Z, Yang Z, Shen C, Xu J, Zhang Y, and Xu H (2019). Integrating shortest dependency path and sentence sequence into a deep learning framework for relation extraction in clinical text. BMC Medical Informatics and Decision Making, 19: 22. https://doi.org/10.1186/s12911-019-0736-9   [Google Scholar] PMid:30700301 PMCid:PMC6354333
21. Lima R, Espinasse B, and Freitas F (2019). A logic-based relational learning approach to relation extraction: The OntoILPER system. Engineering Applications of Artificial Intelligence, 78: 142-157. https://doi.org/10.1016/j.engappai.2018.11.001   [Google Scholar]
22. Lowd D and Domingos P (2007). Efficient weight learning for Markov logic networks. In the European Conference on Principles of Data Mining and Knowledge Discovery, Springer, Warsaw, Poland: 200-211. https://doi.org/10.1007/978-3-540-74976-9_21   [Google Scholar]
23. Mintz M, Bills S, Snow R, and Jurafsky D (2009). Distant supervision for relation extraction without labeled data. In the Joint Conference of the 47^th Annual Meeting of the ACL and the 4^th International Joint Conference on Natural Language Processing of the AFNLP, Association for Computational Linguistics, Suntec, Singapore, 2: 1003-1011. https://doi.org/10.3115/1690219.1690287   [Google Scholar]
24. Mooney RJ and Nahm UY (2002). Text mining with information extraction. In the AAAI 2002 Spring Symposium on Mining Answers from Texts and Knowledge Bases, AAAI Press, Palo Alto, USA: 60-67.   [Google Scholar]
25. Ningthoujam D, Yadav S, Bhattacharyya P, and Ekbal A (2019). Relation extraction between the clinical entities based on the shortest dependency path based LSTM. Available online at: https://bit.ly/2V4Okzi
26. Pawar S, Bhattacharya P, and Palshikar GK (2016). End-to-end relation extraction using markov logic networks. In the International Conference on Intelligent Text Processing and Computational Linguistics, Springer, Konya, Turkey: 535-551. https://doi.org/10.1007/978-3-319-75487-1_41   [Google Scholar]
27. Schmitz M, Bart R, Soderland S, and Etzioni O (2012). Open language learning for information extraction. In the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Association for Computational Linguistics, Jeju Island, Korea: 523-534.   [Google Scholar]
28. Seneviratne MDS and Ranasinghe DN (2011). Inductive logic programming in an agent system for ontological relation extraction. International Journal of Machine Learning and Computing, 1: 344-352. https://doi.org/10.7763/IJMLC.2011.V1.51   [Google Scholar]
29. Seneviratne MDS and Ranasinghe DN (2014). Natural language dependencies for ontological relation extraction. In the 14^th International Conference on Advances in ICT for Emerging Regions, IEEE, Colombo, Sri Lanka: 142-148. https://doi.org/10.1109/ICTER.2014.7083893   [Google Scholar]
30. Shewchuk JR (1994). An introduction to the conjugate gradient method without the agonizing pain. School of Computer Science, Carnegie Mellon University, Pittsburgh, USA.   [Google Scholar]
31. Singla P and Domingos P (2005). Discriminative training of Markov logic networks. American Association for Artificial Intelligence, 5: 868-873.   [Google Scholar]
32. Wang T, Li Y, Bontcheva K, Cunningham H, and Wang J (2006). Automatic extraction of hierarchical relations from text. In the European Semantic Web Conference, Springer, Budva, Montenegro: 215-229. https://doi.org/10.1007/11762256_18   [Google Scholar]
33. Wu F and Weld DS (2010). Open information extraction using Wikipedia. In the 48^th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Uppsala, Sweden: 118-127.   [Google Scholar]
34. Yao L, Haghighi A, Riedel S, and McCallum A (2011). Structured relation discovery using generative models. In the Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Edinburgh, UK: 1456-1466.   [Google Scholar]
35. Yildiz B and Miksch S (2011). Motivating ontology-driven information extraction. In: Munshi UM and Chaudhuri BB (Eds.), Multimedia information extraction and digital heritage preservation: 1-19. Volume 10, World Scientific, Singapore, Singapore. https://doi.org/10.1142/9789814307260_0001   [Google Scholar]
36. Zeng X, He S, Liu K, and Zhao J (2018). Large scaled relation extraction with reinforcement learning. In the 32^nd AAAI Conference on Artificial Intelligence, AAAI Press, New Orleans, USA: 5658-5665.   [Google Scholar]
37. Zhang NR (2001). Hidden Markov models for information extraction. Technical Report, Stanford Natural Language Processing Group, Stanford, USA.   [Google Scholar]