-
CiteScore
2.26
Impact Factor
Volume 2, Issue 2, Chinese Journal of Information Fusion
Volume 2, Issue 2, 2025
Submit Manuscript Edit a Special Issue
Academic Editor
Xinde Li
Xinde Li
Southeast University, China
Article QR Code
Article QR Code
Scan the QR code for reading
Popular articles
Chinese Journal of Information Fusion, Volume 2, Issue 2, 2025: 144-156

Open Access | Research Article | 25 May 2025
Knowledge Graph Reasoning with Quantum-Inspired Reinforcement Learning
1 School of Information and Communication Engineering, Beijing University of Posts and Telecommunications, Beijing 100876, China
2 Provincial Key Laboratory of Multimodal Perceiving and Intelligent Systems, Jiaxing University, Jiaxing 314001, China
3 China Academy of Electronics and Information Technology, Beijing 100049, China
* Corresponding Authors: Xianchao Zhang, [email protected] ; Jun Lu, [email protected]
Received: 25 February 2025, Accepted: 28 April 2025, Published: 25 May 2025  
Abstract
Knowledge reasoning is a critical task in information fusion systems, and its core step is reasoning missing information from existing facts to improve the knowledge graphs. Embedding-based reasoning methods and path-based reasoning methods are two mainstream knowledge reasoning methods. Embedding-based reasoning methods enable fast and direct reasoning but are limited to simple relationships between entities and exhibit poor performance in reasoning complex logical relationships. Path-based reasoning methods perform better in complex reasoning tasks, but suffer from high computational complexity, a large number of model parameters, and low reasoning efficiency. To address the aforementioned issues, this paper introduces a knowledge reasoning model called Quantum-Inspired Reinforcement Learning (QIRL). QIRL leverages quantum reinforcement learning to train a strategy network via a quantum circuit, aiming to generate and optimize reasoning paths. Quantum circuit achieves complex nonlinear operations through limited quantum reasoning paths gate operations, reducing computational complexity. In addition, this article utilizes the quantum entanglement property to encode high-dimensional data, reducing the number of model training parameters. This article evaluates the QIRL method on entity prediction task and proves that the QIRL method can effectively reduce the number of model training parameters.

Graphical Abstract
Knowledge Graph Reasoning with Quantum-Inspired Reinforcement Learning

Keywords
knowledge graph
knowledge reasoning
reinforcement learning
quantum circuit

Data Availability Statement
Data will be made available on request.

Funding
This work was supported by the Project of Natural Science Foundation of Zhejiang Province under Grant LD24F020009.

Conflicts of Interest
The authors declare no conflicts of interest.

Ethical Approval and Consent to Participate
Not applicable.

References
  1. Chen, Y., Li, H., Li, H., Liu, W., Wu, Y., Huang, Q., & Wan, S. (2022). An overview of knowledge graph reasoning: key technologies and applications. Journal of Sensor and Actuator Networks, 11(4), 78.
    [CrossRef]   [Google Scholar]
  2. Chen, S., Yang, X., & Li, Z. (2023). Improving semantic segmentation with knowledge reasoning network. Journal of Visual Communication and Image Representation, 96, 103923.
    [CrossRef]   [Google Scholar]
  3. Zhang, Y., & Yao, Q. (2022). Knowledge graph reasoning with relational digraph. Proceedings of the ACM Web Conference 2022, 912–924.
    [CrossRef]   [Google Scholar]
  4. Chen, S. Y. C. (2023). Asynchronous training of quantum reinforcement learning. Procedia Computer Science, 222, 321–330.
    [CrossRef]   [Google Scholar]
  5. Kim, G. S., Chung, J., & Park, S. (2024). Realizing Stabilized Landing for Computation-Limited Reusable Rockets: A Quantum Reinforcement Learning Approach. IEEE Transactions on Vehicular Technology, 73(8), 12252–12257.
    [CrossRef]   [Google Scholar]
  6. Ansere, J. A., Gyamfi, E., Sharma, V., Shin, H., Dobre, O. A., & Duong, T. Q. (2024). Quantum Deep Reinforcement Learning for Dynamic Resource Allocation in Mobile Edge Computing-Based IoT Systems. IEEE Transactions on Wireless Communications, 23(6), 6221–6233.
    [CrossRef]   [Google Scholar]
  7. Arute, F., Arya, K., Babbush, R., Bacon, D., Bardin, J. C., Barends, R., ... & Boixo, S. (2019). Quantum supremacy using a programmable superconducting processor. Nature, 574(7779), 505–510.
    [CrossRef]   [Google Scholar]
  8. Kruse, G., Dragan, T., Wille, R., & Lorenz, J. M. (2023). Variational Quantum Circuit Design for Quantum Reinforcement Learning on Continuous Environments. International Conference on Agents and Artificial Intelligence.
    [CrossRef]   [Google Scholar]
  9. Guo, T., Yang, Q., Wang, C., Liu, Y., Li, P., Tang, J., Li, D., & Wen, Y. (2024). Knowledgenavigator: Leveraging large language models for enhanced reasoning over knowledge graph. Complex & Intelligent Systems, 10(5), 7063–7076.
    [CrossRef]   [Google Scholar]
  10. Chen, S. Y. C., Yang, C. H. H., Qi, J., Chen, P. Y., Ma, X., & Goan, H. S. (2020). Variational quantum circuits for deep reinforcement learning. IEEE Access, 8, 141007–141024.
    [CrossRef]   [Google Scholar]
  11. Bordes, A., Usunier, N., Garcia-Duran, A., Weston, J., & Yakhnenko, O. (2013). Translating embeddings for modeling multi-relational data. Advances in Neural Information Processing Systems, 26.
    [Google Scholar]
  12. Wang, Z., Zhang, J., Feng, J., & Chen, Z. (2014). Knowledge graph embedding by translating on hyperplanes. Proceedings of the AAAI Conference on Artificial Intelligence, 28(1).
    [CrossRef]   [Google Scholar]
  13. Yang, B., Yih, W. T., He, X., Gao, J., & Deng, L. (2014). Embedding Entities and Relations for Learning and Inference in Knowledge Bases. International Conference on Learning Representations.
    [CrossRef]   [Google Scholar]
  14. Lu, H., Hu, H., & Lin, X. (2022). DensE: An enhanced non-commutative representation for knowledge graph embedding with adaptive semantic hierarchy. Neurocomputing, 476, 115–125.
    [CrossRef]   [Google Scholar]
  15. Pavlović, A., & Sallinger, E. (2023). ExpressivE: A Spatio-Functional Embedding For Knowledge Graph Completion. The Eleventh International Conference on Learning Representations.
    [CrossRef]   [Google Scholar]
  16. Dettmers, T., Minervini, P., Stenetorp, P., & Riedel, S. (2018). Convolutional 2d knowledge graph embeddings. Proceedings of the AAAI Conference on Artificial Intelligence, 32(1).
    [CrossRef]   [Google Scholar]
  17. Yang, J., Jiang, X., Gao, Y., Yang, L. T., & Yang, J. (2024). Generalize to Fully Unseen Graphs: Learn Transferable Hyper-Relation Structures for Inductive Link Prediction. Proceedings of the 32nd ACM International Conference on Multimedia, 1274–1282.
    [Google Scholar]
  18. Xiong, W., Hoang, T., & Wang, W. Y. (2017). DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoning. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, 564–573.
    [CrossRef]   [Google Scholar]
  19. Sun, Z., Deng, Z. H., Nie, J. Y., & Tang, J. (2019). RotatE: Knowledge Graph Embedding by Relational Rotation in Complex Space. International Conference on Learning Representations.
    [Google Scholar]
  20. Trouillon, T., Welbl, J., Riedel, S., Gaussier, E., & Bouchard, G. (2016). Complex embeddings for simple link prediction. International Conference on Machine Learning, 2071–2080.
    [CrossRef]   [Google Scholar]
  21. Yang, F., Yang, Z., & Cohen, W. W. (2017). Differentiable learning of logical rules for knowledge base reasoning. Advances in Neural Information Processing Systems, 30.
    [CrossRef]   [Google Scholar]
  22. Sadeghian, A., Armandpour, M., Ding, P., & Wang, D. Z. (2019). Drum: End-to-end differentiable rule mining on knowledge graphs. Advances in Neural Information Processing Systems, 32.
    [CrossRef]   [Google Scholar]
  23. Tang, X., Zhu, S. C., Liang, Y., & Zhang, M. (2024). RulE: Knowledge Graph Reasoning with Rule Embedding. Findings of the Association for Computational Linguistics: ACL 2024, 4316–4335.
    [CrossRef]   [Google Scholar]
  24. Cheng, K., Ahmed, N., & Sun, Y. (2023). Neural Compositional Rule Learning for Knowledge Graph Reasoning. The Eleventh International Conference on Learning Representations.
    [Google Scholar]
  25. Lao, N., & Cohen, W. W. (2010). Relational retrieval using a combination of path-constrained random walks. Machine Learning, 81, 53–67.
    [CrossRef]   [Google Scholar]
  26. Buluta, I., & Nori, F. (2009). Quantum Simulators. Science, 326(5949), 108–111.
    [CrossRef]   [Google Scholar]
  27. Zhou, Y., Stoudenmire, E. M., & Waintal, X. (2020). What Limits the Simulation of Quantum Computers? Phys. Rev. X, 10(4), 041038.
    [CrossRef]   [Google Scholar]

Cite This Article
APA Style
Chen, J., Zhang, X., Sun, F., & Lu, J. (2025). Knowledge Graph Reasoning with Quantum-Inspired Reinforcement Learning. Chinese Journal of Information Fusion, 2(2), 144–156. https://doi.org/10.62762/CJIF.2025.552445

Article Metrics
Citations:

Crossref

0

Scopus

0

Web of Science

0
Article Access Statistics:
Views: 240
PDF Downloads: 44

Publisher's Note
IECE stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions
CC BY Copyright © 2025 by the Author(s). Published by Institute of Emerging and Computer Engineers. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.
Chinese Journal of Information Fusion

Chinese Journal of Information Fusion

ISSN: 2998-3371 (Online) | ISSN: 2998-3363 (Print)

Email: [email protected]

Portico

Portico

All published articles are preserved here permanently:
https://www.portico.org/publishers/iece/

Copyright © 2025 Institute of Emerging and Computer Engineers Inc.