Chunhong Liu, Wenjun Han

(Huazhong Agricultural University)

Abstract：

Multimodal knowledge graph builds multiple modal entities and semantic relationships between multimodal entities on the basis of traditional knowledge graph, which can provide important text, image, and sound knowledge and play a very important role in eliminating ambiguity and supplementing visual knowledge. In recent years, with the rapid development of agricultural informatization and intelligence, knowledge graph technology has received widespread attention. The article provides a detailed introduction to the meanings of knowledge graphs and multimodality, and elaborates on techniques such as multimodal representation learning from the perspective of graph construction. Focusing on the application of multimodal knowledge graph in the field of agriculture, this paper summarizes the research on the application of knowledge graph in agricultural intelligent Q&A, pest and disease recognition, and agricultural product recommendation. It also looks forward to and analyzes the challenges faced in the construction of multimodal knowledge graph in agriculture and the development prospects of multimodal knowledge graph in the field of agriculture.

Key Words：

multimodal; knowledge graph; Q&A; disease and pest identification; agricultural informatization