Demner-Fushman D, Antani SA, Thoma GR.
Multimodal Biomedical Information Retrieval.
The Fourth International Symposium on Languages in Biology and Medicine (LBM 2011). Nanyang Technological University, Singapore. December 2011.
The search for relevant and actionable information is key to achieving clinical and research goals in biomedicine. Biomedical information exists in different forms: as text and illustrations in journal articles and other documents, in images stored in databases, and as patients' cases in electronic health records. This paper presents ways to move beyond conventional text-based searching of these resources by combining text and visual features in search queries and document representation. A combination of techniques and tools from the fields of Natural Language Processing (NLP), Information Retrieval (IR), and Content-Based Image Retrieval (CBIR) allows developing building blocks for advanced information services. Such services enable searching by textual as well as visual queries, and retrieving documents enriched by relevant images, charts, and other illustrations from the journal literature, patient records and image databases.
More about this article: