Awesome-molecule-text

This repository is the collection of papers about Molecular Machine Learning (MoML) with its textual description, aiming to harness the capabilities of language models for learning the accumulated human knowledge in molecular science. The papers are organized in the order of their publication dates.

We will try to make this list updated. If you find any error or any missed paper, please feel free to open issues or pull requests.

Various Molecule-Text Tasks

We categorize various downstream tasks for molecule-text models and provide examples of notable works in each category.

	Text → Mol	Mol → Text	Mol + Text
Discriminative	Molecule Retrieval [1] Molecule Property Prediction [4]	Text Retrieval [4]	Zero-Shot Learning [7, 9]
Generative	Molecule Generation [2, 6] Molecule Editing [4]	Molecule Captioning [2, 6] Molecular Question-Answering [25]

🚨 Workshop Alert

Language + Molecules workshop, which aims to synthsize language and molecules for scientific insight and discovery, will be held at ACL 2024!

Papers

1. [2021 EMNLP] Text2Mol: Cross-Modal Molecule Retrieval with Natural Language Queries [Paper] [Code]
2. [2022 EMNLP] Translation between Molecules and Natural Language (MolT5) [Paper] [Code]
3. [2022 Nature Communications] A deep-learning system bridging molecule structure and biomedical text with comprehension comparable to human professionals [Paper] [Code]
4. [2022 Nature Machine Intelligence] MoleculeSTM: Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editing [Paper] [Code]
5. [2022 arXiv] A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Language [Paper] [Code]
6. [2023 ICML] Unifying Molecular and Textual Representations via Multi-task Language Modeling [Paper] [Code]
7. [2023 ICML] Enhancing Activity Prediction Models in Drug Discovery with the Ability to Understand Human Language [Paper] [Code]
8. [2023 WCB @ ICML] Extracting Molecular Properties from Natural Language with Multimodal Contrastive Learning [Paper]
9. [2023 NeurIPS] GIMLET: A Unified Graph-Text Model for Instruction-Based Molecule Zero-Shot Learning [Paper] [Code]
10. [2023 NeurIPS Benchmark & Dataset] What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks [Paper] [Code]
11. [2023 ACL Short] MolXPT: Wrapping Molecules with Text for Generative Pre-training [Paper]
12. [2023 EMNLP] MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter [Paper] [Code]
13. [2023 EMNLP] BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associations [Paper] [Code]
14. [2023 EMNLP] Predictive Chemistry Augmented with Text Retrieval [Paper] [Code]
15. [2023 EMNLP Findings] ReLM: Leveraging Language Models for Enhanced Chemical Reaction Prediction [Paper] [Code]
16. [2023 arXiv] MolFM: A Multimodal Molecular Foundation Model [Paper] [Code]
17. [2023 arXiv] Can Large Language Models Empower Molecular Property Prediction? [Paper] [Code]
18. [2023 arXiv] Interactive Molecular Discovery with Natural Language [Paper] [Code]
19. [2023 arXiv] Empowering Molecule Discovery for Molecule-Caption Translation with Large Language Models: A ChatGPT Perspective [Paper] [Code]
20. [2023 arXiv] From Artificially Real to Real: Leveraging Pseudo Data from Large Language Models for Low-Resource Molecule Discovery [Paper]
21. [2023 arXiv] GIT-Mol: A Multi-modal Large Language Model for Molecular Science with Graph, Image, and Text [Paper]
22. [2023 arXiv] Catalyst Property Prediction with CatBERTa: Unveiling Feature Exploration Strategies through Large Language Models [Paper] [Code]
23. [2023 arXiv] GPT-MolBERTa: GPT Molecular Features Language Model for molecular property prediction [Paper] [Code]
24. [2024 ICLR] Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Models [Paper] [Code]
25. [2024 ICLR] Towards 3D Molecule-Text Interpretation in Language Models [Paper] [Code]
26. [2024 ICLR] Conversational Drug Editing Using Retrieval and Domain Feedback [Paper] [Code]
27. [2024 ICLR rejected] Text2Data: Low-Resource Data Generation with Textual Control [Paper]
28. [2024 ICLR rejected] Text-guided Diffusion Model for 3D Molecule Generation [Paper]
29. [2024 ICLR rejected] Form follows Function: Text-to-Text Conditional Graph Generation based on Functional Requirements [Paper]
30. [2024 ICML] Data-Efficient Molecular Generation with Hierarchical Textual Inversion [Paper]
31. [2024 ACL] MolTC: Towards Molecular Relational Modeling In Language Models [Paper] [Code]
32. [2024 ACL Findings] ReactXT: Understanding Molecular Relationship via Reaction-Contextualized Molecule-Text Pretraining [Paper] [Code]
33. [2024 KDD] Learning Multi-View Molecular Representations with Structured and Unstructured Knowledge [Paper] [Code]
34. [2024 CIKM] Vision Language Model is NOT All You Need: Augmentation Strategies for Molecule Language Model [Paper] [Code]

Survey on Molecules and Language Models

1. [2023 arXiv] Transformers and Large Language Models for Chemistry and Drug Discovery [Paper]
2. [2023 arXiv] Language models in molecular discovery [Paper]
3. [2024 arXiv] Scientific Language Modeling: A Quantitative Review of Large Language Models in Molecular Science [Paper]

Acknowledgements

This repository is contributed and maintained by Namkyeong Lee, Tianfan Fu, and Siddhartha Laghuvarapu.