Filtern
Dokumenttyp
- Wissenschaftlicher Artikel (12)
- Preprint (5)
- Konferenzveröffentlichung (3)
- Dissertation (1)
Schlagworte
- DECIMER (2)
- Deep Learning (2)
- Deep learning (2)
- OCSR (2)
- OCSR, Optical Chemical Structure Recognition (2)
- Transformer (2)
- AI (1)
- Chemical structure depictions (1)
- Datensatz (1)
- Hand-drawn chemical structures (1)
- Hand-drawn images (1)
- Molecule images (1)
- Naturstoff (1)
- Optical Chemical Structure Recognition (1)
- artificial intelligence (1)
- machine learning (1)
- optical chemical structure recognition (1)
Institut
- Institut für biologische und chemische Informatik (21) (entfernen)
Advancements in Hand-Drawn Chemical Structure Recognition through an Enhanced DECIMER Architecture
(2024)
Accurate recognition of hand-drawn chemical structures is crucial for digitising hand-written chemical information found in traditional laboratory notebooks or for facilitating stylus-based structure entry on tablets or smartphones. However, the inherent variability in hand-drawn structures poses challenges for existing Optical Chemical Structure Recognition (OCSR) software. To address this, we present an enhanced Deep lEarning for Chemical ImagE Recognition (DECIMER) architecture that leverages a combination of Convolutional Neural Networks (CNNs) and Transformers to improve the recognition of hand-drawn chemical structures. The model incorporates an EfficientNetV2 CNN encoder that extracts features from hand-drawn images, followed by a Transformer decoder that converts the extracted features into Simplified Molecular Input Line Entry System (SMILES) strings. Our models were trained using synthetic hand-drawn images generated by RanDepict, a tool for depicting chemical structures with different style elements. To evaluate the model's performance, a benchmark was performed using a real-world dataset of hand-drawn chemical structures. The results indicate that our improved DECIMER architecture exhibits a significantly enhanced recognition accuracy compared to other approaches.