Abstract The healthcare industry is in dire need for rapid microbial identification techniques. Microbial infection is a major healthcare issue with significant prevalence and mortality, which can be treated effectively during the early stages using appropriate antibiotics. However, determining the appropriate antibiotics for the treatment of the early stages of infection remains a challenge, mainly due to the lack of rapid microbial identification techniques. Conventional culture-based identification and matrix-assisted laser desorption/ionization time-of-flight mass spectroscopy are the gold standard methods, but the sample amplification process is extremely time-consuming. Here, we propose an identification framework that can be used to measure minute quantities of microbes by incorporating artificial neural networks with three-dimensional quantitative phase imaging. We aimed to accurately identify the species of bacterial bloodstream infection pathogens based on a single colony-forming unit of the bacteria. The successful distinction between a total of 19 species, with the accuracy of 99.9% when ten bacteria were measured, suggests that our framework can serve as an effective advisory tool for clinicians during the initial antibiotic prescription. Abstract Figure