ABSTRACT Current methods for single-molecule orientation localization microscopy (SMOLM) require optical setups and algorithms that can be prohibitively slow and complex, limiting the widespread adoption for biological applications. We present POLCAM, a simplified SMOLM method based on polarized detection using a polarization camera, that can be easily implemented on any wide-field fluorescence microscope. To make polarization cameras compatible with single-molecule detection, we developed theory to minimize field of view errors, used simulations to optimize experimental design, and developed a fast algorithm based on Stokes parameter estimation which can operate over 1000 fold faster than the state of the art, enabling near instant determination of molecular anisotropy. To aid in the adoption of POLCAM, we developed open-source image analysis software; a napari plugin for visualization of high-dimensional diffraction-limited polarization camera datasets, and a website detailing hardware installation and software use. To illustrate the potential of POLCAM in the life sciences, we applied our method to study both alpha-synuclein fibrils and the actin cytoskeleton of mammalian cells. To demonstrate that POLCAM also allows diffraction-limited imaging, we demonstrate POLCAM imaging actin in fibroblast-like cells and the plasma membrane of live human T cells.