Recent advances in achieving ultrahigh spatial resolution (e.g. sub-millimeter) diffusion MRI (dMRI) data have proven highly beneficial in characterizing tissue microstructures in organs such as the brain. However, the routine acquisition of in-vivo dMRI data at such high spatial resolutions has been largely prohibited by factors that include prolonged acquisition times, motion induced artifacts, and low SNR. To overcome these limitations, we present here a framework for acquiring and reconstructing 3D multi-slab, multi-band and interleaved multi-shot EPI data, termed 3D-MB-MUSE. Through multi-band excitations, the simultaneous acquisition of multiple 3D slabs enables whole brain dMRI volumes to be acquired in-vivo on a 3 T clinical MRI scanner at high spatial resolution within a reasonably short amount of time. Representing a true 3D model, 3D-MB-MUSE reconstructs an entire 3D multi-band, multi-shot dMRI slab at once while simultaneously accounting for coil sensitivity variations across the slab as well as motion induced artifacts commonly associated with both 3D and multi-shot diffusion imaging. Such a reconstruction fully preserves the SNR advantages of both 3D and multi-shot acquisitions in high resolution dMRI images by removing both motion and aliasing artifacts across multiple dimensions. By enabling ultrahigh resolution dMRI for routine use, the 3D-MB-MUSE framework presented here may prove highly valuable in both clinical and research applications.