One can nowadays readily generate monodisperse colloidal nanocrystals, but a retrosynthetic analysis is still not possible since the underlying chemistry is often poorly understood. Here, we provide insight into the reaction mechanism of colloidal zirconia and hafnia nanocrystals synthesized from metal chloride and metal isopropoxide. We identify the active precursor species in the reaction mixture through a combination of nuclear magnetic resonance spectroscopy (NMR), density functional theory (DFT) calculations, and pair distribution function (PDF) analysis. We gain insight into the interaction of the surfactant, tri-n-octylphosphine oxide (TOPO), and the different precursors. Interestingly, we identify a peculiar X-type ligand redistribution mechanism that can be steered by the relative amount of Lewis base (L-type). We further monitor how the reaction mixture decomposes using solution NMR and gas chromatography, and we find that ZrCl₄is formed as a by-product of the reaction, limiting the reaction yield. The reaction proceeds via two competing mechanisms: E1 elimination (dominating) and S_N1 substitution (minor). Using this new mechanistic insight, we adapted the synthesis to optimize the yield and gain control over nanocrystal size. These insights will allow the rational design and synthesis of complex oxide nanocrystals.