We provide a complete and detailed study of the high-energy limit offour-parton scattering amplitudes in QCD, giving explicit results at two loopsand higher orders, and going beyond next-to-leading logarithmic (NLL) accuracy.Building upon recent results, we use the techniques of infrared factorizationto investigate the failure of the simplest form of Regge factorization,starting at next-to-next-to-leading logarithmic accuracy (NNLL) in ln(s/|t|).We provide detailed accounts and explicit expressions for the terms responsiblefor this breaking in the case of two-loop and three-loop quark and gluonamplitudes in QCD; in particular, we recover and explain a knownnon-logarithmic double-pole contribution at two-loops, and we compute allnon-factorizing single-logarithmic singular contributions at three loops.Conversely, we use high-energy factorization to show that the hard functions ofinfrared factorization vanish in d = 4 to all orders in the coupling, up to NLLaccuracy in ln(s/|t|). This provides clear evidence for the infrared origin ofhigh-energy logarithms. Finally, we extend earlier studies to t-channelexchanges of color representations beyond the octet, which enables us to givepredictions based on the dipole formula for single-pole NLL contributions atthree and four loops.