In spatial imaging, it is well known that two incoherent sources with a separation less than the diffraction limit cannot be resolved, a phenomenon dubbed as Rayleigh’s curse. A recent information theoretic approach suggests that this curse can be avoided using optimal (here, mode-sensitive) measurements instead of the usual intensity-only measurements, which define the classical limit [1] . This quantum enhanced resolution has been realized in both the spatial [2] and temporal domain [3] . Nevertheless, the role of optical coherence on the resolution limit still remains elusive [4] , [5] , [6] . Here, we experimentally resolve this debate using time-domain measurements.