We study the asymptotic dynamics of stochastic Young differential delay equations under the regular assumptions on Lipschitz continuity of the coefficient functions. Our main results show that, if there is a linear part in the drift term which has no delay factor and has eigenvalues of negative real parts, then the generated random dynamical system possesses a random pullback attractor provided that the Lipschitz coefficients of the remaining parts are small.