Critical slowing down exponents in structural glasses: Random orthogonal and related models