The modular variety of hyperelliptic curves of genus three