Vector-valued modular forms and the Gauss map