Let $\Gamma$ be a congruence subgroup of level $N$. What is the modular interpretation of $\Gamma\backslash \mathcal{H}^*$, by that I mean what are the elliptic curves + additional structure it parametrizes.
I know the answer when $\Gamma$ is one of the classical groups $\Gamma(N),\Gamma_0(N)$ or $\Gamma_1(N)$ and I'm looking for a more general picture.
Edit : So I guess after thinking about it I have a little a bit of an idea of how this would work but i'm really not sure. Here it goes :
We know that $\Gamma \backslash \mathcal{H} = \overline{\Gamma} \backslash X(N)$ where $N$ is the level of $\Gamma$ and $\overline{\Gamma}$ is the subgroup of $SL_2(\mathbb{Z}/N\mathbb{Z})$.
Furthermore the modular interpretation for $X(N)$ is that it parametrises pairs $(E,(P,Q))$ where
- $E$ is an elliptic curve over $\mathbb{C}$ and $(P,Q)$ is a base of the $N$-torsion of $E$ such that the weil pairing $e(P,Q)$ is equal to $\zeta_n$
- $(E,(P,Q))$ and $(E',(P',Q'))$ are equivalent if $E$ and $E'$ are isomorphic and that the isomorphism between the two sends $(P,Q)$ to $(P',Q')$
So the question can be reformulated as (modulo everything I said before is correct) how does $SL_2(\mathbb{Z}/N\mathbb{Z})$ act on $(E,(P,Q))$. The obvious thing would be that for $\gamma = \left (\begin{smallmatrix} a & b \\ c & d \end{smallmatrix} \right ) \in SL_2(\mathbb{Z}/N\mathbb{Z}) $ we have $\gamma (E,(P,Q)) = (E,(aP + bQ, cP + dQ))$
Then the modular interpretation of $\Gamma \backslash \mathcal{H}$ would be pairs $(E,(P,Q)$ as before which are equivalent if the isomorphism $E \to E'$ sends $(P,Q)$ to $(P'',Q'')$ where $(P'',Q'')$ can be obtained from $(P',Q')$ by a transformation in $\overline{\Gamma}$
As I said I'm not really sure if that is the correct way to think about things especially since I haven't really seen things explained this way before which probably mean it's false (or it was obvious). So I'm looking for someone to tell me if this interpretation is correct and how is it usually done ?
Edit 2 Obviously a good sanity check would be to see if I'm able this way to get the moduli interpretation of $X_0(N)$ and $X_1(N)$ back but so far I haven't be able to do so (but I haven't tried very hard).