Models of Representations and Langlands Functoriality

In this article we explore the interplay between two generalizations of the Whittaker model, namely the Klyachko models and the degenerate Whittaker models, and two functorial constructions, namely base change and automorphic induction, for the class of unitarizable and ladder representations of the general linear groups.

Analytic Continuation of Equivariant Distributions

We establish a method for constructing equivariant distributions on smooth real algebraic varieties from equivariant distributions on Zariski open subsets. This is based on Bernstein’s theory of analytic continuation of holonomic distributions. We use this to construct H-equivariant functionals on principal series representations of G, where G is a real reductive group and H is an algebraic subgroup. We also deduce the existence of generalized Whittaker models for degenerate principal series representations. As a special case, this gives short proofs of existence of Whittaker models on principal series representations and of analytic continuation of standard intertwining operators. Finally, we extend our constructions to the p-adic case using a recent result of Hong and Sun.

Generalized and degenerate Whittaker models

We study generalized and degenerate Whittaker models for reductive groups over local fields of characteristic zero (archimedean or non-archimedean). Our main result is the construction of epimorphisms from the generalized Whittaker model corresponding to a nilpotent orbit to any degenerate Whittaker model corresponding to the same orbit, and to certain degenerate Whittaker models corresponding to bigger orbits. We also give choice-free definitions of generalized and degenerate Whittaker models. Finally, we explain how our methods imply analogous results for Whittaker–Fourier coefficients of automorphic representations. For $\text{GL}_{n}(\mathbb{F})$ this implies that a smooth admissible representation $\unicode[STIX]{x1D70B}$ has a generalized Whittaker model ${\mathcal{W}}_{{\mathcal{O}}}(\unicode[STIX]{x1D70B})$ corresponding to a nilpotent coadjoint orbit ${\mathcal{O}}$ if and only if ${\mathcal{O}}$ lies in the (closure of) the wave-front set $\operatorname{WF}(\unicode[STIX]{x1D70B})$. Previously this was only known to hold for $\mathbb{F}$ non-archimedean and ${\mathcal{O}}$ maximal in $\operatorname{WF}(\unicode[STIX]{x1D70B})$, see Moeglin and Waldspurger [Modeles de Whittaker degeneres pour des groupes p-adiques, Math. Z. 196 (1987), 427–452]. We also express ${\mathcal{W}}_{{\mathcal{O}}}(\unicode[STIX]{x1D70B})$ as an iteration of a version of the Bernstein–Zelevinsky derivatives [Bernstein and Zelevinsky, Induced representations of reductive p-adic groups. I., Ann. Sci. Éc. Norm. Supér. (4) 10 (1977), 441–472; Aizenbud et al., Derivatives for representations of$\text{GL}(n,\mathbb{R})$and$\text{GL}(n,\mathbb{C})$, Israel J. Math. 206 (2015), 1–38]. This enables us to extend to $\text{GL}_{n}(\mathbb{R})$ and $\text{GL}_{n}(\mathbb{C})$ several further results by Moeglin and Waldspurger on the dimension of ${\mathcal{W}}_{{\mathcal{O}}}(\unicode[STIX]{x1D70B})$ and on the exactness of the generalized Whittaker functor.

A formula for certain Shalika germs of ramified unitary groups

In this article, for nilpotent orbits of ramified quasi-split unitary groups with two Jordan blocks, we give closed formulas for their Shalika germs at certain equi-valued elements with half-integral depth previously studied by Hales. Associated with these elements are hyperelliptic curves defined over the residue field, and the numbers we obtain can be expressed in terms of Frobenius eigenvalues on the first$\ell$-adic cohomology of the curves, generalizing previous result of Hales on stable subregular Shalika germs. These Shalika germ formulas imply new results on stability and endoscopic transfer of nilpotent orbital integrals of ramified unitary groups. We also describe how the same numbers appear in the local character expansions of specific supercuspidal representations and consequently dimensions of degenerate Whittaker models.