Seminars and Colloquia by Series

Learning Theory of Transformers: Sample-Efficient In-Context Learning and Softmax Partitions of Unity

Series
Applied and Computational Mathematics Seminar
Time
Monday, October 26, 2026 - 14:00 for 1 hour (actually 50 minutes)
Location
Skiles 005 and https://gatech.zoom.us/j/94954654170
Speaker
Zhongjie Shi – Georgia Tech –

 

Pretrained Transformers adapt to an unseen task from a short prompt, with no parameter update. This ability, known as in-context learning (ICL), raises a basic question: how does the structure shared across tasks reduce the number of examples a new task requires? We quantify low-dimensional cross-task structure through the covering numbers of the task space, without assuming an explicit parametric representation. The cover supplies anchor functions, and ICL reduces to a task-identification-and-evaluation procedure: the context localizes the unseen task among the anchors, and the prediction at a query aggregates the anchors’ values there. We construct a three-block Transformer that implements this procedure and derive a generalization bound that separates the number of pretraining tasks from the prompt length: the pretraining cost is governed by the intrinsic dimensions of the task space and input domain, while, with sufficiently many pretraining tasks, the dependence on the prompt length becomes dimension-free. The key technical tool is a local-to-global approximation principle realized by a softmax partition of unity: with suitably chosen affine scores, softmax attention produces localized weights that sum to one, so that dense, shallow Transformers with standard softmax attention and sinusoidal positional encodings can glue local approximations into a global one. We further extend this idea to operator learning: a two-level softmax partition of unity, over the input function class and the output domain, yields power-law model- and data-scaling laws for Transformer operator networks on input function classes of low intrinsic dimension. Experiments on the Burgers’ and KdV equations confirm the predicted scaling.

The motivic Lie algebra in the cohomology of moduli spaces

Series
Algebra Seminar
Time
Monday, October 26, 2026 - 13:00 for 1 hour (actually 50 minutes)
Location
Skiles 005
Speaker
Sam Payne – University of Michigan

Recent work studying relations between moduli spaces in algebraic and tropical geometry reveals new and previously unexpected structures in the weight zero cohomology of moduli of curves and abelian varieties. Surprisingly, the motivic Lie algebra, a free Lie algebra with one generator in each odd degree greater than or equal to 3, whose representations control the category of mixed Tate motives over Z, appears in the weight zero cohomology of both of these spaces, with no natural map between the two. I will discuss these structures and highlight recent work of Amy Bradford that connects these two copies of the motivic Lie algebra, through the weight zero cohomology of the moduli of curves of compact type.

Entropic Techniques for Counting Colorful Structures

Series
Combinatorics Seminar
Time
Friday, October 23, 2026 - 15:15 for 1 hour (actually 50 minutes)
Location
Skiles 005
Speaker
Maya Sankar – MIT –

 

What is the maximum number of rainbow triangles in an edge-colored graph with m edges and r colors? Using entropic techniques, we prove an upper bound of C(r)*m^{3/2} rainbow triangles — the explicit constant C(r) we derive is best possible whenever there is an affine plane of order r-1. We also show that constructions attaining at least (C(r)−eps)*m^{3/2} rainbow triangles must exhibit an affine plane structure for sufficiently small epsilon, which further improves the upper bound if no such affine plane exists. Lastly, we consider the problem of counting properly edge-colored copies of K_d with d≥4. Surprisingly the optimal construction is the same for any d≥4, but differs from the affine plane construction that was optimal for d=3.

Unit fraction representation using shifted Golomb primes

Series
Additional Talks and Lectures
Time
Thursday, October 22, 2026 - 16:00 for 1 hour (actually 50 minutes)
Location
Skiles 006
Speaker
Rishika Agrawal – University of Georgia

A unit fraction representation of a positive rational number writes it as a sum of finitely many unit fractions $\frac{1}{n}$ with distinct positive integers $n$. In 1202, Fibonacci showed that every positive rational number has such a representation. Since then, people have been interested in representations with special properties. In this spirit, Bloom asked: which sets $A \subseteq \mathbb{N}$ can represent every positive rational number, subject to some local conditions, using only denominators from $A$? Croot proved in 2003 that for any finite colouring of $\mathbb{N}$, $1$ can be written as sum of unit fractions with denominators in a single-color class. Bloom showed that any $A$ with positive upper logarithmic density works, and Liu and Sawhney improved this to sets with upper logarithmic density $(\log N)^{-1/5 + o(1)}$. Bloom also showed that the shifted primes $p-1$ have this property.

 

To characterize all sets $A$ with this special property, we need to understand which arithmetic properties make this possible. One way to do that is to study thinner sets that still have this special property. In this talk we show that the shifted Golomb primes have this property. The Golomb primes are a subset of primes defined by $q_1 = 3$ and, once $q_1, \dots, q_k$ are known, $q_{k+1}$ is the smallest prime $p$ with $p \not\equiv 1 \pmod{q_i}$ for all $i \le k$. They are a natural generalization of the primes, and their relative density in the primes is about $1/(loglogx)$, which goes to $0$.

Sampling and Inference Time Computation (Unusual Room!)

Series
Stochastics Seminar
Time
Thursday, October 22, 2026 - 15:30 for 1 hour (actually 50 minutes)
Location
Skiles 254
Speaker
Abhishek Shetty – Georgia Institute of Technology –

The success of modern generative models (LLMs) is a technological breakthrough, but foundations on which it is built has remained largely a mystery. A foundational understanding of the distributions that they sample from would vastly improve our ability to both diagnose potential issues (e.g. from a safety perspective) and also ability to push the applications of these models (e.g. in challenging settings such as scientific discovery). In this talk, I will broadly survey some aspects of work in this line while zooming in on a particular aspect: understanding sampling at inference time. In particular, we ask the question of how we can elicit, understand and control new behavior from language models particularly aimed towards long horizon tasks such as reasoning. Typical algorithmic interventions here suffer the issue of having errors compound with the time horizon. In this talk, we will see how these questions here can be connected to classical algorithmic questions from the theory of sampling and Markov chain Monte Carlo.  Using this new perspective, we will present an algorithm VGB, that circumvents compounding of error with the horizon. Time permitting, we will survey the broader algorithmic landscape, with further connections to particle filtering and stochastic control. 

 

This talk is based on joint work with Dhruv Rohatgi, Yuchen Li, Donya Salless, Andrej Risteski, Ankur Moitra and Dylan Foster.

High-Order Reduced Dynamics near Fixed Points and Quasi-Periodic Invariant Tori

Series
CDSNS Colloquium
Time
Thursday, October 22, 2026 - 15:00 for 1 hour (actually 50 minutes)
Location
Skiles 005
Speaker
Joan Gimeno – University of Barcelona

Local invariant manifolds provide a natural way to separate center,
stable, and unstable dynamics near an invariant object and, at the
same time, to construct lower-dimensional models of the dynamics. In
this talk, I will present a unified numerical procedure for computing
high-order local invariant manifolds attached to fixed points and
reducible quasi-periodic invariant tori of Poincaré maps. The
fixed-point setting appears naturally as the zero-dimensional case of
the quasi-periodic formulation.

For a quasi-periodic skew-product, the normal variational dynamics
along the torus defines a linear cocycle over a rigid
rotation. Assuming reducibility, a Floquet transformation converts
this cocycle into a constant matrix, so that a spectral splitting can
be introduced as in the fixed-point case. The desired invariant
manifold is then represented as a graph over a selected spectral
subspace. Expanding this graph in Fourier–Taylor series leads, order
by order, to cohomological equations whose solvability is governed by
the interaction between the base rotation and the Floquet
spectrum. The same construction also provides the nonlinear dynamics
induced on the selected variables, yielding an explicit reduced model
together with a lifting to the full phase space.  

I will illustrate the method first on a (quasi-)periodically forced
pendulum, which provides a simple setting in which to visualize the
response torus, its center reduction, and the dynamics generated by
the reduced map. Time permitting, I will also discuss how the same
ideas arise in (quasi-)periodically forced models from celestial
mechanics.


Joint works with M. Barcelona, L. Domingo, and M. Jorba-Cusco.

The Study of Wave Turbulence: A Breeding Ground for Mathematical Techniques

Series
School of Mathematics Colloquium
Time
Thursday, October 22, 2026 - 11:00 for 1 hour (actually 50 minutes)
Location
Skiles 005
Speaker
Gigliola Staffilani – Massachusetts Institue of Technology

Wave turbulence theory provides a unifying framework for analyzing the nonlinear interactions of dispersive waves across diverse physical regimes. These interactions manifest over an extensive range of scales and media, encompassing phenomena such as gravitational waves in astrophysical contexts, surface waves in fluid dynamics, coherent structures in quantum systems, and even pattern formation in everyday fluid flows.

Despite their widespread occurrence, the mathematical analysis of such systems remains exceptionally challenging due to the interplay between nonlinearity, dispersion, and randomness. These difficulties have catalyzed the development of sophisticated analytical and probabilistic tools, drawing from partial differential equations, statistical mechanics, and dynamical systems theory.

In this lecture, I will present a short survey of recent advances in the rigorous treatment of wave turbulence, emphasizing key techniques, foundational results, and persistent open problems. Some attention will be given to the derivation and analysis of kinetic equations and the role of resonant interactions in the long-time dynamics of weakly nonlinear wave systems.

Murmurations of quadratic characters over function fields by Alexey Pozdnyakov

Series
Number Theory
Time
Wednesday, October 21, 2026 - 15:30 for 1 hour (actually 50 minutes)
Location
Skiles 005
Speaker
Alexey Pozdnyakov – Princeton University –

Murmurations were first observed as surprising correlations between Frobenius traces and root numbers of elliptic curves. They were then rigorously established for the family of modular forms in the level aspect by Zubrillina, and have since been studied in many families of L-functions in the number field setting. As pointed out by Sarnak, murmurations can also be interpreted as a phase transition in the one-level density of the low-lying zeros of the family. The goal of this talk is to investigate the function field analogue of this phenomenon. We will compute the murmuration density for the family of quadratic characters, relate the mean of the murmuration density to the stable homology of the moduli space of hyperelliptic curves, and clarify the relationship this has to one-level density. As a corollary, we will also obtain non-vanishing results for the L-functions of these curves. This is joint work with Lalín, Lee, and Oliver. 

Gowers Uniformity and Pointwise (Non-)Convergence of Weighted Ergodic Averages

Series
Analysis Seminar
Time
Wednesday, October 21, 2026 - 14:00 for 1 hour (actually 50 minutes)
Location
Skiles 005
Speaker
Felix Brokering – University of Bristol –

 In this talk, we will discuss joint work with Ben Krause on pointwise convergence of weighted ergodic averages. After linking pointwise convergence to quantitative decay in Gowers norms, we present our main result: there exist 1-bounded weights whose Gowers norms all decay to zero, and yet whose weighted averages fail to converge pointwise on some measure preserving system. We also show that this phenomenon is generic in a Baire sense and, as an application, obtain arbitrarily dense Gowers uniform subsets of the natural numbers along which pointwise convergence fails. Time permitting, we will go over some of the ideas behind the construction of a weight whose decay in Gowers norms comes arbitrarily close to the threshold ensuring pointwise convergence, and yet whose averages diverge almost everywhere, showing that this threshold is, in a sense, sharp.
 

Pages