Nonparametric statistical estimation

Estimate flexible functions and distributions while balancing smoothness, bias, variance, adaptivity, and uncertainty.

10 published lessons1 module378 min of guided study
  1. 01
    Nonparametric statistical estimationadvanced · 10 lessons

Follow the path or begin with a question. Every lesson is open.

Your notebook0 of 10 lessons completed

Your place, at your pace. Progress is optional and saved only in this browser when available.

Inside this module

Each lesson includes an interactive lab

Nonparametric statistical estimation

Estimate flexible functions and distributions while balancing smoothness, bias, variance, adaptivity, and uncertainty.

  1. 01

    Empirical distributions and uniform bands

    Estimate a complete cumulative distribution and distinguish a simultaneous finite-sample guarantee from a pointwise interval.

    34 min
  2. 02

    Kernel density estimation and bandwidth

    Normalize a density smoother, derive its leading bias and variance, and separate interior asymptotics from boundary behavior.

    37 min
  3. 03

    Local polynomial regression

    Fit weighted local Taylor models, derive reproduction identities, and understand boundary correction without assuming positive prediction weights.

    37 min
  4. 04

    Orthogonal series estimation

    Translate function estimation into noisy coefficient estimation and separate exact Parseval risk identities from approximate regression analogies.

    36 min
  5. 05

    Smoothing splines and penalized functions

    Control curvature directly through a Sobolev penalty and distinguish the infinite-dimensional variational problem from a restricted polynomial calculation.

    37 min
  6. 06

    Minimax rates over smoothness classes

    Match a constructive bias–variance bound with a testing lower-bound argument, while keeping experiment, dimension and loss explicit.

    39 min
  7. 07

    Lepski adaptation and model selection

    Select a resolution by calibrated comparisons, and distinguish a conditional oracle argument from a complete adaptive risk or confidence theorem.

    40 min
  8. 08

    Rank tests and distribution-free inference

    Derive exact rank and sign null distributions from exchangeability, keeping continuity, symmetry and the tested hypothesis distinct.

    37 min
  9. 09

    U-statistics and Hoeffding decomposition

    Separate first-order information from a degenerate pair remainder and identify when the usual square-root-n normal approximation fails.

    40 min
  10. 10

    Nonparametric confidence bands and honesty

    Control smoothing bias and a whole-function coverage event, then distinguish pointwise validity, uniform honesty and adaptation.

    41 min
All mathematics modules