Poisson processes and renewals
Connect event counts to waiting times, derive the memoryless special case, and identify what average arrival rates leave unspecified.
On this page
The question for today
What you’ll understand
- Relate a Poisson count distribution to exponential waiting times.
- Distinguish independent increments from independent interarrival times.
- Use a renewal law with explicit positivity and finite-mean assumptions.
Counting requests and measuring time between requests describe the same arrival history from different viewpoints. The homogeneous Poisson process connects them particularly cleanly: counts over disjoint intervals are independent, and waiting times between arrivals are independent exponentials. Real systems often have batches, scheduling, or long pauses, so the model needs justification. Renewal theory retains independent repeated waiting times while allowing their distribution to be nonexponential. This extension explains why identical long-run rates need not imply identical short-term congestion or remaining waiting times.
A rate is part of a stochastic specification
A homogeneous Poisson process starts with count zero and has independent stationary increments: counts on disjoint time intervals are independent, and an interval's count law depends only on its length. Over an interval of length t, the count has Poisson parameter lambda t. Lambda has units of events per time; the parameter is dimensionless. Both the mean and variance of that interval count equal lambda t. Specifying only an empirical average rate does not establish these stronger distributional and independence claims.
The process has isolated unit jumps almost surely. In a short interval h, a single arrival has probability lambda h plus a smaller-order remainder, while two or more arrivals have probability of order h squared. That short-time description is consistent with the Poisson count law. A workload that routinely submits groups of jobs simultaneously violates the simple unit-arrival model, even if its hourly mean happens to match. Nonhomogeneous Poisson models permit a deterministic changing rate but retain independent increments with integrated-rate parameters.
Waiting for an event and restarting after one
The first waiting time exceeds t precisely when there are no arrivals by t, giving the exponential survival function. Independent stationary increments then restart the same waiting-time law after each arrival. An exponential waiting time is memoryless: conditional on having already waited s, the probability of waiting at least another t is unchanged. This concerns the stochastic model, not a claim that a particular job grows no older while it waits or that a service system has no state.
Independent thinning gives another useful consistency check. Keep each Poisson event independently with probability q, without consulting other events or arrival times. The retained events form a Poisson process with rate q lambda; discarded events form an independent process with rate (1−q) lambda. This conclusion can fail if the keep rule depends on congestion or recent history. Superposition also preserves the Poisson family when the input processes are independent, but dependent streams need not combine into a Poisson process.
Renewals preserve fresh starts at arrivals, not at arbitrary times
A renewal process starts at time zero and has independent identically distributed positive interarrival times T₁,T₂,… . The nth arrival occurs at their cumulative sum. Its count at time t is the largest n whose arrival time is no later than t. The strong law for these sums implies that the count divided by elapsed time approaches the reciprocal mean waiting time almost surely, provided the mean is finite and strictly positive. No exponential distribution is required for that long-run result.
A fresh start occurs at an arrival epoch because the future interarrival times are independent copies of the past ones. At an arbitrary observation time, the age and remaining length of the current interval generally matter. Long intervals are more likely to contain a randomly chosen observation time, producing the inspection paradox. Consequently a deterministic two-second spacing and exponential spacing of mean two seconds share rate one-half, yet have different residual-time distributions. Capacity calculations based on a rate alone omit burstiness, tails, and dependence that can dominate waiting-time performance.
Work it through
From a rate to a count and a waiting time
Assume arrivals follow a homogeneous Poisson process with rate 2 per minute. Find the expected count over 1.5 minutes, the probability of exactly two arrivals, and the mean wait to the first arrival.
Multiply rate by interval length: λt=2×1.5=3. The expected count and count variance are both 3; neither says that exactly three arrivals must occur.
Use the count formula at k=2: . The factorial accounts for the Poisson count distribution, not ordered arrival times.
The first waiting time is exponential with mean 1/λ=0.5 minute. If each arrival is independently retained with probability 1/4, the retained rate becomes 0.5 per minute and its mean waiting time becomes 2 minutes.
The interval count has mean and variance 3, its probability of exactly two is about 0.22404, and the first-event mean waiting time is half a minute.
The living notebook
Explore the model
Interactive lab · queue
An average rate does not generate arrival randomness
Set arrival rate below service rate, then increase it toward the service rate. Playback shows the fluid backlog max(0,4+(λ−μ)t), while the separate M/M/1 residence-time readout grows as 1/(μ−λ). Only that readout assumes Poisson arrivals, exponential service, one server, and stability λ<μ. The moving backlog is deterministic and does not sample Poisson arrivals or renewal waiting times.
- Fluid backlog
- 4
- Net rate · λ − μ
- −1 /s
- M/M/1 mean residence
- 1 s
Fluid backlog starts at 4 and follows max(0, 4 + (λ − μ)t). The separate M/M/1 residence-time formula assumes Poisson arrivals, exponential service and λ < μ. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forThe same rate can enter different models; a fluid slope and a stochastic waiting-time law answer different questions.
Pause & reason
Check your understanding
Your turn
Try it yourself
A renewal process has IID waiting times equal to 1 or 3 seconds with equal probability. What is its almost-sure long-run arrival rate? Does the mean alone make it a Poisson process?
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Compute the mean waiting time before taking its reciprocal. Then inspect whether the waiting-time law is exponential.
Compare with the solution
The mean is (1+3)/2=2 seconds, so the renewal strong law gives N(t)/t→1/2 arrival per second almost surely. The process is not Poisson: its waiting times are discrete and bounded rather than exponential. In particular it cannot have an arrival less than one second after a renewal, which contradicts a positive-rate exponential waiting law.
Keep the idea
Take it with you
- Poisson counts, independent increments, and exponential waiting times form a particular consistent model.
- The renewal strong law needs IID positive intervals with a finite positive mean.
- A common long-run rate does not determine burstiness, residual waiting, or queueing behavior.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.