advanced28 min studyLesson 200 in Engineering

Build a reachability explanation from layered evidence

Investigate names, routes, adjacencies, return paths, and applications while interpreting traceroute responses and packet-size failures cautiously.

On this page

What you’ll understand

  • Choose observations that distinguish competing reachability hypotheses.
  • Explain why a missing traceroute response does not establish a broken transit hop.
  • Use packet-size and return-path evidence without overclaiming the failed component.

A request that times out does not identify its failing layer. Resolution may have returned no address, a local neighbor may be unresolved, a route may lead to a discard, a translator may lack state, or a healthy network may lead to an unhealthy application. Good investigation narrows these possibilities with observations tied to explicit hypotheses. Preserve the source, destination, address family, transport protocol, time, and packet size so that comparisons concern the same path rather than superficially similar tests.

Localize the earliest failed dependency

Start by reproducing the application's exact name and address-family choice, then verify the answer it actually uses. Querying a different resolver or forcing IPv4 can be a useful comparison, but label the changed variable. Once an address exists, inspect the selected route and relevant policy table, its resolved next hop, and local neighbor state. A packet capture showing that the request never leaves the source host changes the next action: distant BGP inspection is unlikely to explain a local configuration or allocation failure.

Continue outward with paired observations. A request seen before a translator but not after it suggests inspecting allocation and filtering there; a request arriving at a server without a reply suggests checking server policy, listener state, or return routing. Absence in a capture is meaningful only if the capture point, filter, time window, and offload behavior are understood. Record a successful control with one variable changed, such as a nearby destination in the same prefix or a different packet size, to sharpen the hypothesis.

Trequest=Tresolve+Tconnect+TapplicationT_{\rm request}=T_{\rm resolve}+T_{\rm connect}+T_{\rm application}
This is a coarse serial budget in seconds for a request that performs these stages in order. It separates measurement boundaries rather than asserting all applications execute serially; connection reuse, retries, and parallel address attempts can change the observed timing.↔ Scroll wide equations horizontally.

Traceroute samples replies, not an omniscient path map

Traceroute-style probes vary IPv4 TTL or IPv6 Hop Limit so routers may return time-exceeded responses at successive distances. A missing response can reflect rate limiting, filtering, a router that forwards traffic while declining to answer, or a failed return path for the ICMP message. If later hops respond, an earlier star is not proof that the earlier router dropped all transit packets. Likewise, loss of diagnostic replies does not automatically equal loss of application traffic, because the traffic classes and processing paths can differ.

Responses can travel back by a different route, so a displayed round-trip time includes an unobserved return component. Load balancing may also send different probes along different paths, and tunnels can hide or alter visible hop structure. Compare probe protocol and flow identifiers deliberately; do not assemble one sequence of independently sampled hops into a guaranteed single flow path. Use source and destination captures, interface counters, and application-level checks to test the proposed explanation. A convincing diagram is not stronger evidence than the packets that support it.

Ri=Fi+Qi+BiR_i=F_i+Q_i+B_i
A probe response round-trip time R_i can be decomposed conceptually into forward travel F_i, reply-generation/queue delay Q_i, and return travel B_i, all in seconds. These components are generally not separately observed by ordinary traceroute, so differences between R_i values are not exact link delays.↔ Scroll wide equations horizontally.

Packet size and time can reveal a narrower fault

If small exchanges work while larger ones stall, investigate path MTU behavior, filtering of required ICMP information, encapsulation overhead, and transport retransmissions. IPv6 routers do not fragment transit packets; packet-too-big feedback helps the source adapt. IPv4 behavior depends on fragmentation rules and the Don't Fragment flag. A size-dependent symptom is evidence for a class of mechanisms, not proof of one blocked message: capture the actual packets and returned errors, and account for offloads when interpreting packet sizes on a host.

The probability lab helps plan repeated probes under a limited independent-loss hypothesis. Set p as per-probe failure probability and n as probe count; predict the chance of zero observed failures and compare the bar. Real bursts and shared paths violate independence, so retain timestamps and group observations by source network, family, destination prefix, and packet size. The lab cannot identify a failing router. It shows why a short clean sample is weak evidence for intermittent reliability and why mechanism-directed tests outperform indiscriminate repetition.

Interpret an apparent traceroute loss

For one fixed source and destination, ten probes at hop three produce two replies, while ten probes at hop four produce ten replies and the application succeeds. What can be concluded from those observations?

  1. The diagnostic response rate at hop three is 2/10 = 20%, leaving eight unanswered probes. This measures replies to that probe set, not directly the fraction of application packets forwarded.

  2. Hop four's replies show that those probes reached beyond the earlier displayed hop under their respective path and timing conditions. Router reply rate limiting or reply-path differences are plausible explanations for hop three's silence.

  3. Do not declare 80% transit loss at hop three. Repeat with controlled flow identifiers and timing, compare end-to-end application loss, and inspect counters or captures if authorized evidence is available.

The result

The data establish a low diagnostic reply rate at one displayed hop and successful later observations. They do not identify eighty-percent transit packet loss or prove a particular router defect.

Explore the model

Interactive lab

Interactive lab · probability

How much does a clean probe run establish?

Change p, interpreted as independent per-probe failure probability, and n. Predict the probability of zero failures before inspecting the exact binomial bars. The model has no routing paths, burst correlation, ICMP rate limits, or failure localization.

How much does a clean probe run establish?These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Current readings: Mean · np: 5; Variance · np(1−p): 2.5; Total probability: 1. All parameters are adjustable with the labeled controls below.03581000.070.150.220.3Successes kP(X = k)k = 0 · P = 9.77e-4
Exact probabilityHighlighted outcomeMean np
Mean · np
5
Variance · np(1−p)
2.5
Total probability
1
t = 0 s

These are exact binomial probabilities for independent trials with one fixed success probability. Playback tours the distribution; it does not resample outcomes. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forProbe results become stronger evidence when their sampling assumptions and diagnostic limits are explicit.

Check your understanding

A traceroute hop fails to answer, but later hops and the application respond. Which conclusion is justified?

Try it yourself

A dual-stack service succeeds when forced to IPv4 but stalls with the application's normal connection attempt. DNS returns both A and AAAA. Name a controlled next test and explain what a successful IPv4 request has not established.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Keep the service name and application behavior comparable while isolating address-family choice; inspect the IPv6 route and packets rather than assuming DNS success is reachability.

Compare with the solution

Run an explicit IPv6 attempt with the same destination service, record its selected AAAA address, route, neighbor state, and outgoing and returned packets. Compare the stage at which it fails with the IPv4 control. IPv4 success proves neither IPv6 forwarding nor correct IPv6 firewall, MTU, return-path, or listener behavior. A valid AAAA answer only provides an address; it does not establish that the path to it works.

Take it with you

  • Reachability investigations need the exact source, address family, protocol, time, and packet size.
  • A traceroute response gap is not automatically transit packet loss.
  • Layered captures and controlled comparisons turn symptoms into testable mechanism claims.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.