research28 min studyLesson 998 in Engineering

Budget the complete optical communication path

Separate one-way payload bandwidth, serialization, conversion, propagation, and energy at the declared accounting boundary.

On this page

What you’ll understand

  • Compute a fictional wavelength-multiplexed payload rate.
  • Separate short-message latency from bulk transfer capacity.
  • Explain how conversion, laser, and idle power affect energy per useful bit.

Optical communication can provide valuable bandwidth density and reach, but a model’s tensors still begin and end as data represented by electrical systems. Modulators, detectors, drivers, receivers, and protocol logic remain part of the path. A large aggregate optical rate also says little about a small message’s completion latency. Define directionality, wavelength channels, modulation, coding overhead, and the exact power boundary before comparing links. The numbers in this lesson are hypothetical; they are not taken from a product’s peak specification or presented as measured performance.

Count independent channels and useful payload

Wavelength-division multiplexing places independently encoded optical channels on the same physical path under a designed transceiver system. Count the supported channels, symbol rate, bits represented per symbol, and payload efficiency. Do not multiply by a channel count already included in an advertised aggregate. A bidirectional total can combine two opposite one-way rates, so label which rate serves the actual communication phase. Directional workloads cannot consume unused reverse-direction capacity automatically.

A usable rate also depends on errors, coding, framing, and the receiver’s operating conditions. More bits per symbol require the corresponding signal quality and implementation; they are not a free arithmetic multiplier for an unchanged physical link. The original TeraPHY demonstration describes a particular electro-optic implementation and boundary. Its role here is to illustrate integrated conversion and multiplexing, while a workload estimate must still use the actual deployed transceiver, protocol, and sustained payload measurements.

Rpayload=nλfsymbsymη,0<η≤1R_{\rm payload}=n_\lambda f_{\rm sym}b_{\rm sym}\eta,\qquad 0<\eta\leq1
nλ is an independent one-direction channel count, fsym symbols/s per channel, bsym bits/symbol, and η payload efficiency after the declared overheads. The result is bits/s. The formula assumes channels operate simultaneously at these compatible conditions.↔ Scroll wide equations horizontally.

Separate serialization from fixed path latency

A bulk transfer’s serialization time falls as payload bandwidth rises, but source queuing, electrical-optical conversion, optical propagation, reception, and completion logic can dominate short messages. State which terms are already included in a quoted endpoint latency. Fiber propagation depends on distance and group velocity; it is not zero because the carrier is light. Additional switches or regeneration can add terms whose inclusion depends on the topology and device design.

Optical circuit switching changes connectivity without making the matrix arithmetic itself optical. A reconfigured topology can improve placement or collective routes while introducing configuration and scheduling constraints. The TPU v4 paper studies a particular optically reconfigurable system; its application results remain attached to its workload, machine, and software. Separate that system-level evidence from a transceiver’s rate, and include topology changes or circuit setup where they are exposed on the application’s critical path.

Tmessage≥Tfixed+8DbytesRpayload+dvgT_{\rm message}\geq T_{\rm fixed}+\frac{8D_{\rm bytes}}{R_{\rm payload}}+\frac{d}{v_g}
Tfixed includes the specified endpoint conversion/protocol terms but excludes propagation here. d is path length in meters and vg group velocity in meters/s. The bound excludes queueing and may need more fixed or hop terms; bytes are converted to bits exactly once.↔ Scroll wide equations horizontally.

Compare energy at the same boundary and utilization

Define whether power includes the laser source, transmitter drivers, receiver circuits, clock recovery, control, package interfaces, and allocated shared infrastructure. A device-only switching-energy number and a complete link power measurement are different quantities. Divide average included power by the useful delivered bit rate over the same interval, and include failed or retransmitted traffic according to the chosen boundary. High raw capacity does not guarantee low energy per useful bit when the application uses only a fraction of it.

Idle and shared-source power can make utilization decisive. If included power stays roughly constant while payload use falls, energy per useful bit rises even though the active channel’s device physics has not changed. Measure both directions and allocate shared power consistently when reporting a directional result. For an AI workload, retain conversion, communication, and compute timing together; faster links help only where the actual graph is communication-limited. State performance and energy as measured workload outcomes or explicitly conditional estimates.

A wide fictional link still has short-message latency

A hypothetical one-way path has 8 independent wavelengths, each at 50 Gbaud with 2 bits/symbol and payload efficiency 0.8. Endpoint conversion and protocol latency totals 20 ns. Fiber length is 10 m with group velocity 2×10⁸ m/s. Compute payload rate and a 64-byte message’s no-queue lower bound.

  1. Payload rate is 8×50×10⁹×2×0.8=640×10⁹ bit/s, or 640 Gb/s. Dividing by eight gives 80 decimal GB/s in this one direction.

  2. A 64-byte message contains 512 bits, so serialization takes 512/(640×10⁹)=0.8 ns. That small term does not include endpoint or propagation latency.

  3. Propagation takes 10/(2×10⁸)=50 ns. Adding the specified 20 ns fixed term and 0.8 ns serialization gives a 70.8 ns lower bound before queuing, arbitration, and additional topology costs.

The result

The high payload rate serves bulk movement, while fixed and propagation terms dominate this tiny message. The calculation makes no claim about a real optical product’s latency.

Explore the model

Interactive lab

Interactive lab · waves

Physical superposition is not an encoded link budget

Reset, set Phase difference to 0° and Amplitude ratio to 1. Predict resultant amplitude 2 and sum at x=0 approximately −0.959 after one Step. Reset, explicitly set phase to 180° and amplitude ratio to 1, then Step: predict cancellation near zero. These are two equal-frequency analytic waves. The lab has no wavelength multiplexing, modulation, conversion, noise, coding, bitrate, or energy model and cannot predict an optical link’s capacity.

Physical superposition is not an encoded link budgetTwo waves share the same frequency and wave number. Playback advances t in sin(2x − t) + a sin(2x − t + phase). Current readings: Sum at x = 0: 0.866; Resultant amplitude: 1.732; Phase difference: 60°. All parameters are adjustable with the labeled controls below.−3.14−1.5701.573.14−3.4−1.701.73.4x · radiansAmplitude
SumFirst componentSecond component
Sum at x = 0
0.866
Resultant amplitude
1.732
Phase difference
60°
t = 0 s

Two waves share the same frequency and wave number. Playback advances t in sin(2x − t) + a sin(2x − t + phase). Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forA physical wave picture does not replace a transceiver and payload accounting model.

Check your understanding

Why does 640 Gb/s payload rate not imply a 0.8 ns complete latency for the 64-byte example?

Try it yourself

A fictional complete one-way link boundary consumes 12 W while delivering 640 Gb/s useful payload. Compute joules per useful bit. If included power remains 12 W but useful rate falls to one quarter, what happens to that metric?

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Watts divided by bits per second gives joules per bit; keep the measured interval and boundary matched.

Compare with the solution

At full rate, 12/(640×10⁹)=18.75×10⁻¹² J/bit=18.75 pJ/bit. At one-quarter useful rate, 160 Gb/s, it becomes 75 pJ/bit. This follows from the stipulated constant-power behavior; a real link’s power may change with utilization and must be measured.

Take it with you

  • Label directional payload rate and avoid counting multiplexing twice.
  • Include conversion, propagation, and completion costs in message latency.
  • Compare energy boundaries and utilization alongside bandwidth.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.