Budget the complete optical communication path
Separate one-way payload bandwidth, serialization, conversion, propagation, and energy at the declared accounting boundary.
On this page
The question for today
What you’ll understand
- Compute a fictional wavelength-multiplexed payload rate.
- Separate short-message latency from bulk transfer capacity.
- Explain how conversion, laser, and idle power affect energy per useful bit.
Optical communication can provide valuable bandwidth density and reach, but a model’s tensors still begin and end as data represented by electrical systems. Modulators, detectors, drivers, receivers, and protocol logic remain part of the path. A large aggregate optical rate also says little about a small message’s completion latency. Define directionality, wavelength channels, modulation, coding overhead, and the exact power boundary before comparing links. The numbers in this lesson are hypothetical; they are not taken from a product’s peak specification or presented as measured performance.
Count independent channels and useful payload
Wavelength-division multiplexing places independently encoded optical channels on the same physical path under a designed transceiver system. Count the supported channels, symbol rate, bits represented per symbol, and payload efficiency. Do not multiply by a channel count already included in an advertised aggregate. A bidirectional total can combine two opposite one-way rates, so label which rate serves the actual communication phase. Directional workloads cannot consume unused reverse-direction capacity automatically.
A usable rate also depends on errors, coding, framing, and the receiver’s operating conditions. More bits per symbol require the corresponding signal quality and implementation; they are not a free arithmetic multiplier for an unchanged physical link. The original TeraPHY demonstration describes a particular electro-optic implementation and boundary. Its role here is to illustrate integrated conversion and multiplexing, while a workload estimate must still use the actual deployed transceiver, protocol, and sustained payload measurements.
Separate serialization from fixed path latency
A bulk transfer’s serialization time falls as payload bandwidth rises, but source queuing, electrical-optical conversion, optical propagation, reception, and completion logic can dominate short messages. State which terms are already included in a quoted endpoint latency. Fiber propagation depends on distance and group velocity; it is not zero because the carrier is light. Additional switches or regeneration can add terms whose inclusion depends on the topology and device design.
Optical circuit switching changes connectivity without making the matrix arithmetic itself optical. A reconfigured topology can improve placement or collective routes while introducing configuration and scheduling constraints. The TPU v4 paper studies a particular optically reconfigurable system; its application results remain attached to its workload, machine, and software. Separate that system-level evidence from a transceiver’s rate, and include topology changes or circuit setup where they are exposed on the application’s critical path.
Compare energy at the same boundary and utilization
Define whether power includes the laser source, transmitter drivers, receiver circuits, clock recovery, control, package interfaces, and allocated shared infrastructure. A device-only switching-energy number and a complete link power measurement are different quantities. Divide average included power by the useful delivered bit rate over the same interval, and include failed or retransmitted traffic according to the chosen boundary. High raw capacity does not guarantee low energy per useful bit when the application uses only a fraction of it.
Idle and shared-source power can make utilization decisive. If included power stays roughly constant while payload use falls, energy per useful bit rises even though the active channel’s device physics has not changed. Measure both directions and allocate shared power consistently when reporting a directional result. For an AI workload, retain conversion, communication, and compute timing together; faster links help only where the actual graph is communication-limited. State performance and energy as measured workload outcomes or explicitly conditional estimates.
Work it through
A wide fictional link still has short-message latency
A hypothetical one-way path has 8 independent wavelengths, each at 50 Gbaud with 2 bits/symbol and payload efficiency 0.8. Endpoint conversion and protocol latency totals 20 ns. Fiber length is 10 m with group velocity 2×10⁸ m/s. Compute payload rate and a 64-byte message’s no-queue lower bound.
Payload rate is 8×50×10⁹×2×0.8=640×10⁹ bit/s, or 640 Gb/s. Dividing by eight gives 80 decimal GB/s in this one direction.
A 64-byte message contains 512 bits, so serialization takes 512/(640×10⁹)=0.8 ns. That small term does not include endpoint or propagation latency.
Propagation takes 10/(2×10⁸)=50 ns. Adding the specified 20 ns fixed term and 0.8 ns serialization gives a 70.8 ns lower bound before queuing, arbitration, and additional topology costs.
The high payload rate serves bulk movement, while fixed and propagation terms dominate this tiny message. The calculation makes no claim about a real optical product’s latency.
The living notebook
Explore the model
Interactive lab · waves
Physical superposition is not an encoded link budget
Reset, set Phase difference to 0° and Amplitude ratio to 1. Predict resultant amplitude 2 and sum at x=0 approximately −0.959 after one Step. Reset, explicitly set phase to 180° and amplitude ratio to 1, then Step: predict cancellation near zero. These are two equal-frequency analytic waves. The lab has no wavelength multiplexing, modulation, conversion, noise, coding, bitrate, or energy model and cannot predict an optical link’s capacity.
- Sum at x = 0
- 0.866
- Resultant amplitude
- 1.732
- Phase difference
- 60°
Two waves share the same frequency and wave number. Playback advances t in sin(2x − t) + a sin(2x − t + phase). Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.
Look forA physical wave picture does not replace a transceiver and payload accounting model.
Pause & reason
Check your understanding
Your turn
Try it yourself
A fictional complete one-way link boundary consumes 12 W while delivering 640 Gb/s useful payload. Compute joules per useful bit. If included power remains 12 W but useful rate falls to one quarter, what happens to that metric?
Take a moment to make a prediction or work it out on paper. Open a hint when you need one.
Give me a hint
Watts divided by bits per second gives joules per bit; keep the measured interval and boundary matched.
Compare with the solution
At full rate, 12/(640×10⁹)=18.75×10⁻¹² J/bit=18.75 pJ/bit. At one-quarter useful rate, 160 Gb/s, it becomes 75 pJ/bit. This follows from the stipulated constant-power behavior; a real link’s power may change with utilization and must be measured.
Keep the idea
Take it with you
- Label directional payload rate and avoid counting multiplexing twice.
- Include conversion, propagation, and completion costs in message latency.
- Compare energy boundaries and utilization alongside bandwidth.
Read further
Original sources and deeper explanations to follow at your own pace.
Optional progress, saved in this browser when available. Revisit any lesson at any time.
Lesson not marked complete.