advanced28 min studyLesson 946 in Engineering

Storage and transfer: account for volume over time and path

Build a unit-consistent fictional model of retained capacity, operation counts, replication, and boundary-crossing data.

On this page

What you’ll understand

  • Integrate storage volume over a precisely defined teaching period.
  • Distinguish logical bytes, transfer bytes, and chargeable route categories.
  • Keep operation counts and capacity-time charges separate.

Keeping a checkpoint and moving it to a worker are different resource events. Storage can depend on retained volume over time, operations on request counts, and transfer on the path and direction of actual bytes. All prices here are explicitly fictional stable teaching inputs in fictional credits, FC. We define a thirty-day teaching month rather than assume a real provider uses that duration. The model is an auditable inventory of chosen charge categories; it does not assert that every network transfer is billable or that any actual service shares these units or rates.

Storage is volume-time rather than the final snapshot

A pool containing two hundred GiB at period end may have held that amount for one day or the entire period. Integrate retained volume with its actual time intervals, including the replicas, snapshots, and versions inside the chosen billing boundary. Logical dataset size can differ from allocated storage because of replication, metadata, encoding, or minimum object sizes. State which quantity the hypothetical rate prices. Preserve the deletion and retention policy as well: a request to delete an object need not establish when its retained versions cease to occupy the accounted resource.

Choose units before calculating. A GiB is 2³⁰ bytes, while a decimal GB is 10⁹ bytes; the label alone must not be silently changed between measurement and pricing. Similarly, an export can represent byte-seconds even when a price is displayed per a larger capacity-time unit. Convert both capacity and duration consistently. This lesson uses GiB and days throughout its storage integral, with an explicitly thirty-day teaching month. That convention is an arithmetic fixture, not a claim about calendar billing, free tiers, minimum commitments, or real invoice rounding.

Cstore=psTm∫0TmV(t) dtC_{\rm store}=\frac{p_s}{T_m}\int_0^{T_m}V(t)\,dt
V(t) is the priced volume in GiB, t and Tm are days, Tm=30 here, and fictional ps is FC per GiB per thirty-day teaching month. The result is FC; other storage policies require another model.↔ Scroll wide equations horizontally.

Price actual operations and actual transfer categories

List request classes separately when they have different units: object reads, writes, listing operations, and retrieval operations need not carry the same policy. A byte total cannot reconstruct their counts. A compressed transfer can have different wire bytes from the decoded object size, and retries can increase the transmitted quantity. Record route, source, destination, and direction rather than label all movement as egress. Internal replication, cross-zone traffic, external delivery, and local reads may have different rules or no separate charge under a particular documented service.

Avoid counting a packaged charge again through its underlying operations. If a fictional storage fee already includes replication, adding another replica fee without a separate boundary double-counts. If a transfer crosses multiple charged segments, retain each eligible segment and its own quantity instead of assuming one end-to-end price. Reconcile the measured quantities with the pricing-unit fields and charge types of the chosen ledger. The useful inventory is a reproducible route and operation map, not an extrapolation from an interface’s advertised link bandwidth.

Ctotal=Cstore+Crequests+∑r∈RprDrC_{\rm total}=C_{\rm store}+C_{\rm requests}+\sum_{r\in\mathcal R}p_rD_r
Each r is a distinct included chargeable route category; Dr is its priced transfer quantity in GiB and fictional pr is FC/GiB. C_requests is FC from separately specified operation counts and units. Packaged or excluded charges must not be added twice.↔ Scroll wide equations horizontally.

Evaluate retention and placement as complete changes

A smaller retained checkpoint set can lower capacity-time while increasing recovery recomputation or repeated transfer. A remote cache can reduce model execution but add network movement, lookup operations, and another failure dependency. Compare the complete accepted workload and recovery requirement under each policy. State which data must remain available and for how long; deleting required evidence is a changed service, not an equivalent storage optimization. Include failed transfers and retry routes when those resources fall inside the chosen accounting boundary.

The function lab illustrates normalized volume-time. Reset, explicitly set a=0.75 and x=2, predict the area, then Play or Step. Repeat from a fresh Reset with a=1.5 and x=2 explicitly set; the areas under y=ax² are two and four. These are normalized area units rather than a real storage bill. The instrument has no objects, deletion policy, operations, transfer route, or billing month. Its purpose is to show why the whole retention curve matters rather than just its ending volume.

A changing retained volume and two priced paths

Use fictional rates 0.02 FC/GiB per thirty-day teaching month, 0.01 FC per thousand operations, 0.05 FC/GiB for one egress path, and 0.02 FC/GiB for a separate replication path. Retain 100 GiB for fifteen days and 200 GiB for fifteen days; execute 10,000 operations and transfer 300 GiB and fifty GiB on the respective paths.

  1. Storage volume-time is 100×15+200×15=4500 GiB-days, or 150 GiB averaged across thirty days. Storage cost is 150×0.02=three FC under the fictional linear policy.

  2. Operations cost (10000/1000)×0.01=0.1 FC. The two distinct transfer categories cost 300×0.05=fifteen FC and 50×0.02=one FC; their bytes are not merged under a single rate.

  3. Total included cost is 3+0.1+15+1=19.1 FC. This sum assumes none of these categories is packaged into another charge, and all listed volumes already use the priced GiB quantity.

The result

The fictional total is 19.1 FC, with capacity-time, operation count, and two transfer categories independently auditable.

Explore the model

Interactive lab

Interactive lab · function

Retained volume must be integrated over time

Use independent Reset → explicitly set BOTH a and x → predict → Play/Step runs for (0.75,2) and (1.5,2), giving normalized areas two and four. No billing period, storage objects, or priced transfers are simulated.

Retained volume must be integrated over timeThis lab uses only y = ax². Playback traces the curve within the fixed integration interval from 0 to x; it does not estimate numerical error or change the chosen point. Current readings: y at chosen x: 0.608; Tangent slope · 2ax: 1.35; Signed area · ax³/3: 0.182. All parameters are adjustable with the labeled controls below.−2.4−1.201.22.4−9−4.504.59xy(x, ax²)
y = ax²TangentSigned integral
y at chosen x
0.608
Tangent slope · 2ax
1.35
Signed area · ax³/3
0.182
t = 0 s

This lab uses only y = ax². Playback traces the curve within the fixed integration interval from 0 to x; it does not estimate numerical error or change the chosen point. Parameter changes pause playback and recompute the model at the current elapsed time. Reset restores both parameters and returns time to zero. Playback starts paused. Adjust either parameter, then choose Play or Step.

Look forRetain a volume-time trace and a separate route-and-operation inventory.

Check your understanding

Which quantity is sufficient for the stated linear storage component?

Try it yourself

For a thirty-day teaching month use fictional rates 0.04 FC/GiB-month, 0.03 FC/GiB egress, and 0.01 FC per thousand operations. Hold fifty GiB throughout, transfer 100 GiB on the included path, and execute 2,000 operations. Compute the total.

Take a moment to make a prediction or work it out on paper. Open a hint when you need one.

Give me a hint

Keep capacity-time, transfer bytes, and operation-count units separate before summing FC.

Compare with the solution

Storage costs 50×0.04=two FC because the volume persists for the entire specified month. Egress costs 100×0.03=three FC, and operations cost (2000/1000)×0.01=0.02 FC. Total is 5.02 FC. This assumes the three categories are separate, linear, and priced exactly as stated. It excludes any other service operations, retries, minimums, or packaged charges. A comparison that moves data to another path must replace that path’s quantity and policy explicitly.

Take it with you

  • Integrate retained volume with consistent capacity-time units.
  • Inventory priced routes and request classes separately.
  • Evaluate retention savings together with recovery and accepted-work requirements.

Read further

Original sources and deeper explanations to follow at your own pace.

Optional progress, saved in this browser when available. Revisit any lesson at any time.

Lesson not marked complete.