Managing the price of GPU compute.

Data centers and the buyers of capacity carry compute price risk for years. How derivatives can help both sides manage it.

Carry Research9 min read

A GPU cluster is a long-lived, expensive asset whose earnings depend on a price that can change quickly. The rental rate for the same model of GPU can move substantially within a single year as new hardware arrives, supply comes online and demand shifts. Several groups carry that risk, often for years at a time.

This article looks at who carries GPU compute price risk, why it is so large, and how forwards, futures and options can help each side manage it. How GPU compute is priced covers the basics of GPU-hours and pricing models.

Why the risk is large

Several features of the market make GPU compute prices unusually uncertain.

  • Fast product cycles. Chipmakers now release major new generations roughly every year. Each one does more work per hour, which tends to lower the rent that older chips can command.
  • Long-lived investments. A data center is built to last decades, and the servers in it are often expected to earn for five or six years. That is several product cycles.
  • Lumpy supply and demand. New capacity arrives in large blocks when a data center is finished and powered. Demand can arrive in large blocks too, when a lab starts a major training run or a product takes off.
  • Rising demand. Demand for compute has grown faster than almost anyone forecast, as AI moves from research into products used every day. Each wave of new models and applications can add demand faster than supply can respond.
  • Constrained capacity. New capacity depends on chips, power, grid connections, cooling and buildings, each with its own lead time. Power in particular has become a limit in many places, and a data center can take years to plan, permit and connect.

Put together, these mean that the price a GPU will rent for in three years is genuinely hard to predict, while the money to buy it is spent today. The risk runs both ways: fast product cycles and new supply can push rents down, while surging demand and constrained capacity can push them sharply up.

Who carries the risk

  • Data centers and cloud providers. They buy or lease GPUs, often with borrowed money, and recover the cost by renting capacity over several years. If rental rates fall faster than expected, the asset may not pay for itself on schedule.
  • Buyers of capacity. AI developers and enterprises sign multi-year commitments to secure the compute they need. If market rates fall, they are paying above market. If rates rise and they did not commit, they may pay more or not get capacity at all.
  • Lenders and investors. Loans secured on GPUs and their rental contracts, and investments in compute capacity, depend on future rental income. Their risk is the same price risk, one step removed.

These exposures point in opposite directions. Providers lose when prices fall; buyers who commit early lose when prices fall too, while buyers who wait lose when prices rise. That is exactly the situation in which a market lets each side hand risk to the other.

How it is managed today

Most compute price risk is managed today through the contracts themselves. Providers seek long reserved commitments from creditworthy customers, sometimes signed before the hardware is installed. Buyers negotiate terms, mix reserved and on-demand capacity, and spread their purchases across providers.

These tools work, but they tie price protection to a specific relationship. A provider cannot easily protect a cluster that has no long-term customer yet. A buyer cannot easily protect itself against prices falling once it has committed. And neither can adjust its protection as plans change without renegotiating. Market instruments separate the price risk from the supply relationship, so each can be managed on its own terms.

Forwards: locking in a rate

A forward agrees today on the price for capacity, or for its cash value, over a future period. A data center with new capacity coming online next year might sell one or two years of compute forward at an agreed rate. The provider gains predictable revenue to show its lenders. The buyer gains a known cost and secured access.

Forwards can be settled in two ways. A physically settled forward delivers the compute itself. A cash-settled forward pays the difference between the agreed rate and a reference price, leaving each side to buy or sell its actual capacity wherever suits it. Cash settlement needs a trusted reference price, but it lets the hedge and the supply arrangement be chosen separately.

Forwards suit parties with a specific, known need. Their limitation is that each is negotiated separately, which makes them slower to agree and harder to transfer.

Futures and perpetuals: a liquid price

Standardized contracts on the price of GPU time, for example per hour on a defined class such as the H100 or H200, let participants hedge without negotiating a bespoke agreement. A provider can sell to protect against falling rates; a buyer can buy to protect against rising ones. Because the contracts are standard, positions can be adjusted or closed as needs change.

Perpetual futures have no expiry date, so a position can be held for as long as the exposure lasts, which suits risks that run for years.

Options: protection with room to benefit

An option gives the right, but not the obligation, to buy or sell at a set price. A provider might buy protection against rates falling below a floor, while keeping the upside if rates hold up. A buyer might cap the price it could pay. The cost of that flexibility is the option premium.

Options are often combined. A provider could buy a floor and pay for it by selling a cap above the current rate, giving up some upside in exchange for cheaper protection. The result is a range: income will not fall below the floor or rise above the cap.

An illustration

With hypothetical numbers: a provider bringing 1,000 GPUs online expects to rent them at around $2.50 an hour and keep them about 80% utilized. That is roughly 7 million rented GPU-hours a year, or about $17.5 million of revenue. Its lenders want comfort that revenue will cover repayments.

Suppose the provider sells forward half of next year's expected hours, about 3.5 million, at $2.50. If market rates fall to $1.80, its unhedged revenue falls to about $12.6 million, but the forward pays about $0.70 on each of the 3.5 million hedged hours, roughly $2.5 million. Total income is about $15.1 million instead of $12.6 million. If rates rise to $3.00, the provider earns more on its rentals but pays out on the forward, ending close to its plan.

By adding a floor on another portion of capacity, the provider can show its lenders a predictable minimum income while keeping some exposure to a stronger market. A buyer planning a large training run could do the reverse: buy forward the capacity it is sure to need, and keep flexibility for the rest.

Providers lose when compute prices fall; buyers lose when they rise. A market lets each hand that risk to the other.

For lenders and investors

Lenders have financed GPU purchases with loans secured on the chips and on the rental contracts behind them. For a lender, the price of compute shows up in two places: in the borrower's rental income, which services the debt, and in the value of the GPUs themselves if the loan has to be recovered from the collateral.

Both move with the market. If rental rates fall faster than expected, income covers less of the repayment schedule. If a new generation of chips arrives, the resale value of older GPUs can fall at the same time. A loan that looked comfortably covered at origination can tighten quickly.

Lenders manage this in familiar ways: by advancing less against each GPU, by favoring borrowers with long contracts from creditworthy customers, and by shortening repayment schedules. Price hedging adds another tool. A lender can ask a borrower to hedge part of its uncontracted capacity, size the loan against the hedged income, or, as markets develop, manage its own exposure to the price of compute directly.

Each of these depends on a reliable reference for what compute costs. A price that can be observed and hedged makes it easier to value the collateral, set covenants and agree terms.

Compute and inference together

The price of compute feeds into the price of inference, but the two do not move in lockstep. Better models and software can produce more tokens from the same GPU-hour, so inference can get cheaper even when GPU rents hold steady. A company that sells inference while renting compute carries both prices, and the gap between them is its margin.

For that company, managing one price without the other leaves half the exposure open. Markets for both, in one place, let it manage the margin rather than each cost separately.

How Carry fits

Carry is building markets for AI compute alongside inference and the infrastructure behind both, including GPU contracts such as the H100 and H200 and forward agreements between providers and buyers of capacity. Bringing compute, inference and infrastructure together lets participants manage the whole chain of exposure: from the price of the hardware, to the price of renting it, to the price of the intelligence it produces.

Compute is becoming one of the most important inputs in the economy. Its price deserves the same tools that energy and metals have had for generations.

Frequently asked questions

What drives GPU rental prices?

New chip generations, the amount of finished capacity that is powered and connected, demand from training and inference, the price and availability of power, and the cost of financing. How GPU compute is priced covers each in more detail.

How can a data center protect itself against falling rental rates?

By signing long reserved contracts with creditworthy customers, by selling part of its future capacity forward at an agreed rate, or by buying options that set a floor under its income while keeping the benefit if rates rise.

How can a buyer lock in the cost of compute?

By reserving capacity for a fixed term, by buying compute forward, or by buying futures that gain if rental rates rise, offsetting a higher cost when the capacity is bought. Options can cap the price while keeping the benefit if rates fall.

What is the difference between a forward and a future on GPU compute?

A forward is a private agreement between two parties, negotiated to fit a specific need and usually held to the end. A future is a standardized contract traded on an exchange, which can be bought or sold at any time and is cleared centrally. What are compute futures? explains how they work.

How do lenders manage GPU price risk?

Through how much they advance against each GPU, the quality and length of the borrower's rental contracts, repayment schedules and covenants, and increasingly by requiring the borrower to hedge part of its income against falling rental rates.

This article is for information only and is not investment advice. Derivatives involve substantial risk of loss and are not suitable for all investors. The figures above are hypothetical illustrations, and product availability depends on jurisdiction.

Newsletter

New research, in your inbox.