The publication additionally notes that some H100 GPU owners are reselling their hardware or reducing orders, opting instead to rent processing capacity from cloud service providers like Amazon, Google, or Microsoft. Late last year, Amazon rolled out shorter-term GPU rentals for clients that only need AI processing for a single job.
Storing hardware is also costly, especially if it isn’t being put to use. Rather than sit on it and wait around for it to become obsolete, it seems some would rather resell the hardware.