Path: ...!weretis.net!feeder9.news.weretis.net!i2pn.org!i2pn2.org!.POSTED!not-for-mail
From: mitchalsup@aol.com (MitchAlsup1)
Newsgroups: comp.arch
Subject: Re: Is Intel exceptionally unsuccessful as an architecture
 =?UTF-8?B?ZGVzaWduZXI/?=
Date: Wed, 18 Sep 2024 18:48:44 +0000
Organization: Rocksolid Light
Message-ID: <a457b7178eb0e250318929e2da83bf31@www.novabbs.org>
References: <memo.20240913205156.19028s@jgd.cix.co.uk> <vcd3ds$3o6ae$2@dont-email.me> <2935676af968e40e7cad204d40cafdcf@www.novabbs.org> <vcd7pr$3op6a$3@dont-email.me> <a20365f1bdcad769edd9e1f840edb2fe@www.novabbs.org> <vcda96$3p3a7$2@dont-email.me> <21028ed32d20f0eea9a754fafdb64e45@www.novabbs.org> <RECGO.45463$xO0f.22925@fx48.iad> <20240918190027.00003e4e@yahoo.com> <vcf11s$4roo$1@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Info: i2pn2.org;
	logging-data="2558750"; mail-complaints-to="usenet@i2pn2.org";
	posting-account="65wTazMNTleAJDh/pRqmKE7ADni/0wesT78+pyiDW8A";
User-Agent: Rocksolid Light
X-Spam-Checker-Version: SpamAssassin 4.0.0
X-Rslight-Site: $2y$10$udIPA977BMpuWMx6WkDSwesPKN26MZNL4My69nR5LuvH4cO26dkhO
X-Rslight-Posting-User: ac58ceb75ea22753186dae54d967fed894c3dce8
Bytes: 2317
Lines: 23

On Wed, 18 Sep 2024 17:01:48 +0000, David Brown wrote:

> On 18/09/2024 18:00, Michael S wrote:
>> On Wed, 18 Sep 2024 15:50:09 GMT
>>
>> It's not easy to get 256GB via HBM.
>> To give one example, Fujitsu A64Fx got only 32GB.
>> It was 5 years ago and some progress was made since then, but density
>> improvements nowadays are sloooooooow.
>>
>
> <https://www.servethehome.com/micron-hbm3e-12-high-36gb-higher-capacity-ai-accelerators-shipping/>
> <https://www.servethehome.com/a-quick-introduction-to-the-nvidia-gh200-aka-grace-hopper-arm/>
>
> It's certainly not /cheap/ to have 256GB (or more) with HBM, but it is
> not unrealistic.

Consider the cost of the power it takes to feed a rack that consumes
100KW
continuously for a year, and don't forget to add in the cooling costs to
remove that 100KW from that rack while computing the cost of the power.
Using $0.15 /KWh = $170,000 per year per rack (including cooling).

The cost of 256GB of memory fades into insignificance.