Path: ...!weretis.net!feeder8.news.weretis.net!eternal-september.org!feeder3.eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: David Brown <david.brown@hesbynett.no>
Newsgroups: comp.arch
Subject: Re: Is Intel exceptionally unsuccessful as an architecture designer?
Date: Wed, 18 Sep 2024 19:01:48 +0200
Organization: A noiseless patient Spider
Lines: 47
Message-ID: <vcf11s$4roo$1@dont-email.me>
References: <memo.20240913205156.19028s@jgd.cix.co.uk>
 <vcd3ds$3o6ae$2@dont-email.me>
 <2935676af968e40e7cad204d40cafdcf@www.novabbs.org>
 <vcd7pr$3op6a$3@dont-email.me>
 <a20365f1bdcad769edd9e1f840edb2fe@www.novabbs.org>
 <vcda96$3p3a7$2@dont-email.me>
 <21028ed32d20f0eea9a754fafdb64e45@www.novabbs.org>
 <RECGO.45463$xO0f.22925@fx48.iad> <20240918190027.00003e4e@yahoo.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Wed, 18 Sep 2024 19:01:49 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="1decd31029dc944afd363c85100edc13";
	logging-data="159512"; mail-complaints-to="abuse@eternal-september.org";	posting-account="U2FsdGVkX19kaCUNAVbU0ASc6pUjp+D81S8wEgrzans="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:tr0UNrKsDGqCognR/EjrB906snU=
Content-Language: en-GB
In-Reply-To: <20240918190027.00003e4e@yahoo.com>
Bytes: 3081

On 18/09/2024 18:00, Michael S wrote:
> On Wed, 18 Sep 2024 15:50:09 GMT
> scott@slp53.sl.home (Scott Lurndal) wrote:
> 
>> mitchalsup@aol.com (MitchAlsup1) writes:
>>> On Wed, 18 Sep 2024 1:27:03 +0000, Lawrence D'Oliveiro wrote:
>>>   
>>>> On Wed, 18 Sep 2024 00:57:59 +0000, MitchAlsup1 wrote:
>>>>   
>>>>> On Wed, 18 Sep 2024 0:44:44 +0000, Lawrence D'Oliveiro wrote:
>>>>>   
>>>>>> On Tue, 17 Sep 2024 23:45:50 +0000, MitchAlsup1 wrote:
>>>>>>   
>>>>>>> "the CPUs are simply I/O managers to the Inference Engines and
>>>>>>> GPUs."
>>>>>>
>>>>>> That particular Wheel of Reincarnation will never turn that way.
>>>>>>
>>>>>> Why? It comes down to RAM. Those addon processors will never have
>>>>>> access to the sheer quantity of RAM that is available to the
>>>>>> CPU. And motherboard-based CPU RAM is upgradeable, as well,
>>>>>> whereas addon cards tend not to offer this option.
>>>>>
>>>>> He showed a die figure with 256GB of DRAM stacked 8-deep and
>>>>> 2×4-wide.
>>>>
>>>> Was it upgradeable? Or was it soldered in?
>>>
>>> Soldered in.
>>
>> Or in the case of HBM, directly stacked on the processor at the
>> fab.
>>
> 
> It's not easy to get 256GB via HBM.
> To give one example, Fujitsu A64Fx got only 32GB.
> It was 5 years ago and some progress was made since then, but density
> improvements nowadays are sloooooooow.
> 

<https://www.servethehome.com/micron-hbm3e-12-high-36gb-higher-capacity-ai-accelerators-shipping/>
<https://www.servethehome.com/a-quick-introduction-to-the-nvidia-gh200-aka-grace-hopper-arm/>

It's certainly not /cheap/ to have 256GB (or more) with HBM, but it is 
not unrealistic.