Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!border-4.nntp.ord.giganews.com!nntp.giganews.com!Xl.tags.giganews.com!local-4.nntp.ord.giganews.com!nntp.earthlink.com!news.earthlink.com.POSTED!not-for-mail
NNTP-Posting-Date: Wed, 25 Dec 2024 08:23:43 +0000
Subject: Re: Are We Back to the "Wars" Now ?
Newsgroups: comp.os.linux.misc
References: <Sp-cnSz8UupYQaf6nZ2dnZfqnPednZ2d@earthlink.com>
 <vhmm4c$hnbj$1@dont-email.me> <vhmn2t$hv8i$3@dont-email.me>
 <vhnikj$me7m$1@dont-email.me> <vhoaau$qjkl$1@dont-email.me>
 <lIqcnTlkpf_Jtd36nZ2dnZfqn_udnZ2d@earthlink.com>
 <vhp9hs$12qaa$2@dont-email.me>
 <v4adnSK1nItcwNz6nZ2dnZfqnPWdnZ2d@earthlink.com>
 <vhrolu$1jata$1@dont-email.me>
 <Oo6dnZb3z-NT6Nz6nZ2dnZfqnPednZ2d@earthlink.com>
 <vhsdbi$1m6qu$1@dont-email.me> <vhth7o$1s5d5$4@dont-email.me>
 <heednZLHO-zE69_6nZ2dnZfqn_idnZ2d@earthlink.com>
 <vhvd06$2900d$1@dont-email.me> <vhvht1$28nn4$1@dont-email.me>
 <wwvldx8qw98.fsf@LkoBDZeT.terraraq.uk>
From: "186282@ud0s4.net" <186283@ud0s4.net>
Organization: wokiesux
Date: Wed, 25 Dec 2024 03:23:42 -0500
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101
 Thunderbird/78.13.0
MIME-Version: 1.0
In-Reply-To: <wwvldx8qw98.fsf@LkoBDZeT.terraraq.uk>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Language: en-US
Content-Transfer-Encoding: 8bit
Message-ID: <MTWdnX9Hd4WSXPb6nZ2dnZfqnPednZ2d@earthlink.com>
Lines: 45
X-Usenet-Provider: http://www.giganews.com
NNTP-Posting-Host: 99.101.150.97
X-Trace: sv3-gjMirWnhadDOODHPS11QPwXFiyHoaUNw7qoOHRvoKXavvOW3xyfijFkxeZBSlwQgF5RmaRwThLnG6pu!7CITws2T3B8g0hGmO4JsF1k05ENgVsIMbv+X/NQXmtMBedvGZgTVtdyxWILQT7moHczoGWa2BRlz!WuMh3IwYLVffxpZ2vtQH
X-Abuse-and-DMCA-Info: Please be sure to forward a copy of ALL headers
X-Abuse-and-DMCA-Info: Otherwise we will be unable to process your complaint properly
X-Postfilter: 1.3.40

On 11/24/24 2:14 PM, Richard Kettlewell wrote:
> Lew Pitcher <lew.pitcher@digitalfreehold.ca> writes:
>> On Sun, 24 Nov 2024 14:25:10 +0000, Rich wrote:
>>> 186282@ud0s4.net <186283@ud0s4.net> wrote:
>>>> On 11/23/24 4:25 PM, Lawrence D'Oliveiro wrote:
>>>>> That’s irrelevant.  Pipes originated on the earliest Unix machine,
>>>>> which was a PDP-11 with only a 64kiB address space.  They work great
>>>>> for pumping around gigabytes of data, but you don’t need
>>>>> gigabyte-sized memory buffers to do that.
>>>>
>>>>    It all has to be SOMEWHERE ... if not in RAM then
>>>>    on a mass storage device.
>>>
>>> Nope, at least not with pipes.
>>
>> Hold on a sec.... pipes are /buffered/ in RAM, so there's at least
>> a small bit of ram set aside for each open pipe.
> 
> The word ‘all’ isn’t just decoration.  The claim was ‘it all has to be
> somewhere’, and Rich’s point (as I understand it) is that it does not
> all have to be somewhere.
> 
> For example,
> 
>    head -c $((1024*1024*1024)) /dev/urandom | sha256sum
> 
> puts a gigabyte of data through a pipe, but at no point does anything
> allocate anywhere close to a gigabyte of storage of any kind.


   There's truth here ... the gigabyte gets kinda 'spread out'.

   But what if it was ten GB, or 100 ?

   So, if you wanna count on sending vast quantities of
   data in pipes, go ahead - it'll almost always work.

   Until vids go 16k or something ...

   As said LONG back ... each developer has to make
   decisions based on their app and the 'likely'
   systems/usage. There isn't really a 'wrong' or
   'right' way here - just 'alternatives'. I like
   terse pipes, you may not care.