Path: ...!eternal-september.org!feeder3.eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail From: Don Y Newsgroups: sci.electronics.design Subject: Re: Chinese downloads overloading my website Date: Mon, 11 Mar 2024 22:19:06 -0700 Organization: A noiseless patient Spider Lines: 27 Message-ID: References: <7qujui58fjds1isls4ohpcnp5d7dt20ggk@4ax.com> <6lekuihu1heui4th3ogtnqk9ph8msobmj3@4ax.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Injection-Date: Tue, 12 Mar 2024 05:19:10 -0000 (UTC) Injection-Info: dont-email.me; posting-host="cd61f5e18330181594e65cc325aef3d5"; logging-data="140210"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1+gukSaUpjsQxLpZSZWEz+4" User-Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.2.2 Cancel-Lock: sha1:KdGvSsjTLQ3SNXUM9ASNGOWmj6I= Content-Language: en-US In-Reply-To: Bytes: 2670 On 3/11/2024 9:57 AM, legg wrote: > Doing some simple experiments by temporarily renaming/replacing > some of the larger files being tageted, just to see how the bot > reacts to the new environment. If they find renamed files it > means something. If visits to get the same 17G alter it means > something else. That;s probably a good, inexpensive strategy to see how "active" your "clients" are. Repeated hits on stale URLs would let you know they are likely just reprobing from previously stored results vs. actively *exploring* your site. [Gotta wonder if they aren't a google/archive wannabe and not smart enough to just *look* at the site.] > This all at the expense and patience of my ISP. Thumbs up there. Be grateful. Many larger corporate providers would just cite the AUP and your subscription terms and that would be the end of THAT "discussion". I run a thin pipe to the house -- my provider would love to upsell me. But, it's saturated 95% of the time; a fatter pipe would be idle while I'm away/asleep. As *latency* isn't an issue, AVERAGE bandwidth remains the same. (as I download another terabyte of rainbow tables...)