Path: ...!3.eu.feeder.erje.net!feeder.erje.net!fu-berlin.de!uni-berlin.de!not-for-mail From: Ethan Furman Newsgroups: comp.lang.python Subject: Re: Help with Streaming and Chunk Processing for Large JSON Data (60 GB) from Kenna API Date: Wed, 2 Oct 2024 18:57:51 -0700 Lines: 7 Message-ID: References: Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Trace: news.uni-berlin.de lURtbFqEiFHhW4GotPa8mAAGI9DUmpfcMoVmslpcB6WA== Cancel-Lock: sha1:K/OVM31DSxi/2u4SewRc8yAlBwg= sha256:k3CA9Ps83UAN2oXUOCO/WQV6xpuwQku+t7Gwv4PiEkw= Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org Authentication-Results: mail.python.org; dkim=pass reason="2048-bit key; unprotected key" header.d=stoneleaf.us header.i=@stoneleaf.us header.b=IsQyMiz4; dkim-adsp=pass; dkim-atps=neutral X-Spam-Status: OK 0.001 X-Spam-Evidence: '*H*': 1.00; '*S*': 0.00; 'thread': 0.05; 'moderator': 0.07; 'subject:API': 0.07; 'received:217.70': 0.09; 'received:217.70.178': 0.09; 'received:gandi.net': 0.09; 'received:mail.gandi.net': 0.09; 'from:addr:ethan': 0.16; 'from:addr:stoneleaf.us': 0.16; 'from:name:ethan furman': 0.16; 'message-id:@stoneleaf.us': 0.16; '~ethan~': 0.16; 'subject:Help': 0.17; 'to:addr:python-list': 0.20; 'header:User-Agent:1': 0.30; 'subject:for': 0.33; 'header:In-Reply-To:1': 0.34; 'subject:from': 0.37; 'received:217': 0.67; 'subject:Data': 0.71; 'subject: \n ': 0.84 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=stoneleaf.us; s=gm1; t=1727920674; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=P9W10kvZ3AKn+LIMugFPTYo3j/0jWFSo5UvQzE/b/n0=; b=IsQyMiz4mAhdPEpdvDIAXnoL7rN6fhZJ8JjnIv96pGw0BJQWcs75qfnX+DfvGSKa8eKgAc KHoM/kd3tvHXLV+Qvul7PHzz9cy2kHXXMfNadvUEjAcC31g6utv2z3O/12EmxpjxAFRLoO EAsuPQ/nyR2SMc+i+5outEqO02TgTxLBVkX+eePFYL06dkqmZj2qOkm/2mi9Kds1Gpe/zH /VI+1dGYRpGtvoNO9Yfw1azsr/yfMt7nDpfWVFZUPB8tBmSdFapxL/WT75bqwhYlbrZgrp asy9U2YSvAYnr0fspSIoj+e/qJZ4z/iREY4OyWVY2VHZRR3PAgwmbMmW7BieZQ== User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.9.1 Content-Language: en-US In-Reply-To: X-GND-Sasl: ethan@stoneleaf.us X-Mailman-Approved-At: Wed, 02 Oct 2024 22:02:14 -0400 X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.39 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-Mailman-Original-Message-ID: X-Mailman-Original-References: Bytes: 3686 This thread is derailing. Please consider it closed. -- ~Ethan~ Moderator