Article <mailman.30.1745483776.3008.python-list@python.org>

Deutsch English Français Italiano
<mailman.30.1745483776.3008.python-list@python.org>

View for Bookmarking (what is this?)
Look up another Usenet article
Path: news.eternal-september.org!eternal-september.org!feeder3.eternal-september.org!fu-berlin.de!uni-berlin.de!not-for-mail
From: Anders Munch <ajm@flonidan.dk>
Newsgroups: comp.lang.python
Subject: RE: Module urljoin does not appear to work with scheme Gemini
Date: Thu, 24 Apr 2025 08:36:12 +0000
Lines: 47
Message-ID: <mailman.30.1745483776.3008.python-list@python.org>
References: <20250421083845.5e5b6d69@workstation.localdomain>
 <f5bikmwp8of.fsf@lochinver.inf.ed.ac.uk>
 <20250422182253.00b9327d@workstation.localdomain>
 <f5bwmbbnexs.fsf@lochinver.inf.ed.ac.uk>
 <VI1PR05MB106805790212AE1658621959AB4852@VI1PR05MB10680.eurprd05.prod.outlook.com>
Mime-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
Cancel-Lock: sha1:tT4Mvq6g7IeNv+h1OcLU1e8YZ5Y= sha256:yzR1Xa5JxQcAH31ZfO8dttv4+7QSEAnU24X4t692UQk=
Thread-Topic: Module urljoin does not appear to work with scheme Gemini
Thread-Index: AQHbsoDCxKkhgz/pXEmmzUCCpt+KL7OvzZNGgAACQICAAYnzQ4ABKFCA
In-Reply-To: <f5bwmbbnexs.fsf@lochinver.inf.ed.ac.uk>
Accept-Language: en-US
Content-Language: en-US
x-ms-exchange-antispam-messagedata-chunkcount: 1
x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?ri+QKBEhlFMkzZ5nFkI1Zp40DdCb3wmCDtg0ZACZc/DVHxE1EGLT6d3BclNf?=
 =?us-ascii?Q?hHCqzKo+9L6DvQvsjWf15A+gpwAZApUzRl0JS7N+JkJbdlrXyh1cLti+pSJA?=
 =?us-ascii?Q?/N5SuHOfI4U3TBnGBqZ6/V/DrCSUzGBl1XSpP4N589J+6IHHydAJUxVmhDH2?=
 =?us-ascii?Q?JWyiTiSCpbWTqxMe79EkRFSMSLZYpfhxP5NdCFWh881UtJYiRbLmK+oq9go5?=
 =?us-ascii?Q?sdXDbqyb+nsVRi3ZpPqNYDK1xsR45n5NP+IJuSkjLwk/+N6/gZX7E7SSdaLh?=
 =?us-ascii?Q?zaH4YAiWxILmawDlBaorIk+1IjeA9OqrweFg2O445HSuD2NmW6/O9QKPBkLL?=
 =?us-ascii?Q?L7SAUKffNSOzCclS6oyxDYiLvJmTOmwavDqlOT1jTL9nq9iKS9ap3m6onOFw?=
 =?us-ascii?Q?i6nXdj0RlnaHF2LNV9fHKVg5zGMSjOZep/reyG+CrWN9SBoWSfg1hBqsJy6D?=
 =?us-ascii?Q?DR3JTEeODmhmoLxuLQ5p3CSic+EPNdQfAXvxXkRERyRig1N1GB9cTXT2A7Js?=
 =?us-ascii?Q?NZN2syAtyjF3W/oe5JqPSIXN7Cl3zTf5XnOTizprNMRp96GLTRQuYL39Vq8E?=
 =?us-ascii?Q?qV7kkD9gkZbDqF1t4Viq3Ow8MNVMtTYZbHYKckm60LLububL0uv10+vkhUKG?=
 =?us-ascii?Q?+6kpAyYQ6vY/4MUqymbvSaJ5UCEDi0PUDMpfSgN7DM0J3ra2rSZgQv8OhWTK?=
 =?us-ascii?Q?CmjL80Gkmjw582xU99Cfh8aDYLlzWNfIUNXZEcwf7cek/q2m/IdSefYxK6Po?=
 =?us-ascii?Q?f/KvHHm1TuKpqY+IV/hIP/2dgKDoDNk5K74GgO32dZ4M3Kga1C4JPn5yxO5c?=
 =?us-ascii?Q?6A27m5+KcsxmeyOZQAN60Tvt7Jyw1UwWzjKFlNlZBK+LPH1uqdp9hioAid/Q?=
 =?us-ascii?Q?xxLzo1BUo98Dmr0VHMOHQyqi4oJB1uBD38dCPbQoB/GPWm4p4oWc+wfEGLC0?=
 =?us-ascii?Q?iXjcr0AtfdQgwcwmzVDLvuj33hvljbzmINg5AndFn51XytXDLjmQLrbvVGq4?=
 =?us-ascii?Q?G53jjeVqEV2vH4ip9rI1V83XZBV0jXv8+/OssZ5HjYhfn4eZ5BJMp89HFhb0?=
 =?us-ascii?Q?lSu9LVG+wNObeoI3thRb2jI9/WIJ0nHp3T+ZMSS02HFuWKfESfP2X1wX2QH7?=
 =?us-ascii?Q?nfgB001+timFFD4Bp26xpIrx8/WvKLovvd7eM19+IQonocyCc64oAaMLJets?=
 =?us-ascii?Q?O791ROnb/O7lUtzgdxX0WwuVVAGe8DdYgDekNXNv2TiNOfCD+i+e9jdO3b7s?=
 =?us-ascii?Q?LbKGfZJHidcLZZDrl/s1m5kTsNdH921IcIGS2fAFwSAqMQYW/qDQ1jX/t4RA?=
 =?us-ascii?Q?/OpmBN7EHSw06lZBl+MVHie0NMtLYaV+SjvXJ0CYmOkPqoUHbWdnF6yAvzir?=
 =?us-ascii?Q?wYupUFMdD6PiEexKc4be+RP9y7Lul31LPYcGb4V8rLldxUQk1dsdQ1f2//Ry?=
 =?us-ascii?Q?UjRwmO/5OMNzBoTp5zIIkaJ/tFCbHvNUJVgGkKxDXd4NxDYpXooKVXQUQ+HK?=
 =?us-ascii?Q?axki0L/YlCBl8nc2czi94e+tO3QQfptc1HGsyepJrqrCNOkY8Fu87NJ/bc9U?=
 =?us-ascii?Q?VaQ4IsP9Qute6LUgUcQ=3D?=
X-OriginatorOrg: flonidan.dk
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: VI1PR05MB10680.eurprd05.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 3fb8fa36-ea9f-4b63-f2d6-08dd830b1237
X-MS-Exchange-CrossTenant-originalarrivaltime: 24 Apr 2025 08:36:12.9737 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 66f919b0-b207-4d78-ae72-d81c18f86ec5
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: TBt1tpXUT+XET9mnCKfVIqxMqr+2cRVakfquxg/1NO17POm/R10SZfiKxi8M+nps
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DU0PR05MB9506
X-BeenThere: python-list@python.org
X-Mailman-Version: 2.1.39
Precedence: list
List-Id: General discussion list for the Python programming language
 <python-list.python.org>
List-Unsubscribe: <https://mail.python.org/mailman/options/python-list>,
 <mailto:python-list-request@python.org?subject=unsubscribe>
List-Archive: <https://mail.python.org/pipermail/python-list/>
List-Post: <mailto:python-list@python.org>
List-Help: <mailto:python-list-request@python.org?subject=help>
List-Subscribe: <https://mail.python.org/mailman/listinfo/python-list>,
 <mailto:python-list-request@python.org?subject=subscribe>
X-Mailman-Original-Message-ID: <VI1PR05MB106805790212AE1658621959AB4852@VI1PR05MB10680.eurprd05.prod.outlook.com>
X-Mailman-Original-References: <20250421083845.5e5b6d69@workstation.localdomain>
 <f5bikmwp8of.fsf@lochinver.inf.ed.ac.uk>
 <20250422182253.00b9327d@workstation.localdomain>
 <f5bwmbbnexs.fsf@lochinver.inf.ed.ac.uk>

Henry S. Thompson wrote:
> Some approach to support future-proofing in general would seem to be in o=
rder.=20
> Given some other precedents, adding a boolean argument called either 'str=
ict' or 'lax' would be my preference.

An alternative would be to refactor urllib.parse to use strategy objects
for schemes.

parse.py contains a number of lists of scheme names, that act as flags to
control parsing behaviour:
        uses_relative, uses_netloc, uses_params, non_hierarchical, uses_que=
ry and uses_fragment.
(If written today they would be sets, but this is very old code that predat=
es sets!)
Group that information by scheme instead of by flag name, in e.g. a datacla=
ss, and
you have made yourself a strategy object lookup table:

scheme_options =3D {
   'https': SchemeOptions(uses_relative=3DTrue,  uses_netloc=3DTrue, uses_p=
arams=3DTrue),
   'git': SchemeOptions(uses_relative=3DFalse,  uses_netloc=3DTrue, uses_pa=
rams=3DFalse),
   ...
}

Once you have that, you can add the strategy object as an optional argument=
 to
functions.  If the argument is not given, you find a strategy object from
scheme_options to use. If the argument is given, you use that.

The best part of this approach is that you now have a way of saying "treat =
this
scheme exactly like https":

   from urllib import parse
   parse.urljoin('sptth://...', '../one-level-up', options=3Dparse.scheme_o=
ptions['https'])

Note: I wrote this before I realised that the lists non_hierarchical, uses_=
query
and uses_fragment are not used.  With only three options instead of six, ma=
king
========== REMAINDER OF ARTICLE TRUNCATED ==========