Author nvetoshkin
Recipients Trundle, brian.curtin, giampaolo.rodola, loewis, neologix, nvetoshkin, pitrou, socketpair, terry.reedy
Date 2011-03-09.21:21:24
SpamBayes Score 1.03048e-07
Marked as misclassified No
Message-id <1299705685.69.0.751195607755.issue11406@psf.upfronthosting.co.za>
In-reply-to
Content
>We could, but someone must:
>1) provide a patch
While working on a straightforward patch for linux, I had to make a lot of copy-paste job. posixmodule.c is quite a mess already :(
>2) demonstrate a significant improvement in some real-world situation
suppose we have a directory with several millions of files and a cron script which must process just a bunch of them at a time. There's no need to gather them all.
As mmarkk mentioned - readdir already provides generator style access to the directory contents, it could be nice to provide such API in Python.

http://pastebin.com/NCGmfF49 - here's a kind of test (cached and uncached)
http://pastebin.com/tTKRTiNc - here's a testcase for batch processing of directory contenst (first is xlistdir(), second - listdir()) both uncached.
History
Date User Action Args
2011-03-09 21:21:25nvetoshkinsetrecipients: + nvetoshkin, loewis, terry.reedy, pitrou, giampaolo.rodola, Trundle, brian.curtin, neologix, socketpair
2011-03-09 21:21:25nvetoshkinsetmessageid: <1299705685.69.0.751195607755.issue11406@psf.upfronthosting.co.za>
2011-03-09 21:21:25nvetoshkinlinkissue11406 messages
2011-03-09 21:21:24nvetoshkincreate