This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author michaelg
Recipients gvanrossum, karamanolev, michaelg, r-englund, vstinner, yselivanov
Date 2015-03-14.13:02:51
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1426338171.8.0.0361093098894.issue23187@psf.upfronthosting.co.za>
In-reply-to
Content
> It looks like you are running your app on Windows. Are you using the proactor event loop?

Yes.

> In Python 3.4.3, I fixed a *lot* of crashes and race conditions in the proactor event loop. There are maybe more race conditions.

I've already tried Python 3.4.3 and got the same crash. The one described in my long message with the stack trace is from 3.4.2, but I got that same stack trace (or a very similar one) with 3.4.3. I have a core dump from that crash as well so I can provide the exact stack trace if necessary.

> Are you running subprocesses with asyncio?

I can't recall running any subprocesses in the server program. The clients do that very often, but they're not the ones crashing...

> The caller is PyList_New(0).

I suppose this creates an empty list?

I managed to get a stack trace from faulthandler somehow and it points to this line in one of the threads:

d = rg.item_counts_by_params.setdefault(params, {})

This runs in a thread (managed by a ThreadPoolExecutor) that computes stuff and writes it to a file. It's in a loop that runs ~200000 times per job. Several lines above there's a similar line that passes an empty list as the 2nd parameter to setdefault().

The other threads are all in threading.wait(), probably doing nothing interesting. One thread is in _run_once().

Unfortunately I don't have any additional information about this particular crash (no dump or stack trace), but it's not unreasonable to assume other crashes occurred during creation of new lists/dicts in a similar manner.
History
Date User Action Args
2015-03-14 13:02:51michaelgsetrecipients: + michaelg, gvanrossum, vstinner, yselivanov, karamanolev, r-englund
2015-03-14 13:02:51michaelgsetmessageid: <1426338171.8.0.0361093098894.issue23187@psf.upfronthosting.co.za>
2015-03-14 13:02:51michaelglinkissue23187 messages
2015-03-14 13:02:51michaelgcreate