The asyncio TaskGroup already uses a WeakSet for its children, so it's suitable for long-lived use.

As for errors in siblings aborting the TaskGroup, could you apply a wrapper to the scheduled coroutines to swallow and log any errors yourself?

Apart from the timeouts, that should get you a long way towards what you're describing.