I cannot reproduce the issue. __exit__() calls close().

>>> import io
>>> class F(io.IOBase):
...     def close(self):
...         print('close')
...         super().close()  # set closed = True
... 
>>> with F(): pass
... 
close