Unless you're working on CPython itself, I'd suggest just installing the debug binaries through the installer.

I've made a note to write a blog post on how to use the embeddable distro, so when that comes out (in a few weeks, probably) hopefully it will help answer these questions. Then I'll look at merging the parts of that which would be good documentation into the Doc/using/windows.rst page.