On Windows, I think we should consider directly supportting
http://www.lfd.uci.edu/~gohlke/pythonlibs/
Unofficial Windows Binaries for Python Extension Packages
When possible, this has 2.6, 2.7, 3.3, and 3.4 binaries for 32 and 64 bits.

I and others use this site, but beginners would not know to use it.  Since last summer, Christoph has switched nearly all files from .zip to pip-installable .whl.  The site says to download and point pip to the local downloaded copy, but I presume pip can be directly pointed to the site.