Azure Pipelines can now support container jobs: https://docs.microsoft.com/en-us/azure/devops/pipelines/process/container-phases?view=vsts&tabs=yaml

I experimented with enabling a manylinux1 build a while back, which should now be able to use identical steps to the POSIX build. With the new syntax, we can enable CI (and perhaps PR?) builds using the snippet below:

• job: ManyLinux1_CI_Tests
  displayName: ManyLinux1 CI Tests
  dependsOn: Prebuild
  condition: |
  and(
  and(
  succeeded(),
  eq(variables['manylinux'], 'true')
  ),
  eq(dependencies.Prebuild.outputs['tests.run'], 'true')
  )

  resources:
  containers:

  • container: manylinux1
    image: dockcross:manylinux-x64

  pool:
  vmImage: ubuntu-16.04

  container: manylinux1

  variables:
  testRunTitle: '$(build.sourceBranchName)-manylinux1'
  testRunPlatform: manylinux1

  steps:

  • template: ./posix-steps.yml

I don't have time right now to test this change, but someone else might. It's certainly going to be easier for someone to test it by adding this to the PR build first (or set up a build on your own Pipelines instance).

Maybe there are other more relevant containers we should be testing in?

I have made the changes I suggested (though correctly...), but ultimately we need to create our own Docker image suitable for running these tests.

So for now, I'm proposing in my PR to make most of the change, as well as a few other Pipelines/test-related improvements, but to leave this open in case someone wants to come in later with a suitable image. At that point, the only change necessary to enable the tests will be to add a "posix_deps_yum.sh" script, update the image name/tag and change the manylinux variable to 'true'.

PR 11493 also fixes a missing LICENSE.txt file in the app store package, which was causing an idlelib test to fail as the fallback text only has one line. *Way* too obscure a failure for my liking, but at least we had a test there, so thanks, Terry :)

I believe it was Louie Lu's idea, bpo-30290, to check more than one line.
I am glad it helped.

New changeset 28f6cb3 by Steve Dower in branch 'master':
bpo-35683: Improve Azure Pipelines steps (GH-11493)
28f6cb3

New changeset 128efca by Steve Dower in branch '3.7':
bpo-35683: Improve Azure Pipelines steps (GH-11493)
128efca

As mentioned above, those changes are other improvements that were worth taking, and about half of the required manylinux1 changes. But we probably need to maintain our own manylinux image for building/running CPython tests, if we want to do it. The existing images are all designed for having CPython already present to build a range of binaries, which is not at all our use case.

@zooba Issue seems have been resolved. Can we close the issue?

Abandoned, rather than resolved, but I doubt we'll come back to it given the complexity of the space within manylinux these days.