manylinux2014 images

[mayeut]

1st attempt at a manylinux2014 image
main differences with the 2010 image:

• drop python 2.7 (EOL in january 2020) & 3.4 (already EOL)
• use system provided openssl for python build
• cmake is not installed anymore (one can use pip install cmake)
• add aarch64 support
• i686 uses default gcc 4.8.5 & misses yasm

c.f. #338

Please do comment

[hrw]

Can 'make' be called with multiple jobs? Would make build faster.

[hrw]

Build on aarch64 fails:

+ for PYTHON in '/opt/python/*/bin/python'
+ /opt/python/cp35-cp35m/bin/python build_scripts/manylinux-check.py
/opt/python/cp35-cp35m/bin/python is NOT manylinux2010 compatible
The command '/bin/sh -c bash build_scripts/build.sh && rm -r build_scripts' returned a non-zero code: 1

Sure, it is manylinux2010 not compatible but only because this architecture did not existed at that time.

[hrw]

So, how it will be processed? I am waiting for it to happen and then will discuss with several projects to get them to publish wheel files for AArch64 architecture.

It will allow me to cut build times from 45 minutes to seconds...

[hrw]

Travis CI got aarch64 support. There will be more projects ready to use manylinux2014 image once it get published.

[auvipy]

is it still WIP?

[mayeut]

@auvipy, yes still a work in progress. Needs at least an auditwheel update (not 2.1.1), README update

[zhaofeng-shu33]

@auvipy, yes still a work in progress. Needs at least an auditwheel update (not 2.1.1), README update

Can I use this docker image to upload wheel tagged with 2014 to pypi.org ?

[veblush]

If possible, how about adding i686 to manylinux2014 docker images? It's one of architectures listed in manylinux2014 policy and there is a base CentOS 7 docker image.

[mayeut]

@veblush, I can't get a recent toolchain on i686, the one you found doesn't exist for centos 7. RHEL provides this for RHEL7 but not centos.
For now, an i686 image would use gcc 4.8.5 (or else someone has to figure out a way to rebuild/store devtoolset-8 from SRPM in a reliable/trusted way).
I've rebuilt devtoolset-8 for centos6-i686 using copr (might do a PR with that) but they do not provide an el7-i686 chroot to do the same for centos7. We could do an image with cross-compilation but https://bugs.centos.org/view.php?id=16181 prevents this.

[hrw]

Is there any todo list before it will be considered done?

[veblush]

@mayeut Thank you for the detailed background! Sorry to know i686 doesn't get enough attention from Redhat and community.

[hrw]

@veblush Red Hat decided to stop supporting i686 when RHEL7 development started. There is no new server class hardware with this architecture and users of "legacy" ones were supported with RHEL6.

There is minimal support for i686 just to keep 32-bit applications running on 64-bit hardware.

In CentOS 7 32-bit x86 is supported as one of "alternative" architectures - check http://mirror.centos.org/altarch/7/ for what is provided. And even there is looks like abandoned architecture.

[hrw]

23:24 - will look at problem tomorrow

[hrw]

one more

[mayeut]

@hrw, thanks for all your reviews. While the build passes locally, there's an issue with travis-ci (seems docker related) that I can't explain so I'm going to try a few things...

[hrw]

@hrw, thanks for all your reviews.

I work on aarch64 for 7+ years now so I am trying to help wherever I can.

While the build passes locally, there's an issue with travis-ci (seems docker related) that I can't explain so I'm going to try a few things...

No idea why it fails.

[mayeut]

Seems to be an issue on travis-ci side: https://travis-ci.community/t/docker-container-download-fails/5674

[di]

@mayeut Thanks for all your work here. It looks like the Travis issues are resolved, and that this is blocked on a 3.0.0 release of auditwheel (pypa/auditwheel#205), correct?

[mayeut]

Correct. There's still one PR opened in auditwheel that needs review and be merged.

[hrw]

And then will be time to go through all python projects and asking them to make more wheels.