Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
fengzch-das
multibuild
Commits
d4fde8c8
Commit
d4fde8c8
authored
Jun 25, 2016
by
Matthew Brett
Browse files
Fill out README
parent
b487287d
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
165 additions
and
2 deletions
+165
-2
README.rst
README.rst
+165
-2
No files found.
README.rst
View file @
d4fde8c8
...
@@ -2,5 +2,168 @@
...
@@ -2,5 +2,168 @@
Utilities for building on travis-ci with OSX and Linux
Utilities for building on travis-ci with OSX and Linux
######################################################
######################################################
A set of scripts to automate some of the work of building wheels on OSX and the
A set of scripts to automate builds of OSX and manylinux1 wheels on travis-ci
manylinux1 docker system.
infrastructure.
These scripts are designed to build *and test*:
* Dual architecture OSX wheels;
* 64-bit manylinux1_x86_64 wheels, both narrow and wide unicode builds;
* 32-bit manylinux1_i686 wheels, both narrow and wide unicode builds.
You can currently build and test against Pythons 2.6, 2.7, 3.3, 3.4, 3.5.
The small innovation here is that you can test against 32-bit builds, and both
wide and narrow unicode Python 2 builds, which was not easy on the default
travis-ci configurations.
Use these scripts like so:
* Make a repository for building wheels on travis-ci - e.g.
https://github.com/MacPython/astropy-wheels - or in your case maybe
``https://github.com/your-org/your-project-wheels``;
* Add this (here) repository as a submodule::
git submodule add https://github.com/matthew-brett/multibuild.git
* Add your own project repository as another submodule::
git submodule add https://github.com/your-org/your-project.git
* Create a ``.travis.yml`` file, something like this::
env:
global:
- REPO_DIR=your-project
# Commit from your-project that you want to build
- BUILD_COMMIT=v0.1.0
# pip dependencies to _build_ your project
- BUILD_DEPENDS="Cython numpy"
# pip dependencies to _test_ your project. Include any dependencies
# that you need, that are also specified in BUILD_DEPENDS, this will be
# a separate install.
- TEST_DEPENDS="numpy scipy pytest"
- PLAT=x86_64
- UNICODE_WIDTH=32
- WHEELHOUSE_UPLOADER_USERNAME=travis-worker
# Following generated with
# travis encrypt -r your-org/your-project-wheels WHEELHOUSE_UPLOADER_SECRET=<the api key>
# This is for Rackspace uploads. Contact the scikit-learn team for
# permission (and the API key) to upload to the Rackspace account used
# here, or use your own account.
- secure:
"MNKyBWOzu7JAUmC0Y+JhPKfytXxY/ADRmUIMEWZV977FLZPgYctqd+lqel2QIFgdHDO1CIdTSymOOFZckM9ICUXg9Ta+8oBjSvAVWO1ahDcToRM2DLq66fKg+NKimd2OfK7x597h/QmUSl4k8XyvyyXgl5jOiLg/EJxNE2r83IA="
language: python
sudo: required
dist: trusty
services: docker
matrix:
include:
- os: linux
python: 2.7
- os: linux
python: 2.7
env:
- UNICODE_WIDTH=16
- os: linux
python: 2.7
env:
- PLAT=i686
- os: linux
python: 2.7
env:
- PLAT=i686
- UNICODE_WIDTH=16
- os: linux
python: 3.4
- os: linux
python: 3.4
env:
- PLAT=i686
- os: linux
python: 3.5
- os: linux
python: 3.5
env:
- PLAT=i686
- os: osx
language: objective-c
env: TRAVIS_PYTHON_VERSION=2.7
- os: osx
language: objective-c
env:
- TRAVIS_PYTHON_VERSION=3.4
- os: osx
language: objective-c
env:
- TRAVIS_PYTHON_VERSION=3.5
before_install:
- source multibuild/common_utils.sh
- source multibuild/travis_steps.sh
- before_install
install:
# Maybe get and clean and patch source
- clean_code $REPO_DIR $BUILD_COMMIT
- build_wheel $REPO_DIR $PLAT
script:
- install_run $PLAT
after_success:
# Upload wheels to Rackspace container
- pip install wheelhouse-uploader
# This uploads the wheels to a Rackspace container owned by the
# scikit-learn team, available at http://wheels.scipy.org. See above
# for information on using this account or choosing another.
- python -m wheelhouse_uploader upload --local-folder
${TRAVIS_BUILD_DIR}/wheelhouse/
--no-update-index
wheels
* Next create a ``config.sh`` for your project, that fills in any steps you
need to do before building the wheel (such as building required libraries).
You also need this file to specify how to run your tests::
# Define custom utilities
# Test for OSX with [ -n "$IS_OSX" ]
function pre_build {
# Any stuff that you need to do before you start building the wheels
# Runs in the root directory of this repository.
:
}
function run_tests {
# Runs tests on installed distribution from an empty directory
python --version
python -c 'import sys; import yourpackage; sys.exit(yourpackage.test())'
}
* Make sure your project is set up to build on travis-ci, and you should now
be ready (to begin the long slow debugging process, probably).
If your project depends on numpy, you will want to build against the earliest
numpy that your project supports - see `forward, backward numpy compatibility
<http://stackoverflow.com/questions/17709641/valueerror-numpy-dtype-has-the-wrong-size-try-recompiling/18369312#18369312>`_.
See the `astropy-wheels travis file
<https://github.com/MacPython/astropy-wheels/blob/master/.travis.yml>`_ for an
example specifying numpy build and test dependencies.
Here are some simple example projects:
* https://github.com/MacPython/astropy-wheels
* https://github.com/scikit-image/scikit-image-wheels
* https://github.com/MacPython/nipy-wheels
* https://github.com/MacPython/dipy-wheels
Less simple projects where there are some serious build dependencies, and / or
OSX / Linux differences:
* https://github.com/MacPython/matplotlib-wheels
* https://github.com/python-pillow/Pillow-wheels
* https://github.com/MacPython/h5py-wheels
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment