Commit d4fde8c8 authored by Matthew Brett's avatar Matthew Brett
Browse files

Fill out README

parent b487287d
...@@ -2,5 +2,168 @@ ...@@ -2,5 +2,168 @@
Utilities for building on travis-ci with OSX and Linux Utilities for building on travis-ci with OSX and Linux
###################################################### ######################################################
A set of scripts to automate some of the work of building wheels on OSX and the A set of scripts to automate builds of OSX and manylinux1 wheels on travis-ci
manylinux1 docker system. infrastructure.
These scripts are designed to build *and test*:
* Dual architecture OSX wheels;
* 64-bit manylinux1_x86_64 wheels, both narrow and wide unicode builds;
* 32-bit manylinux1_i686 wheels, both narrow and wide unicode builds.
You can currently build and test against Pythons 2.6, 2.7, 3.3, 3.4, 3.5.
The small innovation here is that you can test against 32-bit builds, and both
wide and narrow unicode Python 2 builds, which was not easy on the default
travis-ci configurations.
Use these scripts like so:
* Make a repository for building wheels on travis-ci - e.g.
https://github.com/MacPython/astropy-wheels - or in your case maybe
``https://github.com/your-org/your-project-wheels``;
* Add this (here) repository as a submodule::
git submodule add https://github.com/matthew-brett/multibuild.git
* Add your own project repository as another submodule::
git submodule add https://github.com/your-org/your-project.git
* Create a ``.travis.yml`` file, something like this::
env:
global:
- REPO_DIR=your-project
# Commit from your-project that you want to build
- BUILD_COMMIT=v0.1.0
# pip dependencies to _build_ your project
- BUILD_DEPENDS="Cython numpy"
# pip dependencies to _test_ your project. Include any dependencies
# that you need, that are also specified in BUILD_DEPENDS, this will be
# a separate install.
- TEST_DEPENDS="numpy scipy pytest"
- PLAT=x86_64
- UNICODE_WIDTH=32
- WHEELHOUSE_UPLOADER_USERNAME=travis-worker
# Following generated with
# travis encrypt -r your-org/your-project-wheels WHEELHOUSE_UPLOADER_SECRET=<the api key>
# This is for Rackspace uploads. Contact the scikit-learn team for
# permission (and the API key) to upload to the Rackspace account used
# here, or use your own account.
- secure:
"MNKyBWOzu7JAUmC0Y+JhPKfytXxY/ADRmUIMEWZV977FLZPgYctqd+lqel2QIFgdHDO1CIdTSymOOFZckM9ICUXg9Ta+8oBjSvAVWO1ahDcToRM2DLq66fKg+NKimd2OfK7x597h/QmUSl4k8XyvyyXgl5jOiLg/EJxNE2r83IA="
language: python
sudo: required
dist: trusty
services: docker
matrix:
include:
- os: linux
python: 2.7
- os: linux
python: 2.7
env:
- UNICODE_WIDTH=16
- os: linux
python: 2.7
env:
- PLAT=i686
- os: linux
python: 2.7
env:
- PLAT=i686
- UNICODE_WIDTH=16
- os: linux
python: 3.4
- os: linux
python: 3.4
env:
- PLAT=i686
- os: linux
python: 3.5
- os: linux
python: 3.5
env:
- PLAT=i686
- os: osx
language: objective-c
env: TRAVIS_PYTHON_VERSION=2.7
- os: osx
language: objective-c
env:
- TRAVIS_PYTHON_VERSION=3.4
- os: osx
language: objective-c
env:
- TRAVIS_PYTHON_VERSION=3.5
before_install:
- source multibuild/common_utils.sh
- source multibuild/travis_steps.sh
- before_install
install:
# Maybe get and clean and patch source
- clean_code $REPO_DIR $BUILD_COMMIT
- build_wheel $REPO_DIR $PLAT
script:
- install_run $PLAT
after_success:
# Upload wheels to Rackspace container
- pip install wheelhouse-uploader
# This uploads the wheels to a Rackspace container owned by the
# scikit-learn team, available at http://wheels.scipy.org. See above
# for information on using this account or choosing another.
- python -m wheelhouse_uploader upload --local-folder
${TRAVIS_BUILD_DIR}/wheelhouse/
--no-update-index
wheels
* Next create a ``config.sh`` for your project, that fills in any steps you
need to do before building the wheel (such as building required libraries).
You also need this file to specify how to run your tests::
# Define custom utilities
# Test for OSX with [ -n "$IS_OSX" ]
function pre_build {
# Any stuff that you need to do before you start building the wheels
# Runs in the root directory of this repository.
:
}
function run_tests {
# Runs tests on installed distribution from an empty directory
python --version
python -c 'import sys; import yourpackage; sys.exit(yourpackage.test())'
}
* Make sure your project is set up to build on travis-ci, and you should now
be ready (to begin the long slow debugging process, probably).
If your project depends on numpy, you will want to build against the earliest
numpy that your project supports - see `forward, backward numpy compatibility
<http://stackoverflow.com/questions/17709641/valueerror-numpy-dtype-has-the-wrong-size-try-recompiling/18369312#18369312>`_.
See the `astropy-wheels travis file
<https://github.com/MacPython/astropy-wheels/blob/master/.travis.yml>`_ for an
example specifying numpy build and test dependencies.
Here are some simple example projects:
* https://github.com/MacPython/astropy-wheels
* https://github.com/scikit-image/scikit-image-wheels
* https://github.com/MacPython/nipy-wheels
* https://github.com/MacPython/dipy-wheels
Less simple projects where there are some serious build dependencies, and / or
OSX / Linux differences:
* https://github.com/MacPython/matplotlib-wheels
* https://github.com/python-pillow/Pillow-wheels
* https://github.com/MacPython/h5py-wheels
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment