CONTRIBUTING.md 8.26 KB
Newer Older
vfdev's avatar
vfdev committed
1
2
3
4
5
6
# Contributing to Torchvision

We want to make contributing to this project as easy and transparent as possible.

## TL;DR

7
We appreciate all contributions. If you are interested in contributing to Torchvision, there are many ways to help out.
vfdev's avatar
vfdev committed
8
9
Your contributions may fall into the following categories:

10
- It helps the project if you could
vfdev's avatar
vfdev committed
11
    - Report issues you're facing
12
    - Give a :+1: on issues that others reported and that are relevant to you
vfdev's avatar
vfdev committed
13
14
15

- Answering queries on the issue tracker, investigating bugs are very valuable contributions to the project.

16
- You would like to improve the documentation. This is no less important than improving the library itself!
vfdev's avatar
vfdev committed
17
18
19
20
21
If you find a typo in the documentation, do not hesitate to submit a GitHub pull request.

- If you would like to fix a bug
    - please pick one from the [list of open issues labelled as "help wanted"](https://github.com/pytorch/vision/issues?q=is%3Aopen+is%3Aissue+label%3A%22help+wanted%22)
    - comment on the issue that you want to work on this issue
22
    - send a PR with your fix, see below.
vfdev's avatar
vfdev committed
23
24
25
26
27
28
29
30
31
32

- If you plan to contribute new features, utility functions or extensions, please first open an issue and discuss the feature with us.

## Issues

We use GitHub issues to track public bugs. Please ensure your description is
clear and has sufficient instructions to be able to reproduce the issue.

## Development installation

Nicolas Hug's avatar
Nicolas Hug committed
33
34
35
36
37
38
39
40
41
42

### Dependencies

Start by installing the **nightly** build of PyTorch following the [official
instructions](https://pytorch.org/get-started/locally/).

**Optionally**, install `libpng` and `libjpeg-turbo` if you want to enable
support for
native encoding / decoding of PNG and JPEG formats in
[torchvision.io](https://pytorch.org/vision/stable/io.html#image):
vfdev's avatar
vfdev committed
43
44

```bash
Nicolas Hug's avatar
Nicolas Hug committed
45
conda install libpng libjpeg-turbo -c pytorch
vfdev's avatar
vfdev committed
46
47
```

Nicolas Hug's avatar
Nicolas Hug committed
48
49
50
51
52
53
54
Note: you can use the `TORCHVISION_INCLUDE` and `TORCHVISION_LIBRARY`
environment variables to tell the build system where to find those libraries if
they are in specific locations. Take a look at
[setup.py](https://github.com/pytorch/vision/blob/main/setup.py) for more
details.

### Clone and install torchvision
vfdev's avatar
vfdev committed
55
56
57
58

```bash
git clone https://github.com/pytorch/vision.git
cd vision
Nicolas Hug's avatar
Nicolas Hug committed
59
python setup.py develop  # use install instead of develop if you don't care about development.
vfdev's avatar
vfdev committed
60
# or, for OSX
61
# MACOSX_DEPLOYMENT_TARGET=10.9 CC=clang CXX=clang++ python setup.py develop
Nicolas Hug's avatar
Nicolas Hug committed
62
# for C++ debugging, use DEBUG=1
63
# DEBUG=1 python setup.py develop
vfdev's avatar
vfdev committed
64
```
Nicolas Hug's avatar
Nicolas Hug committed
65
66
67
68
69
70
71
72
73
74
75

By default, GPU support is built if CUDA is found and `torch.cuda.is_available()` is true. It's possible to force
building GPU support by setting `FORCE_CUDA=1` environment variable, which is useful when building a docker image.

We don't officially support building from source using `pip`, but _if_ you do, you'll need to use the
`--no-build-isolation` flag.

Other development dependencies include:

```
pip install flake8 typing mypy pytest pytest-mock scipy
vfdev's avatar
vfdev committed
76
77
78
79
80
81
```

## Development Process

If you plan to modify the code or documentation, please follow the steps below:

82
1. Fork the repository and create your branch from `main`.
vfdev's avatar
vfdev committed
83
84
85
2. If you have modified the code (new feature or bug-fix), please add unit tests.
3. If you have changed APIs, update the documentation. Make sure the documentation builds.
4. Ensure the test suite passes.
86
5. Make sure your code passes the formatting checks (see below).
vfdev's avatar
vfdev committed
87

88
89
For more details about pull requests,
please read [GitHub's guides](https://docs.github.com/en/github/collaborating-with-issues-and-pull-requests/creating-a-pull-request).
vfdev's avatar
vfdev committed
90

91
If you would like to contribute a new model, please see [here](#New-architecture-or-improved-model-weights).
vfdev's avatar
vfdev committed
92

93
If you would like to contribute a new dataset, please see [here](#New-dataset).
vfdev's avatar
vfdev committed
94
95
96

### Code formatting and typing

97
98
99
100
101
102
103
104
#### Formatting

The torchvision code is formatted by [black](https://black.readthedocs.io/en/stable/),
and checked against pep8 compliance with [flake8](https://flake8.pycqa.org/en/latest/).
Instead of relying directly on `black` however, we rely on
[ufmt](https://github.com/omnilib/ufmt), for compatibility reasons with Facebook
internal infrastructure.

Edward Z. Yang's avatar
Edward Z. Yang committed
105
To format your code, install `ufmt` with `pip install ufmt==1.3.3 black==22.3.0 usort==1.0.2` and use e.g.:
106

vfdev's avatar
vfdev committed
107
```bash
108
ufmt format torchvision
109
```
110
111
112
113
114

For the vast majority of cases, this is all you should need to run. For the
formatting to be a bit faster, you can also choose to only apply `ufmt` to the
files that were edited in your PR with e.g.:

115
```bash
116
ufmt format `git diff main --name-only`
vfdev's avatar
vfdev committed
117
118
```

119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
Similarly, you can check for `flake8` errors with `flake8 torchvision`, although
they should be fairly rare considering that most of the errors are automatically
taken care of by `ufmt` already.

##### Pre-commit hooks

For convenience and **purely optionally**, you can rely on [pre-commit
hooks](https://pre-commit.com/) which will run both `ufmt` and `flake8` prior to
every commit.

First install the `pre-commit` package with `pip install pre-commit`, and then
run `pre-commit install` at the root of the repo for the hooks to be set up -
that's it.

Feel free to read the [pre-commit docs](https://pre-commit.com/#usage) to learn
more and improve your workflow. You'll see for example that `pre-commit run
--all-files` will run both `ufmt` and `flake8` without the need for you to
commit anything, and that the `--no-verify` flag can be added to `git commit` to
temporarily deactivate the hooks.

#### Type annotations

vfdev's avatar
vfdev committed
141
142
143
144
145
146
147
The codebase has type annotations, please make sure to add type hints if required. We use `mypy` tool for type checking:
```bash
mypy --config-file mypy.ini
```

### Unit tests

148
149
If you have modified the code by adding a new feature or a bug-fix, please add unit tests for that. To run a specific
test:
vfdev's avatar
vfdev committed
150
151
```bash
pytest test/<test-module.py> -vvv -k <test_myfunc>
152
# e.g. pytest test/test_transforms.py -vvv -k test_center_crop
vfdev's avatar
vfdev committed
153
154
155
156
157
```

If you would like to run all tests:
```bash
pytest test -vvv
158
```
vfdev's avatar
vfdev committed
159

160
161
162
Tests that require internet access should be in
`test/test_internet.py`.

vfdev's avatar
vfdev committed
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
### Documentation

Torchvision uses [Google style](http://sphinxcontrib-napoleon.readthedocs.io/en/latest/example_google.html)
for formatting docstrings. Length of line inside docstrings block must be limited to 120 characters.

Please, follow the instructions to build and deploy the documentation locally.

#### Install requirements

```bash
cd docs
pip install -r requirements.txt
```

#### Build

```bash
cd docs
181
make html-noplot
vfdev's avatar
vfdev committed
182
183
```

Nicolas Hug's avatar
Nicolas Hug committed
184
Then open `docs/build/html/index.html` in your favorite browser.
vfdev's avatar
vfdev committed
185

186
The docs are also automatically built when you submit a PR. The job that
187
188
builds the docs is named `build_docs`. You can access the rendered docs by
clicking on that job and then going to the "Artifacts" tab.
189

190
191
192
193
194
You can clean the built docs and re-start the build from scratch by doing ``make
clean``.

#### Building the example gallery - or not

195
196
197
198
In most cases, running `make html-noplot` is enough to build the docs for your
specific use-case. The `noplot` part tells sphinx **not** to build the examples
in the [gallery](https://pytorch.org/vision/stable/auto_examples/index.html),
which saves a lot of building time.
199

200
201
If you need to build all the examples in the gallery, then you can use `make
html`.
202
203
204
205
206
207

You can also choose to only build a subset of the examples by using the
``EXAMPLES_PATTERN`` env variable, which accepts a regular expression. For
example ``EXAMPLES_PATTERN="transforms" make html`` will only build the examples
with "transforms" in their name.

Joao Gomes's avatar
Joao Gomes committed
208
### New architecture or improved model weights
vfdev's avatar
vfdev committed
209

Joao Gomes's avatar
Joao Gomes committed
210
Please refer to the guidelines in [Contributing to Torchvision - Models](https://github.com/pytorch/vision/blob/main/CONTRIBUTING_MODELS.md).
211

vfdev's avatar
vfdev committed
212
213
### New dataset

214
Please, do not send any PR with a new dataset without discussing
vfdev's avatar
vfdev committed
215
216
217
218
it in an issue as, most likely, it will not be accepted.

### Pull Request

219
If all previous checks (flake8, mypy, unit tests) are passing, please send a PR. Submitted PR will pass other tests on
220
different operating systems, python versions and hardware.
vfdev's avatar
vfdev committed
221

222
For more details about pull requests workflow,
vfdev's avatar
vfdev committed
223
224
225
226
227
228
please read [GitHub's guides](https://docs.github.com/en/github/collaborating-with-issues-and-pull-requests/creating-a-pull-request).

## License

By contributing to Torchvision, you agree that your contributions will be licensed
under the LICENSE file in the root directory of this source tree.
229
230

Contributors are also required to [sign our Contributor License Agreement](https://code.facebook.com/cla).