README.md 3.9 KB
Newer Older
rusty1s's avatar
rusty1s committed
1
2
[pypi-image]: https://badge.fury.io/py/torch-scatter.svg
[pypi-url]: https://pypi.python.org/pypi/torch-scatter
rusty1s's avatar
rusty1s committed
3
4
[build-image]: https://travis-ci.org/rusty1s/pytorch_scatter.svg?branch=master
[build-url]: https://travis-ci.org/rusty1s/pytorch_scatter
rusty1s's avatar
rusty1s committed
5
6
[docs-image]: https://readthedocs.org/projects/pytorch-scatter/badge/?version=latest
[docs-url]: https://pytorch-scatter.readthedocs.io/en/latest/?badge=latest
rusty1s's avatar
rusty1s committed
7
8
[coverage-image]: https://codecov.io/gh/rusty1s/pytorch_scatter/branch/master/graph/badge.svg
[coverage-url]: https://codecov.io/github/rusty1s/pytorch_scatter?branch=master
rusty1s's avatar
rusty1s committed
9

rusty1s's avatar
rusty1s committed
10
11
12
13
# PyTorch Scatter

[![PyPI Version][pypi-image]][pypi-url]
[![Build Status][build-image]][build-url]
rusty1s's avatar
rusty1s committed
14
[![Docs Status][docs-image]][docs-url]
rusty1s's avatar
rusty1s committed
15
[![Code Coverage][coverage-image]][coverage-url]
rusty1s's avatar
rusty1s committed
16

rusty1s's avatar
rusty1s committed
17
<p align="center">
rusty1s's avatar
smaller  
rusty1s committed
18
  <img width="50%" src="https://raw.githubusercontent.com/rusty1s/pytorch_scatter/master/docs/source/_figures/add.svg?sanitize=true" />
rusty1s's avatar
rusty1s committed
19
20
21
22
</p>

--------------------------------------------------------------------------------

rusty1s's avatar
rusty1s committed
23
**[Documentation](https://pytorch-scatter.readthedocs.io)**
rusty1s's avatar
rusty1s committed
24

rusty1s's avatar
rusty1s committed
25
This package consists of a small extension library of highly optimized sparse update (scatter and segment) operations for the use in [PyTorch](http://pytorch.org/), which are missing in the main package.
rusty1s's avatar
rusty1s committed
26
Scatter and segment operations can be roughly described as reduce operations based on a given "group-index" tensor.
rusty1s's avatar
rusty1s committed
27
Segment operations require the "group-index" tensor to be sorted, whereas scatter operations are not subject to these requirements.
rusty1s's avatar
rusty1s committed
28

rusty1s's avatar
rusty1s committed
29
The package consists of the following operations with reduction types `"sum"|"mean"|"min"|"max"`:
30

rusty1s's avatar
rusty1s committed
31
32
33
* [**scatter**](https://pytorch-scatter.readthedocs.io/en/latest/functions/segment.html) based on arbitrary indices
* [**segment_coo**](https://pytorch-scatter.readthedocs.io/en/latest/functions/segment_coo.html) based on sorted indices
* [**segment_csr**](https://pytorch-scatter.readthedocs.io/en/latest/functions/segment_csr.html) based on compressed indices via pointers
34

rusty1s's avatar
rusty1s committed
35
36
In addition, we provide the following **composite functions** which make use of `scatter_*` operations under the hood: :`scatter_std`, `scatter_logsumexp`, `scatter_softmax` and `scatter_log_softmax`.

rusty1s's avatar
rusty1s committed
37
All included operations are broadcastable, work on varying data types, are implemented both for CPU and GPU with corresponding backward implementations, and are fully traceable.
rusty1s's avatar
rusty1s committed
38

rusty1s's avatar
rusty1s committed
39
40
## Installation

rusty1s's avatar
rusty1s committed
41
Ensure that at least PyTorch 1.3.0 is installed and verify that `cuda/bin` and `cuda/include` are in your `$PATH` and `$CPATH` respectively, *e.g.*:
rusty1s's avatar
rusty1s committed
42
43
44

```
$ python -c "import torch; print(torch.__version__)"
rusty1s's avatar
rusty1s committed
45
>>> 1.3.0
rusty1s's avatar
rusty1s committed
46
47
48
49
50

$ echo $PATH
>>> /usr/local/cuda/bin:...

$ echo $CPATH
rusty1s's avatar
rusty1s committed
51
>>> /usr/local/cuda/include:...
rusty1s's avatar
rusty1s committed
52
53
```

rusty1s's avatar
typos  
rusty1s committed
54
When running in a docker container without nvidia driver, PyTorch needs to evaluate the compute capabilities and may fail. In this case, ensure that the compute capabilities are set via `TORCH_CUDA_ARCH_LIST`
rusty1s's avatar
rusty1s committed
55

rusty1s's avatar
rusty1s committed
56
```
rusty1s's avatar
typos  
rusty1s committed
57
export TORCH_CUDA_ARCH_LIST = "6.0 6.1 7.2+PTX 7.5+PTX"
rusty1s's avatar
rusty1s committed
58
59
```

60
61
62
63
64
### Windows

If you are installing this on Windows specifically, **you will need to point the setup to your Visual Studio installation** for some neccessary libraries and header files.
To do this, add the include and library paths of your installation to the path lists in setup.py as described in the respective comments in the code.

rusty1s's avatar
rusty1s committed
65
If you are running into any installation problems, please create an [issue](https://github.com/rusty1s/pytorch_scatter/issues).
rusty1s's avatar
rusty1s committed
66
Be sure to import `torch` first before using this package to resolve symbols the dynamic linker must see.
rusty1s's avatar
rusty1s committed
67

rusty1s's avatar
rusty1s committed
68
## Example
rusty1s's avatar
rusty1s committed
69

rusty1s's avatar
rusty1s committed
70
```py
rusty1s's avatar
typo  
rusty1s committed
71
import torch
rusty1s's avatar
rusty1s committed
72
73
from torch_scatter import scatter_max

rusty1s's avatar
rusty1s committed
74
75
src = torch.tensor([[2, 0, 1, 4, 3], [0, 2, 1, 3, 4]])
index = torch.tensor([[4, 5, 4, 2, 3], [0, 0, 2, 2, 1]])
rusty1s's avatar
rusty1s committed
76

rusty1s's avatar
rusty1s committed
77
out, argmax = scatter_max(src, index, dim=-1)
rusty1s's avatar
typo  
rusty1s committed
78
```
rusty1s's avatar
rusty1s committed
79

rusty1s's avatar
typo  
rusty1s committed
80
```
rusty1s's avatar
rusty1s committed
81
print(out)
rusty1s's avatar
rusty1s committed
82
83
tensor([[0, 0, 4, 3, 2, 0],
        [2, 4, 3, 0, 0, 0]])
rusty1s's avatar
rusty1s committed
84

rusty1s's avatar
typos  
rusty1s committed
85
print(argmax)
rusty1s's avatar
rusty1s committed
86
87
tensor([[5, 5, 3, 4, 0, 1]
        [1, 4, 3, 5, 5, 5]])
rusty1s's avatar
typos  
rusty1s committed
88
```
rusty1s's avatar
rusty1s committed
89
90
91

## Running tests

rusty1s's avatar
rusty1s committed
92
```
rusty1s's avatar
rusty1s committed
93
94
python setup.py test
```