"tests/vscode:/vscode.git/clone" did not exist on "8fac837679b93e3105e585b710a43521ada6b2a2"
CHANGE_LOG.md 1.08 KB
Newer Older
1
2
3
4
# Change Log

All notable changes to this project will be documented in this file.

5
6
🚩 **We have moved the change log to the GitHub [release page](https://github.com/hpcaitech/ColossalAI/releases)**

7
## v0.0.2 | 2022-02
8
9
10

### Added

sohn's avatar
sohn committed
11
- Unified distributed layers
12
13
14
15
16
17
18
19
20
21
22
- MoE support
- DevOps tools such as github action, code review automation, etc.
- New project official website

### Changes

- refactored the APIs for usability, flexibility and modularity
- adapted PyTorch AMP for tensor parallel
- refactored utilities for tensor parallel and pipeline parallel
- Separated benchmarks and examples as independent repositories
- Updated pipeline parallelism to support non-interleaved and interleaved versions
23
- refactored installation scripts for convenience
24
25
26
27
28
29
30
31
32
33
34
35
36
37

### Fixed

- zero level 3 runtime error
- incorrect calculation in gradient clipping


## v0.0.1 beta | 2021-10

The first beta version of Colossal-AI. Thanks to all contributors for the effort to implement the system.

### Added

- Initial architecture of the system
sohn's avatar
sohn committed
38
- Features such as tensor parallelism, gradient clipping, gradient accumulation