Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
summary.md 4.67 KB
Newer Older
bailuo's avatar
readme  
bailuo committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113 
<details><summary>Experiment Results</summary>

## Experiment 1: air-passengers

### Description:
| variable      | experiment   |
|:--------------|:-------------|
| h             | 12           |
| season_length | 12           |
| freq          | MS           |
| level         | None         |
| n_windows     | 1            |

### Results:
| metric     |   timegpt-1 |   timegpt-1-long-horizon |   SeasonalNaive |      Naive |
|:-----------|------------:|-------------------------:|----------------:|-----------:|
| mae        |     12.6793 |                  11.0623 |         47.8333 |    76      |
| mape       |      0.027  |                   0.0232 |          0.0999 |     0.1425 |
| mse        |    213.936  |                 199.132  |       2571.33   | 10604.2    |
| total_time |      2.4918 |                   1.5065 |          0.0046 |     0.0045 |

### Plot:
![](/action_files/models_performance/plots/plot_air-passengers_12_12_MS_None_1.png)

## Experiment 2: air-passengers

### Description:
| variable      | experiment   |
|:--------------|:-------------|
| h             | 24           |
| season_length | 12           |
| freq          | MS           |
| level         | None         |
| n_windows     | 1            |

### Results:
| metric     |   timegpt-1 |   timegpt-1-long-horizon |   SeasonalNaive |      Naive |
|:-----------|------------:|-------------------------:|----------------:|-----------:|
| mae        |     58.1031 |                  58.4587 |         71.25   |   115.25   |
| mape       |      0.1257 |                   0.1267 |          0.1552 |     0.2358 |
| mse        |   4040.21   |                4110.79   |       5928.17   | 18859.2    |
| total_time |      0.5508 |                   0.5551 |          0.0032 |     0.0028 |

### Plot:
![](/action_files/models_performance/plots/plot_air-passengers_24_12_MS_None_1.png)

## Experiment 3: electricity-multiple-series

### Description:
| variable      | experiment   |
|:--------------|:-------------|
| h             | 24           |
| season_length | 24           |
| freq          | H            |
| level         | None         |
| n_windows     | 1            |

### Results:
| metric     |   timegpt-1 |   timegpt-1-long-horizon |   SeasonalNaive |          Naive |
|:-----------|------------:|-------------------------:|----------------:|---------------:|
| mae        |    178.293  |                 268.129  |        269.23   | 1331.02        |
| mape       |      0.0234 |                   0.0311 |          0.0304 |    0.1692      |
| mse        | 121586      |              219467      |     213677      |    4.68961e+06 |
| total_time |      1.2402 |                   1.5986 |          0.0046 |    0.0036      |

### Plot:
![](/action_files/models_performance/plots/plot_electricity-multiple-series_24_24_H_None_1.png)

## Experiment 4: electricity-multiple-series

### Description:
| variable      | experiment   |
|:--------------|:-------------|
| h             | 168          |
| season_length | 24           |
| freq          | H            |
| level         | None         |
| n_windows     | 1            |

### Results:
| metric     |   timegpt-1 |   timegpt-1-long-horizon |   SeasonalNaive |          Naive |
|:-----------|------------:|-------------------------:|----------------:|---------------:|
| mae        |    465.496  |                 346.976  |        398.956  | 1119.26        |
| mape       |      0.062  |                   0.0436 |          0.0512 |    0.1583      |
| mse        | 835064      |              403762      |     656723      |    3.17316e+06 |
| total_time |      0.6668 |                   0.637  |          0.0046 |    0.0037      |

### Plot:
![](/action_files/models_performance/plots/plot_electricity-multiple-series_168_24_H_None_1.png)

## Experiment 5: electricity-multiple-series

### Description:
| variable      | experiment   |
|:--------------|:-------------|
| h             | 336          |
| season_length | 24           |
| freq          | H            |
| level         | None         |
| n_windows     | 1            |

### Results:
| metric     |     timegpt-1 |   timegpt-1-long-horizon |   SeasonalNaive |          Naive |
|:-----------|--------------:|-------------------------:|----------------:|---------------:|
| mae        | 558.702       |                 459.769  |   602.926       | 1340.95        |
| mape       |   0.0697      |                   0.0565 |     0.0787      |    0.17        |
| mse        |   1.22728e+06 |              739162      |     1.61572e+06 |    6.04619e+06 |
| total_time |   1.1054      |                   1.3368 |     0.0046      |    0.0038      |

### Plot:
![](/action_files/models_performance/plots/plot_electricity-multiple-series_336_24_H_None_1.png)

</details>