18°

Open log · updates itself

collecting · last run: 2026-10-02 00:00:00 UTC

Weather scoreboard

The weights of ECMWF’s forecast model are public, and they weigh under a gigabyte. So I set it running on my desktop graphics card, and every day I record two things before anything happens: what that model predicts at my house and what the official forecast predicts, which runs on a supercomputer.

When time passes, what actually occurred gets written down. Predictions are never edited. In a few months this table will say who gets it right more often, without anyone having to be taken at their word.

The bot waiting for the next data pointNext hour awaiting confirmation: 2/10, 21:00, 12.5 °C predicted by the model at home.

Local AI

1.09°C

mean error · AIFS on an RTX 4070 Ti SUPER

rmse
1.35
bias
-0.71
worst
3.69
wins
108
Officialahead

0.98°C

mean error · ECMWF operational IFS

rmse
1.24
bias
-0.63
worst
3.40
wins
139

250 hours verified6 waiting on the clocksince 2026-08-16Santiago, Chile · temperature at 2 m

The three curvesThe reality line stops where time has not arrived yet.
  • Local AI
  • Official
  • What happened
The error by how far ahead you lookEach pair compares the mean error at that horizon. The further the model looks, the more it shows.
  • Local AI
  • Official
View as table
HorizonLocal AIOfficial
+6 h1.12 °C1.02 °C
+12 h0.99 °C0.62 °C
+18 h0.86 °C1.01 °C
+24 h1.01 °C1.03 °C
+30 h1.29 °C1.19 °C
+36 h1.20 °C0.83 °C
+42 h0.79 °C0.81 °C
+48 h1.45 °C1.39 °C

The full log

last run: 18s · 5.77 GB

The actual column gets filled in later, with the ERA5 reanalysis; until that arrives the recent analysis is used, marked with an asterisk. The two forecast columns are never edited.

Analysis of 2026-10-02 00:00:00 UTC3/8 verified

18s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
2/10, 03:0014.2215.2016.302.081.10
2/10, 09:0013.6114.7014.500.890.20
2/10, 15:0018.8118.9018.000.810.90
2/10, 21:0012.4713.00——
3/10, 03:009.5910.50——
3/10, 09:0010.5310.60——
3/10, 15:0019.6518.90——
3/10, 21:0013.0012.60——
Analysis of 2026-10-01 00:00:00 UTC7/8 verified

19.2s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
1/10, 03:0011.5910.8011.800.211.00
1/10, 09:0014.0614.0014.300.240.30
1/10, 15:0026.0527.6026.700.650.90
1/10, 21:0018.9619.1019.900.940.80
2/10, 03:0014.3515.4016.101.750.70
2/10, 09:0013.6813.5014.500.821.00
2/10, 15:0018.2519.4018.000.251.40
2/10, 21:0012.2312.60——
Analysis of 2026-09-30 00:00:00 UTC8/8 verified

18.2s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
30/9, 03:0010.3911.2011.601.210.40
30/9, 09:0010.8010.9011.100.300.20
30/9, 15:0015.2118.6017.502.291.10
30/9, 21:0013.1513.9014.201.050.30
1/10, 03:0011.2910.1012.000.711.90
1/10, 09:0013.5813.5014.300.720.80
1/10, 15:0025.6826.9026.701.020.20
1/10, 21:0018.5619.1019.901.340.80
Analysis of 2026-09-29 00:00:00 UTC8/8 verified

18.9s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
29/9, 03:009.6011.0011.101.500.10
29/9, 09:0010.1611.1011.100.940.00
29/9, 15:0017.2017.6016.500.701.10
29/9, 21:0012.9712.2012.500.470.30
30/9, 03:0010.1510.3011.201.050.90
30/9, 09:0010.1610.3011.100.940.80
30/9, 15:0014.9917.5017.502.510.00
30/9, 21:0013.2314.4014.200.970.20
Analysis of 2026-09-27 00:00:00 UTC8/8 verified

17.9s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
27/9, 03:0013.7813.3014.100.320.80
27/9, 09:0014.3613.6013.800.560.20
27/9, 15:0023.0122.4022.200.810.20
27/9, 21:0017.7317.5017.200.530.30
28/9, 03:0012.7012.2013.300.601.10
28/9, 09:0013.3413.8013.600.260.20
28/9, 15:0019.6319.9019.700.070.20
28/9, 21:0014.0813.3013.200.880.10
Analysis of 2026-09-26 00:00:00 UTC8/8 verified

18.2s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
26/9, 03:0013.4913.2013.900.410.70
26/9, 09:0014.4714.2015.400.931.20
26/9, 15:0023.4924.1022.800.691.30
26/9, 21:0018.1617.5017.900.260.40
27/9, 03:0013.4513.6013.800.350.20
27/9, 09:0014.3515.0013.800.551.20
27/9, 15:0023.8223.2022.201.621.00
27/9, 21:0017.4017.0017.200.200.20
Analysis of 2026-09-25 00:00:00 UTC8/8 verified

18.1s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
25/9, 03:0011.6212.6012.000.380.60
25/9, 09:0013.0313.4013.500.470.10
25/9, 15:0020.0422.7020.100.062.60
25/9, 21:0017.3017.0016.400.900.60
26/9, 03:0014.0613.4013.500.560.10
26/9, 09:0013.9413.5015.401.461.90
26/9, 15:0022.1021.7022.800.701.10
26/9, 21:0016.9216.4017.900.981.50
Analysis of 2026-09-20 00:00:00 UTC8/8 verified

17.4s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
20/9, 03:0011.5111.5011.000.510.50
20/9, 09:0011.6110.7011.700.091.00
20/9, 15:0015.3716.3017.602.231.30
20/9, 21:0012.2211.7011.500.720.20
21/9, 03:009.8710.209.700.170.50
21/9, 09:009.6710.509.800.130.70
21/9, 15:0018.6419.2020.101.460.90
21/9, 21:0014.8913.9015.400.511.50
Analysis of 2026-09-16 00:00:00 UTC8/8 verified

18.2s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
16/9, 03:0012.2613.7015.002.741.30
16/9, 09:0012.2713.7014.902.631.20
16/9, 15:0026.7126.7026.000.710.70
16/9, 21:0019.4819.7019.800.320.10
17/9, 03:0013.1314.4016.303.171.90
17/9, 09:0013.2014.7015.702.501.00
17/9, 15:0026.8926.8027.600.710.80
17/9, 21:0017.2916.9017.700.410.80
Analysis of 2026-09-15 00:00:00 UTC8/8 verified

17.8s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
15/9, 03:0011.5013.0014.202.701.20
15/9, 09:0012.0813.3013.701.620.40
15/9, 15:0026.9927.9027.600.610.30
15/9, 21:0019.2119.7020.801.591.10
16/9, 03:0012.4013.9015.302.901.40
16/9, 09:0012.3614.2014.902.540.70
16/9, 15:0026.3126.5026.000.310.50
16/9, 21:0018.9919.6019.800.810.20
Analysis of 2026-09-14 00:00:00 UTC8/8 verified

17.5s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
14/9, 03:009.5010.8011.602.100.80
14/9, 09:009.5011.0012.402.901.40
14/9, 15:0023.9924.7024.700.710.00
14/9, 21:0017.5818.3019.301.721.00
15/9, 03:0011.5513.3014.703.151.40
15/9, 09:0011.8613.1013.701.840.60
15/9, 15:0026.7027.6027.600.900.00
15/9, 21:0018.5419.4020.802.261.40
Analysis of 2026-09-13 00:00:00 UTC8/8 verified

17.9s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
13/9, 03:008.969.409.700.740.30
13/9, 09:009.708.4010.300.601.90
13/9, 15:0023.5024.0023.600.100.40
13/9, 21:0015.9716.1016.800.830.70
14/9, 03:0010.0211.7012.102.080.40
14/9, 09:009.8411.7012.402.560.70
14/9, 15:0024.2024.8024.700.500.10
14/9, 21:0017.5718.6019.301.730.70
Analysis of 2026-09-12 00:00:00 UTC8/8 verified

17.6s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
12/9, 03:008.058.508.900.850.40
12/9, 09:007.498.108.400.910.30
12/9, 15:0020.1019.8018.501.601.30
12/9, 21:0014.8114.6015.000.190.40
13/9, 03:009.559.4010.300.750.90
13/9, 09:009.658.6010.300.651.70
13/9, 15:0023.5223.3023.600.080.30
13/9, 21:0015.7615.8016.801.041.00
Analysis of 2026-09-11 00:00:00 UTC8/8 verified

18s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
11/9, 03:008.119.109.801.690.70
11/9, 09:008.349.509.100.760.40
11/9, 15:0015.8316.3015.200.631.10
11/9, 21:0010.8410.5011.200.360.70
12/9, 03:007.379.008.200.830.80
12/9, 09:006.538.108.401.870.30
12/9, 15:0018.9818.1018.500.480.40
12/9, 21:0013.8913.0015.001.112.00
Analysis of 2026-09-10 00:00:00 UTC8/8 verified

17.9s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
10/9, 03:008.418.7010.301.891.60
10/9, 09:008.189.1010.402.221.30
10/9, 15:0016.7816.1013.902.882.20
10/9, 21:0011.3312.7012.300.970.40
11/9, 03:007.448.309.401.961.10
11/9, 09:007.698.809.101.410.30
11/9, 15:0016.0416.1015.200.840.90
11/9, 21:0010.7310.0011.200.471.20
Analysis of 2026-09-09 00:00:00 UTC8/8 verified

19.6s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
9/9, 03:007.737.808.000.270.20
9/9, 09:007.227.307.600.380.30
9/9, 15:0017.1717.4017.700.530.30
9/9, 21:0011.8113.1013.701.890.60
10/9, 03:007.788.909.701.920.80
10/9, 09:007.268.3010.403.142.10
10/9, 15:0015.3815.0013.901.481.10
10/9, 21:0010.8510.7012.301.451.60
Analysis of 2026-09-08 00:00:00 UTC8/8 verified

17.6s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
8/9, 03:006.596.507.701.111.20
8/9, 09:006.377.308.502.131.20
8/9, 15:0016.9717.9018.701.730.80
8/9, 21:0010.9210.9010.600.320.30
9/9, 03:007.689.108.100.421.00
9/9, 09:007.228.607.600.381.00
9/9, 15:0016.2316.4017.701.471.30
9/9, 21:0011.1912.4013.702.511.30
Analysis of 2026-09-05 06:00:00 UTC8/8 verified

18.9s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
5/9, 08:006.907.207.700.800.50
5/9, 14:0021.2121.1021.200.010.10
5/9, 20:0014.4913.1014.500.011.40
6/9, 03:008.058.4010.302.251.90
6/9, 09:007.417.509.902.492.40
6/9, 15:0020.2118.5020.000.211.50
6/9, 21:0011.8311.0013.001.172.00
7/9, 03:007.246.808.701.461.90
Analysis of 2026-09-04 06:00:00 UTC8/8 verified

19.1s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
4/9, 08:007.427.808.701.280.90
4/9, 14:0019.1418.9018.400.740.50
4/9, 20:0013.3712.8013.900.531.10
5/9, 02:008.228.409.701.481.30
5/9, 08:007.717.807.700.010.10
5/9, 14:0021.1120.8021.200.090.40
5/9, 20:0014.3412.8014.500.161.70
6/9, 03:007.988.0010.302.322.30
Analysis of 2026-09-02 06:00:00 UTC8/8 verified

17.9s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
2/9, 08:0011.1810.8012.901.722.10
2/9, 14:0019.8520.2020.500.650.30
2/9, 20:0013.9513.4014.200.250.80
3/9, 02:0010.3210.2011.901.581.70
3/9, 08:009.949.309.700.240.40
3/9, 14:0018.4418.4018.300.140.10
3/9, 20:0013.2012.6013.900.701.30
4/9, 02:008.059.1010.502.451.40
Analysis of 2026-09-01 06:00:00 UTC8/8 verified

108.4s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
1/9, 08:009.337.908.600.730.70
1/9, 14:0021.5919.8019.502.090.30
1/9, 20:0016.6315.0017.100.472.10
2/9, 02:0013.2111.6014.301.092.70
2/9, 08:0011.8110.3012.901.092.60
2/9, 14:0019.4519.2020.501.051.30
2/9, 20:0013.7914.2014.200.410.00
3/9, 02:0010.1010.0011.901.801.90
Analysis of 2026-08-31 06:00:00 UTC8/8 verified

17.8s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
31/8, 08:008.899.809.500.610.30
31/8, 14:0018.4817.8017.500.980.30
31/8, 20:0013.6313.5014.701.071.20
1/9, 02:009.439.1011.001.571.90
1/9, 08:009.098.808.600.490.20
1/9, 14:0022.0719.4019.502.570.10
1/9, 20:0016.5015.4017.100.601.70
2/9, 02:0013.1411.7014.301.162.60
Analysis of 2026-08-30 06:00:00 UTC8/8 verified

17.8s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
30/8, 08:007.147.309.402.262.10
30/8, 14:0017.7317.3016.101.631.20
30/8, 20:0012.7610.8011.001.760.20
31/8, 02:009.729.9010.500.780.60
31/8, 08:009.078.909.500.430.60
31/8, 14:0019.2818.2017.501.780.70
31/8, 20:0013.7613.7014.700.941.00
1/9, 02:009.109.0011.001.902.00
Analysis of 2026-08-28 06:00:00 UTC8/8 verified

14.5s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
28/8, 08:006.807.507.801.000.30
28/8, 14:0017.0516.0015.901.150.10
28/8, 20:0011.3610.2011.000.360.80
29/8, 02:007.267.207.400.140.20
29/8, 08:006.796.607.000.210.40
29/8, 14:0018.5617.4017.201.360.20
29/8, 20:0012.3012.7012.500.200.20
30/8, 02:007.656.809.301.652.50
Analysis of 2026-08-27 06:00:00 UTC8/8 verified

17.7s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
27/8, 08:008.948.409.200.260.80
27/8, 14:0014.5415.4014.400.141.00
27/8, 20:0010.6910.1010.300.390.20
28/8, 02:007.618.208.000.390.20
28/8, 08:007.077.007.800.730.80
28/8, 14:0016.6015.5015.900.700.40
28/8, 20:0011.219.5011.000.211.50
29/8, 02:007.086.607.400.320.80
Analysis of 2026-08-22 06:00:00 UTC8/8 verified

16.7s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
22/8, 08:0010.648.9011.500.862.60
22/8, 14:0024.1023.9023.101.000.80
22/8, 20:0018.0217.8019.000.981.20
23/8, 02:0011.9811.7014.602.622.90
23/8, 08:009.6710.5012.202.531.70
23/8, 14:0019.2320.4021.101.870.70
23/8, 20:0013.1313.5013.100.030.40
24/8, 02:009.0011.0011.602.600.60
Analysis of 2026-08-21 06:00:00 UTC8/8 verified

17.2s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
21/8, 08:008.656.209.100.452.90
21/8, 14:0023.4022.6021.701.700.90
21/8, 20:0016.8215.5017.000.181.50
22/8, 02:0012.309.0012.400.103.40
22/8, 08:0011.348.5011.500.163.00
22/8, 14:0023.2223.9023.100.120.80
22/8, 20:0017.1117.8019.001.891.20
23/8, 02:0011.5511.4014.603.053.20
Analysis of 2026-08-19 06:00:00 UTC8/8 verified

22.3s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
19/8, 08:006.416.508.902.492.40
19/8, 14:0016.8118.3017.700.890.60
19/8, 20:0011.6512.1012.200.550.10
20/8, 02:007.828.7010.502.681.80
20/8, 08:006.717.8010.403.692.60
20/8, 14:0018.5619.2016.901.662.30
20/8, 20:0013.4013.4013.600.200.20
21/8, 02:009.408.4010.200.801.80
Analysis of 2026-08-18 06:00:00 UTC8/8 verified

21.3s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
18/8, 08:006.213.807.100.893.30
18/8, 14:0017.9517.6017.000.950.60
18/8, 20:0012.6411.8013.400.761.60
19/8, 02:008.307.809.601.301.80
19/8, 08:006.816.008.902.092.90
19/8, 14:0016.4017.2017.701.300.50
19/8, 20:0011.3412.4012.200.860.20
20/8, 02:007.329.7010.503.180.80
Analysis of 2026-08-17 06:00:00 UTC8/8 verified

19.1s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
17/8, 08:007.258.308.100.850.20
17/8, 14:0013.7613.5013.500.260.00
17/8, 20:0010.7610.3011.600.841.30
18/8, 02:007.516.408.100.591.70
18/8, 08:006.393.807.100.713.30
18/8, 14:0017.9417.6017.000.940.60
18/8, 20:0012.5811.8013.400.821.60
19/8, 02:008.097.809.601.511.80
Analysis of 2026-08-16 06:00:00 UTC8/8 verified

19.4s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
16/8, 08:004.675.104.900.230.20
16/8, 14:0014.7915.2014.000.791.20
16/8, 20:0010.219.8010.800.591.00
17/8, 02:007.558.408.901.350.50
17/8, 08:006.597.908.101.510.20
17/8, 14:0013.6212.7013.500.120.80
17/8, 20:0010.4710.4011.601.131.20
18/8, 02:006.945.708.101.162.40
Analysis of 2026-08-16 00:00:00 UTC8/8 verified

108.5s on NVIDIA GeForce RTX 4070 Ti SUPER · 5.77 GB of memory· grid -33.583, -70.720

Hour (Chile)Local AIOfficialActualAI errorOfficial error
16/8, 02:005.776.006.600.830.60
16/8, 08:005.155.104.900.250.20
16/8, 14:0015.1715.2014.001.171.20
16/8, 20:0010.439.8010.800.371.00
17/8, 02:007.598.408.901.310.50
17/8, 08:006.567.908.101.540.20
17/8, 14:0012.8812.7013.500.620.80
17/8, 20:0010.1010.4011.601.501.20

Method and data

Local model
ECMWF AIFS Single 2.0, public weights (CC-BY-4.0), running on an RTX 4070 Ti SUPER with the wrapper that swaps flash-attn for SDPA.
Official reference
ECMWF operational IFS via Open-Meteo, requested with cell_selection=nearest and elevation=nan to get the grid point without elevation correction. Without those parameters the value arrives adjusted by a 90 m elevation model, which introduces 0.60 °C of bias in Santiago.
Ground truth
ERA5 reanalysis. While ERA5 is unavailable the recent analysis is used, flagged as provisional and replaced as soon as the definitive one arrives.
Point
The nearest point of the reduced Gaussian grid to Santiago (−33.4489, −70.6693), about 15 km from the centre. No interpolation.
Metrics
MAE is the mean absolute error. RMSE squares before averaging, so it punishes large errors more: if it is well above the MAE, the model fails rarely but badly. Bias carries a sign and says whether it runs warm or cold.
Known limitation
The IFS updates four times a day and the scoreboard queries the current forecast, which may start from a more recent analysis than AIFS does. That favours the official one. Pinning both runs to the same initial analysis is still pending.

Download the full log as CSV· 256 rows · regenerated on every update

How it is built, step by step, in the article about the model.The code that keeps this log lives onGitHub.