james-ocf commited on
Commit
37ef1d6
·
verified ·
1 Parent(s): 5dab76c

Upload folder using huggingface_hub

Browse files
earthformer_model/README.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ library_name: pytorch
4
+ license: mit
5
+ ---
6
+
7
+
8
+ # Cloudcasting
9
+
10
+ ## Model Description
11
+
12
+ <!-- Provide a longer summary of what this model is/does. -->
13
+ This model is trained to predict future frames of satellite data from past frames. It takes 3 hours
14
+ of recent satellkite imagery at 15 minute intervals and predicts 3 hours into the future also at
15
+ 15 minute intervals. The satellite inputs and predictions are multispectral with 11 channels.
16
+
17
+
18
+ See [1] for the repo used to train the model.
19
+
20
+ - **Developed by:** Open Climate Fix and the Alan Turing Institute
21
+ - **License:** mit
22
+
23
+
24
+ # Training Details
25
+
26
+ ## Data
27
+
28
+ <!-- This should link to a Data Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
29
+ This was trained on EUMETSAT satellite imagery derived from the data stored in [this google public
30
+ dataset](https://console.cloud.google.com/marketplace/product/bigquery-public-data/eumetsat-seviri-rss?hl=en-GB&inv=1&invt=AbniZA&project=solar-pv-nowcasting&pli=1).
31
+
32
+ The data was processed using the protocol in [2]
33
+
34
+
35
+
36
+ ## Results
37
+
38
+ The training logs for the current model can be found here:
39
+ - https://wandb.ai/openclimatefix/sat_pred/runs/ckyb2l1s
40
+
41
+
42
+ ### Software
43
+
44
+ - [1] https://github.com/openclimatefix/sat_pred
45
+ - [2] https://github.com/alan-turing-institute/cloudcasting
earthformer_model/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8470382c40ca61bc382a74f5e34bfd22aa2531b9bfa633497d7d63f3081b732e
3
+ size 34776668
earthformer_model/model_config.yaml ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ _target_: sat_pred.models.earthformer_model.Earthformer
2
+ attn_drop: 0.1
3
+ attn_linear_init_mode: '0'
4
+ base_units: 128
5
+ block_units: null
6
+ checkpoint_level: 0
7
+ conv_init_mode: '0'
8
+ dec_cross_attn_patterns: cross_1x1
9
+ dec_cross_last_n_frames: null
10
+ dec_depth:
11
+ - 1
12
+ - 1
13
+ dec_hierarchical_pos_embed: false
14
+ dec_self_attn_patterns: axial
15
+ dec_self_update_global: true
16
+ dec_use_first_self_attn: false
17
+ dec_use_inter_ffn: true
18
+ down_up_linear_init_mode: '0'
19
+ downsample: 2
20
+ downsample_type: patch_merge
21
+ enc_attn_patterns: axial
22
+ enc_depth:
23
+ - 1
24
+ - 1
25
+ enc_use_inter_ffn: true
26
+ ffn_activation: gelu
27
+ ffn_drop: 0.1
28
+ ffn_linear_init_mode: '0'
29
+ gated_ffn: false
30
+ global_dim_ratio: 1
31
+ initial_downsample_activation: leaky
32
+ initial_downsample_stack_conv_dim_list:
33
+ - 16
34
+ - 64
35
+ - 128
36
+ initial_downsample_stack_conv_downscale_list:
37
+ - 3
38
+ - 2
39
+ - 2
40
+ initial_downsample_stack_conv_num_conv_list:
41
+ - 2
42
+ - 2
43
+ - 2
44
+ initial_downsample_stack_conv_num_layers: 3
45
+ initial_downsample_type: stack_conv
46
+ input_shape:
47
+ - 12
48
+ - 372
49
+ - 614
50
+ - 11
51
+ norm_init_mode: '0'
52
+ norm_layer: layer_norm
53
+ num_global_vectors: 8
54
+ num_heads: 4
55
+ padding_type: zeros
56
+ pos_embed_type: t+h+w
57
+ proj_drop: 0.1
58
+ scale_alpha: 1.0
59
+ self_attn_use_final_proj: true
60
+ separate_global_qkv: true
61
+ target_shape:
62
+ - 12
63
+ - 372
64
+ - 614
65
+ - 11
66
+ upsample_type: upsample
67
+ use_dec_cross_global: false
68
+ use_dec_self_global: false
69
+ use_global_self_attn: true
70
+ use_global_vector_ffn: false
71
+ use_relative_pos: true
72
+ z_init_method: zeros
simvp_model/README.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: mit
4
+ library_name: pytorch
5
+ ---
6
+
7
+
8
+ # Cloudcasting
9
+
10
+ ## Model Description
11
+
12
+ <!-- Provide a longer summary of what this model is/does. -->
13
+ This model is trained to predict future frames of satellite data from past frames. It takes 3 hours
14
+ of recent satellkite imagery at 15 minute intervals and predicts 3 hours into the future also at
15
+ 15 minute intervals. The satellite inputs and predictions are multispectral with 11 channels.
16
+
17
+
18
+ See [1] for the repo used to train the model.
19
+
20
+ - **Developed by:** Open Climate Fix and the Alan Turing Institute
21
+ - **License:** mit
22
+
23
+
24
+ # Training Details
25
+
26
+ ## Data
27
+
28
+ <!-- This should link to a Data Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
29
+ This was trained on EUMETSAT satellite imagery derived from the data stored in [this google public
30
+ dataset](https://console.cloud.google.com/marketplace/product/bigquery-public-data/eumetsat-seviri-rss?hl=en-GB&inv=1&invt=AbniZA&project=solar-pv-nowcasting&pli=1).
31
+
32
+ The data was processed using the protocol in [2]
33
+
34
+
35
+
36
+ ## Results
37
+
38
+ The training logs for the current model can be found here:
39
+ - https://wandb.ai/openclimatefix/sat_pred/runs/ob9v9128
40
+
41
+
42
+ ### Software
43
+
44
+ - [1] https://github.com/openclimatefix/sat_pred
45
+ - [2] https://github.com/alan-turing-institute/cloudcasting
simvp_model/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc35b136a9b0383cc989af09f3b370693a5a147835132282d9086af9e1579e8e
3
+ size 55940132
simvp_model/model_config.yaml ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ _target_: sat_pred.models.simvp_model.SimVP
2
+ forecast_len: 12
3
+ history_len: 12
4
+ num_channels: 11