diff --git a/README.md b/README.md index 7923e211..6907c20d 100644 --- a/README.md +++ b/README.md @@ -83,7 +83,7 @@ NLVR2 | Gradient checkpoint can also be activated in the config file to reduce GPU memory usage. ### Pre-train: -1. Prepare training json files where each json file contains a list. Each item in the list is a dictonary with two key-value pairs: {'image': path_of_image, 'caption': text_of_image}. +1. Prepare training json files where each json file contains a list. Each item in the list is a dictionary with two key-value pairs: {'image': path_of_image, 'caption': text_of_image}. 2. In configs/pretrain.yaml, set 'train_file' as the paths for the json files . 3. Pre-train the model using 8 A100 GPUs:
python -m torch.distributed.run --nproc_per_node=8 pretrain.py --config ./configs/Pretrain.yaml --output_dir output/Pretrain