Missing data folder in root directory

[bcol23]

Issue Description

When locally running memit.ipynb, an error occurs as follows:

Retrieving covariance statistics for EleutherAI_gpt-j-6B @ transformer.h.3.mlp.fc_out.
Attempting to download EleutherAI_gpt-j-6B/wikipedia_stats/transformer.h.3.mlp.fc_out_float32_mom2_100000.npz from https://memit.baulab.info/data/stats/EleutherAI_gpt-j-6B/wikipedia_stats/transformer.h.3.mlp.fc_out_float32_mom2_100000.npz.
Unable to download due to [Errno 17] File exists: 'data'. Computing locally....
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
notebooks/memit/memit_main.py:44, in apply_memit_to_model(model, tok, requests, hparams, copy, return_orig_weights, cache_template)
...
    461         )
    463 # if not using an existing config, then create a new config on the fly
    464 if not builder_config:

ValueError: BuilderConfig 20200501.en not found. Available: ['20220301.aa',...

Cause

The error seems to occur because the data folder in the root directory is missing, which could be because Git ignores empty folders.

Solution

To resolve the issue, simply add an empty data folder to the root directory. This should allow the script to run without encountering the "ValueError".