Inconsistency with download_country_covariates(), especially BrokenPipeError and "dataset not in manifest"

[alex-translation]

• wplib version: wpgpDownload 0.2.1
• Python version: 3.7
• Operating System: Ubuntu, Mac OS 11.6, or Google Colab

Description

• Downloading total population and age sex structures, at 100 m resolution, with UN adjusted constrained. For example, total population ("ppp_2020_UNadj_constrained") and males, age 0-1 ("agesex_m_0_2020_constrained_UNadj"). We are using download_country_covariates()
• This works inconsistently, with little discernible pattern. The same dataset will download perfectly fine one moment and then a little while later –– 30 minutes, 2 hours, or even an entire day –– and it will not work.
• The errors change regularly as well, with the main ones being BrokenPipeError , "timed out", and "dataset not in manifest". This last one seems particularly confusing, given that we run refresh_csv() just before attempting to download the dataset.
• We encounter the same issues when running a Jupyter Notebook (locally or on Google Colab), in a local .py file, or in a GitHub Action.

What I Did

- Commands: `dl(ISO=iso, out_folder='.', prod_name='ppp_2020_UNadj_constrained')`, `dl(ISO=iso, out_folder='.', prod_name='agesex_m_0_2020_constrained_UNadj')`
- Outputs: `BrokenPipeError: [Errno 32] Broken pipe`, 

[alex-translation]

Important lesson learned since posting -- wpgpDownload.utils. wpFtp seems to work just about every time, as long as you pass in a valid path. This can require some odd configuration, but once done, it works far more consistently.

[dbaldig]

I still can't get it running. I use to download the example from Greece but only get the "ValueError: None of the product(s) you have requested exist in the manifest". Even after updating wpgpDownload isos. Have you found a solution?