Skip to content

Conversation

@alecgunny
Copy link
Collaborator

Adding hyperparameter searching functionality. Closes #28 , closes #7 .

  • Find a way to fix logging. Maybe use TUNE environment variables in deepclean.logging to set up different files for each job.
  • How to pass best weights to export? Copy them to root weights.pt at end of training? Use tune library in export?
  • Save all HP runs to dedicated subfolder instead of having subfolders in root?
  • Publish all HP runs in analysis? Just best?

Longer term

  • Integration with typeo for more natural extension of training function without re-exposing all args
  • Extend architecturize wrapper to search function to simplify search for particular architectures

@alecgunny alecgunny added the hyperparameters Research topic about hyperparameters used to train DeepClean label Aug 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

hyperparameters Research topic about hyperparameters used to train DeepClean

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Shuffling produces empirically worse results Hyperparameter search

1 participant