What does “pretraining” mean?
-
noun
Training done before main training or use, especially for models or systems.
The model improves quickly during pretraining before fine-tuning on a specific task.
-
noun
The phase of giving learners some initial practice before the main course.
Pretraining helps new staff learn the basics before actual work.
Often used as
- during pretraining phase
- pretraining data set
- the pretraining stage
Related words and nuances
- preparation
- training
- education
- development
- condition
- instruction