Learn from the model worker, keep up with the model worker!