Model Rollover Process
Why is this process important to me?
- The model rollover process allows us to account for recent changes in behavior. Actions from the past year and the impact on the outcomes could and should look different than what occurred three or five years ago. With a model rollover, we'll introduce the latest year of known outcome data to rebuild your models and most likely drop the oldest year of data previously used in training the model.
- This enhances model performance and the understanding of individual student behaviors.
Who is involved from your institution?
- Data stewards or your data team will add the outcomes to the standard files that are already sent to us.
- It can be as simple as providing the outcomes in the same fashion as in prior years, typically through Yes/No columns or dates flagging enrolled, retained, or graduated students.
- It's good practice to verify that the data reflects the outcomes validated by your institution, which may involve your core Othot team.
What is a model rollover again?
- Post-census day, institutions provide the known outcomes for the student populations that we have been predicting on over the last term or year.
- The most recent year of data (and associated outcomes) is then used by our data science team to inform and rebuild the models.
- This is part of our commitment to you to have the most performant and relevant models.
- If there are significant changes to your model based on the most recent year of data, you may receive a request for a model validation meeting prior to updating the model.
- Note: this process is intended to capture outcome data and rebuild your models. It's not a time to introduce new data. Additional updates should be planned separately with your Client Success Director and Data Curator.
When do I need to send the updated data?
- As soon as your data reflects the final outcomes post-census day, send that data to us, and let your Client Success Director know it's complete.
- We complete the model rollover process in order of data received from our clients.
- While we make every effort to expedite completion of this process, your help is required to make that happen.
Where do I send the data?
- Follow the same process as you have throughout the year, whether it's sending files through the platform or uploading through your institution's SFTP site.