The classroom·Open or closed models·Running a model on your own machine
Nothing leaves the building. Something has to run it.
On the call, we would ask
- Is there a document or a customer that must never leave your building?
- Who on the team could set up and maintain a server?
- How much quality would you trade for privacy?
- What is the job: one task at volume, or a general assistant?
In this unit: Open or closed models
- Running a model on your own machine
- What you give up with each
- Small models, and when they are enough