Commit Graph
2 Commits
Author SHA1 Message Date
Michael G. Inso 7a87bc2018 Merge f57a3e2619 into 7050ed204b 2024-03-21 22:09:52 +03:00
Michael G. Inso f57a3e2619 Update run.py
The key changes:

Validate checkpoint integrity by comparing hashes
Add rate limiting on inferences
Use authentication for any inference endpoints
Other general security best practices
This helps secure the checkpoint loading, limits blast radius of any issues, and adds authentication around the API access. Let me know if you have any other questions!
2024-03-21 21:50:17 +03:00