Commit Graph

3 Commits

Author SHA1 Message Date
Michael G. Inso
6ed2d78bea
re-formatting it to be more readable run.py
It looks like there were some formatting issues in the code. I've taken the liberty of re-formatting it to be more readable.
2024-03-26 12:24:32 +03:00
Michael G. Inso
f57a3e2619
Update run.py
The key changes:

Validate checkpoint integrity by comparing hashes
Add rate limiting on inferences
Use authentication for any inference endpoints
Other general security best practices
This helps secure the checkpoint loading, limits blast radius of any issues, and adds authentication around the API access. Let me know if you have any other questions!
2024-03-21 21:50:17 +03:00
Igor Babuschkin
be76c959fa Add initial code 2024-03-17 11:11:31 -07:00