AMajor/grok-1
1
0
Fork 0
mirror of https://github.com/xai-org/grok-1.git synced 2024-11-24 12:39:54 +03:00
Code Issues Packages Projects Releases Wiki Activity
10 Commits 2 Branches 0 Tags 1.6 MiB
6fd75b4340
Commit Graph

2 Commits

Author SHA1 Message Date
Jacob-Junqi Tian
6fd75b4340
Implemented automated broadcasting in weight rescale when number of model shards is less than number of experts. 2024-03-21 17:23:45 -04:00
Igor Babuschkin
be76c959fa Add initial code 2024-03-17 11:11:31 -07:00