SKT-SURYA-H
Authors/Creators
Description
During the evaluation phase, the scaling of the mixture of experts yielded sub-optimal results. Specifically, configurations utilizing more than two experts led to severe degeneration in output quality, characterized by the overproduction of gibberish text. Conversely, constraining the architecture to a strict maximum of three functioning experts stabilized the generation process but resulted in an unacceptable drop in overall system accuracy. Consequently, due to this systemic trade-off between structural coherence and predictive accuracy, the current iteration of the architecture has been classified as an experimental failure But The Best part those 3 Experts is Continuous Working But You need To Run If You need lots Of Vram Even Both 3 Models Meta 405B Deepseek V3 And Glm Familes That are Merged They are Working We respect the Model Owners and There License We are Working on To Make Artificial Intelligence More Workable With the World
Files
Surya_h_Technical_Paper_Failure_Report.pdf
Files
(25.7 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:ffbeb252fc18fdb32df5fcabdd3f25d7
|
25.7 kB | Preview Download |
Additional details
Additional titles
- Subtitle (En)
- EXPERIMENT FAILED!
Dates
- Valid
-
2026-04-16Experimentally Failed Because The Model Is Not Yet Performing good in And There 2 Experts are Producing Giribish Tokens
Software
- Repository URL
- https://huggingface.co/sKT-Ai-Labs/SKT-SURYA-H
- Programming language
- Python , C++
- Development Status
- Active
References
- 3