Tencent’s Hy4 flash weights available for download – standard version takes up about 440 gigabytes
The weights of Tencent’s Hy4 flash model can now be downloaded to your own hardware: the standard version takes up about 440 gigabytes, even though only about 12 billion parameters take part in computation per token. The licence requires the largest service providers to obtain separate permission.
Pandaily reported on 18 November, citing IT Home, that Tencent has released the weights of Hy4 flash. Tencent launched the model through its API two days earlier. Three versions are available for download: an instruction-tuned model, a version of it quantised to FP8, and a pretrained base model intended for further training.
Hy4 flash is a mixture-of-experts (MoE) model, so only part of the model’s networks process each token. Tencent’s GitHub page says that in each MoE layer a token activates 16 of 512 routed experts plus one shared expert used by all tokens. About 12 billion parameters take part in computation per token, out of 220 billion in total. The company’s website gives the total as 224 billion.
The number of active parameters reflects how much computation the model needs, but all the weights still have to be stored. Pandaily reported that the standard version’s weights take up about 440.5 gigabytes and the FP8 version’s about 287.1 gigabytes. The publication said these figures are not minimum GPU memory requirements and that quantisation does not make the model suitable for consumer hardware. Pandaily confirmed that the download can be started, but it did not download the full weights or run the model.
Tencent’s deployment instructions run the model on eight GPUs. Pandaily said the guide for the vLLM serving software starts the model with a context of 8,192 tokens. A 1 million-token context window therefore does not guarantee that every hardware setup can handle a context that long.
Pandaily noted that the Tencent Hy License 1.0 is not an Apache 2.0 licence. Separate written permission is required if a company offering the model as a service exceeds $50 million in worldwide revenue over 12 consecutive months, or if the model is used in a product or service with more than 100 million monthly users. Pandaily describes Hy4 flash as an open-weight model on Tencent’s terms.
The performance figures are Tencent’s own. In the company’s internal WorkIndex benchmark, Hy4 flash scored 42.1 points and Hy4 preview 39.7. Tencent said Hy4 flash’s average cost per task was 1/13 of Hy4 preview’s. For complex tasks such as long software development tasks, the company recommends the more capable Hy4.
The weights are available from Hugging Face, among other places. Through the API, the model costs $0.07 per million input tokens and $0.281 per million output tokens. Tencent Cloud TokenHub offers a 50 per cent discount on API prices until 30 November.
Read more: Models