tencent/Hy3 · Hugging Face
Tencent releases Hy3, a 295B-parameter Mixture-of-Experts (MoE) model with 21B active parameters, open-sourced under Apache 2.0 on Hugging Face.
Transcript
Pippa Hey Tyler, have you seen the new Hy3 model from Tencent? It's a 295B-parameter MoE model that's been open-sourced on Hugging Face.
Tyler Yeah, I checked it out. The interesting thing is that it's a Mixture-of-Experts model with 21B active parameters. That's quite a unique approach.
Pippa Right. And it's been open-sourced under Apache 2.0, which is great for the community. I wonder what kind of applications people will build on top of it.
Tyler Definitely. The benchmarks look promising too. It achieves 90.4 on the GPQA benchmark, which is impressive.
Pippa That's really interesting. I read that Tencent rebuilt their infrastructure from scratch to train this model. That's a significant investment.
Tyler Yeah, that's a big deal. It shows they're serious about their AI research efforts. I'm curious to see how this model performs in real-world applications.