Skip to main content

Back to open source

Model architecture

MoE-Xtend

Context unbound. Intelligence unleashed.

View the source(opens in a new tab)

Python

Long-context mixture-of-experts transformers.

Open source Next project: INFINICHUNK