CorX Labs

The models we have made.

Everything CorX Labs releases is open-source and published on Hugging Face. Each model has a page here with what it is, what it can do, and where it stops.


Released

Available now

Released Text generation 158M params Apache 2.0

CorX1.5

A ~158M parameter decoder-only transformer, built entirely from scratch — architecture, tokenizer, pretraining and fine-tuning, all written and trained solo on a single GPU. Not a fine-tune of an existing base model.

Parameters
157.8M
Layers
10
Context
1,024 tokens
Vocabulary
32,768 BPE
Pretraining
~3B tokens
Licence
Apache 2.0
In training

More models are in progress.

CorX Labs is a working research lab, not a finished catalogue. New checkpoints and new models are published as they are ready — the release feed and the Hugging Face commit history are the fastest way to see what has changed.

Documentation

How these models are built.

The architecture choices, the three-stage training pipeline, the safety layer and the loading instructions — all in one place.