encoder-only

Here are 4 public repositories matching this topic...

Burakkylmz / Encoder-Only-Transformer

Production-grade, test-driven encoder-only Transformer built from scratch with clean architecture and modular design.

nlp deep-learning transformers pytorch clean-architecture neural-networks educational from-scratch modular-design test-driven self-attention multi-head-attention transformer-architecture encoder-only

Updated May 10, 2026
Python

Rawbeew / stylometric-slm

Star

Cross-lingual authorship attribution as a fine-tuned small language model (mT5 encoder). 91.2% on full 705-passage eval. Two HF models, journal, corpus rebuild path.

nlp reproducibility authorship-attribution stylometry cross-lingual mt5 multilingual-nlp forensic-linguistics encoder-only

Updated Oct 1, 2026
Python

Cinqic / Juniper-Encoder

Star

Retired Cinqic research project exploring an encoder-only routing model. Preserved as a historical research archive; no model was released.

open-source machine-learning research juniper archived retired encoder-only cinqic

Updated Sep 15, 2026
Python

joaoajmatos / laya-sparse

Sponsor

Star

Scaling Laya's encoder models beyond 2K tokens with sparse attention. Pluggable attention variants, benchmarked against decoder scorers.

laya local-model encoder-only system-one-model

Updated Oct 3, 2026
Python

Add this topic to your repo

To associate your repository with the encoder-only topic, visit your repo's landing page and select "manage topics."

Learn more