Skip to content

[HWORKS-3465] Add Factories for Fine-Tuning, Deployment, Generic - #704

Open
jimdowling wants to merge 4 commits into
logicalclocks:mainfrom
jimdowling:HWORKS-3465
Open

jimdowling wants to merge 4 commits into
logicalclocks:mainfrom
jimdowling:HWORKS-3465

Conversation

@jimdowling

@jimdowling jimdowling commented Oct 17, 2026 •

Copy link
Copy Markdown
Contributor

JIRA: HWORKS-3465

Adds a built-in LLM fine-tuning (LoRA) factory, a single-host fine-tuning environment (lora-fine-tuning-torch) and a Ray RL post-training environment (rl-post-training), moves every Ray environment to Ray 2.59.0, and retires the Ray TensorFlow and TensorFlow training environments (environments cloned from them keep working; tensorflow-inference-pipeline stays for TensorFlow Serving). The Terminal gets w9s, an overview of the project's factory systems, and the Factory chat no longer gets out of step with the Terminal. Deployment and Generic factories follow in a later change.

Related PRs: docker-images, hopsworks-ee, hopsworks-helm, hopsworks-front, hopsworks-api, loadtest

Merge order: docker-images first (it publishes the images the backend and chart name), then hopsworks-ee, hopsworks-helm, hopsworks-front, hopsworks-api, docs, loadtest.

This PR

  • Lists the new environments, drops the TensorFlow training environment, and updates the configuration reference for the rl-post-training setting and the Ray version.

Testing

  • hopsworks-docs markdownlint and the strict hopsworks-docs check build.

Loadtests

Run on a dev cluster (5.3.0-SNAPSHOT, Ray on) with this backend, frontend and chart DML deployed, as in-cluster loadtest Jobs from loadtest#1188:

  • Run 1, 28/28 passed: workflows/model_training (test_finetune_envs, test_train torch and TensorFlow), test_factories (7), test_environment, test_ray_job_execution (4), test_proxy_terminal (2), test_terminal_proxy_token (3), test_proxy_raydashboard (7).
  • Run 2, after pushing the images rebuilt from this branch on the current *-5.3.0-SNAPSHOT parents (ray-training-pipeline, ray-torch-training-pipeline, rl-post-training, lora-fine-tuning-torch, tensorflow-inference-pipeline, terminal-server, terminal-gpu, terminal-spark): 14/14 passed, the image-dependent subset (workflows/model_training, test_environment, test_ray_job_execution, the two Terminal proxy modules).

🤖 Generated with Claude Code

https://hopsworks.atlassian.net/browse/HWORKS-3465

The Factory had no way to fine-tune a foundation model, and the base
environments had no fine-tuning or RL post-training stack. Add a
built-in LLM fine-tuning (LoRA) factory, a single-host fine-tuning
environment and a Ray RL post-training environment, move every Ray
environment to Ray 2.59.0, and retire the Ray TensorFlow and
TensorFlow training environments (environments cloned from them keep
working). Working from the Terminal gets w9s, an overview of the
project's factory systems, and the Factory chat stops getting out of
step with the Terminal. Deployment and Generic factories follow.

The docs list the new environments, drop the TensorFlow training
environment, and update the configuration reference for the
rl-post-training setting and the Ray version.

Signed-off-by: Jim Dowling <jim@logicalclocks.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@jimdowling
jimdowling marked this pull request as ready for review October 23, 2026 15:24

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant