Repository navigation
Thor port: build and run on NVIDIA Jetson (non-AMD hosts) - #1
Closed
dcharlot65-openie wants to merge 1 commit into
Closed
dcharlot65-openie wants to merge 1 commit into
dcharlot65-openie wants to merge 1 commit into
Conversation
- npu: build as a no-op stub when AMD XRT headers are absent (npu_stub cfg); unchanged where XRT exists - kitten: portable dot4/sdpa_rows fallbacks for non-x86_64 (NEON via autovec) - vkrt: enable maintenance4 + vulkanMemoryModel(DeviceScope) device features (spec-required by our shaders; RADV tolerated the omission, NVIDIA does not) - jenergy: Rust energy recorder for Jetson INA3221/INA238 hwmon rails, same CLI/JSON as tools/energy/record.py - bench/devinfo: print vkrt DeviceInfo incl. supported coopmat configs - PORT_NOTES_THOR.md: lab notes - first Thor numbers (Nemotron 4B + 30B-A3B decode J/token vs llama.cpp CUDA) and known gaps Decode works and is correct on Thor; batched prefill (PF=1) still device-lost, narrowed by PF_PROBE bisect to coopMatLoad-fed MulAdd. See PORT_NOTES_THOR.md. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
|
Thank you for taking the time to open this! strix-rt is published read-only for now, so we don't merge pull requests and this one was closed automatically. It isn't a judgment of your change: we just can't review and maintain outside code yet. Issues are open for questions, reproduction reports and feedback, and forks are very welcome. Take whatever helps you save energy. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Makes the workspace build and run correct decode inference on an NVIDIA Jetson AGX Thor (Tegra T264, Blackwell CC 11.0, Vulkan 1.4, driver 595.78), while changing nothing on the Strix Halo box.
npu_stubcfg emitted by build.rs). With XRT present, byte-identical behavior.dot4/sdpa_rowsfallbacks for non-x86_64 (multi-accumulator scalar, LLVM autovec to NEON).maintenance4+vulkanMemoryModel(+DeviceScope) device features. Our SPIR-V already requires both (LocalSizeId from glslc, GL_KHR_memory_scope_semantics); RADV tolerated the omission, NVIDIA device-losts. Spec-compliance fix for all platforms.jrecord, a std-only Rust energy recorder for Jetson INA3221/INA238 hwmon rails with the same CLI and JSON shape astools/energy/record.py.Measured (Thor, decode, differential 256−16; details + logs in PORT_NOTES_THOR.md)
Correctness smoke: "The capital of France is" -> " Paris" top-1 by 4 logits (4B model).
Known gaps (documented, not fixed here)
🤖 Generated with Claude Code