TRUEOS RDP input

On Ubuntu, install the runtime dependencies before launching:

sudo apt install ffmpeg libxkbcommon-x11-0

FFmpeg decodes video; libxkbcommon-x11-0 is required by the X11 window backend, including in NoView mode.

StartCenter launches target/release/trueos-rdp -NoView.

Ctrl+Space toggles local center-snap. Space press, repeat, and release are consumed by the shortcut; the combo is not forwarded to TRUEOS. Ctrl still works normally with other keys.

The default capture mode hides the local pointer, shows a centered marker in the input-only window, and sends differences between successive window cursor positions using the existing relative tablet protocol. It does not grab or warp the compositor pointer. This supports absolute input from nested RDP. The first position after capture/entry is only a baseline, avoiding a jump. Motion is limited to positions delivered inside the window; this is not an unlimited relative mouse lock. Ctrl+Space releases the visual snap.

In the laptop → Remmina → Ubuntu → TRUEOS chain, the laptop pointer remains owned by the outer Remmina session. Inner-window confinement does not capture that pointer or create unlimited relative motion. Native Wayland confinement was tested: packets continued, but it did not solve the outer-pointer limit, so that experiment was removed. True relative capture needs support at the outer client and along the input transport.

For a physical mouse with genuine relative input, launch with --raw-capture to use compositor capture and winit raw mouse deltas. Do not infer relative input just from DeviceEvent::MouseMotion: winit 0.30.13's X11 backend assumes XInput raw valuators are relative, including the absolute positions observed in GNOME/Remmina. In live testing, the grab also stopped further motion.

Input diagnostics are written to $XDG_STATE_HOME/trueos-rdp/input.log, or ~/.local/state/trueos-rdp/input.log. This works even though StartCenter discards stderr. Each record includes the process ID. Inspect them with:

tail -f ~/.local/state/trueos-rdp/input.log

Ctrl+Space consumed locally confirms the shortcut. input capture=true counts incoming raw and cursor events once per second, including zero-event intervals. UDP sent tablet-delta records successful local UDP sends (first five and every hundredth packet); it does not prove receipt by TRUEOS.

Build and verify with cargo test and cargo build --release, then relaunch the RDP tool from StartCenter to load the rebuilt executable.

To measure the real UDP receiver and ffmpeg decoder without a graphical window:

cargo run --release --example media-probe -- 192.168.178.94 40

The probe subscribes from an ephemeral local UDP port and prints cumulative access units, decoded frames, datagrams, and receiver anomalies once per second. The rate is IP/UDP traffic in Mbps, excluding Ethernet framing. Anomalies include gaps, reordered or duplicate datagrams, and reassembly skips; they are not an exact packet-loss count. Run a single video subscriber at a time, and allow time for the rig's previous stream session to finish before comparing active samples. The viewer logs the effective receive buffer at startup; the operating system may clamp the 1 MiB request or include additional accounting in the reported size.

On older Intel Haswell GPUs (for example HD Graphics 4600), Mesa may report Vulkan conformance version 0.0.0.0. wgpu hides these adapters by default, even when vulkaninfo detects them. To test the viewer with such an adapter, build the updated executable and launch it directly from the repository:

WGPU_ALLOW_UNDERLYING_NONCOMPLIANT_ADAPTER=1 ./target/release/trueos-rdp

This opts into an incompletely supported driver; rendering may still fail or show artifacts. If startup fails, capture the terminal's adapterlibgfx renderer startup error message.

The Linux build includes Vulkan and native OpenGL/GLES. Both are considered by default, so a GPU hidden by Vulkan can still be selected through OpenGL. The OpenGL path uses presentation-only limits and draws uploaded frames into the window rather than requiring direct swapchain texture uploads. To force OpenGL when diagnosing driver problems:

WGPU_BACKEND=gl ./target/release/trueos-rdp

The terminal's adapterlibgfx desktop selected line identifies the selected backend and GPU. OpenGL uses the system EGL/GL driver; no browser is bundled.