Skip to content

RTX 5070 (GB205): Xid 62 PMU halt on plain idle → GSP task watchdog loop (partition 4#0, task 3), unrecoverable; 610.57.04 open, Wayland #1307

Description

@OK1BR

NVIDIA Open GPU Kernel Modules Version

610.57.04 (Arch Linux packages: nvidia-open-dkms 610.57.04-1, nvidia-utils 610.57.04-1)
GSP Firmware Version: 610.57.04

Please confirm this issue does not happen with the proprietary driver (of the same version)

Not tested. Blackwell (GB205) requires the open kernel modules; the Arch repositories ship
nvidia-open-dkms only for this GPU. I can test the proprietary .run driver on request,
but reproduction is not yet deterministic (see Bug Incidence).

Operating System and Version

Arch Linux (rolling), GNOME 50.4 on Wayland (mutter 50.4-1, gnome-shell 1:50.4-1)

Kernel Release

Linux 7.1.8-arch1-3 x86_64

Please confirm you are running a stable release kernel

Yes — stable Arch linux package, non-rc.

Hardware: GPU

  • NVIDIA GeForce RTX 5070 (GB205), PCI 0000:02:00.0, board by MSI (1462:5323)
  • GPU UUID: GPU-e28eda47-3076-0250-f1c0-658c19763956
  • VBIOS: 98.05.28.00.30, 12 GB VRAM
  • Resizable BAR enabled (BAR1 = 16 GB)
  • CPU: Intel Core Ultra 7 265 (Arrow Lake) — i915 iGPU present and bound, no display attached to it
  • Board: ASRock Z890 LiveMixer WiFi, BIOS 3.21 (2026-01-28)
  • Single display on the NVIDIA GPU (DP-3). Kernel cmdline includes nvidia_drm.modeset=1.

Describe the bug

The GPU's PMU halts while the system is idle, and the GSP never recovers. The desktop
freezes permanently; the rest of the system keeps running normally.

Sequence (2026-08-19, all times CEST):

21:48:01.130  Xid 62 — 324c1547 0000ca08 00000000 20726198 20725344 207254b2 207237b4 20723fa4
21:48:01.130  _kgspRpcGspEventPmuHalted: Received signal from GSP that PMU has halted.
21:48:01.130  Xid 154 — GPU recovery action changed from 0x0 (None) to 0x1 (PF FLR)
21:48:05.029  Reset required [NV_ERR_RESET_REQUIRED] @ gpu_user_shared_data.c:647 / :717
21:48:06.127  kgspHealthCheck_TU102: GSP-CrashCat Report
              GSP task watchdog timeout @ pc:0x1b66396, partition:4#0, task:3, gfid: 0
21:48:08.614  krcWatchdog_IMPL: RC watchdog: GPU is probably locked!
21:48:31.182  Xid 45 — pid=<player>, name=showtime, channel 0x0000000f / 0x00000010
21:48:57.656  Xid 109 — channel 0x00000002, errorString CTX SWITCH TIMEOUT, Info 0x14001

Three points that I believe narrow this down:

1. The PMU halt precedes the GSP watchdog by 5 seconds. The GSP task did not fault on its
own — it was spinning waiting on a PMU that had already stopped. The primary failure is in the
power management unit, not in the graphics path.

2. Recovery is deterministic and always fails identically. The GSP-CrashCat report repeated
8 times at exactly 154-second intervals (21:48:06, 21:49:06, 21:51:40, 21:54:14, 21:56:49,
21:59:23, 22:01:58, 22:04:32) until I power-cycled the machine. Every single one reported
partition:4#0, task:3 and scause:0x8000000000000005 (supervisor timer interrupt), with the
faulting PC clustered in one region: 0x1b661c8 (×3), 0x1b66396, 0x1b663ee, 0x1b6646a,
plus 0x1ba7458 and 0x109d514.

3. The PC trace shows a tight two-address loop. The captured trace alternates between
0x1b6637e and 0x109d51a for its entire depth, terminating at 0x109d45e / 0x1b66354.
This looks like a bounded poll/handshake loop with no timeout on the PMU-response path — the
task spins until the watchdog timer fires, and the retry lands in the same loop every time.

Trigger conditions — idle, not load, not thermal:

The machine had played local video via NVDEC for roughly one hour, then sat idle. The last
video was paused at 21:14:50 and the crash came at 21:48:01 — 33 minutes later, with no user
input and no GPU work in between.
The player process was still alive and still holding its
decoder channels open; the subsequent Xid 45 teardown named showtime (3 channels) and
multiqueue0 (8 channels, GStreamer). So the GPU spent 33 minutes attempting idle power-state
transitions with decoder contexts still allocated.

This is explicitly not the thermal variant reported elsewhere in #1045:

  • no thermal event of any kind in the kernel log
  • HW Thermal Slowdown / SW Thermal Slowdown never fired
  • workload before the freeze was light video decode, card was nowhere near its 250 W limit

Hardware is clean (verified after reboot): 0 correctable and 0 uncorrectable ECC errors,
no retired pages, no remapped rows, PCIe link at full 32 GT/s x16, DevSta reports no
CorrErr/NonFatalErr/FatalErr/UnsupReq, zero MCE and zero AER events in the entire boot.
The filesystem survived the hard power-off without errors. All NVreg parameters are at their
compiled-in defaults (EnableGpuFirmware=0x12, DynamicPowerManagement=3,
PreserveVideoMemoryAllocations=2) — nothing is overridden on this system.

The rest of the system stayed fully alive. Scheduled jobs kept running and journald kept
writing for the entire 17 minutes between the freeze and the power-off; the kernel logged a USB
keyboard re-enumeration at 22:04:53 while the screen was already dead. Only the GPU was gone.
Because the session is Wayland with nvidia_drm.modeset=1, this also takes down every VT, so
there is no way to reach a console — a hard power-off is the only exit.

Full first GSP-CrashCat report (all 8 are structurally identical)
NVRM: GPU0 kgspHealthCheck_TU102: ****************************** GSP-CrashCat Report *******************************
NVRM: GPU0 kgspPrintGspBinBuildId_IMPL: GSP bin buildId: 4f09703c5c7d57baa527d6a189bb6d118bc60e49
GSP task watchdog timeout @ pc:0x1b66396, partition:4#0, task:3, gfid: 0
NVRM:     Reported by libos partition:4#5 kernel v3.1 [0] @ ts:47545
NVRM:     RISC-V CSR State:
NVRM:         sstatus:0x0000000200000020  sscratch:0xffffffffa3013970     sie:0x0000000000000220  sip:0x0000000000000020
NVRM:         sepc:0x0000000001b66396     stval:0x0000000000000000  scause:0x8000000000000005
NVRM:     RISC-V GPR State:
NVRM:         ra:0x0000000001b66382   sp:0x00000005f840f140   gp:0x0000000000000000   tp:0x00000005f8800000
NVRM:         a0:0x0000000000000001   a1:0x00000005f15a3770   a2:0x00000000000000c9   a3:0x000000000000001b
NVRM:         a4:0x0000000000000007   a5:0x000000000000001d   a6:0x001fffffffffffff   a7:0x0000000000000000
NVRM:         s0:0x00000005f840f220   s1:0xffffffffffffffff   s2:0x0000000000000001   s3:0x00000000041d3f50
NVRM:         s4:0x00000005f1392090   s5:0x00000000203b39e8   s6:0x00000005f840f230   s7:0x000000000000003e
NVRM:         s8:0x0000000001582796   s9:0x000000000418ff68  s10:0x00000000203b39d0  s11:0x0000000000003000
NVRM:         t0:0x0000000000000005   t1:0x0000000000000003   t2:0x0000000000000000   t3:0x001fffffffffffff
NVRM:         t4:0x81052206c0820000   t5:0x00000000079c38c1   t6:0x0000000000000010
NVRM:     Stack Trace:
NVRM:         0x0000000001b66396
NVRM:         0x0000000001582796
NVRM:         0x0000000001b66d90
NVRM:         0x0000000001b91a04
NVRM:         0x000000000173d8ea
NVRM:         0x0000000001723558
NVRM:         0x0000000001723936
NVRM:         0x000000000143f912
NVRM:         0x0000000001422ece
NVRM:         0x000000000183fa74
NVRM:         0x000000000183ffdc
NVRM:         0x000000000184746a
NVRM:         0x0000000001b5de46
NVRM:         0x0000000001b6f7ae
NVRM:         0x0000000001b6fcce
NVRM:         0x0000000001b08cfa
NVRM:         0x0000000001836b8a
NVRM:         0x00000000018384f0
NVRM:         0x0000000001834c1e
NVRM:         0x0000000001581fa4
NVRM:         0x0000000001b9bcb8
NVRM:         0x0000000001b9c056
NVRM:         0x0000000001aa8dd0
NVRM:         0x0000000001c0530c
NVRM:         0x0000000001a9e486
NVRM:     PC Trace:
NVRM:         0x0000000001b66396  0x000000000010013e  0x0000000001b66396  0x000000000109d51a  0x0000000001b6637e
NVRM:         0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a
NVRM:         0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e
NVRM:         0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a
NVRM:         0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e
NVRM:         0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a
NVRM:         0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e
NVRM:         0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a
NVRM:         0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e
NVRM:         0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a
NVRM:         0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e
NVRM:         0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a  0x0000000001b6637e  0x000000000109d51a
NVRM:         0x0000000001b6637e  0x000000000109d45e  0x0000000001b66354
NVRM:     Local I/O Register State:
NVRM:         0x01450800:0x00000000   0x01450900:0xbadf5100   0x01450a00:0x00000000   0x01450c00:0x00000000
NVRM:         0x01454a00:0x810490d2   0x01454b00:0x010800d0   0x01454c00:0x00080000   0x01400200:0x00000000
NVRM:     ------------[ end crash report ]------------

To Reproduce

  1. Arch Linux, GNOME 50 Wayland, single display on the NVIDIA GPU, nvidia_drm.modeset=1.
  2. Play local video decoded through NVDEC (GStreamer 1.28.6 via GNOME Showtime).
  3. Pause the video and leave the player open — decoder channels stay allocated.
  4. Leave the machine completely idle. GNOME blanking and suspend are both disabled
    (idle-delay=0, sleep-inactive-ac-type='nothing'), so this is plain idle, not DPMS or S3.
  5. After ~30 minutes the PMU halts and the display freezes permanently.

Bug Incidence

Once so far. This is the first occurrence across 14 boots — the preceding 13 boots
(2026-08-08 through 2026-08-19, including 10 boots on this same 610.57.04 driver) logged
zero Xid events. I cannot yet reproduce on demand and will report back if it recurs.

nvidia-bug-report.log.gz

Not attached — the machine has been rebooted, so a log captured now would not contain the GPU
state at failure time. The complete first GSP-CrashCat report (full RISC-V CSR/GPR state, stack
trace, PC trace, local I/O register state) is inlined above; all 8 repetitions are structurally
identical, differing only in the faulting PC. I have the full kernel journal from the failing
boot (1159 NVRM lines) and can attach it, or provide nvidia-bug-report.log.gz from the next
occurrence if that is more useful.

More Info

Possibly related, all still open:

Things reported as ineffective in #1045, which I have therefore not tried: disabling ASPM
(already disabled on this board), persistence mode, lowering the power limit, driver downgrade
(the same chain is documented on 580, 590, 595 and 610), and reinstalling linux-firmware.
NVreg_EnableGpuFirmware=0 is not an option on Blackwell.

Happy to run any instrumented driver build, enable additional GSP logging, or test a candidate
fix — the machine is a daily driver, so I will hit idle conditions constantly.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions