[WIP] Skip tests using managed memory if CU_DEVICE_ATTRIBUTE_CONCURRENT_MANAGED_ACCESS == 0

[rwgk]

Closes nvbug 5815123

Background: #1539

This PR will have two stages: 1. identify the tests we need to skip, 2. add the skips

[copy-pr-bot]

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

[rwgk]

The temporary commit bddca29 is a trick to identify the tests we need to skip.

Full build and test logs (internal access only);

/home/scratch.rgrossekunst_sw/logs_mirror/smc120-0009.ipp2a2.colossus/logs/cuda-python_qa_bindings_linux_2026-02-04+145720_build_log.txt
/home/scratch.rgrossekunst_sw/logs_mirror/smc120-0009.ipp2a2.colossus/logs/cuda-python_qa_bindings_linux_2026-02-04+150226_testslog.txt

smc120-0009.ipp2a2.colossus.nvidia.com:/wrk/forked/cuda-python $ grep -a '^FAILED ' /home/scratch.rgrossekunst_sw/logs_mirror/smc120-0009.ipp2a2.colossus/logs/cuda-python_qa_bindings_linux_2026-02-04+150226_testslog.txt
FAILED tests/memory_ipc/test_serialize.py::TestObjectPassing::test_main[DeviceMR] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_serialize.py::TestObjectPassing::test_main[PinnedMR] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_serialize.py::TestObjectSerializationDirect::test_main[DeviceMR] - AssertionError: assert 1 == 0
FAILED tests/memory_ipc/test_serialize.py::TestObjectSerializationDirect::test_main[PinnedMR] - AssertionError: assert 1 == 0
FAILED tests/memory_ipc/test_serialize.py::TestObjectSerializationWithMR::test_main[PinnedMR] - AssertionError: assert 1 == 0
FAILED tests/memory_ipc/test_serialize.py::TestObjectSerializationWithMR::test_main[DeviceMR] - AssertionError: assert 1 == 0
FAILED tests/memory_ipc/test_memory_ipc.py::TestIPCSharedAllocationHandleAndBufferObjects::test_main[DeviceMR] - AssertionError: assert 1 == 0
FAILED tests/memory_ipc/test_memory_ipc.py::TestIPCSharedAllocationHandleAndBufferObjects::test_main[PinnedMR] - AssertionError: assert 1 == 0
FAILED tests/memory_ipc/test_memory_ipc.py::TestIPCSharedAllocationHandleAndBufferDescriptors::test_main[DeviceMR] - AssertionError: assert 1 == 0
FAILED tests/memory_ipc/test_memory_ipc.py::TestIPCSharedAllocationHandleAndBufferDescriptors::test_main[PinnedMR] - AssertionError: assert 1 == 0
FAILED tests/memory_ipc/test_memory_ipc.py::TestIPCMempoolMultiple::test_main[DeviceMR] - AssertionError: assert 1 == 0
FAILED tests/memory_ipc/test_memory_ipc.py::TestIPCMempoolMultiple::test_main[PinnedMR] - AssertionError: assert 1 == 0
FAILED tests/memory_ipc/test_memory_ipc.py::TestIpcMempool::test_main[PinnedMR] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_memory_ipc.py::TestIpcMempool::test_main[DeviceMR] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_workerpool.py::TestIpcWorkerPoolUsingIPCDescriptors::test_main[3] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_workerpool.py::TestIpcWorkerPoolUsingIPCDescriptors::test_main[1] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_workerpool.py::TestIpcWorkerPool::test_main[3] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_workerpool.py::TestIpcWorkerPool::test_main[1] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_workerpool.py::TestIpcWorkerPoolUsingRegistry::test_main[1] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_workerpool.py::TestIpcWorkerPoolUsingRegistry::test_main[3] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_send_buffers.py::TestIpcSendBuffers::test_main[1] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_send_buffers.py::TestIpcSendBuffers::test_main[3] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_send_buffers.py::TestIpcReexport::test_main[PinnedMR] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/memory_ipc/test_send_buffers.py::TestIpcReexport::test_main[DeviceMR] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-int16--1] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-bytes-2-bad-size] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-float64-err] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-bytes-4] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-uint32-0xFFFFFFFF] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_copy_to - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-uint16-0x1234] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-int8--1] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_copy_from - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_external_managed[True] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-bytes-0] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-int32-max] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-int16-max] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_external_managed[False] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-int32-min] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-int16-min] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-bytes-1] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_dunder_dlpack_device_success[DummyUnifiedMemoryResource-expected2] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-bytes-3] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-int8-127] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-uint8-255] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-bytes-2] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-float32-1.0] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-int-1000] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-uint32-bad-size] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-uint8-0] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-int8--128] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-uint64-err] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-int-256] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-int32--1] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_close - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-int-0x42] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-uint16-bad-size] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-uint16-0xFFFF] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-bytes-4-bad-size] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-int64-err] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-bad-type-str] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-np-uint32-0xDEADBEEF] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_initialization - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_memory.py::test_buffer_fill[unified-int-neg] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_helpers.py::test_patterngen_seeds - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_helpers.py::test_patterngen_values - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_helpers.py::test_latchkernel - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_graph_mem.py::test_graph_alloc[fill-thread_local] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_graph_mem.py::test_graph_alloc_with_output[thread_local] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_graph_mem.py::test_graph_alloc[fill-no_graph] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_graph_mem.py::test_graph_alloc[fill-relaxed] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_graph_mem.py::test_graph_alloc_with_output[global] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_graph_mem.py::test_graph_alloc[incr-global] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_graph_mem.py::test_graph_alloc[fill-global] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_graph_mem.py::test_graph_alloc[incr-no_graph] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_graph_mem.py::test_graph_alloc[incr-relaxed] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_graph_mem.py::test_graph_alloc_with_output[relaxed] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'
FAILED tests/test_graph_mem.py::test_graph_alloc[incr-thread_local] - AttributeError: module 'cuda.bindings.driver' has no attribute 'cuMemAllocManaged'

[rwgk]

I backed out the band-aid change made with PR #1567 (commit 85f76f5) because it could later mask if we miss skips.

Cursor-generated skips (commit b9f8452) pass local testing, with the MANUALLYDISABLEDcuMemAllocManaged commit bddca29 intentionally still in place.

Running the CI to see if we still have tests that depend on cuMemAllocManaged but only run on platforms other then my dev workstation.

[rwgk]

/ok to test

[github-actions]

Doc Preview CI
🚀 View preview at https://nvidia.github.io/cuda-python/pr-preview/pr-1576/
https://nvidia.github.io/cuda-python/pr-preview/pr-1576/cuda-core/
https://nvidia.github.io/cuda-python/pr-preview/pr-1576/cuda-bindings/
https://nvidia.github.io/cuda-python/pr-preview/pr-1576/cuda-pathfinder/
Preview will be ready when the GitHub Pages deployment is complete.