Pular para o conteúdo
Kitbay
Skill

cuda-streams

NOASSERTIONAtualizado em 11 de nov. de 2026105.390Estrelas no GitHub

A contributor skill in the PyTorch repository about tensor lifetimes when a tensor is used on a CUDA stream other than the one that allocated it.

O que a skill ensina

A contributor skill in the PyTorch repository about tensor lifetimes when a tensor is used on a CUDA stream other than the one that allocated it. Because PyTorch's caching allocator only reuses memory on the allocating stream, cross-stream use needs either an explicit sync back to that stream, which is predictable and preferred, or record_stream, which ties memory reuse to GPU progress and can raise memory use. The skill sorts cases into avoidable, unavoidable with the current API, worth a redesign and hard to avoid, and asks that every record_stream call carry a comment explaining why the free point cannot be controlled.

O que faz

Não informado na documentação