What’s New and Important in CUDA Toolkit 13.0

 The newest update to the CUDA Toolkit, version 13.0, features advancements to accelerate computing on the latest NVIDIA CPUs and GPUs. As a major release, it lays the foundation for all future developments coming to the full CUDA 13.X software lineup. You can access these new features now.


This post highlights some of the new features and enhancements included with this release:


  • Building the foundation for tile-based programming in CUDA
  • Unification of the developer experience on Arm platforms, especially DGX Spark
  • Updated OS and platform support, including Red Hat Enterprise Linux 10
  • NVIDIA Nsight Developer Tools updates 
  • Math libraries linear algebra and FFT updates
  • NVCC Compiler updates, including an improved fatbin compression scheme, and support for GCC 15 and Clang 20
  • Accelerated Python cuda.core release and developer-friendly packaging
  • Feature-complete architectures 
  • Updated vector types with 32 byte alignment for increased performance on Blackwell
  • Support for Jetson Thor

Blackwell GPUs supported by CUDA 13.0 

The Blackwell architecture, first supported in CUDA Toolkit 12.8, continues to improve in performance and capability. CUDA 13.0 supports the latest Blackwell GPUs, including:

https://hackmd.io/@alexaa34/SkuOYdt1Ge

https://medium.com/@alexharris59600/whats-new-and-important-in-cuda-toolkit-13-0-a623a0cc2d26

  • B200 and GB200
  • B300 and GB300
  • RTX PRO Blackwell series
  • RTX 5000 series (GeForce)
  • Jetson Thor
  • DGX Spark

What’s in CUDA 13.0 beyond

Each new CUDA release delivers performance gains and improves programmability across the entire stack. From the beginning, CUDA has embraced a thread-parallel model using Single Instruction, Multiple Threads (SIMT). Now, with CUDA 13.0, we’re laying the foundation for a second, complementary model: tile-based programming.


Tile (or array) programming models are already common in many high-level languages, with Python being a prime example. When working with NumPy, you can apply simple, expressive commands to entire arrays or matrices, and the system handles the low-level execution. This abstraction boosts productivity by letting you focus on the what, not the how—designing performant algorithms without managing thread-level detail.


At GTC 2025, NVIDIA announced plans to bring this tile programming model to CUDA. This is a major step forward for developer productivity and hardware efficiency.


In the tile programming model, you define tiles of data and specify operations over those tiles. The compiler and runtime take care of distributing work across threads and optimizing hardware usage. This higher-level abstraction frees you from managing low-level thread behavior while still unlocking full GPU performance.


Crucially, the tile model maps naturally onto Tensor Cores. The compiler handles tile memory management and operation mapping, enabling programs written today to take advantage of current and future Tensor Core architectures. This ensures forward compatibility: Write once, run fast—now and on GPUs to come.


The tile programming model will be available at two levels:


  • High-level APIs and Domain-Specific Languages (DSLs) – Programmers can use tiles directly in Python, C++, and other languages.
  • Intermediate Representation (IR) – Compiler and tool developers can target a new CUDA Tile IR backend, allowing them to take advantage of the tile model’s performance and hardware features.

CUDA 13.0, as a major release, introduces low-level infrastructure changes necessary to support this model. While most changes are invisible to end users, they lay the groundwork for a new way of programming GPUs: one that combines ease-of-use with maximum performance and long-term portability.


Comments

Post a Comment

Popular posts from this blog

Microsoft adds Windows protections for malicious Remote Desktop files

Microsoft has introduced new Windows protections to defend against phishing attacks that abuse Remote Desktop connection (.rdp) files, adding warnings and disabling risky shared resources by default. RDP files are commonly used in enterprise environments to connect to remote systems because admins can preconfigure them to automatically redirect local resources to the remote host. Threat actors have increasingly abused this functionality in phishing campaigns. The Russian state-sponsored APT29 hacking group has previously used rogue RDP files to remotely steal data and credentials from victims. When opened, these files can connect to attacker-controlled systems and redirect local drives to the connected device, allowing the attacker-controlled device to steal files and credentials stored on disk. They can also capture clipboard data, such as passwords or sensitive text, or redirect authentication mechanisms like smart cards or Windows Hello to impersonate users https://hackmd.io/@alexaa...
Read more

How to write technical blog posts that people actually read?

 Applying recently learned knowledge is one of the best way to reinforce our learning. Turning around and teaching it to somebody else through technical blog post is excellent way to do it. Technical blogging is critical to early growth as a community. The motive of this article is not only to provide medium guidelines but also write technical blog posts that people will actually read. So, how to write such technical blog post? I have divided it into three major sections and we will discuss each one of them. Preparing raw content i.e. substance Tying up everything and packaging Publicizing i.e. making widely known Preparing raw content (Substance) Writing something that matters is challenging. We should do a lot of homework to create a quality content. Knowing the topic you’re writing about and what’s been already written about it is the first thing that’s required. After you are done with your homework, figure out what’s missing. You may feel that everything about the topic is wri...
Read more

Ultimate Guide to Activate YouTube on Smart TVs & Streaming Devices

Watching YouTube on a bigger screen is always more fun—movies, music videos, podcasts, and even your favorite creators come to life! If you’re setting up YouTube on your Smart TV, streaming stick, or gaming console, you’ll likely see an activation page asking you to visit yt.be/activate. Don’t worry — this guide will walk you through the process step-by-step and help fix any activation issues along the way. Let’s get started! https://www.bly.com/blog/general/the-virtue-of-modesty/ https://www.laserantitabac.pro/index.php/2023/04/28/les-addictions-un-probleme-de-sante-publique/ https://sirmaskafsoxila.gr/index.php/component/k2/item/1-lorem-ipsum-has-been-the-industry-s-standard-dummy-text-in-the-world What is yt.be/activate? yt.be/activate is the official YouTube activation website that lets you sign in to your Google account on a TV without typing long passwords using a remote. It connects your YouTube app on:  Smart TVs (Samsung, LG, Vizio, Sony, TCL, Hisense…)  Amazon Fire T...
Read more