GPU Performance Lab

CUDA puzzles and real GPU labs

Only for iPhone

Free · In‑App Purchases

iPhone

What's the most valuable developer skill in the AI era? We'd bet on making GPU code fast. It starts with CUDA: puzzles, then softmax and SwiGLU labs on real GPUs. GPUs are expensive, and AI runs on them. Teams that run their own models need developers who can make GPU code fast. That skill starts with CUDA. Take the first step on your phone: short CUDA puzzles, endless practice sets, then labs on real cloud GPUs that work up to softmax, SwiGLU and attention, the kernels inside LLMs. LAB PATHS: FROM A CPU LOOP TO LLM KERNELS 20 labs in 4 paths, all open on the free plan: • Elementwise Kernels: your first CUDA kernel, grid-stride loops, launch shape, coalescing, then a fused SwiGLU. • Reductions: atomics, a block tree and warp shuffles, up to stable and online softmax, the trick attention kernels are built on. • Matrix Multiplication: from a CPU loop to shared-memory tiling at N = 4096. • Decoder Block: RMSNorm, a packed QKV projection, RoPE, grouped-query attention and causal attention. Small sizes for teaching; no real model weights. HOW A LAB WORKS Put the kernel together from pieces, or pick the launch size, then tap "Run on a real GPU". The app checks your code first; only a build that checks out runs on a real cloud GPU, so you don't need a GPU of your own. The report card says Passed or Not yet, shows each goal as a bar or a tick, explains its numbers with a tap, and shows where the time went. Then you answer a few questions about your run. Labs need a free GPUFlight account: sign in with Apple, Google, GitHub or an email and password. The free plan includes 5 GPU runs a day and 500 credits a month for premium GPUs. THE NOTEBOOK: 14 SKILLS, 122 PUZZLES Each page asks one question: which element this thread works on, how many warps fit on the SM, which bank serves word 37. Pick an answer, tap a line of code, or type the number. Get it wrong and the page shows the right answer and why, and many pages then deal you another one like it. • Threads & Blocks, Rows & Columns, The Warp: how threads find their work, 32 at a time • Memory Lane, First Kernel, Occupancy, Branches: sectors, launches and which resource runs out first • Memory Ladder, Shared Banks, Working Together, Copy & Overlap: caches, bank conflicts, barriers, atomics and streams • PTX 101, Reading PTX, Optimizing with PTX: the same kernel closer to the hardware, line by line, up to FP8 on tensor cores Every skill opens with a short moving lesson. A calculator sits on every puzzle, practice problem and lab question that asks for a number. The notebook works offline and needs no account. PRACTICE SETS: ENDLESS INDEX ARITHMETIC Four sets at the back of the notebook that never run out: One row of threads, Rows and columns, Pitch and strides, 3-D and tensors. Every problem is new; type the numbers and see the steps and the line of C++. Three right in a row with no help masters a set. Free, offline, no account needed. PRACTICE SUBSCRIPTION (OPTIONAL) Practice removes the daily run cap and raises your monthly credits for premium GPUs from 500 to 1,000. It is an auto-renewable monthly subscription; the price is shown in the app in your local currency. • Payment is charged to your Apple Account when you confirm the purchase. • The subscription renews automatically unless it is cancelled at least 24 hours before the end of the current period. Your account is charged for renewal within 24 hours before the end of the current period. • Manage or cancel it in your Apple Account settings (Settings > your name > Subscriptions), or from "Manage subscription" on the app's plan page. • Deleting your GPUFlight account does not cancel an App Store subscription. Terms of Use (EULA): https://www.apple.com/legal/internet-services/itunes/dev/stdeula/ Privacy Policy: https://app.gpuflight.com/privacy CUDA is a trademark of NVIDIA Corporation. GPU Performance Lab is not affiliated with or endorsed by NVIDIA.

  • 5.0
    out of 5
    1 Ratings

• Practice sets: four endless sets of index arithmetic at the back of the notebook. A new problem every time. Get three right in a row with no help to master a set. Free, and they work offline. • Type the answer: many puzzles now ask you to type the number. You see the worked steps, right or wrong. • A calculator on every puzzle, practice problem and lab question that asks for a number, with round-up division (÷↑) for counting blocks. • PTX is now three skills: PTX 101 (25 puzzles), Reading PTX (21) and Optimizing with PTX (12). • A new lab report card: Passed or Not yet, a bar or tick for each goal, every number explained with a tap, and where the time went. • One "Run on a real GPU" button. It checks your code first, and only a build that checks out goes to the GPU. • If the app can't reach the server when it opens, it tries again when you come back to it.

The developer, GPUFlight, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy .

  • Data Linked to You

    The following data may be collected and linked to your identity:

    • Purchases
    • Contact Info
    • User Content
    • Identifiers

Privacy practices may vary, for example, based on the features you use or your age. Learn More

The developer has not yet indicated which accessibility features this app supports. Learn More

Seller
OFFLEASH LAB LLC
Size
6 MB
Category
Education
Compatibility
Requires iOS 17.4 or later.
  • iPhone
    Requires iOS 17.4 or later.
Languages
English
Age Rating
16+
In-App Purchases
Yes
Copyright
© 2026 Offleash Lab LLC