KRMU AI Centre of Excellence

GPU-accelerated AI, in your browser

Powered by NVIDIA DGX Spark and Kubernetes, the KRMU AI Centre of Excellence provides a centralized, GPU-accelerated environment for AI research, development and experimentation.

CPU and GPU notebooks Shared NVIDIA GB10 GPU pool 30 concurrent GPU users tested No setup, just a browser
GB10 NVIDIA
Infrastructure

Three DGX Spark nodes, one GPU pool

Three NVIDIA DGX Spark nodes, each with an NVIDIA GB10 GPU, are joined into one Kubernetes cluster. Notebook sessions are placed across the nodes and share the GPU resources.

Kubernetes: scheduling notebooks across the cluster GB10 GPU DGX Spark node 1 GB10 GPU DGX Spark node 2 GB10 GPU DGX Spark node 3 MLflow tracking Object storage (S3) Archive storage (NAS)
Accounts and GPU access

40 accounts, two kinds of GPU access

All 40 platform accounts have been created. Standard accounts get a fixed compute allocation, and super-user accounts can draw more from the shared GPU pool.

32 standard users (fixed compute)8 super users (more GPU from the shared pool)
Account typeAccountsGPU compute
Standard user32Fixed compute allocation: one logical GPU allocation in the GPU notebook (up to 4 CPU cores and 16 GiB RAM)
Super user8Can use as much GPU compute as is available in the total shared pool at the time
Shared pool: the GPUs are shared by everyone, so speed depends on how many people are working at the same time and GPU memory is not reserved per user.
Get started

Get started in three steps

Your account has already been created. There is nothing to register: use the username and password provided to you by your platform administrator.

01

Open the login page

The login address for the KRMU AI platform is provided by KRMU IT. Open it in your web browser.

02

Sign in

Enter the username and password provided to you by your platform administrator.

03

Choose a notebook

Select a CPU or GPU notebook profile to start your workspace.

New users: if you do not have an account yet, use Sign up on the login page. New accounts must be approved by an administrator before notebook access is enabled, so check back later or contact your platform administrator if sign-in says your account is not approved yet.

Sign in to the platform

Choose your workspace

CPU notebook or GPU notebook

When you start your server you pick one of two profiles. Use the CPU notebook for coding, data work and small experiments, and the GPU notebook for deep learning.

ProfileResourcesBest for
CPU NotebookUp to 2 CPU cores · 8 GiB RAM · 20 GiB workspacePython programming, data analysis, preprocessing and lightweight ML workloads
GPU NotebookUp to 4 CPU cores · 16 GiB RAM · 1 logical GPU allocation · 20 GiB workspacePyTorch, deep learning, model training and GPU-accelerated computation
About the GPU allocation: the GPU profile requests one logical GPU resource. It is not a dedicated physical GPU per student: the NVIDIA GB10 devices are shared between notebooks.
  • Your workspace keeps your files between sessions (20 GiB capacity).
  • An archive of your work is available read-only in the archive folder of your workspace.
  • A PyTorch environment with CUDA support is ready to use in the notebook.
Validated

Tested with 30 users at the same time

We started 30 GPU notebook sessions together and ran a continuous GPU workload in all of them for 10 minutes.

30GPU notebooks running together
0failures during the 10-minute run
3 saverage time to start a session (5 s slowest)
~204TFLOPS combined, steady throughout
GPU throughput (TFLOPS) of each of the 30 users during the test. Bars are grouped by the GPU they shared: two GPUs carried 12 users each and one carried 6.

Measured with a synthetic GPU benchmark (large matrix multiplications) on the three DGX Spark GPUs. TFLOPS means trillions of operations per second. Each session received a steady share of the GPU, roughly 5 to 12 TFLOPS depending on how many sessions shared the same GPU. Real workloads will differ; this shows how the platform behaves under heavy simultaneous use.

Under the hood

How the system works

From your browser to the GPU, in six parts.

Your browserSign in from any device
JupyterHubAccounts, approval, notebook profiles
KubernetesPlaces your notebook and allocates CPU, memory and GPU
GB10 GPUShared NVIDIA GPU resources

MLflow tracking

Records experiments, parameters and metrics so you can compare runs.

Object storage

S3-compatible storage for datasets and model artifacts.

Archive storage

NAS-backed archive of your workspace, readable from your notebook.

Sharing the GPU

Help everyone get the most from the GPU

The GPU pool is shared by all users. A few habits keep it useful for everyone.

Stop your server when you're done

Use File → Hub Control Panel → Stop My Server. Your files are kept. Inactive notebook sessions may also be stopped automatically to make compute resources available to others.

Use the CPU notebook for non-GPU work

Writing code, cleaning data and reading results do not need a GPU. Start the GPU notebook only when you train or run models.

Keep batch sizes moderate

GPU memory is shared and not reserved per user. Start small and increase gradually.

Don't leave jobs running

Stop loops and training runs you no longer need so others can use the GPU.

Questions

Frequently asked questions

Will my work be lost if I log out?
No. Your notebook workspace uses persistent storage, so your files are still there when you sign in again. Saved workspace files remain available according to the platform storage policy.
Can other students see my work?
No. Each user has an isolated notebook workspace.
What is the difference between standard and super-user accounts?
Standard accounts (32) have a fixed compute allocation. Super-user accounts (8) can use as much GPU compute as is available in the total shared pool.
I can't sign in
Check the username and password you were given, or ask your platform administrator. If you signed up yourself, your account must be approved by an administrator before notebook access is enabled.
What if I run out of GPU memory?
Restart your kernel (Kernel → Restart) and try again with smaller settings, such as a smaller batch size. GPU memory is shared, so it can be tight when many people use the GPU at once.
How long does training take?
It depends on your model and data, and on how many people are using the GPU at the same time. Small experiments take minutes, and larger ones take longer.
Can I download my trained models?
Yes. Your models are files in your workspace, and you can download them from the Jupyter file browser whenever you like.
What is the archive folder?
It is a read-only folder in your workspace that gives access to the copies of your work archived on university storage.
Can I use a hosted language model?
Hosted language-model access for student notebooks will be announced by your instructor, together with the address and any access details. Until then you can run models yourself in a GPU notebook.
What if something doesn't work?
Restart your Jupyter kernel first (Kernel → Restart). This fixes most problems. If it still fails, contact your platform administrator.
Ready

Start building

The KRMU AI Centre of Excellence gives you GPU-accelerated notebooks, experiment tracking and storage in one place.

Support: restart your Jupyter kernel for most issues, or contact the designated platform administrator for account access and technical assistance.
↑