Meet MPCDF: An Introduction to the MPCDF LLM Inference Service

MPCDF Seminar

  • Date: Jul 9, 2026
  • Time: 03:30 PM - 04:30 PM (Local Time Germany)
  • Speaker: Nastassya Horlava (MPCDF)
  • Location: Online
  • Room: Zoom
  • Host: MPCDF
  • Contact: training@mpcdf.mpg.de
Meet MPCDF: An Introduction to the MPCDF LLM Inference Service
This seminar in the Meet MPCDF series introduces the MPCDF LLM Inference Service, which enables researchers to run open-source language models on MPCDF-operated HPC infrastructure without exposing sensitive data to external providers.
The talk covers the MPCDF LLM Inference Service at llm.mpcdf.mpg.de, including how to spin up and query inference endpoints on MPCDF HPC systems, how Slurm job management is handled, and a discussion of suitable and unsuitable use cases. Slides will be available after the talk on the MPCDF training website. The talk will not be recorded. After the presentation, MPCDF experts will be available for questions on the talk and on general user experience.
Go to Editor View