Standard
AI

Running Local LLMs With Ollama

Level: Beginner

Master Ollama to deploy and manage AI models locally, customize them for real-world applications, and gain full control over your AI-powered projects

Course Duration: 2.25 Hours
Running Local LLMs With Ollama
User profile

Arsh Sharma

DevOps Expert and Coach

Description

AI is transforming the world, and at the core of this revolution are Large Language Models (LLMs). While cloud-based AI services like ChatGPT and Claude dominate the landscape, running AI models locally opens up new possibilities for control, customization, and efficiency. That’s where Ollama comes in.

This course empowers you to deploy and manage LLMs efficiently on your own infrastructure. Whether you’re a developer, data scientist, or AI enthusiast, mastering Ollama will give you the flexibility to build AI-powered applications while maintaining full control over your models.

What You'll Learn

  • Getting Started with Ollama

    • Set up and configure Ollama on your system.
    • Run your first AI model and explore key CLI commands.
    • Experiment with different models, parameters, and community tools.
  • Building AI Applications

    • Understand Ollama’s REST API and its endpoints.
    • Integrate AI models into real-world applications.
    • Adapt projects for OpenAI API compatibility.
  • Customizing Models with Ollama

    • Modify pre-built AI models with a Modelfile.
    • Fine-tune models and adjust parameters to fit specific use cases.
    • Upload and deploy custom AI models.

Why Take This Course?

This course combines hands-on labs with real-world scenarios, ensuring you gain practical experience in deploying and working with LLMs. You’ll experiment with model customization, build AI-powered applications, and develop skills to harness the full potential of AI on your local infrastructure.

Our students work at..

Vmware logo
Microsoft logo
Google logo
Dell logo
Apple logo
Pivotal logo
Amazon logo

About the instructor

  • Arsh Sharma

    Arsh Sharma

    DevOps Expert and Coach

    Arsh is a passionate technologist with a deep curiosity for exploring and experimenting with emerging technologies. A strong advocate for continuous learning, he actively shares his knowledge through blogs and video tutorials. As a dedicated member of open-source communities, he has built a reputation as a prominent contributor and advocate. Recognized as a CNCF Ambassador and a recipient of the Kubernetes Contributor Award, Arsh has made significant contributions to the cloud-native ecosystem. His open-source journey includes working on the Kubernetes team at VMware and contributing to key CNCF projects such as cert-manager and Kyverno. Beyond engineering, Arsh has extensive experience in technical marketing. At Okteto, a fast-growing startup in the platform engineering space, he led technical content creation and advocacy, bridging the gap between engineering and community engagement.

Course Content