The Using Local Artificial Intelligence (Local LLMs) in Organizations training course is designed for professionals who want to run large language models on their organization's own computers and servers. The course focuses on using AI technologies locally without having to transfer corporate data to cloud-based services.

Through hands-on activities, participants learn how to download, run, and configure open-source language models using tools such as LM Studio and Ollama. The training also covers model settings, system requirements, and practical approaches to incorporating local language models into everyday business workflows.

Data privacy, information security, GDPR and Turkish Personal Data Protection Law (KVKK) considerations, hardware investments, and operating costs are also addressed. By the end of the course, participants will be better equipped to assess whether local AI solutions are suitable for their organization's technical and operational requirements.


Prerequisites

Basic computer skills and introductory familiarity with generative AI tools are recommended.

Who Should Attend

  • Employees who want to use AI tools without transferring sensitive organizational data to cloud services

  • IT support professionals and end-user services teams

  • Business professionals who regularly handle confidential or personal information

  • Information security, data protection, and KVKK compliance specialists

  • Team leaders and managers responsible for planning AI adoption within their organizations

What You Will Learn

Upon completing this training, you will be able to:

  • Compare cloud-based and locally deployed AI models according to organizational requirements.

  • Evaluate the potential benefits of local AI for data privacy, information security, and cost management.

  • Identify the hardware specifications and system requirements needed to run local language models.

  • Search for open-source models on Hugging Face and interpret the information provided in model cards.

  • Assess different model formats and quantization options based on intended use cases.

  • Download and run language models on your own computer using LM Studio.

  • Configure model parameters and system instructions for specific business scenarios.

  • Manage local language models through the Ollama command-line interface.

  • Set up AI assistants tailored to organizational needs and prepare them for team use.

  • Create a web-based interface for interacting with local models using Open WebUI.

  • Implement question-answering applications using internal corporate documents and locally running AI models.

Training Outline

1. Introduction to Local AI and Enterprise Applications

  • Overview of local artificial intelligence technologies

  • Key reasons organizations adopt locally deployed AI solutions

  • Comparison of cloud-hosted and locally running language models

  • Evaluating local AI from data privacy, GDPR, and KVKK perspectives

  • Comparing subscription and token-based expenses with hardware investment costs

2. Hardware Requirements and System Preparation

  • Identifying CPU, GPU, and memory requirements for local language models

  • Understanding the role of GPU memory (VRAM) in model performance

  • Preparing Windows, macOS, and Linux environments for installation

  • Hardware acceleration with NVIDIA CUDA and Apple Metal

3. Exploring Open-Source Language Models

  • Finding suitable language models on the Hugging Face platform

  • Reviewing model cards and interpreting technical specifications

  • Comparing GGUF, AWQ, and EXL2 model formats

  • Understanding how quantization techniques affect inference speed and output quality

4. Running Local Models with LM Studio

  • Downloading and running open-source language models using LM Studio

  • Adjusting model configurations and system instructions for different business requirements

5. Enterprise AI Use Cases with Ollama

  • Managing local language models through the Ollama command-line interface

  • Configuring AI assistants for organization-specific requirements

  • Using Open WebUI to provide web-based chat interfaces

  • Building question-answering workflows with internal company documents and local models

  • Exploring how local AI solutions can support team workflows

Why Choose Us

Leading UK-based global training provider since 1995.

Experience Using Local Artificial Intelligence (Local LLMs) in Organizations in Lyon through Bilginç IT Academy's live and interactive virtual classroom environment. Join a Public course as an individual delegate or arrange a dedicated Private / In-house online training program exclusively for your organization.

  • Delivery Method: Online Instructor-Led
  • Participation Model: Public / Private (In-house)
  • Live and Interactive Training: Connect with your instructor in real time and actively participate through discussions, Q&A sessions, practical exercises, and group activities.
  • Flexible Participation: Join the training from your home, office, or any location with a suitable internet connection.
  • Expert Trainer Network: Learn from experienced trainers with strong industry backgrounds and practical field expertise.
  • Over 30 Years of Training Expertise: Benefit from Bilginç IT Academy's professional training experience since 1995.
  • Worldwide Access: Join our live virtual classrooms from Lyon or anywhere else in the world, or arrange a dedicated online training program for your organization.

Experience Using Local Artificial Intelligence (Local LLMs) in Organizations through face-to-face Classroom Based training in Lyon. Training can be delivered as a Public course open to individual delegates or as a dedicated Private / In-house class for your organization.

  • Delivery Method: Classroom Based
  • Participation Model: Public / Private (In-house)
  • Face-to-Face Learning: Interact directly with your instructor and fellow delegates in an engaging classroom environment.
  • Experienced Trainers: Learn from specialists with extensive industry experience and practical real-world knowledge.
  • Professional Training Environment: Attend training in comfortable, well-equipped classrooms designed to support effective learning.
  • Practical Learning: Depending on the course, reinforce your knowledge through hands-on exercises, scenarios, case studies, and instructor-led activities.

Arrange Using Local Artificial Intelligence (Local LLMs) in Organizations in Lyon as a dedicated Onsite training program for your organization. Bilginç IT Academy trainers can deliver the training at your office or another location of your choice, with the program planned around your team's requirements and business objectives.

  • Delivery Method: Onsite
  • Participation Model: Private (In-house)
  • Training at Your Preferred Location: Organize the training at your company's office or another location selected by your organization.
  • Tailored Course Content: Adapt the training program to your projects, team structure, existing skill levels, and specific business requirements.
  • Team-Focused Learning: Develop your team around a shared knowledge base while strengthening internal collaboration and knowledge transfer.
  • Flexible Scheduling: Plan the training dates, location, and program according to your organization's operational requirements.
  • Worldwide Onsite Delivery: Arrange the training in Lyon or at another preferred location worldwide. Bilginç IT Academy trainers can travel to your selected location to deliver the dedicated training program.


Contact us for more detail about our trainings and for all other enquiries!