AI-Services

AI Services, part of the IBM Open-Source AI Foundation for Power, deliver pre-built AI capabilities and integration with inferencing solutions like Red Hat AI Inference Server. Optimized for IBM Spyre™ on Power, they enable fast deployment and support models such as LLMs, embeddings, and re-rankers—helping enterprises scale AI efficiently.

📘 Table of Contents

• 🗃️ Repository Structure

• 🌟 Introduction

• 🛠️ Configuration and Installation

  • Prerequisites
  • Quick Start
  • Set-up AI Services
  • Configuring in Air-gapped Environment

• 🤖 RAG Chatbot

  • Architecture
  • Setting up RAG Chatbot

• 💻 CLI Reference

  • Auto-completion
  • Commands

• 🧯 Troubleshooting

• ❓ FAQ

• ⚠️ Limitations

• 👩‍💻 Developer Guide

• 🚀 Contributing

---

Quick Start

Pull in AI Services binary

Download the latest ai-services binary from the releases page. Use the following curl command to download it (replace version with the desired release tag):

$ curl -LO https://github.com/IBM/project-ai-services/releases/download/<version>/ai-services
$ sudo chmod +x ai-services
$ sudo mv ai-services /usr/local/bin/

Run the binary to get started

% ai-services --help
A CLI tool for managing AI Services infrastructure.

Usage:
  ai-services [command]

Available Commands:
  application   Deploy and monitor the applications
  completion    Generate the autocompletion script for the specified shell
  help          Help about any command
  version       Prints CLI version with more info

Flags:
  -h, --help      help for ai-services
  -v, --version   version for ai-services

Use "ai-services [command] --help" for more information about a command.

---

Repository Structure

project-ai-services/
├── README.md          # Project documentation
├── ai-services/       # CLI tool for project-ai-services
│   ├── assets/        # Application template files
├── images/            # Helper/Utility image assets
├── spyre-rag/         # Spyre RAG implementation
├── test/              # Test assets
│   ├── golden/        # Golden dataset