English | 日本語

LLMClient

A provider-agnostic LLM client abstraction Swift package

Features

• Provider Agnostic - Unified protocol allows swapping any LLM provider without changing call-site code
• Swift Macro-based Tool Definition - Type-safe Function Calling with @Tool macro
• Structured Output - Type-safe structured responses via @Structured macro and JSON Schema
• Streaming - Real-time token output via AsyncThrowingStream
• Chat Management - Unified API for message history and context management

Installation

// Package.swift
dependencies: [
    .package(url: "https://github.com/no-problem-dev/swift-llm-client.git", .upToNextMajor(from: "3.9.0"))
]

Module Structure

Import only the modules you need:

Quick Start

Structured Output

import LLMClient

// Define a type with the @Structured macro
@Structured("City information")
struct CityInfo {
    @StructuredField("City name")
    var name: String
    @StructuredField("Population (in ten thousands)")
    var population: Int
}

// Generate via a client (any provider implementation)
let client: any StructuredLLMClient<LLMModel> = // any provider implementation
let city: CityInfo = try await client.generate(
    input: "Tokyo has a population of approximately 14 million",
    model: .claude(.sonnet)
)
print(city.name)       // "Tokyo"
print(city.population) // 1400

Tool Definition

import LLMTool

@Tool("Get current weather")
struct GetWeather {
    @ToolArgument("City name")
    var city: String

    func call() async throws -> String {
        // Call weather API
        return "Tokyo: Sunny 25°C"
    }
}

let tools = ToolSet {
    GetWeather()
}

Documentation

See the DocC documentation for detailed guides and API reference.

Requirements

• iOS 17.0+ / macOS 14.0+
• Swift 6.2+
• Xcode 16.0+

License

MIT License - See LICENSE for details

Links

• Full Documentation
• Report Issues
• Discussions
• Release Process