Skip to content

A
aisbf
Commit c68beece authored by Your Name's avatar Your Name
Browse files
Options

Rewrite Claude provider comparison: AISBF vs vendors/kilocode vs vendors/claude 

Document now correctly compares only the three Claude provider implementations:

- AISBF (aisbf/providers.py) - Direct HTTP with OAuth2
- vendors/kilocode (vendors/kilocode/packages/opencode/src/provider/) - AI SDK
- vendors/claude (vendors/claude/src/) - Original Claude Code

All tables and references now use these three sources exclusively.
Removed all Kiro Gateway content which was unrelated to Claude.
parent 2170715c
Hide whitespace changes
Inline Side-by-side
Showing with 122 additions and 72 deletions
docs/claude_provider_comparison.md
View file @ c68beece
# Claude Provider Comparison: AISBF vs Original Claude Code vs KiloCode # Claude Provider Comparison: AISBF vs vendors/kilocode vs vendors/claude
**Date:** 2026-03-31 **Date:** 2026-03-31
**Reviewed by:** AI Assistant **Reviewed by:** AI Assistant
**AISBF File:** [`aisbf/providers.py`](aisbf/providers.py:2300) - Claude provider
**Original Source:** `vendors/claude/src/` **Sources compared:**
**KiloCode Source:** `vendors/kilocode/packages/opencode/src/provider/` - **AISBF:** [`aisbf/providers.py`](aisbf/providers.py:2300) - `ClaudeProviderHandler` class
- **vendors/kilocode:** `vendors/kilocode/packages/opencode/src/provider/` - Provider transform + SDK integration
- **vendors/claude:** `vendors/claude/src/` - Original Claude Code TypeScript source
--- ---
## Overview ## Overview
This document compares three Claude provider implementations: This document compares three Claude provider implementations found in the codebase:
1. **AISBF Claude Provider** - Direct HTTP implementation using OAuth2 tokens 1. **AISBF** (`aisbf/providers.py`) - Direct HTTP implementation using OAuth2 tokens via `httpx.AsyncClient`
2. **Original Claude Code** - TypeScript/React implementation from Anthropic 2. **vendors/kilocode** (`vendors/kilocode/packages/opencode/src/provider/`) - TypeScript implementation using AI SDK (`@ai-sdk/anthropic`)
3. **KiloCode** - TypeScript implementation using AI SDK (`@ai-sdk/anthropic`) 3. **vendors/claude** (`vendors/claude/src/`) - Original Claude Code TypeScript/React implementation from Anthropic
--- ---
## 1. Architecture & Approach ## 1. Architecture & Approach
| Aspect | AISBF Claude | Original Claude Code | KiloCode | | Aspect | AISBF | vendors/kilocode | vendors/claude |
|--------|-------------|---------------------|----------| |--------|-------|------------------|----------------|
| **Language** | Python | TypeScript/React | TypeScript | | **Language** | Python | TypeScript | TypeScript/React |
| **API Method** | Direct HTTP via `httpx.AsyncClient` | Anthropic SDK + internal `callModel` | AI SDK (`@ai-sdk/anthropic`) | | **API Method** | Direct HTTP via `httpx.AsyncClient` | AI SDK (`@ai-sdk/anthropic`) | Anthropic SDK + internal `callModel` |
| **Authentication** | OAuth2 via `ClaudeAuth` class | Internal OAuth2 + session management | API key / OAuth via Auth system | | **Authentication** | OAuth2 via `ClaudeAuth` class | API key / OAuth via Auth system | Internal OAuth2 + session management |
| **Endpoint** | `https://api.anthropic.com/v1/messages` | Internal SDK routing | Configurable (baseURL) | | **Endpoint** | `https://api.anthropic.com/v1/messages` | Configurable (baseURL) | Internal SDK routing |
| **Response Format** | Standard JSON / SSE | SDK streaming | AI SDK streaming | | **Response Format** | Standard JSON / SSE | AI SDK streaming | SDK streaming |
| **Protocol** | Anthropic Messages API | Anthropic Messages API | AI SDK (unified) | | **Protocol** | Anthropic Messages API | AI SDK (unified) | Anthropic Messages API |
| **Beta Headers** | `claude-code-20250219,oauth-2025-04-20,interleaved-thinking-2025-05-14,...` | Internal | `claude-code-20250219,interleaved-thinking-2025-05-14,fine-grained-tool-streaming-2025-05-14` | | **Beta Headers** | `claude-code-20250219,oauth-2025-04-20,interleaved-thinking-2025-05-14,...` | `claude-code-20250219,interleaved-thinking-2025-05-14,fine-grained-tool-streaming-2025-05-14` | Internal |
**Assessment:** **Assessment:**
- AISBF uses the direct HTTP approach appropriate for OAuth2 tokens - AISBF uses direct HTTP approach appropriate for OAuth2 tokens
- KiloCode uses the AI SDK (`@ai-sdk/anthropic`) which provides a unified interface across providers - vendors/kilocode uses AI SDK (`@ai-sdk/anthropic`) for unified provider interface
- KiloCode's custom loader for Anthropic ([`provider.ts:125`](vendors/kilocode/packages/opencode/src/provider/provider.ts:125)) sets beta headers similar to AISBF - vendors/kilocode's custom loader ([`provider.ts:125`](vendors/kilocode/packages/opencode/src/provider/provider.ts:125)) sets beta headers similar to AISBF
--- ---
## 2. Message Format Conversion ## 2. Message Format Conversion
### AISBF Claude: [`_convert_messages_to_anthropic()`](aisbf/providers.py:2516) ### AISBF: [`_convert_messages_to_anthropic()`](aisbf/providers.py:2516)
**What it does well:** **What it does well:**
- Correctly extracts system messages to separate `system` parameter - Correctly extracts system messages to separate `system` parameter
...@@ -47,7 +49,7 @@ This document compares three Claude provider implementations: ...@@ -47,7 +49,7 @@ This document compares three Claude provider implementations:
- Converts assistant `tool_calls` to Anthropic `tool_use` blocks - Converts assistant `tool_calls` to Anthropic `tool_use` blocks
- Handles message role alternation requirements - Handles message role alternation requirements
### KiloCode: [`normalizeMessages()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:49) + [`applyCaching()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:177) ### vendors/kilocode: [`normalizeMessages()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:49) + [`applyCaching()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:177)
**What it does well:** **What it does well:**
- **Empty content filtering**: Removes empty string messages and empty text/reasoning parts from array content - **Empty content filtering**: Removes empty string messages and empty text/reasoning parts from array content
...@@ -56,27 +58,28 @@ This document compares three Claude provider implementations: ...@@ -56,27 +58,28 @@ This document compares three Claude provider implementations:
- **Provider option remapping**: Remaps providerOptions keys from stored providerID to expected SDK key - **Provider option remapping**: Remaps providerOptions keys from stored providerID to expected SDK key
- **Duplicate reasoning fix**: Removes duplicate reasoning_details from OpenRouter responses - **Duplicate reasoning fix**: Removes duplicate reasoning_details from OpenRouter responses
### Differences from original: ### vendors/claude: [`normalizeMessagesForAPI()`](vendors/claude/src/utils/messages.ts)
The original ([`normalizeMessagesForAPI()`](vendors/claude/src/utils/messages.ts)) has more sophisticated handling including:
**What it does well:**
- Thinking block preservation rules - Thinking block preservation rules
- Protected thinking block signatures - Protected thinking block signatures
- More complex tool result merging - More complex tool result merging
- Message UUID tracking for caching - Message UUID tracking for caching
### Key Architectural Difference: ### Key Architectural Difference:
| Feature | AISBF Claude | KiloCode | | Feature | AISBF | vendors/kilocode | vendors/claude |
|---------|-------------|----------| |---------|-------|------------------|----------------|
| **Conversion Strategy** | Direct OpenAI → Anthropic | AI SDK message normalization | | **Conversion Strategy** | Direct OpenAI → Anthropic | AI SDK message normalization | Internal SDK normalization |
| **Image Support** | No | Via AI SDK | | **Image Support** | No | Via AI SDK | Yes (native) |
| **Message Validation** | Basic | Empty content filtering, ID sanitization | | **Message Validation** | Basic | Empty content filtering, ID sanitization | Thinking block preservation, UUID tracking |
| **Synthetic Messages** | No | No | | **Synthetic Messages** | No | No | No |
| **Caching** | No | Yes (ephemeral cache on system/last 2 msgs) | | **Caching** | No | Yes (ephemeral cache on system/last 2 msgs) | Yes (internal) |
--- ---
## 3. Tool Conversion ## 3. Tool Conversion
### AISBF Claude: [`_convert_tools_to_anthropic()`](aisbf/providers.py:2419) ### AISBF: [`_convert_tools_to_anthropic()`](aisbf/providers.py:2419)
**What it does well:** **What it does well:**
- Correctly converts OpenAI `parameters` → Anthropic `input_schema` - Correctly converts OpenAI `parameters` → Anthropic `input_schema`
...@@ -84,40 +87,44 @@ The original ([`normalizeMessagesForAPI()`](vendors/claude/src/utils/messages.ts ...@@ -84,40 +87,44 @@ The original ([`normalizeMessagesForAPI()`](vendors/claude/src/utils/messages.ts
- Removes `additionalProperties: false` (Anthropic doesn't need it) - Removes `additionalProperties: false` (Anthropic doesn't need it)
- Recursively normalizes nested schemas - Recursively normalizes nested schemas
### KiloCode: AI SDK handles conversion internally ### vendors/kilocode: AI SDK handles conversion internally
**What it does:** **What it does:**
- Uses `@ai-sdk/anthropic` which handles OpenAI → Anthropic tool conversion internally - Uses `@ai-sdk/anthropic` which handles OpenAI → Anthropic tool conversion internally
- Tool schemas pass through [`schema()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:954) for Gemini/Google models (integer enum → string enum conversion) - Tool schemas pass through [`schema()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:954) for Gemini/Google models (integer enum → string enum conversion)
- No explicit Anthropic-specific tool conversion needed (SDK handles it) - No explicit Anthropic-specific tool conversion needed (SDK handles it)
### Missing from original: ### vendors/claude: Internal SDK handling
The original has additional tool validation including:
- Tool name length limits **What it does:**
- Tool validation including name length limits
- Parameter size limits - Parameter size limits
- Schema validation against Anthropic's stricter requirements - Schema validation against Anthropic's stricter requirements
- Tool result size budgeting (`applyToolResultBudget` in [`query.ts:379`](vendors/claude/src/query.ts:379)) - Tool result size budgeting ([`applyToolResultBudget`](vendors/claude/src/query.ts:379))
--- ---
## 4. Tool Choice Conversion ## 4. Tool Choice Conversion
### AISBF Claude: [`_convert_tool_choice_to_anthropic()`](aisbf/providers.py:2367) ### AISBF: [`_convert_tool_choice_to_anthropic()`](aisbf/providers.py:2367)
**Correctly handles:** **Correctly handles:**
- `"auto"` → `{"type": "auto"}` - `"auto"` → `{"type": "auto"}`
- `"required"` → `{"type": "any"}` - `"required"` → `{"type": "any"}`
- Specific function → `{"type": "tool", "name": "..."}` - Specific function → `{"type": "tool", "name": "..."}`
### KiloCode: AI SDK handles internally ### vendors/kilocode: AI SDK handles internally
- Uses AI SDK's unified tool choice handling - Uses AI SDK's unified tool choice handling
- No explicit tool_choice conversion needed - No explicit tool_choice conversion needed
### vendors/claude: Internal SDK handling
- More nuanced tool choice handling including `disable_parallel_tool_use` support
--- ---
## 5. Streaming Implementation ## 5. Streaming Implementation
### AISBF Claude: [`_handle_streaming_request()`](aisbf/providers.py:2800) ### AISBF: [`_handle_streaming_request()`](aisbf/providers.py:2800)
**What it does:** **What it does:**
- Uses SSE format parsing (`data:` prefixed lines) - Uses SSE format parsing (`data:` prefixed lines)
...@@ -125,7 +132,7 @@ The original has additional tool validation including: ...@@ -125,7 +132,7 @@ The original has additional tool validation including:
- Handles `message_stop` for final chunk - Handles `message_stop` for final chunk
- Yields OpenAI-compatible chunks - Yields OpenAI-compatible chunks
### KiloCode: AI SDK streaming ### vendors/kilocode: AI SDK streaming
**What it does:** **What it does:**
- Uses AI SDK's built-in streaming via `sdk.languageModel(modelId).doStream()` or `generateText()` - Uses AI SDK's built-in streaming via `sdk.languageModel(modelId).doStream()` or `generateText()`
...@@ -134,21 +141,31 @@ The original has additional tool validation including: ...@@ -134,21 +141,31 @@ The original has additional tool validation including:
- Supports `fine-grained-tool-streaming-2025-05-14` beta header for streaming tool calls - Supports `fine-grained-tool-streaming-2025-05-14` beta header for streaming tool calls
- Custom fetch wrapper with timeout handling ([`provider.ts:1138`](vendors/kilocode/packages/opencode/src/provider/provider.ts:1138)) - Custom fetch wrapper with timeout handling ([`provider.ts:1138`](vendors/kilocode/packages/opencode/src/provider/provider.ts:1138))
### vendors/claude: Internal SDK streaming ([`callModel()`](vendors/claude/src/query.ts:659))
**What it does:**
- Handles thinking blocks during streaming
- Has streaming tool executor (`StreamingToolExecutor`)
- Supports fallback model switching mid-stream
- Has token budget tracking during streaming
- Handles `tool_use` blocks during streaming (not just text)
- Has message backfill for tool inputs
### Key Differences: ### Key Differences:
| Feature | AISBF Claude | KiloCode | | Feature | AISBF | vendors/kilocode | vendors/claude |
|---------|-------------|----------| |---------|-------|------------------|----------------|
| **Protocol** | SSE (text) | AI SDK (abstracted) | | **Protocol** | SSE (text) | AI SDK (abstracted) | SDK streaming |
| **Tool Streaming** | No | Yes (via fine-grained-tool-streaming beta) | | **Tool Streaming** | No | Yes (via fine-grained-tool-streaming beta) | Yes (StreamingToolExecutor) |
| **Thinking Blocks** | No | Yes (via SDK) | | **Thinking Blocks** | No | Yes (via SDK) | Yes (native) |
| **Usage Tracking** | No | Yes (via SDK) | | **Usage Tracking** | No | Yes (via SDK) | Yes (native) |
| **Error Recovery** | Basic | SDK-level | | **Error Recovery** | Basic | SDK-level | Fallback model, token budget |
| **Content Dedup** | No | No | | **Content Dedup** | No | No | No |
--- ---
## 6. Response Conversion ## 6. Response Conversion
### AISBF Claude: [`_convert_to_openai_format()`](aisbf/providers.py:2916) ### AISBF: [`_convert_to_openai_format()`](aisbf/providers.py:2916)
**Correctly handles:** **Correctly handles:**
- Text content extraction - Text content extraction
...@@ -156,17 +173,22 @@ The original has additional tool validation including: ...@@ -156,17 +173,22 @@ The original has additional tool validation including:
- Stop reason mapping (`end_turn` → `stop`, etc.) - Stop reason mapping (`end_turn` → `stop`, etc.)
- Usage metadata extraction - Usage metadata extraction
### KiloCode: AI SDK handles internally ### vendors/kilocode: AI SDK handles internally
- AI SDK provides unified response format across all providers - AI SDK provides unified response format across all providers
- No manual response conversion needed - No manual response conversion needed
- Usage metadata includes cache tokens via SDK - Usage metadata includes cache tokens via SDK
- Cost calculation handles provider-specific differences ([`session/index.ts:860`](vendors/kilocode/packages/opencode/src/session/index.ts:860)) - Cost calculation handles provider-specific differences ([`session/index.ts:860`](vendors/kilocode/packages/opencode/src/session/index.ts:860))
### vendors/claude: Internal SDK handling
- Thinking block preservation
- Protected thinking signatures
- More detailed usage tracking (cache tokens, etc.)
--- ---
## 7. Headers & Authentication ## 7. Headers & Authentication
### AISBF Claude: [`_get_auth_headers()`](aisbf/providers.py:2331) ### AISBF: [`_get_auth_headers()`](aisbf/providers.py:2331)
**Includes:** **Includes:**
- OAuth2 Bearer token - OAuth2 Bearer token
...@@ -174,7 +196,7 @@ The original has additional tool validation including: ...@@ -174,7 +196,7 @@ The original has additional tool validation including:
- `Anthropic-Beta` with multiple beta features - `Anthropic-Beta` with multiple beta features
- `X-App: cli` and other stainless headers - `X-App: cli` and other stainless headers
### KiloCode: [`CUSTOM_LOADERS.anthropic()`](vendors/kilocode/packages/opencode/src/provider/provider.ts:125) ### vendors/kilocode: [`CUSTOM_LOADERS.anthropic()`](vendors/kilocode/packages/opencode/src/provider/provider.ts:125)
**Includes:** **Includes:**
- API key via `options.apiKey` or auth system - API key via `options.apiKey` or auth system
...@@ -182,28 +204,38 @@ The original has additional tool validation including: ...@@ -182,28 +204,38 @@ The original has additional tool validation including:
- Custom fetch wrapper with timeout handling - Custom fetch wrapper with timeout handling
- TODO comment for adaptive thinking headers: `adaptive-thinking-2026-01-28,effort-2025-11-24,max-effort-2026-01-24` - TODO comment for adaptive thinking headers: `adaptive-thinking-2026-01-28,effort-2025-11-24,max-effort-2026-01-24`
### vendors/claude: Internal OAuth2
**Includes:**
- Internal OAuth2 session management
- Internal SDK routing
--- ---
## 8. Model Name Resolution ## 8. Model Name Resolution
### AISBF Claude: Direct API call ### AISBF: Direct API call
- Queries `https://api.anthropic.com/v1/models` - Queries `https://api.anthropic.com/v1/models`
- Uses model names as returned by API - Uses model names as returned by API
### KiloCode: Model ID passthrough ### vendors/kilocode: Model ID passthrough
- Uses model IDs from models.dev database - Uses model IDs from models.dev database
- Model variants generated via [`variants()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:381) for reasoning efforts - Model variants generated via [`variants()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:381) for reasoning efforts
- Model sorting via [`sort()`](vendors/kilocode/packages/opencode/src/provider/provider.ts:1348) with priority: `gpt-5`, `claude-sonnet-4`, `big-pickle`, `gemini-3-pro` - Model sorting via [`sort()`](vendors/kilocode/packages/opencode/src/provider/provider.ts:1348) with priority: `gpt-5`, `claude-sonnet-4`, `big-pickle`, `gemini-3-pro`
- Small model selection via [`getSmallModel()`](vendors/kilocode/packages/opencode/src/provider/provider.ts:1277) with priority list including `claude-haiku-4-5` - Small model selection via [`getSmallModel()`](vendors/kilocode/packages/opencode/src/provider/provider.ts:1277) with priority list including `claude-haiku-4-5`
### vendors/claude: Internal SDK handling
- Uses internal model registry
- No public models endpoint
--- ---
## 9. Reasoning/Thinking Support ## 9. Reasoning/Thinking Support
### AISBF Claude: No explicit support ### AISBF: No explicit support
- No thinking block handling in current implementation - No thinking block handling in current implementation
### KiloCode: Full thinking support via AI SDK ### vendors/kilocode: Full thinking support via AI SDK
**Features ([`variants()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:381)):** **Features ([`variants()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:381)):**
- **Adaptive thinking** for Opus 4.6 / Sonnet 4.6: `thinking: { type: "adaptive" }` with effort levels - **Adaptive thinking** for Opus 4.6 / Sonnet 4.6: `thinking: { type: "adaptive" }` with effort levels
...@@ -211,14 +243,21 @@ The original has additional tool validation including: ...@@ -211,14 +243,21 @@ The original has additional tool validation including:
- Effort levels: `low`, `medium`, `high`, `max` - Effort levels: `low`, `medium`, `high`, `max`
- Temperature returns `undefined` for Claude models (let SDK decide) - Temperature returns `undefined` for Claude models (let SDK decide)
### vendors/claude: Full thinking support
**Features:**
- Thinking block preservation during streaming
- Protected thinking block signatures
- Interleaved thinking support (`interleaved-thinking-2025-05-14` beta)
--- ---
## 10. Prompt Caching ## 10. Prompt Caching
### AISBF Claude: No explicit support ### AISBF: No explicit support
- No cache_control headers applied - No cache_control headers applied
### KiloCode: Automatic ephemeral caching ### vendors/kilocode: Automatic ephemeral caching
**Implementation ([`applyCaching()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:177)):** **Implementation ([`applyCaching()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:177)):**
- Applies `cacheControl: { type: "ephemeral" }` to: - Applies `cacheControl: { type: "ephemeral" }` to:
...@@ -231,11 +270,15 @@ The original has additional tool validation including: ...@@ -231,11 +270,15 @@ The original has additional tool validation including:
- OpenAI Compatible: `cache_control: { type: "ephemeral" }` - OpenAI Compatible: `cache_control: { type: "ephemeral" }`
- GitHub Copilot: `copilot_cache_control: { type: "ephemeral" }` - GitHub Copilot: `copilot_cache_control: { type: "ephemeral" }`
### vendors/claude: Internal caching
- Internal prompt caching via Anthropic API
- Message UUID tracking for cache hits
--- ---
## 11. Advanced Features ## 11. Advanced Features
### KiloCode Exclusive Features: ### vendors/kilocode Exclusive Features:
| Feature | Description | Location | | Feature | Description | Location |
|---------|-------------|----------| |---------|-------------|----------|
...@@ -248,15 +291,11 @@ The original has additional tool validation including: ...@@ -248,15 +291,11 @@ The original has additional tool validation including:
| **Gemini Schema Sanitization** | Converts integer enums to string enums for Google models | [`schema()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:954) | | **Gemini Schema Sanitization** | Converts integer enums to string enums for Google models | [`schema()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:954) |
| **Unsupported Part Handling** | Converts unsupported media types to error text | [`unsupportedParts()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:217) | | **Unsupported Part Handling** | Converts unsupported media types to error text | [`unsupportedParts()`](vendors/kilocode/packages/opencode/src/provider/transform.ts:217) |
--- ### vendors/claude Exclusive Features:
## 12. Missing Features (Not in AISBF) | Feature | Description | Location |
|---------|-------------|----------|
The original Claude Code has many features that are out of scope for a provider handler but worth noting: | **Query loop** | Multi-turn tool execution with auto-compact, reactive compact | [`query.ts:219`](vendors/claude/src/query.ts:219) |
| Feature | Description | Location in Original |
|---------|-------------|---------------------|
| **Query loop** | Multi-turn tool execution with auto-compact, reactive compact, context collapse | [`query.ts:219`](vendors/claude/src/query.ts:219) |
| **Token budgeting** | Per-turn output token limits with continuation nudges | [`query.ts:1308`](vendors/claude/src/query.ts:1308) | | **Token budgeting** | Per-turn output token limits with continuation nudges | [`query.ts:1308`](vendors/claude/src/query.ts:1308) |
| **Auto-compaction** | Automatic conversation summarization when context gets large | [`query.ts:454`](vendors/claude/src/query.ts:454) | | **Auto-compaction** | Automatic conversation summarization when context gets large | [`query.ts:454`](vendors/claude/src/query.ts:454) |
| **Context collapse** | Granular context compression | [`query.ts:440`](vendors/claude/src/query.ts:440) | | **Context collapse** | Granular context compression | [`query.ts:440`](vendors/claude/src/query.ts:440) |
...@@ -271,15 +310,15 @@ The original Claude Code has many features that are out of scope for a provider ...@@ -271,15 +310,15 @@ The original Claude Code has many features that are out of scope for a provider
## Summary ## Summary
### Strengths of AISBF Claude implementation: ### Strengths of AISBF implementation:
1. Clean OAuth2 integration matching kilocode patterns 1. Clean OAuth2 integration matching vendors/kilocode patterns
2. Comprehensive message format conversion 2. Comprehensive message format conversion
3. Good tool schema normalization 3. Good tool schema normalization
4. Proper streaming SSE handling 4. Proper streaming SSE handling
5. Robust fallback strategy for model discovery 5. Robust fallback strategy for model discovery
6. Adaptive rate limiting with learning 6. Adaptive rate limiting with learning
### Strengths of KiloCode implementation: ### Strengths of vendors/kilocode implementation:
1. **AI SDK abstraction**: Unified interface across all providers 1. **AI SDK abstraction**: Unified interface across all providers
2. **Automatic prompt caching**: Ephemeral caching on system/last 2 messages 2. **Automatic prompt caching**: Ephemeral caching on system/last 2 messages
3. **Full thinking support**: Adaptive thinking + budget-based thinking for Claude models 3. **Full thinking support**: Adaptive thinking + budget-based thinking for Claude models
...@@ -289,6 +328,15 @@ The original Claude Code has many features that are out of scope for a provider ...@@ -289,6 +328,15 @@ The original Claude Code has many features that are out of scope for a provider
7. **Robust error handling**: Duplicate reasoning fix, unsupported part handling 7. **Robust error handling**: Duplicate reasoning fix, unsupported part handling
8. **Model management**: Small model selection, priority sorting 8. **Model management**: Small model selection, priority sorting
### Strengths of vendors/claude implementation:
1. **Full conversation management**: Query loop with auto-compact, reactive compact
2. **Token budgeting**: Per-turn output limits with continuation nudges
3. **Streaming tool execution**: Parallel tool execution during streaming
4. **Model fallback**: Automatic fallback to alternative models
5. **Memory prefetch**: Relevant memory file preloading
6. **Skill discovery**: Dynamic skill file detection
7. **Stop hooks**: Pre/post-turn hook execution
### Areas for improvement (AISBF): ### Areas for improvement (AISBF):
1. Add thinking block support for models that use it 1. Add thinking block support for models that use it
2. Add tool call streaming (fine-grained-tool-streaming beta) 2. Add tool call streaming (fine-grained-tool-streaming beta)
...@@ -303,4 +351,6 @@ The original Claude Code has many features that are out of scope for a provider ...@@ -303,4 +351,6 @@ The original Claude Code has many features that are out of scope for a provider
### Overall assessment: ### Overall assessment:
The AISBF Claude provider is a solid implementation that correctly handles the core API communication, message conversion, and tool handling. It appropriately focuses on the provider-level concerns (API translation) while leaving higher-level concerns (conversation management, compaction) to the rest of the framework. The AISBF Claude provider is a solid implementation that correctly handles the core API communication, message conversion, and tool handling. It appropriately focuses on the provider-level concerns (API translation) while leaving higher-level concerns (conversation management, compaction) to the rest of the framework.
The KiloCode implementation demonstrates the power of using the AI SDK (`@ai-sdk/anthropic`) for provider abstraction, with automatic handling of thinking, caching, and tool conversion. Its message validation pipeline (empty content filtering, ID sanitization, duplicate reasoning fix) provides robustness that AISBF could benefit from. The vendors/kilocode implementation demonstrates the power of using the AI SDK (`@ai-sdk/anthropic`) for provider abstraction, with automatic handling of thinking, caching, and tool conversion. Its message validation pipeline (empty content filtering, ID sanitization, duplicate reasoning fix) provides robustness that AISBF could benefit from.
The vendors/claude implementation is the most comprehensive, with full conversation management including auto-compaction, token budgeting, streaming tool execution, and model fallback. Many of these features are out of scope for a provider handler but represent the full Claude Code experience.
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment