Skip to main content
Dynamic plugins require dynamic builds of Vikat which are not enabled by default to keep Vikat setup easier. If you want to build and try custom plugins on OSS read building dynamically linked Vikat binary

​
What are Vikat Plugins?

Vikat plugins allow you to extend the gateway’s functionality by intercepting requests and responses. Plugins can modify, log, validate, or enrich data as it flows through the system, giving you powerful hooks into Vikat’s request lifecycle.

​
Use Cases

Custom plugins enable you to:
  • Transform requests and responses - Modify data before it reaches providers or after it returns
  • Add custom validation - Enforce business rules on incoming requests
  • Implement custom caching - Cache responses based on custom logic
  • Integrate with external systems - Send data to logging, monitoring, or analytics platforms
  • Apply custom transformations - Parse, filter, or enrich LLM responses

​
Plugin Architecture

architecture Vikat leverages Go’s native plugin system to enable dynamic extensibility. Plugins are built as shared object files (.so files) that are loaded at runtime by the Vikat gateway.

​
How Go Plugins Work

Go plugins use the plugin package from the standard library, which allows Go programs to dynamically load code at runtime. Here’s what makes this approach powerful:
  • Native Go Integration - Plugins are written in Go and have full access to Vikat’s type system and interfaces
  • Dynamic Loading - Plugins can be loaded, unloaded, and reloaded without restarting Vikat
  • Type Safety - Go’s type system ensures plugin methods match expected signatures
  • Performance - No IPC overhead; plugins run in the same process as Vikat

​
Building Shared Objects

Plugins must be compiled as shared objects using Go’s -buildmode=plugin flag:
This generates a .so file that exports specific functions matching Vikat’s plugin interface:
  • Init(config any) error - Initialize the plugin with configuration
  • GetName() string - Return the plugin name
  • HTTPTransportPreHook() - Intercept HTTP requests before they enter Vikat core (HTTP transport only)
  • HTTPTransportPostHook() - Intercept HTTP responses after they exit Vikat core (HTTP transport only)
  • PreRequestHook() v1.6.x+ - Once-per-request routing phase: decide provider/model/fallbacks
  • PreLLMHook() - Intercept requests before they reach providers (runs per provider attempt)
  • PostLLMHook() - Process responses after provider calls (runs per provider attempt)
  • Cleanup() error - Clean up resources on shutdown

​
Platform Requirements

Important Limitations:
  • Supported Platforms: Linux and macOS (Darwin) only
  • No Cross-Compilation: Plugins must be built on the target platform
  • Architecture Matching: Plugin and Vikat must use the same architecture (amd64, arm64)
  • Go Version Compatibility: Plugin must be built with the same Go version as Vikat
This means if you’re running Vikat on Linux AMD64, you must build your plugin on Linux AMD64 with the same Go version.

​
Plugin Lifecycle

  1. Load - Vikat loads the .so file using Go’s plugin.Open()
  2. Initialize - Calls Init() with configuration from config.json
  3. Hook Execution - Calls PreRequestHook(), PreLLMHook() and PostLLMHook() for each request
  4. Cleanup - Calls Cleanup() when Vikat shuts down
Plugins execute in a specific order:
  1. HTTPTransportPreHook - Intercept HTTP requests (HTTP transport only)
  2. PreRequestHook v1.6.x+ - Once per request, before any provider call. Routing decisions (provider/model/fallbacks) happen here and propagate to every attempt.
  3. PreLLMHook/PreMCPHook - Per provider attempt, registration order, can short-circuit requests
  4. Provider call (if not short-circuited)
  5. PostLLMHook/PostMCPHook - Per provider attempt, reverse order of PreHooks
  6. HTTPTransportPostHook - Intercept HTTP responses (HTTP transport only, reverse order)

​
Next Steps

Ready to build your first plugin? Choose your approach:
  • Writing Go Plugins - Native Go plugins using shared objects (.so files). Best for performance and full Go ecosystem access.
  • Writing WASM Plugins (Deprecated) - Legacy WebAssembly plugin guide for existing deployments. Use Go plugins for new development while webhook-based plugins are being added.