Skip to content

The Gate

The Gate is Kaimon's bridge between external Julia processes and the MCP server. It lets any Julia REPL – your application, a data pipeline, a TUI – expose itself as a live session that AI agents can interact with, complete with custom tools.

Architecture

The Gate uses ZMQ (ZeroMQ) IPC sockets for communication:

  • A REP socket handles request-reply messages: eval, tool calls, pings, restarts, option changes.

  • A PUB socket streams stdout/stderr in real-time so the agent and TUI see output as it happens.

  • Session discovery works via JSON metadata files written to ~/.cache/kaimon/sock/. The Kaimon server watches this directory and automatically connects to new sessions.

GateTool

GateTool is the struct that wraps a Julia function for exposure as an MCP tool. Kaimon reflects on the function's signature to auto-generate the MCP schema – argument names, types, required/optional status, and docstrings are all extracted automatically.

julia
struct GateTool
    name::String
    handler::Function
end

The name field becomes the MCP tool name (potentially prefixed by the session namespace). The handler is any Julia function whose signature will be introspected.

Gate.serve()

Start the gate from any Julia REPL:

julia
using Kaimon
Gate.serve()

This is non-blocking. The gate runs in a background task and returns immediately. Kaimon's server discovers the session automatically.

Full signature

julia
Gate.serve(;
    session_id::Union{String,Nothing} = nothing,
    force::Bool = false,
    tools::Vector{GateTool} = GateTool[],
    namespace::String = "",
    allow_mirror::Bool = true,
    allow_restart::Bool = true,
)
ParameterDescription
session_idReuse a session ID (e.g., after an exec restart). Auto-generated if nothing.
forceSkip the TTY check. Required for non-interactive processes that want a gate.
toolsSession-scoped tools to expose via MCP.
namespaceStable prefix for tool names. Auto-derived from project basename if empty.
allow_mirrorWhether the agent can enable host REPL mirroring. Default true.
allow_restartWhether the agent can trigger a remote restart via manage_repl. Default true.

Building Custom Tools

Define a plain Julia function with typed arguments, then wrap it in a GateTool:

julia
using Kaimon.Gate: GateTool, serve

function greet(name::String, excited::Bool=false)
    msg = "Hello, $name!"
    excited ? uppercase(msg) : msg
end

serve(tools=[GateTool("greet", greet)])

When the agent calls the greet tool, Kaimon will:

  1. Reflect on greet's method signature to discover that name is a required String and excited is an optional Bool.

  2. Generate an MCP schema with the correct JSON types, required fields, and descriptions (pulled from the function's docstring if present).

  3. Coerce the incoming JSON arguments to the correct Julia types before calling the function.

Type introspection details

Kaimon's _type_to_meta handles the full type mapping:

Julia TypeMCP Schema Kind
String"string"
Bool"boolean"
Integer subtypes"integer"
AbstractFloat subtypes"number"
Symbol"string" (coerced from string)
@enum types"enum" with values
Structs"struct" with recursive field schemas
AbstractVector"array" with element type
Union{T, Nothing}Schema for T, marked as optional
Any"any" (pass-through)

Structs as parameters

Custom structs are automatically decomposed into nested object schemas:

julia
@enum Priority low medium high critical

struct Tag
    name::String
    color::Symbol
end

struct Task
    title::String
    description::String
    priority::Priority
    tags::Vector{Tag}
end

function add_task(task::Task)
    # Kaimon will construct Task from the incoming JSON Dict,
    # including nested Tag structs and the Priority enum.
    push!(task_list, task)
    "Added: $(task.title)"
end

serve(tools=[GateTool("add_task", add_task)])

The agent sees an MCP tool with a nested object schema for Task, enum values for Priority, and a Tag array – all generated from the Julia types.

Keyword arguments

Keyword arguments are discovered via Base.kwarg_decl and exposed as optional parameters:

julia
function search(query::String; limit::Int=10, case_sensitive::Bool=false)
    # ...
end

serve(tools=[GateTool("search", search)])
# Agent sees: query (required), limit (optional), case_sensitive (optional)

Dict handler escape hatch

If your handler accepts Dict{String,Any}, Kaimon passes the raw arguments directly without reflection:

julia
function raw_handler(args::Dict{String,Any})
    name = get(args, "name", "world")
    "Hello, $name!"
end

Namespaces

When multiple Julia processes serve tools with the same name, namespaces prevent conflicts. The namespace is auto-derived from the project's directory name, or you can set it explicitly:

julia
# Two instances of the same app, differentiated by namespace
serve(tools=my_tools, namespace="todo_dev")    # branch A
serve(tools=my_tools, namespace="todo_main")   # branch B

Tool names appear in MCP as namespace_toolname (e.g., todo_dev_add_task). The agent sees and calls them by their namespaced names.

Mirror Mode

When mirroring is enabled, the agent's code and output are echoed in the host Julia REPL:

agent> x = rand(3)
3-element Vector{Float64}:
 0.123
 0.456
 0.789

This is controlled by two settings:

  • allow_mirror: Set at serve() time. If false, the agent cannot enable mirroring. Default true.

  • Mirror toggle: The agent can enable/disable mirroring at runtime via the set_option message (mirror_repl = true/false), but only if allow_mirror is true.

The initial mirror state is read from the user's Preferences configuration.

allow_restart

By default, sessions can be restarted via the agent (manage_repl(command="restart")), directly from the REPL (Gate.restart()), or from the TUI Sessions tab (r key). All three methods use execvp – the process image is replaced with a fresh Julia, same PID, same terminal, fresh state. The session key is preserved so the TUI and agents reconnect seamlessly.

Set allow_restart=false to disable this:

julia
serve(tools=my_tools, allow_restart=false)

Both agent-initiated and REPL-initiated restarts will be blocked. The agent will see a warning message and must restart the process manually (or rely on Revise for hot-reloading).

Complete Example

A minimal application with custom tools:

julia
# my_app.jl
module MyApp

using Kaimon.Gate: GateTool, serve

# Domain types
@enum Status pending running done

struct Job
    id::Int
    name::String
    status::Status
end

# In-memory state
const JOBS = Job[]

# Tool handlers
"""Create a new job with the given name."""
function create_job(name::String)
    id = length(JOBS) + 1
    job = Job(id, name, pending)
    push!(JOBS, job)
    "Created job #$id: $name"
end

"""List all jobs, optionally filtered by status."""
function list_jobs(status::Union{Status, Nothing}=nothing)
    filtered = status === nothing ? JOBS : filter(j -> j.status == status, JOBS)
    join(["#$(j.id) $(j.name) [$(j.status)]" for j in filtered], "\n")
end

function run()
    serve(
        tools=[
            GateTool("create_job", create_job),
            GateTool("list_jobs", list_jobs),
        ],
        namespace="myapp",
        force=true,
    )
end

end # module

MyApp.run()

Run it with julia --project my_app.jl. The agent will see myapp_create_job and myapp_list_jobs as available tools, with schemas generated from the function signatures and docstrings.

TCP Mode

By default, the Gate uses IPC (Unix domain sockets) for local communication. For remote sessions — servers, cloud instances, HPC nodes — use TCP mode:

julia
Gate.serve(mode=:tcp, port=10005, stream_port=10007, force=true)

This binds the REP socket on port and the PUB socket on stream_port. Both ports are printed on startup:

⚡ Kaimon gate connected (myproject)
  TCP mode: tcp://127.0.0.1:10005 (PUB: tcp://127.0.0.1:10007)
  Auth: none (lax mode)

SSH Tunneling

To connect to a remote gate through an SSH tunnel, use fixed ports (not ephemeral) and tunnel both:

bash
ssh -L 10006:localhost:10005 -L 10008:localhost:10007 remote-host

Then configure in Kaimon's Config tab with host 127.0.0.1, port 10006, stream port 10008.

Environment Variables

TCP mode can be configured via environment variables:

VariableDescriptionDefault
KAIMON_GATE_MODE"ipc" or "tcp""ipc"
KAIMON_GATE_HOSTBind address"127.0.0.1"
KAIMON_GATE_PORTREP socket port0 (ephemeral)
KAIMON_GATE_STREAM_PORTPUB socket port0 (ephemeral)
KAIMON_GATE_TOKENAuth token(none)

Setting KAIMON_GATE_PORT automatically implies TCP mode.

kaimon.toml Configuration

Add a [gate] section to your project's kaimon.toml for automatic TCP gate startup:

toml
[gate]
mode = "tcp"
port = 10005
stream_port = 10007
host = "0.0.0.0"
force = true

When Gate.serve() is called (e.g., from startup.jl), it reads this configuration automatically.

Authentication

TCP mode supports token-based authentication. Priority: KAIMON_GATE_TOKEN env var > security config API key > none (lax mode).

When a token is set, every request must include it. The token is displayed on startup and can be queried with Gate.status().

Background Jobs

When an ex() evaluation exceeds 30 seconds, it's automatically promoted to a background job. The agent receives the job ID immediately and can continue working.

Checking Status

check_eval(eval_id="abc123")

Returns status, elapsed time, and the full result if completed.

Stashing Intermediate Values

Running code can report intermediate values using Gate.stash():

julia
for epoch in 1:100
    loss = train_epoch!(model)
    Gate.stash("epoch", epoch)
    Gate.stash("loss", loss)
    Gate.progress("Epoch $epoch: loss=$loss")
end

The agent sees stashed values when calling check_eval:

Stashed values:
  epoch = 42
  loss = 0.0231

Cooperative Cancellation

The agent can cancel a background job:

cancel_eval(eval_id="abc123")

Running code must check Gate.is_cancelled() cooperatively:

julia
for epoch in 1:1000
    Gate.is_cancelled() && break
    loss = train_epoch!(model)
    Gate.stash("epoch", epoch)
end

Listing Jobs

list_jobs(stats=true)

Shows all background jobs with status, elapsed time, and aggregate statistics.

Persistence

Background jobs are stored in SQLite and survive TUI restarts. On restart, Kaimon reconciles stale jobs by querying gate sessions for cached results.

Streaming Progress

Gate.progress(message) sends real-time SSE progress notifications from within a GateTool handler:

julia
tool = GateTool("compile_kernel", function(name::String)
    progress("Parsing $name...")
    # ...
    progress("Optimizing $name...")
    # ...
    return "Compiled $name"
end)

Progress messages are visible in the Kaimon TUI Activity tab and delivered to the MCP client.