Tool Discovery

Conceptual

How tools are indexed, retrieved and kept selectable as the catalogue grows.

Selection quality degrades if every tool is placed in context. Pimsy indexes the catalogue and retrieves a small, high-precision candidate set per step.

Indexing#

  • Each tool is embedded from its name, description, parameter semantics and example invocations.
  • Tools carry tags (read, write, finance, repo, communication) used as hard filters.
  • Historical outcome statistics per step archetype feed the ranking model.
  • Deprecated tools remain resolvable but are demoted and annotated with their replacement.

Retrieval budget#

Catalogue sizeCandidates in contextStrategy
< 30AllDirect listing
30–3008–12Semantic retrieval + tag filter
> 3006–10Two-stage: category routing, then retrieval within category
ts
const candidates = await pimsy.tools.search({
  goal: class="tok-str">"post a summary to the incident channel",
  scopes: [class="tok-str">"connector.slack", class="tok-str">"connector.pagerduty"],
  limit: class="tok-num">8
});

Last updated 2026-09-02