Skip to content
Kitbay

firecrawl-knowledge-base

ISCUpdated on Nov 3, 2026222GitHub stars

A Firecrawl workflow skill for turning web pages or topics into organised text that a language model can use.

What the skill teaches

A Firecrawl workflow skill for turning web pages or topics into organised text that a language model can use. Documentation sites are mapped, topics are searched, and pages are scraped into Markdown that keeps code samples and tables, saved in a folder tree by hostname and path. The agent works out whether the output is for reference, retrieval chunks, training data or a docs mirror, asks only blocking questions, and can split collection across parallel sub-agents by docs section or source type. It relies on the Firecrawl CLI for mapping, search and scraping.

Capabilities

  • Mirror a documentation site as Markdown files
  • Build a topic corpus from web search
  • Prepare retrieval chunks or training data from web pages