Zum Inhalt springen
Kitbay

firecrawl-knowledge-base

ISCAktualisiert am 3. Nov. 2026222GitHub-Sterne

A Firecrawl workflow skill for turning web pages or topics into organised text that a language model can use.

Was der Skill vermittelt

A Firecrawl workflow skill for turning web pages or topics into organised text that a language model can use. Documentation sites are mapped, topics are searched, and pages are scraped into Markdown that keeps code samples and tables, saved in a folder tree by hostname and path. The agent works out whether the output is for reference, retrieval chunks, training data or a docs mirror, asks only blocking questions, and can split collection across parallel sub-agents by docs section or source type. It relies on the Firecrawl CLI for mapping, search and scraping.

Funktionen

  • Mirror a documentation site as Markdown files
  • Build a topic corpus from web search
  • Prepare retrieval chunks or training data from web pages