Import from a sitemap

Where it is: Knowledge → Add & Sources → Add Knowledge → Sitemap.

A sitemap is the list of pages a site wants indexed. Importing from one is almost always better than crawling by following links: you get exactly the pages the site considers real, in one pass, with nothing unexpected dragged in behind them.

Do this

1. Paste the sitemap address — usually https://example.com/sitemap.xml, or /wp-sitemap.xml on a WordPress site.
2. Set a page limit. Start low on an unfamiliar site; you can always run it again.
3. Leave Skip archive pages ticked unless you have a reason not to — category, tag, author and date listings only repeat content that is already indexed from its own page.
4. Start the import. Progress is shown live and can be paused.

Sitemap or Website URL?

• Sitemap means sitemap. If none is found at the address you gave, you get an error rather than a link-following crawl you did not ask for.
• Website URL looks for a sitemap first (/sitemap.xml, /sitemap_index.xml, /wp-sitemap.xml) and falls back to following links when there is none.

Sitemap indexes are followed, so a site that splits pages, posts and products across several sitemaps still imports in one go.

Notes

• Both options use the engine described in Crawl a website: same domain only, robots.txt respected, unchanged pages skipped on a repeat, vanished pages removed.
• Per-page status, retries and exclusions live on the Website Crawl screen.
• For a WordPress site you control, syncing beats crawling — the sync reads custom fields and page-builder layouts that the public HTML does not expose.