Enter your home page and our server crawls the site the way a search engine does: it follows links on the same host, obeys robots.txt and Crawl-delay, and visits up to 200 pages (or about 45 seconds). Pages that redirect, return errors, are not HTML, carry a noindex tag or name a different canonical URL are left out and listed with the reason.
The URLs appear in an editable list, so you can remove pages or add ones the crawler could not reach. The sitemap.xml is written in your browser, with optional lastmod dates from the Last-Modified header, changefreq and priority by click depth.
How to use the XML Sitemap Generator tool
- Enter your site's home page and choose how many pages to crawl.
- Click Crawl site and wait up to a minute.
- Check the list of URLs, edit it if needed, and choose lastmod, changefreq and priority options.
- Click Download sitemap.xml, upload it to your site and submit it in Google Search Console.
Why use ToolOrca XML Sitemap Generator
- Same-host crawl of up to 200 pages that respects robots.txt
- Skips redirects, errors, non-HTML files, noindex and non-canonical pages
- Editable URL list before the XML is written
- Optional lastmod (from Last-Modified), changefreq and depth-based priority
- Shows skipped pages with the reason
- Valid sitemaps.org XML, ready to upload
When a crawler-made sitemap is enough
For small sites (up to a few hundred pages) that change rarely, a generated sitemap works well. Regenerate it after adding or removing pages. Sites built with WordPress, Shopify, Wix or most static site generators can create and update a sitemap automatically; use that if you have it.
The crawler only finds pages that are linked from other pages. Orphan pages, pages behind forms and links added by JavaScript are missed; add them to the list by hand.
After you upload the sitemap
Add Sitemap: https://your-domain/sitemap.xml to robots.txt, submit the sitemap in Google Search Console and check it with the sitemap validator. Search Console then reports how many of the listed pages are indexed and why others are not.
Frequently asked questions
Why are some of my pages missing?
They were not linked from the crawled pages, were blocked by robots.txt, had noindex or another canonical URL, or the 200-page / 45-second limit was reached. The summary says which.
Does it include images or hreflang?
No, it writes a standard URL sitemap. Image and hreflang entries can be added by hand; the hreflang generator writes the XML for language versions.
Is priority useful?
Google ignores priority and changefreq, so they are off by default. Accurate lastmod dates are more useful.
Will the crawl slow down my site?
No. It fetches at most three pages at a time (one at a time when robots.txt sets a Crawl-delay) and stops at 200 pages.
Is the page I check stored anywhere?
No. Our server downloads the page once to analyse it, keeps the result in memory for a few minutes so a repeat check is instant, and stores nothing. Private and local addresses (localhost, 192.168.x.x, 10.x.x.x, .local names) are refused.