Maximum Pages to Crawl? - Sitemap Generator Forum

Welcome to Sitemap Generator Forum.
Log in

January 20, 2026, 10:11:48 AM

News:

Sitemap Generator v7.2 - JSON-LD support and PHP7 compatiblity
Mobile App to manage your sitemaps

Main Menu

Home
Search

Competitor Analysis Tool: Analyze rival websites and gain valuable SEO and PPC insights

Maximum Pages to Crawl?

Started by mail57, March 06, 2010, 09:01:25 PM

Previous topic - Next topic

Print

Go Down Pages1

mail57

Registered Customer
Approved member
Posts: 3
Logged

Maximum Pages to Crawl?

March 06, 2010, 09:01:25 PM

I am trying to crawl a site to get a sitemap and find broken links but it just won't work

I am not sure if I have too many pages? It should have around 10k I think.

Thanks

XML-Sitemaps Support

Administrator
Hero Member
Posts: 11,802
Logged

Re: Maximum Pages to Crawl?

#1

March 08, 2010, 08:38:43 PM

Hello,

what exactly is the error you get?

Oleg Ignatiuk
https://www.xml-sitemaps.com
Send me a Private Message

SEM and SEO Reports, more than 45M domains: The world's leading Competitive Intelligence Tool for digital marketing.

Print

Go Up Pages1

User actions

Print