Toggle navigation
PRO Sitemaps
Standalone Generator
About Sitemaps
News
SEO Tools
Sitemap Generator Forum
Guest
Login
Register
Menu
Home
Help
Search
Login
Register
XML Sitemaps Discussions Category
/
Unlimited PHP Sitemap Generator
/
Am I crazy?
Start solving your marketing challenges today with 50+ tools and reports on Semrush.
Get started for free
« previous
next »
Pages:
1
ONC Hosting
9
Am I crazy?
«
on:
March 25, 2007, 02:57:26 PM »
Is it my imagination or does the script use more resources and get slower as it crawls...
My site is about 1.5 million pages. I am on 200,000 pages in my crawl and it is going MUCH slower than in the early pages...
Am I right?
Logged
XML-Sitemaps Support
11650
Re: Am I crazy?
«
Reply #1 on:
March 25, 2007, 11:33:55 PM »
Hello,
yes, it is possible that crawling becomes slower when significant amount of pages are already crawled, the actual decrease in speed depends on the number of pages and server configuration.
Logged
Oleg Ignatiuk
https://www.xml-sitemaps.com
Send me a Private Message
Gain New Customers Today! Click here
.
Pages:
1
« previous
next »