Terrible Bandwidth Usage
« on: April 15, 2014, 11:55:55 PM »
Hi,

xml-sitemap is using 4GB of Bandwidth for 1269 indexed pages every day/time.

(Pages processed: 2885 - Pages fetched: 2871 - Sitemap files: 1 - Crawled pages size: 36.273Mb
Network transfer time: 0:26:03s - Top memory usage: 4.42Mb).

2 months ago xml-sitemap was using about -10x for the same content.

¿What's the problem? I know I could make less sitemaps. But I need to do it all days (Google news, etc)

Where Could I find the solution?

Thanks.

regards.

Alx

Re: Terrible Bandwidth Usage
« Reply #1 on: April 16, 2014, 06:11:55 AM »
Hello,

from what I see bandwidth is just about 36M:
Crawled pages size: 36.273Mb
Re: Terrible Bandwidth Usage
« Reply #2 on: April 16, 2014, 08:21:27 AM »
Yes sure... in xml-sitemaps.

But in server (Cpanel) cost between 1-4 GB!!

That's very strange because months ago works fine with the same config.

I'm really crazy about it.

Thanks.
Re: Terrible Bandwidth Usage
« Reply #3 on: April 16, 2014, 12:05:17 PM »
Those are requests from visitors/search engine bots, not from generator.
Re: Terrible Bandwidth Usage
« Reply #4 on: April 16, 2014, 12:30:18 PM »
NO, no. Is generator xml-sitemaps by myself. I check it. I check is my IP. The traffic begin and end with cron jobs (Manual too).