• Welcome to Sitemap Generator Forum.
 

Txt files not broken down

Started by yoc, June 10, 2019, 06:06:44 PM

Previous topic - Next topic

yoc

After generating over 300k links and building sitemaps the urllist. txt map remains one big file. With limits of 50k set by search engines this is a problem. ROR file is also not split. Solution?


yoc

FROM google webmasters tools:

Sitemaps
/urllist.txt

Last read
6/11/19
Discovered URLs
50,000

Sitemap can be read, but has errors
Too many URLs
1 instance
Your Sitemap contains too many URLs. Please create multiple Sitemaps with up to 50000 URLs each and submit all Sitemaps.
Examples
Line 50001

yoc

FROM THE WEB:

According to source : A sitemap file can't contain more than 50,000 URLs and must be no larger than 10 MB uncompressed. If your Sitemap is larger than this, break it into several smaller Sitemaps. These limits help ensure that your web server is not overloaded by serving large files to Google.

yoc

FROM Google:
All formats limit a single sitemap to 50MB (uncompressed) and 50,000 URLs. If you have a larger file or more URLs, you will have to break your list into multiple sitemaps. You can optionally create a sitemap index file (a file that points to a list of sitemaps) and submit that single index file to Google. You can submit multiple sitemaps and/or sitemap index files to Google.

XML-Sitemaps Support

Hello,

you only need to submit xml sitemap to google, not the text (as it contains the same list of links).

yoc

I know I only NEED to send Google after the .xml file, but Googles crawls the .txt files way better, already Google has crawled and indexed the .txt files (I had to split them manually) way more aggressively than the .xml files (after many years) - been doing this since 1996.

Change is critical and the internet changes all the time....