Multi Directories CRAWL

[antonpanin]

Hello forum .
Here is my situation .
I run joomla site on shared hosting server , now have around 60.000+ articles . I used Xmap to generate sitemaps . Using Xmap component i created separate sitemap for each STATE (By state i mean actual USA States , Course articles goes be States and cities ) so i can submit separate sitemap to google and be indexed quickly (its 40.000+ indexed already) , but seance iam on shared hosting , i running to a problem of timeout or exeded memory , becourse each sitemap and article  category has growing to more then 10.000+ each , and when memory exeded that i can use on hosting its give me error and of course Google cant pull full sitemap . Thats the problem .

My qustions is :

Would i be able to create or point XML script/bot to crawl separate directories so script can create separate  simemaps ?(like: articles categories , exp: by state or city) ?
Exp:
1. sitemap : points to http://www.  [ External links are visible to forum administrators only ]
Output : http:// www.  [ External links are visible to forum administrators only ]

2. sitemap : points to http:// www. [ External links are visible to forum administrators only ]
Output : http:// www.  [ External links are visible to forum administrators only ]

and etc.....

Or the script runs through all link and output only 1 file ?

Also is is possible to create limit of links that scrips creating to sitemap for specific directory ?
Exp.

1. sitemap : points to http://www.  [ External links are visible to forum administrators only ]    (limit set to 4000 links )
Output : http:// www.  [ External links are visible to forum administrators only ]
             http:// www.  [ External links are visible to forum administrators only ]
             http:// www.  [ External links are visible to forum administrators only ]


1. sitemap : points to http://www.  [ External links are visible to forum administrators only ]    (limit set to 4000 links )
Output : http:// www.  [ External links are visible to forum administrators only ] Alabama/sitemap.newyork.1page4000.xml
             http:// www.  [ External links are visible to forum administrators only ] /Alabama/sitemap.newyork.2page4000.xml
             http:// www.  [ External links are visible to forum administrators only ] /Alabama/sitemap.newyork.3page4000.xml

I hope i explained my situation clearly , if not please point me ....

All this be course iam on the shared hosting and sitemaps too large for server to create output .

Ready to buy script , just need to clarify this things .

Thanks allot in advance , very hope this script can do what i need .
Please PM me if so or post here ,\.

[XML-Sitemaps Support]

Hello,

it's possible to create sitemaps for each directory, you would need to specify corresponding directory as Starting URL for sitemap generator.

[antonpanin]

Hello,

it's possible to create sitemaps for each directory, you would need to specify corresponding directory as Starting URL for sitemap generator.

Thnk you for quick respond , but is it possible to follow this formula ?Below
So it will be multy sitemaps (with lets say 4000 links limit ) for only 1 specific category ?

1. sitemap : points to [external links are visible to admins only].  [ External links are visible to forum administrators only ]    (limit set to 4000 links )
Output : http:// www.  [ External links are visible to forum administrators only ]
             http:// www.  [ External links are visible to forum administrators only ]
             http:// www.  [ External links are visible to forum administrators only ]


1. sitemap : points to [external links are visible to admins only].  [ External links are visible to forum administrators only ]    (limit set to 4000 links )
Output : http:// www.  [ External links are visible to forum administrators only ] Alabama/sitemap.newyork.1page4000.xml
             http:// www.  [ External links are visible to forum administrators only ] /Alabama/sitemap.newyork.2page4000.xml
             http:// www.  [ External links are visible to forum administrators only ] /Alabama/sitemap.newyork.3page4000.xml

[XML-Sitemaps Support]

Hello,

you can limit the number of URLs per sitemap file to 4000 and sitemap generator will create multiple sitemap files automatically.

[antonpanin]

THNK ALLOT , Just what i need .
I more question . Is there option to avoid duplicates ?

[XML-Sitemaps Support]

There won't be duplicate URLs in sitemap, it's auomtatically tracked.