runcrawl error

[paul107]

So I've been trying to generate a sitemap, but the sitemap that results does not include a significant part of my site.

I notice that some forum recommendations for this problem include running runcrawl.php. When I try that, I get the following error:

/generator/runcrawl.php: 102: Syntax error: redirection unexpected (expecting word)

Any ideas?

Thanks!

~paul

[XML-Sitemaps Support]

Hello,

what is the command line you use to run it?

[paul107]

I used:
/usr/bin/php /usr/home/xxxx/public_html/example.com/generator/runcrawl.php

As I recall, I found it on the same page with the Start Creating Sitemap button.

Thanks!

~paul

[XML-Sitemaps Support]

Please try
php /usr/home/xxxx/public_html/example.com/generator/runcrawl.php

[paul107]

Thanks Oleg.

When I try that, I get essentially the same result as when I use the "Start Creating Sitemap" button at the create sitemap page.

The output on the command line shows:
Resuming the last session (last updated: 2020-12-10 05:01:26)

// Numbers with what looks to be the timing

<h4>Crawling phase completed</h4>Total pages indexed: 1235

and so on.

I am still not crawling the entire site as there are a lot of pages that are not included.

Thank you for your assistance.

~Paul

[XML-Sitemaps Support]

Hello,

could you please PM me your generator URL and an example URL that is not included in sitemap and how it can be reached starting from homepage?