Stops adding urls
« on: February 26, 2013, 11:08:11 PM »
I Run the generator and it stops adding urls. I will see it scan a good url and it will ignore it and not add the url. Its also taking for ever. can you please check it out pm sent.
Re: Stops adding urls
« Reply #1 on: February 27, 2013, 02:11:14 AM »
I look at the crawl_dump.log and im geting "400 Bad Request";s:83:" it will have the link with the base url missing so it looks like /data/data/data/   instead of [ External links are visible to forum administrators only ]