SE Bot Simulation Results

Webpage URL

Page layout as seen by the robots

Received HTTP Headers

HTTP/1.1 302 Found
Date: Wed, 29 Jun 2022 15:52:35 GMT
Server: Apache
Location: https://semrush.sjv.io/c/3405087/1017017/13053?subId1=xml_text&subId2=tools
Content-Length: 0
Connection: close
Content-Type: text/html; charset=UTF-8

Internal Links Found

blockRestricted with robots.txt

blockRestricted with rel="nofollow" attribute

External URLs

Our search engine robot simulator shows how your website pages are seen from the search engine point of view. It will list all links on the pages and separate them into sections for links that are:

1. Internal Links
2. Links restricted by robots.txt
3. Links that are restricted by nofollow attribte
4. External links

It will also show you all text on the pages that is spidered in the order of detection.