Search Engine Robot Simulator

SE Bot Simulation Results

Webpage URL

https://www.xml-sitemaps.com/http-headers-viewer.html

Page layout as seen by the robots

 PRO Sitemaps code Unlimited Generator About Sitemaps News Forum SEO Tools HTTP Headers Viewer SEO Tool that allows you to see HTTP headers for any specific webpage URL HTTP Headers Viewer HTTP Header is a part of response sent by your server with a requested page. It includes details like Response Code (success, redirect etc.), Content type, Last modification time, Server Identifier an others. This tool lets you see the http headers for any given URL. Webpage URL User Agent (crawler bot type) XML-Sitemaps Google Yahoo MSN Browser-mode  On Page SEO Checker: Get a list of improvements for your website for free in less than 5 minutes! settings SEO Tools Validate XML Sitemap Search Engine Robot Simulator HTTP Headers Viewer  Try Other SEO Tools:Traffic Analytics, Organic Research and others Privacy policy Contact Pro Sitemaps Our sitemap: XML, HTML, Images, Video, News © 2005-2022 XML-Sitemaps Got it! This website uses cookies to ensure you get the best experience on our website. Learn more

Received HTTP Headers

HTTP/1.1 200 OK
Date: Wed, 29 Jun 2022 15:42:07 GMT
Server: Apache
Connection: close
Transfer-Encoding: chunked
Content-Type: text/html; charset=UTF-8

Internal Links Found

1 open_in_new search
2 open_in_new search
3 open_in_new search
4 open_in_new search
5 open_in_new search
6 open_in_new search
7 open_in_new search
8 open_in_new search
9 open_in_new search
10 open_in_new search
11 open_in_new search
12 open_in_new search
13 open_in_new search
14 open_in_new search
15 open_in_new search
16 open_in_new search
17 open_in_new search
18 open_in_new search
19 open_in_new search
20 open_in_new search

blockRestricted with robots.txt

none found

blockRestricted with rel="nofollow" attribute

1 open_in_new search

External URLs

1 open_in_new search
Start solving your marketing challenges today with 50+ tools and reports on Semrush. Get started for free

Our search engine robot simulator shows how your website pages are seen from the search engine point of view. It will list all links on the pages and separate them into sections for links that are:

  1. Internal Links
  2. Links restricted by robots.txt
  3. Links that are restricted by nofollow attribte
  4. External links
It will also show you all text on the pages that is spidered in the order of detection.

Tools for Any SEO Challenge: Get more traffic to your website with versatile solutions for every step of your SEO journey.

settings SEO Tools

Validate XML Sitemap
Search Engine Robot Simulator
HTTP Headers Viewer
Try Other SEO Tools:
Traffic Analytics, Organic Research and others
Got it!
This website uses cookies to ensure you get the best experience on our website. Learn more