We are happy to announce the new and free Crawler Simulator with which you could download a webpage in the same way as a web crawler/web robot do. Enter the URL or the domain name and click on the Check Button to test a webpage.
To be easier to copy & paste the source code and to read the code two links were added to the code results. The first (Open in a new window) opens a new window and prints out the source code. The second (Open in a New Window with Highlighting) highlights the code of the page. Note that, this is currently in a beta phase.
What can you do with Crawler Simulator?
Crawler simulator could be used to:
check what a webrobot sees form a webpage
check the source code of a webpage
How it works?
A web crawler fetches the webpage you enter, and the result that the webserver gives back will be printed out. Note that the result contains the header information as well.
New Free SEO Tool: Crawler Simulator
We are happy to announce the new and free Crawler Simulator with which you could download a webpage in the same way as a web crawler/web robot do. Enter the URL or the domain name and click on the Check Button to test a webpage.
To be easier to copy & paste the source code and to read the code two links were added to the code results. The first (Open in a new window) opens a new window and prints out the source code. The second (Open in a New Window with Highlighting) highlights the code of the page. Note that, this is currently in a beta phase.
What can you do with Crawler Simulator?
Crawler simulator could be used to:
How it works?
A web crawler fetches the webpage you enter, and the result that the webserver gives back will be printed out. Note that the result contains the header information as well.