Robots.txt checker

Additional page content: Editable from the admin panel -> languages -> choose or create language -> translate app page.

Similar tools

Check if a website returns a proper 404 status code for missing pages.

Checks if a webpage is set to noindex, preventing it from appearing in search engines.

Get all the HTTP headers that an URL returns for a typical GET request.

457

Website status checker.

2,706

10,191

Get the web-host of a given website.

1,574

Check if the URL is cached or not by Google.

1,353

Get & verify the meta tags of any website.

1,247

Check whether a website is using the new HTTP/2 protocol or not.

1,236

Check whether a website is using the Brotli Compression algorithm or not.

1,225