it-handbook.com
robots.txt

Robots Exclusion Standard data for it-handbook.com

Resource Scan

Scan Details

Site Domain it-handbook.com
Base Domain it-handbook.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-19T18:45:21+00:00
Next Scan 2025-12-18T18:45:21+00:00

Last Successful Scan

Scanned2024-11-24T17:06:32+00:00
URL https://it-handbook.com/robots.txt
Domain IPs 94.16.106.197
Response IP 94.16.106.197
Found Yes
Hash 9d0c7859ebd631df4eb1ffcf260f57bbafdc4e6d3dd2519fb1983d571e1a7897
SimHash 4f70dd52e6b1

Groups

*

Rule Path
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /webstat/
Disallow /feed/
Disallow /trackback
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /*?*
Disallow /*?
Disallow /wp-content/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /category/
Disallow /comments
Disallow /page/
Disallow /page
Disallow /tag/
Disallow /20*
Disallow /author/
Disallow /user/
Allow /wp-content/uploads/

googlebot-image

Rule Path
Allow /*

yandex

Rule Path
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /webstat/
Disallow /feed/
Disallow /trackback
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /*?*
Disallow /*?
Disallow /wp-content/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /category/
Disallow /comments
Disallow /page/
Disallow /page
Disallow /tag/
Disallow /20*
Disallow /author/
Disallow /user/
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://it-handbook.com/sitemap.xml

Warnings

  • `host` is not a known field.