thehandbook.com
robots.txt

Robots Exclusion Standard data for thehandbook.com

Resource Scan

Scan Details

Site Domain thehandbook.com
Base Domain thehandbook.com
Scan Status Ok
Last Scan2025-10-03T07:28:25+00:00
Next Scan 2025-10-10T07:28:25+00:00

Last Scan

Scanned2025-10-03T07:28:25+00:00
URL https://thehandbook.com/robots.txt
Redirect https://www.thehandbook.com/robots.txt
Redirect Domain www.thehandbook.com
Redirect Base thehandbook.com
Domain IPs 104.26.12.174, 104.26.13.174, 172.67.74.154, 2606:4700:20::681a:cae, 2606:4700:20::681a:dae, 2606:4700:20::ac43:4a9a
Redirect IPs 104.26.12.174, 104.26.13.174, 172.67.74.154, 2606:4700:20::681a:cae, 2606:4700:20::681a:dae, 2606:4700:20::ac43:4a9a
Response IP 104.26.12.174
Found Yes
Hash 613b5a92473283260a0be1f6179a983e695b430cbf3ac6abbcbb38d9dcfd0187
SimHash 5c0a18c0f42b

Groups

*

Rule Path
Disallow /wp/wp-admin/
Allow /wp/wp-admin/admin-ajax.php

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

siteauditbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

*

Rule Path
Disallow /login/

*

Rule Path
Disallow /wp-json/
Disallow /?rest_route=

Other Records

Field Value
sitemap https://www.thehandbook.com/sitemap.xml
sitemap https://www.thehandbook.com/sitemap.xml?postType=editorial
sitemap https://www.thehandbook.com/sitemap.xml?postType=thb_celebrity

Comments

  • START SemRush
  • ---------------------------
  • ---------------------------
  • END SemRush
  • START Misc
  • ---------------------------
  • ---------------------------
  • END Misc
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK