danielauslan.com
robots.txt

Robots Exclusion Standard data for danielauslan.com

Resource Scan

Scan Details

Site Domain danielauslan.com
Base Domain danielauslan.com
Scan Status Ok
Last Scan2025-09-17T14:10:23+00:00
Next Scan 2025-10-17T14:10:23+00:00

Last Scan

Scanned2025-09-17T14:10:23+00:00
URL https://danielauslan.com/robots.txt
Domain IPs 104.21.48.71, 172.67.181.50, 2606:4700:3033::ac43:b532, 2606:4700:3035::6815:3047
Response IP 104.21.48.71
Found Yes
Hash 71baf130c2de88b012f10efa3e6f142f87680690dbc05b19a3211eb748f42c8f
SimHash 184c4840e113

Groups

*

Rule Path
Disallow /wp-json/
Disallow /?rest_route=

adsbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://danielauslan.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK