thesfmarathon.com
robots.txt

Robots Exclusion Standard data for thesfmarathon.com

Resource Scan

Scan Details

Site Domain thesfmarathon.com
Base Domain thesfmarathon.com
Scan Status Ok
Last Scan2025-09-21T04:58:24+00:00
Next Scan 2025-10-21T04:58:24+00:00

Last Scan

Scanned2025-09-21T04:58:24+00:00
URL https://thesfmarathon.com/robots.txt
Redirect http://www.thesfmarathon.com/robots.txt
Redirect Domain www.thesfmarathon.com
Redirect Base thesfmarathon.com
Domain IPs 104.21.74.23, 172.67.153.109, 2606:4700:3032::6815:4a17, 2606:4700:3035::ac43:996d
Redirect IPs 104.21.74.23, 172.67.153.109, 2606:4700:3032::6815:4a17, 2606:4700:3035::ac43:996d
Response IP 104.21.74.23
Found Yes
Hash b5a38e270175af06e21189f7006a647036fae55f6f8de6bbe9e036981986f272
SimHash e94cccc0a41b

Groups

*

Rule Path
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/

Other Records

Field Value
sitemap https://www.thesfmarathon.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 1 invalid line.