1049thesurf.com
robots.txt

Robots Exclusion Standard data for 1049thesurf.com

Resource Scan

Scan Details

Site Domain 1049thesurf.com
Base Domain 1049thesurf.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-04T18:24:52+00:00
Next Scan 2025-02-02T18:24:52+00:00

Last Successful Scan

Scanned2024-01-10T13:49:44+00:00
URL https://1049thesurf.com/robots.txt
Domain IPs 34.194.190.118, 34.202.173.169
Response IP 34.202.173.169
Found Yes
Hash c0c7edb38ce374ecf7a1f01da268721ac782dc612347434beeb4b296adb18a7e
SimHash 281d5080e990

Groups

*

Rule Path
Disallow /newsletter/
Disallow /nc/

googlebot

Rule Path
Disallow /halfpriceoutlet/

semrushbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /