sweepshark.com
robots.txt

Robots Exclusion Standard data for sweepshark.com

Resource Scan

Scan Details

Site Domain sweepshark.com
Base Domain sweepshark.com
Scan Status Ok
Last Scan2025-08-17T23:50:55+00:00
Next Scan 2025-09-16T23:50:55+00:00

Last Scan

Scanned2025-08-17T23:50:55+00:00
URL https://sweepshark.com/robots.txt
Domain IPs 104.18.33.62, 172.64.154.194, 2606:4700:4400::6812:213e, 2606:4700:4400::ac40:9ac2
Response IP 104.18.33.62
Found Yes
Hash cee543ff719e72774be5de0b601b39d95507969ddcfe96c69442c9bbd0981567
SimHash fd28b8a8efb3

Groups

*

Rule Path
Disallow /?
Disallow *action%3D
Disallow /auth
Disallow /feed/