unwatch.org
robots.txt

Robots Exclusion Standard data for unwatch.org

Resource Scan

Scan Details

Site Domain unwatch.org
Base Domain unwatch.org
Scan Status Ok
Last Scan2025-04-15T06:16:28+00:00
Next Scan 2025-05-15T06:16:28+00:00

Last Scan

Scanned2025-04-15T06:16:28+00:00
URL https://unwatch.org/robots.txt
Domain IPs 194.1.147.28, 194.1.147.54
Response IP 194.1.147.54
Found Yes
Hash a383e54892505d1aa6dea7ff9a3facb985facdfe72b9e6c29a2eb6d7e2e2349c
SimHash 5a1cd4a06ba2

Groups

*

Rule Path
Disallow /*blackhole
Disallow /?blackhole

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

krzana bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10