whowatch.tv
robots.txt

Robots Exclusion Standard data for whowatch.tv

Resource Scan

Scan Details

Site Domain whowatch.tv
Base Domain whowatch.tv
Scan Status Ok
Last Scan2024-11-16T16:24:16+00:00
Next Scan 2024-11-23T16:24:16+00:00

Last Scan

Scanned2024-11-16T16:24:16+00:00
URL https://whowatch.tv/robots.txt
Domain IPs 13.225.4.105, 13.225.4.27, 13.225.4.30, 13.225.4.58
Response IP 13.225.4.30
Found Yes
Hash 2f54eeea513e9388e9570ac2a2a0048aff272f391b8ae74bf41f40bf80332330
SimHash 4808c014c7b1

Groups

*

Rule Path
Disallow /live-achievements
Disallow /viewer/
Disallow /sp/viewer/
Disallow /points/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

facebookexternalhit

Rule Path
Allow /viewer/
Allow /sp/viewer/

twitterbot

Rule Path
Allow /viewer/
Allow /sp/viewer/