wpt.fyi
robots.txt

Robots Exclusion Standard data for wpt.fyi

Resource Scan

Scan Details

Site Domain wpt.fyi
Base Domain wpt.fyi
Scan Status Ok
Last Scan2024-10-05T11:07:49+00:00
Next Scan 2024-11-04T11:07:49+00:00

Last Scan

Scanned2024-10-05T11:07:49+00:00
URL https://wpt.fyi/robots.txt
Domain IPs 2001:4860:4802:32::15, 2001:4860:4802:34::15, 2001:4860:4802:36::15, 2001:4860:4802:38::15, 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Response IP 216.239.38.21
Found Yes
Hash 206969c8f1b7766c4bda7727f67eb3fb422b2eb1f74f6c5de3a96f86bf2bae10
SimHash 4d104404ed12

Groups

*

Rule Path
Disallow /api/