bestflix.pl
robots.txt
Robots Exclusion Standard data for bestflix.pl
Resource Scan
Scan Details
Site Domain | bestflix.pl |
Base Domain | bestflix.pl |
Scan Status | Ok |
Last Scan | 2024-10-31T03:56:17+00:00 |
Next Scan | 2024-11-07T03:56:17+00:00 |
Last Scan
Scanned | 2024-10-31T03:56:17+00:00 |
URL | https://bestflix.pl/robots.txt |
Domain IPs | 104.21.94.131, 172.67.136.79, 2606:4700:3034::6815:5e83, 2606:4700:3034::ac43:884f |
Response IP | 172.67.136.79 |
Found | Yes |
Hash | ecff12de842315558e3daeca97061be42e1148cab87e669d5b8c290b38afb05b |
SimHash | 709cd142c819 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /search/ |
Disallow | /external/* |
Disallow | /blog |
Disallow | /go/* |