critic.de
robots.txt
Robots Exclusion Standard data for critic.de
Resource Scan
Scan Details
Site Domain | critic.de |
Base Domain | critic.de |
Scan Status | Ok |
Last Scan | 2024-11-10T18:37:57+00:00 |
Next Scan | 2024-11-17T18:37:57+00:00 |
Last Scan
Scanned | 2024-11-10T18:37:57+00:00 |
URL | https://critic.de/robots.txt |
Redirect | https://www.critic.de/robots.txt |
Redirect Domain | www.critic.de |
Redirect Base | critic.de |
Domain IPs | 89.110.149.182 |
Redirect IPs | 89.110.149.182 |
Response IP | 89.110.149.182 |
Found | Yes |
Hash | f75475e82f173204c2d6e15ae7e9022680ebc84316411667333f6e83ea66ecd6 |
SimHash | 0dd4c151ac12 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /person/ |
Disallow | /ov-movies-berlin/cinema/ |
Disallow | /ov-movies-berlin/movie/ |