20min.fr
robots.txt

Robots Exclusion Standard data for 20min.fr

Resource Scan

Scan Details

Site Domain 20min.fr
Base Domain 20min.fr
Scan Status Ok
Last Scan2024-09-22T02:12:57+00:00
Next Scan 2024-09-29T02:12:57+00:00

Last Scan

Scanned2024-09-22T02:12:57+00:00
URL https://www.20min.fr/robots.txt
Domain IPs 104.22.12.160, 104.22.13.160, 172.67.23.12, 2606:4700:10::6816:ca0, 2606:4700:10::6816:da0, 2606:4700:10::ac43:170c
Response IP 104.22.13.160
Found Yes
Hash fd89345af6aca5dab85f2aa6a830e270a362b1fa6b5f19607ddd773a081ed651
SimHash 6550c5446511

Groups

*

No rules defined. All paths allowed.