mathsbook.fr
robots.txt

Robots Exclusion Standard data for mathsbook.fr

Resource Scan

Scan Details

Site Domain mathsbook.fr
Base Domain mathsbook.fr
Scan Status Ok
Last Scan2024-09-25T04:35:13+00:00
Next Scan 2024-10-02T04:35:13+00:00

Last Scan

Scanned2024-09-25T04:35:13+00:00
URL https://mathsbook.fr/robots.txt
Domain IPs 104.21.14.26, 172.67.157.167, 2606:4700:3031::6815:e1a, 2606:4700:3036::ac43:9da7
Response IP 104.21.14.26
Found Yes
Hash efe29b141a740206e2bc7c1a13a1c8fd6a709ad4de8d19f383117ea2c3557385
SimHash ba5ee2a18732

Groups

amazonbot

Rule Path
Disallow /

Warnings

  • 29 invalid lines.
  • `iuser-agent` is not a known field.