synapses.polytechnique.fr
robots.txt

Robots Exclusion Standard data for synapses.polytechnique.fr

Resource Scan

Scan Details

Site Domain synapses.polytechnique.fr
Base Domain polytechnique.fr
Scan Status Ok
Last Scan2025-08-30T23:21:47+00:00
Next Scan 2025-09-29T23:21:47+00:00

Last Scan

Scanned2025-08-30T23:21:47+00:00
URL https://synapses.polytechnique.fr/robots.txt
Domain IPs 137.194.22.227, 2a04:8ec0:0:a::89c2:16e3
Response IP 137.194.22.227
Found Yes
Hash a49529f0cb113fc3353702341182fa876fd470724b5d9844a9ded09d8b40fc0e
SimHash 695cd9a28321

Groups

*

Rule Path
Allow /$
Allow /catalogue
Disallow /

Other Records

Field Value
crawl-delay 10

amazonbot

Rule Path
Allow /$
Allow /catalogue
Disallow /catalogue/*/ue
Disallow /