curl.se
robots.txt

Robots Exclusion Standard data for curl.se

Resource Scan

Scan Details

Site Domain curl.se
Base Domain curl.se
Scan Status Ok
Last Scan2025-06-16T16:15:54+00:00
Next Scan 2025-06-30T16:15:54+00:00

Last Scan

Scanned2025-06-16T16:15:54+00:00
URL https://curl.se/robots.txt
Domain IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91, 2a04:4e42:200::347, 2a04:4e42:400::347, 2a04:4e42:600::347, 2a04:4e42:800::347, 2a04:4e42::347, 2a04:4e42:a00::347, 2a04:4e42:c00::347, 2a04:4e42:e00::347
Response IP 151.101.129.91
Found Yes
Hash 5c70a80b658bfa44c7f91338d8a41c91dec47ad8bea7ddd310242bfcebeb5176
SimHash b900e846cdb2

Groups

*

Rule Path
Disallow /dev/log.cgi

Comments

  • no point in indexing these