krokodiler.se
robots.txt

Robots Exclusion Standard data for krokodiler.se

Resource Scan

Scan Details

Site Domain krokodiler.se
Base Domain krokodiler.se
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-06-13T08:07:43+00:00
Next Scan 2025-08-12T08:07:43+00:00

Last Successful Scan

Scanned2025-04-15T08:01:51+00:00
URL https://krokodiler.se/robots.txt
Redirect https://www.krokodiler.se/robots.txt
Redirect Domain www.krokodiler.se
Redirect Base krokodiler.se
Domain IPs 185.189.48.105, 2001:67c:750::26
Redirect IPs 185.189.48.105, 2001:67c:750::26
Response IP 185.189.48.105
Found Yes
Hash bdf3093ca5c30a5195bcc68cc86d57d89ad7cf3b93fc43139293e78e4acde0d2
SimHash 34094f41c1d7

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /includes/
Disallow /-UT-/

Other Records

Field Value
sitemap https://www.krokodiler.se/sitemap.xml

Comments

  • Robot-file for this website