astutium.com
robots.txt

Robots Exclusion Standard data for astutium.com

Resource Scan

Scan Details

Site Domain astutium.com
Base Domain astutium.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-06T22:03:16+00:00
Next Scan 2024-12-05T22:03:16+00:00

Last Successful Scan

Scanned2024-07-16T22:01:40+00:00
URL https://astutium.com/robots.txt
Domain IPs 2001:4bf0:1:0:100:0:10:12, 80.76.216.246
Response IP 80.76.216.246
Found Yes
Hash 1d905ab096b6869049cbe3a28d825b4e44056851bd5c9a5e5c904f11cc16ef00
SimHash 84776386c23b

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /images/
Disallow /modules/
Disallow /othellocode/
Disallow /status/
Disallow /private/
Disallow /whois.php

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.