alien-covenant.com
robots.txt

Robots Exclusion Standard data for alien-covenant.com

Resource Scan

Scan Details

Site Domain alien-covenant.com
Base Domain alien-covenant.com
Scan Status Ok
Last Scan2024-11-05T05:34:18+00:00
Next Scan 2024-11-12T05:34:18+00:00

Last Scan

Scanned2024-11-05T05:34:18+00:00
URL https://alien-covenant.com/robots.txt
Redirect https://www.alien-covenant.com/robots.txt
Redirect Domain www.alien-covenant.com
Redirect Base alien-covenant.com
Domain IPs 69.167.172.216
Redirect IPs 69.167.172.216
Response IP 69.167.172.216
Found Yes
Hash 57721c8f5286fc116ba0b87035df43b3f755a0e7510f853c229f5ea8a13e46be
SimHash 6c526875c7e3

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

*

Rule Path
Disallow /cgi-bin/
Disallow /markitup/
Disallow /bbeditor/
Disallow /bbcode/
Disallow /_private/
Disallow /_vti_bin/
Disallow /_vti_cnf/
Disallow /_vti_log/
Disallow /_vti_pvt/
Disallow /_vti_txt/
Disallow /libs/
Disallow /nbbc/
Disallow /smileys/
Disallow /secure/
Disallow /templates/
Disallow /templates_c/

googlebot
slurp
bingbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.alien-covenant.com/sitemap.xml