co-optimus.com
robots.txt

Robots Exclusion Standard data for co-optimus.com

Resource Scan

Scan Details

Site Domain co-optimus.com
Base Domain co-optimus.com
Scan Status Ok
Last Scan2024-05-01T04:31:51+00:00
Next Scan 2024-05-08T04:31:51+00:00

Last Scan

Scanned2024-05-01T04:31:51+00:00
URL https://co-optimus.com/robots.txt
Redirect https://www.co-optimus.com/robots.txt
Redirect Domain www.co-optimus.com
Redirect Base co-optimus.com
Domain IPs 67.225.129.104
Redirect IPs 67.225.129.104
Response IP 67.225.129.104
Found Yes
Hash 7f7737ab512088af6be5bcc410e08a5a4747272d49b24c58e93f48f1125b8c93
SimHash 29161af64594

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /cgi-bin/
Disallow /cache/
Disallow /js/
Disallow /rss/
Disallow /dev/
Disallow /ajax/
Disallow /includes/
Disallow /admin/
Disallow /db.php
Disallow /ajax_*
Allow /

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /cache/
Disallow /js/
Disallow /rss/
Disallow /dev/
Disallow /admin/
Disallow /twitter/
Disallow /db.php
Disallow /ajax_*
Disallow /ajax_cogpost.php
Disallow /forums/*
Disallow /db.php
Allow /

mozilla/5.0 (compatible;contxbot/1.0)

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.co-optimus.com/sitemaps/general.xml
sitemap https://www.co-optimus.com/sitemaps/siteMapArticles_index.xml
sitemap https://www.co-optimus.com/sitemaps/siteMapGames_index.xml

Warnings

  • 1 invalid line.