dotster.com
robots.txt

Robots Exclusion Standard data for dotster.com

Resource Scan

Scan Details

Site Domain dotster.com
Base Domain dotster.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-06T00:45:43+00:00
Next Scan 2024-08-05T00:45:43+00:00

Last Successful Scan

Scanned2024-03-16T00:14:25+00:00
URL https://dotster.com/robots.txt
Redirect https://www.dotster.com/robots.txt
Redirect Domain www.dotster.com
Redirect Base dotster.com
Domain IPs 65.254.239.180
Redirect IPs 52.84.229.112, 52.84.229.52, 52.84.229.55, 52.84.229.96
Response IP 52.84.229.52
Found Yes
Hash 2bb21b13fafcad45235057bd1bc46bc19d56a34ef09cd93c293e856436332c3e
SimHash 91c241444f26

Groups

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /aboutAppC/
Disallow /admin/
Disallow /affiliateAppC/
Disallow /affiliateControl/
Disallow /appinterface/
Disallow /appinterfaceAppC/
Disallow /articlesAppC/
Disallow /bandwidth/
Disallow /BizBuilder/
Disallow /build/
Disallow /categoryAppC/
Disallow /cgi-bin/
Disallow /cgi-fy/
Disallow /cgi-va/
Disallow /cobrand/
Disallow /cobrandAppC/
Disallow /communityAppC/
Disallow /cvsadmin/
Disallow /data/
Disallow /directMail/
Disallow /directoryAppC/
Disallow /directory/
Disallow /email/
Disallow /error/
Disallow /firetest/
Disallow /homeAppC/
Disallow /joinAppC/
Disallow /knowledgebase/allkeywords.cmp
Disallow /knowledgebase/
Disallow /knowledgebase/beta
Disallow /keepalive/
Disallow /knowledgebaseAppC/
Disallow /mail/
Disallow /marketplaceAppC/
Disallow /metatags/
Disallow /mining/
Disallow /monitoring/
Disallow /newsletterAppC/
Disallow /nortec/
Disallow /opentracker/
Disallow /panel/
Disallow /pdf/
Disallow /pluginControl/
Disallow /popupAppC/
Disallow /productAppC/
Disallow /referAppC/
Disallow /register/
Disallow /scripts/
Disallow /search/
Disallow /secure/
Disallow /secureControl/
Disallow /sitestudioAppC/
Disallow /supportAppC/
Disallow /tipsAppC/
Disallow /unsynced/
Disallow /utils/