dotster.com
robots.txt
Robots Exclusion Standard data for dotster.com
Resource Scan
Scan Details
Site Domain | dotster.com |
Base Domain | dotster.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-06T00:45:43+00:00 |
Next Scan | 2024-08-05T00:45:43+00:00 |
Last Successful Scan
Scanned | 2024-03-16T00:14:25+00:00 |
URL | https://dotster.com/robots.txt |
Redirect | https://www.dotster.com/robots.txt |
Redirect Domain | www.dotster.com |
Redirect Base | dotster.com |
Domain IPs | 65.254.239.180 |
Redirect IPs | 52.84.229.112, 52.84.229.52, 52.84.229.55, 52.84.229.96 |
Response IP | 52.84.229.52 |
Found | Yes |
Hash | 2bb21b13fafcad45235057bd1bc46bc19d56a34ef09cd93c293e856436332c3e |
SimHash | 91c241444f26 |
Groups
*
Rule | Path |
---|---|
Disallow | /aboutAppC/ |
Disallow | /admin/ |
Disallow | /affiliateAppC/ |
Disallow | /affiliateControl/ |
Disallow | /appinterface/ |
Disallow | /appinterfaceAppC/ |
Disallow | /articlesAppC/ |
Disallow | /bandwidth/ |
Disallow | /BizBuilder/ |
Disallow | /build/ |
Disallow | /categoryAppC/ |
Disallow | /cgi-bin/ |
Disallow | /cgi-fy/ |
Disallow | /cgi-va/ |
Disallow | /cobrand/ |
Disallow | /cobrandAppC/ |
Disallow | /communityAppC/ |
Disallow | /cvsadmin/ |
Disallow | /data/ |
Disallow | /directMail/ |
Disallow | /directoryAppC/ |
Disallow | /directory/ |
Disallow | /email/ |
Disallow | /error/ |
Disallow | /firetest/ |
Disallow | /homeAppC/ |
Disallow | /joinAppC/ |
Disallow | /knowledgebase/allkeywords.cmp |
Disallow | /knowledgebase/ |
Disallow | /knowledgebase/beta |
Disallow | /keepalive/ |
Disallow | /knowledgebaseAppC/ |
Disallow | /mail/ |
Disallow | /marketplaceAppC/ |
Disallow | /metatags/ |
Disallow | /mining/ |
Disallow | /monitoring/ |
Disallow | /newsletterAppC/ |
Disallow | /nortec/ |
Disallow | /opentracker/ |
Disallow | /panel/ |
Disallow | /pdf/ |
Disallow | /pluginControl/ |
Disallow | /popupAppC/ |
Disallow | /productAppC/ |
Disallow | /referAppC/ |
Disallow | /register/ |
Disallow | /scripts/ |
Disallow | /search/ |
Disallow | /secure/ |
Disallow | /secureControl/ |
Disallow | /sitestudioAppC/ |
Disallow | /supportAppC/ |
Disallow | /tipsAppC/ |
Disallow | /unsynced/ |
Disallow | /utils/ |