netfirms.com
robots.txt

Robots Exclusion Standard data for netfirms.com

Resource Scan

Scan Details

Site Domain netfirms.com
Base Domain netfirms.com
Scan Status Ok
Last Scan2024-05-17T14:05:53+00:00
Next Scan 2024-06-16T14:05:53+00:00

Last Scan

Scanned2024-05-17T14:05:53+00:00
URL https://netfirms.com/robots.txt
Redirect https://www.netfirms.com/robots.txt
Redirect Domain www.netfirms.com
Redirect Base netfirms.com
Domain IPs 65.254.227.16
Redirect IPs 13.33.88.117, 13.33.88.52, 13.33.88.74, 13.33.88.79
Response IP 13.33.88.52
Found Yes
Hash 2bb21b13fafcad45235057bd1bc46bc19d56a34ef09cd93c293e856436332c3e
SimHash 91c241444f26

Groups

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /aboutAppC/
Disallow /admin/
Disallow /affiliateAppC/
Disallow /affiliateControl/
Disallow /appinterface/
Disallow /appinterfaceAppC/
Disallow /articlesAppC/
Disallow /bandwidth/
Disallow /BizBuilder/
Disallow /build/
Disallow /categoryAppC/
Disallow /cgi-bin/
Disallow /cgi-fy/
Disallow /cgi-va/
Disallow /cobrand/
Disallow /cobrandAppC/
Disallow /communityAppC/
Disallow /cvsadmin/
Disallow /data/
Disallow /directMail/
Disallow /directoryAppC/
Disallow /directory/
Disallow /email/
Disallow /error/
Disallow /firetest/
Disallow /homeAppC/
Disallow /joinAppC/
Disallow /knowledgebase/allkeywords.cmp
Disallow /knowledgebase/
Disallow /knowledgebase/beta
Disallow /keepalive/
Disallow /knowledgebaseAppC/
Disallow /mail/
Disallow /marketplaceAppC/
Disallow /metatags/
Disallow /mining/
Disallow /monitoring/
Disallow /newsletterAppC/
Disallow /nortec/
Disallow /opentracker/
Disallow /panel/
Disallow /pdf/
Disallow /pluginControl/
Disallow /popupAppC/
Disallow /productAppC/
Disallow /referAppC/
Disallow /register/
Disallow /scripts/
Disallow /search/
Disallow /secure/
Disallow /secureControl/
Disallow /sitestudioAppC/
Disallow /supportAppC/
Disallow /tipsAppC/
Disallow /unsynced/
Disallow /utils/