webhostingsearch.com
robots.txt
Robots Exclusion Standard data for webhostingsearch.com
Resource Scan
Scan Details
| Site Domain | webhostingsearch.com |
| Base Domain | webhostingsearch.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-09-08T11:13:10+00:00 |
| Next Scan | 2025-12-07T11:13:10+00:00 |
Last Successful Scan
| Scanned | 2024-07-23T11:10:14+00:00 |
| URL | https://webhostingsearch.com/robots.txt |
| Redirect | https://www.webhostingsearch.com/robots.txt |
| Redirect Domain | www.webhostingsearch.com |
| Redirect Base | webhostingsearch.com |
| Domain IPs | 104.21.74.149, 172.67.159.100, 2606:4700:3033::ac43:9f64, 2606:4700:3034::6815:4a95 |
| Redirect IPs | 104.21.74.149, 172.67.159.100, 2606:4700:3033::ac43:9f64, 2606:4700:3034::6815:4a95 |
| Response IP | 104.21.74.149 |
| Found | Yes |
| Hash | bad23e2d473e1f244dc2072c19494a0ba43d472b348f286cf3ef2bf87ce6239f |
| SimHash | ef6fc244cf9c |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /visit/ |
| Disallow | /admin/ |
| Disallow | /Security/ |
| Disallow | /content/ |
| Disallow | /goto/ |
| Disallow | /cheaphosting.php |
| Disallow | /linuxhosting.php |
| Disallow | /site-search.php? |
| Disallow | /domain-search.php? |
| Disallow | /advanced-search.php/showMatches |
| Disallow | /compare-provider.php |
| Disallow | /web-hosting-campaign |
| Disallow | /web-tools.php/goto/ |
| Disallow | /advanced-search.php? |
| Disallow | /search? |
| Disallow | /blog/?replytocom |
| Disallow | /blog/what-to-look-for-in-a-web-host-048?replytocom |
| Disallow | /blog/more-php-projects-to-require-php5-057?replytocom |
| Disallow | /blog/a-scam-was-in-the-air-066?replytocom |
| Disallow | /blog/? |
| Disallow | /hosting-awards/best-services.php |
| Disallow | /hosting-awards.php |
| Disallow | /swf/HostingFinder/settings/settings.xml |
| Disallow | /review/dedicatednow.php?ppc |
| Disallow | /content-images/ |
| Disallow | /cgi-bin/ |
| Disallow | /review-testimonials.php?host |
| Disallow | /contact.php/ContactUs |
| Disallow | /web-hosting/united-states.php |
| Disallow | /dedicated-server/united-states.php |
| Disallow | /vps-hosting/united-states.php |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.webhostingsearch.com/sitemap.xml |