webinspector.com
robots.txt
Robots Exclusion Standard data for webinspector.com
Resource Scan
Scan Details
| Site Domain | webinspector.com |
| Base Domain | webinspector.com |
| Scan Status | Ok |
| Last Scan | 2025-08-22T19:06:10+00:00 |
| Next Scan | 2025-09-21T19:06:10+00:00 |
Last Scan
| Scanned | 2025-08-22T19:06:10+00:00 |
| URL | https://webinspector.com/robots.txt |
| Redirect | https://www.webinspector.com/robots.txt |
| Redirect Domain | www.webinspector.com |
| Redirect Base | webinspector.com |
| Domain IPs | 162.255.25.39, 2610:1c8:1b::1 |
| Redirect IPs | 162.255.25.39 |
| Response IP | 162.255.25.39 |
| Found | Yes |
| Hash | 8235191cb0eb3610a94fd1e698098faaf2dcba10c909e2997be5acc201ee6d46 |
| SimHash | 39d28964ce71 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /products/* |
| Disallow | /delphi/* |
| Disallow | /webinspector/* |
| Disallow | /newsgroups/* |
| Disallow | /mfs/* |
| Disallow | /public/recent_detections/* |
| Disallow | /wckPolls/wckPolls.php |
| Disallow | /news/ |
| Disallow | /delphi |
| Disallow | /blog/website-security-check/what-is-https-and-why-switching-to-https/?rs=* |
| Disallow | /blog/website-security-check/what-is-https-and-why-switching-to-https/?category=* |
| Disallow | /blog/page/* |
| Disallow | /blog/author/* |
| Disallow | /blog/website-virus-checker/ |
| Disallow | /blog/category/website-scanner/?rs=* |
| Disallow | /blog/page/ |
| Disallow | /blog/author/super-admin/ |
| Disallow | /blog/tag/ |
| Disallow | /blog/category/ |
| Disallow | /blog/page/ |
| Disallow | /blog/author/ |
| Disallow | /livechat/chatpopup.html |
| Disallow | /blog/malware-scan/what-is-website-malware/?rs=* |
| Disallow | /blog/malware-scan/what-is-website-malware/?category=* |
| Disallow | /blog/malware-scan/what-is-website-malware/?email=* |
| Disallow | /blog/malware-scan/what-is-website-malware/?track=* |
| Disallow | /?p=* |
| Disallow | /?category=* |
| Disallow | /?string%282%29_%22RO%22key6sk1=* |
| Disallow | /?agency_tier=* |
| Disallow | /?email=* |
| Disallow | /?click2=* |
| Disallow | /?terms=* |
| Disallow | /?searchbtn.x=* |
| Disallow | /?ap=* |
| Disallow | /?sa=* |
| Disallow | /?cat=* |
| Disallow | /?include_tag=* |
| Disallow | /?key5sk1=* |
| Disallow | /?page=* |
| Disallow | /?src=* |
| Disallow | /?showTxt=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.webinspector.com/sitemap.xml |
Comments