pestworld.org
robots.txt
Robots Exclusion Standard data for pestworld.org
Resource Scan
Scan Details
| Site Domain | pestworld.org |
| Base Domain | pestworld.org |
| Scan Status | Ok |
| Last Scan | 2024-11-12T08:40:49+00:00 |
| Next Scan | 2024-11-26T08:40:49+00:00 |
Last Scan
| Scanned | 2024-11-12T08:40:49+00:00 |
| URL | https://pestworld.org/robots.txt |
| Domain IPs | 20.119.0.58 |
| Response IP | 20.119.0.58 |
| Found | Yes |
| Hash | 882fbd1f9c392d549375b5e9f9d860d217f3ef2ba97ce1a508b09ed71aa4ddfd |
| SimHash | 9304d403eb10 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bed-bug-blog/comments/ |
| Disallow | /pest-control-help/faq/ |
| Disallow | /pest-control-help/pest-faqs/ |
| Disallow | /for-consumers/ |
| Disallow | /For-Consumers/ |
| Disallow | /form-test/ |
| Disallow | /Lady-Bug/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.pestworld.org/xml-sitemap/ |
Comments