pestechnologies.com
robots.txt
Robots Exclusion Standard data for pestechnologies.com
Resource Scan
Scan Details
| Site Domain | pestechnologies.com |
| Base Domain | pestechnologies.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2025-11-22T11:19:07+00:00 |
| Next Scan | 2025-11-23T11:19:07+00:00 |
Last Successful Scan
| Scanned | 2025-10-23T11:18:50+00:00 |
| URL | https://pestechnologies.com/robots.txt |
| Redirect | https://www.pestechnologies.com/robots.txt |
| Redirect Domain | www.pestechnologies.com |
| Redirect Base | pestechnologies.com |
| Domain IPs | 35.189.116.137 |
| Redirect IPs | 35.189.116.137 |
| Response IP | 35.189.116.137 |
| Found | Yes |
| Hash | 8e8208996c2c66ac953993004cf8fbf787e5e32ec1c0d25f7d6c576082829eaf |
| SimHash | 6b00dc4003b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.pestechnologies.com/sitemap_index.xml |