petibble.com
robots.txt
Robots Exclusion Standard data for petibble.com
Resource Scan
Scan Details
| Site Domain | petibble.com |
| Base Domain | petibble.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-10-20T16:09:46+00:00 |
| Next Scan | 2024-11-19T16:09:46+00:00 |
Last Successful Scan
| Scanned | 2024-09-27T16:08:55+00:00 |
| URL | https://petibble.com/robots.txt |
| Domain IPs | 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138 |
| Response IP | 52.221.42.138 |
| Found | Yes |
| Hash | a8877aaba6225f54831e79660c8b5df356763742b3e357e962c79d8c58c9bb7b |
| SimHash | aa4d2800a012 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*%3D* |
| Disallow | /*?* |
| Disallow | /humix/ |
| Disallow | /*humix* |
| Disallow | /beardeddragon/ |
| Disallow | /*beardeddragon* |
| Disallow | /porpoiseant/ |
| Disallow | /*porpoiseant* |
| Disallow | /detroitchicago/ |
| Disallow | /*detroitchicago* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.petibble.com/sitemap_index.xml |
Comments