pitchforkdiaries.com
robots.txt
Robots Exclusion Standard data for pitchforkdiaries.com
Resource Scan
Scan Details
| Site Domain | pitchforkdiaries.com |
| Base Domain | pitchforkdiaries.com |
| Scan Status | Ok |
| Last Scan | 2026-03-06T12:30:40+00:00 |
| Next Scan | 2026-04-05T12:30:40+00:00 |
Last Scan
| Scanned | 2026-03-06T12:30:40+00:00 |
| URL | http://pitchforkdiaries.com/robots.txt |
| Domain IPs | 173.201.181.184 |
| Response IP | 173.201.181.184 |
| Found | Yes |
| Hash | 88afde9a4f43e525d4d225946ec2981eacf3f68bac47eecd4ec9a978965c9d55 |
| SimHash | 101ddd606e13 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.pitchforkdiaries.com//?feed=xmlsitemap41 |
| sitemap | http://www.pitchforkdiaries.com/sitemap1806.xml |
| sitemap | http://www.pitchforkdiaries.com/cms/?feed=xmlsitemap1604 |