oxfordreporter.com
robots.txt
Robots Exclusion Standard data for oxfordreporter.com
Resource Scan
Scan Details
Site Domain | oxfordreporter.com |
Base Domain | oxfordreporter.com |
Scan Status | Ok |
Last Scan | 2025-05-30T16:06:32+00:00 |
Next Scan | 2025-06-06T16:06:32+00:00 |
Last Scan
Scanned | 2025-05-30T16:06:32+00:00 |
URL | https://oxfordreporter.com/robots.txt |
Domain IPs | 104.21.76.180, 172.67.198.103, 2606:4700:3032::ac43:c667, 2606:4700:3034::6815:4cb4 |
Response IP | 104.21.76.180 |
Found | Yes |
Hash | 41cde657ed36f3928392df6093ad7d68e2e9a2c25cbb23cf9f585dfbff2035b6 |
SimHash | 6e1ed144cfb5 |
Groups
*
Rule | Path |
---|---|
Disallow | /search |
Disallow | /*.json |
Disallow | /v.js |
Disallow | /ad.js |
Other Records
Field | Value |
---|---|
sitemap | https://oxfordreporter.com/sitemaps/oxfordreporter/sitemap.xml.gz |
sitemap | https://oxfordreporter.com/sitemaps/oxfordreporter/sitemap_news.xml.gz |
Comments