inquirer.com
robots.txt
Robots Exclusion Standard data for inquirer.com
Resource Scan
Scan Details
Site Domain | inquirer.com |
Base Domain | inquirer.com |
Scan Status | Ok |
Last Scan | 2024-11-02T09:06:27+00:00 |
Next Scan | 2024-11-09T09:06:27+00:00 |
Last Scan
Scanned | 2024-11-02T09:06:27+00:00 |
URL | https://inquirer.com/robots.txt |
Redirect | https://www.inquirer.com:443/robots.txt |
Redirect Domain | www.inquirer.com |
Redirect Base | inquirer.com |
Domain IPs | 35.71.148.62, 52.223.20.214 |
Redirect IPs | 23.52.171.130, 23.52.171.146, 2600:1413:b000:13::b857:c18d, 2600:1413:b000:13::b857:c192 |
Response IP | 23.44.5.187 |
Found | Yes |
Hash | 035095fc5f948b8d36ab2327065cd070b09cd7562929e1a43d193940691b71fe |
SimHash | 89154d5ccbd3 |
Groups
*
Rule | Path |
---|---|
Disallow | /light/ |
Disallow | /search |
Disallow | /sports/betting/ |
Disallow | /wires/ |
Disallow | /zzz-systest/ |
Disallow | /zzz_systest/ |
Disallow | */zzz-systest/ |
Disallow | */zzz_systest/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.inquirer.com/sitemaps/48hour-news-sitemap-partner.xml |
sitemap | https://www.inquirer.com/arc/outboundfeeds/sitemap-index-2/?outputType=xml |