ntnews.com
robots.txt
Robots Exclusion Standard data for ntnews.com
Resource Scan
Scan Details
Site Domain | ntnews.com |
Base Domain | ntnews.com |
Scan Status | Ok |
Last Scan | 2024-09-21T12:41:11+00:00 |
Next Scan | 2024-09-28T12:41:11+00:00 |
Last Scan
Scanned | 2024-09-21T12:41:11+00:00 |
URL | https://ntnews.com/robots.txt |
Redirect | https://www.ntnews.com/robots.txt |
Redirect Domain | www.ntnews.com |
Redirect Base | ntnews.com |
Domain IPs | 52.84.229.13, 52.84.229.34, 52.84.229.44, 52.84.229.88 |
Redirect IPs | 2600:9000:2003:4200:1c:3d97:28c0:93a1, 2600:9000:2003:800:1c:3d97:28c0:93a1, 2600:9000:2003:8400:1c:3d97:28c0:93a1, 2600:9000:2003:8600:1c:3d97:28c0:93a1, 2600:9000:2003:9400:1c:3d97:28c0:93a1, 2600:9000:2003:c400:1c:3d97:28c0:93a1, 2600:9000:2003:cc00:1c:3d97:28c0:93a1, 2600:9000:2003:fa00:1c:3d97:28c0:93a1, 52.84.229.13, 52.84.229.34, 52.84.229.44, 52.84.229.88 |
Response IP | 52.84.229.44 |
Found | Yes |
Hash | ce8d76ed62e9399da84fd824490a00001fb03aaed964e560b758cd01e6a47092 |
SimHash | c835d9408dc3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /wp-admin/ |
Disallow | /?s |
Disallow | /s?* |
Disallow | */embed |
Disallow | /?p= |
Disallow | /wp-json/* |
Disallow | /updates/* |
Disallow | */attachment/* |
Disallow | */category/* |
Disallow | */amp |
Disallow | *utm_* |
Disallow | */tags/* |
Disallow | /search/ |
Disallow | /404.html |
Disallow | *.aspx |
Disallow | /?s=* |
chatgpt-user
Rule | Path |
---|---|
Disallow | / |
Disallow | /wp-admin/ |
Disallow | /?s |
Disallow | /s?* |
Disallow | */embed |
Disallow | /?p= |
Disallow | /wp-json/* |
Disallow | /updates/* |
Disallow | */attachment/* |
Disallow | */category/* |
Disallow | */amp |
Disallow | *utm_* |
Disallow | */tags/* |
Disallow | /search/ |
Disallow | /404.html |
Disallow | *.aspx |
Disallow | /?s=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.ntnews.com/news-sitemap.xml |
sitemap | https://www.ntnews.com/sitemap_index.xml |