nme.com
robots.txt
Robots Exclusion Standard data for nme.com
Resource Scan
Scan Details
Site Domain | nme.com |
Base Domain | nme.com |
Scan Status | Ok |
Last Scan | 2024-11-01T21:38:16+00:00 |
Next Scan | 2024-11-08T21:38:16+00:00 |
Last Scan
Scanned | 2024-11-01T21:38:16+00:00 |
URL | https://nme.com/robots.txt |
Redirect | https://www.nme.com/robots.txt |
Redirect Domain | www.nme.com |
Redirect Base | nme.com |
Domain IPs | 3.165.102.114, 3.165.102.126, 3.165.102.16, 3.165.102.81 |
Redirect IPs | 3.165.82.40, 3.165.82.45, 3.165.82.85, 3.165.82.95 |
Response IP | 3.165.82.45 |
Found | Yes |
Hash | de145b0d9f3107782420f6369e192079b4b5fe0bcc3a224a877a1c5c67c809f5 |
SimHash | 780ac170e02a |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /discount-codes/discount-codes/visit/* |
Disallow | /**.html$ |
Disallow | /search |
Disallow | /search/ |
Disallow | /*?s= |
Disallow | /*?q= |
Disallow | /*?*smid= |
Disallow | /*?*partner= |
Disallow | /*?*utm_source= |
Disallow | */utils/* |
Disallow | */utils/definitions |
Disallow | */ChildVisitor |
Disallow | */ProxyVisitor |
Disallow | */encode |
Disallow | */decode |
Disallow | */definitions |
Disallow | */Message |
Disallow | */consent-string |
Disallow | */PlaceholderVisitor |
Disallow | */0/* |
Disallow | /nme-video/* |
Disallow | /musicvideos/* |
Disallow | /tickets/artist/* |
Disallow | /tickets/cities/* |
Disallow | /tickets/event/* |
Disallow | /tickets/venues/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.nme.com/news-sitemap.xml |
sitemap | https://www.nme.com/sitemap_index.xml |
Comments