usanetwork.com
robots.txt
Robots Exclusion Standard data for usanetwork.com
Resource Scan
Scan Details
Site Domain | usanetwork.com |
Base Domain | usanetwork.com |
Scan Status | Ok |
Last Scan | 2024-05-30T15:34:35+00:00 |
Next Scan | 2024-06-06T15:34:35+00:00 |
Last Scan
Scanned | 2024-05-30T15:34:35+00:00 |
URL | https://usanetwork.com/robots.txt |
Redirect | https://www.usanetwork.com/robots.txt |
Redirect Domain | www.usanetwork.com |
Redirect Base | usanetwork.com |
Domain IPs | 184.84.54.72, 2600:1413:b000:880::2480, 2600:1413:b000:884::2480 |
Redirect IPs | 23.77.30.130, 2600:1413:b000:880::2480, 2600:1413:b000:884::2480 |
Response IP | 23.41.67.145 |
Found | Yes |
Hash | 0194875bc1326fa24023563c3b9cf138fa2f469d1ab1a70e5cd9231b0b5ba67b |
SimHash | a814bd18cf74 |
Groups
*
Rule | Path |
---|---|
Disallow | */includes/ |
Disallow | */misc/ |
Disallow | */modules/ |
Disallow | */profiles/ |
Disallow | */scripts/ |
Disallow | */themes/ |
Disallow | */internaluseronly/ |
Disallow | */CHANGELOG.txt |
Disallow | */cron.php |
Disallow | */INSTALL.mysql.txt |
Disallow | */INSTALL.pgsql.txt |
Disallow | */INSTALL.sqlite.txt |
Disallow | */install.php |
Disallow | */INSTALL.txt |
Disallow | */LICENSE.txt |
Disallow | */MAINTAINERS.txt |
Disallow | */update.php |
Disallow | */UPGRADE.txt |
Disallow | */xmlrpc.php |
Disallow | */admin/ |
Disallow | */comment/reply/ |
Disallow | */content/ |
Disallow | */file/ |
Disallow | */filter/tips/ |
Disallow | */node/ |
Disallow | */search |
Disallow | */user/register/ |
Disallow | */user/password/ |
Disallow | */user/login/ |
Disallow | */user/logout/ |
Disallow | */?q=admin%2F |
Disallow | */?q=comment%2Freply%2F |
Disallow | */?q=content%2F |
Disallow | */?q=file%2F |
Disallow | */?q=filter%2Ftips%2F |
Disallow | */?q=node%2F |
Disallow | */?q=search%2F |
Disallow | */?q=user%2Fpassword%2F |
Disallow | */?q=user%2Fregister%2F |
Disallow | */?q=user%2Flogin%2F |
Disallow | */?q=user%2Flogout%2F |
Disallow | */classic-tv/* |
Disallow | */nightly-news/* |
Disallow | */nightly-news/* |
Disallow | */the-tonight-show/guest/* |
Disallow | *one-app-preview* |
Other Records
Field | Value |
---|---|
sitemap | https://www.usanetwork.com/sitemap.xml |
sitemap | https://www.usanetwork.com/usa-insider-sitemap.xml |
sitemap | https://www.usanetwork.com/usa-insider-googlenews.xml |
sitemap | https://www.usanetwork.com/video_sitemap.xml |
sitemap | https://api.nbc.com/googlePlayGuide/feed.json |
Comments