inc.com
robots.txt
Robots Exclusion Standard data for inc.com
Resource Scan
Scan Details
Site Domain | inc.com |
Base Domain | inc.com |
Scan Status | Ok |
Last Scan | 2024-05-08T03:29:34+00:00 |
Next Scan | 2024-05-15T03:29:34+00:00 |
Last Scan
Scanned | 2024-05-08T03:29:34+00:00 |
URL | https://inc.com/robots.txt |
Redirect | https://www.inc.com/robots.txt |
Redirect Domain | www.inc.com |
Redirect Base | inc.com |
Domain IPs | 151.101.1.54, 151.101.129.54, 151.101.193.54, 151.101.65.54 |
Redirect IPs | 151.101.1.54, 151.101.129.54, 151.101.193.54, 151.101.65.54 |
Response IP | 199.232.45.54 |
Found | Yes |
Hash | b07a0af6582bc22d1317834daa704bb27148230a96000b40b4ee9cf3cc3dde4e |
SimHash | 263bf85da191 |
Groups
*
Rule | Path |
---|---|
Disallow | /apps |
Disallow | /discussions |
Disallow | /cgi-bin |
Disallow | /sendit |
Disallow | /soundoff |
Disallow | /resources/inc500.5172005 |
Disallow | /resources/inc500.20050819 |
Disallow | /resources/inc500.postDART |
Disallow | /resources/inc500.preDART |
Disallow | /resources/inc500.tmp |
Disallow | /inctv/video/featured-video |
Disallow | /inctv/video/featured-audio |
Disallow | /inc5000dev |
Disallow | /adops |
Disallow | /adsales |
Disallow | /atlas |
Disallow | /brandnet |
Disallow | /cache |
Disallow | /clients |
Disallow | /conf |
Disallow | /doubleclick |
Disallow | /lib |
Disallow | /models |
Disallow | /modules |
Disallow | /users |
Disallow | /lib/twitter/start.php |
Disallow | /rest |
Disallow | /home/ |
Disallow | /%26* |
Disallow | /%26lt* |
Disallow | /%26rdquo* |
Disallow | /index.php |
Disallow | /guides/ |
Disallow | /ss/ |
Disallow | /draft/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.inc.com/sitemap/sitemap_index.xml |
sitemap | https://www.inc.com/sitemap/sitemap_news.xml |
sitemap | https://www.inc.com/sitemap/sitemap_videos.xml |
sitemap | https://www.inc.com/sitemap/sitemap_brandview_542.xml |
sitemap | https://www.inc.com/sitemap/sitemap_grow_6.xml |
sitemap | https://www.inc.com/sitemap/sitemap_innovate_7.xml |
sitemap | https://www.inc.com/sitemap/sitemap_lead_4.xml |
sitemap | https://www.inc.com/sitemap/sitemap_magazines.xml |
sitemap | https://www.inc.com/sitemap/sitemap_money_2.xml |
sitemap | https://www.inc.com/sitemap/sitemap_politics_419.xml |
sitemap | https://www.inc.com/sitemap/sitemap_technology_5.xml |
sitemap | https://www.inc.com/sitemap/sitemap_wire_374.xml |
sitemap | https://www.inc.com/sitemap/sitemap_profiles.xml |
Comments