gartner.com
robots.txt
Robots Exclusion Standard data for gartner.com
Resource Scan
Scan Details
Site Domain | gartner.com |
Base Domain | gartner.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-19T21:20:57+00:00 |
Next Scan | 2024-11-17T21:20:57+00:00 |
Last Successful Scan
Scanned | 2024-01-28T18:03:52+00:00 |
URL | https://gartner.com/robots.txt |
Redirect | https://www.gartner.com/robots.txt |
Redirect Domain | www.gartner.com |
Redirect Base | gartner.com |
Domain IPs | 8.15.203.65 |
Redirect IPs | 108.156.133.10, 108.156.133.104, 108.156.133.128, 108.156.133.62 |
Response IP | 52.84.45.108 |
Found | Yes |
Hash | 7f1f269b911dfdc74e522ee5fe2b5e83fe58b9c4977df2a5375b1e619ea74712 |
SimHash | 281d1144d773 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /technology/media-products/ |
Disallow | /it/content/ |
Disallow | /pv_obj_cache/ |
Disallow | /technology/admin/adm_help.jsp |
Disallow | /resources/ |
Disallow | /reviews/review/view/ |
Disallow | /reviews/market/*/compare/*-vs-*-vs-* |
Disallow | /reviews/*/pageInfo |
Disallow | /reviews/*/form |
Disallow | /it/products/podcasting/attributes/ |
Disallow | /technology/html_emails/ |
Disallow | /login/ |
Disallow | /it/sd/ |
Disallow | /imagesrv/pdf/DIR_TSO_2531* |
Disallow | /ngw/*.doc$ |
Disallow | /ngw/*.docx$ |
Disallow | /ngw/*.pdf$ |
Disallow | /ngw/*.ppt$ |
Disallow | /ngw/*.pptx$ |
Disallow | /ngw/*.xls$ |
Disallow | /ngw/*.xlsx$ |
Disallow | /en/*automation-test-area* |
Other Records
Field | Value |
---|---|
sitemap | https://www.gartner.com/ngw/commonassets/code/xml/sitemap-index.xml |
sitemap | https://www.gartner.com/reviews/sitemap.xml |
sitemap | https://www.gartner.com/peer-community/sitemap_index1.xml.gz |