gartner.com
robots.txt

Robots Exclusion Standard data for gartner.com

Resource Scan

Scan Details

Site Domain gartner.com
Base Domain gartner.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-19T21:20:57+00:00
Next Scan 2024-11-17T21:20:57+00:00

Last Successful Scan

Scanned2024-01-28T18:03:52+00:00
URL https://gartner.com/robots.txt
Redirect https://www.gartner.com/robots.txt
Redirect Domain www.gartner.com
Redirect Base gartner.com
Domain IPs 8.15.203.65
Redirect IPs 108.156.133.10, 108.156.133.104, 108.156.133.128, 108.156.133.62
Response IP 52.84.45.108
Found Yes
Hash 7f1f269b911dfdc74e522ee5fe2b5e83fe58b9c4977df2a5375b1e619ea74712
SimHash 281d1144d773

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /technology/media-products/
Disallow /it/content/
Disallow /pv_obj_cache/
Disallow /technology/admin/adm_help.jsp
Disallow /resources/
Disallow /reviews/review/view/
Disallow /reviews/market/*/compare/*-vs-*-vs-*
Disallow /reviews/*/pageInfo
Disallow /reviews/*/form
Disallow /it/products/podcasting/attributes/
Disallow /technology/html_emails/
Disallow /login/
Disallow /it/sd/
Disallow /imagesrv/pdf/DIR_TSO_2531*
Disallow /ngw/*.doc$
Disallow /ngw/*.docx$
Disallow /ngw/*.pdf$
Disallow /ngw/*.ppt$
Disallow /ngw/*.pptx$
Disallow /ngw/*.xls$
Disallow /ngw/*.xlsx$
Disallow /en/*automation-test-area*

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gartner.com/ngw/commonassets/code/xml/sitemap-index.xml
sitemap https://www.gartner.com/reviews/sitemap.xml
sitemap https://www.gartner.com/peer-community/sitemap_index1.xml.gz