insiderintelligence.com
robots.txt

Robots Exclusion Standard data for insiderintelligence.com

Resource Scan

Scan Details

Site Domain insiderintelligence.com
Base Domain insiderintelligence.com
Scan Status Ok
Last Scan2024-06-19T17:19:11+00:00
Next Scan 2024-06-26T17:19:11+00:00

Last Scan

Scanned2024-06-19T17:19:11+00:00
URL https://insiderintelligence.com/robots.txt
Redirect https://www.emarketer.com/robots.txt
Redirect Domain www.emarketer.com
Redirect Base emarketer.com
Domain IPs 18.210.63.196, 18.211.152.42
Redirect IPs 23.41.73.254
Response IP 23.41.73.254
Found Yes
Hash b25f56ab175d78fe4f34ece57b4121a75db4772ea5431b1dfb1a58eace33055f
SimHash 6ad4ab398b0c

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

*

Rule Path
Allow /newsletters
Disallow /learn/
Disallow *thank-you
Disallow /resources/
Disallow /subject/
Disallow /Articles/Email.aspx
Disallow /articles/results.aspx?q=&
Disallow /bin
Disallow /CaptchaValidationLog
Disallow /chart/*/async
Disallow /chart/*/bind
Disallow /chart/*/cancel
Disallow /chart/*/catch_filter
Disallow /chart/*/context
Disallow /chart/*/debuggability
Disallow /chart/*/direct_resolve
Disallow /chart/*/errors
Disallow /chart/*/es5
Disallow /chart/*/finally
Disallow /chart/*/join
Disallow /chart/*/method
Disallow /chart/*/nodeback
Disallow /chart/*/promise
Disallow /chart/*/promise_array
Disallow /chart/*/queue
Disallow /chart/*/schedule
Disallow /chart/*/synchronous_inspection
Disallow /chart/*/thenables
Disallow /chart/*/util
Disallow /chart/c/*/async
Disallow /chart/c/*/bind
Disallow /chart/c/*/cancel
Disallow /chart/c/*/catch_filter
Disallow /chart/c/*/context
Disallow /chart/c/*/debuggability
Disallow /chart/c/*/direct_resolve
Disallow /chart/c/*/errors
Disallow /chart/c/*/es5
Disallow /chart/c/*/finally
Disallow /chart/c/*/join
Disallow /chart/c/*/method
Disallow /chart/c/*/nodeback
Disallow /chart/c/*/promise
Disallow /chart/c/*/promise_array
Disallow /chart/c/*/queue
Disallow /chart/c/*/schedule
Disallow /chart/c/*/synchronous_inspection
Disallow /chart/c/*/thenables
Disallow /chart/c/*/util
Disallow /chart_jpgs
Disallow /content/*/async
Disallow /content/*/bind
Disallow /content/*/cancel
Disallow /content/*/catch_filter
Disallow /content/*/context
Disallow /content/*/debuggability
Disallow /content/*/direct_resolve
Disallow /content/*/errors
Disallow /content/*/es5
Disallow /content/*/finally
Disallow /content/*/join
Disallow /content/*/method
Disallow /content/*/nodeback
Disallow /content/*/promise
Disallow /content/*/promise_array
Disallow /content/*/queue
Disallow /content/*/schedule
Disallow /content/*/synchronous_inspection
Disallow /content/*/thenables
Disallow /content/*/util
Disallow /Corporate/RegisterMe
Disallow /Corporate/RequestInfo
Disallow /corporate/request*
Disallow /daily_process
Disallow /docs
Disallow /Emailer
Disallow /emailpreferences.aspx
Disallow /ErrorLog
Disallow /EssentialMetrics
Disallow /Extranet
Disallow /Extranet.aspx
Disallow /images/chart_gifs
Disallow /images/chart_pdfs
Disallow /images/chart_png300
Disallow /images/chart_png460
Disallow /images/interview_pdfs
Disallow /images/Podcasts
Disallow /images/mockups
Disallow /include
Disallow /Library
Disallow /log
Disallow /manage
Disallow /MPTemplates
Disallow /MyAccount
Disallow /newsletter/*
Disallow /newsletters/*
Disallow /Newsletter_htm
Disallow /newsroom/index.php/tag
Disallow /newsroom/wp-admin
Disallow /newsroom/wp-content/cache
Disallow /PageBuilderControls
Disallow /Products/AddToCart.aspx
Disallow /products/explore
Disallow /Products/Reports.aspx
Disallow /Products/ShoppingCart.aspx
Disallow /Products/subscriptionsSpecial.aspx
Disallow /public_media/docs
Disallow /public_media/images/Onboarding-Documents
Disallow /public_media/images/StyleGuide
Disallow /public_media/images/WPP
Disallow /Results.aspx
Disallow /retailnewsletter*
Disallow /Store
Disallow /*ThankYou*
Disallow /umbraco
Disallow /UnsubscribeConfirmation
Disallow /uploads/excel/*
Disallow /UserControls
Disallow /web_admin
Disallow /Scripts/
Disallow /Styles/
Disallow /router
Disallow /page-data/
Disallow /router/
Disallow /analysts/webapi/
Disallow /dynamiccontent/webapi/
Disallow /topics/category/undefined/
Disallow /*/undefined
Disallow /search
Disallow */webapi/*

Other Records

Field Value
sitemap https://www.emarketer.com/sitemap/sitemap-index.xml

Warnings

  • `host` is not a known field.