Log In Sign Up

marknteladvisors.com
robots.txt

Robots Exclusion Standard data for marknteladvisors.com

Resource Scan

Scan Details

Site Domain marknteladvisors.com
Base Domain marknteladvisors.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-28T11:28:18+00:00
Next Scan 2025-11-04T11:28:18+00:00

Last Successful Scan

Scanned2025-09-27T02:00:29+00:00
URL https://marknteladvisors.com/robots.txt
Domain IPs 67.205.156.153
Response IP 67.205.156.153
Found Yes
Hash 427a401dc9a96aeb754854fa61d473640a03834e526cfb10d1b88933c4dd7268
SimHash 40897f0535f3

Groups

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

google-extended

Rule Path
Allow /

claudebot

Rule Path
Allow /

anthropic-user-agent

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

cohere-ai

Rule Path
Allow /

aicodebot

Rule Path
Allow /

youbot

Rule Path
Allow /

*

Rule Path
Disallow /search/search-result?search_form
Disallow /query/request-toc/
Disallow /query/request-sample/
Disallow /query/talk-to-our-consultant/
Disallow /query/request-customization/
Disallow /admin
Disallow /abcde54321
Disallow /press-release?page
Disallow /infographics?page
Disallow /blogs?page
Disallow /research-library?page
Disallow /upcoming-reports?page
Disallow *?page=
Disallow /index.php/*
Disallow /index.php
Disallow /report_search
Back to top

Other Records

Field Value
sitemap https://www.marknteladvisors.com/sitemap.xml
sitemap https://www.marknteladvisors.com/infographics.xml
sitemap https://www.marknteladvisors.com/blogs.xml
sitemap https://www.marknteladvisors.com/other-pages.xml
sitemap https://www.marknteladvisors.com/press-release.xml
sitemap https://www.marknteladvisors.com/research-library/aerospace-defense.xml
sitemap https://www.marknteladvisors.com/research-library/buildings-construction-metals-mining.xml
sitemap https://www.marknteladvisors.com/research-library/chemicals.xml
sitemap https://www.marknteladvisors.com/research-library/environment.xml
sitemap https://www.marknteladvisors.com/research-library/fintech.xml
sitemap https://www.marknteladvisors.com/research-library/healthcare.xml
sitemap https://www.marknteladvisors.com/research-library/tires.xml
sitemap https://www.marknteladvisors.com/research-library/automotive.xml
sitemap https://www.marknteladvisors.com/research-library/energy.xml
sitemap https://www.marknteladvisors.com/research-library/fmcg.xml
sitemap https://www.marknteladvisors.com/research-library/food-beverages.xml
sitemap https://www.marknteladvisors.com/research-library/ict-electronics.xml
Back to top