discoverasr.com
robots.txt

Robots Exclusion Standard data for discoverasr.com

Resource Scan

Scan Details

Site Domain discoverasr.com
Base Domain discoverasr.com
Scan Status Ok
Last Scan2025-08-13T06:52:25+00:00
Next Scan 2025-09-12T06:52:25+00:00

Last Scan

Scanned2025-08-13T06:52:25+00:00
URL https://discoverasr.com/robots.txt
Redirect https://www.discoverasr.com/robots.txt
Redirect Domain www.discoverasr.com
Redirect Base discoverasr.com
Domain IPs 45.60.33.192, 45.60.35.192
Redirect IPs 45.60.35.192
Response IP 45.60.35.192
Found Yes
Hash 585532550626fe1bd76cc4e614fc2e1dcdbb405fdfd7e981b5e0d83e9f06babc
SimHash d15ad100a2e0

Groups

*

Rule Path
Allow /

*

Rule Path
Allow /*.css
Allow /*.js
Disallow /*?
Disallow /*/*?
Disallow /*/*/*?
Disallow /*/*/*/*?
Disallow /*/*/*/*/*?
Disallow /*%2C*
Disallow /*%*
Disallow /*utm_*
Disallow /*.html
Disallow /*/events/*

chatgpt-user
chatgpt-user/2.0

Rule Path
Allow /

gptbot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

claudebot
claude-web

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

google-extended

Rule Path
Allow /

bingbot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

applebot
applebot-extended

Rule Path
Allow /

facebookbot
meta-externalagent

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

bytespider

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

baiduspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou wap spider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

*

Rule Path
Disallow /en/en.small.html

*

Rule Path
Disallow /zh/zh.small.html

*

Rule Path
Disallow /ja/ja.small.html

*

Rule Path
Disallow /ko/ko.small.html

*

Rule Path
Disallow /fr/fr.small.html

*

Rule Path
Disallow /en/member/partner/*

*

Rule Path
Disallow /zh/member/partner/*

*

Rule Path
Disallow /fr/member/partner/*

*

Rule Path
Disallow /de/member/partner/*

*

Rule Path
Disallow /es/member/partner/*

*

Rule Path
Disallow /ko/member/partner/*

*

Rule Path
Disallow /ja/member/partner/*

*

Rule Path
Disallow /id/member/partner/*

*

Rule Path
Disallow /vi/member/partner/*

*

Rule Path
Disallow /th/member/partner/*

*

Rule Path
Disallow /en/member/vouchers/*

*

Rule Path
Disallow /zh/member/vouchers/*

*

Rule Path
Disallow /fr/member/vouchers/*

*

Rule Path
Disallow /de/member/vouchers/*

*

Rule Path
Disallow /es/member/vouchers/*

*

Rule Path
Disallow /ko/member/vouchers/*

*

Rule Path
Disallow /ja/member/vouchers/*

*

Rule Path
Disallow /id/member/vouchers/*

*

Rule Path
Disallow /vi/member/vouchers/*

*

Rule Path
Disallow /th/member/vouchers/*

*

Rule Path
Disallow /en/about-the-ascott-limited/ascottbrand/*

*

Rule Path
Disallow /zh/about-the-ascott-limited/ascottbrand/*

*

Rule Path
Disallow /fr/about-the-ascott-limited/ascottbrand/*

*

Rule Path
Disallow /de/about-the-ascott-limited/ascottbrand/*

*

Rule Path
Disallow /es/about-the-ascott-limited/ascottbrand/*

*

Rule Path
Disallow /ko/about-the-ascott-limited/ascottbrand/*

*

Rule Path
Disallow /ja/about-the-ascott-limited/ascottbrand/*

*

Rule Path
Disallow /ar/about-the-ascott-limited/ascottbrand/*

*

Rule Path
Disallow /en/app-privacy-policy.html

*

Rule Path
Disallow /zh/app-privacy-policy.html

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

aasa-bot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

*

Rule Path
Disallow /*Incapsula_Resource
Disallow /_Incapsula_Resource

Other Records

Field Value
sitemap https://www.discoverasr.com/sitemap-en.xml
sitemap https://www.discoverasr.com/sitemap-zh.xml
sitemap https://www.discoverasr.com/sitemap-fr.xml
sitemap https://www.discoverasr.com/sitemap-de.xml
sitemap https://www.discoverasr.com/sitemap-es.xml
sitemap https://www.discoverasr.com/sitemap-ko.xml
sitemap https://www.discoverasr.com/sitemap-ja.xml
sitemap https://www.discoverasr.com/sitemap-id.xml
sitemap https://www.discoverasr.com/sitemap-vi.xml
sitemap https://www.discoverasr.com/sitemap-th.xml

Warnings

  • 2 invalid lines.