flashydubai.com
robots.txt

Robots Exclusion Standard data for flashydubai.com

Resource Scan

Scan Details

Site Domain flashydubai.com
Base Domain flashydubai.com
Scan Status Ok
Last Scan2025-10-25T17:06:29+00:00
Next Scan 2025-11-01T17:06:29+00:00

Last Scan

Scanned2025-10-25T17:06:29+00:00
URL https://flashydubai.com/robots.txt
Domain IPs 44.233.28.170
Response IP 44.233.28.170
Found Yes
Hash bc6bf39da8141b8c829618f49cd4d7265e45dba41b6320aa17dbe6592a8ce527
SimHash 731a4069e8c6

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/
Disallow /wp-json/
Disallow /creator-program

gptbot
oai-searchbot
chatgpt-user
chatgpt-user/2.0
anthropic-ai
claudebot
claude-user
claudebot-searchbot
claude-web
perplexitybot
perplexity-user
google-extended
bingbot
amazonbot
applebot
applebot-extended
facebookbot
meta-externalagent
linkedinbot
bytespider
duckassistbot
cohere-ai
ai2bot
ccbot
diffbot
omgili
timpibot
youbot
mistralai-user

Rule Path
Allow /

bubing
genieo
grapeshot
jamesbot
ltx71 - (http://ltx71.com/)
mj12bot
seznambot
dotbot
tineye-bot
pubmatic crawler bot
mappydata
jooblebot
domainstatsbot
pubmaticcrawlerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://flashydubai.com/sitemap_index.xml
sitemap https://flashydubai.com/sitemap-news.xml