accommodationdubai.com
robots.txt

Robots Exclusion Standard data for accommodationdubai.com

Resource Scan

Scan Details

Site Domain accommodationdubai.com
Base Domain accommodationdubai.com
Scan Status Ok
Last Scan2024-10-11T14:13:31+00:00
Next Scan 2024-10-18T14:13:31+00:00

Last Scan

Scanned2024-10-11T14:13:31+00:00
URL https://accommodationdubai.com/robots.txt
Domain IPs 209.182.199.222
Response IP 209.182.199.222
Found Yes
Hash 0fa8e183379bdb03e1cdb8f6b66cb5dced06643f3ab37654763615e300fd1394
SimHash e81fc9606e9b

Groups

*

Rule Path
Disallow /cgi-bin/

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

obot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.accommodationdubai.com/sitemap_index.xml