thinkprop.ae
robots.txt

Robots Exclusion Standard data for thinkprop.ae

Resource Scan

Scan Details

Site Domain thinkprop.ae
Base Domain thinkprop.ae
Scan Status Ok
Last Scan2025-12-08T20:29:53+00:00
Next Scan 2026-01-07T20:29:53+00:00

Last Scan

Scanned2025-12-08T20:29:53+00:00
URL https://thinkprop.ae/robots.txt
Domain IPs 104.26.6.124, 104.26.7.124, 172.67.69.137, 2606:4700:20::681a:67c, 2606:4700:20::681a:77c, 2606:4700:20::ac43:4589
Response IP 104.26.6.124
Found Yes
Hash be457bab50a607290a32ad5fd570b90ebd5af0c324bb46ec07f65e493687a3ae
SimHash 611f5010c813

Groups

gptbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandeximageresizer

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://thinkprop.ae/sitemap.xml