mobiles24.com
robots.txt

Robots Exclusion Standard data for mobiles24.com

Resource Scan

Scan Details

Site Domain mobiles24.com
Base Domain mobiles24.com
Scan Status Ok
Last Scan2026-01-21T14:53:56+00:00
Next Scan 2026-01-28T14:53:56+00:00

Last Scan

Scanned2026-01-21T14:53:56+00:00
URL https://mobiles24.com/robots.txt
Redirect https://www.mobiles24.co/robots.txt
Redirect Domain www.mobiles24.co
Redirect Base mobiles24.co
Domain IPs 104.21.33.173, 172.67.165.14, 2606:4700:3036::ac43:a50e, 2606:4700:3037::6815:21ad
Redirect IPs 64.5.100.108
Response IP 64.5.100.108
Found Yes
Hash c611fb7b0f2890e98caa46c1275f65bfc0fc4c3b0a428b9641e790f4eff44955
SimHash 831fc1c2eb10

Groups

turnitinbot
npbot
ia_archiver
webzip
ccbot
amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /downloads/da/
Disallow /downloads/dd/

semrushbot
petalbot
baiduspider
mj12bot
yandex
semanticscholarbot
ahrefsbot
mediapartners-google

Rule Path
Disallow /downloads/d/