getchecked.ae
robots.txt

Robots Exclusion Standard data for getchecked.ae

Resource Scan

Scan Details

Site Domain getchecked.ae
Base Domain getchecked.ae
Scan Status Ok
Last Scan2025-06-18T00:22:56+00:00
Next Scan 2025-07-18T00:22:56+00:00

Last Scan

Scanned2025-06-18T00:22:56+00:00
URL https://getchecked.ae/robots.txt
Redirect https://www.getchecked.ae/robots.txt
Redirect Domain www.getchecked.ae
Redirect Base getchecked.ae
Domain IPs 162.159.129.73, 162.159.130.73, 2606:4700:7::a29f:8149, 2606:4700:7::a29f:8249
Redirect IPs 162.159.129.73, 162.159.130.73, 2606:4700:7::a29f:8149, 2606:4700:7::a29f:8249
Response IP 162.159.130.73
Found Yes
Hash 0214e254563e41c3bbf1773eb43313e43530e81d5074cec0c9deb82cab5b9209
SimHash 88346232c783

Groups

*

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /
Disallow /cgi-bin/

twitterbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /