aalalkaif.com
robots.txt

Robots Exclusion Standard data for aalalkaif.com

Resource Scan

Scan Details

Site Domain aalalkaif.com
Base Domain aalalkaif.com
Scan Status Ok
Last Scan5/2/2025, 10:52:29 PM
Next Scan 6/1/2025, 10:52:29 PM

Last Scan

Scanned5/2/2025, 10:52:29 PM
URL https://aalalkaif.com/robots.txt
Domain IPs 104.21.65.242, 172.67.167.156, 2606:4700:3031::6815:41f2, 2606:4700:3033::ac43:a79c
Response IP 172.67.167.156
Found Yes
Hash 1be83cf61516e48a8638c22b788d140ea91f52227adbf1817e7785bf40c3ecdc
SimHash 001ccd70ef13

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://aalalkaif.com/online-gaming/sitemap.xml