arabeeworld.com
robots.txt

Robots Exclusion Standard data for arabeeworld.com

Resource Scan

Scan Details

Site Domain arabeeworld.com
Base Domain arabeeworld.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-07-31T12:18:44+00:00
Next Scan 2025-10-29T12:18:44+00:00

Last Successful Scan

Scanned2025-04-03T11:59:09+00:00
URL https://arabeeworld.com/robots.txt
Redirect https://www.alifbee.com:443/robots.txt
Redirect Domain www.alifbee.com
Redirect Base alifbee.com
Domain IPs 104.21.38.206, 172.67.138.84, 2606:4700:3033::6815:26ce, 2606:4700:3035::ac43:8a54
Redirect IPs 9.141.143.140
Response IP 9.141.143.140
Found Yes
Hash 0cd2c6c9b2e64474a86a97697781b97a424ac206f2ccc1421d67d308a4532d75
SimHash 6d419442cf93

Groups

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.alifbee.com/sitemap.xml

Comments

  • https://www.robotstxt.org/robotstxt.html

Warnings

  • `host` is not a known field.