arrabia.com
robots.txt

Robots Exclusion Standard data for arrabia.com

Resource Scan

Scan Details

Site Domain arrabia.com
Base Domain arrabia.com
Scan Status Ok
Last Scan2025-09-06T01:00:59+00:00
Next Scan 2025-09-13T01:00:59+00:00

Last Scan

Scanned2025-09-06T01:00:59+00:00
URL https://arrabia.com/robots.txt
Domain IPs 2a02:4780:15:c2b:23a7:c16b:f420:a624, 2a02:4780:16:59e1:aeda:181a:c2ae:fbe5, 84.32.84.248, 84.32.84.40
Response IP 179.61.189.33
Found Yes
Hash 6a4e4423819e7a982b903b81f7f5288aed4d3ed00bcd0ce14e090bfa6e12c05b
SimHash 61009e1089b2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://arrabia.com/news-sitemap.xml
sitemap https://arrabia.com/video-sitemap.xml
sitemap https://arrabia.com/sitemap.xml
sitemap https://arrabia.com/sitemap.rss