arabstars.me
robots.txt

Robots Exclusion Standard data for arabstars.me

Resource Scan

Scan Details

Site Domain arabstars.me
Base Domain arabstars.me
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-29T00:45:55+00:00
Next Scan 2024-11-28T00:45:55+00:00

Last Successful Scan

Scanned2024-09-20T23:08:46+00:00
URL https://www.arabstars.me/robots.txt
Domain IPs 142.251.12.121, 2404:6800:4003:c11::79
Response IP 142.251.12.121
Found Yes
Hash 069c295e267b6b8ed1a0feb13083112b562e4059132777917359a98b7bc2b4e2
SimHash 2b04de70ce93

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.arabstars.me/sitemap.xml