arab48.dev
robots.txt

Robots Exclusion Standard data for arab48.dev

Resource Scan

Scan Details

Site Domain arab48.dev
Base Domain arab48.dev
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-09-13T02:58:51+00:00
Next Scan 2024-12-12T02:58:51+00:00

Last Successful Scan

Scanned2023-02-15T18:46:18+00:00
URL https://arab48.dev/robots.txt
Domain IPs 13.33.88.124, 13.33.88.27, 13.33.88.87, 13.33.88.91
Response IP 13.33.88.87
Found Yes
Hash c0207cb4ffe9bd6dbbfa543b545270ca13ae35397015c9df9b724e5f02646ca3
SimHash 3d1d115527d0

Groups

*

Rule Path
Disallow /article_print/*
Disallow /?mod=*
Disallow /article/posts*

Other Records

Field Value
sitemap https://www.arab48.com/sitemap/https/sitemapIndex

Comments

  • Arab48.com Robots.txt File
  • Last update 10-Jan-2022