arab48.com
robots.txt
Robots Exclusion Standard data for arab48.com
Resource Scan
Scan Details
Site Domain | arab48.com |
Base Domain | arab48.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-03-11T05:06:55+00:00 |
Next Scan | 2024-06-09T05:06:55+00:00 |
Last Successful Scan
Scanned | 2022-10-22T10:51:26+00:00 |
URL | https://www.arab48.com/robots.txt |
Response IP | 13.33.33.92, 13.33.33.3, 13.33.33.70, 13.33.33.73 |
Found | Yes |
Hash | f1b146bb6fda9ffe70c3a01e54514cb55f6f14f45ff41b65aac68ba3baa50241 |
SimHash | 3d1d1259afd0 |
Groups
*
Rule | Path |
---|---|
Disallow | /article_print/* |
Disallow | /?mod=* |
Disallow | /article/posts* |
Other Records
Field | Value |
---|---|
sitemap | https://www.arab48.com/sitemap/https/sitemapIndex |
Comments