arabia2.com
robots.txt
Robots Exclusion Standard data for arabia2.com
Resource Scan
Scan Details
| Site Domain | arabia2.com |
| Base Domain | arabia2.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-16T09:58:25+00:00 |
| Next Scan | 2024-11-14T09:58:25+00:00 |
Last Successful Scan
| Scanned | 2023-10-22T07:18:17+00:00 |
| URL | https://arabia2.com/robots.txt |
| Domain IPs | 172.66.40.235, 172.66.43.21, 2606:4700:3108::ac42:28eb, 2606:4700:3108::ac42:2b15 |
| Response IP | 172.66.43.21 |
| Found | Yes |
| Hash | 49f170983a9247e048477d4c2051e292f4c63514d47b555761745efcc2d8f6db |
| SimHash | 5510d2e086d2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /vb/threads/*/reply |
| Disallow | /ar/ |
| Disallow | /vbold/ |
| Disallow | /vb/whats-new/ |
| Disallow | /vb/account/ |
| Disallow | /vb/attachments/ |
| Disallow | /vb/goto/ |
| Disallow | /vb/posts/ |
| Disallow | /vb/login/ |
| Disallow | /vb/help/terms/ |
| Disallow | /vb/help/ |
| Disallow | /vb/search/ |
| Disallow | /vb/admin.php |
| Disallow | /vb/admin.php |
| Disallow | /wp-admin |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.arabia2.com/vb/sitemap.php |
| sitemap | https://www.arabia2.com/?sitemap=1 |