afaq4arab.com
robots.txt
Robots Exclusion Standard data for afaq4arab.com
Resource Scan
Scan Details
| Site Domain | afaq4arab.com |
| Base Domain | afaq4arab.com |
| Scan Status | Ok |
| Last Scan | 2024-11-12T20:35:47+00:00 |
| Next Scan | 2024-11-19T20:35:47+00:00 |
Last Scan
| Scanned | 2024-11-12T20:35:47+00:00 |
| URL | http://afaq4arab.com/robots.txt |
| Redirect | http://www.afaq4arab.com/robots.txt |
| Redirect Domain | www.afaq4arab.com |
| Redirect Base | afaq4arab.com |
| Domain IPs | 216.239.34.21, 216.239.36.21, 216.239.38.21 |
| Redirect IPs | 2404:6800:4003:c0f::79, 74.125.200.121 |
| Response IP | 142.251.12.121 |
| Found | Yes |
| Hash | 60414254cc582a70c89db008cbf13d7ff2279b17a4ec53a86f147664cbfca2c7 |
| SimHash | 2d149430dfd3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /p/download-games-anime-requests.html |
| Disallow | /p/online-games-anime-requests.html |
| Disallow | /p/important-instructions.html |
| Disallow | /p/contact-us.html |
| Disallow | /p/terms-of-use.html |
| Disallow | /p/privacy-policy.html |
| Disallow | /search |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.afaq4arab.com/sitemap.xml |