arabnewsnetwork.ps
robots.txt
Robots Exclusion Standard data for arabnewsnetwork.ps
Resource Scan
Scan Details
| Site Domain | arabnewsnetwork.ps |
| Base Domain | arabnewsnetwork.ps |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2026-02-03T09:06:55+00:00 |
| Next Scan | 2026-05-04T09:06:55+00:00 |
Last Successful Scan
| Scanned | 2025-04-09T07:20:58+00:00 |
| URL | https://arabnewsnetwork.ps/robots.txt |
| Domain IPs | 199.188.203.34 |
| Response IP | 199.188.203.34 |
| Found | Yes |
| Hash | 3a6151b30ca0cba1206ae0e83cf54654eba8a9e87086adc04f86537ca60b6921 |
| SimHash | 633449526e89 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-content/ |
| Disallow | /wp-includes/ |
| Disallow | /go/ |
| Disallow | /comments/feed/ |
| Disallow | /trackback/ |
| Disallow | /index.php |
| Disallow | /xmlrpc.php |
| Disallow | /search? |
| Disallow | /?p=* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://arabnewsnetwork.ps/sitemap.xml.gz |
Warnings
- 1 invalid line.