alwatan.com.sa
robots.txt
Robots Exclusion Standard data for alwatan.com.sa
Resource Scan
Scan Details
| Site Domain | alwatan.com.sa |
| Base Domain | alwatan.com.sa |
| Scan Status | Ok |
| Last Scan | 2024-11-13T12:38:23+00:00 |
| Next Scan | 2024-11-20T12:38:23+00:00 |
Last Scan
| Scanned | 2024-11-13T12:38:23+00:00 |
| URL | https://alwatan.com.sa/robots.txt |
| Redirect | https://www.alwatan.com.sa/robots.txt |
| Redirect Domain | www.alwatan.com.sa |
| Redirect Base | alwatan.com.sa |
| Domain IPs | 104.21.52.92, 172.67.197.144, 2606:4700:3034::6815:345c, 2606:4700:3034::ac43:c590 |
| Redirect IPs | 104.21.52.92, 172.67.197.144, 2606:4700:3034::6815:345c, 2606:4700:3034::ac43:c590 |
| Response IP | 104.21.52.92 |
| Found | Yes |
| Hash | ce919ace8c08751f60c9b1351fefb0be99d22da53092457d8e316ab2f91251bf |
| SimHash | 812a5c6379fb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /*.php |
| Disallow | /archive/* |
| Disallow | /search/* |
| Disallow | /ajax/* |
| Disallow | /epaper/* |
| Disallow | /digital* |
| Disallow | /admin* |
| Disallow | /js/* |
| Disallow | /themes/* |
| Disallow | /new/Issues/* |
| Disallow | /New/Issues/* |
| Disallow | /*page%3D |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.alwatan.com.sa/sitemaps/sitemap_0.xml |