emarat-news.ae
robots.txt
Robots Exclusion Standard data for emarat-news.ae
Resource Scan
Scan Details
| Site Domain | emarat-news.ae |
| Base Domain | emarat-news.ae |
| Scan Status | Ok |
| Last Scan | 2024-09-18T08:50:04+00:00 |
| Next Scan | 2024-09-25T08:50:04+00:00 |
Last Scan
| Scanned | 2024-09-18T08:50:04+00:00 |
| URL | https://emarat-news.ae/robots.txt |
| Domain IPs | 104.21.89.152, 172.67.161.40, 2606:4700:3030::ac43:a128, 2606:4700:3031::6815:5998 |
| Response IP | 104.21.89.152 |
| Found | Yes |
| Hash | e8901fda117ffe7ababa6412a99a62b3f99e021d2da7a0cac1d58d5ecc52e988 |
| SimHash | 68407e824783 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /wp-json |
| Disallow | /cgi-bin/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://emarat-news.ae/sitemap_index.xml |