arabtimesonline.com
robots.txt
Robots Exclusion Standard data for arabtimesonline.com
Resource Scan
Scan Details
| Site Domain | arabtimesonline.com |
| Base Domain | arabtimesonline.com |
| Scan Status | Ok |
| Last Scan | 2024-09-18T13:07:10+00:00 |
| Next Scan | 2024-09-25T13:07:10+00:00 |
Last Scan
| Scanned | 2024-09-18T13:07:10+00:00 |
| URL | https://arabtimesonline.com/robots.txt |
| Redirect | https://www.arabtimesonline.com/robots.txt |
| Redirect Domain | www.arabtimesonline.com |
| Redirect Base | arabtimesonline.com |
| Domain IPs | 104.21.53.43, 172.67.208.191, 2606:4700:3033::ac43:d0bf, 2606:4700:3037::6815:352b |
| Redirect IPs | 104.21.53.43, 172.67.208.191, 2606:4700:3033::ac43:d0bf, 2606:4700:3037::6815:352b |
| Response IP | 172.67.208.191 |
| Found | Yes |
| Hash | 603f156a57ad2b83f31fd75cdb9480146e1dc5f73ef4bb2740fd8109443ea037 |
| SimHash | aa0d78476e92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/* |
| Disallow | /print* |
| Disallow | /getRelatedArticles* |
| Disallow | /getMostReadArticles* |
| Disallow | /article_count/* |
| Disallow | /get-menu-header* |
| Disallow | /article.php* |
| Disallow | /login-mgt |
| Disallow | /*.php |
| Disallow | /widget/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.arabtimesonline.com/sitemaps/sitemap_0.xml |