skynewsarabia.com
robots.txt
Robots Exclusion Standard data for skynewsarabia.com
Resource Scan
Scan Details
Site Domain | skynewsarabia.com |
Base Domain | skynewsarabia.com |
Scan Status | Ok |
Last Scan | 2024-05-10T23:08:54+00:00 |
Next Scan | 2024-05-17T23:08:54+00:00 |
Last Scan
Scanned | 2024-05-10T23:08:54+00:00 |
URL | https://skynewsarabia.com/robots.txt |
Redirect | https://www.skynewsarabia.com:443/robots.txt |
Redirect Domain | www.skynewsarabia.com |
Redirect Base | skynewsarabia.com |
Domain IPs | 3.127.180.224, 52.28.202.106 |
Redirect IPs | 13.33.88.69, 13.33.88.71, 13.33.88.75, 13.33.88.78 |
Response IP | 13.33.88.78 |
Found | Yes |
Hash | d5617acca0f94461678a76c8a8f72f7bc608d7468fd306e8e8291d0183c0fb20 |
SimHash | eb055c006593 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi/ |
Disallow | /public/status |
Disallow | /web/search |
Disallow | /search |
Disallow | /keyword-search |
Disallow | /web/tag |
Disallow | /amp/video/embed/ |
Disallow | /cdn-cgi/ |
Disallow | /staticasset/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.skynewsarabia.com/sitemaps/sitemap.xml |