almaghribtoday.net
robots.txt
Robots Exclusion Standard data for almaghribtoday.net
Resource Scan
Scan Details
Site Domain | almaghribtoday.net |
Base Domain | almaghribtoday.net |
Scan Status | Ok |
Last Scan | 2025-05-10T14:56:34+00:00 |
Next Scan | 2025-05-17T14:56:34+00:00 |
Last Scan
Scanned | 2025-05-10T14:56:34+00:00 |
URL | https://almaghribtoday.net/robots.txt |
Redirect | https://www.almaghribtoday.net/robots.txt |
Redirect Domain | www.almaghribtoday.net |
Redirect Base | almaghribtoday.net |
Domain IPs | 104.21.95.152, 172.67.145.133, 2606:4700:3033::ac43:9185, 2606:4700:3036::6815:5f98 |
Redirect IPs | 104.21.95.152, 172.67.145.133, 2606:4700:3033::ac43:9185, 2606:4700:3036::6815:5f98 |
Response IP | 104.21.95.152 |
Found | Yes |
Hash | c332e03e585cbad5204ef437a6d024f616eaafa5d4efc930ba0ff0b2e1f41b50 |
SimHash | 6b095e4464d1 |
Groups
*
Rule | Path |
---|---|
Disallow | /application |
Disallow | /fonts/ |
Disallow | /administrator/ |
Disallow | /siteadmin/ |
Disallow | /cgi-bin/ |
Disallow | /cdn-cgi/ |
Disallow | /captcha/ |
Disallow | /~almaghri/* |
Disallow | /system/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.almaghribtoday.net/sitemapindex.xml |
sitemap | https://www.almaghribtoday.net/2018sitemap-breakingnews11.xml |
sitemap | https://www.almaghribtoday.net/2018sitemap-breakingnews12.xml |
sitemap | https://www.almaghribtoday.net/2018sitemap-homepeople.xml |
Comments