alsherifnews.online
robots.txt

Robots Exclusion Standard data for alsherifnews.online

Resource Scan

Scan Details

Site Domain alsherifnews.online
Base Domain alsherifnews.online
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-07T14:20:00+00:00
Next Scan 2024-07-06T14:20:00+00:00

Last Successful Scan

Scanned2023-02-12T08:08:57+00:00
URL https://alsherifnews.online/robots.txt
Domain IPs 104.21.95.97, 172.67.144.24, 2606:4700:3033::ac43:9018, 2606:4700:3034::6815:5f61
Response IP 104.21.95.97
Found Yes
Hash 53cb4ae691edb8afba35e36fd9d4fc2266e068685469c69021f1241ef29c4217
SimHash 2430b9738ef0

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /wp-
Disallow /wp/
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow *utm%3D
Disallow *openstat%3D
Disallow /api.php
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif

Other Records

Field Value
sitemap https://alsherifnews.online/sitemap.xml