alwakeelnews.net
robots.txt

Robots Exclusion Standard data for alwakeelnews.net

Resource Scan

Scan Details

Site Domain alwakeelnews.net
Base Domain alwakeelnews.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-03-16T06:09:54+00:00
Next Scan 2024-06-14T06:09:54+00:00

Last Successful Scan

Scanned2023-11-18T06:09:06+00:00
URL https://alwakeelnews.net/robots.txt
Domain IPs 104.21.37.35, 172.67.203.176, 2606:4700:3034::6815:2523, 2606:4700:3034::ac43:cbb0
Response IP 172.67.203.176
Found Yes
Hash e6525ecfacf873b2a1daf649ef55fa67faf000d49c6a34b0356350255e3e0f01
SimHash 4104c9355ec7

Groups

*

Rule Path
Disallow /bin/
Disallow /App_Data/
Disallow /Views/
Allow /Scripts/
Allow /Content/*.js*
Allow /Content/*.css*

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.alwakeelnews.com/sitemap.xml