alwafd.news
robots.txt

Robots Exclusion Standard data for alwafd.news

Resource Scan

Scan Details

Site Domain alwafd.news
Base Domain alwafd.news
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-02T21:15:00+00:00
Next Scan 2024-12-01T21:15:00+00:00

Last Successful Scan

Scanned2023-08-10T19:05:01+00:00
URL https://alwafd.news/robots.txt
Domain IPs 104.21.15.183, 172.67.163.194, 2606:4700:3033::6815:fb7, 2606:4700:3033::ac43:a3c2
Response IP 104.21.15.183
Found Yes
Hash 54932e070cef89b3dd6bc3a5cc7554bbd156e8127280d641de246de9787551ac
SimHash 7d05ded2e393

Groups

*

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

bingbot-mobile

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

apis-google

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow
Disallow /reporter/
Disallow /_control
Disallow /_ctl
Disallow /Login.aspx
Disallow /_panel

Other Records

Field Value
sitemap https://www.alwafd.news/sitemaps.xml

Comments

  • SYNC 2023
  • HTTPS www.alwafd.news