news-en.bestreviews.guide
robots.txt

Robots Exclusion Standard data for news-en.bestreviews.guide

Resource Scan

Scan Details

Site Domain news-en.bestreviews.guide
Base Domain bestreviews.guide
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-19T22:38:52+00:00
Next Scan 2024-06-17T22:38:52+00:00

Last Successful Scan

Scanned2023-07-30T19:40:20+00:00
URL https://news-en.bestreviews.guide/robots.txt
Domain IPs 104.26.0.32, 104.26.1.32, 172.67.68.175, 2606:4700:20::681a:120, 2606:4700:20::681a:20, 2606:4700:20::ac43:44af
Response IP 104.26.1.32
Found Yes
Hash 57acc925b78d5bb7717788fd71051b49e681a28e7143dd1c2f7652242bf430e4
SimHash 20009a62c791

Groups

adsbot-google

Rule Path
Disallow

grapeshot

Rule Path
Disallow

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.bestreviews.guide/sitemap.xml