eremnews.com
robots.txt

Robots Exclusion Standard data for eremnews.com

Resource Scan

Scan Details

Site Domain eremnews.com
Base Domain eremnews.com
Scan Status Ok
Last Scan2024-09-26T02:07:48+00:00
Next Scan 2024-10-03T02:07:48+00:00

Last Scan

Scanned2024-09-26T02:07:48+00:00
URL https://eremnews.com/robots.txt
Redirect https://www.eremnews.com/robots.txt
Redirect Domain www.eremnews.com
Redirect Base eremnews.com
Domain IPs 20.74.192.5
Redirect IPs 20.74.192.5
Response IP 20.74.192.5
Found Yes
Hash fa4e96d7908d10ee7bfe72b41957e78d7d9bd69c0199da46688d37a4e741c8fa
SimHash 681890626fb3

Groups

*

Rule Path
Allow /
Disallow /cms/preview/render
Disallow /search

Other Records

Field Value
sitemap https://www.eremnews.com/sitemap.xml
sitemap https://www.eremnews.com/stories/sitemap-index.xml
sitemap https://www.eremnews.com/sitemap-news.xml