dailygalaxy.brownrice.com
robots.txt

Robots Exclusion Standard data for dailygalaxy.brownrice.com

Resource Scan

Scan Details

Site Domain dailygalaxy.brownrice.com
Base Domain brownrice.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-15T17:17:07+00:00
Next Scan 2024-08-13T17:17:07+00:00

Last Successful Scan

Scanned2022-12-28T15:32:08+00:00
URL http://dailygalaxy.brownrice.com/robots.txt
Domain IPs 209.182.253.146
Response IP 209.182.253.146
Found Yes
Hash d625f592ccc594de98f6c095cad6ca20091070d88105245f64cf1fe9c0a8491d
SimHash c90889828031

Groups

*

Rule Path
Allow /
Allow /wp-content/uploads/
Disallow /wp-admin/
Disallow /wp-content/plugins/
Disallow /readme.html
Disallow /refer/
Disallow /test/
Disallow /dev/
Disallow /feed/
Disallow */feed/

Other Records

Field Value
sitemap https://dailygalaxy.com/post-sitemap1.xml
sitemap https://dailygalaxy.com/post-sitemap2.xml
sitemap https://dailygalaxy.com/page-sitemap.xml
sitemap https://dailygalaxy.com/category-sitemap.xml
sitemap https://dailygalaxy.com/post_tag-sitemap1.xml
sitemap https://dailygalaxy.com/post_tag-sitemap2.xml
sitemap https://dailygalaxy.com/author-sitemap.xml
sitemap https://dailygalaxy.com/news-sitemap.xml