motherearthnews.com
robots.txt

Robots Exclusion Standard data for motherearthnews.com

Resource Scan

Scan Details

Site Domain motherearthnews.com
Base Domain motherearthnews.com
Scan Status Ok
Last Scan2024-05-01T09:40:43+00:00
Next Scan 2024-05-08T09:40:43+00:00

Last Scan

Scanned2024-05-01T09:40:43+00:00
URL https://motherearthnews.com/robots.txt
Redirect https://www.motherearthnews.com/robots.txt
Redirect Domain www.motherearthnews.com
Redirect Base motherearthnews.com
Domain IPs 18.161.180.106, 18.161.180.126, 18.161.180.36, 18.161.180.39
Redirect IPs 13.226.228.48, 13.226.228.5, 13.226.228.66, 13.226.228.99
Response IP 18.165.171.86
Found Yes
Hash c9275a63f539498bed8e6cef79ef5aaa005ea4ad0b67df50ee44b398b282f39d
SimHash 03a5d330dba3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /_custom/*
Disallow /wp-json/
Disallow /*/print/
Disallow /search
Disallow /search/*
Disallow /email
Disallow /print
Disallow /print-article.aspx
Disallow /sso/*
Disallow /store/offer/*
Disallow /store/author/*
Disallow /watch/*
Disallow /uploadedFiles/*
Disallow /tags/*
Disallow /contributors/*

rogerbot

Rule Path
Allow /*
Disallow /wp-admin/
Disallow /_custom/
Disallow /wp-json/

twitterbot

Rule Path
Allow /

dotbot

Rule Path
Allow /*
Disallow /wp-admin/
Disallow /wp-json/

Other Records

Field Value
sitemap https://www.motherearthnews.com/sitemap.xml