myfermentation.com
robots.txt

Robots Exclusion Standard data for myfermentation.com

Resource Scan

Scan Details

Site Domain myfermentation.com
Base Domain myfermentation.com
Scan Status Ok
Last Scan2024-06-26T06:13:24+00:00
Next Scan 2024-07-03T06:13:24+00:00

Last Scan

Scanned2024-06-26T06:13:24+00:00
URL https://myfermentation.com/robots.txt
Redirect https://www.myfermentation.com/robots.txt
Redirect Domain www.myfermentation.com
Redirect Base myfermentation.com
Domain IPs 13.35.18.108, 13.35.18.109, 13.35.18.5, 13.35.18.54
Redirect IPs 18.238.238.115, 18.238.238.3, 18.238.238.53, 18.238.238.59
Response IP 3.160.246.117
Found Yes
Hash 542f1e8480fc5c584b014767e19ab94400c4cc0f95f6eb2b9566fc9fa37bb8b2
SimHash 03a59a60dba3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /_custom/*
Disallow /*/print/
Disallow /wp-json/*
Disallow /search/*
Disallow /email
Disallow /print
Disallow /print-article.aspx
Disallow /sso/*
Disallow /store/offer/*
Disallow /store/author/*
Disallow /watch/*
Disallow /uploadedFiles/*
Disallow /tags/*
Disallow /search
Disallow /contributors/*

rogerbot

Rule Path
Allow /*
Disallow /wp-admin/
Disallow /_custom/
Disallow /wp-json/

twitterbot

Rule Path
Allow /

dotbot

Rule Path
Allow /*
Disallow /wp-admin/
Disallow /wp-json/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.myfermentation.com/sitemap.xml