fermentmakers.com
robots.txt

Robots Exclusion Standard data for fermentmakers.com

Resource Scan

Scan Details

Site Domain fermentmakers.com
Base Domain fermentmakers.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-14T17:06:39+00:00
Next Scan 2024-10-14T17:06:39+00:00

Last Successful Scan

Scanned2024-08-16T17:06:17+00:00
URL https://fermentmakers.com/robots.txt
Domain IPs 172.96.186.189
Response IP 172.96.186.189
Found Yes
Hash 998a19f7f7418607dbe8a85f16e83aeacd0277893c3e1c42f2d96fe6ccf92ccc
SimHash 1e105d24f800

Groups

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

seokicks

Rule Path
Disallow /