cappersfarmer.com
robots.txt

Robots Exclusion Standard data for cappersfarmer.com

Resource Scan

Scan Details

Site Domain cappersfarmer.com
Base Domain cappersfarmer.com
Scan Status Ok
Last Scan2024-06-12T02:45:08+00:00
Next Scan 2024-06-19T02:45:08+00:00

Last Scan

Scanned2024-06-12T02:45:08+00:00
URL https://cappersfarmer.com/robots.txt
Redirect https://www.cappersfarmer.com/robots.txt
Redirect Domain www.cappersfarmer.com
Redirect Base cappersfarmer.com
Domain IPs 3.165.102.105, 3.165.102.121, 3.165.102.54, 3.165.102.73
Redirect IPs 99.84.66.44, 99.84.66.52, 99.84.66.82, 99.84.66.89
Response IP 3.160.246.52
Found Yes
Hash dc0f31ace4dd023d6f8e639981ac4c529d6647e01206a2bdb6338729df2cfdde
SimHash 83a5ba60cba3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /_custom/*
Disallow /*/print/
Disallow /wp-json/*
Disallow /search/*
Disallow /email
Disallow /print
Disallow /print-article.aspx
Disallow /sso/*
Disallow /store/offer/*
Disallow /store/author/*
Disallow /watch/*
Disallow /uploadedFiles/*
Disallow /tags/*
Disallow /search
Disallow /contributors/*

rogerbot

Rule Path
Allow /*
Disallow /wp-admin/
Disallow /_custom/
Disallow /wp-json/

twitterbot

Rule Path
Allow /

dotbot

Rule Path
Allow /*
Disallow /wp-admin/
Disallow /wp-json/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cappersfarmer.com/sitemap.xml