beternakpedia.com
robots.txt

Robots Exclusion Standard data for beternakpedia.com

Resource Scan

Scan Details

Site Domain beternakpedia.com
Base Domain beternakpedia.com
Scan Status Ok
Last Scan2024-11-15T14:03:57+00:00
Next Scan 2024-11-22T14:03:57+00:00

Last Scan

Scanned2024-11-15T14:03:57+00:00
URL https://beternakpedia.com/robots.txt
Redirect https://www.beternakpedia.com/robots.txt
Redirect Domain www.beternakpedia.com
Redirect Base beternakpedia.com
Domain IPs 216.239.38.21
Redirect IPs 216.239.38.21
Response IP 216.239.38.21
Found Yes
Hash c3618d95c7b6221c7ec339906fb269face5157df8188939bcbd41eeb5df92c06
SimHash 4904de704f92

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /

Other Records

Field Value
sitemap https://www.beternakpedia.com/sitemap.xml