martins-supermarkets.com
robots.txt

Robots Exclusion Standard data for martins-supermarkets.com

Resource Scan

Scan Details

Site Domain martins-supermarkets.com
Base Domain martins-supermarkets.com
Scan Status Ok
Last Scan2025-04-11T16:20:03+00:00
Next Scan 2025-05-11T16:20:03+00:00

Last Scan

Scanned2025-04-11T16:20:03+00:00
URL https://martins-supermarkets.com/robots.txt
Redirect https://www.martinsgroceriestogo.com/robots.txt
Redirect Domain www.martinsgroceriestogo.com
Redirect Base martinsgroceriestogo.com
Domain IPs 104.18.35.248, 172.64.152.8, 2606:4700:4400::6812:23f8, 2606:4700:4400::ac40:9808
Redirect IPs 104.18.38.80, 172.64.149.176, 2606:4700:4400::6812:2650, 2606:4700:4400::ac40:95b0
Response IP 172.64.149.176
Found Yes
Hash 8a49a82bd90b9174fd732e4976667ad68379a2f3068060b325123ea4948e26b1
SimHash 6b0c980021b2

Groups

mj12bot

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /wp-admin/

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.martinsgroceriestogo.com/sitemap.xml
sitemap https://www.martinsgroceriestogo.com/sitemap.html