grocergaps.com
robots.txt

Robots Exclusion Standard data for grocergaps.com

Resource Scan

Scan Details

Site Domain grocergaps.com
Base Domain grocergaps.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-02-05T05:00:58+00:00
Next Scan 2026-02-19T05:00:58+00:00

Last Successful Scan

Scanned2026-01-21T05:00:19+00:00
URL https://grocergaps.com/robots.txt
Redirect https://www.grocergaps.com/robots.txt
Redirect Domain www.grocergaps.com
Redirect Base grocergaps.com
Domain IPs 2600:3c03::f03c:91ff:fe64:aa83, 45.33.84.38
Redirect IPs 2600:3c03::f03c:91ff:fe64:aa83, 45.33.84.38
Response IP 45.33.84.38
Found Yes
Hash 9ad3ff43bb05dae4ebb207960daf51479de02f1c5c65210b9ed5c0857c6cbb24
SimHash 801ec40ada1a

Groups

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /