growmart.de
robots.txt

Robots Exclusion Standard data for growmart.de

Resource Scan

Scan Details

Site Domain growmart.de
Base Domain growmart.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-02T07:01:46+00:00
Next Scan 2024-08-31T07:01:46+00:00

Last Successful Scan

Scanned2023-10-14T06:18:42+00:00
URL https://growmart.de/robots.txt
Redirect https://www.growmart.de/robots.txt
Redirect Domain www.growmart.de
Redirect Base growmart.de
Domain IPs 104.26.12.236, 104.26.13.236, 172.67.75.236, 2606:4700:20::681a:cec, 2606:4700:20::681a:dec, 2606:4700:20::ac43:4bec
Redirect IPs 104.26.12.236, 104.26.13.236, 172.67.75.236, 2606:4700:20::681a:cec, 2606:4700:20::681a:dec, 2606:4700:20::ac43:4bec
Response IP 104.26.13.236
Found Yes
Hash d0ac65a857d23d255d072566cd90d4471ea1b4f64e613a19e0b9a814fcc665aa
SimHash 6b089053c3b5

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.growmart.de/sitemap_index.xml