store.data18.com
robots.txt

Robots Exclusion Standard data for store.data18.com

Resource Scan

Scan Details

Site Domain store.data18.com
Base Domain data18.com
Scan Status Ok
Last Scan2025-12-31T19:05:39+00:00
Next Scan 2026-01-30T19:05:39+00:00

Last Scan

Scanned2025-12-31T19:05:39+00:00
URL https://store.data18.com/robots.txt
Redirect https://www.store18.com/robots.txt
Redirect Domain www.store18.com
Redirect Base store18.com
Domain IPs 66.206.8.42
Redirect IPs 199.182.184.138
Response IP 199.182.184.138
Found Yes
Hash fc29ceedcba6da66c20ddd566b574e48925b3e4d36848ae1fa0bcad238b65f4d
SimHash c05d5c90e261

Groups

*

Rule Path
Disallow /account/
Disallow /Account/
Disallow /cart/
Disallow /Cart/
Disallow /Search/

megaindex.ru
megaindex.com
pimeyes.com crawler
ahrefs.com

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10