shop.moji-sushi.de
robots.txt

Robots Exclusion Standard data for shop.moji-sushi.de

Resource Scan

Scan Details

Site Domain shop.moji-sushi.de
Base Domain moji-sushi.de
Scan Status Ok
Last Scan2024-05-21T13:32:54+00:00
Next Scan 2024-06-20T13:32:54+00:00

Last Scan

Scanned2024-05-21T13:32:54+00:00
URL https://shop.moji-sushi.de/robots.txt
Domain IPs 18.154.144.110, 18.154.144.70, 18.154.144.73, 18.154.144.8, 2600:9000:24da:1e00:1a:be31:300:93a1, 2600:9000:24da:2600:1a:be31:300:93a1, 2600:9000:24da:4400:1a:be31:300:93a1, 2600:9000:24da:4600:1a:be31:300:93a1, 2600:9000:24da:7e00:1a:be31:300:93a1, 2600:9000:24da:cc00:1a:be31:300:93a1, 2600:9000:24da:ce00:1a:be31:300:93a1, 2600:9000:24da:d400:1a:be31:300:93a1
Response IP 108.157.60.104
Found Yes
Hash a8e9c3636d898f80889567bcbd81d6fdff2a679f42e30b60552f22273b88f094
SimHash 28596086a672

Groups

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea

Rule Path
Disallow /

*

Rule Path
Disallow /dataPrivacy
Disallow /imprint
Disallow /apilogindenied
Disallow /autologout
Disallow /commonerror
Disallow /devdata
Disallow /permissiondenied
Disallow /nojs
Disallow /newerBrowser
Disallow /setIFrameSession
Disallow /health
Disallow /systemdata
Disallow /saveCookieChoise
Disallow /simulateWebsiteWithIframe

Other Records

Field Value
sitemap https://shop.moji-sushi.de/sitemap