zwischengas.com
robots.txt

Robots Exclusion Standard data for zwischengas.com

Resource Scan

Scan Details

Site Domain zwischengas.com
Base Domain zwischengas.com
Scan Status Ok
Last Scan2024-10-12T18:47:52+00:00
Next Scan 2024-10-19T18:47:52+00:00

Last Scan

Scanned2024-10-12T18:47:52+00:00
URL https://zwischengas.com/robots.txt
Domain IPs 104.26.2.63, 104.26.3.63, 172.67.74.173, 2606:4700:20::681a:23f, 2606:4700:20::681a:33f, 2606:4700:20::ac43:4aad
Response IP 104.26.2.63
Found Yes
Hash bddf534d982181781d3369521e8a9b2001b8f4ba9d3c6093b3f0a23dcbfc2f6d
SimHash 4254dc358213

Groups

megaindex

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /de/shop

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /de/shop

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 15

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sideqik

Rule Path
Disallow /de/shop

Other Records

Field Value
crawl-delay 10

aspiegelbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /de/shop

Other Records

Field Value
crawl-delay 10

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.zwischengas.com/sitemap-index.xml