zeller-modellbau.com
robots.txt

Robots Exclusion Standard data for zeller-modellbau.com

Resource Scan

Scan Details

Site Domain zeller-modellbau.com
Base Domain zeller-modellbau.com
Scan Status Ok
Last Scan2025-03-16T18:51:33+00:00
Next Scan 2025-04-15T18:51:33+00:00

Last Scan

Scanned2025-03-16T18:51:33+00:00
URL https://zeller-modellbau.com/robots.txt
Domain IPs 104.21.5.37, 172.67.132.237, 2606:4700:3031::6815:525, 2606:4700:3036::ac43:84ed
Response IP 104.21.5.37
Found Yes
Hash e3c7a6a0e2162d57525f34240f37f9b8ed3c60a88f43d4850c38642801b3def7
SimHash 5e00fdd2e29a

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/plugins/
Disallow /trackback/
Disallow /feed/
Disallow */trackback
Disallow */feed
Disallow */comments
Disallow /*?*
Disallow /*?
Disallow /wp-login.php
Disallow /kasse/order-received/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/

baiduspider
baiduspider-image
haosouspider
jikespider
sosospider
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
yisouspider
youdaobot
mail.ru
rambler
sputnikbot
yandex
yandexmobilebot
adscanner
blexbot
cliqzbot
petalbot
seznambot

Rule Path
Disallow /

slurp
ahrefsbot
siteauditbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
splitsignalbot
semrushbot-coub
dataforseobot
bingbot
adidxbot
bingpreview

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://zeller-modellbau.com/sitemap_index.xml

Comments

  • slow down bots

Warnings

  • 3 invalid lines.