mydeutsch-online.com
robots.txt

Robots Exclusion Standard data for mydeutsch-online.com

Resource Scan

Scan Details

Site Domain mydeutsch-online.com
Base Domain mydeutsch-online.com
Scan Status Ok
Last Scan2024-05-11T13:21:23+00:00
Next Scan 2024-06-10T13:21:23+00:00

Last Scan

Scanned2024-05-11T13:21:23+00:00
URL https://mydeutsch-online.com/robots.txt
Domain IPs 65.21.240.56
Response IP 65.21.240.56
Found Yes
Hash 4945f231fa62ec512122a66cac455d3bedfa738f0e0b6421d44e9d67b3170587
SimHash 0116cec2c0a1

Groups

*

Rule Path
Disallow /*route%3Daccount/
Disallow /*route%3Dproduct/search
Disallow /admin
Disallow /catalog
Disallow /system
Disallow /*?tracking=
Disallow /*%26tracking%3D
Disallow /*search
Disallow /?option=com_content&view=article&catid=9&id=277
Disallow /?option=com_content&view=article&catid=9&id=278
Allow /catalog/view/javascript/
Allow /catalog/view/theme/*/

yandex

Rule Path
Disallow /*route%3Daccount/
Disallow /*route%3Dproduct/search
Disallow /admin
Disallow /catalog
Disallow /system
Disallow /*?tracking=
Disallow /*%26tracking%3D
Disallow /*search
Disallow /?option=com_content&view=article&catid=9&id=277
Disallow /?option=com_content&view=article&catid=9&id=278
Allow /catalog/view/javascript/
Allow /catalog/view/theme/*/

serpstatbot
smtbot
semanticjuice
zoombot
seokicks
awariorssbot
awariosmartbot
deepcrawl
jamesbot
domcopbot
cocolyzebot
mtrobot
xovibot
semrushbot
mj12bot
ahrefsbot
dotbot
blexbot
businessseek.biz_spider
dataprovider
panscient.com
dataforseobot
blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://innafurman.com/sitemap.xml

Comments

  • block lawful bots:

Warnings

  • `clean-param` is not a known field.