motortests.de
robots.txt

Robots Exclusion Standard data for motortests.de

Resource Scan

Scan Details

Site Domain motortests.de
Base Domain motortests.de
Scan Status Ok
Last Scan2024-10-31T14:36:21+00:00
Next Scan 2024-11-07T14:36:21+00:00

Last Scan

Scanned2024-10-31T14:36:21+00:00
URL https://motortests.de/robots.txt
Redirect https://www.motortests.de/robots.txt
Redirect Domain www.motortests.de
Redirect Base motortests.de
Domain IPs 108.156.133.108, 108.156.133.123, 108.156.133.22, 108.156.133.76, 2600:9000:2755:2800:e:1420:7180:93a1, 2600:9000:2755:3a00:e:1420:7180:93a1, 2600:9000:2755:4400:e:1420:7180:93a1, 2600:9000:2755:4800:e:1420:7180:93a1, 2600:9000:2755:7400:e:1420:7180:93a1, 2600:9000:2755:b600:e:1420:7180:93a1, 2600:9000:2755:c200:e:1420:7180:93a1, 2600:9000:2755:f000:e:1420:7180:93a1
Redirect IPs 2.22.248.31, 2.22.248.34
Response IP 2.19.194.89
Found Yes
Hash ba9c7029f02ab33077a4af0110b651b78a05f52a0cf2ae402f0b93df9da0c0b7
SimHash 99a8500981b2

Groups

*

Rule Path
Disallow /out
Disallow /forum/erfahrungen-mit-www-reifenonlineversand-de-oder-www-stahlkomplettrad-de-t1263122.html
Disallow /forum/markenautoteile-de-da-bestelle-ich-nichts-mehr-t1048828.html
Disallow /forum/security-test-track-b157.html
Disallow /forum/fahrzeuge-b769.html
Disallow /2521ef5d58fc027d3121662b7d8f9ac2/images.html
Disallow /suche.html
Disallow /blogs/rogertennis2*
Disallow /blogs/technik-und-ot-blog*
Disallow /blogs/blogs/berlin-paul*

sogou

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Warnings

  • 2 invalid lines.