motortests.de
robots.txt

Robots Exclusion Standard data for motortests.de

Resource Scan

Scan Details

Site Domain motortests.de
Base Domain motortests.de
Scan Status Ok
Last Scan2024-06-27T04:04:19+00:00
Next Scan 2024-07-04T04:04:19+00:00

Last Scan

Scanned2024-06-27T04:04:19+00:00
URL https://motortests.de/robots.txt
Redirect https://www.motortests.de/robots.txt
Redirect Domain www.motortests.de
Redirect Base motortests.de
Domain IPs 108.156.133.108, 108.156.133.123, 108.156.133.22, 108.156.133.76, 2600:9000:2755:0:e:1420:7180:93a1, 2600:9000:2755:5a00:e:1420:7180:93a1, 2600:9000:2755:6400:e:1420:7180:93a1, 2600:9000:2755:c00:e:1420:7180:93a1, 2600:9000:2755:ca00:e:1420:7180:93a1, 2600:9000:2755:ce00:e:1420:7180:93a1, 2600:9000:2755:d200:e:1420:7180:93a1, 2600:9000:2755:e00:e:1420:7180:93a1
Redirect IPs 173.222.105.67, 173.222.105.9
Response IP 92.122.219.216
Found Yes
Hash ba9c7029f02ab33077a4af0110b651b78a05f52a0cf2ae402f0b93df9da0c0b7
SimHash 99a8500981b2

Groups

*

Rule Path
Disallow /out
Disallow /forum/erfahrungen-mit-www-reifenonlineversand-de-oder-www-stahlkomplettrad-de-t1263122.html
Disallow /forum/markenautoteile-de-da-bestelle-ich-nichts-mehr-t1048828.html
Disallow /forum/security-test-track-b157.html
Disallow /forum/fahrzeuge-b769.html
Disallow /2521ef5d58fc027d3121662b7d8f9ac2/images.html
Disallow /suche.html
Disallow /blogs/rogertennis2*
Disallow /blogs/technik-und-ot-blog*
Disallow /blogs/blogs/berlin-paul*

sogou

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Warnings

  • 2 invalid lines.