motor-talk.de
robots.txt

Robots Exclusion Standard data for motor-talk.de

Resource Scan

Scan Details

Site Domain motor-talk.de
Base Domain motor-talk.de
Scan Status Ok
Last Scan2024-09-16T07:19:39+00:00
Next Scan 2024-09-23T07:19:39+00:00

Last Scan

Scanned2024-09-16T07:19:39+00:00
URL https://motor-talk.de/robots.txt
Redirect https://www.motor-talk.de/robots.txt
Redirect Domain www.motor-talk.de
Redirect Base motor-talk.de
Domain IPs 13.33.88.119, 13.33.88.123, 13.33.88.128, 13.33.88.49, 2600:9000:2014:2800:a:2232:6180:93a1, 2600:9000:2014:6600:a:2232:6180:93a1, 2600:9000:2014:7a00:a:2232:6180:93a1, 2600:9000:2014:9a00:a:2232:6180:93a1, 2600:9000:2014:9c00:a:2232:6180:93a1, 2600:9000:2014:b200:a:2232:6180:93a1, 2600:9000:2014:bc00:a:2232:6180:93a1, 2600:9000:2014:c800:a:2232:6180:93a1
Redirect IPs 104.84.152.8, 95.101.142.168
Response IP 23.192.118.76
Found Yes
Hash ba9c7029f02ab33077a4af0110b651b78a05f52a0cf2ae402f0b93df9da0c0b7
SimHash 99a8500981b2

Groups

*

Rule Path
Disallow /out
Disallow /forum/erfahrungen-mit-www-reifenonlineversand-de-oder-www-stahlkomplettrad-de-t1263122.html
Disallow /forum/markenautoteile-de-da-bestelle-ich-nichts-mehr-t1048828.html
Disallow /forum/security-test-track-b157.html
Disallow /forum/fahrzeuge-b769.html
Disallow /2521ef5d58fc027d3121662b7d8f9ac2/images.html
Disallow /suche.html
Disallow /blogs/rogertennis2*
Disallow /blogs/technik-und-ot-blog*
Disallow /blogs/blogs/berlin-paul*

sogou

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Warnings

  • 2 invalid lines.