motorbasar.de
robots.txt

Robots Exclusion Standard data for motorbasar.de

Resource Scan

Scan Details

Site Domain motorbasar.de
Base Domain motorbasar.de
Scan Status Ok
Last Scan2024-09-29T03:06:10+00:00
Next Scan 2024-10-06T03:06:10+00:00

Last Scan

Scanned2024-09-29T03:06:10+00:00
URL https://motorbasar.de/robots.txt
Redirect https://www.motorbasar.de/robots.txt
Redirect Domain www.motorbasar.de
Redirect Base motorbasar.de
Domain IPs 108.156.133.10, 108.156.133.101, 108.156.133.36, 108.156.133.51, 2600:9000:2755:1000:19:65c9:a280:93a1, 2600:9000:2755:1800:19:65c9:a280:93a1, 2600:9000:2755:1a00:19:65c9:a280:93a1, 2600:9000:2755:5600:19:65c9:a280:93a1, 2600:9000:2755:a200:19:65c9:a280:93a1, 2600:9000:2755:ce00:19:65c9:a280:93a1, 2600:9000:2755:ea00:19:65c9:a280:93a1, 2600:9000:2755:f400:19:65c9:a280:93a1
Redirect IPs 96.17.96.20, 96.17.96.25
Response IP 104.88.70.120
Found Yes
Hash ba9c7029f02ab33077a4af0110b651b78a05f52a0cf2ae402f0b93df9da0c0b7
SimHash 99a8500981b2

Groups

*

Rule Path
Disallow /out
Disallow /forum/erfahrungen-mit-www-reifenonlineversand-de-oder-www-stahlkomplettrad-de-t1263122.html
Disallow /forum/markenautoteile-de-da-bestelle-ich-nichts-mehr-t1048828.html
Disallow /forum/security-test-track-b157.html
Disallow /forum/fahrzeuge-b769.html
Disallow /2521ef5d58fc027d3121662b7d8f9ac2/images.html
Disallow /suche.html
Disallow /blogs/rogertennis2*
Disallow /blogs/technik-und-ot-blog*
Disallow /blogs/blogs/berlin-paul*

sogou

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Warnings

  • 2 invalid lines.