Log In Sign Up

mietwagenmarkt.carhire-solutions.com
robots.txt

Robots Exclusion Standard data for mietwagenmarkt.carhire-solutions.com

Resource Scan

Scan Details

Site Domain mietwagenmarkt.carhire-solutions.com
Base Domain carhire-solutions.com
Scan Status Ok
Last Scan2024-06-27T23:51:43+00:00
Next Scan 2024-07-27T23:51:43+00:00

Last Scan

Scanned2024-06-27T23:51:43+00:00
URL https://mietwagenmarkt.carhire-solutions.com/robots.txt
Domain IPs 13.225.4.108, 13.225.4.54, 13.225.4.58, 13.225.4.64
Response IP 13.225.4.108
Found Yes
Hash 73b4d3dc711ecf2898e4ba0148bceac296557ab9b510dc12d88a64b9446d9a46
SimHash 2444c87ac778

Groups

*

Rule Path
Disallow

lwp-simple/5.65

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

lwp-trivial/1.34

Rule Path
Disallow /

lwp-trivial/1.35

Rule Path
Disallow /

lwp-trivial/1.36

Rule Path
Disallow /

lwp-trivial/1.37

Rule Path
Disallow /

lwp-trivial/1.38

Rule Path
Disallow /

lwp-trivial/1.39

Rule Path
Disallow /

lwp-trivial/1.40

Rule Path
Disallow /

lwp-trivial/1.41

Rule Path
Disallow /

lwp-trivial/1.42

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

jakarta commons-httpclient/3.1

Rule Path
Disallow /
Back to top

Comments

  • We do NOT allow non authorized robots any longer.
Back to top

Warnings

  • 4 invalid lines.
Back to top