proline.in
robots.txt

Robots Exclusion Standard data for proline.in

Resource Scan

Scan Details

Site Domain proline.in
Base Domain proline.in
Scan Status Ok
Last Scan2024-09-27T17:35:37+00:00
Next Scan 2024-10-11T17:35:37+00:00

Last Scan

Scanned2024-09-27T17:35:37+00:00
URL https://proline.in/robots.txt
Domain IPs 13.33.88.24, 13.33.88.41, 13.33.88.69, 13.33.88.89, 2600:9000:223b:2400:15:f3a4:f240:93a1, 2600:9000:223b:3800:15:f3a4:f240:93a1, 2600:9000:223b:5000:15:f3a4:f240:93a1, 2600:9000:223b:5a00:15:f3a4:f240:93a1, 2600:9000:223b:6000:15:f3a4:f240:93a1, 2600:9000:223b:600:15:f3a4:f240:93a1, 2600:9000:223b:9400:15:f3a4:f240:93a1, 2600:9000:223b:c00:15:f3a4:f240:93a1
Response IP 13.33.88.24
Found Yes
Hash 9f65c43864e2ef3fbe206dfc72b51c70bae4c50d2ffebd5aaeb53cfe54bdf828
SimHash 0d249d606910

Groups

*

Rule Path
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/
Disallow /checkout
Disallow /my-account
Disallow /search
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /*SID%3D%22

Comments

  • Crawlers Setup
  • Directories
  • Paths