lendsqr.com
robots.txt

Robots Exclusion Standard data for lendsqr.com

Resource Scan

Scan Details

Site Domain lendsqr.com
Base Domain lendsqr.com
Scan Status Ok
Last Scan2024-09-14T08:27:05+00:00
Next Scan 2024-10-14T08:27:05+00:00

Last Scan

Scanned2024-09-14T08:27:05+00:00
URL https://lendsqr.com/robots.txt
Domain IPs 13.227.254.111, 13.227.254.27, 13.227.254.40, 13.227.254.86, 2600:9000:200a:200:13:4d4a:9500:93a1, 2600:9000:200a:2e00:13:4d4a:9500:93a1, 2600:9000:200a:3200:13:4d4a:9500:93a1, 2600:9000:200a:4400:13:4d4a:9500:93a1, 2600:9000:200a:4600:13:4d4a:9500:93a1, 2600:9000:200a:7a00:13:4d4a:9500:93a1, 2600:9000:200a:800:13:4d4a:9500:93a1, 2600:9000:200a:a200:13:4d4a:9500:93a1
Response IP 13.33.183.90
Found Yes
Hash 4637cf384c63b0b3199fb597fde99bf72fd9104fe219b9f2ad3a216770fdf19d
SimHash 4850cb404512

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /about.html
Disallow /index.html
Disallow /sitemap.xml
Disallow /careers.lendsqr.com

Comments

  • Allow all crawlers
  • Block all crawlers for /accounts