Log In Sign Up

lubefinder.com
robots.txt

Robots Exclusion Standard data for lubefinder.com

Resource Scan

Scan Details

Site Domain lubefinder.com
Base Domain lubefinder.com
Scan Status Ok
Last Scan2024-09-09T06:53:33+00:00
Next Scan 2024-10-09T06:53:33+00:00

Last Scan

Scanned2024-09-09T06:53:33+00:00
URL https://lubefinder.com/robots.txt
Redirect https://www.lubefinder.com/robots.txt
Redirect Domain www.lubefinder.com
Redirect Base lubefinder.com
Domain IPs 13.35.18.15, 13.35.18.79, 13.35.18.88, 13.35.18.98, 2600:9000:20c7:2200:6:805b:ed80:93a1, 2600:9000:20c7:3800:6:805b:ed80:93a1, 2600:9000:20c7:3c00:6:805b:ed80:93a1, 2600:9000:20c7:5c00:6:805b:ed80:93a1, 2600:9000:20c7:a00:6:805b:ed80:93a1, 2600:9000:20c7:b400:6:805b:ed80:93a1, 2600:9000:20c7:d800:6:805b:ed80:93a1, 2600:9000:20c7:de00:6:805b:ed80:93a1
Redirect IPs 13.35.18.15, 13.35.18.79, 13.35.18.88, 13.35.18.98, 2600:9000:20c7:3000:6:805b:ed80:93a1, 2600:9000:20c7:5e00:6:805b:ed80:93a1, 2600:9000:20c7:600:6:805b:ed80:93a1, 2600:9000:20c7:6e00:6:805b:ed80:93a1, 2600:9000:20c7:7a00:6:805b:ed80:93a1, 2600:9000:20c7:ba00:6:805b:ed80:93a1, 2600:9000:20c7:bc00:6:805b:ed80:93a1, 2600:9000:20c7:cc00:6:805b:ed80:93a1
Response IP 13.35.18.88
Found Yes
Hash 6fb17f57cb652561c2262e08b1591f512b5f71a3abe4eee2d9e2f7739eec5d57
SimHash dd045a144595

Groups

*

Rule Path
Disallow */shopby/*
Disallow /checkout
Disallow /customer
Disallow /grease
Disallow /sales
Disallow /oil
Disallow /catalogsearch
Back to top

Other Records

Field Value
sitemap https://www.lubefinder.com/sitemap.xml
Back to top