herolot.com
robots.txt

Robots Exclusion Standard data for herolot.com

Resource Scan

Scan Details

Site Domain herolot.com
Base Domain herolot.com
Scan Status Ok
Last Scan2024-09-23T00:58:46+00:00
Next Scan 2024-09-30T00:58:46+00:00

Last Scan

Scanned2024-09-23T00:58:46+00:00
URL https://herolot.com/robots.txt
Domain IPs 104.26.8.225, 104.26.9.225, 172.67.70.237, 2606:4700:20::681a:8e1, 2606:4700:20::681a:9e1, 2606:4700:20::ac43:46ed
Response IP 104.26.9.225
Found Yes
Hash 37db49d1efd8d7dafc9c1e6a114e8a8b500583894ced9c3ca67bb8f2e2ec79ea
SimHash c85cd9c0a313

Groups

*

Rule Path
Allow /
Disallow /user/
Disallow */*?vehicleTypeId=*
Disallow */*?_ym_status-check=*
Disallow */*?sortBy=*

yandex

Rule Path
Allow /
Disallow /user/
Disallow */*?vehicleTypeId=*
Disallow */*?_ym_status-check=*
Disallow */*?sortBy=*

googlebot

Rule Path
Allow /
Disallow /user/
Disallow */*?vehicleTypeId=*
Disallow */*?_ym_status-check=*
Disallow */*?sortBy=*

Other Records

Field Value
sitemap https://storage.herolot.com/sitemaps.xml