salvage-parts.com
robots.txt

Robots Exclusion Standard data for salvage-parts.com

Resource Scan

Scan Details

Site Domain salvage-parts.com
Base Domain salvage-parts.com
Scan Status Ok
Last Scan2025-01-06T04:02:43+00:00
Next Scan 2025-01-13T04:02:43+00:00

Last Scan

Scanned2025-01-06T04:02:43+00:00
URL https://salvage-parts.com/robots.txt
Redirect https://www.salvage-parts.com/robots.txt
Redirect Domain www.salvage-parts.com
Redirect Base salvage-parts.com
Domain IPs 104.21.89.75, 172.67.156.245, 2606:4700:3034::6815:594b, 2606:4700:3035::ac43:9cf5
Redirect IPs 104.21.89.75, 172.67.156.245, 2606:4700:3034::6815:594b, 2606:4700:3035::ac43:9cf5
Response IP 104.21.89.75
Found Yes
Hash 9f7b8d762dc59dcb4765d6324f67de4ac62d7fb4d37a42e9cb00927fa5e1d0be
SimHash 6615d240e511

Groups

*

Rule Path
Disallow /classic-parts/canada/
Disallow /motorcycle-parts/canada/
Disallow /truck-parts/canada/
Disallow /atv-parts/canada/
Disallow /cdn-cgi/

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Comments

  • Baiduspider
  • Yandex