cpu-compare.com
robots.txt

Robots Exclusion Standard data for cpu-compare.com

Resource Scan

Scan Details

Site Domain cpu-compare.com
Base Domain cpu-compare.com
Scan Status Ok
Last Scan2024-11-16T02:33:19+00:00
Next Scan 2024-11-23T02:33:19+00:00

Last Scan

Scanned2024-11-16T02:33:19+00:00
URL https://cpu-compare.com/robots.txt
Domain IPs 104.21.54.140, 172.67.138.253, 2606:4700:3033::6815:368c, 2606:4700:3037::ac43:8afd
Response IP 104.21.54.140
Found Yes
Hash edd8ea1f1600f81cedb32abb63dd412f03951cc5b4dc226a0f14220bcd4af7f8
SimHash 6c10da62b373

Groups

*

Rule Path
Allow /
Disallow /login
Disallow /search

yandex

Rule Path
Allow /
Disallow /login
Disallow /search

Warnings

  • `clean-param` is not a known field.