cpu-bench.com
robots.txt

Robots Exclusion Standard data for cpu-bench.com

Resource Scan

Scan Details

Site Domain cpu-bench.com
Base Domain cpu-bench.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-26T20:54:47+00:00
Next Scan 2025-10-25T20:54:47+00:00

Last Successful Scan

Scanned2025-06-28T09:46:38+00:00
URL https://cpu-bench.com/robots.txt
Redirect https://www.cpu-bench.com/robots.txt
Redirect Domain www.cpu-bench.com
Redirect Base cpu-bench.com
Domain IPs 2a02:4780:15:6850:4ce3:cc60:6bc9:b031, 2a02:4780:38:9510:6724:f583:da5a:8ea2, 84.32.84.225, 84.32.84.60
Redirect IPs 179.61.189.42, 2a02:4780:38:5049:fb2e:7134:4f45:797e, 2a02:4780:39:658d:4e93:65dc:84ff:7cbd, 93.127.187.153
Response IP 93.127.201.29
Found Yes
Hash 6e8e5dec90efbf4a7bcdc5057283c1c59cabee88e2fff71048b5b62ad66b7844
SimHash 490c1856e693

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /private/
Disallow /*.json$
Allow /cpu/
Allow /compare/
Allow /performance/
Allow /about/
Allow /contact/

Other Records

Field Value
sitemap https://cpu-bench.com/sitemap.xml

Comments

  • Site Map
  • Disallow paths
  • Allow specific paths