refiner.io
robots.txt

Robots Exclusion Standard data for refiner.io

Resource Scan

Scan Details

Site Domain refiner.io
Base Domain refiner.io
Scan Status Ok
Last Scan2024-06-21T16:31:17+00:00
Next Scan 2024-07-21T16:31:17+00:00

Last Scan

Scanned2024-06-21T16:31:17+00:00
URL https://refiner.io/robots.txt
Domain IPs 13.33.88.126, 13.33.88.22, 13.33.88.52, 13.33.88.54, 2600:9000:223b:2200:4:85c3:50c0:93a1, 2600:9000:223b:3400:4:85c3:50c0:93a1, 2600:9000:223b:4a00:4:85c3:50c0:93a1, 2600:9000:223b:7400:4:85c3:50c0:93a1, 2600:9000:223b:8400:4:85c3:50c0:93a1, 2600:9000:223b:8600:4:85c3:50c0:93a1, 2600:9000:223b:9e00:4:85c3:50c0:93a1, 2600:9000:223b:da00:4:85c3:50c0:93a1
Response IP 13.33.88.22
Found Yes
Hash fd89345af6aca5dab85f2aa6a830e270a362b1fa6b5f19607ddd773a081ed651
SimHash 6550c5446511

Groups

*

No rules defined. All paths allowed.