comparative.ai
robots.txt

Robots Exclusion Standard data for comparative.ai

Resource Scan

Scan Details

Site Domain comparative.ai
Base Domain comparative.ai
Scan Status Ok
Last Scan2025-10-16T15:59:49+00:00
Next Scan 2025-11-15T15:59:49+00:00

Last Scan

Scanned2025-10-16T15:59:49+00:00
URL https://comparative.ai/robots.txt
Redirect https://datagpt.com/robots.txt
Redirect Domain datagpt.com
Redirect Base datagpt.com
Domain IPs 159.203.146.96
Redirect IPs 108.157.142.100, 108.157.142.128, 108.157.142.74, 108.157.142.89, 2600:9000:2776:1600:18:2394:69c0:93a1, 2600:9000:2776:3800:18:2394:69c0:93a1, 2600:9000:2776:5a00:18:2394:69c0:93a1, 2600:9000:2776:9600:18:2394:69c0:93a1, 2600:9000:2776:c000:18:2394:69c0:93a1, 2600:9000:2776:e000:18:2394:69c0:93a1, 2600:9000:2776:e00:18:2394:69c0:93a1, 2600:9000:2776:ee00:18:2394:69c0:93a1
Response IP 108.157.142.89
Found Yes
Hash 16ceb5ee3e0dc13aa9adf31a3ebbe45a1d965b8c2b9f72eaf84e5911e140ed95
SimHash 4150c1524731

Groups

*

Rule Path
Allow /