aider.ai
robots.txt
Robots Exclusion Standard data for aider.ai
Resource Scan
Scan Details
Site Domain | aider.ai |
Base Domain | aider.ai |
Scan Status | Ok |
Last Scan | 2024-11-06T20:32:21+00:00 |
Next Scan | 2024-12-06T20:32:21+00:00 |
Last Scan
Scanned | 2024-11-06T20:32:21+00:00 |
URL | https://aider.ai/robots.txt |
Redirect | https://www.aider.ai/robots.txt |
Redirect Domain | www.aider.ai |
Redirect Base | aider.ai |
Domain IPs | 75.2.70.75, 99.83.190.102 |
Redirect IPs | 52.197.0.54, 52.199.221.217, 54.178.223.218 |
Response IP | 54.178.223.218 |
Found | Yes |
Hash | d19204a1c320d8269a902a334aecabb139a2cc73fd02644b1bc3540f9b495be7 |
SimHash | b90058c0c390 |
Groups
*
Rule | Path |
---|---|
Disallow | /OG/ |
Disallow | /checkout |
Disallow | /paypal-checkout |
Disallow | /order-confirmation |