aiseo.ai
robots.txt
Robots Exclusion Standard data for aiseo.ai
Resource Scan
Scan Details
Site Domain | aiseo.ai |
Base Domain | aiseo.ai |
Scan Status | Ok |
Last Scan | 2025-09-09T23:59:26+00:00 |
Next Scan | 2025-09-23T23:59:26+00:00 |
Last Scan
Scanned | 2025-09-09T23:59:26+00:00 |
URL | https://aiseo.ai/robots.txt |
Domain IPs | 104.26.2.215, 104.26.3.215, 172.67.68.234, 2606:4700:20::681a:2d7, 2606:4700:20::681a:3d7, 2606:4700:20::ac43:44ea |
Response IP | 104.26.3.215 |
Found | Yes |
Hash | 827b156404fa2acc720c2ef17c03f50cda0c09d03d5b536173407e8f87d3d018 |
SimHash | 6924dc308fe1 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /payment/ |
Disallow | /payment/success/ |
Disallow | /payment/fail/ |
Disallow | /*?ref=* |
Disallow | /docs/ |
Disallow | /docs/* |
Disallow | /cdn-cgi/* |
Disallow | /cdn-cgi/l/email-protection |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://aiseo.ai/sitemap.xml |