prescient-ai.io
robots.txt

Robots Exclusion Standard data for prescient-ai.io

Resource Scan

Scan Details

Site Domain prescient-ai.io
Base Domain prescient-ai.io
Scan Status Ok
Last Scan2025-11-22T20:07:28+00:00
Next Scan 2025-12-22T20:07:28+00:00

Last Scan

Scanned2025-11-22T20:07:28+00:00
URL https://prescient-ai.io/robots.txt
Redirect https://prescientai.com/robots.txt
Redirect Domain prescientai.com
Redirect Base prescientai.com
Domain IPs 104.21.49.187, 172.67.165.228, 2606:4700:3032::6815:31bb, 2606:4700:3033::ac43:a5e4
Redirect IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.21
Found Yes
Hash 54681e60e7e0052cab55c404231d89f2f934d78cffafc3a6dd09f4b8497cac18
SimHash 6100dc104792

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://prescientai.com/sitemap_index.xmlSitemap: https://prescientai.com/sitemap_index.xml