serp.ai
robots.txt

Robots Exclusion Standard data for serp.ai

Resource Scan

Scan Details

Site Domain serp.ai
Base Domain serp.ai
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-10T15:09:07+00:00
Next Scan 2024-06-09T15:09:07+00:00

Last Successful Scan

Scanned2024-01-19T11:25:47+00:00
URL https://serp.ai/robots.txt
Domain IPs 104.26.12.180, 104.26.13.180, 172.67.69.7, 2606:4700:20::681a:cb4, 2606:4700:20::681a:db4, 2606:4700:20::ac43:4507
Response IP 104.26.12.180
Found Yes
Hash c809c70b5d8be2841736caecf43266024f6be8a7085c96b1eb7d078061d6825c
SimHash e0184404ef13

Groups

*

Rule Path
Disallow /ghost/
Disallow /p/
Disallow /email/
Disallow /r/

Other Records

Field Value
sitemap https://serp.ai/sitemap.xml