celeryproject.org
robots.txt

Robots Exclusion Standard data for celeryproject.org

Resource Scan

Scan Details

Site Domain celeryproject.org
Base Domain celeryproject.org
Scan Status Ok
Last Scan2025-04-11T17:05:55+00:00
Next Scan 2025-05-11T17:05:55+00:00

Last Scan

Scanned2025-04-11T17:05:55+00:00
URL https://celeryproject.org/robots.txt
Redirect https://docs.celeryq.dev/robots.txt
Redirect Domain docs.celeryq.dev
Redirect Base celeryq.dev
Domain IPs 217.70.184.55
Redirect IPs 104.16.253.120, 104.16.254.120, 2606:4700::6810:fd78, 2606:4700::6810:fe78
Response IP 104.16.254.120
Found Yes
Hash ca3ae026221d65674c09aad653053a41def8bdc0ca90732e72145e6701d3a4b1
SimHash a804c840cf93

Groups

*

Rule Path Comment
Disallow Allow everything

Other Records

Field Value
sitemap https://docs.celeryq.dev/sitemap.xml