pylons.tech
robots.txt

Robots Exclusion Standard data for pylons.tech

Resource Scan

Scan Details

Site Domain pylons.tech
Base Domain pylons.tech
Scan Status Ok
Last Scan2025-06-19T17:56:43+00:00
Next Scan 2025-07-03T17:56:43+00:00

Last Scan

Scanned2025-06-19T17:56:43+00:00
URL https://pylons.tech/robots.txt
Redirect https://www.pylons.tech/robots.txt
Redirect Domain www.pylons.tech
Redirect Base pylons.tech
Domain IPs 198.185.159.144
Redirect IPs 151.101.131.7, 151.101.195.7, 151.101.3.7, 151.101.67.7, 2a04:4e42:200::775, 2a04:4e42:400::775, 2a04:4e42:600::775, 2a04:4e42::775
Response IP 199.232.47.7
Found Yes
Hash 792a9399cb442ba61bc97e8de16d7945afd9915efe95644c28e850b836e784f8
SimHash e0044504ef13

Groups

*

Rule Path
Disallow /ghost/
Disallow /email/
Disallow /members/api/comments/counts/
Disallow /r/
Disallow /webmentions/receive/

Other Records

Field Value
sitemap https://www.pylons.tech/sitemap.xml