porter.io
robots.txt

Robots Exclusion Standard data for porter.io

Resource Scan

Scan Details

Site Domain porter.io
Base Domain porter.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-11-13T08:59:43+00:00
Next Scan 2026-02-11T08:59:43+00:00

Last Successful Scan

Scanned2023-07-04T19:12:09+00:00
URL https://porter.io/robots.txt
Domain IPs 104.21.4.126, 172.67.132.21, 2606:4700:3034::6815:47e, 2606:4700:3036::ac43:8415
Response IP 104.21.4.126
Found Yes
Hash 4139678d30a504238579362ee052503bccc7318d6215551208766d6daa774596
SimHash 2809c662e794

Groups

*

Rule Path
Allow /
Allow /github.com/*
Allow /top/
Disallow /setup/
Disallow /me/
Disallow /top/*/
Disallow /api/*
Disallow /login/
Disallow /login/*

Other Records

Field Value
sitemap https://www.porter.io/sitemap.xml