pencil.so
robots.txt
Robots Exclusion Standard data for pencil.so
Resource Scan
Scan Details
Site Domain | pencil.so |
Base Domain | pencil.so |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-06-28T22:46:47+00:00 |
Next Scan | 2025-07-28T22:46:47+00:00 |
Last Successful Scan
Scanned | 2025-05-30T20:03:34+00:00 |
URL | https://pencil.so/robots.txt |
Redirect | https://withglyph.com:443/robots.txt |
Redirect Domain | withglyph.com |
Redirect Base | withglyph.com |
Domain IPs | 3.39.87.108, 43.201.165.216 |
Redirect IPs | 3.170.229.3, 3.170.229.35, 3.170.229.42, 3.170.229.79 |
Response IP | 3.170.229.35 |
Found | Yes |
Hash | dc4cf96a6e38c90a21e56cec71514d88625d79212554c7db0bfa5315fae6a543 |
SimHash | 0d0042125f33 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /_internal/ |
Disallow | /_playground/ |
Allow | /api/opengraph/ |