withglyph.com
robots.txt

Robots Exclusion Standard data for withglyph.com

Resource Scan

Scan Details

Site Domain withglyph.com
Base Domain withglyph.com
Scan Status Ok
Last Scan2024-05-30T23:42:26+00:00
Next Scan 2024-06-06T23:42:26+00:00

Last Scan

Scanned2024-05-30T23:42:26+00:00
URL https://withglyph.com/robots.txt
Domain IPs 108.157.254.25, 108.157.254.52, 108.157.254.86, 108.157.254.94
Response IP 108.157.254.94
Found Yes
Hash dc4cf96a6e38c90a21e56cec71514d88625d79212554c7db0bfa5315fae6a543
SimHash 0d0042125f33

Groups

*

Rule Path
Disallow /api/
Disallow /_internal/
Disallow /_playground/
Allow /api/opengraph/

twitterbot

Rule Path
Allow /api/shortlink/