litstack.com
robots.txt

Robots Exclusion Standard data for litstack.com

Resource Scan

Scan Details

Site Domain litstack.com
Base Domain litstack.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-10-22T22:58:50+00:00
Next Scan 2026-01-20T22:58:50+00:00

Last Successful Scan

Scanned2025-06-24T17:33:38+00:00
URL https://litstack.com/robots.txt
Redirect https://www.litstack.com/robots.txt
Redirect Domain www.litstack.com
Redirect Base litstack.com
Domain IPs 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138
Redirect IPs 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138
Response IP 52.221.42.138
Found Yes
Hash 12606ad902838faf753d682f7b8d0c6f56fa10b7acaa4fb4a562b92dc05fd205
SimHash 28189149e9e5

Groups

*

Rule Path
Disallow

twitterbot

Rule Path
Allow /images
Allow /archives

facebookexternalhit

Rule Path
Allow /images

*

Rule Path
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json

Comments

  • Certain social media sites are whitelisted to allow crawlers to access page markup when links to /images are shared.