Log In Sign Up

api.getpocket.com
robots.txt

Robots Exclusion Standard data for api.getpocket.com

Resource Scan

Scan Details

Site Domain api.getpocket.com
Base Domain getpocket.com
Scan Status Ok
Last Scan2025-03-13T04:44:04+00:00
Next Scan 2025-03-27T04:44:04+00:00

Last Scan

Scanned2025-03-13T04:44:04+00:00
URL https://api.getpocket.com/robots.txt
Domain IPs 13.35.202.33, 13.35.202.51, 13.35.202.52, 13.35.202.53
Response IP 13.35.202.53
Found Yes
Hash 589dd1d574e59658e881f277336c7a4f3a0fb53b80375ac9cd1af3c85f59a8a2
SimHash e4105619c3b7

Groups

*

Rule Path
Disallow /v2/*

*

Rule Path
Disallow /v3/*

*

Rule Path
Disallow /create*

*

Rule Path
Disallow /mini_login*

*

Rule Path
Disallow /button*

*

Rule Path
Disallow /addemail*

*

Rule Path
Disallow /redirect*

*

Rule Path
Disallow /email_unsubscribe*

*

Rule Path
Disallow /firefox/new_tab_learn_more*

*

Rule Path
Disallow /s/*

*

Rule Path
Disallow /read/*

*

Rule Path
Disallow /edit*
Disallow /save*

Other Records

Field Value
crawl-delay 2
Back to top

Comments

  • Crawl-delay is non-standard and is interpreted differently between different
  • search engines. 2 *should* be a low enough value to not disrupt our current SEO
Back to top