Log In Sign Up

m.readink.app
robots.txt

Robots Exclusion Standard data for m.readink.app

Resource Scan

Scan Details

Site Domain m.readink.app
Base Domain readink.app
Scan Status Ok
Last Scan2025-10-22T01:24:47+00:00
Next Scan 2025-11-21T01:24:47+00:00

Last Scan

Scanned2025-10-22T01:24:47+00:00
URL https://m.readink.app/robots.txt
Domain IPs 18.155.68.28, 18.155.68.38, 18.155.68.66, 18.155.68.94, 2600:9000:23d2:7400:1f:8621:3f40:93a1, 2600:9000:23d2:800:1f:8621:3f40:93a1, 2600:9000:23d2:9600:1f:8621:3f40:93a1, 2600:9000:23d2:b400:1f:8621:3f40:93a1, 2600:9000:23d2:c00:1f:8621:3f40:93a1, 2600:9000:23d2:d600:1f:8621:3f40:93a1, 2600:9000:23d2:e000:1f:8621:3f40:93a1, 2600:9000:23d2:e800:1f:8621:3f40:93a1
Response IP 18.155.68.66
Found Yes
Hash a9be91eef5f505c8dd0617132b691b92cbd4c0416aa2e175110bfb61ea93661d
SimHash 5043eac2e7b1

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /private/
Disallow /auth/
Disallow /*?_rsc=
Disallow /en
Disallow /en/
Disallow /ja
Disallow /ja/
Disallow /ko
Disallow /ko/
Disallow /th
Disallow /th/
Disallow /zh-TW
Disallow /zh-TW/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Allow /

googlebot-image

Rule Path
Disallow /images/private/
Allow /public/
Back to top

Other Records

Field Value
sitemap https://www.readink.app/sitemap.xml
Back to top

Comments

  • Allow all crawlers
  • Disallow admin and private areas
  • Disallow lang dir
  • Sitemap location
  • Crawl-delay for all bots
  • Crawl-delay: 1
  • Block specific bots that might cause issues
  • Block image crawlers from specific directories
Back to top