poe.com
robots.txt

Robots Exclusion Standard data for poe.com

Resource Scan

Scan Details

Site Domain poe.com
Base Domain poe.com
Scan Status Ok
Last Scan2024-09-17T09:05:49+00:00
Next Scan 2024-09-24T09:05:49+00:00

Last Scan

Scanned2024-09-17T09:05:49+00:00
URL https://poe.com/robots.txt
Domain IPs 162.159.152.17, 162.159.153.247
Response IP 162.159.153.247
Found Yes
Hash c4d660ca8aaaa2daf472c7f97e576907eeda8c87f1c910999c2ac4f667d3a410
SimHash 6d199f3065f6

Groups

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

gptbot

Rule Path
Disallow /p/*

google-extended

Rule Path
Disallow /p/*

*

Rule Path
Disallow /_next/
Disallow /api/
Disallow /chat/
Disallow /s/
Disallow /apple_callback
Disallow /chats
Disallow /continue_chat
Disallow /desktop_app_open
Disallow /google_callback
Disallow /login
Disallow /search
Disallow /settings
Disallow /unsubscribe
Disallow /