popai.pro
robots.txt

Robots Exclusion Standard data for popai.pro

Resource Scan

Scan Details

Site Domain popai.pro
Base Domain popai.pro
Scan Status Ok
Last Scan2025-06-12T19:48:07+00:00
Next Scan 2025-07-12T19:48:07+00:00

Last Scan

Scanned2025-06-12T19:48:07+00:00
URL https://popai.pro/robots.txt
Redirect https://www.popai.pro/robots.txt
Redirect Domain www.popai.pro
Redirect Base popai.pro
Domain IPs 3.165.75.111, 3.165.75.127, 3.165.75.65, 3.165.75.90
Redirect IPs 104.18.12.163, 104.18.13.163, 2606:4700::6812:ca3, 2606:4700::6812:da3
Response IP 104.18.13.163
Found Yes
Hash 95c0ec64bb5382763a4d3ddda42893cf27529849f881243aeee6b9c43bbfc018
SimHash be135980c8f3

Groups

twitterbot

Rule Path
Disallow *
Allow /share
Allow /share.html

yandexbot

Rule Path
Disallow /resources
Disallow /resourcesasset

facebookexternalhit

Rule Path
Disallow *
Allow /
Allow /ai-presentation
Allow /ai-reader
Allow /ai-writing
Allow /ai-paraphraser
Allow /share
Allow /share.html

linkedinbot

Rule Path
Disallow *
Allow /
Allow /ai-presentation
Allow /ai-reader
Allow /ai-writing
Allow /ai-paraphraser
Allow /share
Allow /share.html

*

Rule Path
Allow /
Disallow /history/
Disallow /user/
Disallow /share.html
Disallow /login
Disallow /uncategorized

Other Records

Field Value
sitemap https://www.popai.pro/sitemap.xml