booksie.com
robots.txt

Robots Exclusion Standard data for booksie.com

Resource Scan

Scan Details

Site Domain booksie.com
Base Domain booksie.com
Scan Status Ok
Last Scan2024-06-30T06:01:02+00:00
Next Scan 2024-07-07T06:01:02+00:00

Last Scan

Scanned2024-06-30T06:01:02+00:00
URL https://booksie.com/robots.txt
Domain IPs 104.26.10.30, 104.26.11.30, 172.67.72.50, 2606:4700:20::681a:a1e, 2606:4700:20::681a:b1e, 2606:4700:20::ac43:4832
Response IP 172.67.72.50
Found Yes
Hash 78a53d9ef272e26a155f301a69d2c110c340812aea8424207d91fe6920698b52
SimHash d5140b12d9b2

Groups

*

Rule Path
Allow /
Disallow /public/ajax/ajax/get-posting-info/
Disallow /public/ajax/search-writers/
Disallow /public/ajax/ajax-post-icomment/
Disallow /public/ajax/ajax-remove-from-book-shelf
Disallow /public/ajax/ajax-add-to-book-shelf
Disallow /public/ajax/ajax-unlike-posting
Disallow /public/ajax/ajax-like-posting
Disallow /public/ajax/search-tags
Disallow /public/ajax/read-remark
Disallow /public/ajax/search-group-writers
Disallow /js/ckfinder/
Disallow /twitter-connect
Disallow /public-posted-comments/
Disallow /bookshelf-published/amazon/
Disallow /bookshelf-recommended/
Disallow /quickees/
Disallow /writers-that-like/
Disallow /liked-writers-by/
Disallow /charge-contest
Disallow /genre/gay-and-lesbian/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.booksie.com/sitemap.xml
sitemap https://www.booksie.com/sitemap-content-all.xml
sitemap https://www.booksie.com/sitemap-tags.xml