Log In Sign Up

bookmarkshq.com
robots.txt

Robots Exclusion Standard data for bookmarkshq.com

Resource Scan

Scan Details

Site Domain bookmarkshq.com
Base Domain bookmarkshq.com
Scan Status Ok
Last Scan2025-05-19T13:43:32+00:00
Next Scan 2025-06-18T13:43:32+00:00

Last Scan

Scanned2025-05-19T13:43:32+00:00
URL https://bookmarkshq.com/robots.txt
Domain IPs 104.21.94.58, 172.67.220.42, 2606:4700:3032::ac43:dc2a, 2606:4700:3033::6815:5e3a
Response IP 172.67.220.42
Found Yes
Hash c35cea2274e4ea2b32c2cadae5ba27fa4226e6c83ec09db2c91987252b5ebcc6
SimHash 403468bf01e3

Groups

*

Rule Path
Disallow
Disallow /3rdparty/
Disallow /admin/
Disallow /admin/admin_index.php
Disallow /backup/
Disallow /cache/
Disallow /install/
Disallow /internal/
Disallow /languages/
Disallow /libs/
Disallow /live/
Disallow /LICENSE.txt
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /readme.html
Disallow /search.php
Disallow /search/
Disallow /searchurl/
Disallow /tag/
Disallow /templates/
Disallow /new/recent/
Disallow /new/yesterday/
Disallow /new/today/
Disallow /new/week/
Disallow /new/month/
Disallow /new/year/
Disallow /new/alltime/
Disallow /recent/
Disallow /yesterday/
Disallow /today/
Disallow /week/
Disallow /month/
Disallow /year/
Disallow /alltime/
Disallow /upvoted/
Disallow /downvoted/
Disallow /commented/

Other Records

Field Value
crawl-delay 5
Back to top

Comments

  • 1) this filename (robots.txt) must stay lowercase
  • 2) this file must be in the servers root directory
  • ex: http://www.mydomain.com/kliqqisubfolder/ -- you must move the robots.txt from
  • /kliqqisubfolder/ to the root folder for http://www.mydomain.com/
  • you must then add your subfolder to each 'Disallow' below
  • ex: Disallow: /cache/ becomes Disallow: /kliqqisubfolder/cache/
Back to top