friendbookmark.com
robots.txt

Robots Exclusion Standard data for friendbookmark.com

Resource Scan

Scan Details

Site Domain friendbookmark.com
Base Domain friendbookmark.com
Scan Status Ok
Last Scan2026-03-02T08:27:09+00:00
Next Scan 2026-03-09T08:27:09+00:00

Last Scan

Scanned2026-03-02T08:27:09+00:00
URL https://friendbookmark.com/robots.txt
Redirect https://www.friendbookmark.com/robots.txt
Redirect Domain www.friendbookmark.com
Redirect Base friendbookmark.com
Domain IPs 66.23.231.201
Redirect IPs 66.23.231.201
Response IP 66.23.231.201
Found Yes
Hash 223dc62269c4ad4687e5aef5305f9865c05810deaf6ec7ee47bf805ce2ded185
SimHash 6d1447957151

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-news

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

pinterestbot

Rule Path
Disallow

*

Rule Path
Disallow /main/

Other Records

Field Value
sitemap https://www.friendbookmark.com/sitemap_index.xml

Comments

  • Allow Google crawlers
  • Allow Bingbot (Microsoft)
  • Allow Yahoo Slurp