bedsd.com
robots.txt

Robots Exclusion Standard data for bedsd.com

Resource Scan

Scan Details

Site Domain bedsd.com
Base Domain bedsd.com
Scan Status Ok
Last Scan2025-02-28T15:34:49+00:00
Next Scan 2025-03-30T15:34:49+00:00

Last Scan

Scanned2025-02-28T15:34:49+00:00
URL https://bedsd.com/robots.txt
Redirect https://www.bedsd.com/robots.txt
Redirect Domain www.bedsd.com
Redirect Base bedsd.com
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.48.1
Found Yes
Hash 4d25a5bf38c599ca9720ddd7c518e7f5df437e937afdce4b06859c1b7cbb5774
SimHash 8bd2f44afbf2

Groups

botify
spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /search?
Disallow /list?
Disallow /sign_in?
Disallow /sign_up?
Disallow /*?*filters=*
Disallow /*comments
Disallow /spaces/9225760*
Disallow /spaces/10907142*
Disallow /spaces/10614107*
Disallow /spaces/4183486*
Disallow /spaces/10907098*
Disallow /spaces/6329529*
Disallow /spaces/9225775*
Disallow /spaces/7813739*
Disallow /spaces/2467716*
Disallow /spaces/5396728*
Disallow /spaces/6425926*
Disallow /spaces/13983722*
Disallow /spaces/6908217*
Disallow /spaces/6909135*
Disallow /spaces/10948397*
Disallow /spaces/10127342*
Disallow /spaces/7535997*
Disallow /spaces/5603172*
Disallow /spaces/8958256*
Disallow /spaces/3237233*
Disallow /spaces/7086963*
Disallow /spaces/3789408*
Disallow /spaces/5667869*
Disallow /spaces/10907416*
Disallow /spaces/6581056*
Disallow /spaces/6809076*
Disallow /spaces/4578817*
Disallow /spaces/5933623*
Disallow /spaces/6127834*
Disallow /spaces/6409287*
Disallow /spaces/6908673*
Disallow /spaces/6909707*
Disallow /spaces/8974589*
Disallow /spaces/8974757*
Disallow /spaces/10625104*
Disallow /spaces/5797936*
Disallow /spaces/3889692*
Disallow /spaces/6809069*
Disallow /spaces/6809031*
Disallow /spaces/6013484*
Disallow /spaces/11824152*
Disallow /spaces/11978677*
Disallow /spaces/10906872*
Disallow /spaces/7744019*
Disallow /spaces/6026111*
Disallow /spaces/11380285*
Disallow /spaces/7366871*
Disallow /spaces/13070019*
Disallow /spaces/8562017*
Disallow /spaces/6909139*
Disallow /spaces/13008108*
Disallow /spaces/7443033*
Disallow /spaces/2658065*
Disallow /spaces/5780877*
Disallow /spaces/5934078*
Disallow /spaces/6087366*
Disallow /spaces/6907939*
Disallow /spaces/8741543*
Disallow /spaces/8991881*
Disallow /spaces/11380208*
Disallow /spaces/10907256*
Disallow /spaces/10907515*
Disallow /spaces/7280212*
Disallow /spaces/3563568*
Disallow /spaces/4301591*
Disallow /spaces/10831942*
Disallow /spaces/8580575*
Disallow /spaces/8766397*
Disallow /spaces/9134695*
Disallow /spaces/11065024*
Disallow /spaces/6909724*
Disallow /spaces/13255248*
Disallow /spaces/4170275*
Disallow /spaces/5647668*
Disallow /spaces/4338896*
Disallow /spaces/4257574*
Disallow /spaces/2654104*
Disallow /spaces/5304091*
Disallow /spaces/14188253*
Disallow /spaces/10958346*
Disallow /spaces/2972531*
Disallow /spaces/11520979*
Disallow /spaces/11558605*
Disallow /communities/

Other Records

Field Value
sitemap https://www.bedsd.com/sitemap.xml