tag:blogger.com,1999:blog-7268743010500230881.post3982639132181229765..comments2024-03-06T21:49:33.137-07:00Comments on Mr. Blue Coat: (updated) Distributed File System benchmarkMr. Blue Coathttp://www.blogger.com/profile/11409833689883115951noreply@blogger.comBlogger15125tag:blogger.com,1999:blog-7268743010500230881.post-42334862891616212522021-07-20T08:38:21.858-07:002021-07-20T08:38:21.858-07:00RozoFS is no longer open source: https://github.co...RozoFS is no longer open source: https://github.com/rozofsMr. Blue Coathttps://www.blogger.com/profile/11409833689883115951noreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-69032407245428838632018-10-30T14:20:09.572-07:002018-10-30T14:20:09.572-07:00Another consideration is RozoFS. According to Wiki...Another consideration is RozoFS. According to Wikipedia, it seems to fit most of your requirement:<br /><br />- No single-point-of-failure: Normally, the exportd is the SPOF (http://rozofs.github.io/rozofs/develop/AboutRozoFS.html#rozofs-data-protection), but the replicated metaservers provide fail over (http://rozofs.github.io/rozofs/develop/AboutRozoFS.html#rozofs-fundamentals).<br />- POSIX-compliant: Yes<br />- Open source: GNU General Public License v2<br />- Production ready: 2.5.1<br />- New GA release within the past 12 months: 26 February 2018<br />- Ubuntu-compatible and easy enough to set up via CloudFormation: I have no idea. :(Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-16901440364596107972016-11-12T14:41:26.011-07:002016-11-12T14:41:26.011-07:00Good point Danny! It seems from https://github.co...Good point Danny! It seems from https://github.com/lizardfs/lizardfs/issues/266#issuecomment-93455849 and https://github.com/lizardfs/lizardfs/issues/299 and https://github.com/lizardfs/lizardfs/issues/326 that Metadata HA is not reliable or requires additional tooling. I'll update my recommendation to prefer GlusterFS. Thanks!Mr. Blue Coathttps://www.blogger.com/profile/11409833689883115951noreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-62129662093492970652016-11-08T18:29:44.507-07:002016-11-08T18:29:44.507-07:00Thank you for this work, this is very useful and i...Thank you for this work, this is very useful and informative! I've been considering LizardFS myself however after chatting with one of their reps today I found that both the Windows Native Client and Metadata HA mechanism are closed sourced and provided only as part of a Commercial agreement. Both are important for my use case as we have a mixed Windows/Linux environment and Metadata HA is kind of a basic requirement :)<br /><br />I do wonder, how did you setup the HA for Metadata servers ? from brief review of the CloudFormation script I see that you have 3 Masters, Master1 (Personality=master) and Master2+3 (Personality=shadow).<br /><br />With such a configuration, the fail-over is not automatic, in case Master1 dies one of the Shadow Masters needs to be promoted manually (as was explained to me today).<br /><br />I guess something like corosync could be used to handle this, but I do wonder how you've managed this.<br /><br />Thanks!<br />DannyAnonymoushttps://www.blogger.com/profile/01948213046657281801noreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-39066589704530705562016-08-25T07:19:31.604-07:002016-08-25T07:19:31.604-07:00Hi Kiran, this guide is intended for busy and new ...Hi Kiran, this guide is intended for busy and new sysadmins that simply want a single free HA product that meets their needs. My goal is not academic research-grade completeness by combining and configuring a suite of technical tools. Feel free to use my scripts above, though, and perform that additional study.Mr. Blue Coathttps://www.blogger.com/profile/11409833689883115951noreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-26728572429140761432016-08-24T14:13:14.358-07:002016-08-24T14:13:14.358-07:00Moosefs have 2 version of software - One is a comp...Moosefs have 2 version of software - One is a complete open source (GPLv2 license) which does not need any license and the commercial one which needs a license. The only difference between both is, commercial comes with built in support for HA for master server and in open source version you need to configure it using corosync or ucarp etc.<br /><br />You can try comparing Lizardfs and open source version of Moosefs and lizardfs is fork from open source version of Moosefs.<br /><br />Link to open source Moosefs<br /><br />https://moosefs.com/download/sources.htmlAnonymousnoreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-6695130655742153132016-08-01T21:24:40.781-07:002016-08-01T21:24:40.781-07:00MooseFS is a commercial product and I don't ha...MooseFS is a commercial product and I don't have a license. Sorry.Mr. Blue Coathttps://www.blogger.com/profile/11409833689883115951noreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-53313561413481002312016-08-01T21:17:09.283-07:002016-08-01T21:17:09.283-07:00Is it possible to share performance results betwee...Is it possible to share performance results between LizardFS and Moosefs.<br /><br />Thanks.Shine and Gohttps://www.blogger.com/profile/14271856931543859543noreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-32908977764459787002016-05-14T15:53:16.155-07:002016-05-14T15:53:16.155-07:00Hi Chris, the 410 GB hard drive is the default wit...Hi Chris, the 410 GB hard drive is the default with my selected AWS instance: https://gist.github.com/anonymous/f9e36edf2c341db4d8c3#file-cephfs-json-L54-L64 You don't have to configure additional drive space, it just comes with it by default.Mr. Blue Coathttps://www.blogger.com/profile/11409833689883115951noreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-55163265309986547252016-05-13T18:08:42.378-07:002016-05-13T18:08:42.378-07:00Hello Mr. Blue Coat! Thank you for sharing these r...Hello Mr. Blue Coat! Thank you for sharing these results! :) <br /><br />You say that you use a "410 GB hard drive (local instance storage)" but the CloudFormation script for CephFS doesnt seem to have that configured. I'm sorry if this sounds noobish, but how do you set up such a thing in a cloudformation script?<br /><br />Thanks again! :)Chrishttps://www.blogger.com/profile/02077266055342622597noreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-2139577647691011652016-05-02T09:42:50.805-07:002016-05-02T09:42:50.805-07:00Thanks very much for not only providing some nice,...Thanks very much for not only providing some nice, neutral results but sharing the exact methods needed to reproduce this for others.Benjaminhttps://www.blogger.com/profile/09464415239590576478noreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-18639133610325903192016-03-15T08:06:23.265-07:002016-03-15T08:06:23.265-07:00thanks for these, pretty informativethanks for these, pretty informativeAnonymoushttps://www.blogger.com/profile/15624788712918078157noreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-6665873977477970842016-03-01T16:37:07.285-07:002016-03-01T16:37:07.285-07:00Greatly appreciate theseGreatly appreciate these274https://www.blogger.com/profile/01196602544392578288noreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-31524122568546613802016-02-29T10:58:35.359-07:002016-02-29T10:58:35.359-07:00You're welcome, Mateus!You're welcome, Mateus!Mr. Blue Coathttps://www.blogger.com/profile/11409833689883115951noreply@blogger.comtag:blogger.com,1999:blog-7268743010500230881.post-4611012337302601652016-02-27T18:15:47.771-07:002016-02-27T18:15:47.771-07:00Thank you for sharing your tests.Thank you for sharing your tests.Mateus Mattoshttps://www.blogger.com/profile/05970316100418766401noreply@blogger.com