enira.net

We are all living in a technological wasteland.

RSS
people

NAS – Next-gen filesystems – Introduction

Planning a NAS upgrade: Ubuntu 16.04 LTS

For Ubuntu 16.04 LTS I intend to upgrade and move away from my trusted mdadm RAID. For this use I will be testing to see if there are any new file systems that show some versatility in RAID creation, expanding and maintaining.
I will be looking at BTRFS for my RAID1 and RAID5 needs and MHDDFS for JBOD.

Tests

Part 1: BTRFS RAID 1
Part 2: BTRFS RAID 0 & conversion to RAID 5
Part 3: BTRFS RAID 5
Part 4: MHDDFS
Part 5: Conclusion

2 Responses to “NAS – Next-gen filesystems – Introduction”

  1. pentam Says:

    Enira, I noticed your expertise on Siltaz, and in 2012 you were trying to create a cluster (for both storage, and processing) using gluster.

    I’d like the cluster members to be created from PXE boot, and the OS in memory (ie TinyCore or Siltaz). I noticed Siltaz has a “package converter” so RPM or DEB packages can be converted over and be usable.

    For parallel processing, apparently the answer is easy: just install Julia (language) on each box. this would automatically happen when each cluster member is cloned.

    The “Next Generation” file system is more likely to be BeeGFS (than gluster). BeeGFS.com has both RPM and DEB install packages. To be truely Next Generation, they’d need EC (erasure coding) support, which they don’t have now, but are probably working on.

    Seeing that BeeGFS (aka FhGFS, short for Fraunhofer Gesellschaft File System) is actually production grade software (and working on many existing supercomputers), I’d like to see how a cluster can be made with: Slitaz, BeeGFS and Julia (using the existing debian packages for BeeGFS and Julia).

    cheers
    Doug

  2. enira Says:

    Hi Doug,

    Thanks for reaching out. I still have a few other things (part 4 & 5) to finish before looking into this. :) but it sounds like a great test.

    As for the packages, I don’t like the converter. I did this a few times and dependencies tend to go wonky. From source seems to give me the most clean and stable versions.

    For clean contained packages this might work, however for some packages (such as XenServer Guest Tools) you end up with a horrible mess.

    Kind regards,

Leave a Reply

You must be logged in to post a comment.