Yenya's World

Fri, 06 Feb 2009

Filesystem Round-trip Time

It is not so long since I moved most of my personal machines (home computer, workstation at work, and both laptops) to the ext4 filesystem, which I have been already using for backup partitions for some time. However, these days the development in the filesystems area is really fast (and I am not even going into the networked FS area). So, what is next?

If you are thinking BTRFS, you are right. I have grabbed a fresh-from-git version of btrfs-progs (BTW, the release included in Fedora repository is well behind the kernel, get the git one), compiled it, and now my backup partition runs BTRFS.

The next task is to figure out how to add another partition to the existing filesystem in a mirror-like way, and how to use the FS should either of the disks/partitions crash.

Section: /computers (RSS feed) | Permanent link | 7 writebacks

7 replies for this story:

petr_p wrote: Filesystem in Round-trip Time

At first time, I understood title of this article as `Filesystem *in* Round-trip Time' and I recalled hypothetical storage described at [http://www.isec.pl/papers/juggling_with_packets.txt] immediately. After reading, I am really disappointed you did not save your data into such trustworthy file system :)

lali_da wrote: Btrfs Conversion from ...

Btrfs Conversion from Ext3 - exists: [http://btrfs.wiki.kernel.org/index.php/Conversion_from_Ext3] Btrfs Conversion from Ext4 - exists?

Matěj Cepl wrote: Too old?

Which distro you have? http://koji.fedoraproject.org/koji/buildinfo?buildID=95211 (for Fedora 10) seems pretty up-to-date to me ;-) And keep you backup in some safe place ... I had personally pretty rough experience with it (and I thought that loosing /tmp is not a problem ;-)).

Yenya wrote: Re: Too old?

Matěj, I am talking about btrfs-progs, not the kernel itself. And yes, I had to compile btrfs-progs myself from git sources. The current one in F10 is 0.15-4.fc10, which has build date Jun 30, 2008.

Matěj Cepl wrote: Re: Too old?

Take a look at http://koji.fedoraproject.org/koji/packageinfo?packageID=6398 (and I had no problems to rpmbuild --rebuild btrfs-progs from Rawhide)

Yenya wrote: Re: Too old?

Well, for me it was faster to git-clone and build (and to know that I have the latest-greatest sources) than to search Koji and only hoping the packages there are both recent enough, and buildable on F10. I do not fear the C compiler :-)

Matěj wrote: Re: Too old?

I don't fear gcc, but I admire our magicians, so I prefer koji from local builds (also searching koji is usually much faster than making my own package). Anyway, happy it works for you! That's what matters.

Reply to this story:

 
Name:
URL/Email: [http://... or mailto:you@wherever] (optional)
Title: (optional)
Comments:
Key image: key image (valid for an hour only)
Key value: (to verify you are not a bot)

Tue, 03 Feb 2009

Client-side Redundancy

Many network protocols out there have some kind of client-side redundancy built in the client side: for example, DNS can ask the second nameserver from /etc/resolv.conf, should the first one be too slow to reply in time. For LDAP, multiple LDAP servers can be set up in /etc/ldap.conf. The same with Kerberos, SMTP, and many others. Nevertheless, I think depending (solely) on the client-side redundancy in network protocols should be considered harmful. There are many problems with it:

Therefore I think the redundancy for such latency-sensitive services like DNS, Kerberos, or LDAP should be maintained on the server side using things like Heartbeat and a STONITH device. This avoids the "half-dead" server state, and gives the clients a single IP address to talk with. Fortunately, many client-side protocol libraries have a separate server for write access (such as changing the Kerberos password). So the writes can be redirected to a master server, and reads can be done from a set of two, heartbeat-redundant servers.

Which is what we currently do for DNS and DHCP, and I am thinking about doing so for LDAP and Kerberos as well. The client-side redundancy can be an added bonus, but not a primary solution. How do you handle the redundancy of the network services?

Section: /computers (RSS feed) | Permanent link | 0 writebacks

0 replies for this story:

Reply to this story:

 
Name:
URL/Email: [http://... or mailto:you@wherever] (optional)
Title: (optional)
Comments:
Key image: key image (valid for an hour only)
Key value: (to verify you are not a bot)

About:

Yenya's World: Linux and beyond - Yenya's blog.

Links:

RSS feed

Jan "Yenya" Kasprzak

The main page of this blog

Categories:

Archive:

Blog roll:

alphabetically :-)