http://blog.gmane.org/gmane.comp.file-systems.gluster.user hourly 1 1901-01-01T00:00+00:00 http://gmane.org/img/gmane-25t.png http://gmane.org http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11777 <pre>Hi All, I'm currently testing GFS on a geographically distributed environment. Our scenario: We have 2 Datacenters: Kuwait/Dubai. I have build test servers in both the locations. My glusterFS volume looks like this: Volume Name: cloudgfs Type: Replicate Volume ID: 3e002989-6c9f-4f83-9bd5-c8a3442d8721 Status: Started Number of Bricks: 1 x 4 = 4 Transport-type: tcp Bricks: Brick1: KWTTESTGSNODE001:/mnt/cloudbrick Brick2: KWTTESTGSNODE002:/mnt/cloudbrick Brick3: DXBTESTGSNODE001:/mnt/cloudbrick Brick4: DXBTESTGSNODE002:/mnt/cloudbrick As you see it's a basic replicated volume. This volume is mounted on 2 applications servers: 1in Kuwait/1 in Dubai. This volume will act as a cloud based file share for users. The replication is synchronous. Any idea how we can make the replication asynchronous. Any feedback on how we can make the setup more rigid. Thanks &amp; Regards, Bobby Jacob P SAVE TREES. Please don't print this e-mail unless yo</pre> Bobby Jacob 2013-05-21T13:00:36 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11776 <pre>Hello All, I am exploring options for deploying a Gluster system, and one possible scenario we are contemplating would involve potentially thousands (1-2000) of volumes with correspondingly thousands of mounts. Are there any intrinsic reason why this would be a bad idea with Gluster? The reason this is being contemplated has to do with lvm snapshots in a replicated setup. Thanks, Joseph </pre> Joseph Santaniello 2013-05-21T12:45:46 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11775 <pre>Hi, i`ve a GlusterVolume with a directory quota: features.quota: on features.limit-usage: /test:10TB is there any solution to mount the directory test as "volume" on the Client ? the purpose is "df -h" on the glusterclient should show as available diskspace the directory quota of the "test" Folder - in my case like 10 TB and not the whole GlusterVolume Diskspace ? best regards Rainer </pre> debian-QiA2/PlftgWzZXS1Dc/lvw< at >public.gmane.org 2013-05-21T08:15:20 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11770 <pre>Hi gluster: Im getting the cryptic 107 error, (I guess this means gluster can't see a peer)... gluster peer probe vm-2 peer probe: failed: Probe returned with unknown errno 107 When I can effectively ssh and ping a given server. I've seen other threads regarding this, some of them to deal with the "net.ipv4.ip_nonlocal_bind" parameter, and also a bug https://bugzilla.redhat.com/show_bug.cgi?id=890587 ... But I'm still not sure what the nature of this error is - any thoughts? </pre> Jay Vyas 2013-05-20T22:45:50 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11765 <pre>http://community.gluster.org/a/linux-kernel-tuning-for-glusterfs/ now gives a 404. Does anyone know where it's gone or have a copy? Thanks, Brian. </pre> Brian Candler 2013-05-20T16:33:43 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11764 <pre>Hi, Where can I find glusterfs-hadoop-0.20.2-0.1.x86_64.rpm? The following link is from the Gluster FS Admin Guide, but it doesn't exist: http://download.gluster.com/pub/gluster/glusterfs/qa-releases/3.3-beta-2/glusterfs-hadoop-0.20.2-0.1.x86_64.rpm Thanks! _______________________________________________ Gluster-users mailing list Gluster-users-+FkPdpiNhgJAfugRpC6u6w&lt; at &gt;public.gmane.org http://supercolony.gluster.org/mailman/listinfo/gluster-users</pre> Xing Yang 2013-05-20T15:23:11 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11761 <pre>Hi all, Some really large patch sets for improving RDMA (Infiniband) have been merged into GlusterFS's git repo (master branch) over the last few days. If you're a user of Infiniband and have some time to build the packages from source (it's easy) then test stuff out, that would be really, really welcome. :) Anyone up for the challenge? :) Note - For Fedora/RHEL/CentOS users, package building instructions are here (takes less than 10 mins, completely cut-n-paste steps): http://www.gluster.org/community/documentation/index.php/CompilingRPMS Regards and best wishes, Justin Clift -- Open Source and Standards &lt; at &gt; Red Hat twitter.com/realjustinclift </pre> Justin Clift 2013-05-20T12:04:30 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11759 <pre> RPM: http://bits.gluster.org/pub/gluster/glusterfs/3.3.2qa3/ SRC: http://bits.gluster.org/pub/gluster/glusterfs/src/glusterfs-3.3.2qa3.tar.gz This release is made off jenkins-release-34 </pre> Gluster Build System 2013-05-17T13:17:30 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11755 <pre>Hi Bryan, I've read about your adventures with infiniband and cloudstack on http://www.marshut.com/kqss/cloudstack-glusterfs-over-infiniband.html. I was wondering if you could share how you've setup your secondary storage in cloudstack? Have you done this through nfs over glusterfs? If so, would you mind sharing a bit more information? I am setting up a similar infrastructure and is currently having issues with the secondary storage vm and nfs over glusterfs mountpoint. Many thanks Andrei _______________________________________________ Gluster-users mailing list Gluster-users-+FkPdpiNhgJAfugRpC6u6w&lt; at &gt;public.gmane.org http://supercolony.gluster.org/mailman/listinfo/gluster-users</pre> Andrei Mikhailovsky 2013-05-16T20:28:33 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11747 <pre>Dear all, I got a problem that some directories got the same gfid after doing actions as follow: # cd /testfs/mydir # ls -l total 36 -rw-r--r-- 1 root root 0 Apr 20 00:09 bb drwxrwxrwx 5 protein cms 4096 Apr 21 13:33 aa drwxr-xr-x 2 root root 4096 May 9 22:36 cc drwxr-xr-x 3 root root 4096 May 13 23:12 dd drwxr-xr-x 4 protein cms 4096 May 10 15:33 test # mv test test_old # mkdir test By doing those, we got the same gfid of "test" and "test_old" on server side. At this time, it's confused for client when accessing "test" and "test_old". For this problem, I generated a unique gfid for "test" and reset it manually. It's neccessary to restart client and server to clean inode table to take effect, otherwise, gfid self-heal will always using gfid got from inode to heal it. Does someone get this problem? Who knows to clean inode table online without restart all clients and servers to keep from affecting storage service? Thank you in advance.</pre> huangql 2013-05-15T06:38:45 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11738 <pre>Hi, Im trying to follow this guide to set up a simple cluster: http://www.gluster.org/community/documentation/index.php/QuickStart But when I issue this command : gluster volume create glustervol01 replica 2 192.168.126.128:/export/brick1 192.168.126.129:/export/brick1 I get the following eror: volume create: glustervol01: failed: The brick 192.168.126.129:/export/brick1 is a mount point. Please create a sub-directory under the mount point and use that as the brick directory. Or use 'force' at the end of the command if you want to override this behavior. Am I doing something wrong ? The guide tells you to 'mkdir -p /export/brick1', and add '/dev/glusterfsvol/glusterfslv1 /export/brick1 xfs defaults 1 2' to /etc/fstab. So yeah, /exports/brick is a mount point. You just created it. I dont get it... - John Smith </pre> John Smith 2013-05-14T18:22:34 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11727 <pre>Hi all, I noticed that Fedora 19 has Gluster 3.4.0 beta 1 and I was wanting to test out the new vm storage stuff included with this release. However when trying to create the image with qemu-img create I get an unknown protocal error. I have both glusterfs-server and glusterfs-devel as well as qemu-img-1.4.1 installed from the updates-testing repo. Does anybody know how to test this feature out with Fedora 19 or what I am doing wrong? Thanks, -- _ /-\ ndrew Niemantsverdriet Linux System Administrator Academic Computing (406) 238-7360 Rocky Mountain College 1511 Poly Dr. Billings MT, 59102 </pre> Andrew Niemantsverdriet 2013-05-13T18:13:12 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11724 <pre>Hi all, I'm pretty new to Gluster, and the company I work for uses it for storage across 2 data centres. An issue has cropped up fairly recently with regards to the self-heal mechanism. Occasionally the connection between these 2 Gluster servers breaks or drops momentarily. Due to the nature of the business it's highly likely that files have been written during this time. When the self-heal daemon runs it notices a discrepancy and gets the volume up to date. The problem we've been seeing is that this appears to cause the CPU load to increase massively on both servers whilst the healing process takes place. After trying to find out if there were any persistent network issues I tried recreating this on a test system and can now re-produce at will. Our test system set up is made up of 3 VMs, 2 Gluster servers and a client. The process to cause this was: Add in an iptables rule to block one of the Gluster servers from being reached by the other server and the client. Create some random files on the client. Fl</pre> Matthew Day 2013-05-10T14:40:25 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11718 <pre>After a few problems with power supply , we ended up with few split brains situations using a gluster 3.3.0. We've got 8 bricks having the data in a replicated distributed topology. We've got several files with split brain and while trying to fix one of them, it does not heal automatically. We've both deleted the file and the .gfs attr file. The problem is that the self-heal daemon recreates the file but does not copy the data. the flags are the following: on first brick: getfattr -m . -e hex -d fd04a34a7aa503052503b65ab6eaea5f # file: fd04a34a7aa503052503b65ab6eaea5f trusted.afr.storage-client-0=0x000000000000000000000000 trusted.afr.storage-client-1=0x000000000000000000000000 trusted.gfid=0xf0d12a323e6f434a9886371a3e425f84 trusted.storage-stripe-0.stripe-count=0x3200 trusted.storage-stripe-0.stripe-index=0x3000 trusted.storage-stripe-0.stripe-size=0x31333130373200 on second brick: getfattr -m . -e hex -d fd04a34a7aa503052503b65ab6eaea5f # file: fd04a34a7aa503052503b65ab6eaea5f trusted.afr.storage-clien</pre> samuel 2013-05-12T12:18:07 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11710 <pre> I've got a 24 node compute cluster. Each node has one extra terabyte drive. It seemed reasonable to install Gluster on each of the compute nodes and the head node. I created a volume from the head node: gluster volume create gv1 rep 2 transport tcp compute000:/export/brick1 compute001:/export/brick1 compute002:/export/brick1 compute003:/export/brick1 compute004:/export/brick1 compute005:/export/brick1 compute006:/export/brick1 compute007:/export/brick1 compute008:/export/brick1 compute009:/export/brick1 compute010:/export/brick1 compute011:/export/brick1 compute012:/export/brick1 compute013:/export/brick1 compute014:/export/brick1 compute015:/export/brick1 compute016:/export/brick1 compute017:/export/brick1 compute018:/export/brick1 compute019:/export/brick1 compute020:/export/brick1 compute021:/export/brick1 compute022:/export/brick1 compute023:/export/brick1 And then I mounted the volume on the head node. So far, so good. Apx. 10 TB available. Now I would like each compute node to be able to acces</pre> Bradley, Randy 2013-05-10T22:38:14 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11708 <pre>Good Day Everyone, I am new to linux in general as well as a new member to this mailing list as of 5 minutes ago . I setup my first glusterfs volume version 3.4 and am managing it using ovirt 3.2. I setup a client machine and test user and mounted the gluster volume with no problems at all using NFS. When I login to the server I can read/write just fine to the volume using the test user account. Volume Name: gv0 Type: Replicated Volume ID: ################### Status Started Number of Bricks 1 x 2 = 2 Transport-type: tcp Bricks: Brick1: 192.168.1.210 Brick2: 192.168.1.213 Options Reconfigured: nfs.disable: off user.cifs: on auth.allow: * glnode01.devnet.local:/gv0 on /home/gluster/GlusterTest type nfs (rw,vers=3,addr=192.168.1.210) I have read most people use FTP to access their gluster volumes but I have yet to get this working. I have installed vsftpd but when I FTP to the server I cannot write files to the gluster at all after mounting to the users home directory. Currently I cannot r/w to anywhere on </pre> Antony Nolan 2013-05-09T18:22:12 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11706 <pre>Hi, I'm running 3.4-beta1. I tried to enable WORM for a volume but got this: gluster volume set test feature.worm enable volume set: failed: option : feature.worm does not exist As intructed here: http://www.gluster.org/community/documentation/index.php/Features/worm So.. how do I enable WORM? </pre> Nux! 2013-05-09T16:07:22 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11696 <pre>Test. _______________________________________________ Gluster-users mailing list Gluster-users-+FkPdpiNhgJAfugRpC6u6w&lt; at &gt;public.gmane.org http://supercolony.gluster.org/mailman/listinfo/gluster-users</pre> Michael Kearey 2013-05-08T06:32:23 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11694 <pre>Please ignore, this is just a test to see if MX record has been updated. :) + Justin -- Open Source and Standards &lt; at &gt; Red Hat twitter.com/realjustinclift </pre> Justin Clift 2013-05-07T22:22:02 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11692 <pre>I'm testing out using gluster for storing backup images. I don't have any data redundancy requirements beyond RAID, I just want the volume to still be writable when one (or more?) nodes are down. I tried it, but I'm getting a "transport endpoint is not connected" error when I try to write to a volume where not all the servers are reachable. Some writes fail, some writes succeed. I'm assuming this is because the path hash points to the missing server. Is there some way to get the client to try the write on another server? Currently I'm testing 3.4.0-0.3.alpha3 on CentOS 6.4 (i686! my vintage test servers don't do long mode unfortunately) If I missed some documentation that talks about this, please point me to it! Here are some specifics of what I tried: [root-Q0ErXNX1RuZrG3b9KrPW8Q&lt; at &gt;public.gmane.org ~]# gluster volume info Volume Name: testvol Type: Distribute Volume ID: 45db51e0-18ed-4180-882e-f208ffa01452 Status: Started Number of Bricks: 4 Transport-type: tcp Bricks: Brick1: 192.168.254.50:/mnt/brick1</pre> Andrew Denton 2013-05-07T17:04:04 http://comments.gmane.org/gmane.comp.file-systems.gluster.user/11690 <pre>Hello, I will have a lot (many hundreds of millions) of subdirectories inside a directory, named with md5 hashes. I thought of a subdividivision abcd/efgh/... or maybe a/b/c/... But it will create a bunch of subfolders. Will gluster handler those files without problems ? One last thing : hardlinks will be involved to point the files and often deleted. Does someone has any experience of the troubleshooting I will have to face ? Many Thanks, regards alain _______________________________________________ Gluster-users mailing list Gluster-users-+FkPdpiNhgJAfugRpC6u6w&lt; at &gt;public.gmane.org http://supercolony.gluster.org/mailman/listinfo/gluster-users</pre> alain meunier 2013-05-07T15:15:19 Search the mailing list at Gmane query http://search.gmane.org/?group=$group=gmane.comp.file-systems.gluster.user