David Simpson
2022-Jul-22 09:45 UTC
[Gluster-users] replica2 issue - can't view, heal or delete directory
Hi all, I've got a directory on a replica2 system. (I know replica2 is not favoured, our other systems are replica3 using thin arbiter). We are migrating data off this particular system. glusterfs is 3.8.4 is on this. The problem is I have a directory which is invisible from the client (same version). But is clearly on the backend bricks. The volume in question is on two servers, with 4x bricks on each. I've backed up the content from each brick, for this directory onto another server (not gluster). But I would still like to fix the directory so the client mount can see it properly. Therefore the user can see the data properly on the client mount. Nothing in heal info list or split brain list. There are some files in .glusterfs/indices/{dirty,xattrop} . 1x file in each folder in each brick and stat showing Links: 1 on all. Any pointers welcome. getfattr output from bricks on folder in question below. thanks David SERVER1 # file: REDACTED_FOLDER_PATH_SERVER1 trusted.afr.REDACTED-client-1=0x000000000000000000000000 trusted.afr.dirty=0x000000000000000000000000 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x0000000000000000bffffffdffffffff # file: REDACTED_FOLDER_PATH_SERVER1 trusted.afr.REDACTED-client-3=0x000000000000000000000000 trusted.afr.dirty=0x000000000000000000000000 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x0000000000000000000000003ffffffe # file: REDACTED_FOLDER_PATH_SERVER1 trusted.afr.REDACTED-client-5=0x000000000000000000000000 trusted.afr.dirty=0x000000000000000000000000 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x00000000000000003fffffff7ffffffd # file: REDACTED_FOLDER_PATH_SERVER1 trusted.afr.REDACTED-client-7=0x000000000000000000000000 trusted.afr.dirty=0x000000000000000000000000 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x00000000000000007ffffffebffffffc trusted.glusterfs.dht.mds=0x00000000 ----------------------------- SERVER2 # file: REDACTED_FOLDER_PATH_SERVER2 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x0000000000000000bffffffdffffffff # file: REDACTED_FOLDER_PATH_SERVER2 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x0000000000000000000000003ffffffe # file: REDACTED_FOLDER_PATH_SERVER2 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x00000000000000003fffffff7ffffffd # file: REDACTED_FOLDER_PATH_SERVER2 trusted.afr.REDACTED-client-6=0x000000000000000000000000 trusted.afr.dirty=0x000000000000000000000000 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x00000000000000007ffffffebffffffc trusted.glusterfs.dht.mds=0x00000000 -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20220722/c98a5c6c/attachment.html>
Strahil Nikolov
2022-Jul-30 06:40 UTC
[Gluster-users] replica2 issue - can't view, heal or delete directory
Hi David, can you check the parent dir with getafftr ?Can you provide the 'gluster volume info' ?I assume that you already tested the situation from another client. Best Regards,Strahil Nikolov? On Wed, Jul 27, 2022 at 15:00, David Simpson<SimpsonD4 at cardiff.ac.uk> wrote: <!--#yiv2780180995 _filtered {} _filtered {}#yiv2780180995 #yiv2780180995 p.yiv2780180995MsoNormal, #yiv2780180995 li.yiv2780180995MsoNormal, #yiv2780180995 div.yiv2780180995MsoNormal {margin:0cm;font-size:11.0pt;font-family:"Calibri", sans-serif;}#yiv2780180995 span.yiv2780180995EmailStyle17 {font-family:"Calibri", sans-serif;color:windowtext;}#yiv2780180995 .yiv2780180995MsoChpDefault {font-family:"Calibri", sans-serif;} _filtered {}#yiv2780180995 div.yiv2780180995WordSection1 {}--> Hi all, I?ve got a directory on a replica2 system. (I know replica2 is not favoured, our other systems are replica3 using thin arbiter). We are migrating data off this particular system. ? glusterfs is 3.8.4 is on this. The problem is I have a directory which is invisible from the client (same version). But is clearly on the backend bricks. ? The volume in question is on two servers, with 4x bricks on each. ? I?ve backed up the content from each brick, for this directory onto another server (not gluster). But I would still like to fix the directory so the client mount can see it properly. Therefore the user can see the data properly on the client mount. ? Nothing in heal info list or split brain list. ? There are some files in .glusterfs/indices/{dirty,xattrop} . 1x file in each folder in each brick and stat showingLinks: 1 on all. Any pointers welcome. ? getfattr output from bricks on folder in question below. ? thanks David SERVER1 ? # file: REDACTED_FOLDER_PATH_SERVER1 trusted.afr.REDACTED-client-1=0x000000000000000000000000 trusted.afr.dirty=0x000000000000000000000000 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x0000000000000000bffffffdffffffff ? # file: REDACTED_FOLDER_PATH_SERVER1 trusted.afr.REDACTED-client-3=0x000000000000000000000000 trusted.afr.dirty=0x000000000000000000000000 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x0000000000000000000000003ffffffe ? # file: REDACTED_FOLDER_PATH_SERVER1 trusted.afr.REDACTED-client-5=0x000000000000000000000000 trusted.afr.dirty=0x000000000000000000000000 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x00000000000000003fffffff7ffffffd ? # file: REDACTED_FOLDER_PATH_SERVER1 trusted.afr.REDACTED-client-7=0x000000000000000000000000 trusted.afr.dirty=0x000000000000000000000000 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x00000000000000007ffffffebffffffc trusted.glusterfs.dht.mds=0x00000000 ? ? ----------------------------- ? SERVER2 ? # file: REDACTED_FOLDER_PATH_SERVER2 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x0000000000000000bffffffdffffffff ? # file: REDACTED_FOLDER_PATH_SERVER2 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x0000000000000000000000003ffffffe ? # file: REDACTED_FOLDER_PATH_SERVER2 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x00000000000000003fffffff7ffffffd ? # file: REDACTED_FOLDER_PATH_SERVER2 trusted.afr.REDACTED-client-6=0x000000000000000000000000 trusted.afr.dirty=0x000000000000000000000000 trusted.gfid=0x703f59ac65804a94969d402d585c6c77 trusted.glusterfs.dht=0x00000000000000007ffffffebffffffc trusted.glusterfs.dht.mds=0x00000000 ________ Community Meeting Calendar: Schedule - Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC Bridge: https://meet.google.com/cpu-eiue-hvk Gluster-users mailing list Gluster-users at gluster.org https://lists.gluster.org/mailman/listinfo/gluster-users -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20220730/ce123135/attachment.html>