Hi all, I have a task on setting up a cluster of 2 servers for providing ftp service. We use RH's Cluster suite. However the cluster setup is lack of shared network storage, so the /var/ftp/pub is mounted on each server. The cluster is set with Master and Slave configuration (when the master is down, slave serves. and when master is up again, slaves gives up the service back to master). We thought of using rsync to synchronize the two directory on each server. B -----> A with: rsync -avzgorp -e ssh root at serverB:/var/ftp/pub/ /var/ftp/pub/ A -----> B with: rsync -avzgorp --delete -e ssh /var/ftp/pub/ root at serverB:/var/ftp/pub/ (note: using --delete) We want those command to make sure that the most current and complete /var/ftp/pub is on A and we put those command on A only. So, are we on the right direction? Or is there any better way? Thank you very much, -- Fajar Priyanto | Reg'd Linux User #327841 | Linux tutorial http://linux2.arinet.org 3:44pm up 6:53, 2.6.16.13-4-default GNU/Linux Let's use OpenOffice. http://www.openoffice.org -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 189 bytes Desc: not available URL: <http://lists.centos.org/pipermail/centos/attachments/20070117/7d03d523/attachment.sig>
Indunil Jayasooriya
2007-Jan-17 09:38 UTC
Fwd: [CentOS] OOT: Advice on failover rsync setup
Pls read the below link. It may also help you. Pls note that when you ssh to a serverB, try it as a normal user without a password. What is the Master node? Server A or Server B? http://www.howtoforge.com/mirroring_with_rsync ---------- Forwarded message ---------- From: Fajar Priyanto <fajarpri at cbn.net.id> Date: Jan 17, 2007 2:14 PM Subject: [CentOS] OOT: Advice on failover rsync setup To: CentOS list <centos at centos.org> Hi all, I have a task on setting up a cluster of 2 servers for providing ftp service. We use RH's Cluster suite. However the cluster setup is lack of shared network storage, so the /var/ftp/pub is mounted on each server. The cluster is set with Master and Slave configuration (when the master is down, slave serves. and when master is up again, slaves gives up the service back to master). We thought of using rsync to synchronize the two directory on each server. B -----> A with: rsync -avzgorp -e ssh root at serverB:/var/ftp/pub/ /var/ftp/pub/ A -----> B with: rsync -avzgorp --delete -e ssh /var/ftp/pub/ root at serverB:/var/ftp/pub/ (note: using --delete) We want those command to make sure that the most current and complete /var/ftp/pub is on A and we put those command on A only. So, are we on the right direction? Or is there any better way? Thank you very much, -- Fajar Priyanto | Reg'd Linux User #327841 | Linux tutorial http://linux2.arinet.org 3:44pm up 6:53, 2.6.16.13-4-default GNU/Linux Let's use OpenOffice. http://www.openoffice.org _______________________________________________ CentOS mailing list CentOS at centos.org http://lists.centos.org/mailman/listinfo/centos -- Thank you Indunil Jayasooriya -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.centos.org/pipermail/centos/attachments/20070117/80ccf691/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 190 bytes Desc: not available URL: <http://lists.centos.org/pipermail/centos/attachments/20070117/80ccf691/attachment.sig>
Fajar Priyanto wrote:> I have a task on setting up a cluster of 2 servers for providing ftp service. > We use RH's Cluster suite. However the cluster setup is lack of shared network > storage, so the /var/ftp/pub is mounted on each server. The cluster is set > > So, are we on the right direction? Or is there any better way? > Thank you very much, >have you considered using drbd ? -- Karanbir Singh : http://www.karan.org/ : 2522219 at icq
Benjamin Smith wrote:> On Wednesday 17 January 2007 04:41, Karanbir Singh wrote: >> Fajar Priyanto wrote: >>> I have a task on setting up a cluster of 2 servers for providing >>> ftp service. We use RH's Cluster suite. However the cluster setup >>> is lack of shared network storage, so the /var/ftp/pub is mounted >>> on each server. The cluster is set >>> >>> So, are we on the right direction? Or is there any better way? >>> Thank you very much, >>> >> >> have you considered using drbd ? > > Well, I was going to suggest using RAID1 with one of the partitions > being a network block device, but this looks even better! > > Rsync is great for period backups (not more than once per day or so)I run rsync every hour on multi-terrabyte systems with no problems. The NASes do have a private GB network to push the data through, so the user network doesn't see the network traffic generated by rsync. I can have anywhere from just a couple hundred megs, to 100 gigs of data change inside of an hour. <snipped>> > It's great, though, for Distaster Recovery off-site backups. See > http://www.effortlessis.com/backupbuddy > for an example I cooked up some time back.I'll have to read this. I wrote my configuration up on how to use rsync for hourly, daily and weekly backups here: http://marks-tech-pages.blogspot.com Rsync really shines, I've totally abandoned backing up to tape. It's nice to have restores run at network speeds. Thanks! Mark Schoonover IS Manager American Geotechnical - California, Nevada and Arizona V-> 858.450.4040 F-> 714.685.3909 C-> 858.472.3816
John Summerfield wrote:> Mark Schoonover wrote: >> Benjamin Smith wrote: >>> On Wednesday 17 January 2007 04:41, Karanbir Singh wrote: >>>> Fajar Priyanto wrote: >>>>> I have a task on setting up a cluster of 2 servers for providing >>>>> ftp service. We use RH's Cluster suite. However the cluster setup >>>>> is lack of shared network storage, so the /var/ftp/pub is mounted >>>>> on each server. The cluster is set >>>>> >>>>> So, are we on the right direction? Or is there any better way? >>>>> Thank you very much, >>>>> >>>> have you considered using drbd ? >>> Well, I was going to suggest using RAID1 with one of the partitions >>> being a network block device, but this looks even better! >>> >>> Rsync is great for period backups (not more than once per day or so) >> >> I run rsync every hour on multi-terrabyte systems with no problems. >> The NASes do have a private GB network to push the data through, so >> the user network doesn't see the network traffic generated by rsync. >> I can have anywhere from just a couple hundred megs, to 100 gigs of >> data change inside of an hour. > > OTOH I found running rsync daily over the Internet to backup a Linux > box impractical; it used heaps of RAM (and swap) and ran for hours. > Fortunately, its excessive use of swap (several times real RAM) didn't > lead to thrashing. >This seems rather odd performance for rsync. As I type this, I'm sending 800GB to a new server, and rsync is using 28MB of RAM. I don't think network speed is an issue with how much RAM/SWAP is getting used by rsync. Could you post your rsync command, I'm curious to what your running. What version of rsync are you using??> Now, I run a hand-crafted script that makes a compressed ISO > (mkzftree) and I rsync that. I'm maintaining a backup filesystem of > about 8 Mbytes remotely now; the rsync runs for a little over two > hours daily.That's what I love about *NIX, more than one way to skin a cat! Thanks! Mark Schoonover IS Manager American Geotechnical - California, Nevada and Arizona V-> 858.450.4040 F-> 714.685.3909 C-> 858.472.3816 * software development * systems administration * networking * security *