Hi, I've configured 'backuppc' to transfer files via rsyncd, with enabled checksums. Whith one of the shares I get the error (in syslog): --------------------------------------------------------------------- robbe rsyncd[2183]: ERROR: out of memory in receive_sums [sender] robbe rsyncd[2183]: rsync error: error allocating core memory buffers (code 22) at util2.c(106) [sender=3.1.2dev] robbe rsyncd[9821]: connect from elefant.control.local (192.168.1.200) robbe rsyncd[9821]: rsync on . from backuppc at elefant.control.local (192.168.1.200) --------------------------------------------------------------------- I read that the memory overflow comes from bulding the checksums list. Is there a way to find out where in the file tree that overflow occurs for determine splitting points? The OS is Debian 7.4 amd, 24 GB RAM, 32 GB swap. Kind regards, Hans
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 You should not be using rsync's --checksum during routine backups. It is only for very rare use cases not every backup run. On 04/09/2015 04:43 AM, Hans Kraus wrote:> Hi, > > I've configured 'backuppc' to transfer files via rsyncd, with > enabled checksums. Whith one of the shares I get the error (in > syslog): > --------------------------------------------------------------------- > >robbe rsyncd[2183]: ERROR: out of memory in receive_sums [sender]> robbe rsyncd[2183]: rsync error: error allocating core memory > buffers (code 22) at util2.c(106) [sender=3.1.2dev] robbe > rsyncd[9821]: connect from elefant.control.local (192.168.1.200) > robbe rsyncd[9821]: rsync on . from backuppc at elefant.control.local > (192.168.1.200) > --------------------------------------------------------------------- > >I read that the memory overflow comes from bulding the checksums list.> > Is there a way to find out where in the file tree that overflow > occurs for determine splitting points? > > The OS is Debian 7.4 amd, 24 GB RAM, 32 GB swap. > > Kind regards, Hans- -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ Kevin Korb Phone: (407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. Kevin at FutureQuest.net (work) Orlando, Florida kmk at sanitarium.net (personal) Web page: http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iEYEARECAAYFAlUmqrAACgkQVKC1jlbQAQdYnQCfSDNBGlPPbi1T0ATUlNngj3tz fTsAn1OwEGeDdkOKf+lCaDTZEBJoS/jg =TJEs -----END PGP SIGNATURE-----
devzero at web.de
2015-Apr-09 17:25 UTC
Aw: Re: rsync error: error allocating core memory buffers
> You should not be using rsync's --checksum during routine backups.you know that excel can change a file`s contents without changing a file`s timestamp - do you? ;)> Gesendet: Donnerstag, 09. April 2015 um 18:37 Uhr > Von: "Kevin Korb" <kmk at sanitarium.net> > An: rsync at lists.samba.org > Betreff: Re: rsync error: error allocating core memory buffers > > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > You should not be using rsync's --checksum during routine backups. It > is only for very rare use cases not every backup run. > > On 04/09/2015 04:43 AM, Hans Kraus wrote: > > Hi, > > > > I've configured 'backuppc' to transfer files via rsyncd, with > > enabled checksums. Whith one of the shares I get the error (in > > syslog): > > --------------------------------------------------------------------- > > > > > robbe rsyncd[2183]: ERROR: out of memory in receive_sums [sender] > > robbe rsyncd[2183]: rsync error: error allocating core memory > > buffers (code 22) at util2.c(106) [sender=3.1.2dev] robbe > > rsyncd[9821]: connect from elefant.control.local (192.168.1.200) > > robbe rsyncd[9821]: rsync on . from backuppc at elefant.control.local > > (192.168.1.200) > > --------------------------------------------------------------------- > > > > > I read that the memory overflow comes from bulding the checksums list. > > > > Is there a way to find out where in the file tree that overflow > > occurs for determine splitting points? > > > > The OS is Debian 7.4 amd, 24 GB RAM, 32 GB swap. > > > > Kind regards, Hans > > - -- > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ > Kevin Korb Phone: (407) 252-6853 > Systems Administrator Internet: > FutureQuest, Inc. Kevin at FutureQuest.net (work) > Orlando, Florida kmk at sanitarium.net (personal) > Web page: http://www.sanitarium.net/ > PGP public key available on web site. > ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v2 > > iEYEARECAAYFAlUmqrAACgkQVKC1jlbQAQdYnQCfSDNBGlPPbi1T0ATUlNngj3tz > fTsAn1OwEGeDdkOKf+lCaDTZEBJoS/jg > =TJEs > -----END PGP SIGNATURE----- > -- > Please use reply-all for most replies to avoid omitting the mailing list. > To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html >
At 18:37 09.04.2015, Kevin Korb wrote:>>I read that the memory overflow comes from bulding the checksums list. >> >> Is there a way to find out where in the file tree that overflow >> occurs for determine splitting points?If you run rsync with -v(v..) or --progress don't you see where it is when it bails out? bye Fabi