rsync - May 2014 - [Bug 10580] New: Total file size reported wrong with --stats --info=progress2

https://bugzilla.samba.org/show_bug.cgi?id=10580

           Summary: Total file size reported wrong with --stats
                    --info=progress2
           Product: rsync
           Version: 3.1.0
          Platform: x64
        OS/Version: Linux
            Status: NEW
          Severity: major
          Priority: P5
         Component: core
        AssignedTo: wayned at samba.org
        ReportedBy: vania.toperich at gmail.com
         QAContact: rsync-qa at samba.org


Hi,

For some reason, rsync reports wrong total file size of transfer.... It reports
3.13G and stops on 50% when all the files are transferred correctly....:

sending incremental file list
              0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=10/14)
home/media/Movies/???? ????????/????? 1975/????? 1975_1.avi
        733.67M  23%   71.74MB/s    0:00:09 (xfr#1, to-chk=0/14) 
home/media/Movies/???? ????????/????? 1975/????? 1975_1.srt
        733.68M  23%   71.73MB/s    0:00:09 (xfr#2, to-chk=5/14)
home/media/Movies/???? ????????/????? 1975/????? 1975_2.avi
          1.57G  49%   71.64MB/s    0:00:20 (xfr#3, to-chk=3/14)
home/media/Movies/???? ????????/????? 1975/????? 1975_2.srt
          1.57G  50%   28.28MB/s    0:00:52 (xfr#4, to-chk=0/14)

Number of files: 14 (reg: 8, dir: 6)
Number of created files: 0
Number of regular files transferred: 4
Total file size: 3.13G bytes
Total transferred file size: 1.57G bytes
Literal data: 0 bytes
Matched data: 1.57G bytes
File list size: 0
File list generation time: 0.006 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 224.51K
Total bytes received: 392.49K

sent 224.51K bytes  received 392.49K bytes  10.37K bytes/sec
total size is 3.13G  speedup is 5,076.28

Here is info on both sides:

Remote:
root at reng:/home/media/Movies/???? ????????/????? 1975# du -h
1.5G    .

Local:
du -h /home/media/Movies/????\ ????????/?????\ 1975/
1.5G    /home/media/Movies/???? ????????/????? 1975/

Please let me know if you need any additional information. 

Looking forward to hear from you.

Kind regards,

Vania

-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug.

https://bugzilla.samba.org/show_bug.cgi?id=10580

--- Comment #1 from Vania Toperich <vania.toperich at gmail.com>
2014-05-01 13:10:53 UTC ---
ls -la /home/media/Movies/????\ ????????/?????\ 1975/
total 1529336
drwxr-xr-x  2 media media      4096 Aug 20  2011 .
drwxr-xr-x 14 media media      4096 Mar 13 12:07 ..
-r-xr--r--  1 media media 733667328 Jul 11  2011 ????? 1975_1.avi
-r-xr--r--  1 media media     15467 Jul 11  2011 ????? 1975_1.srt
-r-xr--r--  1 media media 832309248 Jul 11  2011 ????? 1975_2.avi
-r-xr--r--  1 media media     27318 Jul 11  2011 ????? 1975_2.srt

-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug.

https://bugzilla.samba.org/show_bug.cgi?id=10580

Vania Toperich <vania.toperich at gmail.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Version|3.1.0                       |3.1.1

--- Comment #2 from Vania Toperich <vania.toperich at gmail.com>
2014-05-01 13:28:47 UTC ---
rsync  version 3.1.1pre1  protocol version 31
Copyright (C) 1996-2014 by Andrew Tridgell, Wayne Davison, and others.
Web site: http://rsync.samba.org/
Capabilities:
    64-bit files, 64-bit inums, 64-bit timestamps, 64-bit long ints,
    socketpairs, hardlinks, symlinks, IPv6, batchfiles, inplace,
    append, no ACLs, xattrs, iconv, symtimes, prealloc

rsync comes with ABSOLUTELY NO WARRANTY.  This is free software, and you
are welcome to redistribute it under certain conditions.  See the GNU
General Public Licence for details.

-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug.

https://bugzilla.samba.org/show_bug.cgi?id=10580

--- Comment #3 from Vania Toperich <vania.toperich at gmail.com>
2014-05-01 15:03:25 UTC ---
I am using --include-files and list is created automatically. Here is an
example:

/home/media/Movies/???? ????????/????????? ????? 1969
/home/media/Movies/???? ????????/????????? ????? 1969/????????? ????? 1969.avi
/home/media/Movies/???? ????????/????????? ????? 1969/????????? ????? 1969.srt

It seems that rsync will calculate size for root folder as well and then add
also files in it....

-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug.

https://bugzilla.samba.org/show_bug.cgi?id=10580

Wayne Davison <wayned at samba.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |ASSIGNED

--- Comment #4 from Wayne Davison <wayned at samba.org> 2014-05-26
18:19:52 UTC ---
The --info=progress2 option only works with incremental recursion at present.
Performing a --files-from=FILE copy does an implied --no-inc-recursive scan,
which doesn't work at all with --info-progress2 at present.  We'll need
to look
into how best to fix that.  Thanks for the report.

-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug.