rsync - May 2006 - DO NOT REPLY [Bug 3784] New: Showing Progress without being Verbose

https://bugzilla.samba.org/show_bug.cgi?id=3784

           Summary: Showing Progress without being Verbose
           Product: rsync
           Version: 3.0.0
          Platform: x86
        OS/Version: Linux
            Status: NEW
          Severity: enhancement
          Priority: P3
         Component: core
        AssignedTo: wayned@samba.org
        ReportedBy: Tam@SiuLung.com
         QAContact: rsync-qa@samba.org


I'd like to rsync 100+ million files. I want to show the overall progress
(e.g.
20% done) instead of generating one line per file like --progress.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=3784


pkchan+bug=samba@tnc.hk changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |pkchan+bug=samba@tnc.hk




------- Comment #1 from pkchan+bug=samba@tnc.hk  2006-12-21 09:46 MST -------
How's the progress here?  I'd say this is an important enhancement as I
routinely transfer tens of thousands (small) files from one system to another
and --progress would be an overkill for the purpose of monitoring progress --
all I want is just a neat and tidy summary.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=3784


unit3@demoni.ca changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |unit3@demoni.ca




------- Comment #2 from unit3@demoni.ca  2008-07-04 12:17 CST -------
I second this, it's about the only feature I consistently wish for in rsync.
Also, can Wayne or Tam change this to Hardware: All please?


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=3784





------- Comment #3 from unit3@demoni.ca  2008-07-04 15:54 CST -------
Created an attachment (id=3390)
 --> (https://bugzilla.samba.org/attachment.cgi?id=3390&action=view)
patch to give total run progress indication

Here's a little patch that creates a new flag "--total-progress",
which causes
the progress indication to be based on data-copied/total-data, rather than on a
per-file basis. It may be used with or without -v(erbose).

Is this useful, or would people prefer to just use the existing --progress/-P
flag, and have the global totals only used in non-verbose mode?

Also, when used with -r(ecursive) mode, you can see some interesting oddities,
as it scans subdirectories as it goes. This means it's possible to have the
total number of files (and the % completed) *decrease* as it runs as it scans
more subdirectories. I'm not sure if there's any real way around this.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=3784





------- Comment #4 from unit3@demoni.ca  2008-07-04 15:55 CST -------
Oh, forgot to mention, but that patch should apply to v3.0.3.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=3784


wayned@samba.org changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |ASSIGNED




------- Comment #5 from wayned@samba.org  2008-07-13 23:29 CST -------
Thanks for the patch.  I'm incorporating this idea into the latest rsync
(3.1.0dev) using the new general-purpose --info=FLAGS option to turn this on: 
the --progress option will infer --info=progress (along with the other output
flags that it traditionally affects) and gives you the normal per-file
progress.  You can instead specify --info=progress2 to get overall transfer
progress, which will output on a single line (if rsync is not outputting any
names).  I'm still working on what I want the various fields to display, but
it
is working in the latest git repository version.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=3784





------- Comment #6 from unit3@demoni.ca  2008-07-14 00:18 CST -------
Great!! I wasn't sure what output format, options, and behavior would end up
being the most useful or user friendly, so I'll defer to your judgment on
that.
In any case, I know quite a few people who'll be very happy when this
feature
makes it into the major distributions they use, so thanks again. :)


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=3784


bashukhan at gmail.com changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |bashukhan at gmail.com




------- Comment #7 from bashukhan at gmail.com  2009-12-25 07:30 CST -------
There seems to an error with speed calculation with --info=progress in version
3.1dev. It's showing a continues speed of 26.90MB/s which is just impossible
to
attain under my internet downstream. 

# rsync3 -arth --info=progress2 --no-motd --exclude=debug/
rsync://mirrors.kernel.org/centos/5.4/updates/i386 /Raid/centos/5.4/updates

        135.08M   8%   26.90MB/s    0:00:54  Quit68, to-chk=275/346)


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.

https://bugzilla.samba.org/show_bug.cgi?id=3784

--- Comment #8 from Jo?o M. S. Silva <joao.m.santos.silva at gmail.com>
---
I'd also like this enhancement very much, especially because when I use -v
the
process stalls somehow during the transfer (simple home directory backup) and I
have to "killall rsync".

Why does --progress imply --verbose? I was expecting -v to be one thing and
--progress to be another, completely independent.

Thanks for this great program.

-- 
You are receiving this mail because:
You are the QA Contact for the bug.