gmane.network.rsync.general

Re: rsync equivalent of 'cp -al' ?

Chris Dennis — 2013-06-18T17:33:35

Good point -- I hadn't thought of it like that.  Thanks for the tip.

cheers

Chris

Re: rsync equivalent of 'cp -al' ?

Kevin Korb — 2013-06-18T16:35:58

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

If you make a link to a link you make a link to all of its links.  The
effect is the same.

On 06/18/13 12:27, Chris Dennis wrote:

- -- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
Kevin KorbPhone:    (407) 252-6853
Systems AdministratorInternet:
FutureQuest, Inc.Kevin< at >FutureQuest.net  (work)
Orlando, Floridakmk< at >sanitarium.net (personal)
Web page:http://www.sanitarium.net/
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.20 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlHAjG4ACgkQVKC1jlbQAQcvVgCgks/5JRXax+OLMVH3chMOqge8
vMsAoJYat6BZWtDdDGeg2kTQvr0gT5Rx
=xaMU
-----END PGP SIGNATURE-----

Re: rsync equivalent of 'cp -al' ?

Chris Dennis — 2013-06-18T16:27:49

I realise that --link-dest implies hard links between directories, but I 
use -H as well to maintain any hard links within the source directory. 
Does that make sense?

cheers

Chris

Re: rsync equivalent of 'cp -al' ?

Kevin Korb — 2013-06-18T15:53:09

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

The -H there isn't needed and could only cause increased memory usage.


On 06/18/13 11:49, Chris Dennis wrote:

- -- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
Kevin KorbPhone:    (407) 252-6853
Systems AdministratorInternet:
FutureQuest, Inc.Kevin< at >FutureQuest.net  (work)
Orlando, Floridakmk< at >sanitarium.net (personal)
Web page:http://www.sanitarium.net/
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.20 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlHAgmUACgkQVKC1jlbQAQf8nwCePHOSo1b6BFhzQSb0KSUwxJec
ErkAoNZey1UBaIVcAFPe8gMkoMSpZhuF
=uXd/
-----END PGP SIGNATURE-----

Re: rsync equivalent of 'cp -al' ?

Chris Dennis — 2013-06-18T15:49:52

Thank you Kevin.

I'd forgotten that --link-dest needed a relative path.  This works for me:

     rsync -Haxv --stats --link-dest ../dir1 dir1/ dir2

The / on the end of the second dir1 is, of course, essential.

cheers

Chris

Re: rsync equivalent of 'cp -al' ?

Kevin Korb — 2013-06-18T14:02:48

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

rsync -vai --lin-dest=/path/to/source/ /path/to/source/ /path/to/target/
Note that if you try it with relative paths the link-dest will be
relative to the source not .

On 06/18/13 09:39, Chris Dennis wrote:

- -- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
Kevin KorbPhone:    (407) 252-6853
Systems AdministratorInternet:
FutureQuest, Inc.Kevin< at >FutureQuest.net  (work)
Orlando, Floridakmk< at >sanitarium.net (personal)
Web page:http://www.sanitarium.net/
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.20 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlHAaIgACgkQVKC1jlbQAQcKLQCfSaHopk/J2bhPCUFuwR3KSIMM
daQAnjpVXhgeRz0bvb2/ttKVNZHAmuq6
=5f7j
-----END PGP SIGNATURE-----

rsync equivalent of 'cp -al' ?

Chris Dennis — 2013-06-18T13:39:42

Hello rsync people

I thought I knew how to use rsync, but I can't work out how to use it to 
do the equivalent of

     cp -al dir1 dir2

where dir1 and dir2 are both local and on the same disk.

In other words I want to make dir2 a copy of dir1, with every file 
hard-linked to its counterpart in dir1.

Why not just use cp?  Because I want to be able to do it as a user who 
has sudo permission to run rsync but not cp.

cheers

Chris

Re: Support for CACHEDIR.TAG excludes?

Christoph Biedl — 2013-06-17T19:29:43

Francis.Montagnac< at >inria.fr wrote...


Close enough for my needs. Initially I had some trouble getting this
to work, especially when running against an rsyncd. Until I tried to
create a reproducer for a bug report, now everything works fine.
Reverse Schrödinbug, I guess.


You know what I want :-)

Thanks for your help,

    Christoph

Re: ignore time completely (don't report with -i)?

Wayne Davison — 2013-06-17T15:29:18


To check file contnets you need -c.  Without that you're comparing size and
mtime, and the capital T is just telling you that the required file
transfer (due to those not matching) is going to set the mtime to "now".
 You could also try --size-only, but I don't recommend it (since files
sometimes change content w/o changing size).

There are several ways to speed-up a checksum transfer if you find that it
is too slow.  The patch checksum-updating.diff handles that via text files
inside the file hierarchy. The db.diff patch handles it via external
databases (mysql or sqlite are currently supported).  I have been updating
db.diff for the 3.1.0 version just recently since I started to use it at
work recently.

..wayne..

ignore time completely (don't report with -i)?

Ian Smairk — 2013-06-17T12:23:19

$ rsync -rin --no-t --ignore-times src dst


I still get items like



<f..T...... file



Is it possible to completely turn off time synchronization? Because windows (cygwin) targets seem unable to handle them, and I'm basically using rsync -ri as a remote diff. I want to verify that ftp'd files are faithfully transferred (no CRLF bull, for example).



This obsession with times seems excessive. I care about the file contents, not the #< at >!%ing times.



Ian Smairk
smairk< at >aol.com

[Bug 8847] detect-renamed.diff update to ensure existence ofdirectory for partial-dir

2013-06-16T22:57:45

https://bugzilla.samba.org/show_bug.cgi?id=8847

Wayne Davison <wayned< at >samba.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
   Attachment #7435|0                           |1
           is patch|                            |
   Attachment #7435|application/octet-stream    |text/plain
          mime type|                            |

[Bug 9948] Patch to provide progress display in log file

2013-06-13T22:19:16

https://bugzilla.samba.org/show_bug.cgi?id=9948

Devin Nate <devin.nate< at >cloudwerx.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
   Attachment #8967|Log progress                |rsync-3.0.9-log-progress.pa
        description|                            |tch

[Bug 9948] Patch to provide progress display in log file

2013-06-13T22:18:11

https://bugzilla.samba.org/show_bug.cgi?id=9948

Devin Nate <devin.nate< at >cloudwerx.com> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
   Attachment #8967|0                           |1
           is patch|                            |
   Attachment #8967|application/octet-stream    |text/plain
          mime type|                            |

[Bug 9948] New: Patch to provide progress display in log file

2013-06-13T22:17:52

https://bugzilla.samba.org/show_bug.cgi?id=9948

           Summary: Patch to provide progress display in log file
           Product: rsync
           Version: 3.0.9
          Platform: All
        OS/Version: All
            Status: NEW
          Severity: enhancement
          Priority: P5
         Component: core
        AssignedTo: wayned< at >samba.org
        ReportedBy: devin.nate< at >cloudwerx.com
         QAContact: rsync-qa< at >samba.org


Created attachment 8967
  --> https://bugzilla.samba.org/attachment.cgi?id=8967
Log progress

Hi all,

Please find attached a patch we're using, which others may find useful
therefore submitted here. It will log progress to the rsync log file. It does
the following:

1. log progress once every 60 seconds with proper newlines, and
2. log progress at end of transfer, and
3. changes the logfile handling to log before transfer when logging (it already
did this for stdout)
4. happens to modify the output of the final end-of-file transfer log format.
5. disables --show-progress fr

Re: Password from the stdout

Henri Shustak — 2013-06-12T05:37:11

To get started, the following URL offers introductory information : 
http://www.lbackup.org/network_backup#creating_ssh_keys_for_testing

Hope this helps.


---------------------------------------------------------------------
This email is protected by LBackup, an open source backup solution.
http://www.lbackup.org

Re: [Bug 9915] New: File stopped synchronizing during transmission

Justin T Pryzby — 2013-06-10T19:51:05

Are you sure it's not a network issue?  Have you tried swapping
cables?  Are there any interface errors on either end?  ifconfig will
show that, and you might also check linux sysstat.

It sounds like tcp packet loss.  Are you able to strace both rsync
processes when this happens?

Justin

[Bug 9915] File stopped synchronizing during transmission

2013-06-10T00:10:03

https://bugzilla.samba.org/show_bug.cgi?id=9915

--- Comment #1 from Alvin <oswulf_chua< at >msn.com> 2013-06-10 00:10:02 UTC ---
For the time being, we are sending small 1byte message periodically to "give a
push" to the "appeared to be hung" files over. This seems to work temporarily
and we are hopping to have a fix for this issue. Let us know if this is a
configuration issue as well.

Re: Password from the stdout

Kevin Korb — 2013-06-08T23:27:24

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

If you mean an rsyncd password then use --password-file.
If you mean rsync over ssh then absolutely not.  Use an ssh key instead.

On 06/08/13 19:25, garvit sharma wrote:

- -- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
Kevin KorbPhone:    (407) 252-6853
Systems AdministratorInternet:
FutureQuest, Inc.Kevin< at >FutureQuest.net  (work)
Orlando, Floridakmk< at >sanitarium.net (personal)
Web page:http://www.sanitarium.net/
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.19 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlGzvdsACgkQVKC1jlbQAQf6MgCfYR4fFJrjUWILhb3ymGUA8PXY
9eoAnjGNJ2LNCZFgg35MfnYDhitZ8Bv7
=JoPd
-----END PGP SIGNATURE-----

Password from the stdout

garvit sharma — 2013-06-08T23:25:01

Hello All,

I want to use rsync in a process and for the i want it to take password
from file instead of stdout. Is there any way to do it in rsync ?

Thanks,

rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)

Robert DuToit — 2013-06-08T16:58:01

Dear All,

I have been getting reports and noticing these acl errors again recently. rsync 3.0.7 thru 3.0.9. Someone reported that files were being skipped but we don't know if it is the acl issue since it doesn't state the file name. In the archives I found Henry's post about this and saw that Matt was going to post a patch. I haven't been able to find the patch and wonder if one exists or anyone can point me to the code where I can perhaps add at least the file path to the error thrown. Also I would probably opt myself for keeping the file without the acls, knowing the possible risks.

Thanks, Rob

Re: delaying symlinks sync until the data it points to available

Wayne Davison — 2013-06-08T15:59:25



No, there is not.  A couple possible other solutions:

Consider using --delay-updates so that rsync moves all the completed
files/symlinks into place very rapidly (make sure to use a relative
--partial-dir, which is true by default).

Or consider using the atomic-rsync script from the support dir which would
allow you to do a normal --link-dest transfer into a new directory and (if
setup with symlinks) atomically move the whole new hierarchy into place at
once.

..wayne..