Questions tagged [rsync]

GENERAL RSYNC SUPPORT IS OFF-TOPIC. Support questions may be asked on https://superuser.com. rsync can copy files locally, over ssh or rsh remote shell services, or with a remote rsync daemon. Files can be incrementally updated and rsync provides for file-size and last-modified time update checks. rsync runs on POSIX systems including Linux, BSD, Unix, and Windows (via Cygwin).

Filter by
Sorted by
Tagged with
-1 votes
1 answer
29 views

rsync's --files-from is giving error instead of syncing file

I have a directory in $HOME/me/backup set up like this test/ file.txt sync.txt The only contents of sync.txt is this: file.txt I open my terminal, navigate to $HOME/me/backup and run rsync -av --...
Generic_User_ID's user avatar
0 votes
1 answer
41 views

Rsync - Include Only One Folder

I have several folders inside a folder named "parent". Namely "childone", "childtwo", "childthree", as well as several files. I wish to rsync only "child ...
eyeprotocol's user avatar
0 votes
0 answers
12 views

Files transferred by rsync from Windows to Ubuntu cannot be found by Node.js

I'm having a problem with synchronizing code from my development environment on Windows with the Linux server. I am using rsync with git bash. I'm running the following commands in a while loop: rsync ...
Smail's user avatar
  • 1
0 votes
0 answers
27 views

Makefile: sha256sum hangs forever with 0% CPU usage

my Makefile behaves absolutely chaotically: I have Makefile for backups. The backup directory has name format: 2023-09-11 and contains 3 disk image files, each with their sha256 checksum: # ls -1 2023-...
Martin Vegter's user avatar
0 votes
0 answers
12 views

Is it possible for rsync to read files simulteneosly on source and destination?

I'm curious how rsync works internally: as I understand, rsync first reads files at source, then calculates checksums for chunks of these files and then sends this data to a remote rsync daemon at ...
Mr D's user avatar
  • 23
2 votes
0 answers
67 views

RSync Command not working in Script but in Shell direct. What am I doing wrong?

This is the command I used. rsync -v -h --progress --stats --ignore-existing --remove-source-files --compress /mnt/ramdisk/Cam/* -r -e "sshpass -p 'yî\`ÃÝíä}' ssh -p12345 USER@IP" :/home/...
H-OS's user avatar
  • 21
0 votes
0 answers
23 views

Postgresql archive_command suddenly stopped to work

Yesterday it just stopped to send WALs to remote destination, I was using rsync on Windows. There are no error in logs. archive_mode is of course on What is really strange that Postgres seems to stop ...
sh4rkyy's user avatar
  • 343
0 votes
2 answers
74 views

Ansible synchronize files among remote hosts

I have three VMs for example. VM.A is the Ansible controller, VM.B is remote server 1 and VM.C is remote server 2. I want to be able to transfer files from VM.B to VM.C using the synchronize module in ...
Alistair's user avatar
0 votes
0 answers
38 views

Using crontab to rsync files to Synology NAS, getting permissions error

I am trying to backup my Linux system to my Synology NAS by using rsync in crontab. I have used ssh-keygen -t rsa and then used ssh-copy-id [email protected] to move the key over to the NAS. I run ...
gagestinson's user avatar
-1 votes
1 answer
43 views

vscode rsync error: some files could not be trasferred (code 23) error

I'm running a deployment to EC2 using rsync. Until a week ago, the deployment was working fine. Since August 3 or 4, I'm getting the following error. It looks like an error for IOS deployment. I'm ...
geuni620's user avatar
0 votes
0 answers
9 views

speed up sync files from server to remote backup storage (currently using rsync)

Need to speed up the sync of a local folder with hundreds of thousands files (small and big) to a remote sshsfs storage. Currently using rsync but open to anything else. Usually less than 1% of them ...
Colegatron's user avatar
1 vote
1 answer
95 views

How to print the output of rsync when running from within a bash script

I currently have a bash script that helps me rsync a file. # Copy the file over echo "* Downloading: ${TARGET_FILE_NAME}" rsync -vh --progress --stats "$TARGET_FILE_PATH" "$...
Alberto Lerdo's user avatar
0 votes
1 answer
44 views

Ansible couldn't locate rsync even though rsync installed in the server

I tried executing a synchronize push task in ansible as seen below: - name: Transfer package from server to target server synchronize: src: "{{ item }}" dest: "{{ item }}&...
rishi_stark's user avatar
0 votes
2 answers
53 views

Getting error when using Rsync and Python

When I try to use rsync (Linux Mint) in Python I get the following error rsync: [sender] change_dir "home/user/my_source_folder" failed: No such file or directory (2) Here is the code I ...
jwill's user avatar
  • 84
0 votes
1 answer
39 views

How to use `--files-from` `rsync` option to download a list of files?

I'm using the following command to download a folder from remote using rsync: sshpass -p "my_pwd" rsync -av --partial --progress <usr>@<remote>:/home/remote/folder /home/...
roschach's user avatar
  • 8,400
2 votes
1 answer
84 views

Postgresql replica upgrade using rsync on Windows

I have no idea what I'm doing wrong but the result is way off, trying to follow the procedure from documentation I ran from cmd following commands: cd G:\Postgresql_test rsync --archive --delete --...
sh4rkyy's user avatar
  • 343
0 votes
0 answers
25 views

rsync + find -> local server to remote - copying full path

running out of option, maybe rsync is not what I'm looking for. I'm trying to synch two folder (local to remote) with somes options (time, ... ) Here the example : Server A : /pathA/pathAA/...
Paulo's user avatar
  • 66
0 votes
0 answers
25 views

rsync does not take into account --include-from setting

I spent a lot of time to find a solution for my problem or find what am i doing wrong. I would like to save my user home folder into another, mounted folder...so I thought, I am going to use rsync......
aBanhidy's user avatar
  • 257
0 votes
0 answers
42 views

Bash while loop containing a rsync command does not work [duplicate]

I have the following file containing spaces : $ cat /.shareLIST Archive 1 Archive 2 Archive 3 Archive 4 And I have the following bash while loop : while read share do echo $share rsync -Hauv -...
SebMa's user avatar
  • 4,089
0 votes
0 answers
53 views

Cwrsync Paths: change_dir failed: No such file or directory

I want to use rsync on Windows for a project. As a test, I'm trying to use cwrsync to sync the folder C:\Users\Name\Pictures\Test1 to C:\Username\Name\Pictures\Test2. I ran the command rsync -a C:\...
MelodiCat's user avatar
1 vote
0 answers
79 views

Build C++ Applications in a Amazon Linux 2 Docker Container with Visual Studio

I followed the next URL and successfully built a simple C++ app on Ubuntu Docker container with Visual studio 2022. Build C++ Applications in a Linux Docker Container with Visual Studio Next, I tried ...
onkjm's user avatar
  • 11
1 vote
1 answer
43 views

Linux parallel copy from one source to multi destinations with a progress output

I'm trying to parallel copy one large dataset (~7TB) to three external USB drives at the same time. Ideally I want to be able to kick it off, leave it to crack on and come back to check on it every so ...
Andy W's user avatar
  • 11
0 votes
0 answers
177 views

rsync transfer 'Broken pipe (32)' connection dropping

I am trying to create a small script to transfer a lot of images from a proxmox VM to a raspberry pi on the same LAN (around 70 GB of images/videos). This is not always working as intended, since I ...
786yt's user avatar
  • 1
0 votes
0 answers
31 views

How do I change iTerm2 to use rsync instead of the default scp for downloading?

Question: How do I change iTerm2's default downloading protocol, scp, to use rsync instead? I want to use the iTerm2's CMD+Click feature to download a file from a server that I am ssh'd into without ...
Alan's user avatar
  • 1
1 vote
1 answer
102 views

Upgrade Postgres standby replica using rsync

I have some doubts about the documentation which states the following: Upgrade streaming replication and log-shipping standby servers If you used link mode and have Streaming Replication (see ...
sh4rkyy's user avatar
  • 343
0 votes
1 answer
110 views

Ansible Syncronize Keeps failing with Permission denied

I have this simple Ansible setup: host_vars/testserver.yaml --- ansible_host: x.x.x.x ansible_connection: ssh ansible_port: 22 ansible_ssh_user: ansible ansible_become: true ansible_become_user: root ...
Amin Persia's user avatar
0 votes
0 answers
39 views

Using rsync but cannot get copy to be mirror

I've set up a cron job to try and periodically clone/mirror some data from one hard drive to another for emergency restoration purposes. I'm using rsync and finding that the sync is not happening the ...
dinki's user avatar
  • 103
0 votes
0 answers
16 views

How to remove the permission of non-exsist user of a folder of file on Windows

I use rsync of WSL1 to back up my data from disk C:\ to disk D:, the latter one is a USB disk. Recently, I upgrade my C:\ disk to a new one with larger space and install a new Windows in it. In the ...
Chokaii Moris's user avatar
0 votes
0 answers
28 views

gsutl rsync: skip copying large files

How can i skip copying files larger than say 100MB with gsutil rsync command? The plain rsync linux utility has --max-size=SIZE flag. Is there an equivalent with gsutil version? I can't find any in ...
A. K.'s user avatar
  • 34.7k
0 votes
0 answers
96 views

Bi-directional mirror between minIO and filesystem

For some time now, I try to find a solution for a bi-directional mirroring between a minIO bucket (of folder in a bucket) and a file system folder (mostly needed for linux). I am familiar with the ...
Asaf's user avatar
  • 15
2 votes
1 answer
37 views

Alternative Solutions for Syncing PostgreSQL Databases Across Machines

I possess two machines: My laptop, which operates on Ubuntu 22.04. OKD (Openshift container) that runs on CentOS 7. My objective is to synchronize a PostgreSQL database between these two machines. ...
Mehrdad Salimi's user avatar
0 votes
0 answers
45 views

Efficient data access from docker cluster to centralized NAS

How to download efficiently large amounts of data from TrueNAS server into docker container. Our current setup is as following: a TrueNAS Scale server is hosting the large dataset with lots of videos ...
turborierer's user avatar
0 votes
0 answers
34 views

Rsync (3.2.7): log file does not contain [receiver] entries?

I am using rsync 3.2.7 and set it to log to a file via --log-file '/path/to/log.file'. I use the log file to sniff for occurrences of "No space left on device" error messages. They are ...
mrcalvin's user avatar
  • 3,361
0 votes
0 answers
70 views

How can rsync compression help if the device is an ordinary disk?

The rsync man page explains the z in rsync -avz foo:src/bar /data/tmp by saying Additionally, compression will be used to reduce the size of data portions of the transfer. How can rsync compression ...
Sam7919's user avatar
  • 562
1 vote
1 answer
604 views

rsync command is not working when executing from remote ssh

rsync command is not working when executing it from a remote host. Jenkins node tries to execute few commands on a remote server, but when running the rsync command I am getting below error sh: rsync: ...
DevOps_Guy_1903's user avatar
1 vote
1 answer
102 views

rsync with X11-Forwarding does not set DISPLAY? [closed]

Some context: I have some services running on my Debian server, and from time to time I want to make a backup of the relevant data I have a backup directory on the server, which I update manually by ...
Eternal's user avatar
  • 2,658
0 votes
0 answers
16 views

Why does the ordering of optional args appear to make this rsync statement fail?

This rsync command is failing for reasons that appear to be inexplicable, because each constituent part works when you break it down. And when you put it back together, the whole thing works after all....
markling's user avatar
  • 1,242
0 votes
0 answers
46 views

How to increase SSH lifetime to 1 year?

I have an Ubuntu server with rsync installed. And there is Windows 10 for additional file backup with Ubuntu. For this I use VBScript: Set WS = CreateObject("WScript.Shell") WS....
PTZ_M's user avatar
  • 1
0 votes
0 answers
38 views

rsync with the --delete option didn't delete the extra folders in destination

I want to backup data to the destination server, and I try the commmand like this: rsync -Aaq --exclude=folder1/ --exclude=folder2/ --delete /SourceFolder/ /DesinationFolder/ I hope to backup data to ...
Hadow's user avatar
  • 1
0 votes
1 answer
131 views

Rsync & SELinux - Required SELinux Settings Required

TL/DR: SELinux stopping Rsync from writing to local Repository Mirror from Public Repositories - Please Help First off: Sorry if this is posted to the wrong thread. I've been researching this issue ...
Dulux-Oz's user avatar
-1 votes
2 answers
65 views

A shell script question involving rsync and symlink using cp

The script under consideration has been coded as shown below: #!/bin/bash #recursive remove REC_RM="rm -rf" #recursive copy REC_CP="cp -Rf" #rsync RSYNC_CMD="rsync -av --...
Vinod's user avatar
  • 1,041
-1 votes
1 answer
99 views

How to rsync a linux server to a local directory excluding all os files [closed]

I wanted to backup an aws machine and exclude os files, only user files including root owned ones which need sudo permission to read.
Jahan Zinedine's user avatar
2 votes
1 answer
68 views

rsync with options as variable

I read old topic And try do the same rsync with options as variable But I get Warning: Identity file $myVar/ssh_key/my_ssh_key not accessible: No such file or directory. My code options=(-rvz -e 'ssh ...
Андрей Тернити's user avatar
-2 votes
1 answer
48 views

Upload to random server from original server SSH

I currently have 5 servers, 1 upload server (ftp.example.com) and 4 storage servers (fs#.example.com). I'm currently looking for a way to send files from my upload server to one of the storage servers ...
Paulamonopoly's user avatar
-1 votes
1 answer
267 views

rsync : Copying all files into a destination directory with a different name

Given: A source directory /mnt1/src, a destination directory /mnt2/dest. Problem: For a daily backup, I want to rsync all files in the tree under /mnt1/src into /mnt2/dest, so that for example /mnt1/...
user1934428's user avatar
0 votes
0 answers
76 views

rsync : how to replace only newer files on the target

How can I use rsync to restore a backup system to the current system. Files, which are newer on the target should be replaced by the older ones, and files on the target which don't exist in the source ...
HJarausch's user avatar
0 votes
2 answers
271 views

How to write an incremental backup script using rsync

I am trying to implement custom function for backup using rsync. For this, I modified the following exist code https://linuxconfig.org/how-to-create-incremental-backups-using-rsync-on-linux as follows:...
ecjb's user avatar
  • 5,183
0 votes
1 answer
139 views

Log back into terminal to see how rsync is doing [duplicate]

I have a bash script which copies one drive to another which is working fine. I am using the -v option so it outputs on the terminal as it performs the operation. Is it possible to log out of the ...
Ian Barber's user avatar
0 votes
1 answer
55 views

Bash: How to handle brackets in filepath when passing as variable in pipe?

recently inherited some scripts and looking to find out what is going wrong with the following script, which aims to copy a specific TSV from multiple similar directories, over to a target directory ...
Jared's user avatar
  • 95
-1 votes
1 answer
156 views

sh: 1: rsync: not found

I made a python application and its running fine. So now i made a service still all fine. last part of my program was to sync some files to a different server, rsync command works when i run it as my ...
user2433624's user avatar

1
2 3 4 5
50