OS/2, eCS & ArcaOS - Technical > Storage

RSYNC - what to put in EXCLUDE list?

(1/3) > >>

Dariusz Piatkowski:
Alright...so with the New Year comes a resolution of mine: "get rsync up and running"!

I used to run dSync back in the day to run a local (disk to disk) nightly backup of my partitions (mostly Maintenance and OS2). I then moved off of HPFS386 to JFS, made some changes to hardare (went to SSD) and just never got around to re-configuring the backup routines. Now, dSync had some issues, so I decided to move to RSYNC.

Alright, so with a few spare days on my hands I was able to make a bit of progress. Spent the day yesterday actually re-learning all the RSYNC stuff and managed to do a whole bunch of testing with the --dry-run option (so no actual changes are written out). Again, this is still a LOCAL rsync, so if I understood the functionality correctly it does it all as if the '--whole-file' parameter was specified, which is all fine here (since on a local storage it really would not make sense to do just the incremental, unless of course it's some massively huge data file - maybe dbms???). Anyways, once I have this rsync configured correctly I will execute nightly through the CRON/2 deamon process I have installed on my machine.

Now here comes the core of my post: for a complete backup of a full OS2 partition (one that has boot and apps on it) I am seeing three exceptions on my machine, they are:

1) SWAPPER.DAT

--- Code: ---2020/01/01 00:48:07 [587] [sender] os2getxattr: DosOpenL(./SWAPPER.DAT) failed with error 32 at lib/sysxattrs.c(426)
2020/01/01 00:48:07 [587] rsync: get_xattr_names: llistxattr("g:/./SWAPPER.DAT",1024) failed: Permission denied (13)

--- End code ---

2) Mozilla => parent.lock

--- Code: ---2020/01/01 00:48:36 [587] [sender] os2getxattr: DosOpenL(HOME/mozilla.org/userprofiles/Mozilla/Firefox/Profiles/p5gjgk21.Testing/parent.lock) failed with error 32 at lib/sysxattrs.c(426)
2020/01/01 00:48:36 [587] rsync: get_xattr_names: llistxattr("g:/HOME/mozilla.org/userprofiles/Mozilla/Firefox/Profiles/p5gjgk21.Testing/parent.lock",1024) failed: Permission denied (13)

--- End code ---

3) PMMail => mua.mtx

--- Code: ---2020/01/01 00:49:38 [587] [sender] os2getxattr: DosOpenL(apps/tcpip/PMMail3/Accounts/mua.mtx) failed with error 32 at lib/sysxattrs.c(426)
2020/01/01 00:49:38 [587] rsync: get_xattr_names: llistxattr("g:/apps/tcpip/PMMail3/Accounts/mua.mtx",1024) failed: Permission denied (13)

--- End code ---

Therefore, the question I have is: can I skip all of the above files?, or if I should NOT skip them are there RSYNC options to allow me to deal with such a situation (force the archive past the 'Permission denied' error)?

I think SWAPPER.DAT is an easy one, yes, I can skip it. If I ever have to recover from a backup image that will get re-created during boot.

The 'Mozilla => parent.lock' is most likely due to FF being up and running, which is going to be the situation, so I can not avoid this. Likewise, the 'PMMail => mua.mtx' is a semaphore I think, it is always present as long as PMMail is up and running, so that one I can not avoid as well.

As always, appreciate any and all feedback you can provide! Thanks...

ivan:
Hi Dariusz,

Not saving the first 2 is not a problem, in fact I have SWAPPER.DAT out on a ram disk and I regularly delete parent.lock to stop ff popping up the 'do you want to renew' message.

mua.mtx must be something from the newer versions of PMMail, I don't see it on my old 2.20.2382 version so I can't help there.   

Doug Bissett:
This is my Exclude list:

--- Code: ---- $live$
- Cache/
- Cache.Trash/
- umix.log
- DSS_RMT.PID
- /PROCDUMP/
- /CDTemp/
- Recycled
- /TEMP/
- /SPOOL/
- /SWAPPER/
- System Volume Information
- rsync*.log
- clamd.log
- logfile.log*
- stunnel.log
- WP?ROOT.?SF
- WP?SHARE.?SF
- var/log/cups/
- /SYSDumps/
- *thumbnails/
- /WATCOM/binp/nmpbind.exe
- /bluegriffon/
- /Kompozer/
- /Seamonkey/
- /thunderbird/
- /TRASH/
- $RECYCLE.BIN
- TestAccts/
- /Download/RSyncCrash/updvbox.cmd
- chklgjfs*.log
- PSTAT.$$$
- webmonx.log
- /HOME/OpenOffice/4/user/extensions/shared/log.txt
- /HOME/OpenOffice/4/user/extensions/tmp/
- /MOZPROFILES/MOZILLA/Firefox/Profiles/wzf5p2q3.default-1485581936463/
- parent.lock
- socktidy.log
- CHKDSK.*
- volumes.cfg
- helpdesk/host/etc/passwd
- static.key

--- End code ---

Most of it is just for my convenience, but none of it is actually required in a backup. You need to determine that, for yourself.

This is a typical command file to backup one local disk to another (USB) local disk:

--- Code: ---ECHO --->RSYNC.LOG
ECHO Backup started>>RSYNC.LOG

ECHO ---/D:\>>RSYNC2.LOG
rsync.exe -a --stats --delete --log-file=RSYNC2.LOG --filter=._filters.list d:/ I:/main/DDrive/
ECHO ---/D: Done>>RSYNC2.LOG

ECHO ---/W:\>>RSYNC2.LOG
rsync.exe -aX --stats --delete --log-file=RSYNC2.LOG --filter=._filters.list w:/ I:/main/WDRIVE/
ECHO ---/W: Done>>RSYNC2.LOG

--- End code ---
You do need to change this, to match your system. I: is the USB HDD (JFS). D: is a FAT32 drive, and W: is a JFS drive (my main programs and data drive). This basically just smart copies D:\* to I:\main\DDrive, and W:\* to I:\main\WDrive, leaving out what is listed in filters.list. You can make separate exclude, and include, lists, depending on what you are trying to do.

I normally shut down things like Firefox, PMMail, and OpenOffice, over night, and this runs at about 4 AM (I use the scheduler in DragText). Swapper.DAT and parent.lock are pretty obvious things to omit. Look through my list, above, for other ideas. I built the list by studying the logs, to see what it has trouble with, then I decide what to do about it. Most of the time, I just add them to the list. It is always a good idea to see if the affected program has a problem, by renaming the file, before you commit to leaving it out. Some of it is just stuff that isn't really needed, to cut down on the time, and storage room, that is required.


--- Quote ---I have SWAPPER.DAT out on a ram disk
--- End quote ---

Just an observation about this. I have more than 2 GB in most of my systems. It has been YEARS, since I saw the swap file actually used. I usually just leave it as it was installed. Even my 1 GB machine, running ArcaOS, and used as a NAS device (with some extras), never uses the swap file. If your RAMDISK is in memory above about 3.5 GB, it doesn't matter. If it is below the 3.5 GB mark, you would be better off to have the swap file on a real disk, and use the memory as program memory.


--- Quote ---mua.mtx must be something from the newer versions of PMMail, I don't see it on my old 2.20.2382 version so I can't help there. 
--- End quote ---

mua.mtx is new, and it can be omitted.

ivan:
Hi Doug,

All my machines have 8GB of memory installed including those running OS/2 - ArcaOS so ram disk space is not a problem

Tom:

--- Quote from: ivan on January 01, 2020, 07:29:07 pm ---(...)  I regularly delete parent.lock to stop ff popping up the 'do you want to renew' message.

--- End quote ---

Deleting parent.lock is only a temporary solution, as you have discxovered: it needs to be repeated from time to time.

A permanent solution is to create a new boolean key with the name

browser.disableResetPrompt

through about:config and give it the value True .

Navigation

[0] Message Index

[#] Next page

Go to full version