Show Posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.


Messages - Shmuel (Seymour J.) Metz

Pages: [1] 2
1
Applications / Re: P7zip syntax for archiving an entire volume
« on: January 08, 2019, 11:26:57 pm »
Sent to your email address. Also contact info at [url]https://www.s-t.de/de/firma.html[/url

His link there is
Code: [Select]
javascript:mail(rudi)
Clicking on it gives me
Quote
You'll need a ne app to open this mailto

I did receive your e-mail and sent him a query, to which I have not yet received a response.

2
Applications / Re: P7zip syntax for archiving an entire volume
« on: January 07, 2019, 08:40:40 pm »

I haven't seen a contact listed for the OS/2 build. If you can point me to the right location, I'll be happy to report it, with supporting documentation.

Looking at http://hobbes.nmsu.edu/h-viewer.php?dir=/pub/os2/util/archiver&file=p7zip-16.02-os2-1.zip&backto=%2Fh-search.php%3Fbutton%3DSearch%26key%3Dp7zip%26dir%3D%252F seems to be Ruediger Ihle. Shouldn't be hard to find his email, though he hasn't been much involved with OS/2 for a while. Usually he does a good porting job.

I tried getting his contact data from eCSoft2, and they would also like Ruediger Ihle's address. If anybody knows it, please give me a heads up at smetz3@gmu.edu. Thanks.

3
Applications / Re: Creating archive > 4GiB from script
« on: December 30, 2018, 10:23:56 pm »
The version on my backup partition reports itself ("zip -v") as:
Code: [Select]
Copyright (c) 1990-2008 Info-ZIP - Type 'zip "-L"' for software license.
This is Zip 3.0 (July 5th 2008), by Info-ZIP.
Currently maintained by E. Gordon.  Please send bug reports to
the authors using the web page at www.info-zip.org; see README for details.

Latest sources and executables are at ftp://ftp.info-zip.org/pub/infozip,
as of above date; see http://www.info-zip.org/ for other sites.

Compiled with emx+gcc 4.4.6 for OS/2 2.x/3.x (32-bit) on Jul 17 2013.

This is a slightly older-than-the-latest build of the bww code.  IIRC, I built it myself from the bww sources, after adding a patch to implement OS/2 support for the archive attribute switches (-AS/-AC).  I believe bww incorporated my patch in their subsequent releases. As such, there should be no real difference between my build and theirs, beyond theirs being based on slightly newer upstream code; still, if you want to try it, it's http://altsan.org/os2/utils/zip_300_os2_archive.zip.

My usual production volume uses the currently-latest version from the Netlabs yum repo, although I don't think I've tried zipping any massive archives with that build.

The bad news is that the same error exists in that build; the good news is that if I remove the working directory (-b) option, the archive is no longer truncated, although zip does take more than twice as long.

4
Applications / Re: Creating archive > 4GiB from script
« on: December 27, 2018, 09:06:10 pm »
Last I checked, the 7zip archive format did not support EAs.  That renders it unsuitable for backing up certain things, like OS/2 system volumes.

I wound up using zip with exclude and include; that leaves me with more archive files for the volume, but the elapsed time is under an hour, far faster than with 7za. I'd still like a URL for a working version of zip.

Quote
BTW, I use info-zip (v3) to back up my volumes all the time.  I've never had any problem creating zips much larger than 4 GB, as long as the target volume supports it.

With what provenance? The one I'm using is from the ArcaOS and Netlabs repositories:
Code: [Select]
Installed Packages
Name        : unzip
Arch        : i686
Version     : 6.0
Release     : 7.oc00
Size        : 202 k
Repo        : installed
Summary     : A utility for unpacking zip files
URL         : http://www.info-zip.org/UnZip.html
License     : BSD
Description : The unzip utility is used to list, test, or extract files from a
            : zip archive.  Zip archives are commonly found on MS-DOS systems.
            : The zip utility, included in the zip package, creates zip
            : archives.  Zip and unzip are both compatible with archives created
            : by PKWARE(R)'s PKZIP for MS-DOS, but the programs' options and
            : default behaviors do differ in some respects.
            :
            : Install the unzip package if you need to list, test or extract
            : files from a zip archive.

Name        : zip
Arch        : i686
Version     : 3.0
Release     : 8.oc00
Size        : 524 k
Repo        : installed
Summary     : A file compression and packaging utility compatible with PKZIP
URL         : http://www.info-zip.org/Zip.html
License     : BSD
Description : The zip program is a compression and file packaging utility.  Zip
            : is analogous to a combination of the UNIX tar and compress
            : commands and is compatible with PKZIP (a compression and file
            : packaging utility for MS-DOS systems).
            :
            : Install the zip package if you need to compress files using the
            : zip program.


UnZip 6.00 of 20 April 2009, by Info-ZIP.  Maintained by C. Spieler.  Send
bug reports using http://www.info-zip.org/zip-bug.html; see README for details.

Latest sources and executables are at ftp://ftp.info-zip.org/pub/infozip/ ;
see ftp://ftp.info-zip.org/pub/infozip/UnZip.html for other sites.

Compiled with emx+gcc 4.9.2 for OS/2 (32-bit) on Jun 12 2018.

UnZip special compilation options:
        ASM_CRC
        COPYRIGHT_CLEAN (PKZIP 0.9x unreducing method not supported)
        OS2_EAS
        SET_DIR_ATTRIB
        SYMLINKS (symbolic links supported, if RTL and file system permit)
        TIMESTAMP
        UNIXBACKUP
        USE_EF_UT_TIME
        USE_UNSHRINK (PKZIP/Zip 1.x unshrinking method supported)
        USE_DEFLATE64 (PKZIP 4.x Deflate64(tm) supported)
        LARGE_FILE_SUPPORT (large files over 2 GiB supported)
        ZIP64_SUPPORT (archives using Zip64 for large files supported)
        USE_BZIP2 (PKZIP 4.6+, using bzip2 lib version 1.0.6, 6-Sept-2010)
        VMS_TEXT_CONV
        [decryption, version 2.11 of 05 Jan 2007]

A zip of the entire volume creates
Code: [Select]
12-23-18  10:37   4,294,967,295    124  M.zip
Attempting to unzip it gives
Code: [Select]
Archive:  K:/M.zip
  End-of-central-directory signature not found.  Either this file is not
  a zipfile, or it constitutes one disk of a multi-part archive.  In the
  latter case the central directory and zipfile comment will be found on
  the last disk(s) of this archive.

Doing the zip in pieces gives
Code: [Select]
12-23-18   3:13   2,252,560,732    124  M.pdf.Galaxy.zip
12-23-18   3:41   3,468,746,085    124  M.pdf.IBM.zip
12-23-18   3:59          45,183      0  M.pdf.IBM370.log
12-23-18   4:22          28,300      0  M.pdf.IBM370.tlog
12-23-18   4:11   3,199,967,659    124  M.pdf.IBM370.zip
12-23-18   4:24     269,681,811    124  M.pdf.IBMz.zip
12-23-18   4:26     198,084,369    124  M.pdf.Math.zip
12-23-18   2:52   2,642,968,249    124  M.pdf.zip
12-23-18   2:33     676,719,403    124  M.zip


5
Applications / Re: P7zip syntax for archiving an entire volume
« on: December 27, 2018, 08:44:38 pm »
You could try the information available https://info.nrao.edu/computing/guide/file-access-and-archiving/7zip/7z-7za-command-line-guide here.

That just repeats the information in the manual. It turns out that my syntax was correct; it worked when I used http://hobbes.nmsu.edu/download/pub/os2/util/archiver/p7zip-9.20.1-os2.zip instead of the newer http://hobbes.nmsu.edu/download/pub/os2/util/archiver/p7zip-16.02-os2-1.zip.

Are you now good with p7zip 9.20.1?

Yes, other than the performance. For the time being, I'm using multiple zip archives with include and exclude, which dumps the whole volume in less than an hour.

Quote
Do you see any developer listed to get a bug report?

I haven't seen a contact listed for the OS/2 build. If you can point me to the right location, I'll be happy to report it, with supporting documentation.

6
Applications / Re: P7zip syntax for archiving an entire volume
« on: December 21, 2018, 07:45:26 pm »

I need a solution that runs from the command line (well, from inside a Rexx script.) P7zip seems to fit the bill, even if I have to use an old version to get it to work.

If Zipboot is a front end to Info-zip, then doesn't it have the issue described in https://www.os2world.com/forum/index.php/topic,1941.msg19570.html#msg19570?


Try - BackEmUp - I use my "BackEmUp" (command line version) and/or "BackEmUI" (PM gui version of same functionality...) to keep my systems backed up. Eugene Gorbunoff is adding his own interface (Vareyne another alternative gui..) on top of my command line program to add in automatic scheduling, etc. (I use the "AT" command for my scheduling...)
[\quote]

Do you have a URL for the documentation?

Quote
And read what Alex Taylor wrote on your other post about 7z, also as many others have stated there is no issue with zip v3.

He told me to use split, which does not work; I mentioned that in my initial message.

Had there been no issue with zipv3 then I wouldn't have posted my message. The (presumed) fact that you haven't encountered the problem doesn't negate the fact that I did. Maybe the build from Smedley, which I'm about to try, works; the one included in ArcaOS definitely doesn't.

8
Applications / Re: P7zip syntax for archiving an entire volume
« on: December 20, 2018, 08:05:21 pm »
I'd like to create a 7z archive of an entire volume, using p7zip on ArcaOS. My first attempt was
Code: [Select]
Tue 11-27-18 22:47:32{1}[h:\vendors\7-zip\p7zip-16.02-os2-1\bin] 7za a w:\temp\m.7z m:\

7-Zip (a) [32] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=en_US.IBM-850,Utf16=on,HugeFiles=on,32 bits,2 CPUs x
86)

Open archive: w:/temp/m.7z
--
Path = w:/temp/m.7z
Type = 7z
Physical Size = 32
Headers Size = 0
Solid = -
Blocks = 0

Scanning the drive:

WARNING: No more files
m:

0 files, 0 bytes

Updating archive: w:/temp/m.7z

Items to compress: 0


Files read from disk: 0
Archive size: 32 bytes (1 KiB)

Scan WARNINGS for files and folders:

m: : No more files
----------------
Scan WARNINGS: 1

I then tried m:\* and the -r option; neither helped. What is the correct syntax? Thanks.


Hi

Here are some backup options, try PM Backup Suite.  Also, if you know some REXX you can modify Zipboot too.

http://os2notes.duckdns.org/os2backups.html


Greggory

I need a solution that runs from the command line (well, from inside a Rexx script.) P7zip seems to fit the bill, even if I have to use an old version to get it to work.

If Zipboot is a front end to Info-zip, then doesn't it have the issue described in https://www.os2world.com/forum/index.php/topic,1941.msg19570.html#msg19570?

10
Applications / P7zip syntax for archiving an entire volume
« on: December 19, 2018, 07:25:42 pm »
I'd like to create a 7z archive of an entire volume, using p7zip on ArcaOS. My first attempt was
Code: [Select]
Tue 11-27-18 22:47:32{1}[h:\vendors\7-zip\p7zip-16.02-os2-1\bin] 7za a w:\temp\m.7z m:\

7-Zip (a) [32] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=en_US.IBM-850,Utf16=on,HugeFiles=on,32 bits,2 CPUs x
86)

Open archive: w:/temp/m.7z
--
Path = w:/temp/m.7z
Type = 7z
Physical Size = 32
Headers Size = 0
Solid = -
Blocks = 0

Scanning the drive:

WARNING: No more files
m:

0 files, 0 bytes

Updating archive: w:/temp/m.7z

Items to compress: 0


Files read from disk: 0
Archive size: 32 bytes (1 KiB)

Scan WARNINGS for files and folders:

m: : No more files
----------------
Scan WARNINGS: 1

I then tried m:\* and the -r option; neither helped. What is the correct syntax? Thanks.

11
Applications / Re: Creating archive > 4GiB from script
« on: December 19, 2018, 07:13:39 pm »
Quote
Why do you believe that it takes hours to change a few dozen characters on the screen?

I know that PMMail has a serious problem populating the display container, when there are a few thousand entries to display. I see no reason why the Archive tool doesn't have the same problem. It is part of the way that OS/2 works, unless a programmer takes steps to work around it.

The only significant display updating is in the progress box; the update for each file is subsecond. There are only a bit over 4K files.

Quote
Quote
The problem is that I need to backup my data, not yours, and the zip provided with ArcaOS truncates the archive at 4 GiB - 1.

It occurs to me, that you may have a media problem (I know that ZIP/UNZIP will do it). What, exactly, are you backing up to?

M: is formatted JFS.

Quote
I know that FAT32 has some sort of maximum file size (probably 4 GB, and that is possibly fixed in the latest FAT32 versions). Try using JFS on the backup media.

The backup medium is formatted JFS.

12
Applications / Re: Creating archive > 4GiB from script
« on: December 17, 2018, 09:13:23 pm »
This may be a bit off-topic in this thread, but why use compression tools for backup purposes? Disk space is fairly cheap nowadays. Rsync and Keith's Easy Synch are imho far better tools for that, not in the least because they can do differential/incremental backups, it's easily possible to restore individual files etc. Are network copying times an issue?

I want off-site backups, and the only devices that I have for removable media are DVD drives and USB ports, both slow. The capacity of a DVD is too small, so that leaves thumb drives or USB hard drives.

With zip or other compressed archive there are fewer data to write, which reduces the time required. I've rarely needed to restore an entire volume; usually I just need to restore one file to get the version prior to a finger check.

Of course, zip is also nice for porting my environment to another machine when my house loses power for weeks  >:(

13
Applications / Re: Creating archive > 4GiB from script
« on: December 17, 2018, 08:57:38 pm »
Quote
The screen update time is negligible.

No it's not.

Why do you believe that it takes hours to change a few dozen characters on the screen?

Quote
Quote
I also use ANPM to manage that stuff, and the version installed by ANPM is broken.

What is the problem? They work well, for me.

The problem is that I need to backup my data, not yours, and the zip provided with ArcaOS truncates the archive at 4 GiB - 1.

Quote
Have you made sure, that no other versions are sitting around in your system, just waiting to cause problems?

I don't understand how any of the other versions could have generated the date in "Compiled with emx+gcc 4.9.2 for OS/2 2.x/3.x (32-bit) on Sep 28 2018."

Quote
Have you reported your problem (if you really do have one)?

Who are you and what have you done with the real Doug Bissett? What is "See also http://trac.netlabs.org/ports/ticket/194", chopped liver? Please read what I've already posted here before accusing me of making up the problem.


14
Applications / Re: Creating archive > 4GiB from script
« on: December 14, 2018, 08:15:18 pm »
The Python zip documentation and link to module, https://docs.python.org/2/library/zipfile.html

Thanks.

Quote
With gzip, bzip2, xv, the way to do it is to create a tar archive and then gzip, bzip2 or xz the tar archive. Tar usually supports both steps, read the documentation. Problem with these is no EA support unless you use really old versions, which don't support large files.
There is star, http://hobbes.nmsu.edu/download/pub/os2/util/archiver/star-1.5.73-os2.zip, an alternative tar program that does support EAs, large files and gzip and IIRC, bzip2. Worth looking at as Yuri did a good job of porting, not just rebuilding.
In order of compression, from worst to best, gzip, bzip2 and xz. Note that xz is not considered as stable though I've never had a problem with xz compressed tarballs I've downloaded.

I definitely need both EA and large archive support. I'll take a look at star, but in the meantime if you can give me a URL for a zip build that can creat a large archive under ArcaOS, I'd appreciate it.

15
Applications / Re: Creating archive > 4GiB from script
« on: December 14, 2018, 08:00:34 pm »
Quote
1. Arctool can create and read a 12 GiB zip file, although it takes more than 4 times as long

It reads the ZIP file (I have done it with 60 GB files), just as fast. What takes the time, is formatting the screen output, so the user can see, and select, the files that are inside the zip file. Overall, much easier to use, but slower.

It's the zip speed I'm concerned with, and that's 4 times as slow. The screen update time is negligible.
Quote

Quote
2. what are the URLs for the zip and unzip builds that support > 4GiB in OS/2?

I don't know, offhand. I use Arca Noae Package Manager (ANPM) to manage that stuff, so I don't need to do it manually. I expect that they are wherever they post the RPM packages. Whether they will work properly, without all of the other stuff that ANPM (RPM/YUM) installs, I don't care to know.

I also use ANPM to manage that stuff, and the version installed by ANPM is broken. That's why I asked for the  URL to a working zip version. I don't care whether it is an rpm, a wpi or a zip, as long as correctly builds a large zip.

Quote
Quote
4. Several of the other compression tools, e.g., gzip, xz, are intended to compress in place rather than to build a compressed archive.

That doesn't make sense. How can you compress a folder (for example) "in place"? And what good are they, if they don't produce an archive file?

You can't. The default behavior of those utilities is to create a compressed file and delete the original.

Quote
Gzip and xz do exactly what ZIP does, they create an archive file out of (a) source file(s).

Not even close. See the Dec 7 reply by David Yeo

Pages: [1] 2