OS2 World Community Forum

OS/2, eCS & ArcaOS - Technical => Applications => Topic started by: Glenn on August 05, 2024, 04:19:04 pm

Title: ANPM database error
Post by: Glenn on August 05, 2024, 04:19:04 pm
Hello all, I "regularly" check for updates with ANPM, but today it does not want to display me anything (see screenshot as attachment).

I tried the options to clean and to redo the rpm database, to no available. I could find some old web mention of that error on os2.org (dating from 2019 IIRC) but without definitive solution (I tried what was suggested there).

Anyone has an idea on how to fix that problem?

Thanks for any idea !
Title: Re: ANPM database error
Post by: Dave Yeo on August 05, 2024, 04:37:54 pm
I think the problem is upstream as if you look at the VLC 3.0.21 not starting thread, a few of us are getting the same error.
Title: Re: ANPM database error
Post by: Glenn on August 05, 2024, 04:47:29 pm
I think the problem is upstream as if you look at the VLC 3.0.21 not starting thread, a few of us are getting the same error.
Thanks Dave, I don't run VLC on ArcaOS, so did not check that thread. I am relieved the problem is not on my side.
Title: Re: ANPM database error
Post by: Silvan Scherrer on August 05, 2024, 05:24:12 pm
Hello all, I "regularly" check for updates with ANPM, but today it does not want to display me anything (see screenshot as attachment).

I tried the options to clean and to redo the rpm database, to no available. I could find some old web mention of that error on os2.org (dating from 2019 IIRC) but without definitive solution (I tried what was suggested there).

Anyone has an idea on how to fix that problem?

Thanks for any idea !

it seems the database file on the netlabs server is broken. I contacted Adrian already. Lets hope he can fix it soon
Title: Re: ANPM database error
Post by: Dave Yeo on August 07, 2024, 06:40:36 am
Lewis has rebuilt the database at 2rosenthals.com so can disable netlabs release and enable the mirror at https://repos.arcanoae.com/release/$releasever/ (https://repos.arcanoae.com/release/$releasever/). See https://www.arcanoae.com/wiki/anpm/ (https://www.arcanoae.com/wiki/anpm/) for more info
Edit: Might need a "yum clean" to get working
Title: Re: ANPM database error
Post by: Glenn on August 09, 2024, 01:27:15 pm
Lewis has rebuilt the database at 2rosenthals.com so can disable netlabs release and enable the mirror at https://repos.arcanoae.com/release/$releasever/ (https://repos.arcanoae.com/release/$releasever/). See https://www.arcanoae.com/wiki/anpm/ (https://www.arcanoae.com/wiki/anpm/) for more info
Edit: Might need a "yum clean" to get working

I still get an error, after removing the Netlabs server. I wish that Lewis, in the same way that ArcaOS ISO images are generated with the serial number automatically online, could create a way to automatically generate ANPM configuration files, with identifiers, proper servers, etc..
Title: Re: ANPM database error
Post by: Eugene Tucker on August 09, 2024, 09:59:14 pm
Did not work for me either.
Title: Re: ANPM database error
Post by: Mark Szkolnicki on August 09, 2024, 11:41:53 pm
Lewis has rebuilt the database at 2rosenthals.com so can disable netlabs release and enable the mirror at https://repos.arcanoae.com/release/$releasever/ (https://repos.arcanoae.com/release/$releasever/). See https://www.arcanoae.com/wiki/anpm/ (https://www.arcanoae.com/wiki/anpm/) for more info
Edit: Might need a "yum clean" to get working

Tried Dave's and Lewis's instructions this afternoon, and was able to get the ANPM file listings again, by:

1) going into ANPM
2) Going to Manage - Repositories on the menu
3) Right clicking on netlabs-rel and changing status to disable
4) Then clicking on Repository - Add - Yum Repository
5) When the information fill-in box comes up, putting in a name (I used 2Rosenthals)
6) Dragging the link Dave provided to the URL box (the drag spawns a URL object which can be placed into the box)
7) Pressing Save, closing the fill-in box

I did not need to exit ANPM and restart or do YUM Clean-up - ANPM went through its filelist update sequence and the file listings reappeared.

Haven't tried to update or add anything yet, but at least that got past the "File malformed" problem.

Best!

M
 
Title: Re: ANPM database error
Post by: Mark Szkolnicki on August 10, 2024, 12:20:39 am
Lewis has rebuilt the database at 2rosenthals.com so can disable netlabs release and enable the mirror at https://repos.arcanoae.com/release/$releasever/ (https://repos.arcanoae.com/release/$releasever/). See https://www.arcanoae.com/wiki/anpm/ (https://www.arcanoae.com/wiki/anpm/) for more info
Edit: Might need a "yum clean" to get working

I have done a number of updates to the 5.0.7 partition where I made the ANPM filelist update modifications, so everything copacetic so far - I don't know where those files reside but haven't run into any problems so far.

M
Title: Re: ANPM database error
Post by: Dave Yeo on August 10, 2024, 01:08:25 am
Yes, it worked fine for me basically the same way you (Mark) described. I did clean everything just to be safe.
Another way is to create a file, @unixroot\etc\yum\repos.d\ARCANOAE-REL.REPO containing something like,
Code: [Select]
[arcanoae-rel]
name=ArcaNoae stable repository $releasever
baseurl=https://repos.arcanoae.com/release/$releasever/
enabled=1
and in the neighbouring NETLABS-REL.REPO, change the enabled=1 to enabled=0.
Title: Re: ANPM database error
Post by: Rene Hvidsoe on August 11, 2024, 03:31:46 pm
This does work for either.

Best Regards

Rene
Title: Re: ANPM database error
Post by: David McKenna on August 12, 2024, 11:52:41 pm
 Even the 2Rosenthals repo doesn't work for me - same 'disk image is malformed' error as with the netlabs-rel repo - even after a yum cleaning. So the bit rot seems to be spreading. The ArcaNoae-rel repo Dave suggests only has about a dozen or so files listed (which was already installed here).

 This situation is very bad...

Regards,
Title: Re: ANPM database error
Post by: Dave Yeo on August 13, 2024, 12:49:43 am
The 2Rosenthals repo seems fine here. They do have down time occasionally.
Latest word from Adrian,
Code: [Select]
On 07.08.2024 12:55, Adrian Gschwend wrote:

Hi everyone,

> Hopefully I can then send the data to the new, faster VM & get rid of the traps as well.

good news, after spending hours, I figured out a way to properly send the zfs filesystems with the data to the new VM!

I'll have to setup services on the new VM which will take some time as I need to change some system internal abstractions due to no longer supported tools I had in use.

But in general I can say the data should be fine & it's just a matter of time now till we are on a new, much faster VM.

regards

Adrian

So things are looking up.
Title: Re: ANPM database error
Post by: Digi on August 13, 2024, 07:46:07 am
Even the 2Rosenthals repo doesn't work for me - same 'disk image is malformed' error as with the netlabs-rel repo - even after a yum cleaning. So the bit rot seems to be spreading. The ArcaNoae-rel repo Dave suggests only has about a dozen or so files listed (which was already installed here).

I have the same situation on my two boxes. I've been waiting for a several days for the problem to be fixed.
Title: Re: ANPM database error
Post by: Remy on August 13, 2024, 10:05:55 am
Lewis has rebuilt the database at 2rosenthals.com so can disable netlabs release and enable the mirror at https://repos.arcanoae.com/release/$releasever/ (https://repos.arcanoae.com/release/$releasever/). See https://www.arcanoae.com/wiki/anpm/ (https://www.arcanoae.com/wiki/anpm/) for more info
Edit: Might need a "yum clean" to get working

Tried Dave's and Lewis's instructions this afternoon, and was able to get the ANPM file listings again, by:

1) going into ANPM
2) Going to Manage - Repositories on the menu
3) Right clicking on netlabs-rel and changing status to disable
4) Then clicking on Repository - Add - Yum Repository
5) When the information fill-in box comes up, putting in a name (I used 2Rosenthals)
6) Dragging the link Dave provided to the URL box (the drag spawns a URL object which can be placed into the box)
7) Pressing Save, closing the fill-in box

I did not need to exit ANPM and restart or do YUM Clean-up - ANPM went through its filelist update sequence and the file listings reappeared.

Haven't tried to update or add anything yet, but at least that got past the "File malformed" problem.

Best!

M

Thanks,
It worked for me
Title: Re: ANPM database error
Post by: Eugene Tucker on August 13, 2024, 01:06:50 pm
It worked for me as well.
Title: Re: ANPM database error
Post by: Mark Szkolnicki on August 14, 2024, 02:44:43 am
Heh David!

Even the 2Rosenthals repo doesn't work for me - same 'disk image is malformed' error as with the netlabs-rel repo - even after a yum cleaning. So the bit rot seems to be spreading. The ArcaNoae-rel repo Dave suggests only has about a dozen or so files listed (which was already installed here).

 This situation is very bad...

Regards,

Are you sure that the Netlabs-Rel repository is really disabled?

The only reason I ask is that I decided to also update the 5.0.7 partition to 5.0.8 on my system, and in the process it decided to re-enable netlabs-rel, giving me the image is malformed window yet again.

Disabling the Netlabs-rel repository yet again, and enabling 2rosenthals, everything went back to normal again.

One has to be disabled (netlabs-rel) while the other is enabled (2rosenthals) - otherwise you get the same message - at least I experienced that, twice.

Also are you using this link Dave provided in the new repo (and BTW the new repo listing does not have to be named 2rosenthals - I did that myself as Lewis has been a huge supporter of all of this, essentially creating ArcaOS - the name can be anything you like, but the Repo URL that works for me remains:

https://repos.arcanoae.com/release/$releasever/

Best!

M
Title: Re: ANPM database error
Post by: Digi on August 14, 2024, 04:23:38 am
Are you sure that the Netlabs-Rel repository is really disabled?

It doesn't help me. Enabled repositories in my list:
https://repos.arcanoae.com/release/$releasever/
https://www.2rosenthals.com/rpm.netlabs.org/release/$releasever/$basearch/
Title: Re: ANPM database error
Post by: Dave Yeo on August 14, 2024, 06:08:40 am
Try disabling https://www.2rosenthals.com/rpm.netlabs.org/release/$releasever/$basearch/
 (https://www.2rosenthals.com/rpm.netlabs.org/release/$releasever/$basearch/)
All my Arca related entries are repos.arcanoae.com based
Title: Re: ANPM database error
Post by: David McKenna on August 14, 2024, 12:37:25 pm
 The 2Rosenthals repo gives the same 'malformed' error here as the netl;abs-rel repo (which I would expect if it is a mirror). I already had the arcanoae-rel repo installed, but it doesn't have the same files as the netlabs-rel repo. Dave, I'm curious what you get if in ANPM, you click on 'Available'->'RPM' in the left pane, then in the 'repositories' dropdown at upper right, click on 'arcanoae-rel'. Here I just get a list of about 12 packages

Regards,
Title: Re: ANPM database error
Post by: Digi on August 14, 2024, 02:31:12 pm
Try disabling https://www.2rosenthals.com/rpm.netlabs.org/release/$releasever/$basearch/
 (https://www.2rosenthals.com/rpm.netlabs.org/release/$releasever/$basearch/)
All my Arca related entries are repos.arcanoae.com based

Yes, it works without 2rosenthals. But there are not enough packages on repos.arcanoae.com.
Title: Re: ANPM database error
Post by: Mark Szkolnicki on August 14, 2024, 03:10:40 pm
Hi Digi!

Try disabling https://www.2rosenthals.com/rpm.netlabs.org/release/$releasever/$basearch/
 (https://www.2rosenthals.com/rpm.netlabs.org/release/$releasever/$basearch/)
All my Arca related entries are repos.arcanoae.com based

Yes, it works without 2rosenthals. But there are not enough packages on repos.arcanoae.com.

I see what you and David are talking about now - in ANPM your referring to the "available" files that you don't have installed - I also get 12 files listed - I was looking at the "installed" files, of which I have roughly 250 installed, and as of last week I could update them.

I still have one update listed in the installed files - QT5. When I attempt to download that I get the following window message:

_____________

Error with transaction check vs depsolve:qt5-multimedia is needed by qt5-15.2-1,oc00.noarchqt5-qtwebsockets is needed by qt5-15.2-1,oc00.noarch. Please report this error at https://github.com/bitwiseworks/rpm-issues.

______________

So I agree with you - something is broken in the repo referenced, mirror or otherwise.

Best!

Mark
Title: Re: ANPM database error
Post by: Dave Yeo on August 14, 2024, 04:30:14 pm
Yes, same as Mark, sorry for miss leading people.
Title: Re: ANPM database error
Post by: Digi on August 15, 2024, 12:09:47 am
I see what you and David are talking about now - in ANPM your referring to the "available" files that you don't have installed - I also get 12 files listed - I was looking at the "installed" files, of which I have roughly 250 installed, and as of last week I could update them.

Once again, arcanoae-rel lacks many packages that are on netlabs-rel.
Title: Re: ANPM database error
Post by: Steven Levine on August 15, 2024, 10:33:51 pm
A couple of comments which hopefully will reduce the confusion rather than increase it.

The correct repository URLs can be found at

  https://www.arcanoae.com/wiki/anpm

The link to the Arca Noae mirror of the netlabs-rel repo is

  https://www.2rosenthals.com/rpm.netlabs.org/release/$releasever/$basearch/

which decodes to
   
  https://www.2rosenthals.com/rpm.netlabs.org/release/00/i386/

The repo URLs that contain repos.arcanoae.com only apply to Arca Noae supplied packages.  They cannot be used to install netlabs supplied packages.

The netlabs-rel repo is at

  http://rpm.netlabs.org/release/$releasever/$basearch/
 
which decodes to

   http://rpm.netlabs.org/release/00/i386/

The mirror content is close but not exactly the same as what's at netlabs.  It's supposed to be, but perhaps the netlabs server issues caused the mirror operation to fail in some ways.  This would be a question for Lewis.

Lewis is building the yum metadata locally until netlabs is fully back in service.  This metadata will only include files that the mirror contains.

If someone needs to install a specific package not known to the mirror, you can download the rpm package from the netlabs repo and use anpm or rpm to install it.  For those using the pentium4 platform, the netlabs rpms are at

  http://rpm.netlabs.org/release/00/i386/pentium4/

These do not seem to be affected the netlabs server issues.
Title: Re: ANPM database error
Post by: Eugene Tucker on August 16, 2024, 12:52:06 am
Thank you Steven Levine.
Title: Re: ANPM database error
Post by: Mark Szkolnicki on August 16, 2024, 01:56:58 am
Hi Steve!

A couple of comments which hopefully will reduce the confusion rather than increase it.

The correct repository URLs can be found at

  https://www.arcanoae.com/wiki/anpm

The link to the Arca Noae mirror of the netlabs-rel repo is at

  https://www.2rosenthals.com/rpm.netlabs.org/release/$releasever/$basearch/

which decodes to
   
  https://www.2rosenthals.com/rpm.netlabs.org/release/00/i386/

The repo URLs that contain repos.arcanoae.com only apply to Arca Noae supplied packages.  They cannot be used to install netlabs supplied packages.

The netlabs-rel repo is at

  http://rpm.netlabs.org/release/$releasever/$basearch/
 
which decodes to

   http://rpm.netlabs.org/release/00/i386/

The mirror content is close but not exactly the same as what's at netlabs.  It's supposed to be, but perhaps the netlabs server issues caused the mirror operation to fail in some ways.  This would be a question for Lewis.

Lewis is building the yum metadata locally until netlabs is fully back in service.  This metadata will only include files that the mirror contains.

If someone needs to install a specific package not known to the mirror, you can download the rpm package from the netlabs repo and use anpm or rpm to install it.  For those using the pentium4 platform, the netlabs rpms are at

  http://rpm.netlabs.org/release/00/i386/pentium4/

These do not seem to be affected the netlabs server issues.

I don't think we corresponded in the past, Steve - Martin pointed out that I confused you with Steve Wendt in a previous incarnation of this post, so I've corrected the error - sorry if it caused any confusion

I'm not a programmer per se - but I am an Emergency Response Troubleshooter, and have been a beta tester for years. So I was musing on your post here and decided to try a number of experiments.

I created repositories for both the mirror and the decode links you posted, in ANPM separately (4 separate repositories), as a test for both the 2rosenthals/arcanoae and netlabs links. I then enabled each separately, while disabling all the other repositories I had. What I got in each when it ran was the "Disk Image is malformed" message.

IOW I was not able to create a more definitive files list of downloads, using any of the four links you provided. Someone else may want to try what I did, to confirm what my findings were this evening. I trained as a scientist, so it doesn't mean that what I did did not work - if someone else gets a repo working, with the links you provided, I would be more than happy to test again.

The only one which still seems to work was the original link Dave Yeo posted - and still only contained the 12 files mentioned previously.

I have corresponded with Lewis in the past occasionally, but as you probably know I'm not part of the global ArcaNoae development team, so I may report this directly to see if he has any bright ideas.

Thanks for the additional information, Sir and Best!

M
Title: Re: ANPM database error
Post by: Martin Iturbide on August 16, 2024, 05:49:44 am
Hello Mark
I think we corresponded in the past a few times over the last couple of decades when you were doing OS/2 News and Rumors

I think that on this case you are confusing Steve Levine, OS/2 software developer, with Steve Wendt, creator of the OS/2 News and Rumors site. But anyways, both Steve had done excellent work within the community.  :D

Regards
Title: Re: ANPM database error
Post by: Mark Szkolnicki on August 16, 2024, 04:31:59 pm
Hi Martin!

Hello Mark
I think we corresponded in the past a few times over the last couple of decades when you were doing OS/2 News and Rumors

I think that on this case you are confusing Steve Levine, OS/2 software developer, with Steve Wendt, creator of the OS/2 News and Rumors site. But anyways, both Steve had done excellent work within the community.  :D

Regards

You are indeed correct Sir and I apologize to Steve for the error, and I will correct the post.

Best!

Mark
Title: Re: ANPM database error
Post by: Mark Szkolnicki on August 16, 2024, 07:20:30 pm
Hi All!

I re-enabled netlabs-rel this morning to run some tests and all the previous RPMs and more seem to be available again.

Can anyone else confirm?

I also went over to the ANPM wiki today and tried the "official stable release" URL for arcanoae-rel, and found only the same 12 files listed, reason unknown. As an emergency planner I think Lewis and the Arca Noae folks should make sure that the stable RPM's are also maintained regularly on arcanoae-rel as well as at least an emergency  back-up, if it hasn't been in the past.

Mirrors are fine, but the problems Adrian has been having pointed out a serious flaw in maintaining ANPM.

Plan to have an email chat with Lewis in future and Best!

M
Title: Re: ANPM database error
Post by: Eugene Tucker on August 16, 2024, 07:56:11 pm
Mark I can confirm  what you are seeing.
Title: Re: ANPM database error
Post by: Mark Szkolnicki on August 16, 2024, 08:57:51 pm
Mark I can confirm  what you are seeing.

Thanks Eugene!

The array of available files I'm seeing is somewhat different than what was previously there, or at least I think so.

I also sent an e-mail to Lewis today, as I had a few questtions.

A fine weekend to you, Sir and Best!

M
Title: Re: ANPM database error
Post by: Lewis Rosenthal on August 16, 2024, 10:10:18 pm
Sorry for the bumpy ride with the (temporary) transition to maintaining our own metadata at the 2rosenthals.com mirror.s I managed to fat-finger my edit to the update script which caused us to bypass the actual download of new packages (D'Oh!).

Anyway, all fixed now. The last metadata update on the 2rosenthals.com mirrors of netlabs-rel and netlabs-exp was timestamped at around 5:30am EDT, which corresponds with the timing of the cron job. We also managed to pick up some more recent files.

A word of caution:

The 2rosenthals.com mirror of netlabs-rel and netlabs-exp have nothing whatsoever to do with arcanoae-rel, arcanoae-exp, and arcanoae-sub. The Arca Noae content is unique to the arcanoae-* repos. None of the arcanoae-* repos are mirrors of anything else, nor are there any mirrors of their content anywhere.

Also, one might note that there are a handful of qt5 5.15.2 packages available from arcanoae-rel which are not available from netlabs-rel (or, obviously, the 2rosenthals.com mirror thereof). These packages were necessary to allow qt5 to upgrade cleanly on ArcaOS, as bww did not provide them (e.g., the qt5 metapackage for 5.15.2). It is not possible to upgrade qt5 with *just* the packages at arcanoae-rel, nor was that ever the intent of Arca Noae.

Hopefully, the Netlabs repos will be back up and available soon.
Title: Re: ANPM database error
Post by: Mark Szkolnicki on August 16, 2024, 11:39:50 pm
Heh Lewis!
Sorry for the bumpy ride with the (temporary) transition to maintaining our own metadata at the 2rosenthals.com mirror.s I managed to fat-finger my edit to the update script which caused us to bypass the actual download of new packages (D'Oh!).

Anyway, all fixed now. The last metadata update on the 2rosenthals.com mirrors of netlabs-rel and netlabs-exp was timestamped at around 5:30am EDT, which corresponds with the timing of the cron job. We also managed to pick up some more recent files.

A word of caution:

The 2rosenthals.com mirror of netlabs-rel and netlabs-exp have nothing whatsoever to do with arcanoae-rel, arcanoae-exp, and arcanoae-sub. The Arca Noae content is unique to the arcanoae-* repos. None of the arcanoae-* repos are mirrors of anything else, nor are there any mirrors of their content anywhere.

Also, one might note that there are a handful of qt5 5.15.2 packages available from arcanoae-rel which are not available from netlabs-rel (or, obviously, the 2rosenthals.com mirror thereof). These packages were necessary to allow qt5 to upgrade cleanly on ArcaOS, as bww did not provide them (e.g., the qt5 metapackage for 5.15.2). It is not possible to upgrade qt5 with *just* the packages at arcanoae-rel, nor was that ever the intent of Arca Noae.

Hopefully, the Netlabs repos will be back up and available soon.

Thanks for posting this, Sir - as to the Netlabs-rel site, it seems to be back up, as of this morning - sent you a second e-mail on that one. I don't think netlabs-exp was ever down.

Best as always!

Mark

Title: Re: ANPM database error
Post by: Digi on August 17, 2024, 04:50:48 am
The netlabs repository and its mirror now work without problems on my systems.
Title: Re: ANPM database error
Post by: Rene Hvidsoe on August 17, 2024, 11:48:16 am
I can confirm, works here.

Thanks.

Best regards

Rene
Title: Re: ANPM database error
Post by: Lewis Rosenthal on August 17, 2024, 04:45:50 pm
I should probably put a finer point on this.  :)

The recent problem at Netlabs has generally not been one of "up" or "down" in terms of accessibility vs no accessibility of content, but rather the integrity of the repository metadata. YUM (and thus, ANPM, which is only a front end for YUM and WarpIN) reads the metadata (catalog) of the repository and presents a list of packages based on that metadata. Errors parsing the metadata are presented in various ways likely as discussed earlier in this thread (I haven't fully read it), including "cannot find xyz...primary.sqlite" and so forth.

Under normal circumstances, the 2rosenthals.com mirrors simply include the Netlabs metadata when mirroring the repositories, cleaning out any prior mirrored metadata files in the process. When the issue(s) surfaced at Netlabs, it became necessary for us to generate/update/maintain our own metadata unique to the 2rosenthals.com mirrors.

It is entirely possible to have metadata downloaded from the 2rosenthals.com mirrors, select a package for installation, and have that package pulled from either rpm.netlabs.org or www.2rosenthals.com (if you have the yum fastestmirror plugin installed and enabled, whichever server provides the best response will be chosen for the download). As long as the checksum of the downloaded file matches the one in the metadata for that package, the rpm is accepted as valid for installation. The current "problem," then, only manifests itself when refreshing metadata for the Netlabs repos, because if the metadata is refreshed from rpm.netlabs.org and is broken, errors will occur (the download of a given metadata file will be successful, but the original on the server will likely be corrupt). The rpms themselves change very little, and the current issue at Netlabs seems to be with new files created by the server, not files copied to it or downloaded from it.

So, in summary, note that it may be necessary to remove/comment rpm.netlabs.org from the netlabs-???.repo file in order to have the metadata refresh from the mirror, and then add/uncomment rpm.netlabs.org again for "normal" operation. It is, of course, possible to extend the life of the metadata (i.e., not have it expire as quickly, so it needs refreshing less often). To do this, simply edit yum.conf and look for (or add):

metadata_expire  Time (in seconds)

where Time is the number of seconds to keep the metadata before refreshing again. The default is 6 hours (see the yum.conf man page). "never" is a valid value, which means that the metadata must be manually refreshed (and may be a reasonable setting for the time being, until we can be assured that the Netlabs issues have been fully resolved).