Author Topic: ANPM database error  (Read 9384 times)

Eugene Tucker

  • Sr. Member
  • ****
  • Posts: 402
  • Karma: +15/-0
    • View Profile
Re: ANPM database error
« Reply #30 on: August 16, 2024, 07:56:11 pm »
Mark I can confirm  what you are seeing.

Mark Szkolnicki

  • Sr. Member
  • ****
  • Posts: 454
  • Karma: +18/-0
    • View Profile
Re: ANPM database error
« Reply #31 on: August 16, 2024, 08:57:51 pm »
Mark I can confirm  what you are seeing.

Thanks Eugene!

The array of available files I'm seeing is somewhat different than what was previously there, or at least I think so.

I also sent an e-mail to Lewis today, as I had a few questtions.

A fine weekend to you, Sir and Best!

M
Vincit Que Se Vincit - "He Who Conquers Self Succeeds"

Lewis Rosenthal

  • Jr. Member
  • **
  • Posts: 94
  • Karma: +6/-0
    • View Profile
    • Tales from the Trenches of IT
Re: ANPM database error
« Reply #32 on: August 16, 2024, 10:10:18 pm »
Sorry for the bumpy ride with the (temporary) transition to maintaining our own metadata at the 2rosenthals.com mirror.s I managed to fat-finger my edit to the update script which caused us to bypass the actual download of new packages (D'Oh!).

Anyway, all fixed now. The last metadata update on the 2rosenthals.com mirrors of netlabs-rel and netlabs-exp was timestamped at around 5:30am EDT, which corresponds with the timing of the cron job. We also managed to pick up some more recent files.

A word of caution:

The 2rosenthals.com mirror of netlabs-rel and netlabs-exp have nothing whatsoever to do with arcanoae-rel, arcanoae-exp, and arcanoae-sub. The Arca Noae content is unique to the arcanoae-* repos. None of the arcanoae-* repos are mirrors of anything else, nor are there any mirrors of their content anywhere.

Also, one might note that there are a handful of qt5 5.15.2 packages available from arcanoae-rel which are not available from netlabs-rel (or, obviously, the 2rosenthals.com mirror thereof). These packages were necessary to allow qt5 to upgrade cleanly on ArcaOS, as bww did not provide them (e.g., the qt5 metapackage for 5.15.2). It is not possible to upgrade qt5 with *just* the packages at arcanoae-rel, nor was that ever the intent of Arca Noae.

Hopefully, the Netlabs repos will be back up and available soon.
Lewis
-------------------------------------------------------------
Lewis G Rosenthal, CNA, CLP, CLE, CWTS
Managing Member
Arca Noae, LLC                               www.arcanoae.com

Mark Szkolnicki

  • Sr. Member
  • ****
  • Posts: 454
  • Karma: +18/-0
    • View Profile
Re: ANPM database error
« Reply #33 on: August 16, 2024, 11:39:50 pm »
Heh Lewis!
Sorry for the bumpy ride with the (temporary) transition to maintaining our own metadata at the 2rosenthals.com mirror.s I managed to fat-finger my edit to the update script which caused us to bypass the actual download of new packages (D'Oh!).

Anyway, all fixed now. The last metadata update on the 2rosenthals.com mirrors of netlabs-rel and netlabs-exp was timestamped at around 5:30am EDT, which corresponds with the timing of the cron job. We also managed to pick up some more recent files.

A word of caution:

The 2rosenthals.com mirror of netlabs-rel and netlabs-exp have nothing whatsoever to do with arcanoae-rel, arcanoae-exp, and arcanoae-sub. The Arca Noae content is unique to the arcanoae-* repos. None of the arcanoae-* repos are mirrors of anything else, nor are there any mirrors of their content anywhere.

Also, one might note that there are a handful of qt5 5.15.2 packages available from arcanoae-rel which are not available from netlabs-rel (or, obviously, the 2rosenthals.com mirror thereof). These packages were necessary to allow qt5 to upgrade cleanly on ArcaOS, as bww did not provide them (e.g., the qt5 metapackage for 5.15.2). It is not possible to upgrade qt5 with *just* the packages at arcanoae-rel, nor was that ever the intent of Arca Noae.

Hopefully, the Netlabs repos will be back up and available soon.

Thanks for posting this, Sir - as to the Netlabs-rel site, it seems to be back up, as of this morning - sent you a second e-mail on that one. I don't think netlabs-exp was ever down.

Best as always!

Mark

Vincit Que Se Vincit - "He Who Conquers Self Succeeds"

Digi

  • Jr. Member
  • **
  • Posts: 69
  • Karma: +4/-1
  • http://os2.snc.ru/
    • View Profile
    • OS/2 ports and applications
Re: ANPM database error
« Reply #34 on: August 17, 2024, 04:50:48 am »
The netlabs repository and its mirror now work without problems on my systems.
« Last Edit: August 17, 2024, 04:54:15 am by Digi »

Rene Hvidsoe

  • Jr. Member
  • **
  • Posts: 58
  • Karma: +2/-0
    • View Profile
Re: ANPM database error
« Reply #35 on: August 17, 2024, 11:48:16 am »
I can confirm, works here.

Thanks.

Best regards

Rene

Lewis Rosenthal

  • Jr. Member
  • **
  • Posts: 94
  • Karma: +6/-0
    • View Profile
    • Tales from the Trenches of IT
Re: ANPM database error
« Reply #36 on: August 17, 2024, 04:45:50 pm »
I should probably put a finer point on this.  :)

The recent problem at Netlabs has generally not been one of "up" or "down" in terms of accessibility vs no accessibility of content, but rather the integrity of the repository metadata. YUM (and thus, ANPM, which is only a front end for YUM and WarpIN) reads the metadata (catalog) of the repository and presents a list of packages based on that metadata. Errors parsing the metadata are presented in various ways likely as discussed earlier in this thread (I haven't fully read it), including "cannot find xyz...primary.sqlite" and so forth.

Under normal circumstances, the 2rosenthals.com mirrors simply include the Netlabs metadata when mirroring the repositories, cleaning out any prior mirrored metadata files in the process. When the issue(s) surfaced at Netlabs, it became necessary for us to generate/update/maintain our own metadata unique to the 2rosenthals.com mirrors.

It is entirely possible to have metadata downloaded from the 2rosenthals.com mirrors, select a package for installation, and have that package pulled from either rpm.netlabs.org or www.2rosenthals.com (if you have the yum fastestmirror plugin installed and enabled, whichever server provides the best response will be chosen for the download). As long as the checksum of the downloaded file matches the one in the metadata for that package, the rpm is accepted as valid for installation. The current "problem," then, only manifests itself when refreshing metadata for the Netlabs repos, because if the metadata is refreshed from rpm.netlabs.org and is broken, errors will occur (the download of a given metadata file will be successful, but the original on the server will likely be corrupt). The rpms themselves change very little, and the current issue at Netlabs seems to be with new files created by the server, not files copied to it or downloaded from it.

So, in summary, note that it may be necessary to remove/comment rpm.netlabs.org from the netlabs-???.repo file in order to have the metadata refresh from the mirror, and then add/uncomment rpm.netlabs.org again for "normal" operation. It is, of course, possible to extend the life of the metadata (i.e., not have it expire as quickly, so it needs refreshing less often). To do this, simply edit yum.conf and look for (or add):

metadata_expire  Time (in seconds)

where Time is the number of seconds to keep the metadata before refreshing again. The default is 6 hours (see the yum.conf man page). "never" is a valid value, which means that the metadata must be manually refreshed (and may be a reasonable setting for the time being, until we can be assured that the Netlabs issues have been fully resolved).
Lewis
-------------------------------------------------------------
Lewis G Rosenthal, CNA, CLP, CLE, CWTS
Managing Member
Arca Noae, LLC                               www.arcanoae.com