Show Posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.


Messages - Dariusz Piatkowski

Pages: 1 ... 46 47 [48] 49 50 ... 88
706
Storage / RSYNC - what to put in EXCLUDE list?
« on: January 01, 2020, 06:43:26 pm »
Alright...so with the New Year comes a resolution of mine: "get rsync up and running"!

I used to run dSync back in the day to run a local (disk to disk) nightly backup of my partitions (mostly Maintenance and OS2). I then moved off of HPFS386 to JFS, made some changes to hardare (went to SSD) and just never got around to re-configuring the backup routines. Now, dSync had some issues, so I decided to move to RSYNC.

Alright, so with a few spare days on my hands I was able to make a bit of progress. Spent the day yesterday actually re-learning all the RSYNC stuff and managed to do a whole bunch of testing with the --dry-run option (so no actual changes are written out). Again, this is still a LOCAL rsync, so if I understood the functionality correctly it does it all as if the '--whole-file' parameter was specified, which is all fine here (since on a local storage it really would not make sense to do just the incremental, unless of course it's some massively huge data file - maybe dbms???). Anyways, once I have this rsync configured correctly I will execute nightly through the CRON/2 deamon process I have installed on my machine.

Now here comes the core of my post: for a complete backup of a full OS2 partition (one that has boot and apps on it) I am seeing three exceptions on my machine, they are:

1) SWAPPER.DAT
Code: [Select]
2020/01/01 00:48:07 [587] [sender] os2getxattr: DosOpenL(./SWAPPER.DAT) failed with error 32 at lib/sysxattrs.c(426)
2020/01/01 00:48:07 [587] rsync: get_xattr_names: llistxattr("g:/./SWAPPER.DAT",1024) failed: Permission denied (13)

2) Mozilla => parent.lock
Code: [Select]
2020/01/01 00:48:36 [587] [sender] os2getxattr: DosOpenL(HOME/mozilla.org/userprofiles/Mozilla/Firefox/Profiles/p5gjgk21.Testing/parent.lock) failed with error 32 at lib/sysxattrs.c(426)
2020/01/01 00:48:36 [587] rsync: get_xattr_names: llistxattr("g:/HOME/mozilla.org/userprofiles/Mozilla/Firefox/Profiles/p5gjgk21.Testing/parent.lock",1024) failed: Permission denied (13)

3) PMMail => mua.mtx
Code: [Select]
2020/01/01 00:49:38 [587] [sender] os2getxattr: DosOpenL(apps/tcpip/PMMail3/Accounts/mua.mtx) failed with error 32 at lib/sysxattrs.c(426)
2020/01/01 00:49:38 [587] rsync: get_xattr_names: llistxattr("g:/apps/tcpip/PMMail3/Accounts/mua.mtx",1024) failed: Permission denied (13)

Therefore, the question I have is: can I skip all of the above files?, or if I should NOT skip them are there RSYNC options to allow me to deal with such a situation (force the archive past the 'Permission denied' error)?

I think SWAPPER.DAT is an easy one, yes, I can skip it. If I ever have to recover from a backup image that will get re-created during boot.

The 'Mozilla => parent.lock' is most likely due to FF being up and running, which is going to be the situation, so I can not avoid this. Likewise, the 'PMMail => mua.mtx' is a semaphore I think, it is always present as long as PMMail is up and running, so that one I can not avoid as well.

As always, appreciate any and all feedback you can provide! Thanks...

707
Article Discussions / Re: Community Ideas BrainStorm for 2020
« on: January 01, 2020, 04:23:42 pm »
Martin, everyone...: Happy New Year to all!

Hmm, excellent question you pose. Here are a few wishes I have (some of this I've voiced in the past as well):

1) Development
- can we pick-up from where EDM/2 left-off?
- I know some effort has been made, but does anyone today really know "who knows what" (from a technical/dev perspective) on our platform?
- Yes, there are a couple of core groups (BWW and AN), but who does what, who knows what?
- Along with this really comes the notion of "can anyone build/write-up instructions to create a robust OS/2 development environment?" we can all use?

2) RPM
- it feels like we would do ourselves a favour by migrating as much of what we currently have to RPMs, so is there a way for all of us to engage in the RPM-Migration effort?
- if this is doable, how do we support that effort with the right platform? I'm thinking an actual central repository of OS2World activities, say os2world-rel & os2world-exp? These should not double up on what's already being done elsewhere, instead these should be anciliary

3) Testing
- a bit of a follow-up to the RPM above, but if you take a look at everything that's sitting out there on netlabs-exp right now you've got a list of about 15 packages I think...many of them have been in the netlabs-exp repo for quite some time...so is that b/c the testing is slow to move these to -rel?
- perhaps we could help with the testing efforts?
- right now I (personally) have absolutely ZERO idea how the current team does the testing and what actually causes a package to be pushed from -exp to -rel status
- this is a lot of manual effort, which means body count matters, and that's precisely where we could all help

-Dariusz

EDIT
====
From a "who done it an how" perspective I'd be happy to sign-up for a "How to configure RSYNC" article. I am currently going through this on my machine, both LOCAL and NETWORKED runs, so I think I should be able to pull some stuff together. Do we just toss this out into OS2World Wiki => HowTo pages (https://www.os2world.com/wiki/index.php/Category:How_To)?

708
Setup & Installation / Re: Late Christmas Present - my new video
« on: December 30, 2019, 12:26:17 am »
Nice complication Sigurd!

709
Internet / Re: FF trap in Web Developer => Network function...
« on: December 27, 2019, 10:46:23 pm »
Dave!

...should be at the same level as my last releases (might have screwed up the readme slightly). The XQS files are just built from the map files using a script Rich wrote some years back, the problem was in package-manifest.in, which lists what gets packaged.

I'm curious about something. This release had all the other DLLs iincluded. I had assumed this was the case since they were built using the same AMD family optimizations.

OK, so since I did not want to leave all these DLLs in the Firefox program directory I moved them out to \usr\local\lib. For FF purposes that was OK (\usr\local\lib is the 1st directory in my LIBPATH), however, things like ANPM fail, specifically that one complains of being unable to load the NSS library:

Code: [Select]
Executing: @python G:\UTIL\ANPM\scripts\yum_populate.py
error: Failed to initialize NSS library
Traceback (most recent call last):
  File "G:\UTIL\ANPM\scripts\yum_populate.py", line 6, in <module>
    import yum
  File "/@unixroot/usr/lib/python2.7/site-packages/yum/__init__.py", line 23, in <module>
    import rpm
  File "/@unixroot/usr/lib/python2.7/site-packages/rpm/__init__.py", line 39, in <module>
    from rpm.transaction import *
  File "/@unixroot/usr/lib/python2.7/site-packages/rpm/transaction.py", line 5, in <module>
    from rpm._rpm import ts as TransactionSetCore
ImportError: cannot import name ts
Return code: 0

Therefore, I moved the DLLs back into FF directory to avoid impacting the remainder of the system. This works so far, but begs the question of: do I not run into DLL conflicts now?

So FF will use it's own DLLs, but when things like ANPM run they will load them from the \usr\lib path, which is where they should be.

Now, maybe all this is a bit of a moot point, and maybe you built stuff like NSS from the latest releases which are currently showing up in netlabs-exp repo, and which i have not installed here?

What do you recommend as the preferred install?

FYI: I did try running just the core FF binaries with the current netlabs-rel DLLs, however that did cause some one-off crashes which i could not explain. So I am making the assumption the stuff in your FF release package must all go together and be used together.

710
Internet / Re: FF trap in Web Developer => Network function...
« on: December 21, 2019, 04:18:49 pm »
Hey Dave!

Seems to be timing related, script calling another while it is loading? I loaded cbc.ca/news about 2 dozen times and reproduced your crash twice. It's a big page and takes anywhere between 25 seconds and 210 seconds to load here and it only seemed to crash when loading faster then 25 seconds...

Hmm, makes sense, the page actually loads in under 10 sec here, so probably a combination of the hardware (although not exactly any sort of blazing speed by today's standards lol) and the network speed (due to the 1Gig Fibre hookup).

Anyways, alright sir, thank you! I appreciate the time you spent to take a peek at this.

On another note, should I keep this version of FF as production-ready code? I am not sure what's involved in getting the additional debug info baked-in, but I wanted to utilize the fixes you put out in your last i686 and Pentim-M releases, and now that you built the Phenom version should I keep it?

711
Internet / Re: FF trap in Web Developer => Network function...
« on: December 20, 2019, 10:52:22 pm »
Dave,
Same crash, which I think is good b/c now we have the additional information that was previously missing, please see attached file.

FYI, I went through the process of trying these captures one-by-one (as per my previous post), all resulted in a crash...so I'm thinking it's something at the back-end?

712
Internet / Re: FF trap in Web Developer => Network function...
« on: December 18, 2019, 05:14:14 am »
Thanks Dave...will put it through the paces next!

713
Internet / Re: FF trap in Web Developer => Network function...
« on: December 17, 2019, 08:25:34 pm »
Hey Dave!

...Guess I could rebuild it if you want to post the optimize arguments I used, they'll be under about:buildconfig...

Ohhh...like you didn't know I'be be all over that in a blink...LOL!

Here they are, and big Thank You!

Code: [Select]
about:buildconfig
Build platform
target
i386-pc-os2-emx
Build tools
Compiler Version Compiler flags
gcc.exe 5.5.0 -Wall -Wempty-body -Wpointer-to-int-cast -Wsign-compare -Wtype-limits -Wno-unused -Wcast-align -Zomf -std=gnu99 -fgnu89-inline -fno-strict-aliasing -Zomf -fno-math-errno -pthread
c++ 5.5.0 -idirafter g:/OS2TK45/h -Wall -Wempty-body -Woverloaded-virtual -Wsign-compare -Wwrite-strings -Wno-invalid-offsetof -Wcast-align -fno-exceptions -fno-strict-aliasing -Zomf -fno-rtti -fno-exceptions -fno-math-errno -std=gnu++0x -pthread -DNDEBUG -DTRIMMED -g -march=amdfam10 -O2 -fomit-frame-pointer
Configure arguments

--enable-application=browser '--enable-optimize=-mtune=generic -march=pentium-m -O2' '--enable-optimize=-march=amdfam10 -O2' --disable-debug --enable-debug-symbols --disable-tests --enable-os2-high-mem --without-x --enable-system-cairo --enable-system-pixman --with-intl-api --with-system-icu --with-system-zlib --with-system-nss --with-system-nspr --with-system-libvpx --disable-startupcache

Not sure how complex of an undertaking this is, but can you also include the fixes you published for the i686 and pentium4 builds a month ago (or thereabouts)?

In the meantime I'm going to try to separate out the trap to one of the elements in that capture, by default I'm picking up 'All, but that's a combination of:HTML, CSS, JS, HXR, Fonts, Images, Media, Flash & Other. Maybe it's just one of these that's the contributing factor to the crash?

714
Internet / FF trap in Web Developer => Network function...
« on: December 17, 2019, 07:05:16 pm »
FF 45.9, AMD Phenom build that Dave did a while back here.

For years I was running my FF configuration utilizing options that attempted to balance the page renderning speed given the available connection throughput. Well, I moved to Fibre about a year ago and other than a couple of small tweaks I didn't spend much time changing the previous configuration.

Well, having some spare time on my hands at the moment I decided to revisit this (I will do another post on this subject since the results I'm seeing here are very encouraging).

I have been using the 'Web Developer => Network' function to assess the impact various config:about changes have. Specifically how long do various connections take, what's coming out of cache vs. pure fetch.

This approach has worked very well for numeours destinations, however there is a specific site I use rather heavily that always causes a problem in this process however, that being https://www.cbc.ca/news.

Here is a snippet from the crash report:

Code: [Select]
______________________________________________________________________

 Exception Report - created 2019/12/15 00:47:44
______________________________________________________________________

 OS2/eCS Version:  2.45
 # of Processors:  5
 Physical Memory:  3327 mb
 Virt Addr Limit:  2560 mb
 Exceptq Version:  7.11.3-shl (Jul  5 2016)

______________________________________________________________________

 Exception C0000005 - Access Violation
______________________________________________________________________

 Process:  G:\APPS\TCPIP\FIREFOX\FIREFOX.EXE (12/28/2018 21:29:16 279,712)
 PID:      12B (299)
 TID:      01 (1)
 Slot:     BA (186)
 Priority: 200

 Module:   XUL
 Filename: G:\APPS\TCPIP\FIREFOX\XUL.DLL (12/28/2018 21:41:21 36,967,630)
 Address:  005B:9B46ECFF (0001:032EECFF)
 Cause:    Attempted to read from 000000A8
           (not a valid address)

______________________________________________________________________

 Failing Instruction
______________________________________________________________________

 9B46ECE4  SUB ESP, 0x1ec            (81ec ec010000)
 9B46ECEA  MOV ESI, [ESP+0x200]      (8bb424 00020000)
 9B46ECF1  MOV EBX, [ESP+0x204]      (8b9c24 04020000)
 9B46ECF8  MOV EDI, [ESP+0x208]      (8bbc24 08020000)
 9B46ECFF >CMP BYTE [ESI+0x38], 0x0  (807e 38 00)
 9B46ED03  JNZ 0x9b46ed0e            (75 09)
 9B46ED05  CMP BYTE [EBX+0xed], 0x0  (80bb ed000000 00)
 9B46ED0C  JZ  0x9b46ed24            (74 16)

______________________________________________________________________

 Registers
______________________________________________________________________

 EAX : 00000070   EBX  : 2013CD80   ECX : 0019EE7C   EDX  : 00000000
 ESI : 00000070   EDI  : 0019EE7C
 ESP : 0019EC60   EBP  : 0019F0A4   EIP : 9B46ECFF   EFLG : 00210206
 CS  : 005B       CSLIM: FFFFFFFF   SS  : 0053       SSLIM: FFFFFFFF

 EAX : not a valid address
 EBX : read/write memory allocated by LIBCN0
 ECX : read/write memory on this thread's stack
 EDX : not a valid address
 ESI : not a valid address
 EDI : read/write memory on this thread's stack

______________________________________________________________________

 Stack Info for Thread 01
______________________________________________________________________

   Size       Base        ESP         Max         Top
 00100000   001A0000 -> 0019EC60 -> 0011F000 -> 000A0000

______________________________________________________________________

I've attached the full trap file (zipped down to size). Not sure if this trap is readily recognizable, or whether this is one of these "deep in the bowels of the beast" type of a thing... ???

715
Setup & Installation / Re: Partitioning Recommendations
« on: December 14, 2019, 03:19:16 am »
Hi Kev,

Well, I can not provide any hands-on feedback on the proposed layout (all of my stuff is dumped onto a single drive, this is due to historical reasons as my OS/2 install has gone un-reinstalled since literally the days of the original install, as in Warp3).

However, as applicable to the following hardware configuration of 3 storage drives: SSD 250G, HDD1 280G, HDD2 475G, I will say the following:
1) I do have my main OS/2 partition on the SSD drive, that also has a small 55M maintenance pertition, all of this is mirrored on HDD1

2) leftover space on HDD1 is a 'scratch' area...basically storage dumping ground...LOL, stuff I need to toss somewhere that for whatever reason I do not want on my main OS/2 boot drive

3) all of HDD2 is basically a DATA_STORE, meaning things like ISO files, etc.

This is all running JFS, HPFS only exists on a 4G ramdrive (which is the temp space while OS/2 has booted and is running, fast).

If I had to do it all over again, here is what I would do:
1) size up the MAINT partition to give me a runable WPS environment
2) separate the OS partition as per the recommendations you covered
3) build a separate partition that's for programs
4) possibly build a separate partition that's for data

#3 & #4 could go on the same partition, it really depends on how much data movement we are talking about, size of datasets, etc., each configuration will be unqiue.

I use a nifty little utility to build the MAINT partition with, it's called BOOTOS2 and you can find it here => http://hobbes.nmsu.edu/h-viewer.php?dir=/pub/os2/util/system&file=bootos2.zip&backto=%2Fh-search.php%3Fkey%3Dbootos2%26pushbutton%3DSearch.

EDIT
====
Oh...almost forgot, it totally makes sense these days to simply build yourself a bootable USB stick which basically becomes your MAINT partition. I haven't gotten around to doing just that, but that'll probably be my very next project...best to be ready in case the SDD or HDDx take a dump on ya!

716
Applications / Re: WPS - folder refresh failure...
« on: December 08, 2019, 05:27:15 pm »
Well, so a week later I am happy to report that in my case shutting off XWP's Folder Refresh feature has completely addressed the issue I was seeing.

As an added benefit the occasional WPS crashes I was seeing are now also completely gone (that was the trap screen I attached to the previous post).

Anyways, I realize the XWP logic is probably fairly complex - so I'm not just outright knocking the thing - but for what its worth doing away with that feature has resulted in a more stable system here.

717
Applications / Re: WPS - folder refresh failure...
« on: December 01, 2019, 03:00:19 pm »
Hey Doug!

Yes I have seen this - both on folders on a remote machine and folders on local drives. 

My problem was files that I knew to be in a directory were not showing up in WPS.  I have also seen where I drop a folder template on a drive object and the new folder does not appear - even after hitting refresh...

Ahh, good reminder. I had actually responded to your post back then for a slightly different reason, although it may very well be the same reason that's causing me a problem today.

I've had a re-occuring issue with XWP where WPS folders stop populating. In it's most obvious form the WHOLE folder goes blank, nothing shows up and the moment this occurs the whole WPS filesystem object structure is impacted. The only way to fix is to do a Desktop re-start, and if that hangs, well a re-boot is required.

Over the years I have tracked that down to what appears to be the very same crash in XWP. Take a look at the attached capture (all these entries show up in the xwptrap.log file), I shared with Rich Walsh previously (who I believe maintains XWP today). Unfortunately he has not been able to find the root cause.

Anyways, for now given that I suspect the two things I'm seeing here have common root cause I turned OFF XWP's folder refresh option. This means I am relying on the native WPS processing. I hate to say it but so far I haven't ran into a single occurence of either one of the issues I described above. This has only been a couple of days, so far too short of a duration to say this is IT...so more testing is needed.

Oh, btw: I'm seeing this behaviour with ALL file objects, regardless of whether they have EAs or not. In particular the NAS stuff does not have any EAs, b/c the ZyXel box Samba implementation does not support EAs.

718
Applications / WPS - folder refresh failure...
« on: November 29, 2019, 10:48:28 pm »
I'm curious how many of you are running into a situation where the WPS itself does not appear to be showing refreshes of folders?

Let me explain a bit my situation b/c this is a bit more complicated.

My OS/2 box (4.52 SMP) has XWP installed (latest Aug_2019 1.0.13 release). What I am consistently running into is seeing my NAS hosted folders not showing new contents. For example, I have a SYSLOG deamon running on my NAS and collect LOGs from all the PCs on the network on the NAS. On my OS/2 box I have a shadow to the NAS folder where these exist, yet despite the fact that new files are being created in that folder (on the NAS) I often times do not see the matching OS/2 folder refreshes happen. Even if I invoke the 'Refresh Now' option those NEW files never appear.

The NAS is accessed through a Samba share and NetDrive mapping. Yet this is not a samba/netdrive issue (as best as i can tell so far) b/c checking the contents of the NAS folder through CLI clearly shows the NEW files. So at the Samba/netdrive interface level this appears to be fine.

My XWP has the option turned ON to replace the native WPS folder refresh process. As I attempt to track this down I will shut this OFF and monitor.

But back to my original Q: is anyone else seeing something similar to this behaviour?

719
Applications / Re: Gotcha 2.0.0.1
« on: November 28, 2019, 05:53:26 am »
I'm not familiar with Gotcha functionality...but for anyone using that or Embelish or any other apps, why not use PMView?

It has multiple way of doing screen capture...extremely flexible...never let me down in any of my attempts!

720
Networking / Re: OS/2 to Ubuntu: Any options other than Samba?
« on: November 24, 2019, 03:55:51 am »
Hi Ben,

...I would very quickly dump any version of *nix and use OS/2 exclusively if it could handle the two 4Tb drives.

I wonder... is there any hope of that happening? I understand that this is not possible, but, I've heard such things said before. So, I remain  realistically hopeful.[/color]

Have you tried building a logical LVM volume from multiple 2T partitions?

I am not sure if this would work (seeing that JFS is maxed at 2T anyways) but if the issue is a mapping to actual hardware vs logical addressability of the filesystem space then the logical LVM volume approach may work.

Pages: 1 ... 46 47 [48] 49 50 ... 88