OTOH, building a Phenom II (-march=amdfam10) succeeds. Previously when building the AVX Firefox, packaging failed while creating startup.cache. I thought due to a sigill but never actually checked. Well, the AMD build's packaging also failed, after re-enabling the startup.cache, so I figured swap in a working xpcshell.exe. Still failed. Seems to actually run out of memory.
make[3]: Entering directory `Y:/work/cc45-git/mozilla/obj-fb/browser/installer'
OMNIJAR_NAME=omni.ja \
NO_PKG_FILES="core bsdecho js js-config jscpucfg nsinstall viewer TestGtkEmbed elf-dynstr-gc mangle* maptsv* mfc* msdump* msmap* nm2tsv* nsinstall* res/samples res/throbber shlibsign* certutil* pk12util* BadCertServer* OCSPStaplingServer* GenerateOCSPResponse* chrome/chrome.rdf chrome/app-chrome.manifest chrome/overlayinfo components/compreg.dat components/xpti.dat content_unit_tests necko_unit_tests *.dSYM " \
Y:/work/cc45-git/mozilla/obj-fb/_virtualenv/bin/python Y:/work/cc45-git/mozilla/toolkit/mozapps/installer/packager.py -DMOZ_APP_NAME=firefox -DPREF_DIR=defaults/preferences -DMOZ_NATIVE_NSPR=1 -DMOZ_NATIVE_NSS=1 -DJAREXT= -DMOZ_CHILD_PROCESS_NAME=plugin-container.exe -DDLL_PREFIX= -DDLL_SUFFIX=.dll -DBIN_SUFFIX=.exe -DDIR_MACOS= -DDIR_RESOURCES= -DBINPATH=bin -DRESPATH=bin -DLPROJ_ROOT=en -DMOZ_ICU_VERSION=56 -DMOZ_NATIVE_ICU -DMOZ_SHARED_ICU -DMOZ_ICU_DBG_SUFFIX= -DX_DISPLAY_MISSING=1 -DMOZ_ENABLE_PROFILER_SPS=1 -DMOZILLA_VERSION='"45.9.0"' -DMOZILLA_VERSION_U=45.9.0 -DMOZILLA_UAVERSION='"45.0"' -DOS2=1 -DXP_OS2=1 -DOS2EMX_PLAIN_CHAR=1 -DMOZ_OS2_HIGH_MEMORY=1 -DD_INO=d_ino -DMOZ_DEBUG_SYMBOLS=1 -DSTDC_HEADERS=1 -DHAVE_DIRENT_H=1 -DHAVE_GETOPT_H=1 -DHAVE_SYS_BITYPES_H=1 -DHAVE_MEMORY_H=1 -DHAVE_UNISTD_H=1 -DHAVE_NL_TYPES_H=1 -DHAVE_MALLOC_H=1 -DHAVE_IO_H=1 -DHAVE_CPUID_H=1 -DHAVE_SYS_QUEUE_H=1 -DHAVE_SYS_TYPES_H=1 -DHAVE_NETINET_IN_H=1 -DHAVE_SIN_LEN=1 -DHAVE_SCONN_LEN=1 -DHAVE_SA_LEN=1 -DHAVE_LIBCX=1 -DNO_X11=1 -DHAVE_PTHREAD_H=1 -DHAVE_GMTIME_R=1 -DHAVE_LOCALTIME_R=1 -DHAVE_ARC4RANDOM=1 -DHAVE_CLOCK_MONOTONIC=1 -DHAVE_LANGINFO_CODESET=1 -DVA_COPY=va_copy -DHAVE_VA_COPY=1 -DHAVE_THREAD_TLS_KEYWORD=1 -DHAVE_I18N_LC_MESSAGES=1 -DHAVE_LOCALECONV=1 -DMALLOC_H='<malloc.h>' -DHAVE_ALLOCA_H=1 -DHAVE_STRNDUP=1 -DHAVE_POSIX_MEMALIGN=1 -DHAVE_MEMALIGN=1 -DHAVE_MALLOC_H=1 -DMALLOC_USABLE_SIZE_CONST_PTR=const -DHAVE_VALLOC=1 -DHAVE_VALLOC=1 -DTARGET_XPCOM_ABI='"x86-gcc3"' -DRELEASE_BUILD=1 -DMOZ_UPDATE_CHANNEL=default -DMOZ_PHOENIX=1 -DMOZ_BUILD_APP=browser -DMOZ_PDF_PRINTING=1 -DNS_PRINTING=1 -DNS_PRINT_PREVIEW=1 -DMOZ_OFFICIAL_BRANDING=1 -DMOZ_DISTRIBUTION_ID='"org.mozilla"' -DACCESSIBILITY=1 -DMOZ_SAMPLE_TYPE_FLOAT32=1 -DMOZ_WEBSPEECH=1 -DMOZ_WEBSPEECH_TEST_BACKEND=1 -DATTRIBUTE_ALIGNED_MAX=16 -DMOZ_WEBM=1 -DMOZ_FFMPEG=1 -DMOZ_FMP4=1 -DMOZ_EME=1 -DMOZ_MEDIA_NAVIGATOR=1 -DMOZ_LIBKAI=1 -DMOZ_VPX=1 -DHAVE_LIBVPX=1 -DMOZ_VPX_NO_MEM_REPORTING=1 -DMOZ_WAVE=1 -DMOZ_VORBIS=1 -DMOZ_WEBM_ENCODER=1 -DMOZ_PERMISSIONS=1 -DENABLE_SYSTEM_EXTENSION_DIRS=1 -DMOZ_WEBGL_CONFORMANT=1 -DMOZ_CRASHREPORTER_ENABLE_PERCENT=100 -DMOZ_ENABLE_SIGNMAR=1 -DMOZ_FEEDS=1 -DMOZ_SAFE_BROWSING=1 -DMOZ_URL_CLASSIFIER=1 -DGL_PROVIDER_=1 -DMOZ_STACKWALKING=1 -DMOZ_LOGGING=1 -DFORCE_PR_LOG=1 -DMOZ_PAY=1 -DMOZ_ACTIVITIES=1 -DMOZ_SECUREELEMENT=1 -DHAVE___CXA_DEMANGLE=1 -DHAVE__UNWIND_BACKTRACE=1 -DJS_DEFAULT_JITREPORT_GRANULARITY=3 -DMOZ_OMNIJAR=1 -DMOZ_USER_DIR='"Mozilla"' -DHAVE_FT_BITMAP_SIZE_Y_PPEM=1 -DHAVE_FT_GLYPHSLOT_EMBOLDEN=1 -DHAVE_FT_LOAD_SFNT_TABLE=1 -DHAVE_FONTCONFIG_FCFREETYPE_H=1 -DHAVE_STDINT_H=1 -DHAVE_INTTYPES_H=1 -DMOZ_XUL=1 -DMOZ_PROFILELOCKING=1 -DENABLE_MARIONETTE=1 -DBUILD_CTYPES=1 -DMOZ_PLACES=1 -DMOZ_SOCIAL=1 -DMOZ_SERVICES_COMMON=1 -DMOZ_SERVICES_CRYPTO=1 -DMOZ_SERVICES_HEALTHREPORT=1 -DMOZ_SERVICES_METRICS=1 -DMOZ_SERVICES_SYNC=1 -DMOZ_SERVICES_CLOUDSYNC=1 -DMOZ_JSDOWNLOADS=1 -DMOZ_MACBUNDLE_ID=org.mozilla.firefox -DMOZ_B2G_VERSION='"1.0.0"' -DMOZ_B2G_OS_NAME='""' -DMOZ_APP_UA_NAME='""' -DMOZ_APP_UA_VERSION='"45.9.0"' -DFIREFOX_VERSION=45.9.0 -DMOZILLA_OFFICIAL=1 -DMOZ_TELEMETRY_DISPLAY_REV=2 -DMOZ_DATA_REPORTING=1 -DMOZ_DLL_SUFFIX='".dll"' -DA11Y_LOG=1 -DEXPOSE_INTL_API=1 -DENABLE_INTL_API=1 -DMOZ_STATIC_JS=1 -DNO_NSPR_10_SUPPORT=1 -DAB_CD=en-US \
--format omni \
--removals Y:/work/cc45-git/mozilla/browser/installer/removed-files.in \
\
\
\
\
--optimizejars \
\
Y:/work/cc45-git/mozilla/browser/installer/package-manifest.in ../../dist ../../dist/firefox \
Executing Y:/work/cc45-git/mozilla/obj-fb/dist/bin/xpcshell.exe -g Y:/work/cc45-git/mozilla/obj-fb/dist/bin/ -a Y:/work/cc45-git/mozilla/obj-fb/dist/bin/ -f Y:/work/cc45-git/mozilla/toolkit/mozapps/installer/precompile_cache.js -e precompile_startupcache("resource://gre/");
out of memory: 0x0000000020000000 bytes requested
Creating 00EC_01.TRP
With the trp showing a INT 3 triggered by the OOM handler.
I'll rerun the build with the startup.cache disabled, then, since I seemed to have forgot to renable it, try a Pentium M build and see if it does the OOM thing. SM has always had the startup.cache enabled.