bitcoind out of memory

[yancy ribbens]

I'm running 6.8 and trying to run bitcoind (C++), however, I continue to
receive a core dump while running the application (out of memory). The
dmesg file is below.

The application is running as root and I've set datasize-max and
datasize-cur to infinity in the login.conf daemon section as I suspect the
core dump is happening because of an upper memory bound enforced by the OS.

running the application \time -l twice shows the resident set size each
time to be:
662128
650388

I've also observed "top" while running and there is more than 1GB free and
SWAP is not being used at the time it core dumps (out of memory).

Is this a problem with a login.conf parameter or something else?

OpenBSD 6.8 (GENERIC.MP) #440: Sun Oct 4 18:33:20 MDT 2020
***@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC.MP
real mem = 3707572224 (3535MB)
avail mem = 3623641088 (3455MB)
random: good seed from bootblocks
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: date 12/22/09, BIOS32 rev. 0 @ 0xffa10, SMBIOS rev. 2.4
@ 0xf6510 (54 entries)
bios0: vendor Dell Inc. version "A14" date 12/22/2009
bios0: Dell Inc. Latitude E4300
acpi0 at bios0: ACPI 4.0
acpi0: sleep states S0 S3 S4 S5
acpi0: tables DSDT FACP HPET ____ APIC ASF! MCFG TCPA SLIC BOOT SSDT
acpi0: wakeup devices PCI0(S4) PCIE(S4) USB1(S0) USB2(S0) USB3(S0) USB4(S0)
USB5(S0) USB6(S0) EHC2(S0) EHCI(S0) AZAL(S3) RP01(S4) RP02(S4) RP03(S3)
RP04(S3) RP05(S3) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpihpet0 at acpi0: 14318179 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Core(TM)2 Duo CPU P9400 @ 2.40GHz ("GenuineIntel" 686-class)
2.40 GHz, 06-17-06
cpu0:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
mtrr: Pentium Pro MTRR support, 7 var ranges, 88 fixed ranges
cpu0: apic clock running at 265MHz
cpu0: mwait min=64, max=64, C-substates=0.2.2.2.2.1.3, IBE
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Core(TM)2 Duo CPU P9400 @ 2.40GHz ("GenuineIntel" 686-class)
2.40 GHz, 06-17-06
cpu1:
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins, remapped
acpimcfg0 at acpi0
acpimcfg0: addr 0xf8000000, bus 0-63
acpimcfg0: addr 0x0, bus 0-0
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 2 (PCIE)
acpiprt2 at acpi0: bus 11 (RP01)
acpiprt3 at acpi0: bus 12 (RP02)
acpiprt4 at acpi0: bus -1 (RP03)
acpiprt5 at acpi0: bus 13 (RP04)
acpiprt6 at acpi0: bus -1 (RP05)
acpiprt7 at acpi0: bus -1 (RP06)
acpiec0 at acpi0
"PNP0A03" at acpi0 not configured
acpicmos0 at acpi0
acpibtn0 at acpi0: LID_
acpibtn1 at acpi0: PBTN
acpibtn2 at acpi0: SBTN
acpiac0 at acpi0: AC unit online
acpibat0 at acpi0: BAT0 not present
acpibat1 at acpi0: BAT1 not present
"*pnp0c14" at acpi0 not configured
acpicpu0 at acpi0: !C3(***@162 ***@0x50), !C2(***@1 ***@0x10),
C1(***@1 mwait.1), PSS
acpicpu1 at acpi0: !C3(***@162 ***@0x50), !C2(***@1 ***@0x10),
C1(***@1 mwait.1), PSS
acpitz0 at acpi0: critical temperature is 107 degC
acpivideo0 at acpi0: VID_
acpivout0 at acpivideo0: LCD_
acpivideo1 at acpi0: VID2
bios0: ROM list: 0xc0000/0xf800! 0xcf800/0x800
cpu0: Enhanced SpeedStep 2394 MHz: speeds: 2401, 2400, 1600, 800 MHz
pci0 at mainbus0 bus 0: configuration mode 1 (no bios)
pchb0 at pci0 dev 0 function 0 "Intel GM45 Host" rev 0x07
inteldrm0 at pci0 dev 2 function 0 "Intel GM45 Video" rev 0x07
drm0 at inteldrm0
intagp0 at inteldrm0
agp0 at intagp0: aperture at 0xe0000000, size 0x10000000
inteldrm0: apic 2 int 16, GM45, gen 4
"Intel GM45 Video" rev 0x07 at pci0 dev 2 function 1 not configured
em0 at pci0 dev 25 function 0 "Intel ICH9 IGP M AMT" rev 0x03: msi, address
00:24:e8:a8:ee:60
uhci0 at pci0 dev 26 function 0 "Intel 82801I USB" rev 0x03: apic 2 int 20
uhci1 at pci0 dev 26 function 1 "Intel 82801I USB" rev 0x03: apic 2 int 21
uhci2 at pci0 dev 26 function 2 "Intel 82801I USB" rev 0x03: apic 2 int 22
ehci0 at pci0 dev 26 function 7 "Intel 82801I USB" rev 0x03: apic 2 int 22
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
azalia0 at pci0 dev 27 function 0 "Intel 82801I HD Audio" rev 0x03: msi
azalia0: codecs: IDT 92HD71B7, Intel/0x2802, using IDT 92HD71B7
audio0 at azalia0
ppb0 at pci0 dev 28 function 0 "Intel 82801I PCIE" rev 0x03: apic 2 int 16
pci1 at ppb0 bus 11
ppb1 at pci0 dev 28 function 1 "Intel 82801I PCIE" rev 0x03: apic 2 int 17
pci2 at ppb1 bus 12
iwn0 at pci2 dev 0 function 0 "Intel WiFi Link 5300" rev 0x00: msi, MIMO
3T3R, MoW, address 00:21:6a:2d:87:7c
ppb2 at pci0 dev 28 function 3 "Intel 82801I PCIE" rev 0x03: apic 2 int 19
pci3 at ppb2 bus 13
uhci3 at pci0 dev 29 function 0 "Intel 82801I USB" rev 0x03: apic 2 int 20
uhci4 at pci0 dev 29 function 1 "Intel 82801I USB" rev 0x03: apic 2 int 21
uhci5 at pci0 dev 29 function 2 "Intel 82801I USB" rev 0x03: apic 2 int 22
ehci1 at pci0 dev 29 function 7 "Intel 82801I USB" rev 0x03: apic 2 int 20
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
ppb3 at pci0 dev 30 function 0 "Intel 82801BAM Hub-to-PCI" rev 0x93
pci4 at ppb3 bus 2
"Ricoh 5C832 Firewire" rev 0x05 at pci4 dev 1 function 0 not configured
sdhc0 at pci4 dev 1 function 1 "Ricoh 5C822 SD/MMC" rev 0x22: apic 2 int 18
sdhc0: SDHC 1.0, 33 MHz base clock
sdmmc0 at sdhc0: 4-bit, sd high-speed, mmc high-speed
"Ricoh 5C843 MMC" rev 0x12 at pci4 dev 1 function 2 not configured
pcib0 at pci0 dev 31 function 0 "Intel 82801IEM LPC" rev 0x03
pciide0 at pci0 dev 31 function 2 "Intel 82801I SATA" rev 0x03: DMA,
channel 0 configured to native-PCI, channel 1 configured to native-PCI
pciide0: using apic 2 int 19 for native-PCI interrupt
wd0 at pciide0 channel 0 drive 0: <ST500LX003-1AC15G>
wd0: 16-sector PIO, LBA48, 476940MB, 976773168 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 6
atapiscsi0 at pciide0 channel 1 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <TSSTcorp, DVD+-RW TS-U633A, D200> removable
cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 5
ichiic0 at pci0 dev 31 function 3 "Intel 82801I SMBus" rev 0x03: apic 2 int
17
iic0 at ichiic0
sdtemp0 at iic0 addr 0x1a: mcp98242
spdmem0 at iic0 addr 0x50: 2GB DDR3 SDRAM PC3-8500 SO-DIMM
spdmem1 at iic0 addr 0x52: 2GB DDR3 SDRAM PC3-8500 SO-DIMM
pciide1 at pci0 dev 31 function 5 "Intel 82801I SATA" rev 0x03: DMA,
channel 0 wired to native-PCI, channel 1 wired to native-PCI
pciide1: using apic 2 int 19 for native-PCI interrupt
usb2 at uhci0: USB revision 1.0
uhub2 at usb2 configuration 1 interface 0 "Intel UHCI root hub" rev
1.00/1.00 addr 1
usb3 at uhci1: USB revision 1.0
uhub3 at usb3 configuration 1 interface 0 "Intel UHCI root hub" rev
1.00/1.00 addr 1
usb4 at uhci2: USB revision 1.0
uhub4 at usb4 configuration 1 interface 0 "Intel UHCI root hub" rev
1.00/1.00 addr 1
usb5 at uhci3: USB revision 1.0
uhub5 at usb5 configuration 1 interface 0 "Intel UHCI root hub" rev
1.00/1.00 addr 1
usb6 at uhci4: USB revision 1.0
uhub6 at usb6 configuration 1 interface 0 "Intel UHCI root hub" rev
1.00/1.00 addr 1
usb7 at uhci5: USB revision 1.0
uhub7 at usb7 configuration 1 interface 0 "Intel UHCI root hub" rev
1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard
pms0 at pckbc0 (aux slot)
wsmouse0 at pms0 mux 0
pms0: ALPS Dualpoint, version 0x6222
wsmouse1 at pms0 mux 0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
ugen0 at uhub4 port 1 "Broadcom Corp 5880" rev 1.10/1.01 addr 2
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
root on wd0a (0354f4736990a258.a) swap on wd0b dump on wd0b
inteldrm0: 1280x800, 32bpp
wsdisplay0 at inteldrm0 mux 1: console (std, vt100 emulation), using wskbd0
wsdisplay0: screen 1-5 added (std, vt100 emulation)

Cheers,
-Yancy

[Stuart Henderson]

Post by yancy ribbens
I'm running 6.8 and trying to run bitcoind (C++), however, I continue to
receive a core dump while running the application (out of memory). The
dmesg file is below.

Always surprises me when people are willing to run things like that as root..

Post by yancy ribbens
The application is running as root and I've set datasize-max and
datasize-cur to infinity in the login.conf daemon section as I suspect the
core dump is happening because of an upper memory bound enforced by the OS.

Did you logout and back in between updating login.conf and retrying?
(Needs to be a full logout; if you use an ssh persistent connection that
will need to be closed; if you use X that needs to be restarted).
Check what ulimit -a says.

Post by yancy ribbens
running the application \time -l twice shows the resident set size each
662128
650388
I've also observed "top" while running and there is more than 1GB free and
SWAP is not being used at the time it core dumps (out of memory).

If it requests an allocation which fails, that memory won't be "used" to
show up in top / time -l.

Post by yancy ribbens
Is this a problem with a login.conf parameter or something else?
OpenBSD 6.8 (GENERIC.MP) #440: Sun Oct 4 18:33:20 MDT 2020

...

Post by yancy ribbens
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN

LONG in the cpu capabilities line means that the hardware can usually run
amd64. That would give you a few hundred MB more physical memory, and much
more available memory address space (and a lot of software is only really
tested on 64-bit archs these days anyway..) So you might possibly like
to try that.

[yancy ribbens]

Post by Stuart Henderson
Always surprises me when people are willing to run things like that as root..

This is a single purpose system so I'm not worried about collateral damage,
although I agree it's best practice to use a limited account for usrland
applications. I had thought it would be experimentally easier to try this
using root.

Did you logout and back in between updating login.conf and retrying?

Post by Stuart Henderson
(Needs to be a full logout; if you use an ssh persistent connection that
will need to be closed; if you use X that needs to be restarted).
Check what ulimit -a says.

Yes, I tried a full logoug and also running "cap_mkdb /etc/login.conf"
after updating.

Post by Stuart Henderson
LONG in the cpu capabilities line means that the hardware can usually run
amd64. That would give you a few hundred MB more physical memory, and much
more available memory address space (and a lot of software is only really
tested on 64-bit archs these days anyway..) So you might possibly like
to try that.

Thanks, I overlooked this and thought it was a 32bit machine. After
installing amd64 and running bitcoind under a limited user account, It's
been working perfectly out of the box without any system modifications.

Cheers,
-Yancy

Post by Stuart Henderson

Post by yancy ribbens
I'm running 6.8 and trying to run bitcoind (C++), however, I continue to
receive a core dump while running the application (out of memory). The
dmesg file is below.

Always surprises me when people are willing to run things like that as root..

Post by yancy ribbens
The application is running as root and I've set datasize-max and
datasize-cur to infinity in the login.conf daemon section as I suspect

the

Post by yancy ribbens
core dump is happening because of an upper memory bound enforced by the

OS.
Did you logout and back in between updating login.conf and retrying?
(Needs to be a full logout; if you use an ssh persistent connection that
will need to be closed; if you use X that needs to be restarted).
Check what ulimit -a says.

Post by yancy ribbens
running the application \time -l twice shows the resident set size each
662128
650388
I've also observed "top" while running and there is more than 1GB free

and

Post by yancy ribbens
SWAP is not being used at the time it core dumps (out of memory).

If it requests an allocation which fails, that memory won't be "used" to
show up in top / time -l.

Post by yancy ribbens
Is this a problem with a login.conf parameter or something else?
OpenBSD 6.8 (GENERIC.MP) #440: Sun Oct 4 18:33:20 MDT 2020

...
FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
LONG in the cpu capabilities line means that the hardware can usually run
amd64. That would give you a few hundred MB more physical memory, and much
more available memory address space (and a lot of software is only really
tested on 64-bit archs these days anyway..) So you might possibly like
to try that.