[Tile-serving] [osm2pgsql] Import 'Killed' twice now while 'Going over pending ways...' (#218)
Michael Prentice
notifications at github.com
Mon Dec 1 18:54:46 UTC 2014
```
Nov 25 06:43:19 dream-map-server kernel: [1267106.883922] perf samples too long (286030 > 250000), lowering kernel.perf_event_max_sample_rate to 500
Nov 25 06:43:19 dream-map-server kernel: [1267106.883922] INFO: NMI handler (perf_event_nmi_handler) took too long to run: 125.887 msecs
Nov 25 06:50:45 dream-map-server kernel: [1267552.973070] postgres invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
Nov 25 06:50:45 dream-map-server kernel: [1267552.976009] postgres cpuset=/ mems_allowed=0
Nov 25 06:50:45 dream-map-server kernel: [1267552.988014] CPU: 6 PID: 22085 Comm: postgres Not tainted 3.13.0-36-generic #63-Ubuntu
Nov 25 06:50:45 dream-map-server kernel: [1267552.992874] Hardware name: OpenStack Foundation OpenStack Nova, BIOS Bochs 01/01/2011
Nov 25 06:50:45 dream-map-server kernel: [1267552.992884] 0000000000000000 ffff8800a68bf968 ffffffff8171e569 ffff8805958eb000
Nov 25 06:50:45 dream-map-server kernel: [1267552.992900] ffff8800a68bf9f0 ffffffff81718e24 0000000000000001 ffffffff81c3f860
Nov 25 06:50:45 dream-map-server kernel: [1267552.992902] ffff8805da6d7500 0000000000000015 0000000000000000 ffffffff81c3f860
Nov 25 06:50:45 dream-map-server kernel: [1267552.992905] Call Trace:
Nov 25 06:50:45 dream-map-server kernel: [1267552.997186] [<ffffffff8171e569>] dump_stack+0x45/0x56
Nov 25 06:50:45 dream-map-server kernel: [1267552.997190] [<ffffffff81718e24>] dump_header+0x7f/0x1f1
Nov 25 06:50:45 dream-map-server kernel: [1267552.997193] [<ffffffff81151ebe>] oom_kill_process+0x1ce/0x330
Nov 25 06:50:45 dream-map-server kernel: [1267552.997199] [<ffffffff812d4815>] ? security_capable_noaudit+0x15/0x20
Nov 25 06:50:45 dream-map-server kernel: [1267552.997201] [<ffffffff811525f4>] out_of_memory+0x414/0x450
Nov 25 06:50:45 dream-map-server kernel: [1267552.997204] [<ffffffff8115896c>] __alloc_pages_nodemask+0xa5c/0xb80
Nov 25 06:50:45 dream-map-server kernel: [1267552.997207] [<ffffffff81196d73>] alloc_pages_current+0xa3/0x160
Nov 25 06:50:45 dream-map-server kernel: [1267552.997210] [<ffffffff8114eab7>] __page_cache_alloc+0x97/0xc0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997212] [<ffffffff811504c5>] filemap_fault+0x185/0x410
Nov 25 06:50:45 dream-map-server kernel: [1267552.997215] [<ffffffff8117513f>] __do_fault+0x6f/0x530
Nov 25 06:50:45 dream-map-server kernel: [1267552.997217] [<ffffffff811792e2>] handle_mm_fault+0x482/0xf00
Nov 25 06:50:45 dream-map-server kernel: [1267552.997220] [<ffffffff811d7fdf>] ? touch_atime+0x10f/0x140
Nov 25 06:50:45 dream-map-server kernel: [1267552.997222] [<ffffffff81150f98>] ? generic_file_aio_read+0x598/0x700
Nov 25 06:50:45 dream-map-server kernel: [1267552.997225] [<ffffffff8172a524>] __do_page_fault+0x184/0x560
Nov 25 06:50:45 dream-map-server kernel: [1267552.997229] [<ffffffff8136687b>] ? radix_tree_lookup+0xb/0x10
Nov 25 06:50:45 dream-map-server kernel: [1267552.997231] [<ffffffff8115ace3>] ? __do_page_cache_readahead+0xc3/0x260
Nov 25 06:50:45 dream-map-server kernel: [1267552.997233] [<ffffffff8172a91a>] do_page_fault+0x1a/0x70
Nov 25 06:50:45 dream-map-server kernel: [1267552.997235] [<ffffffff81729f99>] do_async_page_fault+0x29/0xe0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997244] [<ffffffff81726db8>] async_page_fault+0x28/0x30
Nov 25 06:50:45 dream-map-server kernel: [1267552.997248] Mem-Info:
Nov 25 06:50:45 dream-map-server kernel: [1267552.997251] Node 0 DMA per-cpu:
Nov 25 06:50:45 dream-map-server kernel: [1267552.997253] CPU 0: hi: 0, btch: 1 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997255] CPU 1: hi: 0, btch: 1 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997256] CPU 2: hi: 0, btch: 1 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997256] CPU 3: hi: 0, btch: 1 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997257] CPU 4: hi: 0, btch: 1 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997258] CPU 5: hi: 0, btch: 1 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997259] CPU 6: hi: 0, btch: 1 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997260] CPU 7: hi: 0, btch: 1 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997261] Node 0 DMA32 per-cpu:
Nov 25 06:50:45 dream-map-server kernel: [1267552.997263] CPU 0: hi: 186, btch: 31 usd: 45
Nov 25 06:50:45 dream-map-server kernel: [1267552.997264] CPU 1: hi: 186, btch: 31 usd: 24
Nov 25 06:50:45 dream-map-server kernel: [1267552.997264] CPU 2: hi: 186, btch: 31 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997265] CPU 3: hi: 186, btch: 31 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997266] CPU 4: hi: 186, btch: 31 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997267] CPU 5: hi: 186, btch: 31 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997268] CPU 6: hi: 186, btch: 31 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997269] CPU 7: hi: 186, btch: 31 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997270] Node 0 Normal per-cpu:
Nov 25 06:50:45 dream-map-server kernel: [1267552.997271] CPU 0: hi: 186, btch: 31 usd: 185
Nov 25 06:50:45 dream-map-server kernel: [1267552.997272] CPU 1: hi: 186, btch: 31 usd: 67
Nov 25 06:50:45 dream-map-server kernel: [1267552.997273] CPU 2: hi: 186, btch: 31 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997274] CPU 3: hi: 186, btch: 31 usd: 33
Nov 25 06:50:45 dream-map-server kernel: [1267552.997275] CPU 4: hi: 186, btch: 31 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997276] CPU 5: hi: 186, btch: 31 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997277] CPU 6: hi: 186, btch: 31 usd: 13
Nov 25 06:50:45 dream-map-server kernel: [1267552.997278] CPU 7: hi: 186, btch: 31 usd: 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997281] active_anon:5397278 inactive_anon:520093 isolated_anon:0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997281] active_file:55 inactive_file:2 isolated_file:0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997281] unevictable:0 dirty:6 writeback:0 unstable:0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997281] free:40805 slab_reclaimable:5637 slab_unreclaimable:6704
Nov 25 06:50:45 dream-map-server kernel: [1267552.997281] mapped:35337 shmem:35250 pagetables:14219 bounce:0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997281] free_cma:0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997283] Node 0 DMA free:15908kB min:44kB low:52kB high:64kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_fi
le:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15992kB managed:15908kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB
slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Nov 25 06:50:45 dream-map-server kernel: [1267552.997289] lowmem_reserve[]: 0 3488 23526 23526
Nov 25 06:50:45 dream-map-server kernel: [1267552.997291] Node 0 DMA32 free:89976kB min:10012kB low:12512kB high:15016kB active_anon:2860540kB inactive_anon:609996kB activ
e_file:4kB inactive_file:28kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3653620kB managed:3574644kB mlocked:0kB dirty:0kB writeback:0kB mapped:20644kB
shmem:20640kB slab_reclaimable:3452kB slab_unreclaimable:3364kB kernel_stack:248kB pagetables:5324kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:3
50 all_unreclaimable? yes
Nov 25 06:50:45 dream-map-server kernel: [1267552.997295] lowmem_reserve[]: 0 0 20038 20038
Nov 25 06:50:45 dream-map-server kernel: [1267552.997297] Node 0 Normal free:57336kB min:57524kB low:71904kB high:86284kB active_anon:18728572kB inactive_anon:1470376kB ac
tive_file:216kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:20905984kB managed:20519248kB mlocked:0kB dirty:24kB writeback:0kB mapped:1
20704kB shmem:120360kB slab_reclaimable:19096kB slab_unreclaimable:23452kB kernel_stack:1472kB pagetables:51552kB unstable:0kB bounce:0kB free_cma:0kB writeback_tmp:0kB pa
ges_scanned:1573 all_unreclaimable? yes
Nov 25 06:50:45 dream-map-server kernel: [1267552.997300] lowmem_reserve[]: 0 0 0 0
Nov 25 06:50:45 dream-map-server kernel: [1267552.997302] Node 0 DMA: 1*4kB (U) 0*8kB 0*16kB 1*32kB (U) 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (R
) 3*4096kB (M) = 15908kB
Nov 25 06:50:45 dream-map-server kernel: [1267552.997318] Node 0 DMA32: 129*4kB (UEM) 123*8kB (UEM) 161*16kB (UEM) 145*32kB (UEM) 112*64kB (UEM) 85*128kB (UE) 60*256kB (UE
) 46*512kB (UEM) 20*1024kB (EM) 2*2048kB (E) 0*4096kB = 90252kB
Nov 25 06:50:45 dream-map-server kernel: [1267552.997326] Node 0 Normal: 14421*4kB (UE) 0*8kB 0*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 576
84kB
Nov 25 06:50:45 dream-map-server kernel: [1267552.997339] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Nov 25 06:50:45 dream-map-server kernel: [1267552.997340] 40835 total pagecache pages
Nov 25 06:50:45 dream-map-server kernel: [1267552.997345] 5431 pages in swap cache
Nov 25 06:50:45 dream-map-server kernel: [1267553.000011] Swap cache stats: add 104045, delete 98614, find 5860496/5868510
Nov 25 06:50:45 dream-map-server kernel: [1267553.005219] Free swap = 0kB
Nov 25 06:50:45 dream-map-server kernel: [1267553.005220] Total swap = 49148kB
Nov 25 06:50:45 dream-map-server kernel: [1267553.005221] 6143899 pages RAM
Nov 25 06:50:45 dream-map-server kernel: [1267553.005222] 0 pages HighMem/MovableOnly
Nov 25 06:50:45 dream-map-server kernel: [1267553.005223] 96684 pages reserved
Nov 25 06:50:45 dream-map-server kernel: [1267553.005224] [ pid ] uid tgid total_vm rss nr_ptes swapents oom_score_adj name
Nov 25 06:50:45 dream-map-server kernel: [1267553.005229] [ 606] 0 606 3815 26 12 33 0 upstart-socket-
Nov 25 06:50:45 dream-map-server kernel: [1267553.005231] [ 645] 0 645 2556 55 7 518 0 dhclient
Nov 25 06:50:45 dream-map-server kernel: [1267553.005232] [ 987] 0 987 3819 27 12 33 0 upstart-file-br
Nov 25 06:50:45 dream-map-server kernel: [1267553.005234] [ 1047] 102 1047 9837 69 23 56 0 dbus-daemon
Nov 25 06:50:45 dream-map-server kernel: [1267553.005235] [ 1110] 0 1110 3635 2 12 40 0 getty
Nov 25 06:50:45 dream-map-server kernel: [1267553.005237] [ 1113] 0 1113 3635 2 11 38 0 getty
Nov 25 06:50:45 dream-map-server kernel: [1267553.005238] [ 1117] 0 1117 3635 2 11 37 0 getty
Nov 25 06:50:45 dream-map-server kernel: [1267553.005239] [ 1118] 0 1118 3635 2 12 40 0 getty
Nov 25 06:50:45 dream-map-server kernel: [1267553.005241] [ 1120] 0 1120 3635 2 12 38 0 getty
Nov 25 06:50:45 dream-map-server kernel: [1267553.005245] [ 1166] 0 1166 15341 26 34 143 -1000 sshd
Nov 25 06:50:45 dream-map-server kernel: [1267553.005247] [ 1182] 0 1182 5914 16 17 39 0 cron
Nov 25 06:50:45 dream-map-server kernel: [1267553.005248] [ 1184] 0 1184 4785 6 13 37 0 atd
Nov 25 06:50:45 dream-map-server kernel: [1267553.005249] [ 1207] 0 1207 1092 1 8 35 0 acpid
Nov 25 06:50:45 dream-map-server kernel: [1267553.005251] [ 1209] 0 1209 4797 31 13 36 0 irqbalance
Nov 25 06:50:45 dream-map-server kernel: [1267553.005252] [ 1268] 0 1268 3635 2 12 38 0 getty
Nov 25 06:50:45 dream-map-server kernel: [1267553.005254] [ 1274] 0 1274 3197 1 12 38 0 getty
Nov 25 06:50:45 dream-map-server kernel: [1267553.005255] [ 6428] 106 6428 61609 422 58 285 -900 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005257] [ 6430] 106 6430 61684 34454 118 274 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005258] [ 6431] 106 6431 61609 33390 118 278 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005260] [ 6432] 106 6432 61609 1074 53 309 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005261] [ 6433] 106 6433 61825 1777 118 385 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005262] [ 6434] 106 6434 25562 76 48 290 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005264] [ 6943] 0 6943 45260 1031 89 56 0 apache2
Nov 25 06:50:45 dream-map-server kernel: [1267553.005266] [12698] 0 12698 4869 22 13 33 0 upstart-udev-br
Nov 25 06:50:45 dream-map-server kernel: [1267553.005267] [12701] 0 12701 12463 1 28 146 -1000 systemd-udevd
Nov 25 06:50:45 dream-map-server kernel: [1267553.005269] [14231] 101 14231 65019 148 29 98 0 rsyslogd
Nov 25 06:50:45 dream-map-server kernel: [1267553.005270] [14819] 0 14819 10863 33 26 56 0 systemd-logind
Nov 25 06:50:45 dream-map-server kernel: [1267553.005272] [32663] 1000 32663 7278 785 18 515 0 tmux
Nov 25 06:50:45 dream-map-server kernel: [1267553.005273] [32664] 1000 32664 5377 79 15 470 0 bash
Nov 25 06:50:45 dream-map-server kernel: [1267553.005275] [22015] 33 22015 344011 9671 195 7214 0 renderd
Nov 25 06:50:45 dream-map-server kernel: [1267553.005276] [22023] 106 22023 63802 1266 72 191 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005278] [22078] 1000 22078 6294919 5849429 11492 183 0 osm2pgsql
Nov 25 06:50:45 dream-map-server kernel: [1267553.005279] [22080] 106 22080 69700 34363 134 541 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005281] [22081] 106 22081 70777 36480 136 300 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005282] [22082] 106 22082 73914 39312 142 435 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005284] [22083] 106 22083 69647 35402 134 337 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005285] [22084] 106 22084 63838 35316 124 190 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005286] [22085] 106 22085 64677 36234 126 185 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005288] [22086] 106 22086 63696 35202 124 190 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005295] [28814] 33 28814 117549 1063 117 56 0 apache2
Nov 25 06:50:45 dream-map-server kernel: [1267553.005297] [28815] 33 28815 117549 1063 117 56 0 apache2
Nov 25 06:50:45 dream-map-server kernel: [1267553.005299] [ 5727] 106 5727 71980 3589 116 185 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005300] [ 5771] 106 5771 66023 2169 87 256 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005301] [ 5784] 106 5784 68136 26393 131 186 0 postgres
Nov 25 06:50:45 dream-map-server kernel: [1267553.005303] Out of memory: Kill process 22078 (osm2pgsql) score 970 or sacrifice child
Nov 25 06:50:45 dream-map-server kernel: [1267553.050611] Killed process 22078 (osm2pgsql) total-vm:25179676kB, anon-rss:23397716kB, file-rss:0kB
```
---
Reply to this email directly or view it on GitHub:
https://github.com/openstreetmap/osm2pgsql/issues/218#issuecomment-65114948
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.openstreetmap.org/pipermail/tile-serving/attachments/20141201/657cbc3f/attachment-0001.html>
More information about the Tile-serving
mailing list