首页 > 其他分享> > Impala查询报错Memory limit exceeded: Error occurred on backend cdh01:22000 by fragment 【未解决】
Impala查询报错Memory limit exceeded: Error occurred on backend cdh01:22000 by fragment 【未解决】
作者：互联网
Query 2b4c5263b1fdbd24:61ae4f9500000000: 0% Complete (0 out of 2)
Query 2b4c5263b1fdbd24:61ae4f9500000000: 50% Complete (1 out of 2)
WARNING: The following tables are missing relevant table and/or column statistics.
ods.a,ods.b
Memory limit exceeded: Error occurred on backend cdh01:22000 by fragment 2b4c5263b1fdbd24:61ae4f9500000001
Memory left in process limit: -10.92 MB
Query(2b4c5263b1fdbd24:61ae4f9500000000): Reservation=82.00 MB ReservationLimit=360.80 MB OtherMemory=44.15 MB Total=126.15 MB Peak=130.13 MB
Fragment 2b4c5263b1fdbd24:61ae4f9500000002: Reservation=34.00 MB OtherMemory=22.76 MB Total=56.76 MB Peak=56.84 MB
HASH_JOIN_NODE (id=2): Reservation=34.00 MB OtherMemory=236.25 KB Total=34.23 MB Peak=34.23 MB
Exprs: Total=110.12 KB Peak=110.12 KB
Hash Join Builder (join_node_id=2): Total=110.12 KB Peak=110.12 KB
Hash Join Builder (join_node_id=2) Exprs: Total=110.12 KB Peak=110.12 KB
EXCHANGE_NODE (id=3): Reservation=11.09 MB OtherMemory=78.19 KB Total=11.16 MB Peak=11.16 MB
KrpcDeferredRpcs: Total=78.19 KB Peak=78.19 KB
EXCHANGE_NODE (id=4): Reservation=11.34 MB OtherMemory=0 Total=11.34 MB Peak=11.41 MB
KrpcDeferredRpcs: Total=0 Peak=78.17 KB
HdfsTableSink: Total=0 Peak=0
CodeGen: Total=18.13 KB Peak=2.33 MB
Fragment 2b4c5263b1fdbd24:61ae4f9500000000: Reservation=24.00 MB OtherMemory=11.46 MB Total=35.46 MB Peak=36.98 MB
HDFS_SCAN_NODE (id=0): Reservation=24.00 MB OtherMemory=11.22 MB Total=35.22 MB Peak=36.44 MB
Queued Batches: Total=11.21 MB Peak=12.43 MB
KrpcDataStreamSender (dst_id=3): Total=1.64 KB Peak=1.64 KB
CodeGen: Total=3.32 KB Peak=710.50 KB
Fragment 2b4c5263b1fdbd24:61ae4f9500000001: Reservation=24.00 MB OtherMemory=9.93 MB Total=33.93 MB Peak=36.07 MB
HDFS_SCAN_NODE (id=1): Reservation=24.00 MB OtherMemory=9.69 MB Total=33.69 MB Peak=35.83 MB
Queued Batches: Total=9.69 MB Peak=11.82 MB
KrpcDataStreamSender (dst_id=4): Total=1.64 KB Peak=1.64 KB
CodeGen: Total=3.32 KB Peak=710.50 KBProcess: memory limit exceeded. Limit=451.00 MB Total=461.95 MB Peak=465.14 MB
Buffer Pool: Free Buffers: Total=10.66 MB
Buffer Pool: Clean Pages: Total=0
Buffer Pool: Unused Reservation: Total=-10.83 MB
Control Service Queue: Limit=50.00 MB Total=0 Peak=28.57 KB
Data Stream Service Queue: Limit=22.55 MB Total=0 Peak=211.01 KB
Data Stream Manager Early RPCs: Total=0 Peak=0
TCMalloc Overhead: Total=35.91 MB
RequestPool=fe-eval-exprs: Total=0 Peak=0
RequestPool=root.bigdata: Total=296.31 MB Peak=300.29 MB
Query(5d42cfde7e204b64:1a35cd2c00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=25.84 KB
Query(0e4023074f0b8916:59c13a5c00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=18.37 KB
Query(814da27ebf32f362:db5408db00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=18.37 KB
Query(a64bf5250d56fe41:364f753a00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=13.57 KB Total=13.57 KB Peak=24.59 MB
Query(0c4cfe588aadcf72:2b15df5a00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=24.59 MB
Query(fb4658d30cccf5dd:d22dd18a00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=13.57 KB Total=13.57 KB Peak=24.59 MB
Query(e14e662c3eb6f3eb:7c902ed100000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=15.82 KB Total=15.82 KB Peak=24.49 MB
Query(c44252ee453e23b1:ec1b3a5200000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=15.82 KB Total=15.82 KB Peak=24.49 MB
Query(5d4c0bde77c9a8f1:9682396c00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=7.74 KB Total=7.74 KB Peak=1.67 MB
Query(ca46033163774dbe:9ad0807200000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=14.73 KB Total=14.73 KB Peak=578.85 KB
Query(4c453b8a3ce9a089:8c98e86e00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=16.85 KB
Query(6f43d2a001a9687f:8f0231f100000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=14.80 KB Total=14.80 KB Peak=578.85 KB
Query(a94922b0c9f3006e:3913363300000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=24.46 KB Total=24.46 KB Peak=622.83 KB
Query(1540d47e82a39d55:6eb9d12e00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=24.46 KB Total=24.46 KB Peak=622.83 KB
Query(354f70299fa5ba94:a895f62b00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=24.46 KB Total=24.46 KB Peak=622.83 KB
Query(dc4ef1f6369551e8:d51d578500000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=24.46 KB Total=24.46 KB Peak=622.83 KB
Query(a6411e032b250c94:6351271500000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=37.03 MB
Query(1a409fbb9ae03a82:dfaa772e00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=1.57 KB Total=1.57 KB Peak=24.48 MB
Query(3e47ed700c34cfd0:bd010d2c00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=1.71 KB Total=1.71 KB Peak=24.48 MB
Query(8b4b56fa69810f7d:60d295d400000000): Reservation=136.00 MB ReservationLimit=360.80 MB OtherMemory=33.97 MB Total=169.97 MB Peak=188.78 MB
Query(2b4c5263b1fdbd24:61ae4f9500000000): Reservation=82.00 MB ReservationLimit=360.80 MB OtherMemory=44.15 MB Total=126.15 MB Peak=130.13 MB
Untracked Memory: Total=129.90 MB (1 of 3 similar)
Query 2b4c5263b1fdbd24:61ae4f9500000000: 50% Complete (1 out of 2)
WARNING: The following tables are missing relevant table and/or column statistics.
ods.a,ods.b
Memory limit exceeded: Error occurred on backend cdh01:22000 by fragment 2b4c5263b1fdbd24:61ae4f9500000001
Memory left in process limit: -10.92 MB
Query(2b4c5263b1fdbd24:61ae4f9500000000): Reservation=82.00 MB ReservationLimit=360.80 MB OtherMemory=44.15 MB Total=126.15 MB Peak=130.13 MB
Fragment 2b4c5263b1fdbd24:61ae4f9500000002: Reservation=34.00 MB OtherMemory=22.76 MB Total=56.76 MB Peak=56.84 MB
HASH_JOIN_NODE (id=2): Reservation=34.00 MB OtherMemory=236.25 KB Total=34.23 MB Peak=34.23 MB
Exprs: Total=110.12 KB Peak=110.12 KB
Hash Join Builder (join_node_id=2): Total=110.12 KB Peak=110.12 KB
Hash Join Builder (join_node_id=2) Exprs: Total=110.12 KB Peak=110.12 KB
EXCHANGE_NODE (id=3): Reservation=11.09 MB OtherMemory=78.19 KB Total=11.16 MB Peak=11.16 MB
KrpcDeferredRpcs: Total=78.19 KB Peak=78.19 KB
EXCHANGE_NODE (id=4): Reservation=11.34 MB OtherMemory=0 Total=11.34 MB Peak=11.41 MB
KrpcDeferredRpcs: Total=0 Peak=78.17 KB
HdfsTableSink: Total=0 Peak=0
CodeGen: Total=18.13 KB Peak=2.33 MB
Fragment 2b4c5263b1fdbd24:61ae4f9500000000: Reservation=24.00 MB OtherMemory=11.46 MB Total=35.46 MB Peak=36.98 MB
HDFS_SCAN_NODE (id=0): Reservation=24.00 MB OtherMemory=11.22 MB Total=35.22 MB Peak=36.44 MB
Queued Batches: Total=11.21 MB Peak=12.43 MB
KrpcDataStreamSender (dst_id=3): Total=1.64 KB Peak=1.64 KB
CodeGen: Total=3.32 KB Peak=710.50 KB
Fragment 2b4c5263b1fdbd24:61ae4f9500000001: Reservation=24.00 MB OtherMemory=9.93 MB Total=33.93 MB Peak=36.07 MB
HDFS_SCAN_NODE (id=1): Reservation=24.00 MB OtherMemory=9.69 MB Total=33.69 MB Peak=35.83 MB
Queued Batches: Total=9.69 MB Peak=11.82 MB
KrpcDataStreamSender (dst_id=4): Total=1.64 KB Peak=1.64 KB
CodeGen: Total=3.32 KB Peak=710.50 KBProcess: memory limit exceeded. Limit=451.00 MB Total=461.95 MB Peak=465.14 MB
Buffer Pool: Free Buffers: Total=10.66 MB
Buffer Pool: Clean Pages: Total=0
Buffer Pool: Unused Reservation: Total=-10.83 MB
Control Service Queue: Limit=50.00 MB Total=0 Peak=28.57 KB
Data Stream Service Queue: Limit=22.55 MB Total=0 Peak=211.01 KB
Data Stream Manager Early RPCs: Total=0 Peak=0
TCMalloc Overhead: Total=35.91 MB
RequestPool=fe-eval-exprs: Total=0 Peak=0
RequestPool=root.bigdata: Total=296.31 MB Peak=300.29 MB
Query(5d42cfde7e204b64:1a35cd2c00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=25.84 KB
Query(0e4023074f0b8916:59c13a5c00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=18.37 KB
Query(814da27ebf32f362:db5408db00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=18.37 KB
Query(a64bf5250d56fe41:364f753a00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=13.57 KB Total=13.57 KB Peak=24.59 MB
Query(0c4cfe588aadcf72:2b15df5a00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=24.59 MB
Query(fb4658d30cccf5dd:d22dd18a00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=13.57 KB Total=13.57 KB Peak=24.59 MB
Query(e14e662c3eb6f3eb:7c902ed100000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=15.82 KB Total=15.82 KB Peak=24.49 MB
Query(c44252ee453e23b1:ec1b3a5200000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=15.82 KB Total=15.82 KB Peak=24.49 MB
Query(5d4c0bde77c9a8f1:9682396c00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=7.74 KB Total=7.74 KB Peak=1.67 MB
Query(ca46033163774dbe:9ad0807200000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=14.73 KB Total=14.73 KB Peak=578.85 KB
Query(4c453b8a3ce9a089:8c98e86e00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=16.85 KB
Query(6f43d2a001a9687f:8f0231f100000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=14.80 KB Total=14.80 KB Peak=578.85 KB
Query(a94922b0c9f3006e:3913363300000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=24.46 KB Total=24.46 KB Peak=622.83 KB
Query(1540d47e82a39d55:6eb9d12e00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=24.46 KB Total=24.46 KB Peak=622.83 KB
Query(354f70299fa5ba94:a895f62b00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=24.46 KB Total=24.46 KB Peak=622.83 KB
Query(dc4ef1f6369551e8:d51d578500000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=24.46 KB Total=24.46 KB Peak=622.83 KB
Query(a6411e032b250c94:6351271500000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=37.03 MB
Query(1a409fbb9ae03a82:dfaa772e00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=1.57 KB Total=1.57 KB Peak=24.48 MB
Query(3e47ed700c34cfd0:bd010d2c00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=1.71 KB Total=1.71 KB Peak=24.48 MB
Query(8b4b56fa69810f7d:60d295d400000000): Reservation=136.00 MB ReservationLimit=360.80 MB OtherMemory=33.97 MB Total=169.97 MB Peak=188.78 MB
Query(2b4c5263b1fdbd24:61ae4f9500000000): Reservation=82.00 MB ReservationLimit=360.80 MB OtherMemory=44.15 MB Total=126.15 MB Peak=130.13 MB
Untracked Memory: Total=129.90 MB (1 of 3 similar)
Query 2b4c5263b1fdbd24:61ae4f9500000000: 50% Complete (1 out of 2)
WARNING: The following tables are missing relevant table and/or column statistics.
ods.a,ods.b
Memory limit exceeded: Error occurred on backend cdh01:22000 by fragment 2b4c5263b1fdbd24:61ae4f9500000001
Memory left in process limit: -10.92 MB
Query(2b4c5263b1fdbd24:61ae4f9500000000): Reservation=82.00 MB ReservationLimit=360.80 MB OtherMemory=44.15 MB Total=126.15 MB Peak=130.13 MB
Fragment 2b4c5263b1fdbd24:61ae4f9500000002: Reservation=34.00 MB OtherMemory=22.76 MB Total=56.76 MB Peak=56.84 MB
HASH_JOIN_NODE (id=2): Reservation=34.00 MB OtherMemory=236.25 KB Total=34.23 MB Peak=34.23 MB
Exprs: Total=110.12 KB Peak=110.12 KB
Hash Join Builder (join_node_id=2): Total=110.12 KB Peak=110.12 KB
Hash Join Builder (join_node_id=2) Exprs: Total=110.12 KB Peak=110.12 KB
EXCHANGE_NODE (id=3): Reservation=11.09 MB OtherMemory=78.19 KB Total=11.16 MB Peak=11.16 MB
KrpcDeferredRpcs: Total=78.19 KB Peak=78.19 KB
EXCHANGE_NODE (id=4): Reservation=11.34 MB OtherMemory=0 Total=11.34 MB Peak=11.41 MB
KrpcDeferredRpcs: Total=0 Peak=78.17 KB
HdfsTableSink: Total=0 Peak=0
CodeGen: Total=18.13 KB Peak=2.33 MB
Fragment 2b4c5263b1fdbd24:61ae4f9500000000: Reservation=24.00 MB OtherMemory=11.46 MB Total=35.46 MB Peak=36.98 MB
HDFS_SCAN_NODE (id=0): Reservation=24.00 MB OtherMemory=11.22 MB Total=35.22 MB Peak=36.44 MB
Queued Batches: Total=11.21 MB Peak=12.43 MB
KrpcDataStreamSender (dst_id=3): Total=1.64 KB Peak=1.64 KB
CodeGen: Total=3.32 KB Peak=710.50 KB
Fragment 2b4c5263b1fdbd24:61ae4f9500000001: Reservation=24.00 MB OtherMemory=9.93 MB Total=33.93 MB Peak=36.07 MB
HDFS_SCAN_NODE (id=1): Reservation=24.00 MB OtherMemory=9.69 MB Total=33.69 MB Peak=35.83 MB
Queued Batches: Total=9.69 MB Peak=11.82 MB
KrpcDataStreamSender (dst_id=4): Total=1.64 KB Peak=1.64 KB
CodeGen: Total=3.32 KB Peak=710.50 KBProcess: memory limit exceeded. Limit=451.00 MB Total=461.95 MB Peak=465.14 MB
Buffer Pool: Free Buffers: Total=10.66 MB
Buffer Pool: Clean Pages: Total=0
Buffer Pool: Unused Reservation: Total=-10.83 MB
Control Service Queue: Limit=50.00 MB Total=0 Peak=28.57 KB
Data Stream Service Queue: Limit=22.55 MB Total=0 Peak=211.01 KB
Data Stream Manager Early RPCs: Total=0 Peak=0
TCMalloc Overhead: Total=35.91 MB
RequestPool=fe-eval-exprs: Total=0 Peak=0
RequestPool=root.bigdata: Total=296.31 MB Peak=300.29 MB
Query(5d42cfde7e204b64:1a35cd2c00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=25.84 KB
Query(0e4023074f0b8916:59c13a5c00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=18.37 KB
Query(814da27ebf32f362:db5408db00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=18.37 KB
Query(a64bf5250d56fe41:364f753a00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=13.57 KB Total=13.57 KB Peak=24.59 MB
Query(0c4cfe588aadcf72:2b15df5a00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=24.59 MB
Query(fb4658d30cccf5dd:d22dd18a00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=13.57 KB Total=13.57 KB Peak=24.59 MB
Query(e14e662c3eb6f3eb:7c902ed100000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=15.82 KB Total=15.82 KB Peak=24.49 MB
Query(c44252ee453e23b1:ec1b3a5200000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=15.82 KB Total=15.82 KB Peak=24.49 MB
Query(5d4c0bde77c9a8f1:9682396c00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=7.74 KB Total=7.74 KB Peak=1.67 MB
Query(ca46033163774dbe:9ad0807200000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=14.73 KB Total=14.73 KB Peak=578.85 KB
Query(4c453b8a3ce9a089:8c98e86e00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=16.85 KB
Query(6f43d2a001a9687f:8f0231f100000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=14.80 KB Total=14.80 KB Peak=578.85 KB
Query(a94922b0c9f3006e:3913363300000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=24.46 KB Total=24.46 KB Peak=622.83 KB
Query(1540d47e82a39d55:6eb9d12e00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=24.46 KB Total=24.46 KB Peak=622.83 KB
Query(354f70299fa5ba94:a895f62b00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=24.46 KB Total=24.46 KB Peak=622.83 KB
Query(dc4ef1f6369551e8:d51d578500000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=24.46 KB Total=24.46 KB Peak=622.83 KB
Query(a6411e032b250c94:6351271500000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=0 Total=0 Peak=37.03 MB
Query(1a409fbb9ae03a82:dfaa772e00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=1.57 KB Total=1.57 KB Peak=24.48 MB
Query(3e47ed700c34cfd0:bd010d2c00000000): Reservation=0 ReservationLimit=360.80 MB OtherMemory=1.71 KB Total=1.71 KB Peak=24.48 MB
Query(8b4b56fa69810f7d:60d295d400000000): Reservation=136.00 MB ReservationLimit=360.80 MB OtherMemory=33.97 MB Total=169.97 MB Peak=188.78 MB
Query(2b4c5263b1fdbd24:61ae4f9500000000): Reservation=82.00 MB ReservationLimit=360.80 MB OtherMemory=44.15 MB Total=126.15 MB Peak=130.13 MB
Untracked Memory: Total=129.90 MB (1 of 3 similar)
标签：KB,cdh01,MB,fragment,报错,Peak,Reservation,OtherMemory,Total 来源： https://blog.csdn.net/qq_26502245/article/details/114984328