Powered By Blogger

Friday, October 25, 2019

Machine allocation executor and core

6 machines
16 cores per machine - 96 cores total
64gb ram per machine


smallest possible executor
1 core per executor - so that 96 executors we can have


largest possible
6 executors  with each executor having 16 cores
No resources for other process


best approach

96 cores : 1 core for each machine we have to leave for os

we have 90 cores, so we are left with 15 cores.


15 cores each machine ... we can have 3 executors with each 5 cores

63/3 = 21GB , leave 2 gb for yarn overhead 19gb per executor


SO each machine will have 3 executors , and each executor having 5 cores each





No comments:

Post a Comment