6 machines
16 cores per machine - 96 cores total
64gb ram per machine
smallest possible executor
1 core per executor - so that 96 executors we can have
largest possible
6 executors with each executor having 16 cores
No resources for other process
best approach
96 cores : 1 core for each machine we have to leave for os
we have 90 cores, so we are left with 15 cores.
15 cores each machine ... we can have 3 executors with each 5 cores
63/3 = 21GB , leave 2 gb for yarn overhead 19gb per executor
SO each machine will have 3 executors , and each executor having 5 cores each
16 cores per machine - 96 cores total
64gb ram per machine
smallest possible executor
1 core per executor - so that 96 executors we can have
largest possible
6 executors with each executor having 16 cores
No resources for other process
best approach
96 cores : 1 core for each machine we have to leave for os
we have 90 cores, so we are left with 15 cores.
15 cores each machine ... we can have 3 executors with each 5 cores
63/3 = 21GB , leave 2 gb for yarn overhead 19gb per executor
SO each machine will have 3 executors , and each executor having 5 cores each
No comments:
Post a Comment