Sunday, December 8, 2013

ESXi Build Complete Part I: Server Framework

I finally completed my ESXi server build and without further delay, here is the final build complete with part numbers for anyone that might want to build using my framework.
OEM
Item:
Manufacturer #
Qty
Unit $
Ext. $
ASUSASUS Barebones Rack ServerRS500-E6/EPS41599.99599.99
IntelXeon E5620 LG1366 CPU 2.4GHzBX80614E56202410.99821.98
Crucial16GB 1066 DDR3 SDRAMCT16G3ERSLQ810672196.99393.98
IntelS3500 120GB SSDSSDSC2BB120G4012149.99299.98
Western Digital1TB AV-GP HDDWD10EURX279.99159.98
Adaptec6405E RAID Controller/Card2270800-R1194.99194.99
SilverStoneSSD/HDD AdapterSDP09214.9929.98
RosewillSAS-SATA 1-4 Breakout CableSFF-8087121.9921.99
Total = Roughly $2,500 without Shipping and Handling or any applicable taxes.

Below are my server specifications with the hardware purchased. 
CategorySpecification
Operating System
VMWare ESXi 5.1 (Yes I know 5.5 is out)
CPUDual Quad Core / 8 Physical Cores / 16 Logical Cores
RAM32GB DDR3 RDIMM
Storage (SSD)2x 120GB SSDss
Storage (HDD)2x 1TB HDDs
RAID (Hardware)Array 1 (2x 120GB SSD, RAID I) Array 2(2x 1TB HDD RAID I)
Network2x Intel Gigabit LAN
Management1x iKVM MGT LAN

I was able to purchase nearly all of the equipment from NewEgg except for the processors which they happened to be out of stock at the time. 

ASUS
Thus far, everything has worked PERFECTLY. And let me take this time to say that ASUS is incredible in my opinion. If you want high power at low cost, ASUS is the perfect way to go. My high powered PC that I built 3 years ago, my Vyatta router/firewall, and this server are all ASUS based machines and I haven't had any issues out of them. 

The Build
Assembly was relatively easy. I received the processors first, put them in, applied thermal paste and put the included heatsinks in. The other parts came last Friday and I put everything in at relative ease. 

RAID
I built the RAID configuration next. I set up two arrays. The first array consists of two 120 GB SSDs. I went with RAID 1 for mirroring for simplicity sake and because I was limited to 4 drives. The OS (ESXi) is mirrored on this array. It took about 20 minutes to build and verify Array I. The second array is for the Datastore where the virtual machines and ISO files are stored. This array consists of two 1TB HDDs in a RAID I configuration. Array II took 2 hours to build and verify. 

OS Install
I went with VMWare ESXi 5.1 as my chosen hypervisor. Yes, I know that 5.5 is out, but there are a lot of limitations with the free version. Number one is what I have heard is the elimination of the Vsphere Client which is how the virtual machines are managed from a remote PC. From my understanding, ESXi is becoming more and more dependent on VCenter which now comes in the form of an appliance that IS NOT free. Until they iron details out on how they will support management for free users, I will stick with 5.1. 

Caveats
The ONLY snag I hit setting the server up was the RAID controller. The first thing any potential builders should know is that ESXi DOES NOT support software (built-in/integrated) RAID controllers at the present time. You must use a hardware controller/card if you want to use RAID with ESXi. Also, I used the Adaptec 6405E RAID controller and I had to use the ESXi ISO Customizer in order to create a custom ESXI installable ISO for ESXi to detect the array during OS installation. That software can be found here

Remote Management
Along with standard remote management through the Vsphere Client, I am also able to manage the server from the BIOS level up (including viewing the ESXi shell) using the ASMB-iKVM4 on the server. 

Now check out the pictures!
RAID Array I (OS) Building from Adaptec RAID BIOS.

RAID Array II (Datastore) Building
 
RAID Array health looks great.
  
After creating the custom ISO, ESXi detects the arrays.


 
ESXI is installed and server is racked and powered on.

Nice pic of the LEDs.
Another nice LED pic.
Rear pic of LAN ports and RAID controller (red LED)
 
The two servers of my CCNP lab.
In the next post I will detail some OS (ESXi) and Vsphere client photos!