It seems I installed it the first way around the first time. Whoops!
The online instructions use one of the Artic Cooling cases that exhausts air out the front.

Its running at like 2700 RPM. Is that normal? My CPU is nice and cool now, thought not as cool as I'd like.