I think the most important first question is "why?"
What are you trying to solve? Is there a hole in current languages you want to fill?
Or is it for learning purposes?
If the latter, you'll probably want to start off understanding the operating system a bit better, and the abstraction layers (such as System Calls on up to DirectX and similar)
I'd suggest having a look at Gnu C. It's open source, runs on everything, is tight, and is written well.
And, like it or not, you're going to need to get down to the assembler level at the least and probably down to microcode to really do justice to your knowledge-base.
DBP + VC Ent.Studio | Maya, MAX, Soft3D, MilkShape, Character FX | 3.0Ghz P4, IC7G, GF 6800GT (primary) / 3200XP, A7N8x, GF 6600GT (secondary) / 6x dual 2.8Ghz Xeon SuperMicro (renderfarm)