http://www.reddit.com/r/buildapc/comments/k33vz
Recommend reading that, get comfortable knowing what you're doing. I'd also recommend overclocking the CPU in BIOS.
If I recall correctly, most Intel chips can make it up to ~90 degrees. It's AMD chips that can't go past ~60/70. What cooler do you have? I think you should be fine overclocking with those current temps though, just check what your CPU's max temp is.