A fast loading website is important because websurfers are an impatient lot.
All the server related problems have to be dealt by you while managed hosting is its vice-versa.