Nope, imagine an extra dimension as a curve in space. I'll use Brian Greene's 'ants on a hosepipe' analogy. Normally with our perception of 3 spatial dimensions, we can specify the position of a point with 3 co-ordinates. But if there was an ant on a hosepipe, we can also specify its location with an extra dimension, a value of position on the curve.