Bilbo lives at a point 100 miles north of the line of latitude near to the south pole which has a 100 miles long circumference. He therefore goes 100 miles south onto that line, travels around the world, and travels 100 miles north back home.