Selmer is located at 35°10'10" North, 88°35'31" West (35.169722, -88.592222).
According to the United States Census Bureau, the town has a total area of 9.79 mi2 (25.37 km2). 9.78 mi2 (25.32 km2) of it is land and 0.02 mi2 (0.05 km2) of it is covered by water. The total area is 0.19% water.
Selmer is located in the Central Standard Time (CST) timezone, GMT-06:00. It observes Daylight Saving Time (DST).