Caryville is located at 36°17'56" North, 84°13'23" West (36.298889, -84.223333).
According to the United States Census Bureau, the town has a total area of 5.46 mi2 (14.13 km2). 5.20 mi2 (13.48 km2) of it is land and 0.25 mi2 (0.66 km2) of it is covered by water. The total area is 4.64% water.
Caryville is located in the Eastern Standard Time (EST) timezone, GMT-05:00. It observes Daylight Saving Time (DST).