I change fluid more frequently than that, and I don't tow but very, very infrequently. Even with that, my transfer case failed at 85,000 miles. It cost $1,719 to replace.
Changing the fluid (Mercon LV) in the transfer case is easy - it actually has a for real drain plug!