Other than the fact that each version of Tortoise svn typically adds new features or changes up some ways to do things to improve the process...I don't see any problem with using the latest. I've worked for .coms, small, and huge companies and nobody has ever worried about this.
Now if you're new and you're trying to stick with what the team has, because in case any instructions go out to help you then you might want to stick with whatever the rest of the team is using.
For me, I'm very comfortable with Tortoise. It's no big deal for me to figure out how to do the same way as an older version in a newer version if that particular functionality has changed.
However I'm wondering...or I assume basically that the underlying repository (Subversion) is always going to be consistent. That using x version of tortoise svn won't matter in terms of meta data being stored, etc.
Is this a correct assumption and if so where did you find info on that because I haven't seen anything that really talks about this.