MS licensing is long and complicated. From the licensing seminars I've been too, most of the talk is per connection/user. If you are moving people away from Office, those licenses you free up should be able to be counted against the users in the remote session.
Most of the issues surrounding licensing is your intent. If the BSA came to your business and did an audit, they are looking more for pirated software and software grossly misused. (like buying one copy and installing it 5 times) I've been to many MS seminars and the speakers will sometimes contradict themselves from show to show with regards to licensing and different scenarios. VMs and remote sessions usually cause the most confusion and different answers.
So the short of it is, if you are trying to have the licenses for each user on file - you should be OK.