Backup Exec 2010 R2 to R3 - Do I need to upgrade Remote Agents right away?

We currently have 2010 R2 and looking to upgrade to R3.  Do I need to upgrade Remote Agents right after the Media Server is upgraded to R3?

I need to schedule a rolling maintenance window to upgrade Remote Agents on our production servers.  There is no way for me to say upgrade the Media Server and all Remote Agents in one sitting.  If I recall, upgrading Remote Agents require a server reboot.

PS: My predecessor did not use the Media Server to push out the Remtoe Agents (looks like he just installed them indivually on each server).  I plan on using the Media Server to push it out once it's been upgraded to R3.