When you’re upgrading a plugin you can quickly check if the plugin version you are about to upgrade to works with your current version of WordPress. Is there a way of checking that your current plugins will work with the version of WordPress you are about it upgrade to without searching for each one in the directory?
How to check plugin compatibility before upgrading WordPress
Have a glance at Better Plugin Compatibility Control. I just found this out this morning. I think this does what you’re after.
@Brady’s plugin is exactly what you are asking for, and I use it too, but just to list another plugin that is handy when you are updating plugins is the Changelogger plugin. It can show you what has changed between your current plugin version and the update that is available.