This behaviour depends on the browser and whether you install or update your plugin.
See the table below for reference : 

Browser

Install

Update

Internet Explorer Page refresh needed Browser restart needed
Safari No refresh needed, 
AdapterJS auto-reloads the plugin list

Browser restart needed 
(Actually quitting Safari, not just closing all windows)