This behaviour depends on the browser and whether you install or update your plugin.
See the table below for reference : 

  
Browser
Install
Update
Internet Explorer Page refresh needed Browser restart needed
Safari 10 & lower



No refresh needed,
AdapterJS auto-reloads the plugin list

Browser restart needed
(Actually quitting Safari, not just closing all windows)

Safari 11 (with plugin) Browser restart needed
Browser restart needed