Hey @jdlaroche,
Circling back, the proper location for the system setting would be Control Panel > Notification Area Icons on Windows 7, sorry for the inaccurate post above.
In the Control Panel, the setting pertaining to Mattermost should be set to "Show icon and notifications ", after which the balloon notification should appear.
Let us know if the above helps fix the issue,