From my Notebook >

How to Toggle Mute with the Keyboard in XFCE / Xubuntu

Instead of:

amixer set Master toggle

Try this:

amixer -D pulse sset Master toggle