Why the fuck does ubuntu need pulseaudio, everything seemed to work so well "WITHOUT" it!!! After removing the damn thing it seems xbmc worked much better on my system, before I had to kill it before launching xbmc. Had some troubles with boxee too, but after removing PA it works much better now.
All I can say is PulseAudio = Pathetic Audio
No one wants you PulseAudio so scram!!!
sudo apt-get remove pulseaudio