I see that you haven't had a reply to this one, and as a complete non-expert I can't suggest any causes - but I can say that we had a similar problem at our place in Auckland some four years ago. We lost almost all of our big kawakawa plants - generally the whole thing rather than just individual stems. However, now we seem to have more plants than ever (well into three figures), and they come up very easily through natural dispersal (mainly from blackbirds, I think!). So if it gets any worse, you may just have to wait and trust to nature - it worked in our case.