If you like the noisy more experimental side, The Dead C providing you are not aware of them are awesome. Eusa Kills which was released on FN is excellent.
http://www.youtube.com/watch?v=9MVxKyj0wfM
There is also The Gordons who would become Bailter space later on. They released some great noisy post-punk.
http://www.youtube.com/watch?v=rDKGkWU0lWQ
Then the Axemen who were a lo-fi/noise rock group from Christchurch
http://www.youtube.com/watch?v=Yv-iM_1h5uA
In terms of songwriting you can't really beat the Clean or the Verlaines who just made great pop music.
http://www.youtube.com/watch?v=cQ8C-ndyFXk
http://www.youtube.com/watch?v=Eeuy8PD0bFM
I apologies for the link overload but there really is a huge amount of great stuff on the label.