You can get really real Icelandic food, as well as Asian food, in Kolaportiš.
Also, the former Allsherjargoši for the Pagan religion in Iceland sells shoes there.