Candle: Level 1, Parapa Palace
Hammer: This is your reward for persevering through the Cave Mazes on the Southern part of Hyrule.
Glove: Level 2, Midoro: The Swamp Palace
Raft: Level 3, the Island Palace
Boots: Level 4, Island Maze
Trumpet: Level 5, the Ocean Palace
Magic Key: The town of Kasuto
Cross: Level 6, the Dragon's Maze.