You should not leave southern Norway without doing a boat trip and seeing the old outports, spotting the birds, the islands and skerries.
The ferry is departing from Høllen pier, Søgne and goes to Ny-Hellesund. The trip takes a little over an hour. Most trips corresponds with the bus from Kristiansand.
See the website for info on departures/return.