For those of you interested, here is a picture of my setup (bad quality since the only good camera I have is in the picture)
I use a Gopro Hero 3 for the video and an Olympus with an old stereo microphone for the sound recording. For both I have made wooden mounts since working with wood is what I enjoy (see here). The video mount is an expandable arm that can be turned 360 degrees, the microphone is hung up through a number of rubber bands. Both is attached to the canoe, mostly the thwart or one of the seats.