go to the cornishe jetty, opposite the Central Bank Bldg. There are some fishing dhows there. These are rented for as long as you want, you need to book in advance though. Just go there and find out. Price will vary according to number of people, size of dhow etc.

have a good trip.