Ocean or Bay of Fundy? Look for places that have kayak tours. Personally I would avoid the upper Bay of Fundy unless you like mud slogs over half the time.
http://www.novascotia.com/explore/road- ... a-kayakingSome places are usually protected. However we just had two kayak fatalities here in Maine in a "usually protected" area. Including the guide . Bad short lasting squall. Its best to do a tour if you are not experienced in the ocean. Its a good safe way to start ocean paddling.
I started 30 years in a kayak club which taught me lots about the sea.
BTW. Rec kayaks are totally unsuitable for ocean use. You need kayaks you can self rescue on that have flotation or sealed bulkheads in all but the cockpit.