Here is a little trick i found out wheni was exploring the open sea.
If you toogle aoutwalk (Num lock) undearwater and take the map on, you will swim without loosing Breath or Fatigue, it freezes when you take the map up and continues when you take the map down (M).
Then its easier to get to Gm island
Happy exploring