Published: May 06, 2010 9:43 PM EDT

NORTH FORT MYERS, Fla. - Authorities have confirmed that the body pulled from the Caloosahatchee River Wednesday morning is that of 54-year-old Gary Potts, of Punta Gorda.

Potts' remains were discovered by family members, who had gone out on jet skis in an attempt to find his body. It was around 10:45 a.m. Wednesday, May 5, when they located his remains in the mangroves in the area where he disappeared.

Potts was on a boating trip on the Caloosahatchee river Sunday near the Bay Pointe Yacht and Racquet Club in North Fort Myers when he jumped into the water to cool off. While in the waters where he had been swimming for decades, he disappeared under the water. His brother attempted to save him, but the rescue attempt was unsuccessful.

The Lee County Sheriff's Office had called off the search for a missing swimmer Monday. Divers had scoured the Caloosahatchee River all day as they searched for Potts.

Search crews worked to the point of exhaustion as they searched for Potts, working against dark, "ink"-like water.

Potts' brother spoke with WINK News in an exclusive interview. (See video.)