The Rockville City Police Department is taking the plunge into the icy waters of the Chesapeake.