Swim with the Fishes

What does the idiom “Swim with the Fishes” mean?

Definition:

Have been killed, especially with involvement of organized crime

For example:

“You won’t be able to ask Carmine about the missing money. He swims with the fishes.”

Notes:

This is old-fashioned Mafia jargon—not terribly common today.