On the Straight and Narrow

What does the idiom “On the Straight and Narrow” mean?

Definition:

Of high moral standards; acting prooerly

For example:

“Even though Andrew lived in a neighborhood with a lot of wild bars, he kept himself on the straight and narrow.”