My Old Man, My Old Lady

What does the idiom “My Old Man, My Old Lady” mean?

Definition:

My spouse

For example:

“I’d love to go to the mall with you, but I told my old man I’d go to the football game.”

Notes:

This has a joshing, slightly derogatory flavor.