I Need Your Help With Some Lyrics

No, I mean have you really given some serious thought to the lyrics of "Winter Wonderland"?

In the meadow we can build a snowman
Then pretend that he is Parson Brown
He'll say, "Are you married?"
We'll say, "No man"
But you can do the job, when you're in town.

That's the part I don't understand.

"Are you married?" - "No man, but you can do the job when you're in town?"

I don't mean to turn this into some sort of weird sexual thing, but what exactly are they talking about.  What kind of job can only be done when you're in town?

Will someone please explain this line to me?

I'll be the first to admit I'm not the brightest bulb in the package, but I'm pretty sure this has somehow got to involve the "Hobble-ity Ga-ga." - if you know what I mean.