So am I, tpe! I just thought it was another vague term of condemnation, like nerd, but I've never used it as it's not something said in British English.
Actually when i think about it vicars and priests ans similar often try to be folksy and "come down to the level" of "ordinary" lay people. Perhaps he was just trying to do this and got it wrong, as, in a cringe-making way, often happens.