Could i get less in my tax returns if i file married filing separate?

I recently married and he hasn't filed a tax return in 12 years. Would I get penalized? Will they charge me money that he owes? Can I file single? We both see it as his money and debt is his and mine is mine. I know the saying is once you marry, the debt is shared.Or something like that.