My employer is thinking about changing our pension plan from defined benefits to defined contribution. Can they just do that? Does this constitute a change in my compensation package?

A change to your pension plan is certainly a change to the compensation package. If the change is significant, it may constitute a constructive dismissal. Whether this amounts to a constructive dismissal will depend on the language of your employment agreement and pension plan.