Regression testing

I've been asked to automate regression testing. i.e. script the testing needed to make sure that any and all customizations continue working as they should after an upgrade and/or big cross-module deployment.

With 35 custom modules and counting, and practically every stock module modified from APIs to logic hooks to controllers... I'm not sure how to approach this.

Any ideas?

FrancescaS