Soooo I'm an idiot, I took the blower Resistor/Amp out and I took the nee blower motor out to try and test, I couldn't get a test light into the connector deep enough to get a connection. So I moved to testing the blower, I ran leads from the battery but that didn't seem to work either, so I plugged the resistor / Amp back in but left it hanging and plugged the blower back and turned on the blower and it started up and started moving. So I must not have plugged it in all the way when I plugged it in the first time. As I put everything back together I kept checking to make sure it worked and sure enough it works fine now.
So yeah IT WAS THE BLOWER, but the new one just wasn't sat right.