I finally fixed it. Went outside in the cold the other day and decided I wasn't going to leave until the noise was gone.
I changed the ground again, now it's grounded at the same place, but it's a seperate ground from the sub.
Now it's working fine, go figure.