I find programming easy, and the school I go to here (UCSD) is impacted in this major, so they try to flood the firstyears with a lot in a short time, and expect the students to learn a lot of it on their own. There is a lot of programming in the first year (I spent over 18 hours a week on assignments for ONE class), but I find the other stuff harder. Because its an engineering class, you need to take as much lower division math as a math major, same goes with physics. Then its also specialized in that it is all about computing, so you need to take at least 5 or 6 programming classes in the lower division before you even get started.
Basically, theres a TON of material, and its nearly impossible to do in 4 years (even though I am trying, thats a different story, I do it in 4 years out of necessity, not convenience). If I leave a suicide note here on the forum, you will know what happened to me :P
CS here has a 50% dropout rate in the first year, none of the other majors have even close to half that. At the end of the 4 (5) years, usually there are only 15-20% of the original students remaining.
Its tough, but worth it, even if you aren't guaranteed a good job anymore.
[edited typo]