As a current student there, I agree thesparky about Caltech. The faculty are extremely open and responsive and the attitude among students is collegial and non-competitive.
After visiting, I had very positive impressions of, and continue to hear good things about, the departments at Boston College and UCSD.