Saw over at both
LetsKillDave and
Gamasutra that
XNA Beta 2 has been released. As with the previous release,
VC# Express needs to be installed.
Unfortunately, I didn't get to do much of anything with Beta 1, but I'm hoping to play around a bit with Beta 2. Definitely going to need to learn C# though. Just another language to add to the growing list of languages I'm familiar with.. 
There are also a few sites dedicated to XNA development. Check them out :
LearnXNA
XNA Spot
XNA Resources
GarageGames has also been working a bit with XNA and their Torque engine and they've ported it over to XNA. It's going to Beta on November 6th, but should be released around the same time XNA is officially released. Of course, release dates slip so don't take my word for it.. Exciting stuff!