I made it through the prescreening no problem and was given a list of five problems -- solve one. I chose to solve it in ruby and then a follow up with two people to peer review. I must have made an impression because I was brought onsite. Everyone was very cordial and the environment looked like a lot of fun.
First interview was with two developers, simple 1-on-2 about my background and what happens at Rally. Then I pair programmed with two junior developers and that went well. Next, another two developers took me out to lunch. Finally, a met with a manager and I believe the interview went great. She even said at the end of the interview that she wasn't going to bother with a technical challenge since I had already proven myself with my skill set.
That was it. A day later, I got an email from Rally saying they were going to pass. No explanation, just a "bug off and have a nice day" (nicer words than that). I tried to follow up on figuring out why I was not accepted, but was simply ignored. And that was the end of that.
I got a free lunch out of the deal, but it'd be nice if the company was a bit more transparent on their expectations.