Grammar

• "I spent a sabbatical year at Nuffield, my kids going to Phil and Jim's and us attending St. Ebbe's, so I have fond memories of Oxford too."

Should it be "us attending" or "we attending"?

Grammar says "we"; sounding right says "us".