During the 2004 Summer Olympics Games held in Athens, Greece, Kingsbury, who has a Greek grandmother, was given the chance to playing for the host nation, Greece. Most of the players on the Greek Baseball team was up of Americans with Greek heritage, including North Florida coach Dusty Rhodes, and White Sox scout John Kazanas, Clay Bellinger of the Orioles, outfielders Nick Markakis the Orioles and Nick Theodorou of the Dodgers, and catchers Mike Tonis of Royals and George Kottaras of the Padres.
Kingsbury, an alumnus and 2008 Hall of Fame inductee of Fordham University and current member of the Pittsburgh Pirates organization, picked up one of the biggest hits of the tournament for Greece, an RBI triple, in their lone win, which came against Italy in the preliminary round.
In the spring of 2006, Kingsbury was invited to the Pirates major-league camp in Bradenton, FL as a non-roster invitee. During the seventh inning of the first game against the Philadelphia Phillies, Kingsbury dove for a ball in right field and upon hitting the ground dislocated his left throwing shoulder. He fully tore his rotator cuff and labrum thus ending his 2006 campaign.