As noted in Fred Plotkin's book Italy for the Gourmet Traveler he found the best gelato in all of Italy in the town of Noto.
In Syracuse, try Caseificio Borderi (Via Emanuele de Benedictis 6 Mercato di Ortigia) for delicious sandwiches.