JasperReports uses Xalan for XML processing which is very slow. Ther is a solution to change the processor to Jaxen.
http://stackoverflow.com/questions/15875199/jasperreports-fillreport-too-slow-and-resource-consuming