... QARLA, for the evaluation of text summarisation systems. The in-put of the framework is a set of man-ual (reference) summaries, a set of base-line (automatic) summaries and a set of similarity ... evaluate automatic summarisation systems and,at the same time, similarity metrics conceived aswell to evaluate summarisation systems. There-fore, testing the validity of the QARLA proposalimplies ... QARLA, that addresses such issues.Given a set of manual summaries and another set of baseline summaries per task, together with a set of similarity metrics, QARLA provides quantita-tive measures...