Performance evaluation in humanitarian operations is a vital issue, as it enables better results and faster service. One of the evaluation perspectives is related to how humanitarian operations can be effective and efficient in helping beneficiaries. In this sense, the main objective of this study is to propose a framework for evaluating the performance of humanitarian operations, based on the beneficiaries perception. For this, 22 articles are selected and 130 indicators are identified through a systematic review of the literature. Based on these results, a taxonomy of pre- and post-disaster criteria, a specific research agenda for topic improvement, and a framework for performance evaluation are proposed. Then, an empirical study addressing the case about the fall of the leisure area of a building is conducted, consisting of a survey, with the residents of the building and a case study with the company responsible for the work. The survey presents 44 responses with satisfactions, dissatisfactions, positives, and negatives of the post-disaster operation, where the main results indicate that there are dissatisfactions related to the issue of adaptation to the new place of residence and the main positive point concerns the speed of the first visits affected people. The results of the case study indicate that the company is concerned with the satisfaction of its customers and is flexible to meet their needs. Thus, the results give a first validation of the framework, being suggested as future research the development of studies deepen other types of disasters.