IRIN Evaluation Report - March 2003
by Graham Mytton & Sharon Rusu

16. An informal narrative history approach was also employed, most of which is to be found in Part 1, Background . This approach required various interviewees to recall their memories of IRIN from start-up to today. A narrative history is a particularly sensitive evaluation tool in that it places events in a context which better permits analysis of significant events in the life of a project and is useful for drawing lessons. Moreover, it does not preclude the use of more analytical models whose purpose is to assess performance and accountability.
17. The assessment criteria were developed with a view to measuring the effectiveness of the IRIN model by assessing IRIN's performance as a humanitarian news service through analysing user perceptions of IRIN's products, services and management. Interviews with OCHA and IRIN senior managers and staff, as well as an extensive literature review, helped to provide the additional information required for an evaluation of IRIN's management under the more general heading of IRIN sustainability. Under sustainability, the IRIN model, staffing and management, and over-all cost-effectiveness were assessed.
18. Based on the following assessment criteria, an effective IRIN would be one with:
    • a reputation for rigorous analysis and investigative reporting based on multiple viewpoints and the application of quality assurance as prescribed by the IRIN Style Guide (high analytical capability)
    • a focussed communications/media strategy in planning and operations, which is demonstrably communicating with and educating strategic audiences and decision-makers (high communications strategy)
    • strong influence on the discourse, behaviours and policy approaches of key decision-makers or key groups associated with major IRIN advocacy initiatives (high influence)
    • high levels of experience and best practice exchange between network members, and demonstration of the institutionalisation of lessons learned into future practice, including standardized investigative and editorial practices. (high levels of cross-network learning and knowledge transfer)
    • strong relationships with key decision-makers in the UN, media, governments, NGOs, civil society and with donors. In addition, the capacity to initiate new relationships with a view to enhancing the mainstream capacity of IRIN and developing new approaches to fundraising and sustainability (high connectivity)
    • a high level of credibility and access to key stakeholders whether international agencies or media or local actors and success in mainstreaming key issues thereafter. Accountable, relevant and effective management structures and practices, including information technology, based on effective planning and people management, and successful donor relationships that are premised on broadening IRIN's funding base and supporting relative, appropriate expansion while avoiding overstretch ¹⁹ (sustainability)
    • a high level of accountability in the application of best practice principles of accountability and transparency in operations and reporting. An organisational culture that encourages and rewards creativity, initiative, new knowledge and inclusive decision-making. (governance)
19. Using the criteria as a base, each interview response was ranked high, medium or low. These designations rated the performance of IRIN against each of the criteria as applied to several categories including: mandate, institutional role and partnerships, products and services, gaps in geographic coverage, themes and language, and sustainability. Importantly, these ratings are viewed as a means to identify patterns in subscriber perceptions of IRIN's overall performance rather than to measure quantity. This formula was also used to assess the effectiveness of the management of the IRIN model and, as perceived by its subscribers, peer groups in the media and other humanitarian agencies, the extent to which IRIN adds value as a humanitarian news service. (See Annex 7 for a sample interview with ratings).

[Ends]

Top of the Page?