This report is prepared and published in accordance with the Fire Services Implementation Monitor’s (FSIM) requirements under section 141 of the Fire Rescue Victoria Act 1958 (FRV Act). It provides commentary and analysis on the Country Fire Authority’s (CFA) and Fire Rescue Victoria’s (FRV) respective outcomes frameworks for quarter 3 (Q3) of the 2023-24 financial year (FY).
FSIM publishes these quarterly reports at Fire Services Implementation Monitor publications.
1.1 Reporting on outcomes
CFA and FRV have each developed an outcomes framework that sets out their respective outcomes-based fire services performance measures, in accordance with section 140(1) of the FRV Act.
This quarter, CFA reported on 26 indicators in their newly released Year Four Outcomes Framework, and FRV reported on 18 measures (against 12 indicators) in their existing Year Three Outcomes Framework.
CFA and FRV’s Q3 2023-24 outcomes progress reports are provided in Appendices A and B, respectively.
Changes to FSIM’s outcomes reporting criteria
FSIM revised its outcomes reporting criteria to streamline reporting this quarter. As such, the criterion ‘varies more than 5 per cent from the agency’s baseline or average over time’ will no longer be reported as a stand-alone criterion but will be considered within the parameters of the three criteria below.
Under these criteria, FSIM has identified the following notable indicators and measures for the quarter:
- demonstrates a notable achievement:
- CFA: Decrease in average time to control bushfires (indicator 2.2.4).
- CFA: Increase in percentage of grass and scrub fires contained to 5 hectares (indicator 2.2.2).
- FRV: Percentage of response to EMR (emergency medical response) within 9.2 minutes (target 90%) (measure 2.1.3a).
- continuing off-track trend over repeated quarter:
- CFA: Decrease average time spent suppressing structure fires (time spent on scene of incident) (indicator 2.2.3).
- FRV: Increase in support and maintenance of firefighters’ physical and psychological health (indicator 3.1.1).
- FRV: Percentage of response to structure fire incidents within 7.7 minutes (target 90 per cent) (measure 2.1.3a).
- significant change from the previous quarter (positive or negative):
- CFA: A decrease in stock loss due to fires (indicator 2.3.4).
- FRV: Number of incidents other than structure fires and other non-fire related incidents within FRV districts: non-structure fires (measure 1.3.3).
1.2 Maturing outcomes frameworks
CFA and FRV regularly review their respective outcomes frameworks to ensure the outcomes, indicators and measures continue to align with their strategic priorities and remain fit-for-purpose.
CFA’s outcomes framework
CFA advises that it continues to mature the way in which it uses performance data to inform decision-making. CFA undertakes an annual review of its Outcomes Framework which includes consultation with data stewards across the agency, and then formal consideration by the CFA Executive and Board. CFA report that minimal changes were implemented to provide greater clarity and transparency to reporting.
The following indicators were removed:
- Decrease in new volunteer compensation claims (previously reported as indicator 3.1.3)
- Decrease in new WorkCover claims (previously reported as indicator 3.1.4)
- Increase in timely resolution of internal audit recommendations (previously reported as indicator 4.2.2).
FRV’s outcomes framework
FRV commenced a review of the Outcomes Framework to consider potential structure, scope, and alignment with their Strategic Plan. The work is scheduled to be completed by the end of May 2025.
FRV removed the measure ‘Average number of days for first return to work within quarter’ (formally 3.1.1a). FRV previously reported (Q2 2023-24) the indicator as an ineffective measure of workforce health and safety as it did not account for the claims lodged at the end of the quarter.
1.3 Issues impacting data quality and data availability
Industrial action impacting data quality
Data quality for some FRV indicators continues to be affected by industrial action. For instance, FRV reports that false alarm data informing the measure ‘Number of properties with six or more false alarms on different days (rolling 12 months)’ are impacted by the ongoing Triple Zero Victoria industrial action since 18 December 2023. This action resulted in arbitrary coding of false alarms. FRV also note that the industrial actions by FRV staff reported in Q1 and Q2 continue to impact the rolling 12-month figures reported for this measure. FRV advise that the Q3 results for this measure are not appropriate for comparison with previous quarters.
As reported in Q2 for the measure ‘2.1.3b: Total operational fleet availability’, FRV report that protected industrial action taken by CFA District Mechanical Operators has meant that FRV cannot access total fleet availability data in regions for formal reporting. CFA note however this industrial action did not impact on appliance-related emergency response or related activities. As industrial action was lifted in February 2024, FSIM will continue to monitor this indicator in future reports.
FRV report that Q3 data reported for measure 2.1.3b reflects appliances in metropolitan Melbourne only.
FRV cyber-attack impacts on outcomes framework reporting
The December 2022 cyber-attack continues to impact FRV’s access to the Australian Incident Reporting System (AIRS) and FireCode reporting system. As reported previously, FRV cannot provide results for all operational measures.
FRV report on the following impacted measures using validated data from the TZV Computer Aided Dispatch (CAD) system:
- Number of properties with six or more false alarms on different days (rolling 12 months)
- Number of structure fire incidents
- Number of incidents other than structure fires and other non-fire related incidents
- Percentage of response to structure fire incidents within 7.7 minutes
- Percentage of response to EMR (emergency medical response) within 9.2 minutes.
FRV advise AIRS will be restored for reporting in the 2024-25 FY, and FireCode reporting system will not meet its previously reported deadline of June 2024 and is expected to be fully recovered by 30 September 2024.
Updated