Saturday, September 02, 2006

MONITORING CHARTS FOR ROUTINE EPI, August 2006.

MONITORING CHARTS FOR ROUTINE EXPANDED PROGRAMME ON IMMUNISATION (EPI), August 2006.


INTRODUCTION

There is a multitude of EPI monitoring charts or graphs of different formats from a variety of sources in use by health actors.

The five operational components of the Reaching Every District (RED) strategy proposed by the Global Alliance for Vaccines and Immunisation (GAVI) partners in 2003 (Mid-Level Management (MLM) Course for EPI Managers, WHO) are:
  • Re-establishing outreach vaccination: regular outreach visits to underserved communities
  • Supportive supervision: on-site training by supervisors
  • Strengthening links between community and service: regular meetings between community and health staff.
  • Monitoring for action: collecting and using quality data at all levels and through monitoring charts, maps for each facility
  • Planning and management of resources: better management of human and financial resources.
This contribution will be based on the monitoring for action.

‘Monitoring refers to reviewing, on continuous basis, the degree to which program activities are completed, targets are being met. This allows corrective action to be taken during program implementation’ (MSH&WHO Management of Drug Supply)

Monitoring is keeping track of ongoing operational activities, milestones or objectives attainment, the use of budget, staff time and other resources. It facilitates reprogramming of strategy, and eventual evaluation (MLM). Monitoring should be carried out at all levels using appropriate and adaptable tools.

Specifically, the progress of the implementation of any plan can be monitored by measuring achievement of certain milestones or intermediate objectives.

The objective of the immunisation programme is to reach high vaccination coverage rates of the target population through provision of quality services, using the available human, material and financial resources, so as to reduce morbidity and mortality, eliminate or eradicate the diseases using available vaccines. In order to measure all the above parameters in the programme, the monitoring indicators are categorised into key areas (MLM):

Input indicators – immunisation policies, resource inputs (human, material, financial). These are pre-requisite indicators for implementation.

Process indicators – examine functionality and quality of immunisation system and includes all activities: planning, financing, quality of service delivery, immunisation safety, assessment of the programme and its efficiency.

Output indicators – vaccination coverage rates, set objectives and milestones.

Impact indicators
– reduction of morbidity and mortality of targeted diseases

Outcome indicators – related to achievement of final goal e.g. polio eradication, neonatal tetanus elimination.
  • Monitoring of output indicators – vaccination coverage rates and set objectives - to improve quality of routine EPI will constitute this contribution:
    The vaccination coverage rate expressed in percentage for each EPI antigen at the end of each month is the total cumulative vaccinated number of target population since January of the year divided by the total cumulative target population of the same month since January multiplied by 100.
  • The drop out rate expressed also in percentage is used for multiple vaccines – DPT, Polio; or BCG and Measles; DPT1 and Measles, etc. It is calculated at the end of each month thus, as example: (Cumulative vaccinated number of 0-11m having received DPT1 - Cumulative vaccinated number of 0-11m having received DPT3) divided by Cumulative vaccinated number of 0-11m having received DPT1 multiplied by 100
These indicators are usually presented in the form of charts, graphs, or maps to enhance easy visual appreciation of their trends in relation to set objectives.
Monitoring charts, graphs and maps should:
  • Be used at all at levels of the health system in the same format.
  • Provide trends of evolution vaccination coverage rates of health areas, districts, regions, provinces and the nation at the end of each month using cumulative data since January of the year
  • Help health staff obtain information for improving and strengthening EPI activities
  • Assist in identifying training needs necessary to improve EPI activities.
  • Assist supportive supervision in assessing data compiling, analysis and interpretation, completeness and timeliness of routine reporting in the health system.
  • Enhance the analysis and interpretation of data collected at all levels for decision making and action by health actors at all levels
  • Facilitate visualization of the trends of vaccination coverage rate.
  • Be produced with computer in the same format at all levels of the health level
  • Be easily interpreted by health staff at all levels of health system world wide
  • Have a universal name.
  • Show the vaccination coverage rate that would be calculated from cumulative vaccination data at end of each month of the year
  • Be universally and scientifically valid.
  • Indicate whenever possible the proportion of the target population vaccinated at the end of each month of the year
  • Facilitate the identification of implementation problems and intervention in the community
  • Enhance feed back and dissemination of information just by using diagrams.
  • Be easy to reproduce locally by users.
  • Help target supervision to problem areas.
This contribution will be based only on charts or graphs for the monitoring of vaccination coverage rates because of the inability of health staff to correctly fill and interpret the numerous types of monitoring charts or graphs they use. There is more often no or very little action taken in the community because of the poor interpretation of present graphs.

GOAL
Propose charts or graphs for the monitoring of vaccination coverage rates using cumulative data in routine EPI


SPECIFIC OBJECTIVESi) Study some monitoring charts used by health staff.
ii) Present and describe the proposed monitoring graphs
iii) Propose community monitoring tools for vaccination coverage rate


METHOD
Monitoring charts in some reference documents and in Bamenda Health District are reviewed and their data used to produce graphs to explain this contribution to data analysis and information management for decision making.

The charts studied are:
- Cumulative Coverage and drop out monitoring chart, in Immunization Essentials, A practical field guide.

- Monthly monitoring of vaccination coverage rate in Huambo Province in 2004 in Angola. The Reaching Every District (RED) approach of routine immunization service delivery, presentation during the STOP 22 Training May 2006

- A monitoring chart with twenty rows

- Bamenda (Cameroon) Health District monitoring graphs August 2005
Alternative health facility monitoring chart and community monitoring tools of vaccination coverage rate are proposed.

**All the diagrams are presented at the end of the write up in order to facilitate the insertion of this contribution to improve monitoring charts in EPI into the web site: http://www.mfonfudaniel.blogspot.com/.
RESULTS
a) Cumulative Coverage and drop out monitoring chart, in Immunization Essentials, A practical field guide.

Cumulative percentages are placed in the principal y-axis while cumulative target population is on the secondary y-axis. It is like the World Health Organisation (WHO) model although in WHO monitoring chart the cumulative target population is on the principal y-axis. Nevertheless in some WHO documents cumulative percentages and target population are placed indifferently either on the primary or secondary y-axes; sometimes target populations are put on both axes. It contains 13 rows with the first row serving as zero. It has two columns for each month each month except for January, one for children vaccinated in the month and the other for total (cumulative number vaccinated since January). It has an oblique line running from 0 at the principal y-axis to the 13th row at the secondary y-axis, which serves as a fixed objective. The drop out rate is calculated on the chart. It does not give the vaccination coverage rate that is usually calculated from cumulative data. The WHO chart shows the proportion of the total target population vaccinated at the end of the month read by extension on the secondary y-axis. Some field workers say it shows the ‘achievement rate of the objective’ or ‘cumulative vaccination coverage’. It cannot be produced by computer in the present format. Using the data on the chart a graph has been produced with the computer that shows obliquely the vaccination coverage rate as would be calculated from cumulative data. The objective can be set using one of oblique lines that indicate a vaccination coverage rate; the proportion of the annual target population vaccinated can be read from secondary axis by projecting the point on the month horizontally to it. One other graph has been developed with the computer that shows monthly evolution of vaccination coverage rate and drop out rate in lines calculated from cumulative data.

b) Monthly monitoring of vaccination coverage rate in Huambo Province in 2004 in Angola.The chart is similar to the one described above; the percentage is at the secondary y-axis. There is only one column per month, offering a possibility to produce it with the computer. The proportion of the annual target population is calculated instead of the vaccination coverage rate using the corresponding cumulative data. Supplementary graphs were also produced from the data of Huambo Province; they show high vaccination coverage rates for DPT1 and DPT3 increasing suddenly from January, and high drop out rate.

c) A monitoring chart with twenty rows.

The chart is similar to that of 13 rows; the percentage is at the secondary y-axis. It cannot be produced with the computer. The plotting of data and interpretation of this chart by health staff is extremely difficult.

d) Bamenda Health District Monitoring graphs August 2005.

The ‘oblique chart’ is based on the monitoring chart in the Norms and Standards of the Expanded Programme on Immunisation (EPI) of Cameroon. It is a square divided into 12 rows and 12 columns, with the cumulative target population at the primary y-axis and the vaccination coverage rate at the secondary y-axis. It shows the vaccination coverage rate between two oblique lines and the proportion of the annual target population vaccinated from the point on the month projected horizontally on the secondary y-axis. It is produced with the computer. Supplementary graphs were programmed and produced to enhance the appreciation of the monthly performance of each health area, and the monthly evolution of vaccination coverage rate in the course of the year.

e) Proposed chart for the monitoring of vaccination coverage rate – read between oblique lines.
- The chart is a square of 12 principal gridlines (vertical and horizontal) at equal interval.

- The abscise (X): The principal line corresponds to the end of each month from January to December. The monthly cumulative number of vaccinated target since January is plotted on the vertical gridlines of this axis.

- The primary ordinate (Y) is for the cumulative target population. Divide the known or estimated target population at the beginning of the year by 12 to obtain the interval between two principal lines. The first principal line is equal to the value of the interval, the second is the value of the interval multiplied by 2; continue thus until the 12th principal line which should correspond to the annual target population.

- The secondary ordinate indicates the vaccination coverage rates in percentage. Oblique lines connect the zero point of the graph to percentages on the secondary ordinate. The space between two oblique lines shows the vaccination coverage rate range in percentage. Projecting a horizontal line from the plotted point of the month to secondary ordinate gives the proportion of the annual target population vaccinated for the given month.

When to use it:
At the end of the month after having made the synthesis of vaccination data. It can also be used for other health activities for which the annual target populations are known or could be estimated at the beginning of the year - general consultations, ANC, IWC, etc.

How to use it:
Fill the name of country, the year; the name of the Province/Region, Health District, Health Area/Health Centre, depending on the level; the annual total population of the level concerned; the vaccines; the annual target population; and the set objective of the vaccination coverage rate for the year in percentage. Indicate the set objective on one of the oblique lines that corresponds to it (bold the line). Divide the target population by 12 and write the values at the principal lines of the ordinates (Y) as described above. From the monthly EPI synthesis extract the number of the target population vaccinated for the month according to the vaccines considered and fill the table below the graph. Calculate the cumulative number of the target population vaccinated for the month since January. Plot this cumulative number at the end of each month on the corresponding principal line of the abscise (X). Joint the points plotted; use a specific style for each vaccine curve. Compare the curve thus produced to the set objective line for the year: if the curve is above the oblique line objective, the vaccination coverage rate in the community may be good; if the curve is below the vaccination coverage rate may be low. Calculate the drop out rate according to the formula provided and fill the corresponding cell for the month. In order to know exactly the vaccination status, calculate the vaccination coverage rate at the end of each month with the cumulative data for the month using the appropriate formula and fill the corresponding cell. Use the information thus obtained to make decisions, and carry out activities both in the community and at the health facility to consolidate or to improve the vaccination coverage rate.

Who should use it:
It should be used at all levels of the health system: Health Area, Health Facility, Health District, Health Province, Heath Region, and Ministry of Public Health.

Advantages of the chart:
Only data from the EPI monthly report are used; no vaccination coverage rate is calculated before hand. It permits the estimation and the visual appreciation of the evolution of vaccination coverage rate during the year. One obtains information for decision making and local intervention. It facilitates supervision; obliges the supervisor to verify the registers and monthly returns, and to propose actions to improve and consolidate the vaccination coverage rate. It can be produced and programmed with computer in its present format.

Disadvantage:
The increasing appearance of the graph may give a false impression that all is going on well; therefore great care should be taken in interpreting it.

f) Proposed chart for the monitoring of vaccination coverage rate calculated from cumulative data.- It is a simple chart producing curves in lines.

- The abscise (X): The principal line corresponds to the end of each month from January to December. The vaccination coverage rate calculated from monthly cumulative data is plotted on the vertical gridline of the respective month of this axis.

- The primary ordinate (Y) shows the range of the vaccination coverage rate with percentages indicated against the principal gridline.

- When to use it: At the end of the month after having made the synthesis of vaccination report and calculated the vaccination coverage rate using cumulative data. It can also be used for other health activities for which the monthly coverage rate can be calculated.

How to use it:
Fill the name of country, the year; the name of the Province/Region, Health District, Health Area/Health Centre; the annual total population of the level concerned; the vaccines; the annual target population; and the set objective of the vaccination coverage rate for the year in percentage. Indicate the set objective on one of the horizontal gridline of the y-axis lines that corresponds to it (bold the line). From the monthly EPI returns extract the number of the target population vaccinated for the month according to the vaccines considered and fill the table below the graph. Calculate the cumulative number of the target population vaccinated for the month since January. Calculate the vaccination coverage rate using the cumulative data at the end of each month according to the formula provided, fill the corresponding cell of the table and plot it on the principal line of the abscise (X) for the month. Joint the points plotted; use a specific style for each vaccine curve. Compare the curve thus produced to the set objective line for the year: if the curve is above the objective line, the vaccination coverage rate in the community may be good; if the curve is below the vaccination coverage rate is may be low. Calculate the drop out rate according to the formula provided and fill the corresponding cell for the month in the table. Use the information thus obtained to make decisions, and carry out activities in the community and at the health facility to consolidate or to improve the vaccination coverage rate.

Who should use it:
It should be used at all levels of the health system: Health Area, Health facility, Health District, Province, Region, and Ministry of Public Health.

Advantages of the chart:
It permits the horizontal visualization of the evolution of exact calculated vaccination coverage rates using cumulative data during the year. It facilitates the appreciation of trends, identification anomalies, and taking of corrective measures monthly.

g) Community monitoring tools of vaccination coverage rate.
The tools have been developed within the premise of strengthening links between community and service. At the first level health facilities in most countries there are dialogue structures or organs (Health Committee) that promote community participation in health programmes including EPI. There are community mobilisers or animators who work in collaboration with health staff to sensitize the population on vaccination, and carry out active search for drop outs and active surveillance in the community. Proximity social mobilisation that is usually done will be facilitated by using the form for assessing the vaccination status of children less than one year. The synthesis of the data collected will provide information that will first of be motivating to staff and community animators, and then serve as concrete fact and information for feedback to the community thereby stirring up the parents of the various quarters to bring out their children for vaccination. The data collection and synthesis forms are easy to fill and produce. This community monitoring does not necessarily need any scientific approach of sampling because it is used by community mobilisers in their respective quarters.


DISCUSSION

The essence of the monitoring of the vaccination coverage rate is action oriented based on the information obtained from the interpretation of results provided by monitoring tools; the better the quality of the monitoring tool the more accurate and effective the information as shown by the supplementary graphs produced with data of monitoring charts of reference documents in this write up.

The EPI has a spiral target population with a cross section being a year starting from January to December. The population does not evolve in a straight line but in a spiral form and as such the vaccination coverage rate cannot start from zero at the beginning of the year. It has been observed that surveys carried out in the community at any time of the year to evaluate the vaccination coverage rate produce results that correspond to or are more compatible with vaccination coverage rates calculated from monthly cumulative data than those calculated from cumulative percentages or with monthly population that is the same for each month of the year.

The author, based on his personal working experienced, publications, and field evaluation, has proposed some charts for the monitoring of vaccination coverage rates using cumulative data:

i) At health service level with administrative EPI data
  • Monitoring chart with oblique lines showing vaccination coverage rates obtained from cumulative data at the end of each month. The vaccination coverage rate is estimated between two oblique lines. This chart is good for vaccination coverage rates that are below 100%. The evolution of the vaccination coverage rate should be interpreted carefully because it is increasing within a range of percentage from January and not in absolute percentage.
  • Monitoring chart or graphs with horizontal lines showing the monthly evolution of vaccination coverage rate calculated from cumulative data at the end of each month. This chart can be used for vaccination coverage rates below and above 100%, but the vaccination coverage rates have to be first of all calculated. This chart shows that the objective should be attained each month but not at the end of the year. It is the simplest and most explicit chart.
  • Monitoring chart at the level of the Health District that show the monthly performance of each health area or health centre at the end of month using bars should be elaborated as in Bamenda Health District (August 2005); same should be done at the level of the Province/Region and Ministry of Public Health.
ii) Ccommunity proximity social mobilisation should be based on facts that are obtained by the intermittent assessment of vaccination status of children 0 – 11 months in the community by social mobilisers/animators and health staff of the health centre, using the appropriate community monitoring tools proposed in this write up. By so doing a strong community adhesion to and participation in EPI will be achieved. The results thus obtained could be compared with those of routine administrative EPI data.
  • Form for the Community Monitoring of vaccination coverage rate of children 0 - 11 months
  • Form for the Synthesis of Community monitoring of vaccination coverage rate of children 0 - 11 months.

CONCLUSION

In most reference documents on EPI the calculation of vaccination coverage rate using cumulative data is clearly defined. It is therefore necessary that monitoring charts should be designed to produce the same vaccination coverage rates so that they can be easily visualized; otherwise health staff will resort to calculating the vaccination coverage rates, or create other tables or graphs to enable them appreciate their performance, or will be confused.

It is highly recommended these proposed charts and those existing in the field should be tested so that more efficient universal tools for the monitoring of vaccination coverage rates calculated from cumulative data in the Expanded Program on Immunization could be adopted and put in place in order to ameliorate the performance of health actors.

The author is available to provide his modest contribution to the improvement of monitoring charts or graphs to be used by health services for the monitoring of vaccination coverage rates in EPI.

Acknowledgement should be made to the author for the use of extracts of this document.

REFERENCES:1) Immunization Essentials, A practical field guide. USAID, ISBN 0-9742991, October 2003.

2) Managing drug supply, Second edition, 1997, Management Sciences for Health & World Health Organisation.

3) Mid-Level Management (MLM) Course for EPI Managers, WHO

4) DQA reports for Cameroon, WHO

5) Immunization in Practice DIP-755; WHO/IVB/04.06

6) Expanded Programme on Immunisation (EPI) in Bamenda health district- Cameroon from 1999 – August 2005 (September 2005); Dr Mfonfu Daniel; web site: www. mfonfudaniel.blogspot.com

7) Demographic and health survey 2004, Cameroon; Vaccination coverage rate in children 12-23 months

8) Normes et Standards du Programme Elargi de Vaccination (PEV), Cameroun, Ministère de la Santé Publique, Janvier 2005.
**All the diagrams are presented at the end of the write up in order to facilitate the insertion of this contribution to improve monitoring charts in EPI into the web site: http://www.mfonfudaniel.blogspot.com/.

No comments: