ECDE DIPLOMA COURSE OUTLINE FOR RESEARCH, MONITORING AND EVALUATION NOTES

ECDE DIPLOMA COURSE OUTLINE FOR RESEARCH, MONITORING AND EVALUATION

  1. Meaning of terms.
  2. Research.
  3. Monitoring.
  1. Importance of research in ECDE programmes.
  2. Understanding children and predicting their behaviours.
  3. Improving parenting and care.
  1. Improving teaching and learning.

Characteristics of research.

  1. Categories of research.
  2. Cross-sectional.
  3. Longitudinal.
  1. Experimental.
  2. Basic research.
  3. Action research.
  1. Historical research.
  2. General research methods in psychology and human learning.
  3. Case studies.
  4. Psychological tests.
  1. Observation
  2. Survey method.
  3. Experimental method.
  1. Ethnographic method.
  2. Achievement tests.
  3. Rating scales.
  4. Qualitative and quantitative research.
  5. Definition of terms; Qualitative and quantitative research.
  6. Characteristics of Qualitative and quantitative research.
  1. Qualitative research methods.
  1. Quantitative research methods.
  1. Participatory Learning and Action (PLA) and appreciative inquiry approaches. (AIA).

 

  1. Origin .
  1. Designing a research study.
  2. Identifying a research topic from
  1. Deciding on the population ,sample and sampling methods.
  1. Deciding on fitting research category.
  2. Deciding on data collection procedures and organization.
  3. Deciding on data analysis procedures and presentation.
  4. Sample and sampling methods.
  1. Data analysis and presentation procedures.
  1. Research proposal.
  1. Research report.
  1. Ethical consideration in research.
  1. Monitoring and evaluation.
  1. Basic statistics in Education.

References .

Course lecturer:  IsaackGachuiga, (Dip(ECDE),B.Ed, M.Ed)

 

DEFINITION AND IMPORTANCE OF RESEARCH AND EVALUUATION

DEFINITIONS

Research is defined as:

Monitoring: Monitoring is defined as a systematic and continuous collection of data which is analyzed to show the progress achieved in a project over a period. This progress is measured against the objectives of the project.

Evaluation: evaluation is defined as a systematic and continuous collection of data which is analyzed and is used to make certain judgments about a project. Evaluation assesses the effects of the activities in the project on the beneficiaries (those who are meant to benefit from the project)./it is the process of making judgement of the value of a project.

CHARACTERISTICS OF RESEARCH

IMPORTANCE OF RESEARCH IN ECDE PROGRAMMES

Research provides information which may help:

CATEGORIES OF RESEARCH AND RESEARCH DESIGNS

CATEGORIES OF RESEARCH

  1. Basic Research

The main aim of basic research is to add new knowledge. It does not necessarily produce results of immediate practical application. It is mostly based on testing or applying theory. However, not all basic research is based on theory. A theory consists of systematically organized ideas and observable data which is used to predict or explain behavior.

  1. Applied Research

Applied research is undertaken to solve an immediate practical problem. In action research knowledge which has been gained through theory can be applied to solve practical problems. Not all applied researches are however based on theory. Whether based on theory or not, research should be systematic and well organized in order to obtain valid data.

  1. Action Research

Action research is a type of applied research. Action research is used to solve specific problems. It is aimed at improving practices and is usually carried out by practitioners such as teachers and administrators. Action research uses modified basic research guidelines. Action research is supposed to improve practices, for example, provide ideas on better methods of teaching young children. It can be carried out by individuals, teams or organizations. Research undertaken by teams is sometimes referred to as collaborative research.

Action research should be organized in a systematic way to minimize bias and misinterpretation Classroom teachers ,ECDEcentres or schools can use action research to improve teaching-learning methodologies. This can lead to improvement in learning environments and pupil performance. Action research can also be done on a large scale, for example, during piloting and implementation of a curriculum, a lot of data is collected by teachers, education field officers and curriculum developers. This data is used to decide on areas that need to be modified or strengthened. action research is characterized by the following features:

Strengths

Limitations.

Basic Research Designs

Descriptive research

Descriptive research is used for observing and recording behaviour. It consists of naturalistic observation, participant observation, interviews, questionnaires, case studies, ethnographic studies and historical research.

  1. Naturalistic observation research.

In naturalistic research, the participants are studied in their real natural world. One can, for   example, do a naturalistic research by observing children as they play in the neighborhood, or observe them in classroom.

Advantage.

Limitations.

  1. Participation

Participation observation occurs when the observer or researcher is actively involved as a participant in the research activity or intervention. The researcher takes time to observe what he/she researching on and the rest of the time participates in the activities that the people he/she is studying  are involved in. the researcher observes whatever he is supposed to observe over a period of time. He takes detailed  notes. The information collected help to reveal the progress made, patterns and trends.

Strengths

  Limitations

Interviews and questionnaires are also used to obtain descriptive data. They are described in more detail in Unit Three.

  1. Case studies

A case study is an-depth look at an individual or a single entity. A case study of a person can be done by tracing the case history from birth and noting the experiences and environments that the person has been through. Several methods such as published biographical materials, observation, clinical interviews, medical examination and tests, or achievement tests can be used to collect data for case studies. Such case studies are helpful for persons in need of guidance and counseling, medical treatment and rehabilitation. The case study method can also be used of study groups or projects. It can provide data on the history of the group, group dynamics and processes.

Advantages

Limitations

  1. Ethnographic studies

An ethnographic study is an in-depth description and interpretation of behaviours in a cultural group. The researcher lives among the group, participates in the group activities and collects information through interviews, observation and study of documents.

Strengths

Limitations

  1. Historical Research

Historical research is the systematic and objective study which evaluates and synthesizes data collected in order to establish facts and draw conclusions concerning past events. In order to obtain credible facts and carry out a good historical research it is important to ensure that:

Strengths

Limitations

Correlational Research

Correlational design is a design in which the researcher gathers information without changing the participant’s experiences and examine relations between variables. Variables are factors which may influence changes in a population. Examples of variables include age, formal education level, gender, religious background and socio-economic level. Correlation refers to the degree of relationship between two or more variables. A correlation coefficient  ranges from1.0 to 1.0. A correlation of 0 means that there is no relationship between two variables. A positive correlation indicates that the two variables tend to change in the same direction. For example, the older people get the more patient they become. A negative correlation between two variables indicates that they tend to change in the opposite direction. For example, the older one gets the slower the physical movements. When two variables are correlated, they can be used to predict one another. Two positively correlated variables can cause one another or both can be caused by another variable.

Example of positively correlated variables.

 

 

 

Another example, if you give 3 tests of maths, history and geography to a group of pupils. The results of the tests can be analyzed statistically to obtain correlation coefficients. If the correlation coefficient between the marks and geography is 80 while that between maths and history is 50, we can conclude that maths is likely to be a better predictor of performance in geography than in history. Correlation, however, does not mean causation. From example, if parent-child relationship correlates with high academic performance, you cannot say for certain, that high academic performance was caused by the parent-child relationship because there are many factors that influence academic performance. Also academic performance can influence parent-child relationship.

Strengths

Limitations

Experimental research design

Experimental research design comprises experimental design, modified experimental design and natural experiment.

  1. Experimental design

This is a research design in which participants are randomly assigned to two or more treatment conditions. In such a design, one studies the effect that manipulating an independent variable has on a dependent variable. An independent variable is the one anticipated or hypothesised to cause a change in the other variable known as the dependent variable. Most experimental researches are conducted in laboratories to allow maximum control of the variables. A treatment such as a new teaching method is introduced in one group and not in another similar group which is referred to as a control group. The two groups are matched for all factors except the teaching method.

 

Strengths

 

Limitations

  1. Modified experimental designs
 

Field experiments are a type of modified experimental design. Field experiments are designs in which the participants are randomly assigned to treatment conditions in natural settings. Treatment refers to a condition such-as training, teaching method or a type of reinforcement. For example, one can randomly assign children from one class into two groups. One group is taught maths by a teacher who only works all the examples on the chalk board. In the other group, the teacher works the examples on the chalk board and then children practice in their exercise books. After some lessons, children are tested to find out if there is a difference in the performance of the two groups.

 

Strengths

Limitations

 

iii. Natural experiment

This is a design in which the researcher studies already existing treatments in natural settings by .carefully selecting groups of participants with similar characteristics. One can, for example, compare pre-schools, carefully selecting the participants to ensure they have similar characteristics. In natural experiments, one can study the same group before and after the treatment and compare it with a group that has not undergone the treatment.

 

Strengths

Limitations

 

Time-span research designs

Longitudinal design

Longitudinal design is a research in which participants are studied repeatedly at different ages over a period of time. The time span may range from months to several years. The same group of children can be studied on their performance in maths or social skills at the age of 3, 5 and 7 years.

Strengths

Limitations

studies.

 

  1. ii) Cross sectional design

This is a research in which groups of participants of different ages are studied at the same point in time. One can study children’s academic aspirations by comparing at the same time responses of 5, 7 and 9 year-olds.

 

Strengths

 

Problems of conducting cross sectional research

 

 

GENERAL RESEARCH METHODS IN PSYCHOLOGY AND HUMAN LEARNING

Observation

  1. Naturalistic observation involves recording behaviour of interest in the natural setting. This helps the researcher to observe things as they are or as they really happen in real life.

 

    Strengths

Limitations

  1. Structured observation involves observation of behaviour in a laboratory setting where conditions are the same for all participants.

 

Procedures used in systematic observation

 

Strengths

 

Limitations

 

Self reports

  1. Clinical interview

This is a flexible interview procedure in which the researcher obtains a comprehensive account of the participant’s thoughts and behaviour by questioning the participant. Jean Piaget used this method in his studies. It is also used by doctors, psychologists, psychiatrists, and counsellors to collect information from clients.

 

Strengths

 

Limitations

  1. Structured interviews, questionnaires and tests

In these instruments, every participant responds to the same questions in the same way.

 

 

Strengths

Limitations

 

iii)     Interview schedules

Interview schedules involve face-to-face and one-to-one sessions.

 

Advantages

 

Disadvantages

 

Guidelines for doing a good interview

 

  1. iv) Focus group discussions (FGDs)

Focus group discussions are similar to interviews but involve more than one person. They are discussions held with a group of people. The number should be 6-10. FGD is an effective method of data collection in qualitative studies, for example, those on opinions, attitudes, likes, dislikes or aspirations.

Strengths

Most of the information collected is correct. This is because the group members tend to censure one another’s responses. No respondent will dare tell a lie when she/he knows that those aroundher/him know everything about her/him.

 

Limitations

 

Guidelines of doing a good FGD

 

 

  1. v) Questionnaires

These are questions mailed or given to respondents to answer on their own. Questionnaires can be closed or open-ended. In open-ended questions, respondents are free to respond to questions in the way they choose. Respondents could, for example, be asked “What is the cause of discipline problems in our schools?” The answers are likely to vary from one respondent to another. In close-ended questionnaires, answers are provided and the respondent is asked to choose the answer. An example, “Indicate by an X the causes of discipline problems in own schools among the options given below.” Answers to close-ended questions reflect facts and opinions more accurately. However, they give no room for other factors which could be significant and true.

 

An example of close-ended questionnaire/interview

  1. Since completing your training as a teacher have you had any problems obtaining a job?
    Yes No
  2. How often was this, the case?

Always                  Most of the time                     Hardly                         Never

  1. What among the following fall within your immediate plans?
    Go to the university Look for another job
    Stay where I am                            Take leave for 2 years

An example of an open ended questionnaire

  1. What would you like to do as soon as you complete the ECDE Diploma training?
  2. What are the reasons for your choice of this action?
  3. What else can you do if your first plan does not succeed?

Advantages of questionnaires

 

Disadvantages

 

Guidelines of developing a good questionnaire

 

  1. vi) Case studies and clinical method

The case study method is also referred to as clinical method in psychological studies. It involves getting a picture of an individual’s psychological functioning. Data is obtained by combining interviews, observations, text scores and sometimes psycho-physiological assessments. The method is used a lot by doctors, psychologists, social workers and counselors. The case study method can also be used to study a group or youth group or an organization such as an ECD centre or primary school. Both qualitative and quantitative methods can be used to collect data.

 

Strengths

 

Limitations

 

Psycho-physiological methods

Psycho-physiological methods measure the relationship between behaviour and physiological conditions. Some of the common methods take measures of autonomic nervous system (heart rate, respiration, and hormone stress levels) and measures of brain functioning such as electroencephalogram (EEG), event-related potentials (ERPs) and functional magnetic resonance imaging(fMRI).

Strengths

Limitations

 

Ethnography

In ethnography, the researcher becomes a participant observer of a culture or distinct social group. He lives with them during the research period. He participates in all their activities. He shares their life with them including their joys and sorrows. During his stay with them he collects extensive information on the culture of the people, their traditions, beliefs, values, aspirations and practices.

 

Strengths

 

Limitations

Psychological texts

Psychological tests are used to measure and assess human behaviour. Some of the psychological tests are used to assess intelligence, vocational interests, values, attitudes, scholastic achievement or personality. A person’s performance on these tests is compared to others in a similar situation. Some of the tests are administered on individual basis while others are administered in group settings.

Strengths

 

Limitations

 

Survey Method

The survey method is used to collect a lot of data from a large number of people within a very short period of time. Surveys are, for example, used to study types of diseases found in an area, opinions of people on discipline in schools, services available in homesteads, political opinions or attitudes. Surveys usually use questionnaires or interviews. Questions can be administered to participants by mail. Interviews are done through either telephones or person to person.

Strengths

 

Limitations

 

Experimental method

Details of this method are presented in Unit Two. Suffice to say that experimental research method is possibly the most scientific of the research methods. It tests for cause and effect of behaviour. It is crucial to understanding and predicting behaviour.

Strengths of the method

 

Limitations

 

Self description

Individuals can provide important information for research studies through self description. They could write their life stories, through compositions, diaries, paintings and drawings or drama. The accuracy and reliability of such data will depend on how much the individuals want to disclose about themselves, the purpose and context of the research.

 

Correlation method

Ir. correlation method, two sets of variables or attributes are compared to see the extent to which they are related and if they can be used to predict each other. The correlation between two sets of variables is indicated by means of correlation coefficient which may be positive or negative. A positive coefficient ranges from 0 to 1.0 while a negative coefficient ranges from 0 to 1.0. One is a perfect correlation and 0 indicates that there is no correlation between two sets of variables. Details of this method are provided in Unit Two.

 

Achievement tests

Achievements tests measure what the student has learnt or the skills he/she has mastered. Teachers administer many achievements tests based on subjects during term time, end of term or year. External examinations conducted by Kenya National Examinations Council (KNEC) are also achievement tests. Achievement tests are described in more detail in Unit Ten.

 

Rating techniques

Rating technique is a type of observational or self descriptive method whereby besides categorizing behaviour or items to be observed, one also classifies behaviour according to evaluative characteristics. One makes qualitative judgments. Rating techniques use rating scales. The scale is a number of positions which are defined through brief descriptive statements.

 

Example of a rating scale

Indicate by an X your rating of the methods teachers use to maintain class discipline.

 

Method Often Sometimes Rarely
Praises children      
Gives physical reward      
Pats children      
Scolds children      
Slaps children      
Beats children      
Allows children a lot of time to play      

Strengths

 

Challenges in use of rating scales

 

QUANTITATIVE AND QUALITATIVE RESEARCHMETHODS

 

Definitions

Qualitative research collects information that shows how people in an area live and function as a community. The information collected consists of the views, opinions, feelings, values, norms aspirations, achievements and problems of a community group. Qualitative methods help to build an in-depth picture of how a relatively small group functions, how members relate and how different aspects of their lives are linked. Qualitative methods also indicate how people understand their own situation, their aspirations, problems and what their priorities are. Most of the data of qualitative research is presented through descriptions. The research describes what most of the people said or felt. It is difficult to use numerical form to analyze. Qualitative research does not use numerical data like percentages and correlation coefficients extensively.

 

Quantitative research is a method of carrying out an inquiry that emphasizes measurement. The data collected is analyzed using percentages, correlation coefficients and other statistical methods. This is because quantitative research methods collect data that can be analyzed in a numerical form. They pose the questions like who, what, when, where, how much, how often? Things are measured or counted or close-ended questions asked so that answers can be coded and analyzed numerically. Statistical analysis can be used on quantitative data to give precise description in terms of averages, ratios, ranges or percentages.

 

Characteristics of qualitative and quantitative research methods

Qualitative

 

Quantitative research

 

Strengths and limitation of qualitative and quantitative research

Qualitative research

Strengths and usefulness

 

Limitations

 

Quantitative research

Strengths and usefulness

 

Limitations

 

Activity

Characteristics

Strengths

Limitations

 

Qualitative research methods

Qualitative research uses a variety of methods. Some of these methods including observation, interviews, personal description, focus group discussions and case studies are described in Unit Three. This unit will present additional methods used in qualitative research. These are the main methods used in the Participatory Learning and Action (PLA) research. PLA is discussed in greater details in chapter 5. The PLA qualitative research methods include mapping, transects, historical profiles, seasonal calendar, daily calendar, ranking and scoring, Venn diagrams and study of secondary information.

 

Social and resource mapping

Social and resource mapping consists of the community members drawing a map to show the location of physical features (mountains, rivers, valleys) and resources are available. The resources they map include homesteads, water sources, institutions (schools, health centres), transport network, shops and factories. A social resource map enables community members to analyse and understand their area better. They are able to appreciate what they have. They also reflect on how they can use what they have better. A social map could indicate differences between what families possess; differences among community members in such aspects as educational level, ethnic groups, religious beliefs, traditions and property owned.

 

Procedure

 

Advantages of mapping

 

Activity

 

Transect walk

A transect is a walk across a section of the area occupied by a community. The group that makes the transect walks observes and learns about the physical features, soils, vegetation, institutions and services, infrastructure (roads, telephone lines, electricity lines) and land use patterns.

Procedure

Advantages of a transect

 

Historical profile or timeline

A historical profile shows the main events that have occurred in a community within a certain period of time. It shows trends, patterns and changes over time, recurring and one time events. Changes can be cultural, social, economic or geographical.

Procedure

A       A  historical profile of Kenya 1991-2006

 

 

Year Event Effect Coping mechanism
1991 Ethnic clashes, floods Displacement, death, suspicion Resettlement, relief supplies, reconciliation
1992 General elections Suspicions Campaign, media
1997 Ethnic clashes/ general elections Displacement, suspicion, drop in tourists Resettlement, reconciliation campaign, advertisement for tourists
2002

 

 

General elections People hopeful Rehabilitation of cash crops/ livestock and industries
2005/6 Drought Lack of food, inadequate water, increase in childhood illnesses Emergency food, relief by government, NGOs and bilateral bodies

 

 

 

 

 

 

 

 

 

 

 

Advantages of historical profiles

 

Seasonal calendar

Aseasonal calendar can be used to analyze and record different conditions and activities occurringin different seasons. Symbols can be used to represent months or seasons and the activities occurring in different seasons. The group can start by recording the major features of seasons, for example, rain or temperatures. Then they can record the other aspects of interest.

 

Month Weather conditions Diseases & conditions Activities and conditions
January Hot, dry Harvesting, enough food, enough pasture
February Hot, dry Enough food, lack of pasture
March Hot, dry Preparing land, lack of pasture
April Warm, rain Malaria Planting, enough pasture
May Warm, rain Inadequate diet Weeding, enough pasture,
June Cool, dry Colds and pneumonia Weeding
July Cool, dry   Weeding
August Cool, dry Enough food Harvesting, enough pasture
September Hot, dry Enough food Preparing land, lack of pasture
October Hot, dry Inadequate diet Planting, lack of pasture
November Cool, rain Malaria Weeding, enough pasture
December Cool, rain   Weeding, enough pasture

Advantages

 

Daily schedule

It is used to identify who does what during different times of the day. It shows the number of hours people in a community spend doing different activities like working and relaxing. It also shows the division of labour by gender. It can be used to create awareness on the fair sharing of responsibilities between gender. Different symbols can be used to represent different activities and time.

 

Daily schedule for men and women

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Ranking and scoring

Ranking means putting various issues of community life in order of importance, value or preference. Scoring means assigning values to different issues according to some convenient scale. In participatory community development, people are often asked to rank priorities, problems, needs, constraints, preferences, or resources.

 

 

 

Procedure

Participants identified large families as the biggest problem followed by poverty.

Preference ranking done on individual basis

 

Problems P1 P2 P3 P4 P5 Total
P: Participant

Participants identified large families as the biggest problems followed by poverty.

Rank

Diseases 1 2 1 4 5 13 3
Poverty 3 3 2 3 3 14 2
Access to education 5 1 3 2 1 12 4
Sanitation 1 4 4 1 2 12 4
Large Families 4 5 5 5 4 23 1

 

Pair wise ranking

This is done by building a matrix where the problems, for example, are listed on the vertical axis and on the horizontal axis as shown below. Pair wise ranking gives better results when done on the individual or small groups and comparing a few problems at a time.

Pair wise Ranking

  Disease Poverty Education Sanitation Large Families Poor Organization
Disease X Disease Disease Disease Disease Disease
Poverty X X Poverty Poverty Poverty Poverty
Education X X X Education Education Education
Sanitation X X X X Sanitation Sanitation
Large Families X X X X X Poor Organization
Poor Organization X X x x x x

 

Procedure

 

 

Problems ranking based on pairwise ranking

Problems Score Rank
Disease 5 1
Poverty 4 2
Education 3 3
Sanitation 2 4
Large Families 0 6
Poor Organization 1 5

 

Advantages of preference and pairwise ranking

 

Matrix scoring

In matrix scoring, problems, constraints or solutions are compared against selected criteria.

Procedure

 

 

 

 

Ranking candidates who have applied for a job

Creteria/ Ranking Alima Yusuf Adan

 

Hardworking 2nd 1st 3rd
Intelligent 1st 2nd 3rd
Team Player 3rd 1st 2nd
Total 6 4 8
Average 2 1.3 2.6

 

Advantages

 

Venn or chapati diagram

Venn diagram shows relationship between actors, institutions or factors. The relationship is indicated by the position of circular shapes in relation to each other. The importance of the ft or institution is shown by the size of the circle as perceived by the key stakeholders.

Procedure

 

       Interpretation of circles by size or position

Separate Circles Little or no contact
Touching circles Information passes between institutions
Small overlap Some cooperation in decision making.

Resources and implementation

Large overlap A lot cooperation in decision making, resources and implementation.

 

 

 

Creating village resources management plans (VRMPs)

Purpose

The plan serves a variety of purposes and audiences.

  1. It is a record of community’s development projects. These projects are ranked in order of their importance from the first to the last. The plans also show the resources available in the community which can be used to carry out the projects identified. This record is used to plan activities to be carried out in the development projects.

 

  1. The Sub-location Development Committees use the document for planning and implementation of community projects. They forward it to the District Development Committee for possible funding.

 

 

The plans contain several elements:

  1. Development priorities as agreed on by the community.
  2. Proposed activities and resources required to implement these activities.
  1. Work schedules.
  2. Identification of areas where the community needs external assistance.
  3. Costs of various activities.

 

Study of Secondary Information

Secondary data is information that has already been collected and documented by others. The main sources of secondary data are (i) published sources and (ii) unpublished sources

 

Published sources

 

Unpublished sources

 

Strengths of the method

 

Limitations

 

 

 

Creative arts

Data can also be  collected through creative arts such as drawings, use of symbols, songs and symbols, songs and drama these methods are particularly useful when collecting data from children. drawings and symbols can be used to illustrate something one is trying to explain, illustrate ideas or criteria for preference. these drawings and symbols can reveal ones feelings, aspirations or life experience. in songs and drama, participants can reveal their emotions and feeling, concerns, priorities, level of awareness and life experiences.

 

Quantitative research methods

Quantitative research methods include structure interviews questionnaires, rating scales

,observation, psychological and achievement tests. These methods are discussed in unit three and unit ten study of secondary information can also provide quantitative data

 

Unit five

Definition of participatory learning and action (pla)

Pla is both a philosophy and also an approach of bringing about change and development in communities. it is a philosophy because it is based on the principle that community members can brings about their own change and development. People are able to analyses their needs, aspirations, goals, problems and resources. they are able to come up with solutions to solve their problems. they are also able to identify what to do to meet their needs.pla is an approach because it uses different methods to collect data. these methods include for example

Interviews, focus group discussions (fgds),social mapping, seasonal calendars,venn diagrams and transect walk. It is a form of research which considers the interrelatedness of different aspects of life of a community for example the relationship ,economic activities disease and skills.

 

ORIGIN AND DEVELOPMENT OF PLA

PLA has been adapted from participatory rapid assessment (PRA) research. PLA is a type of qualitative research .the term participatory is used in this research because the community members participate in the research. They participate in analyzing their own situation. This involves identifying their needs problems, aspirations and resources. They also identify they can carry out to meet their needs and what they can do to solve their problems. They participate in planning and implementing activities to solve the problems they identify in the research. The term”rapid”was used because data was collected in a relatively shorter time than is the case with ordinary researches.the”assessment”is used because this research helps all those involved in it(both outsiders and the community) to gain deeper understanding of the community’s way of life, for example,culture,traditions,practices,aspirations and feelings PLA has however continued to be improved and refined because of new ideas and theories.

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

The term PLA  is now preferred. This is because community members participate in the research and all their development projects. As they participate they also learn. They do research and also decide on the actions or activities to carry out to meet their needs and to solve their problems. Hence the term PLA. It comprises the methods used in rural and urban research. In addition, it stresses the importance of community learning from the research and taking action. It is not enough to collect data. The community should reflect on the data, learn from it and take action. The action taken by the community involves planning and implementing activities which improve the community‘s social and economic conditions. In recent years, there have been changes in the way participatory processes are used both in the community as follows.

 

 

Why use the Approaches?

 

Importance of PLA approaches

 

 

Characteristics and principles of PLA

  1. PLA is a systematic learning process. The community members and “outsiders” learn as they participate in the research. They acquire new knowledge and skills as they carry out research and as they share ideas and experiences.
  2. PLA recognizes that there are different ways of interpreting issues and solving problems. All people must therefore be listened to. They should be given the freedom to contribute their ideas, analyze their problems, identify possible solutions and decide which solution is the best for their problem.
  3. Multidisciplinary team. The PLA team has people with different skills and backgrounds. This ensures that they deal with different issues in an integrated way. This strengthens the PLA activity. All the members of PLA should be involved in all the stages of the study. Community members should be in the PLA team.

 

Multidisciplinary teams

Multiple disciplines

 

 

 

 

Men/Women                                                              Insiders/outsiders

 

  1. Triangulation in PLA means the same data is collected from different sources using different methods and tools. The different sources include parents, teachers, community leaders and religious leaders. Examples of different methods include FGDs, daily schedules, transect walk, seasonal calendars, Venn diagrams and community maps. Examples of tools include interviews, FGDs, participant observation and self reports. Triangulation ensures the authenticity and accuracy of data. The use of different sources, methods and tools to collect the same data ensures that data collected is cross-checked and verified./ this ensures that data is valid, accurate, genuine and convincing.

Mixture of techniques and tools                                     Many sources of information

 

 

 

 

 

 

 

 

  1. PLA requires flexibility. The study needs to be continuously reviewed so that methods are adapted to the changing needs of the community.
  2. PLA is a group learning process. PLA must involve the community members and “outsiders” at all stages. This helps in better interpretation of data and understanding of issues.
  3. PLA should be context specific. This means that the methods and approaches are designed or adapted to the local situation, preferably by the community members with the assistance of outsiders, this ensures that the methods and approaches are relevant, more accurate and owned by the people.
  4. The “outsiders” should act as catalysts. They motivate the community to participate in the research. They ask questions which make the community members start to reflect on their lives, traditions, culture and practices. The community members should decide what to do with the data and information that is collected. Both the “outsiders” and the community members should be committed to engage in follow-up actions.
  5. Make the study simple. Data collection should be simple, and time spent on data collection should be minimized. Only essential data should be collected. Data analysis and reports should be simple and easily understood by the community.
  6. On the spot analysis. The data should be analyzed as it is collected. This provides opportunities for community members to learn as they participate in the research. This is also allows emerging issues to be identified early and action taken to address them.
  7. Offsetting biases and being self-critical. PLA team needs to ensure that the study caters for all groups in the community without biases.

The three pillars of PLA

PLA is supported by three pillars (i) Behaviour /attitudes  (ii)  Methods and (iii) Sharing.

Behaviour/ Attitudes

Pillars of PLA

Sharing

 

 

Behaviour / Attitudes

PLA challenges both the experts and that community members to change their attitudes and behavior towards one another and towards life issues. It does this by ensuring that those participating:

Methods

PLA uses methods and techniques that allow those participating to interact and to share their knowledge, skills and experiences freely without fear and intimidation. These methods emphasize:

Sharing

PLA encourages and emphasizes:

The steps in PLA process

  1. Site selection. The area where PLA is to be carried should be:
  1. Selection of PLA team including community members. The PLA team should
  1. Preliminary visit. The PLA team should make a preliminary visit to the research site to establish contacts, know the people, meet community leaders and sort out administrative issues.
  2. Organize a public meeting to officially launch the PLA activity with the government: and other key leaders. During this launching explain objectives, the site and activities of PLA
  3. Data gathering with the people. Before beginning to collect data, clarify objectives, choose main topics or themes, identify indicators and sources of data, identify and develop tools. The s-t activities can be carried out in a workshop. The community should be well-represented. This involves collection of data from the field and from records. During data collection ensure:
  1. Data analysis with the people
  1. Preparation of Community Action Plan (CAP) with the community. The PLA members and community groups discuss further the problems, opportunities and interventions identified. A Community Action Plan is then prepared.
  2. Adoption of the CAP. The community discusses in details the CAP, activities to the carried out, roles of different members, resources required and other implications of the CAP. The community identifies the available resources and those required from outside the community. The communities must understand clearly their role and that of the external donors.
  3. Implementation of the CAP. The community should decide on the implementation process. Members should understand clearly the activities to be carried out, when and by whom. The structure to oversee the implementation should be agreed upon.
  4. Monitoring and evaluation. The PLA team should train the community in basic elements of monitoring and evaluation so that community members too monitor and evaluate the PLA activities. The community needs to develop its own monitoring and evaluation indicators.

 

Collecting data from the field

 

Activity

 

You have been asked by your community to help them establish an ECDE centre.

PLA techniques and tools

PLA tools and techniques are user-friendly. They also try to eliminate biases such as:

The following is a summary of different tools which are used to collect data in PLA researchers (These tools are described in detail in Units Three and Four)

Data collection tools

  1. Spatial tools which give us information about the areas of study
  1. Time related or temporal tools which are used to gather information related to changes over time
  1. Socio-economic tools which are used to collect data on livelihood and ways of life.

Analysis Tools

Guidelines for analysis of PLA findings

 

Completing the process

Time-frame.

 

Summary of benefits of people’s participation

 

Challenges and dilemmas of PLA

 

 

Activity

A new youth group in your community wishes to start an environmental conservation project for income generation. The group has asked you to advise it how to go about the project.

 

Appreciative inquiry

Appreciative inquiry (AI) is an approach which emphasises the communities focusing on their abilities, potentials, strengths, achievements and resources rather than on their problems. AI goes beyond participation of the community. It encourages the development of self-esteem and confidence at the grass-roots level. Appreciative approach came into being with the understanding of the importance of people’s self reflection. It encourages us to appreciate what this world can do for us and what we can do for it. AI encourages the communities to find out what exists (what is) and that they are proud of. The search of what exists helps the community members to realize that they have many resources which they can use to bring about their own development. These resources include knowledge, skills, abilities, potentials, time and facilities. AI also encourages the community members to have dreams and aspirations (what could be) that motivate them towards working to improve their future. AI therefore acts as a catalyst or a motivating force for community development. What communities have makes them feel proud of who they are while their dreams and aspirations give them hope for the future. These energize or motivate them to take action in order to improve their present and their future.

 

When communities realize that they have many resources and strengths they feel energized and motivated. On the other hand, if they focus on problems they tend to feel discouraged.

 

Stages of appreciative inquiry

The appreciative inquiry involves the community working together to collect information on their strengths, abilities, good news, success stories and achievements. The communities also spend time to appreciate themselves and celebrate all their successes and achievements. This makes them feel good about themselves. AI also involves our ability to recognize the strengths and achievements of systems, situations and other human beings around us. Local people can use their understanding of “the best of what is” which includes their strengths, potentials and resources to develop a vision of what their community might be in the future. They achieve this goal by using their current achievements as a foundation to develop their dreams and aspirations to improve their future.

Discovery

“What gives life?

(The best of what is)

APPRECIATING

The appreciative inquiry cycle

 

 

 

 

 

 

Discovery phase

 

The main aim of the discovery phase is to help the community to appreciate the best of “what is” by looking for best examples of their victories, strengths, achievements and successes. The community then tries to understand what made it possible for them to achieve the victories, successes achievements identified. Was it leadership, internal relationships, knowledge, skills, technologies values, capacity building or external relationships?

 

People deliberately choose not to focus on problems and challenges. They do not spend timeanalysing problems and deficits. Instead they focus on strengths and achievements, systematically seek to isolate and learn from even the smallest victories and successes. people share stories of exceptional achievements and they discuss the factors which made realize these achievements. They deliberate upon the aspects of their history that they value and want to enhance in the future.

 

Dream phase

This phase involves the community sharing their dreams and aspirations. They base these dreams and aspirations on their past victories, success and achievements. They share their experience their past achievements, victories and successes. They believe firmly that if they have succeeded the past they can achieve greater victories and success in the future. This belief becomes a d force which helps them to march into the future with confidence that they will succeed. They usethese positive stories in the same way an artist uses paints to create a portrait of the community potential. They think great thoughts and create great possibilities for their communities, then turn those thoughts into dreams and aspirations for themselves.

 

Design phase

The community develops ways of ensuring that they achieve their dreams and aspirations. They do so by re-defining approaches to leadership, governance, use of resources, and participation on capacity building. They identify qualities of community life that they want to protect, and the relationship that they want to achieve. They also identify the activities they need to carry out in order to ac their dreams and aspirations.

 

Destiny phase

This involves the community working together in order to ensure they continue to do all that

required to achieve their dreams and aspirations. It is a time of continuous learning, making adjustments and doing all that must be done to ensure dreams and aspirations are achieved. During ibis time people have a lot of motivation and energy for being innovative and creative in order to achieve the goals they have set for themselves. The destiny phase leads naturally to new discoveries of community strengths, new achievements and beginning of the whole process a new.

 

Why Al works

 

Principles of Al

The following principles help explain the power behind the appreciative inquiry approach

 

Advantages of AI

 

Challenges

 

Activity

 

HOW TO DESIGN A RESERCH STUDY

The design of the research project consists of the stages that a researcher goes through from the time of identifying the project to the writing of the research report.

Major Steps in Research

The following are the major steps in research.

Each of the steps is elaborated in the chart that follows.

 

A flow chart of major steps in research

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Selection of the problem

 

Every research starts with the researcher identify a problem whose solution she considers will offer useful information for child development or the education system. A researcher needs to narrow her problem down to address problems related to her discipline and area of interest. For example, if the researcher is in ECD, she should focus on problems related to ERCD. If she is in primary education, she shouldfocus in that area.

Possible Sources of Research Problem / Topics

 

Principles in selecting a research problem

The selection of a research problem is a difficult task. It often takes a long time. The following are me principles or considerations that can guide a researcher when selecting a research problem:

 

How to find a research problem/topic

In order to find a research problem, the researcher needs to be motivated and interested to do research. She should appreciate the value of research in improving her personal and professional life and in contributing new knowledge to the discipline. To be able to get a good research problem the researcher needs to:

 

 

Questions to guide in selection of research problems

The following are the questions that will help the researcher to decide on the research problem

 

SAMPLE AND SAMPLING PROCEDURES.

DECIDING ON THE POPULATION SAMPLE AND ON SAMPLING METHOD

When concluding a research, one must often use a sample of population as opposed to using the entire population. A population can be defined as any set or persons/subjects having a common observable characteristics. It is the total number of subject/person with similar characteristics under the study (research). Sample is a subset or small group of subjects/persons representing the whole population in the research study. The characteristics of a population are called a parameter.

Sampling is a process of selecting a number of individual or subjects from a population such that the selected group contains elements representative of the characteristics found in the entire population.

Reason for Sampling

Why do we sample instead of using the population as the focus of study. There are at least four major reasons to sample.

Sampling Method

Ideally, in sampling we would like to obtain a sample that is will be representative of the target population. To be representative means to provide a close approximation of certain characteristics of a target group.

The quality of a sample must be judged in terms of the procedure that produces it, that is in terms of its sampling methods/design.

Sampling methods/designs are classified into two (2) broad classes:

  1. Probability sampling/Random.
  2. Non-probability sampling.

TYPES OF PROBABILITY SAMPLING

  1. Simple Random Sampling
  2. Interval or Systematic sampling
  3. Stratified Sampling
  4. Cluster or Multi-stage Sampling

Simple Random Sampling

The usual definition of simple random sample is that it a procedure in which all the individuals in the defined population have an equal and   independent chance of being selected as a member of sample. By independent it means that the selection of one individual does not affect any way the selection of any other individual. A more precise definition of simple random sample is that it is a process of selection from a population that provides every sample of a given size an equal probability of being selected.

The main purpose of using random sampling technique is that random sample yield research data that can be generalized to a larger population within margins of error that can be determined statistically. Random sampling is also preferable because it permits the researcher to make certain references about population value e.g. mean, SD, correlation coefficient on the basis of obtained sample value. Random sampling therefore simply means accidental. According simple random is a sampling procedure which provides equal opportunity of selection for each element of the population. There are several techniques of selecting by simple random selection namely; tossing a coin or dice, lottery technique, using random number table.

 

Tossing a coin or dice depends on the selection of variables i.e. tail or head for the coin.

Battery technique- This is where a symbol for each unit of the population is written on small pieces of equal sizes of same colour placed in a container, mixed well, and the lucky number (s) drawn ( money or box style). The symbol for each unit of the population can be names of participants or symbol yes/no written on identical pieces of papers. One needs to establish the sample size (if only one is needed out of it, we allocate one yes and three (3) Nos).

Random number table. This is more sophisticated methods, particularly useful for large population. Generally, the table consists of a long series of five digit numbers generated randomly by computers. To use the random number table, we randomly select a row or column as a starting point, then select all the numbers that follow in that row or column, depending on the size of the population. Each member of the population is assigned numbers, then as many numbers as possible comprise the sample size is selected from the table. Generally, this table consists of big series of five digit numbers generated randomly by computer. To use the random table, one will need to know the size of the population and sample size and assign a number to each case or population. To start in the table, one needs to randomly select a row or column as a starting point, then select all the numbers in that row or column. If more numbers are needed, proceed to the next row or column until enough numbers have been selected to make up the desired sample size. In effect, you may start at nay random point in the table and select numbers from column, row or diagonally if you wish.

Example one (1).

If there is a population to members and 70 are to be selected at random each of the 70 members is assigned number 1 to 70. The 1st ten members that appear, whenever one begins random, number table, determine the 10 sample member. Since there is only 70 members in the population, two digits random are used. In summary, simple random sampling is a powerful technique for selecting a sample that is representative of a larger population. Nevertheless, it is rarely possible to study a simple random that is perfect. Even if a simple random sample is initially selected, some subject will probably refuse to co-operate and other lost through alteration hence leaving a sample that is not truly random.

Systematic or Interval Sampling

The technique is based on the selection of element at equal interval, starting with a randomly selected element on the population list. The use of systematic sampling is quite common in educational research where large populations are studied and alphabetical or possibly other list of the population member is available.

Systematic sampling is a procedure by which the selection of the 1st sample member determines the entire sample. The population members that is, their names or type of identification are in some type of order for example by names of pupils in a class may be placed in alphabetical order on the register. The sample size is chosen and the sampling constant ‘K’ is determined, if sampling constant K = 50/10 = 5. Hence, every K or the 5th student is selected. K would have a range of (1-) pupil on the last, one would need to randomly select whether to start with the 1st, 2nd, 3rd, 4th, or 5rth pupils. If you randomly select the 2nd pupil, then selection would include (2nd, 7th, 12th, 22nd, 27th, 32nd, 37th, 42nd and 47th pupils). If the starting pupil was number 5, then the selection order would be 5,10,25,20,25,30,35,40,45,50.

 

The systematic sampling consists of selection of every K. The sampling interval is merely the ration of the number of cases in the pop in the desired sample size. Random startrefer to the process of using a table of random numbers or some other devise to select at random the initial case between 1 and K.

Stratified Random Sampling

In many educational studies, the sample should be selected in such a way that you are assured that certain sub-groups in a pop will be represented in the sample in proportion to their numbers in the pop itself. Such sub samples are usually referred to as stratified sample.

In stratified random sampling, the population is first sub-divided into two or more mutually exclusive segments called strata, based on categories of one or combination or relevant variables. Simple random samples are then drawn from each stratum and then these sub samples are joined to form the complete stratified sample.

Example

Assume that a researcher wanted a sample of 100 pupils from sample of 1000 of the River Bank Academy. It is expected that the student will vary by gender and according to class (year of study).

Allocation of sample size among strata. The decision must be made as to the number that is allocation) that will be selected from each stratum for the sample. There are three (3) methods of allocated:

  1. Equal allocation
  2. Proportional allocation

 

The equal allocation are used when all the strata contribute equal number of members or the study.

A commonly used method is proportional allocation, whereby each stratum contributes to the sample a number that is proportional to its size in the population. The sampling fraction f = sample /fraction which is f = n/N.

 

The third method of allocation is optimum allocation. In optimum allocation, the strata contributions to the sample are proportional to the product of the strata, population sizes and variability of the independent variables within strata. Larger strata with larger variability will have the larger allocation to the sample. This is rarely used.

 

Summary of the three types of allocation in stratified random sampling

 

TYPE CHARACTERISTICS
Equal Allocation All strata contribute the same number to the sample. There are 166 strata, each contribute n/k member to the sample. The sampling fraction varies among strata
Proportion Allocation Sample allocation is proportional to the strata population size.  The sampling fraction is constant for all strata and equal n/N. the larger the stratum, the more member it contributes to the sample.
Optimum Allocation Sample allocation is proportional to the product of the strata population size and variability. The larger and more variables the stratum, the greater will be the contribution to the sample. The sampling fraction varies the stratums.

 

In the following example, we shall use the proportional allocation of sample. The River Bankpupils distribution by gender and class in the pre-school.

 

 

CLASS FEMALE MALE
KG 1 2000 1500
KG 2 2500 2000
Total 4500 3500

 

A random sample of 500 pupils using proportional allocation is drawn from 800 pupils taking into account the difference in the class and gender, since the different strata will in the population, the size calculated is proportional to the total population. The sampling structure is the ratio of sample size to population size.

 

Sampling fraction f= n = size of sample

N = size of population

F = n= 50 = 1

N   800  16

For a single random sample, the sampling fractions equal the probability of any member of the population being selected for the sample. Therefore, each category of the population being selected for the sample. Therefore, each category of the population has to be multiplied by this fraction to obtain the corresponding category of the sample. The result is as follow.

 

CLASS FEMALE SAMPLE MALE SAMPLE
KG 1

KG2

2000 x 1/16 = 125

2500 x1/16 = 156

128

1500 x 1/15 = 94

2000 x 1/16 = 125

219

 

The total size of the sample becomes 281 + 219 = 500

 

The next step is to use sample random or systematic sample method to draw the difference from the nominal roll i.e. sample of 125 female from KG 1 and 156 female from KG 2 and 994 males fro KG 1 and 125 from KG 2 making a  total of 500.

 

NOTE: Stratified sampling guard against wild samples and ensure that no sub population will be omitted from the sample. It is also avoids overloading in certain sub populations. Simple random samples have a tendency to distribute themselves according to the population proportion and stratified random sampling with proportion allocation will build this proportionally into sample.

 

Therefore, proportion allocation in stratified random sampling distributes the sample in such a way that the sampling fraction is the same for all strata.

 

Multi-Stage Cluster Sampling

In cluster sampling, the unit of sampling is not individual but lather natural occurring group of individual. Cluster sampling is used it is more feasible or convenient to select group of individuals from a defined population. This situation occurs when it is either impartial or impossible to obtain a list of members of the accessible population.

 

Multi-stage cluster sampling is variant of cluster sampling. The principle underlying multi stage sampling is to start by sampling population which is much more general than the final one. The common multi stage cluster sampling is done when an entire population is being studied involves area sampling as the first step. Area sampling rests on the simple (if not always correct) assumption that people live somewhere. If areas are sampled, then anyone has an opportunity to fall into the sample. The researcher 1st draws a sample of designated areas, perhaps city blocks or rural location. Each household in the sampled area is listed and from that list is drawn a final sample.

 

NON-PROBABILITY SAMPLING

Non- probability sampling refers to the process of case selection other than random. Without random selection, non-probability samples have two (2) weaknesses.

  1. The do not control investigators’ biasness in the selection of units.
  2. Their pattern of variability cannot be predicted from probability sampling theory. This makes it impossible to calculate sampling error or to estimate sample precision. However, while one should be ever mindful of these weaknesses, it would be a mistake to rule out non probability sampling. Many instances, this form of sampling is either more appropriate or practical than probability sampling or the only mean of case selection.

 

When is Non Probability Sampling Most Appropriate

 

 

 

 

Types of Non- Probability Sampling

It includes

  1. Convenient sampling
  2. Purposive sampling
  1. Dimensional sampling
  2. Snow ball sampling

 

Convenient Sampling

This type of sampling (also called haphazard fortuitous and accidental sampling, the researcher simply selects a required number from cases that are conveniently available. In the case of coast star parents attitude towards cost sharing arrangements towards tuition holiday. The researcher might decide to:

 

Ask teacher for permission to administer questionnaire to all parents in his school.

Interview however comes in the office or takes his/her child when the teacher (researcher) happens to be there.

 

Find a convenient spot in the school office or compound from which to administer the questionnaire or interview the parents concerned. TV station and newspaper wanting to tap public opinion in specific issues may interview conveniently available commuters, shoppers, store clerk and others. Such of a case selection are easy, and inexpensive. If the researcher is at an early stage and generalizations is not an issue, then they may be perfectly appropriate. However, convenience sampling is a matter of catch-as-catch can. There is no way of determining to whom, other than the sample itself, the results apply.

 

Purpose Sampling

In this form, the investigator relies on his or her expertise or expert judgment to select units that are representative or typical of the population. The general strategy is to identify important sources of variations or criteria in the population and then select a sample that reflects this variation ( type of school, boarding status and sex). One might select a single unit or sub-population that is thought to be typical of the population in important respects or select a few units that correspond to key population differences. In other words, purposive sampling is hand picking the cases to be included in the sample in basis of one judgment of their typically. The subjects area chosen according to a certain specific criteria e.g. Boys and girls school, rural vs. urban  residence etc.

 

Quota Sampling

Quota sampling is a form of purposive sampling that bears a superficial resembling to proportionate stratified sampling. Like the latter, quota sampling begin by dividing the population into relevant strata such as age, geographical region or years. The total sample is allocated among the strata in direct proportion to their estimated or actual size in the population. Finally, to obtain the correct proportions to their estimated or actual size in the population. Finally, to obtain the correct proportions in the sample, interviewers are asked to speak to a fixed quota of respondents in each stratum. So many men and so many women, those of a given age or income and so on are selected. To fill the quota, interviewers are free to choose anyone who meets the quota requirements.

 

The differences between quota and stratified sampling lies precisely in how cases are selected once quota has been set. In stratified quota sampling, the requisite number of cases within each stratum must be drawn by simple random sampling. But in quota sampling, the quota of cases within the stratum may be filled in whatever vary the investigator chooses.

The potential biases in such procedure are obvious: friends are likely to resemble closely the interviewer themselves; people who visit particular centre may differ sharply from those who do not; and preference for a nicer neighbourhood and homes will almost certainly create a strong socio-economic bias. Thus, representative quota in some characteristic does not ensure representative in others.

 

Dimensional Sampling

A further refinement of quota sampling where you identify various factors of interacts in a population and obtaining at least one respondent for every combination of these factors.

 

Snow ball Sampling

After identifying a small number of individuals who have the required characteristics,  you use them as  informants to identify others who qualify for inclusion. The study n drop out or cause of adolescent pregnancies would use this method more successfully.

SELECTING APPROPRIATE RESEARCH METHOD

Here it is a matter of deciding which research designs are appropriated to the study in relation to topic, objectives and data collection method. There are no strict rules for making decisions about what research approach and methods to use. For each study, data collection options and strategies will depend on what kind of information is for and how the information is to be used. Qualitative and quantitative approaches to research are complimentary, and where appropriate should be combined in such a way as to maximize the strength and minimize the limitations.

SELECTING AND DEVELOPING APPROPRIATE RESEARCH TOOL/INSTRUMENT;

In education, as in other behavioural sciences, researchers rely mostly on reactive research method as opposed to unconstructive methods. In other words, in much educational research, the researched person (respondent) is aware of being studied and reacts to stimuli, or the instrument of studying them in the form of the questions presented by the researcher. The most frequently used tools of gathering information is by directly asking respondents to express their views or opinion.

 

Data Collection Tools/Instruments

They include

  1. Questionnaires
  2. Interviews
  3. Observational guidelines
  4. Rating scales
  5. Ranking order

 

Critical Considerations when Constructing Research Instrument/Tools

The critical consideration while construction instruments are:

 

Objective of the study

A researcher must have a clear understanding of what to obtain from the results of the study. This means that the researcher must be able to anticipate and spell out the type of information needed. First, the researcher must have a clear vision of the time frame for the research specification whether or not to focus current educations practices or trend over time (longitudinal studies).

 

Type of population/sample:

The research should be aware that some type of instrument are unsuitable to some groups of people / respondents depending on their literacy level, and type of work or professional culture and level of socialization . For illiterate population questionnaire will be unsuitable, hence of interview or observation method will be necessary.

 

Geographical Distribution of subjects

A researcher needs to be conversant with geographical location and spread of the sources of information before making decision on the type of instrument to be constructed and administered. One need whether the study will survey the whole country (census).Selected provinces, district, division or location. The span of the will dictate the type of instrument to be used.

Nature of Research Item.

In the special cases, each item must be developed to measure a specific aspect of the stated objectives. The item (whether in multiple or open ended format) should reflected why the question is being asked and how the item will be analyzed. The type of item should be able to be understood and interpreted by the respondents. It is usually desirable for the researcher to deve3lop during table to assist easier analysis later.

Questionnaires

A questionnaire is an instrument used to gather data, which allows a measurement for or against particular view point. A questionnaire has the ability to collect a large amount of information in a reasonably quick space of time.

This is a big advantage but do not let this deceive you into thinking that questionnaire design is a straight forward operation. Asking correct question about a particular topic need careful planning.

 

Planning checklist.

In planning a questionnaire needs careful consideration. The checklist below should be constructed before moving on actual design. You should be able to answer all these questions in a positive way that should be able to state the specific goals of your study.

When you look at the goals of the study do they convey a picture of something that is worth doing?

Be sure in your mind that the worth is not of trivial nature.

Do you know enough of subject area to create a questionnaire that has inclusive items?

How much do you know about the characteristics of your target population?

What is the approximate cost of your study and how long will it take to complete.

What sort of sample are you going to use.

 

NOTE: A common problem with many questionnaires is the number of irrelevant items or questions that are included.

 

Take a look into a few questionnaires. What are the most common items you see at the beginning of these questionnaires? Age gender, marital status, religion, occupation are families items contained in question. Justification for inclusive is all important and the contents must reflect the aim and objective of your study. If marital status is included in the study of pre primary education performance, why should you include it. Or if there is no sex difference in performance of certain cognitive aspect in pre primary pupils, it is not necessary to include it in the questionnaire.

 

Question Types

Question con come in a variety of shapes but in general there are 4 types:-

Background questions

Closed-end questions

Partially closed end questions

Open end question

Background Questions

This type of questions is used to gather demographic details from the group being studied. It is quite common to find background question quite early in a questionnaire because usually they are fairly easy to answer.

 

Please provide the following

Gender……………………………………………

Teaching Experience :………………………

Marital status :………………………

For example:

 

 

 

 

 

 

NOTE: Only seek background information that is relevant to your study and its objective.

 

Close-End Question

This type of question is used to collect information or determine opinion on issues by giving the respondent a set of choice or response options.

For examples: – 1

 

 

 

 

 

Example 2:

 

 

 

 

 

The teaching example has unordered responses. Choice are described but there is no single dimension related to the options. Each of the 6 categories has to be viewed as independent of the others.

 

Partially closed

Partially closed End questions with this type of questions the respondent also has option but is not forced to select of them. There is provision for other reasons to be listed, once which we include in the fixed choices.

For example

 

As and ECD teacher one of the following areas would you specialized draining in (tick one box only.)

  1. ECDESchool administration and management degree
  2. ECD food and nutrition degree.
  3. Degree in curriculum design in ECD

 

Another area, please describe ………………………………………………………..

 

 

 

 

 

 

 

 

 

 

 

Open – end question

These are sometime called free response types because they allow the respondents to answer in their own words. Open questions are often used to explore issues.

 

Question construction

 

Constructing good questions may take some time and what first may look as ideal can, after a pilot test, be shown to be unreliable or infective. Below are some useful hints on questionnaire construction.

 

  1. Specific questions will produce specific answers: try to avoid vague sounding questions. They are usually difficult to answer. For example: have you read the book recently? Different people will interpret recently in various ways. Substitute recently with, within the last 7 days or month.
  2. Over precise questions can cause problems: if you make the question too difficult to answer. Example: how many of your classmates did you talk to yesterday?
  3. Keep the language simple: look at who will be answering your questions and write at their level. Avoid jargon or technical terms.eg Donor conditionality,jittygritty,without much ado.
  4. Avoid the use of double negative: two negative in a question can be confusing and the purpose is to facilitate a clear response. Example: lack of midterm exams is not something to worry about.
  5. Limit each question to a single idea. Example : are you favoring of reducing the number of teaching hours and increasing pupil intake on the KG level.What will be the answer to the above question tell you? (Yes or no).
  6. Avoid emotional charged words: such words can create bias and introduce a highly personal tone which many respondents may feel uneasy with. Do you usually abscord Friday afternoon lessons? .How is your relationship with your headteacher?
  7. Avoid leading questions there are questions which by their wording suggests the answer. Example: do you think we should increase pre-primary academic staff pay since they work such long hours and provide available services?, Do not think learners who fail in one class should be told to repeat to avoid failure in their K.C.P.E?, Don’t you think the current wrangles over Mau forest will split the ODM?
  8. Be careful of personalization: personalization can cause problems if you are seeking opinion of a general nature. Example: what do you think of day care services? Don’t you think Kamba people practice witchcraft?
    1. Try to avoid subjective terms: such as “usually”, “often” and “many”, as they can be interpreted in various ways. For example “many people” to a city dweller will probably mean something different to someone in living in rural isolation as far as population of their setting is concerned.
    2. Keep the item as short as possible: there is nothing more irritating than a lengthy sentence that needs someone to re-read again and again before he gets the message.
    3. Ensure that all response options are included: it is surprising how many questionnaires do not include categories such as “don’t know” or “not applicable”. Knowing that respondents don’t know can be variable piece of information.
    4. Avoid acronyms and abbreviation e.g STD may stand for standard Trunk Dialing or Sexually Transmitted Disease. So use full letters in questionnaire.
    5. Pilot the questionnaire: once you have constructed a questionnaire, try it out on a small sample to check if it is operational.
    6. Intensity questions: it is quite likely that you may need to measure strength opinion. The most common format is the LIKERT This permits the respondent to select from a number of degree of intensity (usually five). For example:

 

 

 

 

 

 

This type of item is usually associated with the measurement of attitude.

  1. Constructing relevant questions: Depending on the subject matter of the questionnaires there may be times when you will have difficulties arriving at appropriate questions i.e. those that will give you the information you are seeking. It is good to think deep and focus in questions that can give relevant information.

 

The Questionnaire Layout

As with most products the usual impact can be a big plus. Check your question or the following:

Physical layout – It may be restarting the obvious but, make sure your questionnaire is neat, easy to use, easy to code and easy to store.

Production cost – The information you get should be worth the cost of production.

 

 

Question

What are the advantages and disadvantages of a questionnaire as a data collection tool?(10mks).

 

Interviews

Interviews involve a researcher meet a respondent physically or through phone and series of questions orally asked as part of research project. There are 3 types of interviews in an education set up, especially in ECDE program:

  1. Unstructured interview
  2. Semi structured interview

Un-Structured Interview Technique

It is one of the most widely used techniques of data collection in education. In this approach of interviewing, the researcher has some idea in mind of the topic covered and may use some sort of topic list as a reminder, but there is minimal control over the order in which topics are covered and over the respondent answers. In unstructured interviewing, neither the specific questions to be asked nor the range of type of possible answer are pre-defined.

Unstructured interviewing is formal and conversational, and the aim is to get inform unto open up and to express themselves in their own terms.

 

Strength unstructured interviews:

 

Weakness of unstructured interview:

 

Semi-structured interview

Semi-structured interview area based on the use of interview guide. This is a writer list of questions or topics that need to be covered during the interview. However, the exact order and wording of the questions may vary from respondent to respondent. The interviewer may still follow leads and new topics that arise in the course of the interview, but the interview guide is a set of clear instructions concerning the main question to be asked or topic to be probe. Semi structured interview include: Depth / Focused interviews that intensively investigate a particular topic and case studies that collect comprehensive, systematic and in depth information about particular cases of interest.

 

Structured systematic interviews

Structured interviewing involves subjecting every informant in a simple to the same stimuli i.e. asking each informant the exact same question. Survey such as are most familiar with the structured questionnaire.

The data collection technique under discussion produces numerical quantifiable data.

Nonetheless, these methods are included in the discussions of qualitative research because their purpose is to help describe and analyses the culture and behavior of respondent from the respondent point of view. Furthermore, their effective user depend on prior understanding of the study of population’s view and perspective

 

OBSERVATION TECHNIQUES AND GUIDELINES

Observations provide information about actual behavior. Direct observation of behavior is useful because some behavior involves habitual routine which people are hardly aware of. In such cases, observation can reveal more information than interviews or questionnaires. Direct observation also allows the research to put behavior in context and thereby understanding it better. Observation can either be unobtrusive and non-reactive or obvious and reactive.

Unobtrusive observation is whereby people are observed without them knowing, but involves serious ethical dilemmas. Here we will only discuss obvious and reactive techniques. The approaches are three, namely:

 

Participant Observation

 

Participant observation refers to an approach whereby the investigator becomes to a greater or lesser extent, an active functioning member of the culture under study for example a family health organization, teaching staff or community. The investigator participated in any activities appropriate for a person of the status in which is assumed. Observe what others do and in general attempt to see through the eyes of a member of a culture rather than through those of an outsider. Participant observation in itself does not constitute a specific data, unstructured interview and unstructured observation; rather it simply means living in or hanging around the community or culture under study. In participant observation the people being observed are aware of the researcher’s presence in the community and usually know the purpose of the researcher’s presence is to learn about their way of life. Participant observation produces textual descriptive account.

 

Strength of Participant Observation

 

 

Structured observation

 

In structured observation, the observer is an on-looker, he or she observes as an outside. Those observed know they are being observed but usually do not know the exact behaviors that are being observed and recorded. The focus tends to be on small number of very specified behavior. Only those behaviors appearing on a pre defined observation list are recorded. Structure observations produce quantitative data with little contextual description. In order to conduct structured observation, behaviors and actors of interested must be clearly specified.

 

The importance of the timing of observations must be determined (time of day, season e.t.c.) and focal behaviors must be defined, broken down so that recording is reliable.

This approach ensures that the observation will be optimally reproducible, comparable and quantifiable.

 

Unless the behaviors of interest are well understood, it is not possible to develop a good observation recording sheet. Therefore structured observations should never be used before first, rather conducting unstructured observations and interviews to explore what really needs to be known, and in what detail.

 

The approach may include continuous monitoring, spot check and rating checks.

Strength of Structured Observation

 

 

Weakness of Structured Observation

 

 

 

Weakness of Participant Observation

 

 

 

 

Unstructured Observation

 

Also referred to as open observation. The observer takes the position of an onlooker rather than a participant observer. Those being observed know that they are being observed, but the “what” to be observed is only very broadly defined for example, infant feeding.

Unstructured observations are broadly focused and their aim is to observe behaviours in its context .Data are collected in form of detailed descriptive accounts. Unstructured observations are often used or conducted when the researcher is trying to discover unknown aspects of a problem. They allow the discovery of “surprises” which can then be followed up in later stages of the research. Unstructured observations are particularly helpful for understanding behaviors in their physical and social context.

Data coding, entry and analysis can be very time consuming.

 

RATING SCALE

Scale can be created from any number of concepts or attributes, and items can be rated on a single conceptual scale or each may be rated on a series of scales presenting a variety of concepts or attributes. Scales can be presented numerically. For example:

 

  1. Circle the number that corresponds to the level of severity you will associate with pupils dropout rate in each stage in your school.

Pre primary stage 0  2  3  4  5  6  7  (from least to severe)

 

Lower primary stage 0  2  3  4  5  6  7  (From L to S)

 

Upper primary stage 0  2  3  4  5  6  7  (From L to S)

 

  1. Mark an X on the line below indicating where you will rate the drop out rate of pupils by gender.

 

Boy

 

 

 

Girls

 

 

Strength of rating scales

Rating scale are easier to administer.

Weakness of Rating scales

Rating scale can be extremely sensitive to responses bias (the propensity of an individual to always use one end of the scale or a narrow range in the middle of the scale).

 

RANK ORDER METHODS

Rank order method require information to rank items i.e from most to least in term of a specific characteristic, for example dropout rate by class and gender in terms of severity.

 

Complete rank ordering method usually require that informant be literate and involves presenting respondent with a list of items which they are asked to order from most to least on some scales or attribute by putting number next to each item. Another method is to present each information with visual stimuli or stack of cords on which items names are written and ask them to order the item or cards from most to least (best to worst or whatever the attribute of interests is).

 

Partial rank ordering: Pair each item with each of the other item. The pair of items are presented to respondents who are asked to indicate which is more or less, a best of worst, most ordering is obtained by summing the number of items each item was chosen.

Strength of Rank Order Method

The complete rank ordering technique produces a great deal of information and is productive for the time spent by the informant. The method is ideal for study individual differences.

 

Paired comparisons are probably the easiest and most reliable method to use with illiterate when there is small number of items to be ordered.

Weakness of rank order method

The complete rank ordering technique can be tedious for non-literate respondent. For paired comparison, pre testing is crucial for identifying the maximum number of pairs that informant will tolerate. Some researcher has found that even as few as 15 pairs can be tedious.

 

DATA COLLECTION PROCEDURE PROGRAMME AND ORGANIZATION

The process of data collection is much decided by the research and amount of resources available (time and money).

After choosing appropriate research tools which can be a combination of 2 or more research tool, if not one, a researcher may decide to do it in personal or hire other skilled people in the collection of data.

 

For interview he may decide to interview informant through the phone or meet them personally for an interview.

 

As for questionnaire he may present them personally to informants, then collect in personally after the informants have filled the questionnaire or he may send them through post office and wait for informant to fill the questionnaire and send them back to him.

 

 

 ETHICAL CONSIDERATION IN RESEARCH

Through the process of data collection, the problems of persuading participants to co-operate with the researcher and participate in the research is ever present.  Lack of co-operation can be disastrous in a research task.  Participants have the right to refuse openly to take part.  Generally, acceptable ethical right must be followed.  This is particularly the case when dealing with public schools and other educational institutions.  When you are working with school children and teachers as subject, its necessary to have understanding and co-operation of school administration, (the education officer, head teacher, teacher).  Interested community groups and other key stakeholders.

Ethical Principles

Researcher needs to be conversant with ethical principles to ensure that human rights and public relations are strictly adhered to.  Apart from one overall observation of professional outlook, mannerism, mien and decorum, one needs to ensure that the following are observed.

  1. Informed Consent

Educational or social science research invades person’s privacy.  An investigator might want information of a private nature or observed people in situations harmful to or at least uncomfortable to participants.  People should not be subjected to research of such nature unless they agree to participate in it.  Participation in research must be voluntary and people have the right to refuse to divulge certain information about themselves.  This right to privacy demands that direct consent for participation must be obtained from adults and incase of children from their parents or teachers.

  1. Ensure confidentiality

The participant must be assured that the information will be kept confidential and only used for used for the purpose of the research alone.  The participants must be told who will access to the data.  In this case, the participant must be assured that the data will only be used for the stated purpose of the research and that no undesirable person will have access to the data.  Assured of these conditions, a respondent will feel free to give honest and complete information.  Therefore to ensure confidentiality, researcher should:

  1. Plagiarism

This is the use of somebody else ideas or research purporting it to be yours, without acknowledging the source.  It is an academic crime and it is punishable.  It is protected by writers’ copyright (patent rights to writers’ creation).  When using somebody else ideas, you should quote the worker’s work using quotations.

  1. Risk to Participants

The subject/participant should not be harmed in anyway – mentally, psychologically, physically, emotionally or morally for the sake of obtaining information in the name of scientifically research.  If the research involves any risk, the subject should be informed.  If school children are involved in the study for example, the parent or guardians should be informed and written permission secured from them.

  1. Permission to interview children.

In addition to parental consent, researcher should seek the informed consent of children age seven (7) and above for research participation.  The use of deception in research with children is especially risky since debriefing can undermine their basic faith in the trustworthiness of adults.

  1. Using of human beings as specimen object.

At no one time in a research should human beings be subjected as specimen in the study i.e. being used without human integrity or reduced to animal level.

Since studies can only take effect when some vital information is withheld or subject not told, the absolute truth is necessary.  Although needed data can be collected without deception, practical considerations such as limited fund and time lead some researchers to use deception.  This is used in extreme cases where serious issues such as crime and potential respondents may be violent if they discover that one is collecting data on them (e.g. criminals).

  1. Should ensure good human relation for example, it should not bring conflict between Head teacher and his teacher or among pupils or in families and societies.

 

 

 

                                          MONITORING AND EVALUATION

 

MONITORING.

Monitoring is the systematic and continuous assessment of the progress of a piece of program/work over time.  It is a basic and a universal management tool for identifying strength and weaknesses in a programme.

EVALUATION.

An evaluation is the assessment at one point in a time of the impact of a piece of work/programme and the extent to which stated objectives have been achieved.

Importance of monitoring and evaluation

  1. They help to show what impact the work/programme is having and the progress towards meeting objectives so that activity can be adjusted if necessary.
  2. Monitoring and evaluation assist in maintaining high standard of a programme i.e. assess the quality, effectiveness and efficiency of activities, as well as the volume of work.
  1. They are used to plan work i.e. to show what and who will be available when, and how work could be affected by seasonal trends.
  2. Evaluation and monitoring identify problems and find solutions at nearly stage of the programme to make sure problems can be discussed and tackled before they become too serious.
  3. They help staff feel their work has a definite purpose. Knowing more about objectives, progress, impact and quality of work in a programme will help staff feel motivated and involved in the programme.

 

Monitoring and Evaluation tools/Method

There are many different methods of data collection.  The most appropriate method can be selected according to the kind of information that is needed and when and how it will be used.  Combination of objects should always be used so that data can be cross checked.

Possible method for collecting Data at specific Point during monitoring

  1. Surveying with a set of questionnaire

Survey samples can be selected to compare population affected by the programme or to compare current data with the results of a baseline carried out before the programme started.  Regular surveys can be used in a monitoring system to collect information about key indicators to see how the target population is affected by a piece of work over time.

  1. Participatory method

Participatory method including those discussed in PLA can be used for finding out how the different people involved in a programme, including people affected by the programme, views its progress.

  1. Measuring skills and knowledge

The skills and knowledge of trainees in ECDE programmes can be assessed to measure effectiveness of activities designed to train and teach people or to influence their attitude or behaviour method.  Measuring can be done through the following methods-:

 

 

Possible methods for collecting data regularly for monitoring system include-:

  1. Regular record-keeping: Forms and diaries

Some information about activities is recorded on regular basis.  Forms and set formats are often used for recording quantitative and qualitative information.

 

The following factors are important

 

  1. Supervision checklist and Reports

The collection of data during supervision meetings provides an opportunity to discuss the information as it is being collected.  This can be useful for both supervisors and those being supervised.  Checklist and set formats can be used to ensure that information about indicators is collected.

 

Case study can be used to examine the impact of a programme on a particular set up (community).  A checklist can be used to ensure certain questions are addressed, without being restricted only to a pre-determined indicator.  It can be useful way to looking at unexpected outcome and indirect effects of a programme and to see how other factors have contributed to any change in people’s lives.

  1. Spot checks

Periodic studies into a particular aspect of the programme.  Selected activities may be monitored in detail over a specific period.  For example, all staff could fill in activity sheet every day for several weeks to assess the effectiveness of their use of time.  This can be useful exercise leading up to a more formal evaluation, since it gives staff and participants a clearer idea of what they are doing, especially if they do not usually keep regular record of activities.

Uses of monitoring and evaluation data

The data collected is used:

  1. To assess the progress and impact of programme toward achieving set objectives.
  2. To clarify the objectives of the programme that has been running for some time.
  3. To identify the issues and problems faced by the programmes, so that they can be solved.
  4. When lesson learned from work experience need to be analyzed to help formulate policy and guidelines for future for the programme.
Exit mobile version