Thursday, November 28, 2013

SAMPLING IN EDUCATIONAL RESEARCH

 

SOME IMPORTANT TERMS IN SAMPLING

Population

            By population we mean the aggregate or totality of objects or individuals regarding which inferences are to be made in a sampling study. A population is any group of individuals that have one or more characteristics in common that are of interest of the researcher.

Sample

            A sample is a small proposition of a population selected for observation and analysis. By observing the characteristics of the sample, one can make certain inferences about the characteristics of the population from which it is drawn.

Sampling

It is the process of selection of sample from the population. For this purpose, the population is divided into a number of parts called sampling units.

Parameter

            A parameter is the population value representing any trait or characteristics of the population as a whole.

Statistics

            A statistics is the sample value representing any trait or characteristic of the members of the sampling.

Sampling Error

            Sampling error is simply the difference between the value of parameter and that of corresponding statistic or the difference between population value and sample value.

Sampling Distribution

            The sampling distribution is the relative frequency distribution of an infinity of determinants of the value of this statistic.

Sampling Bias

            If the mean of the sampling distribution of a statistic coincides with or equals that of the corresponding parameter it is said to be unbiased. If, on the other hand, the mean of its sampling distribution does not coincide with the parameter, it is said to be biased.

Standard Error

            The standard error of any statistic is the standard deviation of its sampling distribution.

Importance of sampling

·        When the population is very large it can be satisfactorily corrected by sampling.

·        It saves a lot of money, time, energy etc.

·   Especially when the units of the area are homogeneous sampling technique is merely useful.

·        When the data’s are unlimited the use of this method is readily useful.

Characteristics of a good sampling:

1. True representative:

A good sample is a true representative of the population corresponding to its properties.

2. Free from bias:

A good sample is free from bias. It does not permit prejudicious, preconceptions and imagination to influence its choice.

3. Objective:

A good sample is an objective one. It prefers to objectivity in selection procedure or absence of subjective elements from the situation.

4.  Accurate:

A good sample maintains accuracy. It gives accurate estimates or statistics and does not involve errors.

5. Comprehensive:

A good sample is comprehensive in nature. A comprehensive sample is controlled by specific purpose of the investigator.

6. Economical:

            A good sample is economical in terms of energy, time at any point of view.

7. Approachable:

The subjects of good sample are easily approachable. The research tools can be easily administrated on them and the data can be easily collected.

 

 

 

8. Good size:

The size of good sample is such that it yields an accurate result. The probability of errors can be estimated.

9. Feasible:

A good sample makes the research work more feasible.

METHODS OF SAMPLING

Bloomers and Lindquist have said, in general sampling schemes may be classified into two they are:

a)     Probability Sampling

b)     Non-probability Sampling

a) Probability Sampling:

·        In probability sampling every individual of the population has equal chance of selecting.

·        Probability sample may be representative of the population.

·        The observations (Data) of the probability sample are used for the inferential purpose.

·        Inferential or parametric statistics are used for probability sample.

·        There is a risk for drawing conclusions from probability sample.

b) Non-Probability Sampling:

·        There is no probability of selecting any individual.

·        The observations of non-probability sample are not used for generalization purpose.

·        Non-parametric or non-inferential statics are used in non-probability sample.

·        There is no risk for drawing conclusions from non-probability sample.

 

 

Probability Sampling Techniques

1. Simple Random Sampling

            A simple random sample is one in which each element of the population has an equal and independent chance of being included in the sample. It is defined as a sampling technique where every item in the population has an even chance and likelihood of being selected in the sample. Here the selection of items entirely depends on luck or probability, and therefore this sampling technique is also sometimes known as a method of chances. Randomization is done by using a number of techniques as: Tossing a coin, Throwing a dice, Lottery method etc. For example to select a sample of 200 students from a population of 10,000 students using simple random sampling, the researcher has to number all the 10,000 students as 1,2,3,….10,000. Then using random number table or a computer generated random numbers, a list of 200 students are prepared and invited to be the sample for the research study.

Advantages

  It is free from subjectivity and free from personal error.

  It provides appropriate data for the purpose of research.

  The observations of the sample can be used for inferential purpose.

Dis-advantages

      The inferential accuracy of the finding depends upon the size of the sample. So the greater     the sample size, the greater is the accuracy of results.

      The representativeness of a sample cannot be ensured by this method.

      Inappropriate for heterogeneous sample.

2. Systematic Sampling

            Systematic random sampling is a type of probability sampling technique. With the systematic random sample, there is an equal chance (probability) of selecting each unit from within the population when creating the sample. The systematic sample is a variation on the simple random sample. Rather than referring to random number tables to select the cases, the researcher selects units directly from the sample frame. This method selects the individuals of the population in any systematic way. It involves selecting every Kth item (K= Sampling Interval). Which can be determined by K=No. of items in the population / No. of items in the sample. For example: Imagine that a researcher wants to study about the career goals of students at a University, and if the university has roughly 10,000 students. These 10,000 students form the population (N). In order to select a sample of 400 students from this population of 10,000 students, using systematic random sampling, the  researcher could select every 25th student  to get a sample of 400 where 25 is the sampling interval ie. (10000/400).

Advantages

  This is a simple method of selecting a large number of samples.

  This method improves the possibility for the sampling units to be more evenly spread over the population.

  This method reduces the potential for human bias in the selection of cases to be included in the sample. So it provides a highly representative sample

Dis-advantages

   There is a chance of selecting the homogeneous group if the list of the population has some kind of standardized arrangement (order/pattern). In that case systematic sampling could pick out similar cases rather than completely random ones.

      Attaining a complete list of the population can be a difficult task for the researcher in certain cases.

3. Stratified Sampling

Unlike the simple random sampling and the systematic random sampling, sometimes if the researcher is interested in particular strata or groups within the population such as male vs. female, rural vs urban etc., In that case, stratified random sampling method is the most useful method. In this method the population is divided into strata on the basis of some characteristics such as gender, locality, medium of instruction etc., and from each of these smaller homogeneous groups (Strata) samples are selected randomly. This stratification of the population should be relevant to the particular research study. Stratified random sampling can be classified as proportionate sampling and disproportionate sampling.

·         Proportionate sampling: In this technique, the samples are selected from each stratum as they stand in the universe ie. in the way they are distributed in the population.

·         Dis-proportionate sampling: In this technique an equal number of samples are taken from each stratum regardless of the size of strata in proportion to the universe or population.

For example if a researcher wants to select a sample of 100 from a population of 10,000 students he may choose the 100 as 50 male and 50 female.

Advantages

   It yields a sample that is a good representative of the population.

   It is an objective method of sampling.

Dis-advantages

   It is difficult for the researcher to decide the relevant criterion for stratification. Also a complete list of population is needed for doing this method of sampling.

      Bias may occur due to improper stratification

 

4. Cluster sampling

            Cluster sampling is typically used in market research. It’s used when a researcher can’t get information about the population as a whole, but they can get information about the clusters. In cluster sampling, the researcher divides the population into separate groups, called clusters. Then, a simple random sample of clusters are selected from the population. Example: Imagine an organization wants to survey the performance of smartphones across a country. They can divide the entire country’s population into cities (clusters) and select n cities among them and include all the members of the city.

Thus in cluster sampling the total population is divided into a number of relatively small subdivisions called clusters then from these clusters respondents or cases are randomly selected for inclusion in the overall sample. Suppose we want to estimate the proportion of machine parts in an inventory which are defective. Also assume that there are 20000 machine parts in the inventory at a given point of time, stored in 400 cases of 50 each. Now using a cluster sampling, we would consider the 400 cases as clusters and randomly select ‘n’ cases and examine all the machine parts in each randomly selected case.

Advantages

     It is an easy method and economical method.

     It is practical and highly applicable in education.

Dis-advantages

     Produces larger sampling error

     May be biased in certain cases.

     Generalizations may lack precision.

5. Multistage sampling

            Multistage sampling divides large populations into stages to make the sampling process more practical. It is a complex form of cluster sampling, sometimes, also known as multistage cluster sampling. In this method, significant clusters of the selected groups are split into sub-groups at various stages to make it simpler for primary data collection. In this method first the researcher samples inclusive groups from the population and then select subgroups from the inclusive groups. At the third stage individual cases are selected from the selected subgroups. At every level sampling is done at random. Suppose is a researcher wants to investigate the working efficiency of nationalized banks in India. The researcher using multi-stage sampling divides the population into states and take a simple random sample of states. For the next stage, the researcher takes a simple random sample of banks from within those states. Then he may randomly select certain districts and interview all banks in the chosen districts.  

Advantages

   It is a good representation of the population.

   It is an objective procedure of sampling.

Dis-advantages

   It is a difficult and complex method of sampling.

   It involves error in the primary and secondary stages of sampling.

Non-Probability Techniques

     There is no idea of population in non-probability sampling.

     There is no probability of selecting any individual

     Non probability sample has a free distribution.

     Observations are not used for generalization purpose.

     Non Parametric or Non –Inferential statistics are used.

Non-Probability based Sampling Techniques

1. Incidental or Accidental Sampling

The term incident or accidental applied to those samples that are taken because they are most frequently available, i.e., this refers to group which are used as samples of a population because they are readily available or the researcher is unable to employ more acceptable sampling methods. It is applicable when such groups used as samples are easily available eg., Children in a school, members of a club It may be quite acceptable for certain action research projects which do not require generalizations. It is generally used in exploratory studies where much accuracy is not needed.

Advantages

·         It is very easy method of sampling.

·         It reduces the time, money and energy, i.e., it is an economical method.

Dis-advantages

·         It is not a representative of the population.

·         It is not free from error.

2. Judgement Sampling

            This involves the selection of a group from the population on the basis of available information thought it is to be representative of the total population. In this method the investigator selects a particular group and leaves the rest of the members of the group. The researcher himself judges that this is a good representative sample.

Advantages

·         Knowledge of the investigator can be best used in this technique of sampling.

·         This technique of sampling is also economical.

Dis-advantages

·         It is not free from error.

·         It includes uncontrolled variation.

3. Quota Sampling

            This is a combined form of both judgement sampling and probability sampling. The population is classified into several categories. On the basis of judgement or assumption or the previous knowledge, the proportion of population falling into each category is decided. Quota sampling is very arbitrary and likely to figure in municipal surveys.

Advantages

·         It is an easy sampling technique.

·         It is most frequently used in social surveys.

Dis-advantages

·         It is not a representative sample.

·         It is not free from error.

·         It has the influence of regional, geographical and social factors.

4. Convenience sampling

It is also known as careless, unsystematic or opportunistic sampling. In this type the researcher select certain units, which are convenient to him. No preplanning is necessary for the selection of items. This method may be used for pilot studies. It is also used when the Universe is not clear, Sampling unit is not clear and complete source list is not available.

5. Snowball Sampling

Snowball sampling or chain-referral sampling is defined as a non-probability sampling technique in which the samples have traits that are rare to find. This is a sampling technique, in which existing subjects provide referrals to recruit samples required for a research study. Snowball sampling method is purely based on referrals and that is how a researcher is able to generate a sample. Therefore this method is also called the chain-referral sampling method. The snowball sampling method is extensively used where a population is unknown and rare and it is tough to choose subjects to assemble them as samples for research.

Advantages

·         The chain referral process allows the researcher to reach populations that are difficult to sample when using other sampling methods.

·         The process is cheap, simple and cost-efficient.

·         This sampling technique needs little planning and fewer workforce compared to other sampling techniques.

Disadvantages of Snowball Sampling

·         The researcher has little control over the sampling method. The subjects that the researcher can obtain rely mainly on the previous subjects that were observed.

·         Representativeness of the sample is not guaranteed. The researcher has no idea of the true distribution of the population and of the sample.

·         Sampling bias is also a fear of researchers when using this sampling technique. Initial subjects tend to nominate people that they know well. Because of this, it is possible that the sample that the researcher will obtain is only a small subgroup of the entire population with similar characteristics.

Sampling error

Sampling error is incurred when the statistical characteristics of a population are estimated from a subset, or sample, of that population. Since the sample does not include all members of the population, statistics on the sample, such as means and quantiles, generally differ from the characteristics of the entire population, which are known as parameters. Since sampling is typically done to determine the characteristics of a whole population, the difference between the sample and population values is considered a sampling error.

Population Specification Error: This error occurs when the researcher does not understand who he/she should survey. If the researcher is not aware of the population clearly then he is likely to draw a faulty sample which may lead to sampling error.

Sample frame Error - A frame error occurs when the wrong sub-population is used to select a sample. Sometimes the researcher may choose his/her sample from a biased frame which may cause sampling error.

Selection Error - This occurs when respondents self-select their participation in the study – only those that are interested respond. Selection error can be controlled by going extra lengths to get participation.

Non-Response - Non-response errors occur when respondents are different than those who do not respond. This may occur because either the potential respondent was not contacted or they refused to respond. The extent of this non-response error can be checked through follow-up surveys using alternate modes.

These errors occur because of variation in the number or representativeness of the sample that responds. Sampling errors can be controlled by (1) careful sample designs, (2) large samples, and (3) multiple contacts to assure representative response.

Sample Size

The sample size is a term used for defining the number of subjects included in a sample size. By sample size, we understand a group of subjects that are selected from the general population and is considered a representative of the real population for that specific study. Sample size in the context of educational research refers to the number of participants in an experiment or study.

For example, if we want to predict how the population in a specific age group will react to a new product, we can first test it on a sample size that is representative of the targeted population.

The sample size is a subset, an extract, several persons extracted from that population. The population is considered infinite; in practice, we cannot study an endless number of cases.

The size of the sample should be large enough to be an accurate representation of the population and large enough to achieve statistically significant results.

For descriptive research (ex: aviators), a number of 20% of the respective population is sufficient. The larger the population, the smaller the percentage. Ex: 20% of 1000 people = 200 people; 10% of 5000 people = 500 people. For small populations (under 100 persons), the sample size is approximately equal to the population.

Friday, February 22, 2013

RESEARCH TOOLS


QUESTIONNAIRE
Questionnaire refers to the device for securing answers to questions by using a form, which the respondent fills by himself. – Goode and Hatt
FORMS OF QUESTIONNAIRE
  1. Structured questionnaire consisting of definite concrete and directed questions.
  2. Non – Structured questionnaire consisting of partially completed questions or statements. 
  3. Closed Form or restricted questionnaire. It calls for short check responses and restricts the choice of response of the respondents.
  4. Open Form questionnaire calling for a free response in the respondents’ own words. No clues are provided.
  5. Fact questionnaire requires certain information of facts from the respondent without any reference to his opinion or attitude about them.
  6. Opinion questionnaire requires opinion or attitude of the respondent regarding some phenomena.
CHARACTERISTICS OF A GOOD QUESTIONNAIRE
  • It should be as short as possible but yet comprehensive to get the essential information.
  • It should contain clear and complete directions.
  • Double negatives, double barrelled questions and descriptive adjectives and adverbs should be avoided.
  • Adequate alternatives should be provided.
  • It should be arranged from simple to complex.
  • Avoid embarrassing questions.
  • Responses should be such that it can be easily tabulated and analyzed.
Advantages of questionnaire:
  1. It is economical in terms of effort and cost.
  2. It is easy to plan, construct and administer. A skillfully constructed questionnaire could be administered by anybody.
Limitations of questionnaire
  1. It has low validity and reliability.
  2. If the sample is biased, then questionnaire will not be good measuring instrument.
  3. For incomplete or indefinite response nothing can be done.
  4. Behaviours and gestures are left unnoticed.
  5. Not appropriate for young children and illiterates.


INTERVIEW
                  It is an oral questionnaire in which the respondent or the interviewee gives the needed information verbally in a face-to-face relationship. It is a two-way method, which permits an exchange of ideas and information. It involves collection of data through direct verbal interaction between the interviewer and the interviewee
TYPES OF INTERVIEW

Based on functions
Diagnostic: It is frequently used in clinics to locate possible causes of an individual’s problem.
Clinical: It introduces a patient to a therapy.
Research: It act as tool to gather data and test hypothesis.

Based on number of participants
Individual: It is conducted in a private setting with one person at a time.
Group: It is conducted to a group with a common problem.
Single interviewer: It is held by a one interviewer.
Panel of interviewers: It is held by panel of interviewers consisting of various experts in the area to be covered.

Based on format of response
Structured: It is rigidly standardized and formal. Same questions are presented in same order to each subject.
Non-Structured: It is conducted informally without a preplanned questionnaire.
Non-directive: It encourages the respondent to talk freely under minimum direct questions
Focused: It concentrates on some particular event or subjective experience.
Depth: It is intensive in nature and is used for studies requiring a detailed account of subject.

STEPS IN THE INTERVIEW
  1. Preparation for the interview
  2. Conception of the purpose of the interview, kind of interview tool to be used etc.,
  3. Establishing rapport
  4. Establish a sympathetic contact with the subjects. – a personal relationship.
  5. Eliciting Information
  6. Secure the desired information through planned questioning with encouraging comments, clarifications and explanations.
  7. Recording of responses
  8. Use a check list for precoded questions and recording for questions that are not precoded.
  9. Interpreting the interview
  10. Based on responses make a complete objective analysis.
Advantages of Interview
Appropriate to deal with young children and illiterates.
People are more willing to talk than write.
Sincerity of the respondents can be checked by cross-questioning.
Exchange of ideas can occur

Limitations of Interview
It is expensive and time consuming
Interviewer bias can occur
It is not suitable for infants, shy people, deaf people and animals.

OBSERVATION
            It seeks to ascertain what people think and do by watching them in action as they express themselves in various situations and activities. It is a more natural way of collecting data, which is more real and true. It is a most direct means of studying people when one is interested in their overt behaviour.

TYPES OF OBSERVATION
Participant observation :  In this type the observer becomes part of the group under observation and shares the situation. It is  more reliable and flexible.
Non-Participant observation It is used in infants, children or abnormal persons. Here the observer takes the position where his presence is least disturbing to the group but where he can observe in detail the behaviour of the group under study.

REQUISITES OF GOOD OBSERVATION
·        Proper planning
·        Define the behaviour or unit to be observed
·        Choose appropriate group to be observed
·        Specify the scope of observation
·        Decide the length of observation
·        Select instruments of recording
·        Get trained in the art of scientific observation
·        Skilful execution
·        Record what is being observed by proper measures
·        Interpreting observation
·        Draw meaningful inferences from the data.

QUALITIES OF A GOOD OBSERVER
1.      Should possess efficient sense organs.
2.      Must be able to estimate rapidly and accurately
3.      Should to alert to observe several details simultaneously
4.      Should be able to control his personal prejudices.
5.      Should be in a good physical condition.
6.      Must be able to record immediately and accurately the results of his observation.
     
      Advantages of Observation
·        It is useful for infants, children and abnormal people.
·        It is useful for assessing significant aspects of personality.
·        Simple observation can be done through physical examination, measurement and comparison with fixed standards.
Disadvantages of Observation
·        Problem of Subjectivity is involved.
·        Establishing validity is always difficult in the case of observation.
·        People being observed may become conscious and behaves unnaturally


Tools in Educational Research


Tools

                   Relevant data, adequate in quality or quantity should be collected using systematic procedure. Devices or instruments employed in the collection of data are called tools. In research process, the preparation of tools is one of the vital stages. A researcher requires many data gathering tools or techniques, which may vary in their complexity, design, administration and interpretation. 
Each tool is appropriate for the collection of certain type of evidence or information. The researcher has to select from the available tools, which will provide data, he requires for the testing of the hypotheses. In some situations, he may find that the existing research tools do not suit his purpose and so he may have to modify them or construct his own. For this, the researcher should familiarize himself with the nature, merits and limitations of the existing research tools, and should also develop skill in the construction and use of each of these research tools.

Characteristics of a good measurement tool

            The most important criteria to be used in evaluating a measurement tool are,
  • Uni dimensionality: This means the tool should measure only one characteristic at a time.
  • Validity: This refers to the ability of a scale to measure what it is supposed to measure.
  • Reliability: A tool should give an accurate and precise measure of what we want to measure from time to time.
  • Simplicity: A tool should be as simple as possible; an elaborate, complicated and over refined scale may become unduly awkward, costly or even useless.
  • Practicability: A tool should be practicable one.
  • Objectivity: It should make clear judgement free from personal bias of the investigator
  • Economy: It should be economical in terms of time and money
  • Interest : A tool should be enjoyable to gain cooperation of the subject

FACTORS RELATED TO THE CONSTRUCTION OF TOOLS

  1. Subject related factors such as age, mental maturity, literacy level etc.,
  2. Test related factors such as dimension of the characteristics to be measured, number of items to be included, assembling the items etc.,
  3. Develop proper response sheets
  4. Standardize the administrative procedure
  5. Develop scoring scheme
  6. Conduct pilot study to validate the test and establish reliability