What if sample size is too big?
There are many circumstances in which very large studies include systematic biases or have large amounts of missing information, and even missing key variables. Large sample size does not overcome these problems: in fact, large sample studies can magnify biases resulting from other study design problems.
What happens to the effect size when sample size increases?
Effect sizes in small studies are more highly variable than large studies. The study found that variability of effect sizes diminished with increasing sample size. This reduction in standard deviations as sample size increases tracks closely on reductions in the mean effect sizes themselves.
Why should sample size be large?
Sample size is an important consideration for research. Larger sample sizes provide more accurate mean values, identify outliers that could skew the data in a smaller sample and provide a smaller margin of error.
What to do when your sample size is too big?
Power. If you change your desired level of power, you will need fewer participants. Generally in social science research, a power of .80 is desired. If you have set your power level higher during your sample size calculations, try setting it at .80.
How is the sample size related to the effect size?
Your power (and thus sample size) is also related to your anticipated effect size. Your effect size (i.e., the strength of an association or difference) can be classified as small, medium, and large. To find a large effect, you need fewer participants, and to find a small effect, you need more participants.
Is the sample size big or small for statistical significance?
The the independent variables have almost 0 p-value which shows they have significant effect on dependent variable. But, since the sample size is big (35000 records) and coefficients are so small (e.g. 0.0001) then it shows that there is no relationship because when sample size is so big everything can get significant.
Why do we solve for the effect size?
The effect that is in the data is the effect that is in the data. This is why we solve for sample size – it’s the one thing, usually, within the researcher’s control.