How does a funnel plot measure publication bias?

A funnel plot shows the relation between a study’s effect size and its precision. It is a scatter plot of the treatment effects estimated from individual studies (horizontal axis) against sample size (vertical axis).

Asymmetry in the funnel plot, measured using regression analysis, is an indication of publication bias. In the absence of bias, results from small studies will scatter widely at the bottom of the graph, with the spread narrowing among larger studies.

The idea here is that small studies are more likely to remain unpublished if their results are nonsignificant or unfavourable, whereas larger studies get published regardless. This leads to asymmetry in the funnel plot.

Frequently asked questions: Research bias

What is selective perception?: Selective perception is the unconscious process by which people screen, select, and notice objects in their environment. During this process, information tends to be selectively perceived in ways that align with existing attitudes, beliefs, and goals.

Although this allows us to concentrate only on the information that is relevant for us at present, it can also lead to perception bias. For example, while driving, if you become hyper-focused on reaching your exit on a highway, your brain may filter visual stimuli so that you can only focus on things you need to notice in order to exit the highway. However, this can also cause you to miss other things happening around you on the road.
What is the framing effect in polling?: In survey research, such as political polling, the way questions are worded or the order in which answers are presented can influence how respondents answer the questions. This is called the framing effect.

For example, if voters are asked to select which of two candidates they plan to vote for, the order in which the candidates are listed affects the percentage of respondents selecting each candidate. Recognising the potential for research bias, researchers typically rotate which major candidate is listed first and which is listed second.
What is the framing effect in advertising?: The framing effect is often used in advertising to positively influence consumer choice.

One common type of frame is ‘gain framing‘. This shows consumers how they are going to benefit from a product or service. For example, dental care product advertisements use gain framing to display the benefits of using their product: white teeth, healthy gums, fresh breath, etc.

Apart from the obvious benefits, ads using the framing effect often imply other benefits, such as how a better-looking smile makes one more attractive to potential dating partners.
What is the framing effect in economics?: Because of the framing effect, the way information is presented to us influences how attractive a proposition is.

Suppose you are considering joining a gym. A membership at £500 per year sounds like a considerable investment and might prevent you from signing up immediately. However, if they tell you it costs just £1.37 per day and emphasize that this is less than the cost of a cup of coffee, you might think it’s a great offer, even though in reality both offers cost you the same.
What is the opposite of optimism bias?: The opposite of optimism bias is pessimism bias. Optimism bias occurs when we overestimate our chances of experiencing positive events in our lives, while pessimism bias occurs when we overestimate our chance of experiencing negative events.

For example, pessimism bias could cause someone to think they are going to fail an exam, even though they are well prepared and get good grades.
What is a positive illusion?: A positive illusion is a form of self-deception under which people have inflated, favorable attitudes about themselves or others close to them.

The most common positive illusions involve:

Exaggerating one’s positive traits

Overestimating one’s degree of control in life

Harboring overly optimistic beliefs about future events (also called optimism bias or positivity bias).
What is the planning fallacy?: The planning fallacy refers to people’s tendency to underestimate the resources needed to complete a future task, despite knowing that previous tasks have also taken longer than planned.

For example, people generally tend to underestimate the cost and time needed for construction projects. The planning fallacy occurs due to people’s tendency to overestimate the chances that positive events, such as a shortened timeline, will happen to them. This phenomenon is called optimism bias or positivity bias.
What is a self-fulfilling prophecy?: A self-fulfilling prophecy is a belief about a future event that leads people to act a certain way, ultimately bringing about the expected outcome. In other words, we cause something to happen just because we expect it.

This suggests that beliefs have the power to alter people’s behaviour in such a way that they become a new reality in the end. Optimism bias can create a self-fulfilling prophecy: when we expect positive things, we are more likely to align our actions with this belief and try harder to influence the outcome.
What is myside bias?: Myside bias is a type of cognitive bias where individuals process information in a way that favors their prior beliefs and attitudes. It occurs when people search for, interpret, and recall information that confirms their opinions, and refute opinions different from their own—such as selecting news sources that agree with one’s political affiliation, while ignoring any opposing arguments from other sources.

Myside bias is closely related to confirmation bias. Although some researchers use the terms interchangeably, others use myside bias to refer to the tendency of processing information that supports one’s own position.
What is the difference between availability bias vs confirmation bias?: Although both are common types of cognitive bias, they refer to different ways of processing information.

The availability bias (or availability heuristic) refers to the tendency people have to rely on information that is easier to recall when faced with a decision.

Confirmation bias is the tendency to selectively search for or interpret information in a way that confirms one’s preconceived ideas.

In other words, the availability heuristic gives preference to information that is easy to recall, while confirmation bias gives preference to information that aligns with our existing beliefs. Even though they are different, they both cause us to focus on only a subset of information.
Why is perception bias a problem?: Perception bias is a problem because it prevents us from seeing situations or people objectively. Rather, our expectations, beliefs, or emotions interfere with how we interpret reality. This, in turn, can cause us to misjudge ourselves or others. For example, our prejudices can interfere with whether we perceive people’s faces as friendly or unfriendly.
What is an everyday life example of perception bias?: A real-life example of perception bias is the false consensus effect. Because we spend most of our time with friends, family, and colleagues who share the same opinions or values we do, we are often misled to believe that the majority of people think or act in ways similar to us. This explains, for instance, why some people take office supplies home: they may genuinely feel that this behavior is more common than it really is.
What is the difference between correspondence bias and fundamental attribution error?: Correspondence bias and fundamental attribution error were often seen as interchangeable in the past. However, researchers have recently proposed that there is a subtle difference between the two.

Correspondence bias refers to the fact that behavior is often viewed as a reflection of a person’s character. In other words, we believe that a person’s behavior reflects stable internal qualities, even though it was actually caused by the situation.
The fundamental attribution error refers to the idea that people fundamentally ignore or underestimate situational influences on others’ behavior.

Although people often commit the fundamental attribution error, they do not necessarily fall for correspondence bias at the same time. Only when we take the fundamental attribution error one step further and judge a person’s character from their actions do we display correspondence bias.
Why is correspondence bias a problem?: Correspondence bias is a problem because it can cause us to make incorrect judgments about other people’s behaviors. This can lead to misunderstandings that can negatively affect our relationship with them. When we overlook the situation and jump to conclusions about an individual’s character, it is also easier to justify reacting to them aggressively.

In a wider social context, if we ignore the situational factors that might have pushed someone to behave a certain way, we may also ignore systemic factors, like discrimination. For example, some people attribute poverty and unemployment to individuals rather than to social conditions.
What is a real-life example of correspondence bias?: A real-life example of correspondence bias is how we think about people who cut in line. For example, you are waiting in line at the airport and someone cuts in front of you at the security checkpoint. Because of correspondence bias, your immediate reaction is to feel annoyed and think that the person must be entitled and rude. In reality, this person may never cut into lines and they are doing this only because they are about to miss their plane, which they are taking to visit a sick family member.
What is a real-life example of vividness bias?: A real-life example of vividness bias can often be observed in the outcome of business negotiations. Price is usually the most vivid information, while other aspects, such the complexity of implementation, or the time needed to complete the project, might be ignored.
Why is vividness bias important?: Vividness bias is important because it can affect our decisions and negotiations. It causes us to assign more weight to vivid information, like a perception of prestige, rather than other factors that, upon greater reflection, are more important to us. As a result, we get distracted and lose sight of our goals and priorities.
What is the vividness effect in communication?: The vividness effect in communication is the persuasive impact that vivid information is thought to have on opinions and behaviors. In other words, information that is vivid, concrete, dramatic, etc., is more likely to capture our attention and sway us into believing or doing one thing rather than another. On the contrary, information that is dull or abstract is not so effective. The vividness effect relates to the vividness bias.
Why are placebos used in research?: Placebos are used in medical research for new medication or therapies, called clinical trials. In these trials some people are given a placebo, while others are given the new medication being tested.

The purpose is to determine how effective the new medication is: if it benefits people beyond a predefined threshold as compared to the placebo, it’s considered effective.
How does attrition threaten external validity?: Attrition bias can skew your sample so that your final sample differs significantly from your original sample. Your sample is biased because some groups from your population are underrepresented.

With a biased final sample, you may not be able to generalise your findings to the original population that you sampled from, so your external validity is compromised.
What is the observer-expectancy effect?: The observer-expectancy effect occurs when researchers influence the results of their own study through interactions with participants.

Researchers’ own beliefs and expectations about the study results may unintentionally influence participants through demand characteristics.
What is the definition of observer bias?: Observer bias occurs when a researcher’s expectations, opinions, or prejudices influence what they perceive or record in a study. It usually affects studies when observers are aware of the research aims or hypotheses. This type of research bias is also called detection bias or ascertainment bias.
What’s the difference between demand characteristics and social desirability bias?: Demand characteristics are aspects of experiments that may give away the research objective to participants. Social desirability bias occurs when participants automatically try to respond in ways that make them seem likeable in a study, even if it means misrepresenting how they truly feel.

Participants may use demand characteristics to infer social norms or experimenter expectancies and act in socially desirable ways, so you should try to control for demand characteristics wherever possible.
What is the difference between response and nonresponse bias?: Response bias is a general term used to describe a number of different conditions or factors that cue respondents to provide inaccurate or false answers during surveys or interviews. These factors range from the interviewer’s perceived social position or appearance to the the phrasing of questions in surveys.

Nonresponse bias occurs when the people who complete a survey are different from those who did not, in ways that are relevant to the research topic. Nonresponse can happen either because people are not willing or not able to participate.
Why is bias in research a problem?: Bias affects the validity and reliability of your findings, leading to false conclusions and a misinterpretation of the truth. This can have serious implications in areas like medical research where new forms of treatment are being evaluated.
What are common types of selection bias?: Common types of selection bias are:

Sampling or ascertainment bias

Attrition bias

Volunteer or self-selection bias

Survivorship bias

Non-response bias

Undercoverage bias
Why is generalisability important in research?: Generalisability is important because it allows researchers to make inferences for a large group of people, i.e., the target population, by only studying a part of it (the sample).
What is sampling bias?: Sampling bias occurs when some members of a population are systematically more likely to be selected in a sample than others.
What causes the placebo effect?: Although there is no definite answer to what causes the placebo effect, researchers propose a number of explanations such as the power of suggestion, doctor-patient interaction, classical conditioning, etc.
What’s the difference between confirmation bias and recall bias?: Confirmation bias is the tendency to search, interpret, and recall information in a way that aligns with our pre-existing values, opinions, or beliefs. It refers to the ability to recollect information best when it amplifies what we already believe. Relatedly, we tend to forget information that contradicts our opinions.

Although selective recall is a component of confirmation bias, it should not be confused with recall bias.

On the other hand, recall bias refers to the differences in the ability between study participants to recall past events when self-reporting is used. This difference in accuracy or completeness of recollection is not related to beliefs or opinions. Rather, recall bias relates to other factors, such as the length of the recall period, age, and the characteristics of the disease under investigation.
What are common types of cognitive bias?: Cognitive bias is an umbrella term used to describe the different ways in which our beliefs and experiences impact our judgment and decision making. These preconceptions are ‘mental shortcuts’ that help us speed up how we process and make sense of new information.

However, this tendency may lead us to misunderstand events, facts, or other people. Cognitive bias can be a source of research bias.

Some common types of cognitive bias are:

Anchoring bias

Framing effect

Actor–observer bias

Availability heuristic

Confirmation bias

The halo effect

The Baader–Meinhof phenomenon
What is the bandwagon effect?: The bandwagon effect is a type of cognitive bias. It describes the tendency of people to adopt behaviours or opinions simply because others are doing so, regardless of their own beliefs.
What is the difference between belief bias and confirmation bias?: Belief bias and confirmation bias are both types of cognitive bias that impact our judgment and decision-making.

Confirmation bias relates to how we perceive and judge evidence. We tend to seek out and prefer information that supports our preexisting beliefs, ignoring any information that contradicts those beliefs.

Belief bias describes the tendency to judge an argument based on how plausible the conclusion seems to us, rather than how much evidence is provided to support it during the course of the argument.
What is an availability heuristic example in everyday life?: The availability heuristic can influence our perception of risk in everyday life. One common example occurs when we are considering buying insurance. The sharp increase in purchases of flood insurance in the aftermath of flood events illustrates this phenomenon.

Witnessing such events, knowing someone who was personally affected, or extensive media coverage can make us more aware of floods (or make floods more ‘available’ to us). This can change our risk perception, even though statistically there may not be a change in the probabilities of future flooding.
What is an example of heuristic in psychology?: Heuristics are mental shortcuts or rules of thumb that help people reduce the time and effort required to make a decision. An example of a heuristic in psychology is the availability heuristic (or availability bias). It involves relying on information that comes to mind quickly, (i.e., information that is available to us).

Questions?

Ask our team

Want to contact us directly? No problem. We are always here for you.

Frequently asked questions

See all

How can I contact Scribbr?: Our support team is here to help you daily via chat, WhatsApp, email, or phone between 9:00 a.m. to 11:00 p.m. CET.
Can I choose between the 6th and 7th editions of APA Style?: Our APA experts default to APA 7 for editing and formatting. For the Citation Editing Service you are able to choose between APA 6 and 7.
Can I get a sample edit?: Yes, if your document is longer than 20,000 words, you will get a sample of approximately 2,000 words. This sample edit gives you a first impression of the editor’s editing style and a chance to ask questions and give feedback.

How does the sample edit work?

You will receive the sample edit within 24 hours after placing your order. You then have 24 hours to let us know if you’re happy with the sample or if there’s something you would like the editor to do differently.

Read more about how the sample edit works
Can I upload my document in sections?: Yes, you can upload your document in sections.

We try our best to ensure that the same editor checks all the different sections of your document. When you upload a new file, our system recognizes you as a returning customer, and we immediately contact the editor who helped you before.

However, we cannot guarantee that the same editor will be available. Your chances are higher if

You send us your text as soon as possible and

You can be flexible about the deadline.

Please note that the shorter your deadline is, the lower the chance that your previous editor is not available.

If your previous editor isn’t available, then we will inform you immediately and look for another qualified editor. Fear not! Every Scribbr editor follows the Scribbr Improvement Model and will deliver high-quality work.
Can I have my document edited during weekends and holidays?: Yes, our editors also work during the weekends and holidays.

Because we have many editors available, we can check your document 24 hours per day and 7 days per week, all year round.

If you choose a 72 hour deadline and upload your document on a Thursday evening, you’ll have your thesis back by Sunday evening!
English is not my first language. Can you fix all my mistakes?: Yes! Our editors are all native speakers, and they have lots of experience editing texts written by ESL students. They will make sure your grammar is perfect and point out any sentences that are difficult to understand. They’ll also notice your most common mistakes, and give you personal feedback to improve your writing in English.
What types of editing does Scribbr offer?: Every Scribbr order comes with our award-winning Proofreading & Editing service, which combines two important stages of the revision process.

For a more comprehensive edit, you can add a Structure Check or Clarity Check to your order. With these building blocks, you can customize the kind of feedback you receive.

You might be familiar with a different set of editing terms. To help you understand what you can expect at Scribbr, we created this table:

Types of editing Available at Scribbr?

Proofreading
Correction of superficial mistakes, such as typos, misspellings, punctuation errors and consistency errors. Yes!
This is the “proofreading” in Scribbr’s standard service. It can only be selected in combination with editing.

Copy editing
Focus on grammar, syntax, style, tone and the conventions of the field. The editor also considers the internal logic of the text and flags any obvious contradictions. Yes!
This is the “editing” in Scribbr’s standard service. It can only be selected in combination with proofreading.

Line editing
Focus on language, style, concision and choices. The editor helps you strengthen your story, polish your sentences and ensure that your use of language drives home your ideas. Yes!
Select the Structure Check and Clarity Check to receive a comprehensive edit equivalent to a line edit.

Developmental editing (i.e. content editing, substantive editing)
This is the first step of the editing process and applies to very early drafts. The editor helps you structure your ideas, decide what story to tell and find direction for your writing. No.
This kind of editing involves heavy rewriting and restructuring. Our editors cannot help with this.

View an example
Is the editor an expert in my field of study?: When you place an order, you can specify your field of study and we’ll match you with an editor who has familiarity with this area.

However, our editors are language specialists, not academic experts in your field. Your editor’s job is not to comment on the content of your dissertation, but to improve your language and help you express your ideas as clearly and fluently as possible.

This means that your editor will understand your text well enough to give feedback on its clarity, logic and structure, but not on the accuracy or originality of its content.

Good academic writing should be understandable to a non-expert reader, and we believe that academic editing is a discipline in itself. The research, ideas and arguments are all yours – we’re here to make sure they shine!
How do I receive my document when the editor has finished proofreading?: After your document has been edited, you will receive an email with a link to download the document.

The editor has made changes to your document using ‘Track Changes’ in Word. This means that you only have to accept or ignore the changes that are made in the text one by one.

It is also possible to accept all changes at once. However, we strongly advise you not to do so for the following reasons:

You can learn a lot by looking at the mistakes you made.

The editors don’t only change the text – they also place comments when sentences or sometimes even entire paragraphs are unclear. You should read through these comments and take into account your editor’s tips and suggestions.

With a final read-through, you can make sure you’re 100% happy with your text before you submit!
I have a tight deadline. Can you edit my document in time?: You choose the turnaround time when ordering. We can return your dissertation within 24 hours, 3 days or 1 week. These timescales include weekends and holidays. As soon as you’ve paid, the deadline is set, and we guarantee to meet it! We’ll notify you by text and email when your editor has completed the job.

Very large orders might not be possible to complete in 24 hours. On average, our editors can complete around 13,000 words in a day while maintaining our high quality standards. If your order is longer than this and urgent, contact us to discuss possibilities.

Always leave yourself enough time to check through the document and accept the changes before your submission deadline.
What type of documents does Scribbr proofread?: Scribbr is specialised in editing study related documents. We check:

PhD Theses

Graduation projects

Dissertations

Essays

Admissions essays

College essays

Application essays

Personal statements

Reports

Process reports

Reflections

Internship reports

Academic papers

Interviews

Proposals

Research proposals

Prospectuses

Calculate the costs
How fast can Scribbr proofread my document?: The fastest turnaround time is 24 hours.

You can upload your document at any time and choose between four deadlines:

Same day delivery

3 hours

6 hours

12 hours

24 hours

3 days

7 days
What is Scribbr’s 100% happiness guarantee?: At Scribbr, we promise to make every customer 100% happy with the service we offer. Our philosophy: Your complaint is always justified – no denial, no doubts.

Our customer support team is here to find the solution that helps you the most, whether that’s a free new edit or a refund for the service.
Can I choose between American, British and Australian English?: Yes, in the order process you can indicate your preference for American, British, or Australian English.

If you don’t choose one, your editor will follow the style of English you currently use. If your editor has any questions about this, we will contact you.

Types of editing	Available at Scribbr?
Proofreading Correction of superficial mistakes, such as typos, misspellings, punctuation errors and consistency errors.	Yes! This is the “proofreading” in Scribbr’s standard service. It can only be selected in combination with editing.
Copy editing Focus on grammar, syntax, style, tone and the conventions of the field. The editor also considers the internal logic of the text and flags any obvious contradictions.	Yes! This is the “editing” in Scribbr’s standard service. It can only be selected in combination with proofreading.
Line editing Focus on language, style, concision and choices. The editor helps you strengthen your story, polish your sentences and ensure that your use of language drives home your ideas.	Yes! Select the Structure Check and Clarity Check to receive a comprehensive edit equivalent to a line edit.
Developmental editing (i.e. content editing, substantive editing) This is the first step of the editing process and applies to very early drafts. The editor helps you structure your ideas, decide what story to tell and find direction for your writing.	No. This kind of editing involves heavy rewriting and restructuring. Our editors cannot help with this.

Frequently asked questions

How does a funnel plot measure publication bias?

Frequently asked questions: Research bias

Questions?

Ask our team

Frequently asked questions

How does the sample edit work?