Catalogue Search | MBRL
Search Results Heading
Explore the vast range of titles available.
MBRLSearchResults
-
DisciplineDiscipline
-
Is Peer ReviewedIs Peer Reviewed
-
Item TypeItem Type
-
SubjectSubject
-
YearFrom:-To:
-
More FiltersMore FiltersSourceLanguage
Done
Filters
Reset
99
result(s) for
"Mixed-mode designs"
Sort by:
Mixing modes in a population-based interview survey: comparison of a sequential and a concurrent mixed-mode design for public health research
by
Mauz, Elvira
,
Hoebel, Jens
,
Schmich, Patrick
in
Bias
,
Comparative analysis
,
Concurrent mixed-mode design
2018
Background
Population-based surveys currently face the problem of decreasing response rates. Mixed-mode designs are now being implemented more often to account for this, to improve sample composition and to reduce overall costs. This study examines whether a concurrent or sequential mixed-mode design achieves better results on a number of indicators of survey quality.
Methods
Data were obtained from a population-based health interview survey of adults in Germany that was conducted as a methodological pilot study as part of the German Health Update (GEDA). Participants were randomly allocated to one of two surveys; each of the surveys had a different design. In the concurrent mixed-mode design (
n
= 617) two types of self-administered questionnaires (SAQ-Web and SAQ-Paper) and computer-assisted telephone interviewing were offered simultaneously to the respondents along with the invitation to participate. In the sequential mixed-mode design (
n
= 561), SAQ-Web was initially provided, followed by SAQ-Paper, with an option for a telephone interview being sent out together with the reminders at a later date. Finally, this study compared the response rates, sample composition, health indicators, item non-response, the scope of fieldwork and the costs of both designs.
Results
No systematic differences were identified between the two mixed-mode designs in terms of response rates, the socio-demographic characteristics of the achieved samples, or the prevalence rates of the health indicators under study. The sequential design gained a higher rate of online respondents. Very few telephone interviews were conducted for either design. With regard to data quality, the sequential design (which had more online respondents) showed less item non-response. There were minor differences between the designs in terms of their costs. Postage and printing costs were lower in the concurrent design, but labour costs were lower in the sequential design. No differences in health indicators were found between the two designs. Modelling these results for higher response rates and larger net sample sizes indicated that the sequential design was more cost and time-effective.
Conclusions
This study contributes to the research available on implementing mixed-mode designs as part of public health surveys. Our findings show that SAQ-Paper and SAQ-Web questionnaires can be combined effectively. Sequential mixed-mode designs with higher rates of online respondents may be of greater benefit to studies with larger net sample sizes than concurrent mixed-mode designs.
Journal Article
The effect of prepaid incentives on panelists’ response across survey modes in a sequential mixed-mode design
2025
While the use of prepaid incentives and data collection in a sequential mixed-mode survey design is standard in cross-sectional and longitudinal studies, little is known about the interaction of these strategies and how this affects target persons’ survey participation. Therefore, based on a panel study, this study investigates whether such unconditional prepayments—monetary or non-monetary incentives—increase the efficiency of a sequential mixed-mode survey design in regard to boosted response rates and speed of return after receipt of an invitation to participate in a survey. While the survey design is always identical, the different incentives vary across the waves considered. Different prepayments, such as cash or in-kind incentives, have different effects on invitees’ participation in different survey modes. In particular, non-monetary incentives seem to work only in a sequential mixed-mode design, while cash, as a universal medium, always works in the expected way, across different survey modes. In sum, the study finds that when a single sequential mixed-mode design is used across panel waves the overall response rates are rather similar, even when different incentives are provided.
Journal Article
The effects of a special sequential mixed-mode design, and reminders, on panellists’ participation in a probability-based panel study
2022
The sequential mixed-mode strategy has become standard practice in the survey management of longitudinal studies, in order to achieve consistently high response rates. To realise this aim in a cost-efficient way, a first mode is often an online questionnaire, towards which the target persons are pushed, and a second mode is then a telephone interview, offered to those who do not respond to the initial mode. However, the rationale for using the sequential mixed-mode plus “push-to-web” strategy to reduce the burden of choosing between survey modes, in order to maximise survey participation, could be undermined if there is an overlapping field period during which the target persons could choose between two or more offered modes. The use of reminders might be useful in solving this problem of competing risks. In the context of a multiple-panel study, this question was investigated by utilising longitudinal paradata from the fieldwork, as well as procedures of event history analysis that are adequate for the analysis of processes with competing risks. First, for a web survey as the initial mode and computer-assisted telephone interview (CATI) as the subsequent mode, it was found that the idea of a sequential mixed-mode plus “push-to-web” strategy does work even in the case of competing risks in the choice of a survey mode. Second, it was confirmed that reminders are a useful instrument for stimulating panellists to choose the running survey mode. Third, and finally, it was found that this feature of survey management is effective in countering panellists’ procrastination in regard to responding to a survey.
Journal Article
Short- and long-term effects of reminders on panellists’ survey participation in a probability-based panel study with a sequential mixed-mode design
2023
In recent panel studies, besides other methods such as sequential mixed-mode design, push-to-web method, and prepaid monetary incentives, follow-up contacts such as personalised electronic mails (e-mails) or short message service are often used to motivate nonrespondents to complete the questionnaire, increase the response rate within a limited fieldwork period, and minimise panel attrition. Since it is still unclear when and how often non-complying panellists should be reminded to take part in a survey, this contribution analyses the short- and long-term effects of digital reminders across the fieldwork period. For this purpose, longitudinal data and statistical procedures of event history analysis are applied to reveal the effects of reminders on the likelihood, timing, and social structure of Swiss juveniles’ survey participation. On the one hand, there are short-term and long-term effects of multiple early reminders on the response of panellists receiving reminders. On the other hand, there are no cumulative effects across the fieldwork period or overlapping effects of reminders across the mixed survey modes. Considering the social structure of nonrespondents who receive reminders, it appears plausible that there may be a selective response in terms of the panellists’ social origin, educational level, and language proficiency.
Journal Article
The effect of home visits as an additional recruitment step on the composition of the final sample: a cross-sectional analysis in two study centers of the German National Cohort (NAKO)
by
Mikolajczyk, Rafael
,
Kluttig, Alexander
,
Bedir, Ahmed
in
Age groups
,
Angina pectoris
,
Body mass index
2021
Background
Participation in epidemiologic studies has been declining over the last decades. In addition to postal invitations and phone calls, home visits can be conducted to increase participation. The aim of this study was therefore to evaluate the effects of home visits in terms of response increase and composition of the additionally recruited and final sample.
Methods
In the framework of the German National Cohort (NAKO) recruitment process, two of 18 study centers, Halle (Saale) and Berlin-Center, performed home visits as additional recruitment step after postal invitation and reminders. Response increase was calculated and differences between participants recruited via home visits and standard recruitment were examined. Proportions are presented as percentages with 95%-confidence intervals.
Results
In the general population in Halle, 21.3-22.8% participated after postal invitation and two reminders in the five assessed recruitment waves. The increase of the overall response was 2.8 percentage points (95%confidence interval: 1.9-4.0) for home visits compared to 2.4 percentage points (95%CI: 1.7-3.3) for alternatively sent third postal reminder. Participants recruited via home visits had similar characteristics to those recruited via standard recruitment. Among persons of Turkish descent in Berlin-Center site of the NAKO, home visits conducted by native speakers increased the participation of women, persons living together with their partner, were born in Turkey, had lower German language skills, lower-income, lower education, were more often smokers and reported more often diabetes and depression to a degree which changed overall estimates for this subsample.
Conclusions
As an additional recruitment measure in the general population, home visits increased response only marginally, and the through home visits recruited participants did not differ from those already recruited. Among persons with migration background, home visits by a native speaker increased participation of persons not reached by the standard recruitment, but the effects of using a native speaker approach could not be separated from the effect of home visits.
Journal Article
Lessons Learned From a Sequential Mixed-Mode Survey Design to Recruit and Collect Data From Case-Control Study Participants: Formative Evaluation
by
White, Alice E
,
Scallan Walter, Elaine J
,
Albanese, Bernadette A
in
COVID-19
,
Disease transmission
,
Ethnicity
2024
Sequential mixed-mode surveys using both web-based surveys and telephone interviews are increasingly being used in observational studies and have been shown to have many benefits; however, the application of this survey design has not been evaluated in the context of epidemiological case-control studies.
In this paper, we discuss the challenges, benefits, and limitations of using a sequential mixed-mode survey design for a case-control study assessing risk factors during the COVID-19 pandemic.
Colorado adults testing positive for SARS-CoV-2 were randomly selected and matched to those with a negative SARS-CoV-2 test result from March to April 2021. Participants were first contacted by SMS text message to complete a self-administered web-based survey asking about community exposures and behaviors. Those who did not respond were contacted for a telephone interview. We evaluated the representativeness of survey participants to sample populations and compared sociodemographic characteristics, participant responses, and time and resource requirements by survey mode using descriptive statistics and logistic regression models.
Of enrolled case and control participants, most were interviewed by telephone (308/537, 57.4% and 342/648, 52.8%, respectively), with overall enrollment more than doubling after interviewers called nonresponders. Participants identifying as female or White non-Hispanic, residing in urban areas, and not working outside the home were more likely to complete the web-based survey. Telephone participants were more likely than web-based participants to be aged 18-39 years or 60 years and older and reside in areas with lower levels of education, more linguistic isolation, lower income, and more people of color. While there were statistically significant sociodemographic differences noted between web-based and telephone case and control participants and their respective sample pools, participants were more similar to sample pools when web-based and telephone responses were combined. Web-based participants were less likely to report close contact with an individual with COVID-19 (odds ratio [OR] 0.70, 95% CI 0.53-0.94) but more likely to report community exposures, including visiting a grocery store or retail shop (OR 1.55, 95% CI 1.13-2.12), restaurant or cafe or coffee shop (OR 1.52, 95% CI 1.20-1.92), attending a gathering (OR 1.69, 95% CI 1.34-2.15), or sport or sporting event (OR 1.05, 95% CI 1.05-1.88). The web-based survey required an average of 0.03 (SD 0) person-hours per enrolled participant and US $920 in resources, whereas the telephone interview required an average of 5.11 person-hours per enrolled participant and US $70,000 in interviewer wages.
While we still encountered control recruitment challenges noted in other observational studies, the sequential mixed-mode design was an efficient method for recruiting a more representative group of participants for a case-control study with limited impact on data quality and should be considered during public health emergencies when timely and accurate exposure information is needed to inform control measures.
Journal Article
A comparison of data collection methods: Mail versus online surveys
2018
Online surveys offer an alternative to mail, telephone, and on-site techniques for gathering data. However, criticisms of Internet surveys, including survey and item nonresponse bias, and differences in the nature of the data have been raised. A total of 11 data sets were collected at Zuma Beach, California; within various state parks and forests in Massachusetts; at Buck Island Reef National Monument, USVI; and at Dry Tortugas National Park, Florida. These studies were designed, in part, to test for differences between the modes of survey delivery. Data for each study site were collected via both mail and Internet surveys, with the mail and Internet surveys being identical for each study location. Results indicate that while some differences exist between mail and online surveys at the individual study level, these differences are not present when the studies are combined and that mode differences observed for individual studies may be idiosyncratic rather than mode specific.
Journal Article
Are Prepaid Monetary Incentives Sufficient for Reducing Panel Attrition and Optimizing the Response Rate? An Experiment in the Context of a Multi-Wave Panel with a Sequential Mixed-Mode Design
2018
In this contribution, we evaluate the short- and long-term effects of a prepaid cash incentive on young people’s cooperation and response rate in the fourth and fifth wave of a panel with sequential mixed-mode design (online questionnaire, CATI). Analyses are based on a survey experiment of students from randomly selected school classes of equal shares, which have participated in the third wave. Findings show that a monetary incentive has a direct and positive effect on the response rate in the fourth but not in the subsequent wave. However, the effect of the incentive is not persistent, since the effect weakens and fades away during the field phase and cannot be directly transferred to the second survey mode. As emphasized in the tailored design method (TDM), a monetary incentive can contribute to a shorter field phase and hence lower costs, but it is an insufficient instrument against panel attrition and the optimization of the retention rate when other strategies are disregarded.
Journal Article
Data Collection in a Probability-Based Internet Panel: How the LISS Panel Was Built and How It Can Be Used
2011
Collecte des données dans un panel Internet basé sur les probabilités - Comment le panel LISS a été construit et comment il peut être utilisé: Dans cet article nous présentons la méthodologie pour la mise en place d’un panel qui combine les normes scientifiques pour un panel longitudinal avec les avantages des entretiens par Internet comme méthode de collecte de données. Un panel qui est destiné à la recherche scientifique exige un échantillon probabiliste, couvrant toute la population d’intérêt et donc y compris les personnes sans accès à Internet et les personnes qui ne sont pas volontaires pour répondre aux questions. Nous montrons comment un tel panel peut être construit et entretenu, et comment les chercheurs peuvent l’utiliser et travailler à partir de leurs données gratuites.
In this paper, we introduce a methodology to set up a panel that combines the scientific standards for a longitudinal panel with the advantages of Internet interviewing as a method of data collection. A panel that is intended for scientific research demands a probability sample, covering the whole population of interest and thus including people without Internet access and people who do not actively volunteer to answer questions. We will show how such a panel can be built and maintained, and how researchers can use it for their own, cost free data collection.
Journal Article
Survey Experiments on Interactions and Nonresponse: A Case Study of Incentives and Modes
by
Bianchi, A.
,
Biffignandi, S.
in
computer assisted personal interviewing‐only design
,
incentives
,
longitudinal panel
2019
This chapter presents a case study focusing on the comparison of a mixed‐mode design with a web component and a computer assisted personal interviewing‐only design and on the use of incentives. Outcome measures include response rate and other quality indicators. The chapter investigates these factors in a single wave of a longitudinal panel. It presents a critical review of the literature on randomized experiments to study the effects of incentives with special reference to different modes. The chapter then presents the case study based on experiments carried out in Wave 5 of the Understanding Society Innovation Panel in 2012. Outcomes from the experiments are presented using statistical tests and models. The case study provides an example of how to design such experiments and how to handle the analysis of such experiments from a statistical perspective, while also providing evidence of the impact of incentive strategies and modes.
Book Chapter