Assessing response fatigue in phone surveys: Experimental evidence on dietary diversity in Ethiopia

Assessing response fatigue in phone surveys: Experimental evidence on dietary diversity in Ethiopia PDF

Author: Abay, Kibrom A.

Publisher: Intl Food Policy Res Inst

Published: 2021-04-30

Total Pages: 28

ISBN-13:

DOWNLOAD EBOOK →

The COVID-19 pandemic has spurred interest in the use of remote data collection techniques, including phone surveys, in developing country contexts. This interest has sparked new methodological work focusing on the advantages and disadvantages of different forms of remote data collection, the use of incentives to increase response rates and how to address sample representativeness. By contrast, attention given to associated response fatigue and its implications remains limited. To assess this, we designed and implemented an experiment that randomized the placement of a survey module on women’s dietary diversity in the survey instrument. We also examine potential differential vulnerabilities to fatigue across food groups and respondents. We find that delaying the timing of mothers’ food consumption module by 15 minutes leads to 8-17 percent decrease in the dietary diversity score and a 28 percent decrease in the number of mothers who consumed a minimum of four dietary groups. This is driven by underreporting of infrequently consumed foods; the experimentally induced delay in the timing of mothers’ food consumption module led to a 40 and 11 percent decrease in the reporting of consumption of animal source foods, and fruits and vegetables, respectively. Our results are robust to changes in model specification and pass falsification tests. Responses by older and less educated mothers and those from larger households are more vulnerable to measurement error due to fatigue.

Assessing Response Fatigue in Phone Surveys

Assessing Response Fatigue in Phone Surveys PDF

Author: Kibrom A. Abay

Publisher:

Published: 2021

Total Pages: 26

ISBN-13:

DOWNLOAD EBOOK →

The COVID-19 pandemic has spurred interest in the use of remote data collection techniques, including phone surveys, in developing country contexts. This interest has sparked new methodological work focusing on the advantages and disadvantages of different forms of remote data collection, the use of incentives to increase response rates, and how to address sample representativeness. By contrast, attention given to associated response fatigue and its implications remains limited. This study designed and implemented an experiment that randomized the placement of a survey module on women's dietary diversity in the survey instrument. The study also examines potential differential vulnerabilities to fatigue across food groups and respondents. The findings show that delaying the timing of mothers' food consumption module by 15 minutes leads to 8-17 percent decrease in the dietary diversity score and a 28 percent decrease in the number of mothers who consumed a minimum of four dietary groups. This is driven by underreporting of infrequently consumed foods; the experimentally induced delay in the timing of mothers' food consumption module led to decreases of 40 and 11 percent in the reporting of consumption of animal source foods and fruits and vegetables, respectively. The results are robust to changes in model specification and pass falsification tests. Responses by older and less educated mothers and those from larger households are more vulnerable to measurement error due to fatigue.

COVID-19 and global food security: Two years later

COVID-19 and global food security: Two years later PDF

Author: McDermott, John

Publisher: Intl Food Policy Res Inst

Published: 2022-03-07

Total Pages: 200

ISBN-13: 0896294226

DOWNLOAD EBOOK →

Two years after the onset of the COVID-19 pandemic, the health, economic, and social disruptions caused by this global crisis continue to evolve. The impacts of the pandemic are likely to endure for years to come, with poor, marginalized, and vulnerable groups the most affected. In COVID-19 & Global Food Security: Two Years Later, the editors bring together contributions from new IFPRI research, blogs, and the CGIAR COVID-19 Hub to examine the pandemic’s effects on poverty, food security, nutrition, and health around the world. This volume presents key lessons learned on food security and food system resilience in 2020 and 2021 and assesses the effectiveness of policy responses to the crisis. Looking forward, the authors consider how the pandemic experience can inform both recovery and longer-term efforts to build more resilient food systems.

Phone surveillance, from scratch: Novel sample design features of the nationally representative Myanmar Household Welfare Survey (MHWS)

Phone surveillance, from scratch: Novel sample design features of the nationally representative Myanmar Household Welfare Survey (MHWS) PDF

Author: Myanmar Agriculture Policy Support Activity (MAPSA)

Publisher: Intl Food Policy Res Inst

Published: 2022-04-04

Total Pages: 48

ISBN-13:

DOWNLOAD EBOOK →

The first round of the Myanmar Household Welfare Survey (MHWS)–a nationwide phone panel consisting of 12,100 households–was implemented between December 2021 and February 2022. The objective of the survey was to collect data on a wide range of household and individual welfare indicators–including wealth, livelihoods, unemployment, food insecurity, diet quality, health shocks, and coping strategies–in a country exceptionally hard hit by conflict, severe economic collapse, and several damaging waves of COVID-19. The respondents interviewed in the MHWS were purposely selected from a large phone database aimed at being representative at the region/state level and urban/rural level in Myanmar. In this paper, we discuss two key steps taken to ensure that the MHWS is nationally and subnationally representative at the state/region and urban/rural level. First, we used a quota-based sampling strategy by setting survey quotas for respondents’ geography, education, farming status, gender, and rural/urban residence. This sampling strategy is used to address the well-known drawbacks of phone survey samples (e.g., the over-sampling of more educated respondents) and the survey’s particular interest in over-sampling farm households and equally sampling men and women. Second, we constructed household, population, and individual level weighting factors to further ensure that the survey generates nationally and subnationally representative statistics. To assess the effectiveness of these two strategies on achieving representativeness and consistency with previous surveys, we compare results from the MHWS to earlier nationally representative datasets, focusing on sample sizes of interviewed households for each state/region, and on education levels, farm/non-farm occupation, urban/rural residence, as well as respondents’ housing characteristics, which are unlikely to change substantially over short periods of time. We show that the phone-based MHWS has broader geographical coverage than previous national surveys, reaching 310 of Myanmar’s 330 townships. Moreover, our sampling approach was generally effective in reducing the education bias of phone surveys, except for a handful of states/regions. The MHWS is also unique in providing equal representation of male and female respondents. Additionally, the MHWS sampling and weighting strategies produce statistics on key indicators that closely mirror results from the two most recent national surveys in Myanmar. Overall, the results suggest that these strategies are successful in generating a subnationally representative phone survey that collected data on a rich array of household welfare indicators in exceptionally difficult political and economic circumstances.

Mobile Phone Panel Surveys in Developing Countries

Mobile Phone Panel Surveys in Developing Countries PDF

Author: Andrew Dabalen

Publisher: World Bank Publications

Published: 2016-07-12

Total Pages: 128

ISBN-13: 1464809054

DOWNLOAD EBOOK →

Household survey data are very useful for monitoring living conditions of citizens of any country. In developing countries, a lot of this data are collected through “traditional†? face-to-face household surveys. Due to the remote and dispersed nature of many populations in developing countries, but also because of the complex nature of many survey questionnaires, collection of timely welfare data has often proved expensive and logistically challenging. Yet, there is a need for faster, cheaper to collect, lighter, more nimble data collection methods to address data gaps between big household surveys. The recent proliferation of mobile phone networks has opened new possibilities. By combining baseline data from a traditional household survey with subsequent interviews of selected respondents using mobile phones, this facilitates welfare monitoring and opinion polling almost real time. The purpose of this handbook is to contribute to the development of the new field of mobile phone data collection in developing countries. The handbook documents how this innovative approach to data collection works, its advantages and challenges. The handbook draws primarily from the authors’ first-hand experiences with mobile phone surveys in Africa and also benefits from experiences elsewhere. It is intended to serve a diverse audience including those involved in collecting (representative) data using mobile phones, and those using data collected through this approach. For those who will be implementing a mobile phone panel survey, the different chapters guide them through every stage of the implementation process. For potential users of the data collected via mobile phone technology, the handbook presents a new approach to data collection which they can use for monitoring programs and facilitate almost real time decision-making. A further purpose of this book is to contribute to the debate regarding the advantages of the method as well as the challenges associated with it.

Are we done yet? Response fatigue and rural livelihoods

Are we done yet? Response fatigue and rural livelihoods PDF

Author: Ambler, Kate

Publisher: Intl Food Policy Res Inst

Published: 2020-12-09

Total Pages: 46

ISBN-13:

DOWNLOAD EBOOK →

Accurate understanding of peoples’ livelihoods activities is needed to inform effective policy. Existing evidence relies heavily on studies that use designated respondents to provide information about their household members, imposing significant costs on these respondents along with possible distortions in the data. In rural Ghana, we randomize the order that household members are asked about and estimate that response fatigue leads to undercounting of labor activities by 8% on average. Women are twice as impacted as men while youth are four times as impacted as older adults, distorting both within-household and population wide comparisons. These biases result from women and youth being listed systematically later in rosters and stronger effects of fatigue for them, conditional on roster position. The implications of our results extend to other topics of enquiry as well, wherever similar repetitive survey structures are deployed, such as birth records, plot-level inputs, and household consumption and expenditures.

Impacts of COVID-19 on food security: Panel data evidence from Nigeria

Impacts of COVID-19 on food security: Panel data evidence from Nigeria PDF

Author: Amare, Mulubrhan

Publisher: Intl Food Policy Res Inst

Published: 2020-08-11

Total Pages: 43

ISBN-13:

DOWNLOAD EBOOK →

This paper combines pre-pandemic face-to-face survey data with follow up phone surveys collected in April-May 2020 to quantify the overall and differential impacts of COVID-19 on household food security, labor market participation and local food prices in Nigeria. We exploit spatial variation in exposure to COVID-19 related infections and lockdown measures along with temporal differences in our outcomes of interest using a difference-in-difference approach. We find that those households exposed to higher COVID-19 cases or mobility lockdowns experience a significant increase in measures of food insecurity. Examining possible transmission channels for this effect, we find that COVID-19 significantly reduces labor market participation and increases food prices. We find that impacts differ by economic activities and households. For instance, lockdown measures increased households' experience of food insecurity by 12 percentage points and reduced the probability of participation in non-farm business activities by 13 percentage points. These lockdown measures have smaller impacts on wage-related activities and farming activities. In terms of food security, households relying on non-farm businesses, poorer households, those with school-aged children, and those living in remote and conflicted-affected zones have experienced relatively larger deteriorations in food insecurity. These findings can help inform immediate and medium-term policy responses, including social protection policies aiming at ameliorating the impacts of the pandemic, as well as guide targeting strategies of governments and international donor agencies by identifying the most impacted sub-populations.

Food data collection in Household Consumption and Expenditure Surveys. Guidelines for low and middle income countries

Food data collection in Household Consumption and Expenditure Surveys. Guidelines for low and middle income countries PDF

Author: Food and Agriculture Organization of the United Nations

Publisher: Food & Agriculture Org.

Published: 2018-10-30

Total Pages: 108

ISBN-13: 9251309809

DOWNLOAD EBOOK →

The measurement of food consumption and expenditure is a fundamental component of any analysis of poverty and food security, and hence the importance and timeliness of devoting attention to the topic cannot be overemphasized as the international development community confronts the challenges of monitoring progress in implementing the 2030 Agenda for Sustainable Development. In 2014, the International Household Survey Network published a desk review of the reliability and relevance of survey questions as included in 100 household surveys from low- and middle-income countries. The report was presented in March 2014 at the forty-fifth session of the United Nations Statistical Commission (UNSC), in a seminar organized by the Inter-Agency and Expert Group on Food Security, Agricultural and Rural Statistics (IAEG-AG). The assessment painted a bleak picture in terms of heterogeneity in survey design and overall relevance and reliability of the data being collected. On the positive side, it pointed to many areas in which even marginal changes to survey and questionnaire design could lead to a significant increase in reliability and consequently, great improvements in measurement accuracy. The report, which sparked a lot of interest from development partners and UNSC member countries, prompted IAEG-AG to pursue this area of work with the ultimate objective of developing, validating, and promoting scalable standards for the measurement of food consumption in household surveys. The work started with an expert workshop that took place in Rome in November 2014. Successive versions of the guidelines were drafted and discussed at various IAEG-AG meetings, and in another expert workshop organized in November 2016 in Rome. The guidelines were put together by a joint FAO-World Bank team, with inputs and comments received from representatives of national statistical offices, international organizations, survey practitioners, academics, and experts in different disciplines (statistics, economics, nutrition, food security, and analysis). A list of the main contributors is included in the acknowledgment section. In December 2017 a draft of the guidelines was circulated to 148 National Statistical Offices from low- to high-income countries for comments. The document was revised following that consultation and submitted to UNSC, which endorsed it at its forty-ninth session in March 2018 (under item 3(j) of the agenda, agricultural and rural statistics. The version presented here reflects what was endorsed by the Commission, edited for language. The process received support from the Global Strategy for Agricultural and Rural Statistics. The document is intended to be a reference document for National Statistical Offices, survey practitioners, and national and international agencies designing household surveys that involve the collection of food consumption and expenditure data.