Survey format and content

Summary

The survey looked at two major aspects of the Resonate panel research, the structure of the surveys and their content.

Survey structure.

67% of respondents preferred that we continue with the current monthly schedule rather than becoming more or less frequent. Currently respondents complete about one survey in four on average.

Two other factors we looked at were the length of surveys and the time they were ‘in field’ and available to complete. Both of these factors will have an influence on the completion rates for surveys. Up to about 10 minutes duration most respondents will complete a survey if they can irrespective of the subject matter involved. Over 15 minutes in length and the ‘would always do’ dropped off significantly and the subject matter started to become a significant factor. By the time we passed 20 minutes 52% ‘would not do’ and 41% would only do dependent on the subject matter.

Currently surveys are being made available for completion for a period of only 3 or 4 days, largely on the basis that this has proved long enough to usually get a sample of 1000. We have received comments that respondents were disappointed that they had not been able to complete the survey in this time. This is supported by this survey which shows that those who would be likely to take part rose significantly from 19% to 58% if the survey was kept open in field for a full week.

Survey content

It is important that we select subjects that are of interest and importance to respondents in order to maintain their interest and involvement especially when at times commercial research may be less than interesting.

In general survey topics should be relevant and informative to everyday life and where possible have some practical application in their conclusions. Ideally a topic would be newsworthy, of interest to respondent’s interaction with everyday life and of relevance or assistance to their faith development. We discuss specific topics in greater detail later in this report but where a topic can be said to cover a variety of interests and issues it should be designed to do so.

 Chapter 1. Analysis – Survey Structure

 We firstly asked respondents about the frequency with which they would be happy to receive questionnaires and put the following question.

Ideally how frequently would you be happy to receive survey invitations? (knowing you don't have to do them if you do not have the time)?"

 

 Given that about 75% would prefer to receive them monthly or don’t mind, there would seem to be no reason for considering any change from our present monthly schedule.

Respondents were asked to choose between length and frequency of survey.

If you had to choose between the following which would you prefer? (assume both possibilities contain the same number of questions)?

 

Clearly it was the overall number of questions they were asked which was more important although given the choice there was a preference for shorter and more frequent surveys.

We then asked them about their likelihood to complete a questionnaire based on survey length

How likely would you be to complete a survey of the following length?

  

Would always or would usually do remained well above 90% up to a survey length of 10 minutes. By 20 minutes this had dropped significantly to under 40%.

When asked whether subject matter would influence the length of survey respondensts were happy to take they said up to 10 minutes in length subject matter had little effect on their likelihood to complete although by 20 minutes this would be an important factor for over 33% of respondents.

Finally we asked:

Would you be more likely to respond to the questionnaire if you had more time in which to complete it?

 

 Respondents were asked to give their view at 2 or 3 days (the current duration), one week and two weeks. The likelihood rose significantly for one week but fell back if available for two weeks.

 Chapter 2. Analysis – Survey Content

 We asked:

Where we are able to choose the subject of our research surveys we want to ensure that the questions are interesting and useful both to you and the wider Christian community. In your experience how valuable/interesting would the following issues/topics be.

 

 

Subjects were rated on scores from 4 = Very interesting to 1 = Very uninteresting

Chapter 3. Demographics

Questions were asked about the presentation, length and content of the Resonate surveys to help guide development of the survey programme for next year

The survey was conducted amongst 1105 practicing Christians during the week beginning 10th October 2016.

The demographic breakdown was as follows:

Age groups

 

Gender

TOTAL

Male

Female

Other

Prefer not to say

TOTAL

1105

607

494

3

1

100%

55%

45%

0%

0%

100%

100%

100%

100%

100%

16 - 24

2

1

1

0

0

100%

50%

50%

0%

0%

0%

0%

0%

0%

0%

25 - 34

33

16

17

0

0

100%

48%

52%

0%

0%

3%

3%

3%

0%

0%

35 - 44

72

38

34

0

0

100%

53%

47%

0%

0%

7%

6%

7%

0%

0%

45 - 54

199

97

101

1

0

100%

49%

51%

1%

0%

18%

16%

20%

33%

0%

55 - 64

359

198

160

1

0

100%

55%

45%

0%

0%

32%

33%

32%

33%

0%

65 - 74

336

190

145

1

0

100%

57%

43%

0%

0%

30%

31%

29%

33%

0%

75 or over

76

53

23

0

0

100%

70%

30%

0%

0%

7%

9%

5%

0%

0%

Prefer not to say

28

14

13

0

1

100%

50%

46%

0%

4%

3%

2%

3%

0%

100%

 Gender

Age 

 

Region

East Midlands

55

5%

East of England

74

7%

London

91

8%

North East

37

3%

North West

86

8%

South East

301

27%

South West

135

12%

West Midlands

103

9%

Yorkshire & Humberside

62

6%

Wales

42

4%

Scotland

56

5%

Northern Ireland

6

1%

Other

57

5%

 Denomination

Anglican/Church of England

520

47%

Baptist

125

11%

Catholic

33

3%

Independent

93

8%

Methodist

96

9%

New Church

31

3%

Pentecostal

33

3%

Presbyterian

16

1%

Prefer not to say

22

2%

Other

136

12%