Sun
Aug
20

2006

National Church Life Survey - a waste of time?

Today (Sunday) was our church’s day to complete the NCLS.
On a number of levels, I’m not convinced this is a worthwhile use of our time and energy.
I should preface this by saying that this is my personal opinion, and does not reflect my church’s official policy. I also have no training in statistics.

  • Statistical sample In one sense, I understand that there is value in collecting basic biographical and sociological information about who is in our churches on a given day. But even then, there are problems. We get back a basic statistical package about our church. But surely, the sample is so small (statistically speaking) as to be of very limited use. For example at a previous church in a poor area of Sydney, we had only one or two people native to that congregation who had tertiary qualifications. But the presence of some people who were from another part of Sydney, helping us build up our church for a year or two, meant that one NCLS came back saying that our morning congregation had a ridiculously high number of people with uni degrees! The survey did not reflect the reality.
  • Phrasing of questions I have no idea how the science of phrasing questions in surveys works, but I do know it doesn’t work with the NCLS. Today’s survey kept mixing up the use of the terms ‘church service’ and ‘congregation’. Most people in our church use the term ‘congregation’ to refer to those people who gather at a particular time on (for us) a Sunday. Eg: the 9:45am congregation. The survey used the word in that way and to refer to all the people that belong to Toongabbie Anglican. Other terms are ambiguous and rubbery, and can mean very different things in (for example) the Sydney Anglican context, compared to other denominations in Sydney or even Anglican churches elsewhere.
  • Self Assessment This is a more difficult issue. Surveys like the NCLS are all about what we think of our church and our leadership. But why should that be such an important issue? Surely, if a church’s leadership needs a national survey to tell them that their members are not happy with the senior minister, then that church has real problems that a survey certainly won’t help! Surely, in the end, the only assessment of our church that really matters is that of Jesus. I know personally of one minister who started a ministry in a church that had suffered under comparatively liberal teaching in the past. He started gently, sensitively but clearly and uncompromisingly teaching the Bible. A few months into his time there, an NCLS survey was completed. The result showed that a high proportion of his church members were not happy with his teaching and leadership! The survey concluded that it was not a healthy, growing church and implied that urgent action was needed. But the truth is, his ministry was exactly what that church needed (and time has proved that). The problem was the members self-assessment was deeply flawed and not based on what Jesus values in a church.

    In Revelation 2-3 we have the letters to the seven churches in Asia Minor. They are short notes of assessment of those churches by Jesus. Mini report cards, if you like.
    In more than one, they are criticised for having an inaccurate view of their spiritual state. Thinking they were more healthy than they were.
    The NCLS is a real temptation for us to do the same. And that’s a real spiritual danger. We would be better off pausing and thinking about the qualities that Jesus looks for in His church. Then spending time in repentance and prayer for how we fail.

  • Use of resources Our denomination takes the survey seriously, and various church bodies will use the results of the survey to form policy and direct resources. But what if the survey results are skewed? Those resources and polices will be seriously flawed. Our navel-gazing and self-focus can have an ongoing and significant negative impact on our mission.

    Conclusion
    At the local level, I am not aware that we have done a single constructive thing with the results from the last survey.
    Today, all three meetings were seriously disrupted for up to 35 minutes while the survey was done, distracting from the ministry of the word, and breaking the flow of fellowship between people.
    All for what?
    Another small forest of trees sacrificed on the alter of the self-obsessed.

    NCLS? Bah! Humbug.

Comment

  1. In the end it was easier just to fill it out and be done with it. Hopefully the results will be ignored as in previous years, otherwise I should have the same concerns.

    — David G · Aug 21, 04:34 AM · #

  2. I think that there were a couple of useful things you could glean from it. Probably the most obvious is the spiritual health of the church – there were quite a few questions about whether people do personal bible readings and prayer and stuff like that. If the results come back saying that a large proportion of our church doesn’t take care of their own spiritual health, you know that that is something you can be pushing.

    Regarding leadership, you can use your brain and figure out what the asnwers really mean. Your example about the minister coming into the liberal church could have looked at the answers saying they didn’t like his teaching to tell him that there were people in his flock that were spiritually immature etc and so it would help him to know that he had to work even harder teach them, both by working on his preaching as well as praying that God would change their hearts.

    Having said that, a minister should probably have an idea about these things already.

    David Corless · Aug 21, 05:56 AM · #

  3. I agree, Phone, but to get an accurate ‘reading’ on whether people do personal Bible readings and so on, people have to honestly complete the survey. I would hazard a guess that because of what we know about the way people fill out surveys in general, people will tend to over-rate themselves unless they very deliberately choose not to; I know I was tempted to make myself look better than I really am! I suspect that Christians are probably not exempt from self-presentational bias, just because they are Christians, and there didn’t appear to be any statistical checks and balances to pick that kind of bias up.

    Ultimately, though, I have to ask, what’s the point of doing the NCLS if we aren’t implementing anything with it, especially if it disrupts our church meetings like it did last night?

    Ben · Aug 21, 03:42 PM · #

  4. Ben beat me to answering most of your thoughts Phone, and I think you answered yourself with your last point. In addition to presenting what should be the bleedin’ obvious in the case of my minister friend, the distorted view of that church would have been entered in the national database.
    Get enough of those blunders (and anecdotally, I think there are a lot of big errors), and you have some real problems as resources are directed based on that data.

    NeilA · Aug 21, 03:49 PM · #

Commenting is closed for this article.