I had the opportunity to sit in, as a guest lecturer, on a doctoral seminar in the Instructional Systems program at Florida State University in 2007. Prof. Norbert Seel, who led the seminar, asked students to indicate what each regarded as the single most important research question to be addressed in the next five years in the domain of instructional systems, broadly and loosely defined to include analysis, design, development, evaluation, management and technology. Answers reflected topic areas rather than research questions. He then asked each student to indicate an appropriate research methodology to address [part or all of] the indicated question – this proved to be problematic since topic areas rather research questions had been indicated. I was struck by two things. First, the notions of ‘science’ and ‘research’ seemed to vary considerably from one person to another. Second, specific responses indicated a strong tendency to only consider those aspects of instructional systems with which a particular individual was engaged, with the implicit assumption that what each was doing represented the most critical research issue in instructional systems.
What is science? What is the nature of scientific inquiry? What distinguishes scientific research from other forms of research? What do scientists do? There are many answers to such questions. They can be found in books on the philosophy of science and in nearly every introductory text to a particular scientific discipline. I found myself generating such questions during Prof. Seel’s seminar as various doctoral students provided their responses. I settled on a rough and ready representation of inquiry in physics as a starting point. For centuries, physicists have been asking such questions as these: (a) what kinds of things are there in the universe? (b) where did these things come from? and, (c) how do these different kinds of things affect each other? My first thought was that the basic questions within a discipline have remained fairly stable over the years; what have changed are the instruments and tools used to develop answers, which have led to new answers and some variations on the basic questions. Of course research methods and perspectives have also evolved, partly based on new answers to the basic questions. The basic research questions, though, change very little from one generation to the next, in spite of what we might want to believe our how innovative and radical our own approaches are. What changes are the answers to those basic research questions. Moreover, interpretations of the basic questions have changed considerably over the years; new interpretations of the basic questions might be regarded as representing a new approach, or possibly even a paradigm shift.
For example, Empedocles, (a pre-Socratic physicist who lived circa 492-432 BCE) believed that there were only four basic things - earth, air, fire and water – and that the physical world and our experiences could be completely accounted for in terms of these four elements and their interactions. Aristotle further elaborated this view of matter and argued that all earthly substances contained mixtures of these four elements, with the particular distribution of the basic elements determining the nature and appearance of a particular object. For example, a rock contained much more earth than air, fire or water, according to Aristotle, which is presumably why rocks are hard, not readily combustible, and not easily transformed into liquid or gaseous forms. Aristotle then identified four kinds of causes: (a) material cause – the basic composition of an object; (b) formal cause – the inherent or underlying structure of a thing; (c) efficient cause – how the thing came to be in its current state; and (d) final cause – the purpose of an object.
We do not think about the world in the same way as did Empedocles and Aristotle. Physicists no longer accept their account of the physical world. In spite of dramatic advances in physics in the last two thousand years, much has not changed. What has not changed are the basic questions: What kinds of things exist, where did they come from, and how do they interact? Scientists are still attempting to elaborate adequate answers to these basic questions. Modern answers are that there are some 118 or so elements – a few more than four – and these elements are comprised of more basic building blocks – with leptons, quarks, and bosons being the basic categories for these sub-atomic building blocks. Where did these things come from? Big bang … or is that just someone knocking on my office door?
My basic line of thought while listening to various doctoral students was that this framework might be applicable to Prof. Seel’s questions. Someone will tell me not to waste my time because such an account applies only to the hard sciences – the physical sciences, such as astronomy, biology, chemistry, and physics. This person says that the soft sciences (including the social sciences, the learning sciences, and what Herbert Simon called the sciences of the artificial) are different. I understand those distinctions, I think, but there are some common concerns that I believe apply across all the sciences. Basically, what scientists want to know is what exists – the building blocks – and how these things interact to bring about the things we observe, predict or would like to create. While causal interactions might be more difficult to establish in the social sciences, there is still strong interest in understanding, explaining, and predicting critical human interactions, including the development of knowledge and expertise. While the things that social scientists investigate might not be as precisely and narrowly defined as those investigated by physical scientists, there is still strong interest in identifying the basic elements that explain and can predict what we have observed and are likely to observe with regard to human learning and development. Moreover, if we wish instructional design knowledge and practice to be cumulative, it would seem to be in our interest to have a small set of basic questions and ways to explore those questions that others could examine with regard to credibility of methods and veracity of findings.
Perhaps this is a biased or naïve interpretation of science. Nonetheless, I am going to look for the basic elements and their interactions in the domain of instructional systems. What are the basic building blocks of an instructional system? What comes to mind immediately are students, instructors, things to be learned, and instructional resources. This might be an earth-air-fire-and-water kind of answer, though. Each of these elements might be further elaborated in terms of more discrete components which are more informative with regard to explaining interactions that are observed or desired.
What are the essential interactions or causal influences in an instructional or learning context? Outcomes common to most instructional and learning systems include improved understanding and performance with regard to some body of knowledge or set of skills. This implies that there should be reliable ways to assess relative levels of understanding and performance (relative to past performance or understanding or relative to a desired standard or goal). Other outcomes might be identified, and these might be further elaborated in terms of types of outcomes (e.g., affective, cognitive, psycho-motor or … there are many ways to cluster outcomes) and their relationship to knowledge, beliefs, attitudes, habits of minds, mental models, skills, and such.
Regardless of the sophistication and granularity of the components and interactions, we want to understand the various things that comprise an instructional or a learning system and how they are related, especially with regard to efficacy in achieving desired outcomes. Maybe. Well, I seem to recall Gagné saying that our job was to help people learn better. What can we do at a systems level to fulfill that responsibility? How can we measure and foster success?
Lastly, there is the notion of research issues central to progress in a domain. The students who responded to Prof. Seel each had a favorite area or method of inquiry. Why believe that one’s favorite area or method of inquiry is critical to progress in instructional and learning systems research, however? What evidence can one bring to bear to defend such a view? How might one identify critical areas and methods of research inquiry in educational technology?
One might think beyond oneself and beyond one’s own training and set of predispositions. One might look at what distinguished researchers in related areas have said. The Book of Problems (see the 2002 events archive at www.learndev.org) would be a good starting point, I would think. I recall the advice I was given when selecting a dissertation topic by Ed Allaire, my dissertation advisor at the University of Texas in Austin: Pick the central domain and then pick a central unresolved issue within that domain. Allaire’s perspective was that writing a dissertation was a part of an ongoing process of developing knowledge and competence, and, further, that familiarity with central issues was an essential part of that process. Of course there is some subjectivity in this – there will be different views about the centrality of domains and issues. I suspect, however, that a small number of alternatives can be identified. What might these alternatives be for instructional and learning systems?
That is where I thought the discussion might have gone in Prof. Seel’s seminar, or at least that is how it was going in my mind during the seminar. What I have not touched upon yet is a core issue involving values – values that are at the core of scientific inquiry. The starting point of scientific research is a desire to understand a phenomenon or situation or sequence of events. This implies that one admits to a state of relative ignorance: “I do not understand this.” One might say that humility (“I know that I do not know”) is the starting point of every scientific inquiry. What do leading instructional systems researchers admit to not knowing or not understanding? Again I recommend looking at Visser’s Book of Problems (www.learndev.org) to gain insight in to this question. There is too much that I do not know about learning and instruction for me to include the list here. However, one thing that I do not understand well is how particular people develop competence in solving complex, challenging and ill-structured problems. We do learn by doing, so engaging in and reflecting on such problem-solving and decision-making activities seems to be a necessary ingredient in the mix. It also seems woefully insufficient, however. More challenging still, from my perspective, is how we can measure individual progress in developing such skills, which I think is needed in order to develop and implement robust and reliable training programs. We could of course leave such matters to chance and coincidence, but there does seem to be an increasing demand for people who are skilled in solving very complex problems.
A second value to add to humility with regard to scientific investigation concerns being open to alternatives. “This alternative you or I have devised is only one possible approach or explanation; perhaps there are others.” The inability to imagine alternative explanations does not mean that alternative explanations do not exist. Alternative explanations always exist (this is a remark about the logic of scientific explanations). Humility is the starting point, and openness to alternative explanations is required for sustained inquiry.
Finally, one ought to engage in a kind of inquiry that will contribute to progress of human knowledge in and about the domain of inquiry. Scientific inquiry at its best is cumulative and progressive. This requires using reliable instruments and methods that others might also use. If every study is about a unique situation and every instrument used is unique to that study, then generalizing findings becomes a significant challenge – that is one of the many challenges confronting educational research, I think.
Perhaps no one mentioned such things because they are so obvious. I find myself requiring such reminders, though.
Mike Spector
AECT President
Thursday, December 17, 2009
Saturday, December 12, 2009
To Serve and Support
Ideas come and go. Sometimes they come back. Occasionally they take root. Here is one that has returned several times since I became AECT President. The idea is simply that a primary responsibility of an educator is to serve and support. This is not a new idea. I suppose it has returned because I have had the chance to see it in action several times in the last few months. I visited the annual convention of the New Jersey Association of School Librarians and saw many persons there demonstrating a variety of innovative technology integration efforts in New Jersey schools. The school librarians and media specialists who presented their work were uniformly focused on helping students learn. These educators were serving and supporting their students. I have been working with teachers in poorly performing rural K-8 schools in the Southeast where I have seen teachers dedicated to helping their students improve in reading, mathematics and science. I have visited schools in Indonesia and seen teachers there helping students learn without the benefit of any of the technologies we take for granted.
I recall the mentors I have had over the years. In our field, I have benefitted from the support of Bob Gagné and Dave Merrill and others who helped me develop an understanding of instructional technology and educational research. I have seen service and support in action, and I have personally benefitted from the service and support of others. I am now confronted with a serious question of conscience. Am I doing what I could or should to serve and support?
I am generally suspicious of self-assessments, but I will venture one here because I want to urge those who might read this to ask themselves the same question. I think I have done well with regard to my personal life and my family, especially my children (they might disagree with this assessment). However, when I think about service and support in my professional life I am inclined to say I have been more focused on self-service and self-promotion and less focused on service and support to students. This is perhaps not unusual. It is perhaps natural to want to advance one’s career. Doing so might incline one to focus on those to whom one reports – deans and directors and managers – rather than focusing on those for whom one is responsible – students, in my case, or teachers if you are a principal or a dean.
We seem to always be in the middle between those above us – those who pay our salaries – and those we, as educators, are supposed to serve and support. Most of my career has been in higher education and government service, so most of my work has involved adults – college students and government workers. My ideal notion of the chain of service and support is that it should be primarily directed down the official or professional hierarchy in which one is working. In a college or university, this would mean that the president’s service and support should be focused primarily on deans and directors – not the Board of Regents. The dean’s service and support should be focused primarily on faculty and staff – not the provost or president. The teacher’s service and support should be focused primarily on students. Likewise, in a school system, the superintendent’s service and support should be focused on principals, with principals focused primarily on teachers and teachers focused primarily on students.
I know this is a naïve and simplistic view of serving and supporting, but it is my view. When I then consider why I have fallen short, I think about the incentives to perform my duties and responsibilities. I am rewarded for publishing papers and getting grants. I am not directly rewarded for advising a struggling graduate student. Indeed, the time I spend with students is hardly noticed or taken into account in the university systems in which I have worked. There is a token look at service and support of students built into the tenure and promotion process, but that aspect of tenure and promotion that examines one’s service to and support of students is typically very superficial and only marginally influential on the outcome of a tenure and promotion decision.
Publish or perish is alive and well in academia. As a journal editor, I get several emails every year asking about the status of a paper submitted by a junior faculty member who is being reviewed for tenure. Has the paper been reviewed yet? What is the outcome? Will it be published, and, if so, when? The system encourages us to be concerned with ourselves. I have done well, I suppose, in this kind of system in terms of self-advancement. I have neglected students, though – more so than I should or would were I not so busy piling up words, writing papers, pursuing funding, and seeking to advance still more. I cannot blame the system for my behavior, nor am I sure how to improve a university system or a school system to focus on those we should be serving and supporting. I am merely the victim of this simple idea that one should serve and support those for whom one is at least partly responsible.
Of course I wonder about my role as AECT President as well. I should be serving and supporting the membership. How best can I do that? Again I am not sure, but I am convinced that communication is critical. I have heard from some members after the 2009 convention. Some were happy and pleased with the meeting, and some were disappointed. What could I have done differently to better serve and support all of the membership of AECT? One thing I hope to do is to keep the next AECT President, Barbara Lockee, informed of the things I am hearing from the membership. There is not much time to make significant changes in a short period of service, but one can initiate some changes that might be pushed further by the next leader.
Some of the changes that we have been pursuing on behalf of the membership began with prior leaders and include efforts to link AECT to national organizations such as the National Technology Leadership Coalition and the New Media Consortium. We are continuing to make efforts to improve the quality of presentations at the annual meeting by providing feedback to submitters and asking that the comments of reviewers be included in final papers and presentations. We have introduced reflection paper sessions to allow those with new but not yet well developed or empirically explored ideas to present those ideas and get feedback from others – a kind of scholarly mentoring. We are continuing the series of research symposia that focus on research pertaining to important aspects of educational technology.
There are some things to which we have not responded as well as we might have. The venue for the annual conference has been a contentious point over the years. We are not going back to Orlando in response to the membership. However, we are returning to Anaheim because the hotel has lowered its cost and the location will draw a significant number of people. Then I wonder whether the time spent on worrying about the complaints of a few about the venue should outweigh the concern from so many that we pick an affordable location with convenient air access.
In sum, I am not sure if I am really serving and supporting or simply being pushed in one direction or another by various constituencies. I am really not sure about this, but I will try to serve and support as best I can in my remaining 10 months in this position.
To serve and support others or to be self-serving and self-promoting – that is the question of conscience and the idea that has returned to haunt me. I hope that it will haunt you as well. I hope that idea takes root – it will surely require much nourishing and care in order to survive.
Meanwhile, I wish you a happy and safe holiday season.
Mike Spector
AECT President
I recall the mentors I have had over the years. In our field, I have benefitted from the support of Bob Gagné and Dave Merrill and others who helped me develop an understanding of instructional technology and educational research. I have seen service and support in action, and I have personally benefitted from the service and support of others. I am now confronted with a serious question of conscience. Am I doing what I could or should to serve and support?
I am generally suspicious of self-assessments, but I will venture one here because I want to urge those who might read this to ask themselves the same question. I think I have done well with regard to my personal life and my family, especially my children (they might disagree with this assessment). However, when I think about service and support in my professional life I am inclined to say I have been more focused on self-service and self-promotion and less focused on service and support to students. This is perhaps not unusual. It is perhaps natural to want to advance one’s career. Doing so might incline one to focus on those to whom one reports – deans and directors and managers – rather than focusing on those for whom one is responsible – students, in my case, or teachers if you are a principal or a dean.
We seem to always be in the middle between those above us – those who pay our salaries – and those we, as educators, are supposed to serve and support. Most of my career has been in higher education and government service, so most of my work has involved adults – college students and government workers. My ideal notion of the chain of service and support is that it should be primarily directed down the official or professional hierarchy in which one is working. In a college or university, this would mean that the president’s service and support should be focused primarily on deans and directors – not the Board of Regents. The dean’s service and support should be focused primarily on faculty and staff – not the provost or president. The teacher’s service and support should be focused primarily on students. Likewise, in a school system, the superintendent’s service and support should be focused on principals, with principals focused primarily on teachers and teachers focused primarily on students.
I know this is a naïve and simplistic view of serving and supporting, but it is my view. When I then consider why I have fallen short, I think about the incentives to perform my duties and responsibilities. I am rewarded for publishing papers and getting grants. I am not directly rewarded for advising a struggling graduate student. Indeed, the time I spend with students is hardly noticed or taken into account in the university systems in which I have worked. There is a token look at service and support of students built into the tenure and promotion process, but that aspect of tenure and promotion that examines one’s service to and support of students is typically very superficial and only marginally influential on the outcome of a tenure and promotion decision.
Publish or perish is alive and well in academia. As a journal editor, I get several emails every year asking about the status of a paper submitted by a junior faculty member who is being reviewed for tenure. Has the paper been reviewed yet? What is the outcome? Will it be published, and, if so, when? The system encourages us to be concerned with ourselves. I have done well, I suppose, in this kind of system in terms of self-advancement. I have neglected students, though – more so than I should or would were I not so busy piling up words, writing papers, pursuing funding, and seeking to advance still more. I cannot blame the system for my behavior, nor am I sure how to improve a university system or a school system to focus on those we should be serving and supporting. I am merely the victim of this simple idea that one should serve and support those for whom one is at least partly responsible.
Of course I wonder about my role as AECT President as well. I should be serving and supporting the membership. How best can I do that? Again I am not sure, but I am convinced that communication is critical. I have heard from some members after the 2009 convention. Some were happy and pleased with the meeting, and some were disappointed. What could I have done differently to better serve and support all of the membership of AECT? One thing I hope to do is to keep the next AECT President, Barbara Lockee, informed of the things I am hearing from the membership. There is not much time to make significant changes in a short period of service, but one can initiate some changes that might be pushed further by the next leader.
Some of the changes that we have been pursuing on behalf of the membership began with prior leaders and include efforts to link AECT to national organizations such as the National Technology Leadership Coalition and the New Media Consortium. We are continuing to make efforts to improve the quality of presentations at the annual meeting by providing feedback to submitters and asking that the comments of reviewers be included in final papers and presentations. We have introduced reflection paper sessions to allow those with new but not yet well developed or empirically explored ideas to present those ideas and get feedback from others – a kind of scholarly mentoring. We are continuing the series of research symposia that focus on research pertaining to important aspects of educational technology.
There are some things to which we have not responded as well as we might have. The venue for the annual conference has been a contentious point over the years. We are not going back to Orlando in response to the membership. However, we are returning to Anaheim because the hotel has lowered its cost and the location will draw a significant number of people. Then I wonder whether the time spent on worrying about the complaints of a few about the venue should outweigh the concern from so many that we pick an affordable location with convenient air access.
In sum, I am not sure if I am really serving and supporting or simply being pushed in one direction or another by various constituencies. I am really not sure about this, but I will try to serve and support as best I can in my remaining 10 months in this position.
To serve and support others or to be self-serving and self-promoting – that is the question of conscience and the idea that has returned to haunt me. I hope that it will haunt you as well. I hope that idea takes root – it will surely require much nourishing and care in order to survive.
Meanwhile, I wish you a happy and safe holiday season.
Mike Spector
AECT President
Subscribe to:
Posts (Atom)
