Advising and Supervising Doctoral Students
Gordon B. Davis
Honeywell Professor of Management Information Systems
Carlson School of Management
University of Minnesota
gdavis@csom.umn.edu
Preliminary Draft
April 28, 2003
This draft was prepared for a faculty consortium in Finland. It was also used as an exposure draft by a conference by IFIP WG8.2 and WG9.4.
Information Systems PhD Supervisors' Workshop, June 14, 2003 in Athens, Greece.
Feedback and comments are invited.
Advising and Supervising Doctoral Students
Gordon B. Davis
Honeywell Professor of Management Information Systems
Carlson School of Management
University of Minnesota
Abstract
A major problem with the supervision of doctoral students is the lack of advisor experience. An advisor has done one dissertation under one advisor or supervisor and may have observed some other advisors, but models of supervision are rarely written down. Advice on advising is anecdotal and incomplete. This paper codifies some observations from being on well over a hundred doctoral dissertation committees and being the principal advisor for thirty or so doctoral dissertations. I use the terms “advising” and “supervising” to mean the same thing, i.e., providing guidance, advice, and quality assurance for a doctoral student doing a dissertation.
The process of building expertise in advising a doctoral student begins with understanding four underlying issues: doctoral program assumptions, motivations for a doctorate, advising styles, and student need for advising. The first issue is the underlying assumptions about a doctoral program: the two major assumptions are an entry-level doctorate or a mid-career doctorate. The second issue is the student or program motivation for a doctorate. These motivations range from recognition or prestige to a career requirement with a number of variations of these two extremes. The third issue is different advising styles. At the extremes, these range from a very strong master/apprentice model to a hands-off model. There are many variations between these extremes. Each advising style has advantages and disadvantages, depending on the student and the problems being studied. The fourth issue is differences in student need for advice and supervision. At the extremes, these needs range from need for very close direction and supervision to need only for general direction and supervision. With basic understanding of these issues, an advisor can begin to develop a preferred personal advising style and can make decisions about variations in advising to suit a particular student or problem.
Given an understanding of the four basic issues of program assumptions, student motivations, advising styles, and student needs, an advisor should be familiar with and apply some basic concepts about doctoral advising and some useful procedures. These concepts and procedures will help in achieving good results. Three basic concepts relate to the definition of contribution required for an acceptable dissertation, advisor competence to supervise a given dissertation, and appropriate methodology. The contribution concept defines the essence of a dissertation. Advisor competence is a quality assurance concept to ensure an advising process that provides quality in supervision and advice. The methodology concept relates to whether a methodology is appropriate for the problem and powerful enough to yield a contribution to knowledge.
Understanding underlying issues and concepts about advising are not sufficient for good advising. An advisor needs to apply good advising procedures. Good advising procedures will tend to result in good dissertations (assuming the student is receptive to good advising). Some important advising procedures are a student career plan that defines the role of the dissertation in his or her career, topic analyses to consider alternative dissertations, a formal dissertation proposal, a dissertation project plan, a formal or informal dissertation proposal defense, and progress documentation. The value of a student career plan in defining the role of the dissertation is emphasized in this paper; the other procedures are only summarized because
they are described in some detail in a short monograph on managing the doing of a doctoral dissertation, Gordon B. Davis and Clyde A. Parker, Writing the Doctoral Dissertation: A Systematic Approach, 2nd edition, Barrons Educational Series, 1997.
The Problem of Training Advisors
Terminology may vary in different countries but the underlying problems are the same. To avoid using multiple terms, I will use the following terms to apply to the dissertation advising function being performed and the objective:
A major problem with supervising doctoral students is the lack of advisor experience. An advisor will have done one dissertation under one advisor and may have observed some other advisors, but models of supervision are rarely written down. Advice is anecdotal and incomplete. As with many knowledge work processes, there is an implied assumption that completing a doctoral program and doctoral dissertation qualifies a professor to be a good advisor. In fact, some professors have good advising instincts and naturally do good advising. Others, however, must learn through a trial and error process.
The assumption of this paper is that professors can learn advising skills by following some systematic advising processes. This paper codifies some of my observations from being on well over a hundred doctoral dissertation committees and being the principal advisor for thirty or so doctoral dissertations. I summarize lessons I learned both by mistakes I have made or observed and by successes. Like all such codified experience, the lessons are a starting point for building good advising skills rather than being a perfect recipe.
Four Underlying Issues Important to Advising Doctoral Students
Not all doctoral programs are the same. Not all dissertations are based on the same assumptions. A dissertation advisor may impose certain values and standards without considering alternatives. It is useful in building advising skills to understand four issues that underlie differences in doctoral programs. These are doctoral program assumptions, motivations for a doctorate, different advising styles, and differences in student needs for advice and supervision.
Underlying Issue One: Doctoral Program Assumptions
Discussions of advising often are not productive because the doctoral program assumptions are not surfaced. At the risk of oversimplifying, it may be useful to define two alternative assumptions for the purpose and conduct of a doctoral program. I term these: mid-career doctoral program and entry-level doctoral program.
These two different assumptions explain many of the differences in doctoral programs. There is a world-wide trend to a entry-level doctoral programs, primarily because they fit the majority of students. However, there are students who fit best with a mid-career program. I have observed students who were entry level and entered mid-career programs; the results were in general somewhat unsatisfactory. On the other hand, I have advised some mid-career persons to not do an entry-level doctorate and to seek a mid-career program. Those who have followed this advice have found it worked very well.
The two assumptions do not hold perfectly in practice. I am familiar with a doctoral program that has all the external appearance of a mid-career program but many individual advisors essentially establish conditions that fit entry-level students.
A related issue is the length of time it takes to complete a doctorate. Ignoring preparatory activities, a typical dissertation takes the equivalent of 12 to 18 months of full-time work. The average time for United States and Canadian doctoral students in entry-level programs (including the dissertation) is between four and five years. In the United States, this time has been increasing steadily during the past 25 years. There are four reasons for this increase in time: first, the depth and quality of preparation have improved; second, students entering the job market are expected to have evidence of teaching ability; third, students entering the job market are expected to have demonstrated an ability to write and submit articles for publication; and fourth, dissertations must be completed before taking a position. The latter condition means effectively that students who are a few months behind schedule must wait many months before entering the job market.
Underlying Issue Two: Motivations for a Doctorate
The reasons for doing a doctorate are varied. They affect the design of doctoral programs in different fields and certainly influence the selection of topics, acceptable research methods, and advising processes. Even within doctoral programs in a given field or discipline, students may have different motivations. Without trying to look at all motivations, four examples illustrate this point:
The first motivation of a scholarly career is the dominant basis for many doctoral programs. For the MIS doctoral program at the University of Minnesota, we clearly make that our objective. An entry-level program is very consistent with this motivation. Other doctoral programs seem to support consulting as a basis for doctoral work. Certain programs in the university have professional qualification as the basis for a doctorate, and it is reflected in the design of the programs. I have observed doctoral programs in departments where program objectives and student motivations are varied. One department prepared students for either scholarly careers or professional careers requiring a doctorate as a credential. The mixed objectives meant that they did not do a good job of either.
Underlying Issue Three: Advising Styles
For the purposes of discussion, it may be useful to identify five advising styles. These are illustrative, but I have known advisors I would classify in each of the five styles. The five styles are ordered from strong, detail supervision to hands-off laissez faire advising. Each style has strengths and weaknesses.
The two extremes of strong master/apprentice style and passive hands-off style have significant risks but may work well under appropriate conditions. The middle three styles are less extreme. Advisors can develop styles that are not at the extremes, based on their preferences, the maturity of students they advise, the availability of funding, and so forth. Probably the extremes should be avoided, but one style does not fit all advisors and one style does not fit all students. For example, an advisor may use a collegial master/apprentice style with limited domains allowed with many students but change to a collegial development style with extended domain advising style for other students. For a very mature student who demonstrates good competence, an advisor who prefers a collegial master/apprentice style of detailed advising within restricted domains may be willing to change advising style to a guidance/suggestion style. In any situation, an advisor should identify his or her own strengths and weaknesses, identify both a preferred style but also alternative styles he or she can do, and evaluate his or her ability to advise different students.
One advantage from dissertation supervisor training or mentoring of new advisors is building more confidence in advisors, so that they can better adapt to the needs of the students and the conditions of the academic institution.
Underlying Issue Four: Different Student Needs for Advice and Supervision
There are significant differences in the maturity and confidence of doctoral students relative to the process of selecting a dissertation topic, selecting a research design and research method, and managing the process of research and write up. To illustrate the range of students needs for advice and supervision, three archetypes will be described.
Understanding how students differ in their needs may help a potential advisor to not accept supervisor assignments that he or she cannot do well. It may help an advisor to modify a preferred advising style to fit the needs of a student.
Preferred Advising Style and Adapting to Variations in Students
I have observed students who were frustrated with a master/apprentice advising style because they were not given enough freedom develop themselves; I have observed other students who had hands-off advisors who complained that they couldn’t ever get any advise or direction. In these cases, other students were very happy with the advisors. This suggests an advisor can do two things to be more effective: one is to develop a preferred advising style and communicate this to prospective advisees; the second is to adapt somewhat to the different needs of students.
Advising styles an advisor is able to employ effectively may change during the course of an academic, advising career. Experience with different styles and different student needs may assist an advisor in drawing clear boundaries to discuss with potential advisees. One very good advisor says that she has a clear, detailed session with any potential advisee in which she explains her philosophy and approach to advising. For example, she believes a major part of the advisor’s work is to help the student in formulating and writing a good dissertation proposal. She does not want to work with a student who wants to start dissertation work without a detailed proposal. A student who works with her understands the advising relationship and is expected to work within the guidelines provided.
The discussion of advising styles suggests that students need to understand preferred advising styles of potential advisors. Students can evaluate their maturity and level of skill. They can evaluate their need for close monitoring and supervision versus fairly loose monitoring. Such self examination can lead to a useful dialog with potential advisors. It can lead to clarity relative to expectations by both student and advisor.
Basic Concepts for Dissertation Advising
There are a number of concepts that are important in dissertation advising. Three that are especially significant are the concepts of contribution of a doctoral dissertation, advisor competence to supervise, and dissertation research methodology.
Contribution Required for a Doctoral Dissertation
One of the important roles of an advisor is to work with the student to define what is required for the dissertation to meet university requirements. There are significant variations within a university and among universities on what is required for an acceptable dissertation. However, there are some reasonable general guidelines. Individual departments or fields of study may make the general guidelines more specific.
It is simpler and more meaningful to discuss some general concepts that define contribution rather than making rules that measure contribution. Some general ideas are the following:
An advisor should also provide practical guidance to the student in evaluating dissertation topics. Although the research should be needed and interesting, theory-based, and make a contribution to knowledge, it should also meet some feasibility and career criteria. Some of these are fit of topic to available research methods, time required to do the proposed dissertation, match with student capabilities and interests, attractive for funding (if relevant), and consistent with student career objectives. An important criterion is the symmetry of potential outcomes, so that there will be an expected contribution from the research if the data or design results are as expected or are unexpected.
Advisor Competence for a Specific Dissertation Topic
An advisor should give good advice, give good direction, and be able to judge the quality of work being performed for a dissertation. That means that advisors are constrained in the problems and methods they can supervise well. It may be useful to distinguish between operational competence and review competence. A master type advisor needs operational competence, especially with immature students. Some advisors have a broad perspective and are very good at review competence; given a dissertation proposal and research plan, they can do a very good job of evaluating the project and making good suggestions. Note again the need for matching advisor competence (operational and/or review) with the maturity level of the student.
An advisor does not always have to be an expert when presented with a proposal where his or her competence is not strong. An advisor who is collegial and open to learning new skills may be willing to invest heavily in order to work with a doctoral student. In one case I observed, a faculty member chose to invest in a new area of research in order to be a good, collegial advisor. The result was very good for the student and allowed the faculty member to mentor a number of students in the same area of research. The question in such cases is the commitment of the faculty member to invest.
Advisor competence may be an important factor in student selection of a research area and a dissertation topic. Unless a student has good skills and confidence, the tendency is to gravitate to the advisor who can provide adequate mentoring and quality assurance. In one case, a student did dissertation research in an area outside of her long term interest because of the lack of advisor competence in her department for the area of her interest.
The traditional mid-career doctorate typically has one advisor. This places significant responsibility on the advisor to either not advise on problems where his or her competence is insufficient or to make a strong commitment to build competence. Because the traditional mid-career doctorate places the quality control on external examiners after the dissertation is completed, an advisor with insufficient competence may lead a student to do a complete dissertation that will not be accepted.
The committee model common with entry-level doctoral programs provides a basis for good advising without relying on a single advisor. There are still conditions for success. The committee must have a good mix of appropriate skills and be willing to provide good advice and mentoring. The advisor must invest enough to make sure the committee structure provides the requisite guidance and advice. Another advantage of the committee structure is the ability to have a collegial contract (not a legal contract) based on a dissertation proposal. Weaknesses can be spotted early and appropriate advice given. This will be described in the advising procedures.
Dissertation Research Methodology
There are a number of alternative research methodologies that may be applied. Jenkins (at the 1985 Manchester Conference by IFIP 8.2) defined thirteen methodologies (ranging from strongest to weakest in terms of hypothesis testing):
Math modeling
Experimental simulation
Laboratory experiment
Free simulation
Field experiment
Adaptive experiment
Field study
Group feedback analysis
Opinion research
Participative research (action research)
Case study
Archival research
Philosophical research
The thirteen methodologies focus on hypothesis testing. These fit both hypothesis testing and interpretive research. They do not include design science methodologies. In design science, the research builds an artifact (algorithm, computer program, analytical method, prototype, theory or set of concepts, etc.). The artifact is a contribution if it adds to knowledge. The issue with design science artifacts as contribution is how to evaluate them. In some fields, the artifacts may be evaluated in terms of simplicity and/or elegance of design; in other fields, the artifacts must be supported by evidence that they yield improved results, are deemed useful by those who apply them, etc.
Conceptually, the question of methodology is simple. The methodology should fit the problem, so that a contribution is achieved. But problems may be amenable to different research approaches and different methodologies. The concept of methodology choice can involve several criteria. These are the role of methodology in achieving a contribution, methodology choice relative to a long term research career, fit with student skills and interests, and fit with advisor skills and interests.
Useful Advising Procedures
The paper has focused on improving advisor understanding of the underlying issues and concepts for dissertation advising. Good conceptual understanding helps; good advising procedures are also required. This section will describe the use of a student career plan to provide focus and clarity for dissertation research. It also describes some useful resources that may help a student to become more independent and develop good research skills. The focus is on readily available resources on the web. Examples are from the field of information systems, but other fields have similar resources. Advising includes providing an environment in which the student learns from interaction with other scholars and other students. The last part of this section summarizes some useful procedures that are described in more detail elsewhere.
Use of Student Career Plan to Provide Clarity about
Research Interests and Role of Dissertation
Most students have an interest in a broad field. As they investigate research in the broad field, they may find many topics of interest. They have difficulty in narrowing their focus. A second problem is selection of a dissertation topic without considering the implications of the topic for a career. For students with a motivation that requires a dissertation but no further research, the failure to consider long-term implications is not a problem. For those who choose a research or scholarly career, failure to consider the dissertation as a part of a career plan may have serious consequences. My use of a career plan to provide clarity about research interests and the role of the dissertation in a scholarly, research career has emerged through experience in assisting students to make choices fairly early in their doctoral studies.
The basic reasoning that motivates this procedure is somewhat based on the typical tenure process in North American universities, but the reasoning can be generalized to a broad range of systems. The reasoning is:
Students have difficulty thinking about a ten-year plan, but as they do three iterations of the plan, they become more focused and the plan makes sense to them. The biggest objection is that they may change their mind, and the plan will not fit. No problem. They create a new plan.
In working with students, they often name their interests very broadly or very narrowly. I try to get them to think of narrow interests as instances of a topic area or research stream. As they do so, they see an area of interest emerging. If they name a very broad interest, I ask them to identify some broad streams of research within it. The end point of the discussion and the results needed for the ten-year plan are:
In an introductory seminar taught during the first year of doctoral studies, the students prepare a ten-year plan. They do this with three iterations. They get detailed feedback and advice on how to distinguish between instances of research and streams of research. The results have been excellent. The students use the plan to guide them in selecting supporting fields, selecting projects in seminars, and writing papers.
Use Existing Resources for Doctoral Dissertation Research
In preparatory seminars or personal advising, students should be encouraged to identify resources that will help them be productive. There are two types of resources: the one is more general advice; the other is specific and practical.
Some examples of general knowledge and advice are:
Some examples of specific, practical advice are:
Providing Candidates with Opportunities to Interact with Established Scholars and Other Students
In addition to providing both general and specific sources of knowledge and advice, a doctoral student should be provided with opportunities to listen to research presentations by established scholars and other students. They should have an opportunity to present their papers and get comments on content, methods, result, and presentation. A regular workshop or colloquium in which research papers are presented is invaluable.
A valuable opportunity for student development is provided by doctoral consortia. These may be organized by conferences, scholarly organizations, sets of universities, etc. The basic idea is to have students present their work at various stages of development and get feedback from both senior researchers and other students.
Summary of Some Other Useful Advising Procedures to Promote Completion and Quality
An advisor can promote completion and quality for a dissertation by employing some simple methods. Some examples are:
These are described and illustrated in Davis and Parker, Writing the Doctoral Dissertation, Barrons Educational Series, Second Edition, 1997.
An advisor may be invaluable in helping students to maintain momentum and to overcome discouragement and delays. Prompt return of drafts with helpful comments, regular meetings, providing deadlines, having student turn in intermediate products for review, etc. are all important.
An advisor can help a student maintain perspective. Spouse and family should not be sacrificed for the sake of a dissertation. An advisor may help a student to block out dedicated times for spouse or family and to maintain some balance in his or her life. (Probably setting a good example helps also.)
Summary
References