Hi Karel,

Thanks for the heads up on the Bologna process report.

I'm not surprised at the critique of PhD supervision.

There is extensive damning research (see below) on the quality of PhD
examination and examiners  understaning of 'what is a PhD'. PhD examination
is mainly done by supervisors so it reflects badly on supervisors
understanding of doctoral study. Parallel research on best practice in PhD
supervision indicates that many  supervisors are a long way from
best-practice. The research at Newcastle University here in Oz offers  a
good reference point  for studying best practice in PhDs and identifying
ways of improving PhDs.   

To some extent, failures of supervision is a fault of universities' academic
management. In particular, it is a problem where insufficient time is
allocated academics either for PhD supervision, op for other work such that
supervision is short-changed. 

A quick test. How many PhD supervisors on this list provide 1 hour face to
face supervision with all their PhD students each week?

Best wishes,
Terry
____________________

Dr. Terence Love, FRDS, AMIMechE, PMACM

Director Design-focused Research Group, Design Out Crime Research Group
Researcher, Digital Ecosystems and Business Intelligence Institute
Associate,  Planning and Transport Research Centre
Curtin University, PO Box U1987, Perth, Western Australia 6845
Mob: 0434 975 848, Fax +61(0)8 9305 7629, [log in to unmask] 
Visiting Professor, Member of Scientific Council 
UNIDCOM/ IADE, Lisbon, Portugal
Honorary Fellow, Institute of Entrepreneurship and Enterprise Development
Management School, Lancaster University, Lancaster, UK
____________________


<snip> 3 - The third quote makes the assumption that at the moment 'doctoral
programmes do not always provide high quality disciplinary research'. I
would like to see some evidence for this. The need to complement current PhD
studies with inter-disciplinary and inter-sectoral programmes could be seen
as a fierce critique on the competence of current supervisors, who don't see
the necessity of this addition at the moment. I'm baffled by this arrogance.

References on research into PhD education from
http://www.newcastle.edu.au/research-centre/sorti/publications/phd-2008.html



2009
Simmons, B., Holbrook, A., St.George, J., Lawry, M., & Graham, A. (2009).
Developing a researcher perspective during the course of a fine art research
degree: Issues relating to supervision. In P. Jeffrey (Ed.) AARE 2008
Conference Papers Collection [Proceedings]. Full Paper

2008
Bourke, S. (2008). PhD thesis quality: The views of examiners. South African
Journal of Higher Education, 21(8), 1039-1050.

Bourke, S., & Holbrook, A. (2008). PhD thesis quality: Predicting examiner
recommendation as one measure of thesis quality. In M. Kiley & G. Mullins
(Eds). (17-18 April, 2008). Quality in postgraduate research: Research
education in the new global environment - Conference Proceedings. Canberra:
CEDAM, ANU. Full Paper

Bourke, S., Holbrook, A., Craig, H., Lovat, T., Holmes, K., & Prieto, E.
(2008). Utilising linguistic analysis to explore text patterning in PhD
examination reports. Paper presented at the Australian Association for
Research in Education International Conference, 30 Nov-4 Dec 2008, Brisbane.

Bourke, S., Holbrook, A., Fairbairn, H., & Lovat, T. (2008). Consistency and
inconsistency in PhD thesis examination, Australian Journal of Education,
52(1), 35-47.

Cantwell, R., Scevak, J., Bourke., & Reid, A. (2008). Relationships between
doctoral students' metacognitive beliefs and their experiences during
candidature. Abstract in M. Kiley & G. Mullins (Eds). (17-18 April, 2008).
Quality in postgraduate research: Research education in the new global
environment - Conference Proceedings. Canberra: CEDAM, ANU. Abstract

Holbrook, A.(2008). The PhD examination in balance and imbalance. Abstract
in M. Kiley & G. Mullins (Eds). (17-18 April, 2008). Quality in postgraduate
research: Research education in the new global environment - Conference
Proceedings. Canberra: CEDAM, ANU. Abstract

Holbrook, A., Lu, Y., & Bourke, S. (2008). An exploration of differences
between the text of reports by PhD examiners and peer reviewers in Education
and the physical sciences. Paper presented at the Australian Association for
Research in Education International, 30 Nov. - 4 Dec. 2008, Brisbane

Lovat, T., Holbrook, A., & Bourke, S. (2008). Ways of knowing in doctoral
examination: How well is the doctoral regime? Educational Research Review,
3(1), 66-76.

2007
Bourke, S.,Holbrook, A., & Lovat, T. (2007a). Examiners and examination
outcomes. In C. Denholm & T. Evans (Eds.), Supervising Doctorates Downunder:
Keys to Effective Supervision in Australia and New Zealand (pp. 234 - 242).
Melbourne: ACER Press.

Bourke, S., Holbrook, A., & Lovat, T. (2007b). Quality indicators for PhD
theses in Engineering. Presentation at the 12th Biennial Conference for
Research on Learning and Instruction(EARLI): Developing Potentials for
Learning, Budapest, 28 August - 1 September. Full Presentation

Bourke, S., Holbrook, A., & Lovat, T. (2007c). Relationships of PhD
candidate, candidature and examination characteristics with thesis outcomes.
Paper presented as part of a symposium: Looking behind the Doctorate,
Proceedings of the 2006 Australian Association for Research in Education
Conference, Adelaide, 27 - 30 November. Full Paper

Holbrook, A.(2007). Dalliance or intimate relationship: Evidence of what
contributes to successful use of the literature in a doctorate. Keynote
address presented at the Postgraduate Supervision - State of the Art and the
Artists - Conference, Stellenbosch, South Africa, April 23 - 26.

Holbrook, A., (2007). Levels of success in the use of the literature in a
doctorate,South African Journal of Higher Education, 21 (8), 1020-1041.

Holbrook A., & Bourke, S. (2007). ARC DG Project 2008 -2010: Assessing the
quality of research theses using examiner reports. Paper presented at the
Deans and Directors of Graduate Studies (DDoGS) Meeting, Auckland, 5 - 6
November.

Holbrook, A., & Bourke, S. (2007). Doctoral examiner ego and assessment
etiquette. Presentation at the12th Biennial Conference for Research on
Learning and Instruction (EARLI): Developing Potentials for Learning,
Budapest, 28 August - 1 September.Full Presentation

Holbrook. A., Bourke, S., & Fairbairn, H. (2007). Do examiners differ across
major disciplines in inviting or requiring corrections to a PhD thesis?
Paper presented as part of a symposium "Looking behind the Doctorate":
Proceedings of the 2006 Australian Association for Research in Education
Conference, Adelaide, 27 - 30 November.

Holbrook, A., Bourke, S., Fairbairn, H., & Lovat, T. (2007). Examiner
comment on the literature review in PhD theses. Studies in Higher Education,
32(3), 337 - 356.

Holbrook. A., Bourke, S., Lovat, T., & Fairbairn, H. (2007). Sources of
disagreement in PhD thesis examination. Paper presented at the 2007 AERA
Annual Meeting" The World of Educational Quality", Chicago, 9 - 13 April.

Monfries, M., & Lovat, T. (2007). Gender, power and PhD examination in
Australia. Paper presented as part of a symposium "Looking behind the
Doctorate": Proceedings of the 2006 Australian Association for Research in
Education Conference, Adelaide, 27 - 30 November. Full paper

Scevak, J., Cantwell, C., Bourke, S., & Reid, A. (2007). A metacognitive
profile of doctoral students. Paper presented at the EARLI 12th Biennial
Conference for Research on Learning and Instruction: Developing Potentials
for Learning, Budapest, Hungary, 28 August 28 - 1 September. 
Bourke, S. (2006). A model for assessing the quality of PhD theses. Paper
presented at the 7th Quality in Postgraduate Research Conference: Knowledge
Creation in Testing Times, Adelaide, 20 - 21 April. Full Paper

Cantwell, R., Scevak, J., Bourke S., & Reid A. (2006). A comparison of
Australian and international PhD students' responses to measures of
individual differences. Paper presented at the 18th International
Cross-Cultural Psychology Congress, Spetses, Greece, 11 - 15 July.

Holbrook, A. (2006). New expectations: Information to consider in preparing
for, and examining, non-traditional research theses. Keynote Address at the
2006 Postgraduate Conference in the Creative Industries Faculty, Queensland
University of Technology, Brisbane, 24 - 26 October.

Holbrook, A., Bourke, S., Lovat, T., & Fairbairn, H. (2006). PhD Thesis
examination: Overview on an ARC Discovery Grant project 2003-06. HERDSA
News, 38(2), 17-19.

Holbrook, A., StGeorge, J., Graham, A., Lawry, M., & Ashburn, L. (2006).
Assessment Practice in Fine Art Higher Degrees. Media International
Australia, 118, February, 86 - 97.
Bourke, S. (2005). Some relationships between nature of PhD enrolment, time
of candidature and thesis quality. Paper presented at the 11th Biennial
Conference EARLI 2005, "Integrating multiple perspectives on effective
learning environments", Nicosia, Cyprus 23 - 27 August, 2005. Abstract

Bourke, S., Hattie, J., & Anderson, L. (2004) Predicting examiner
recommendations on PhD theses. International Journal of Educational
Research, 41(2), 178-194. Abstract

Bourke, S., Holbrook, A., & Lovat, T. (2005). Using examiner reports to
identify quality in PhD theses. Paper presented as the AARE Special Notice
Focus Conference: Quality in Educational Research, Cairns, 4-5th July 2005.
Abstract Full Paper

Bourke, S., Holbrook, A., Lovat, T., & Farley, P. (2005). Attrition,
Completion and completion times of PhD candidates. Paper presented at the
AARE Annual Conference, Melbourne, 28 Nov - 2 Dec, 2004. Full Paper

Dally, K., Holbrook, A., Graham, A., & Lawry, M. (2004). The processes and
parameters of Fine Art PhD examination. International Journal of Educational
Research, 41(2), 136-162. Abstract

Holbrook, A., Bourke, S., Lovat, T., & Dally, K. (2005). An investigation of
inconsistencies in PhD examination decisions. Proceedings of the Australian
Association for Research in Education Conference, 28 Nov - 2 Dec, 2004,
Melbourne. Full Paper

Holbrook, A., Bourke, S., Lovat, T., & Dally, K.(2004). Investigating PhD
thesis examination reports. International Journal of Educational Research,
41(2), 98-120. Abstract

Holbrook, A., Bourke, S., Lu, Y., Lovat, T., & Fairbairn, H. (2005). The
Assessment of the Literature Review in the PhD thesis. Paper presented at
the HERDSA Conference: Higher education in a changing world, Universityof
Sydney, 3-6th July, 2005.

Holbrook, A., Dally, K.., Graham, A., & Lawry, M. (2005). Examiner
reflections on the Fine Art higher degree examination process. Paper
presented at the AARE Annual Conference, Melbourne, 28 Nov - 2 Dec, 2004.
Full Paper

Holbrook, A., StGeorge, J., Graham, A., Lawry, M., & Ashburn, L. (2006).
Assessment Practice in Fine Art Higher Degrees. Media International
Australia, 118 (Creativity and Practice-led Research), Acceptedfor
publication 26 October 2005.

Holbrook, A., StGeorge, J., Graham, A., Lawry, M., & Ashburn, L. (2005).
Assessment practice in visual arts Higher degrees. Paper presented at the
11th Biennial Conference EARLI 2005, "Integrating multiple perspectives on
effective learning environments", Nicosia, Cyprus,23 - 27 August, 2005.
Abstract

Lovat, T., & Monfries, M. (2005). Power Discourse and Gender in Doctoral
Examination. Paper presented at the 11th Biennial Conference EARLI 2005,
"Integrating multiple perspectives on effective learning environments",
Nicosia,Cyprus,23 - 27 August, 2005.

Lovat, T., Monfries, M., & Morrison, K. (2004). Ways of knowing and power
discourse in doctoral examination. International Journal of Educational
Research, 41(2), 163-177. Abstract

Shaw, K., & Holbrook, A. (2006). An investigation of the nature and
contribution of Honours programs in Australia. Paper accepted for
presentation at the 7th Quality in Postgraduate Research Conference:
Knowledge Creation in Testing Times, Adelaide, South Australia,20 - 21
April, 2006
Bourke, S., Hattie, J., Anderson, L., Holbrook, A., & Lovat, T. (2004).
Predicting examiner recommendation on PhD theses. Paper presented at the
EARLI (SIG Higher Education) Conference, Motivation, Learning and Knowledge
Building in the 21st Century, Norway, 18-21 June, 2004. Abstract

Bourke, S., Holbrook, A., Lovat, T. & Dally, K. (2004). Characteristics,
degree completion times and thesis quality of Australian PhD candidate.
Paper presented at the Quality in Postgraduate Research Conference,
Adelaide, South Australia, 22-23 April, 2004. Abstract Full Paper

Bourke, S., Holbrook, A., Lovat, T., & Farley, P. (2004). Attrition,
completion and completion times of PhD candidates. Paper presented at
theAARE International Educational Research Conference, "Doing the Public
Good: Positioning Education Research", Melbourne, 28 Nov - 2 Dec, 2004.
Abstract

Cantwell, R. & Scevak, J. (2004). Supervisor conceptions of a doctorate and
their relationship to a developing assessment framework. Paper presented at
the Quality in Postgraduate Research Conference, Adelaide, South Australia,
22-23 April, 2004. Abstract

Cantwell, R., & Scevak, J. (2004a). Discrepancies between the "ideal" and
"passable" doctorate: Supervisor thinking on doctoral standards. Paper
presented at the AARE International Educational Research Conference, "Doing
the Public Good: Positioning Education Research", Melbourne, 28 Nov - 2 Dec,
2004. Abstract

Dally, K. & Holbrook, A, Lawry, M., & Graham, A. (2004). Assessing the
exhibition and the exegesis in visual arts higher degrees: Perspectives of
examiners. Working Papers in Art and Design, 3, 1-14. Full Paper

Dally, K., Holbrook, A., Graham, A. & Lawry, M. (2004). The Fine Art higher
degree examination process. Paper presented at the Quality in Postgraduate
Research International Conference, Adelaide, South Australia, 22-23 April,
2004. Abstract

Holbrook, A., & Bourke, S. (2004). An investigation of PhD examination
outcome in Australia using a mixed method approach. Australian Journal of
Educational & Developmental Psychology, Vol 4, 153-169. Full Paper

Holbrook, A., Bourke, S., Cantwell, R., Carmichael, K., & McBriarty, L.
(2004). Longitudinal tracking of research student progress to inform and
facilitate strategic action. Enabling the Research Environment: Delivering
Enhanced Outcomes and Impact. Program and Papers, Australasian Research
Management Society Inc. Annual Conference, Fremantle, WA, 15-17 September.
Promaco, pp.45-57.

Holbrook, A. Bourke, S., Lovat, T., & Dally, K. (2004a). Qualities and
characteristics in the written reports of doctoral thesis examiners.
Australian Journal of Educational & Developmental Psychology, Vol 4,
126-145.Full Paper

Holbrook, A., Bourke, S., Lovat, T, & Dally, K. (2004b). PhD theses at the
margin: Examiner comment of re-examined theses. Melbourne Studies in
Education, 45(1), 89-115. Abstract

Holbrook, A., Bourke, S., Lovat, T., & Dally, K. (2004c). An investigation
of inconsistencies in PhD examination decisions. Paper presented at the AARE
International Educational Research Conference, "Doing the Public Good:
Positioning Education Research", Melbourne, 28 Nov - 2 Dec, 2004. Abstract

Holbrook, K., Dally, K., Bourke, S., Lovat, T., Monfries, M, & Lu, Y.
(2004). Evaluating some fundamental features of doctoral assessment. Paper
presented at the Quality in Postgraduate Research International Conference,
Re-imaging Research Education, Adelaide, South Australia, 22-23 April, 2004.
Abstract

Holbrook, A., Dally, K., Graham, A., & Lawry, M. (2004a). Examiner
reflections on the Fine Art Higher Degree examination process. Paper
presented at the AARE International Educational Research Conference, "Doing
the Public Good: Positioning Education Research", Melbourne, 28 Nov - 2 Dec,
2004. Abstract

Holbrook, A., Dally, K., Graham, A. & Lawry, M. (2004b). The perspectives of
examiners on the processes of research higher degree supervision and
examination in Fine Art. Paper presented at the EARLI (SIG Higher Education)
Conference, Motivation, Learning and Knowledge Building in the 21st Century,
Norway, 18-21 June, 2004. Abstract

Lawry, M., Graham, A., Dally, K., & Holbrook, A. (2004). Assessing the
exhibition and the exegesis in Visual Arts higher degrees: Perspectives of
examiners. Paper presented at the Research into Practice Conference,
Hertfordshire, UK, 2 July, 2004. Abstract Full Paper

Lovat, T. (2004). 'Ways of Knowing' in doctoral examination: how examiners
position themselves in relation to the doctoral candidate. Australian
Journal of Educational & Developmental Psychology, Vol 4, 146-152. Full
Paper

Lu, Y. (2004). Editorial peer review in education: Mapping the field. Paper
presented at theAARE International Educational Research Conference, "Doing
the Public Good: Positioning Education Research", Melbourne, 28 Nov - 2 Dec,
2004. Abstract

Monfries, M., & Lovat, T. (2004). Power discourse in PhD examination
reports: A cross-disciplinary analysis. Paper presented at the AARE
International Educational Research Conference, "Doing the Public Good:
Positioning Education Research", Melbourne, 28 Nov - 2 Dec, 2004. Abstract

Scevak, J., Cantwell, R., & Absalom. D. (2004). A textual analysis of
doctoral abstracts: Do they indicate quality of doctoral thought? Paper
presented at the AARE International Educational Research Conference, "Doing
the Public Good: Positioning Education Research", Melbourne, 28 Nov - 2 Dec,
2004. Abstract
Holbrook, A., Dally, K., Cantwell, R., Scevak, J., Bourke, S., & Lovat, T.
(2003). Doctoral examiners as supervisors. Unrefereed papers accepted for
2003 HERDSA Conference Presentation and Proceedings, Christchurch, New
Zealand, 6-9 July, 2003. Full Paper

Bourke, S.(Organiser). (2003). Investigating doctoral assessment Symposium.
Symposium at EARLI 10th Biennial Conference, Padova, Italy - August 26 - 30,
2003.

Holbrook, A., & Dally, K. (2003). Emphases in 603 doctoral examination
reports. In M Lucia, A. Andreuzza, B. Arfe & L. Del Favero (eds.), Abstracts
of the 10th Biennial EARLI Conference: Improving learning, fostering the
will to learn, Padova, Italy, 26-30th August, 2003.

Bourke, S., Hattie, J., & Anderson, L. (2003). Doctoral examination: Some
relationships between content categories of written examiner reports and
overall assessments. In M Lucia, A. Andreuzza, B. Arfe, & L. Del Favero
(eds.), Abstracts of the 10th Biennial EARLI Conference: Improving learning,
fostering the will to learn, Padova, Italy, 26-30th August, 2003.

Lovat, T. (2003). "Ways of knowing" and styles of assessment and the
supervisory role in the doctorate. In M Lucia, A. Andreuzza, B. Arfe, & L.
Del Favero (eds.), Abstracts of the 10th Biennial EARLI Conference:
Improving learning, fostering the will to learn, Padova, Italy, 26-30th
August, 2003.

Holbrook, A., Bourke, S. & Dally, K.(2003). How examiners describe quality
in the doctoral thesis. In M Lucia, A. Andreuzza, B. Arfe, & L. Del Favero
(eds.), Abstracts of the 10th Biennial EARLI Conference: Improving learning,
fostering the will to learn, Padova, Italy, 26-30th August, 2003.

Cantwell, R. & Jeaneret, N. (2003). Performance Assessment In Doctoral
Study: A Framework. In P. Jeffery (ed.), AARE Mini-Conference 2003
Conference Papers, "Defining the Doctorate", Newcastle, Australia 2-4
October, 2003.

Chen, S., Absalom, D. & Holbrook, A. (2003). Cultural Conflict in PhD
Supervision. In P. Jeffery (ed.), AARE Mini-Conference 2003 Conference
Papers, "Defining the Doctorate", Newcastle, Australia 2-4 October, 2003.
Full Paper

Dally, K., Holbrook, A., Bourke, S., Graham, A., & Lawry, M. (2003). Higher
degree examination in the Fine Art. In P. Jeffery (ed.) AARE Mini-conference
2003 Conference Papers, "Defining the Doctorate", Newcastle, Australia, 2-4
October, 2003. Full Paper

Lovat, T., Holbrook, A., Bourke, S., Dally, K., & Morrison, K. (2003). Ways
of knowing in assessing the PhD and ramifications for the role of the
supervisor. In P. Jeffery (ed.), AARE 2003 Conference Papers, International
Education Research Conference AARE-NZARE, Auckland, 30th 30 Nov - 3 Dec Dec,
2003. Full Paper
Anderson, L. (2002). The underlying structure of examiners' reports. Paper
presented at a Symposium, "Examining the Quality of Doctoral Research" at
the AERA Conference, New Orleans 1 - 5 April 2002.

Bourke, S. (2002). Links between PhD candidate background, aspects of
candidature, examiner Information and the examiner reports. Paper presented
at a Symposium, "Examining the Quality of Doctoral Research" at the AERA
Conference, New Orleans 1 - 5 April, 2002.

Holbrook A., Bourke, S. & Lovat, T. (2002). Anticipating the examiner
reports on a PhD thesis. Paper presented at the Quality in Postgraduate
Research Conference, Glenelg, South Australia, 2002.

Holbrook, A. & Bourke. S. (2002). PhD assessment: Design of the study,
qualities of examiner reports and candidature information. Paper presented
at a Symposium, "Examining the Quality of Doctoral Research" at the AERA
Conference, New Orleans 1 - 5 April 2002.

Holbrook, A. (2002). How examiners of doctoral theses utilise the written
report. Paper presented at a Symposium, "Examining the Quality of Doctoral
Research" at the AERA Conference, New Orleans 1 - 5 April 2002.

Lovat, T. (2002). 'Ways of knowing': How examiners position themselves in
relation to the doctoral theses. Paper presented at a Symposium, "Examining
the Quality of Doctoral Research" at the AERA Conference, New Orleans 1 - 5
April 2002.

Lovat, T., Holbrook, A., Bourke, S., Dally, S & Hazel, G. (2002). Examiner
comment on theses that have been revised and resubmitted. In P. Jeffery
(ed.), AAREConference 2003 Conference Papers, 1-5 December, Brisbane, 2002.
Bourke, S., Scevak, J., & Cantwell, R. (2001). PhD examination and examiner
characteristics. In P. Jeffery (ed.), AARE Conference 2001 Conference
Papers, Fremantle, 2-6 Dec., 2001.

Holbrook, A. (2001). PhD examination - Assessment's least mapped frontier.
Paper presented as part of a symposium, "Frontiers in research training:
Evaluating PhD examination and supervision", at the AAREConference,
Fremantle, 2-6 Dec., 2001.

Holbrook, A., Bourke, S., Farley, P. & Carmichael, K. (2001). Analysing PhD
examination reports and the links between PhD candidate history and
examination outcomes: A methodology. Research and Development in Higher
Education, 24, 51-61.

Holbrook, A., Bourke, S., Lovat, T. & Monfries, M. (2001) Examination of PhD
theses. Paper presented at the Biennial Conference of the European
Association for Research into Learning and Instruction (EARLI), Fribourg,
Switzerland, August 2001.

Holbrook, A., Lovat, T., & Monfries, M. (2001a). Examiners as teachers: the
instructional content of PhD reports. Paper presented at the British
Educational Research Association (BERA), Leeds, UK, 2001.

Lovat, T., Holbrook, A., & Hazel, G. (2001). What qualities are rare in
examiners reports? Paper presented as part of a symposium, "Frontiers in
research training: Evaluating PhD examination and supervision", at the
AAREConference, Fremantle, 2-6 Dec., 2001.