[The following is not exactly a reply to the posts following my
casual (and naive?) introduction of reflective practice. Rather,
it is my attempt at an elaboration that should have been in the
original post had I had the time and sense to write it then.

It is also quite long for an email. Over 1400 words. I tend to
see email as a lightweight medium, a mailing list as a verbal
discussion rather than a forum for written academic discourse.
But I am prepared to experiment with new work practices, even
though I fear that I contribute to the segmentation of the
phd-design list more than anything else.]

First, I would like to lay out a few personal beliefs that are
foundational to the rest of the text.

1. Design is to explore possible futures of the design situation
under consideration.

2. On a grand scale, scientific research is the efforts of a
certain community to produce knowledge pertaining to its field of
interest. If a member or would-be member of such a community
wishes to make a contribution, she needs to produce transferable
results.

[Remark 1. I realize that my choice of words in (1) is colored by
my own field of interaction design, where you always essentially
design a future use-of-IT (or non-use-of-IT!) situation rather
than an IT artifact. It might be that my characterization is
entirely unfamiliar to readers from more established fields of
design. In that case, please accept my apologies and read the
following, if you want to go on reading, merely as an anecdote
from a sibling discipline.

Remark 2. I am not too happy with the word 'transferable'. To me
as a non-native English speaker, it has a flavor of conduit,
transmission, information theory. In Swedish, I use the word
'vidareforbar' (courtesy of Goran Goldkuhl) which is more open to
the fact that any reception, assimilation is an active act of
interpretation and assessment. However, I will stick to
'transferable' for now because I don't know any better
alternative, and instead try to explain what it means to me.]

To explore possible futures of a design situation refers to the
parallel activities of creating expressions of possible futures
(including, but not limited to material artifacts) and reflecting
upon these expressions, assessing their qualities by analytical
as well as empirical means, clarifying the motives for key design
decisions. The two activities feed on each other: new ideas about
possible futures emerge from reflection, yielding new expressions
to assess, and so on.

It is conceivable that the results from such explorations can be
communicable. For instance, they can be communicable to other
designers concerned with similar situations.

I suggest the possibility of doing research by design along these
lines. This implies the possibility of a scientific community
where members make contributions that are well-grounded, possible
to criticize, possible to use as parts of the joint knowledge
construction going on in the community. As you might understand,
I think that interaction design can be or should be an example of
such a community.

So, what does all this have to do with Schoen and reflective
practice? There are two connections, I think. One is in the view
of design expressed in (1) above, where I use the word
'reflection' not in the sense of the famous reflection-in-action
concept but rather more like the cousin called
reflection-on-action. The insistence on action/reflection
parallelity also echoes the view of designing as a practice
rather than an analytical activity.

The other connection is in the belief that the main audience for
a piece of scientific research is other members of the scientific
community. I expect my fellow researchers to be designers, in the
sense that they work exploratively as suggested in (1).

And: an important idea discussed in Schoen and then further
elaborated by other design theoreticians is that design knowledge
relies heavily on a repertoire of formats. If my scientific
community aims at constructing design knowledge, a goal in
communicating my research becomes to support fellow researchers
in their development of repertoires.

Schoen is unfortunately not very clear on what a repertoire
consists of. His main ideas on how to develop design knowledge
(the reflective practicum, etc) seem strongly based on an
articulate master-apprentice relationship, quite craft-like but
more processually aware. This model is not easily adapted to a
scientific community. Other researchers have observed the use of
what seems to be repertoire elements in design, but there is no
definitive understanding that I am aware of.

We all know, of course, the importance of examples in design
education and discourse. I would propose that the granularity of
a repertoire (be it a personal one, or a collective one
continually constructed by a scientific community) is more
abstract than individual examples.

There has been a recent surge of interest in pattern languages to
encode and communicate slightly abstracted elements of design
knowledge, often motivated by arguments similar to the above. I
am not convinced that this is the way to go. Rather, I would
suggest a focus on the outcomes of reflection and assessment (as
part of research by design exploration). Qualities of a
particular expression of a possible future can be articulated and
communicated. Well-grounded communication of such qualities seems
to me to have great power in terms of extending the design
knowledge of the scientific community.

To mention a couple of interaction design examples, the work on
dynamic queries and starfield visualization by Christopher
Ahlberg and Ben Shneiderman at Maryland in the early 90s led them
to formulate the concept of 'tight coupling' which has a
significant impact on interactive visualization and arguably the
whole field of interaction design. Seely Brown and Duguid
discussed 'boundary resources' in human-technology relations
around 95 in a way that meant a lot to the emerging topic of calm
computing. [I don't have my library handy, please take the
bibliographic details with a grain of salt.]

What all this means, I think, is that a proper piece of
scientific research (in the community I think I belong to, or
would like to belong to) is argumentatively built from designs
and concepts. Or rather, representations of design acts in media
appropriate to the communication situation, plus words
introducing concepts stemming from 'reflection' on the design
acts.

Bluntly, research can consist of examples and a discussion of
them.

But not any examples and any discussion, of course. Apart from
the usual criteria of addressing relevant design situations and
making original contributions, there is a methodological
stringency part that I earlier refered to as transferability:

* The researcher must open herself to critique (following from
the community construction of knowledge view). Report data
interpretations and their grounds, report research process,
report interpretations of related work, report own bias, and so
on. All the standard requirements for qualitative empirical and
analytical research, which I find as elaborate as the
requirements for quantitative experimentation, if not as easy to
summarize.

* The progression of the work must tie the designs and concepts
together in the argumentative structure.

* The motivation for key design decisions must be constructed
(yes, I use this word intentionally) according the
criticizability criterion above. The design grounds for
conceptual development must be reported similarly.

Are there examples of this kind of research? To some extent.
There are many examples in, e.g., institutes of technology,
albeit most of them are not fully balanced. Most work in applied
computer science requires what is called implementations, which
refers to the practical work of expressing possible futures of
the design situation (to use my terminology). Such
implementations are routinely reported as part of papers and PhD
theses, sometimes even in replicable forms. I think it is fair to
say that they contribute to the collective repertoire of the
field. But the 'reflection' part, the development of concepts
with power beyond the individual examples, is less well developed
(with some counterexamples, of course).

I am not aware of any scientific community where the two strands
of 'action' and 'reflection' in the sense above are well-balanced
as a general rule. This may be an indication of possible gaps to
fill, or it could (quite likely) be a demonstration of my
ignorance. Can anyone educate me?

[I think this may be a good place to stop, for fear of moving too
far off on a tangent that is either uninteresting or plain common
sense to this readership. In my obsessed mind, there are many
topics that could be further addressed. Examples of scientific
communities working like this? Relations to the divide between
art practice and art criticism? Relative importance of
epistemologically different forms of 'reflection'/assessment?
Etc.

In either case, I find the notion of scientific research by the
reflective practice of design quite conceivable. Whether it is
adequate for attaining PhD degrees is a different question, that
finds its answer perhaps more in the politics of higher
education.]


Regards,
Jonas Lowgren