developing students' skills in reflective practice - CiteSeerX

0 downloads 0 Views 93KB Size Report
Cunliffe (2004) believes that the practice of reflective thinking is partic- ... evaluation to further our pedagogical understanding of how journal design.
DEVELOPING STUDENTS’ SKILLS IN REFLECTIVE PRACTICE: DESIGN AND ASSESSMENT

Kathryn Pavlovich Eva Collins Glyndwr Jones University of Waikato This article examines learning journals as a method for developing selfawareness within a business education context, exploring “how can effective design and assessment of reflective journals assist the development of students’ self-knowledge?” The authors describe three different approaches to learning journals, with each case study outlining the purpose of the course and the learning journal within it, the design and assessment of the journal, and an evaluation of this experience. The authors’ aim is to illustrate how journals can be implemented in management education. Although each case study is distinct, three interconnecting themes also emerge that underlie why this approach to learning is important: finding the subjective voice that enables students to access their inner learning; accepting that learning is mutually constructed within a cocreative space rather than something “done to the student”; and that a more reflective self-awareness engages a higher sense of personal purpose. These significant outcomes illustrate the success of this learning approach. Keywords: assessment, design, learning journals, management, reflection

Education is longing for a deeper more connected, more inclusive, and more aware way of knowing. One that connects heart and hand and head and does not split knowledge into dualities of thought and being, mind, and body, emotion and intellect, but resonates with a wholeness and fullness that engages every part of one’s being. —Kind, Irwin, Grauer, and de Cosson (2005, p. 33) JOURNAL OF MANAGEMENT EDUCATION, Vol. XX No. X, Month XXXX xx-xx DOI: 10.1177/1052562907307640 © 2007 Organizational Behavior Teaching Society

1

Copyright 2007 by The Organizational Behavior Teaching Society.

2

JOURNAL OF MANAGEMENT EDUCATION / Month XXXX

Conventionally, teaching has focused on what Palmer (1998) describes as questions of “what” (the nature and boundaries of the problem), “how” (the methods and techniques for finding solutions), and occasionally “why” (the underlying purpose of the nature of the topic of investigation). Rarely is there an engagement with the “who,” with our own self-awareness, and the relationships we have with others. Questions concerning the experiences we have, how we reflect on them, and the changes we implement in our lives can offer a key to a deeper sense of learning and experience. In examining the “who,” the focus turns to a practice of inner reflection on our individual actions to make sense of and to learn from them. Cunliffe (2004) believes that the practice of reflective thinking is particularly important in management education, as through challenging our own assumptions, “we can develop more collaborative, responsible and ethical ways of managing organisations” (p. 408). Thus, she continues, a critically reflexive stance is “not thinking about thinking, but thinking about self from a subjective process” (p. 418). This changes the emphasis from the passive neutral voice so evident in the densely referenced text of academic writing to a more intuitive inner dialogue that Schön (1983) describes as reflection-in-action. Thus, “who” we are changes what we write about and how we write, and our role as educators is to assist students to engage in insights and perceptions that take them to a new level of self-awareness and appreciation (Brearley, 2000). Journaling is one method that requires students to explore their personal engagement with academic subject content and their individual learning processes. The writing of thoughts over the duration of an academic course becomes a journey of exploring one’s learning. We agree with Hall, Ramsay, and Raven (2004) that a well-designed educative process can assist students to engage at a deeper level of awareness than conventional methods. Learning journals, then, are a way of organizing students to become better connected with their academic subject and, more important, with their own self-awareness. In this article, we examine “how can effective design and assessment of reflective journals assist the development of students’ self-knowledge?” This position brings the “who” back into the education process. To explore this question, we present three case studies of learning journals from different courses within one university. With our School’s focus on sustainable business, we have opportunities to encourage our students to think more holistically than conventional neo-liberal institutions. Thus, our broader vision is to educate future managers to understand the importance of integrating economic, social, environmental, and spiritual imperatives into their workplaces. Our aim in this article is to describe each of our three journal approaches through a format of purpose, design, assessment, and evaluation to further our pedagogical understanding of how journal design and assessment may be better employed to encourage student self-awareness. Case 1 is an undergraduate course that uses learning journals as a method

Pavlovich et al. / REFLECTIVE PRACTICE

3

for developing and deepening students’ reflective thinking abilities. Case 2 is an undergraduate course that uses electronic journals and thus provides a contemporary modern media approach to journaling, and Case 3 is a graduate course that uses journals to explore the students’ learning experience. In the next section we review the literature on issues related to the design and assessment of learning journals, followed by a description of the research method and our classroom contexts. The case studies will then outline the design, assessment, and evaluation of the individual learning journal approaches. Finally we propose insights for wider application.

Reflection and Learning in Management Education DESIGN

A central strength of learning journals is that they allow students to tap into intelligences other than just the cognitive (Gardner, 1999). In seeking to bring self-awareness into our education system, these journals encourage students to express their thoughts, feelings, and experiences toward the classroom content and processes. As the quote at the beginning of this article claims, bringing feeling into the education process allows head and heart to be connected and thus reduces the separation that currently occurs through the externalization of knowledge as something that happens outside of oneself. In bringing the emotional experience into the journal process, students are able to examine not just how they think but also how they feel (Brearley, 2002). Brearley continues that these emotional connections enable us to explore our “shadows of experience” as we more deeply make sense of the past. Indeed, the act of writing such things down requires a connection through feeling, requiring honesty about how one feels through authenticity (being true to oneself) and spontaneity (as it feels at that moment). Thus, the use of the personal voice requires teaching to be student-centered on the “who.” Journaling requires a different form of expression than is conventionally found in dense academic text based on analysis of content. It is a private process. It is about “me” (Locke & Brazelton, 1997). Although discussion of learning journals is common in the literature (Cunliffe, 2004; English, Luckett, & Mladenovic, 2004; Haigh, 2001), studies that adequately outline such design processes are rare. Those that do note two central features: clear structure and guidelines, and a student-centered approach. For instance, Varner and Peck (2003) note that learning journals encourage students to be self-directed and determine their own focus in assignment. The assignment, then, focuses on the students’ awareness of how they interact with the content rather than solely on what the content is. They also posit that following the journal process, students are better able to anchor their new learning in experience and have the opportunity to solve actual problems.

4

JOURNAL OF MANAGEMENT EDUCATION / Month XXXX

Palmer (1998) note that the space created plays a critical role in the design process so that students are able to be private. He argues that openness must be developed between teacher and student. Particular challenges face teachers using this method as students are more familiar with writing what they think the teacher wants. Moving the dialogue to the student requires a space without judgment or prejudice. It is one of compassion and empathy for the experiences that others have been engaged in. Hooks (1994) claims this requires an “engaged pedagogy” that involves a reciprocal exchange between teacher and student that goes further than just empowering students. Rather it seeks to employ a holistic model of learning where teachers and students grow and are empowered by the process. The challenge, then, is to develop a format that creates clear guidelines for students regarding what is expected with this form of writing, while still placing the students’ awareness at the center of the process. ASSESSMENT

The biggest issue encountered with reflective journals is their assessment. Varner and Peck (2003) note that students invest much of their personality and self-image into the journal, and this makes them sensitive pieces of assessment to mark. Crème (2005) too claims that in writing these journals, we ask our students to open themselves up to us by using their individual voice, expressing a sense of honesty, and taking a risk in the content they write. This makes grading and evaluation difficult, as their subjective nature defies the standardized criteria of more objective forms of assessment. Furthermore, when journals are graded, the grade becomes the emphasis that constrains free expression and creativity. On the other hand, grading encourages classroom preparation and participation, with other studies concluding that when journals are not counted toward a grade, students do not put in the work (Kennison & Misselwitz, 2002). As Crème (2005) notes, what we assess is pedagogically important as it powerfully influences student learning and also sends signals as to what we, as teachers, believe is important. Moon (1999) concludes that detailed assessment criteria can play a central part in the success of the journal writing, as they provide the structure and foundation for what is expected. Clarity of objectives assists students to move beyond descriptive accounts of their experiences. In a study on learning journals, Crème (2005) identifies the following guidelines for assessing journals. A good record of study she claims is a) comprehensive as it meets requirements of an introduction, conclusion and demonstrates syllabus coverage; b) shows understanding of the material, with the ability to select, summarize, analyze and show relationships between concepts, both within the course and outside of it; c) shows self-awareness of

Pavlovich et al. / REFLECTIVE PRACTICE

5

the writer as learner, both in relation to the ideas on the course, and to course activities, processes and colleagues; and d) demonstrates that the writer is prepared to take risks with the material in relation to their own political and intellectual position. (p. 290)

Embedded in these guidelines is a mix of cognitive skills in knowing what content should be selected as important, while also writing in a manner that emotionally and holistically connects the student with the context. Dilemmas regarding issues surrounding the subjectivity of the assessment process not withstanding, we share Dewey’s (1933) view that reflective habits must be taught if we wish to foster critical thinking. We believe that learning journals sharpen our ability to reflect. Most important, we agree that reflection as a skill can be developed and follow the Habermas tradition in seeing it as a tool for personal empowerment and emancipation (Moon, 1999). Our aim in this article is to examine how the design and assessment of learning journals may be better employed to encourage student self-awareness.

Method We have chosen a case study method for this research, as the case study allows rich description of the journaling assessment process that we have each developed (Yin, 2003). This descriptive approach is significant in that one of our primary aims is to explain, describe, and illustrate the different formats that we have developed. As noted earlier, one of the weaknesses in the literature is an absence of how journaling assessment has been developed in order that more extensive upgrading of different approaches can be applied and improved. Furthermore, we have chosen what Stake (1995) posits as the collective case approach, whereby a number of cases are examined to illustrate the predictability of certain phenomena. This again allows us to proffer differing approaches that may be redesigned for certain contexts. Our research question of the use of journals to develop self-knowledge in our students places the “who” at the center of our inquiry. Yet to achieve this, we need to develop structures around the “what” and the “how” to engage our students in their academic content (Palmer, 1998). The description of our differing assessments outlines each case study in the following way: (a) the purpose of the journals, (b) the design of each journal, (c) the assessment criteria, and (d) evaluation of the process. Thus, the “what” and “how” questions noted by Palmer (1998) structure a framework around which students can more deeply examine their own self-awareness and deeper learning processes. The second aim of the current research is to identify themes that emerge from the case studies that can be actively used to assist deep learning. Generating conceptual themes conforms to Miles and Huberman’s (1994) method of textual analysis, whereby issues of importance inductively emerge

6

JOURNAL OF MANAGEMENT EDUCATION / Month XXXX

from the data. It is important to note that we also follow Weick’s (2006) form of “abduction,” whereby one begins with fragments of understanding and then builds more holistic pictures of an observable reality. This form of “invention” includes an act of “faith,” as abduction forms the “rules that are postulated to explain the observed facts . . . they are the groundwork before coding can begin” (Harrowitz, cited in Weick, 2006, p. 1731). Underlying our method of research is Palmer’s (1998) what, how, why, and who approach. The “what” question is addressed through the academic subject area. This is the framework in which the learning takes place. The “how” question denotes the processes around which learning occurs in the journaling process. The “why” emerges through the themes from the case study analysis. Finally it is through the synthesis of the above approaches through abduction that the “who” can then be examined and developed through the inner dialogue reflective process. Furthermore, it relates to Yin’s (2003) fourth proposition of case studies, in that their purpose is to explore the relationships being evaluated. This thematic analysis identifies the processes that are being used to achieve intervention of deep learning (self-awareness).

Learning Journal Case Studies CASE 1: MANAGING WITH SPIRIT

This course is offered in the fourth and final year of the undergraduate management degree, and its central purpose is to explore the key questions of Who am I? Why am I here? What is my purpose? In developing students’ awareness, content issues are examined such as the interconnection of all life forms (deep ecology), accessing personal and organizational spiritual virtues, and understanding how a creation paradigm constructs human flourishing through meaningful work rather than following a consumption and exploitation paradigm. Purpose of the journal. The reflective journal in this course was designed to develop students’ reflective abilities and move their decision-making processes from solely intellectual and emotional responses, to more spiritually- and mindfully-aware actions. Thus, the reflective journal was developed to specifically guide students to analyze their responses to situations, and then unthread how and why they made those decisions. The intended outcome is that students become consciously aware of their actions in every moment. Design of the journal. In Managing with Spirit, all students were required to write three separate journals of three to four pages in length through the 12 teaching weeks (worth 20% of the final grade). Each entry was expected to cover the readings, the classroom discussions, and personal experiences.

Pavlovich et al. / REFLECTIVE PRACTICE

7

A modified framework from Williams and Wessel (2004, p. 19) was used as a structure for the journal entry. Over iterations of the course, the need to be very specific on what the requirements were for this assignment emerged, confirming studies identified in the literature (Crème, 2005; Moon, 1999). The following format developed over the years clearly sets the expectations on what is required: • Describe the learning event, issue or situation. What happened? • How did you feel? c What was your reaction and why did this happen? (Cognitive and emotional) c Identify specific emotions: this is very important to be able to really understand the triggers for change. • Analyze the learning event, issue, or situation in relation to prior knowledge, feelings, or attitudes. What were the consequences of that feeling? • Discuss three to four points from the literature that help you understand what happened. c This section ensures that students are covering the reading material and plays an important role in assessment. • What have you learnt? c Have you gained a new understanding of the learning event, issue, or situation? What is that value of the learning event, issue, or situation that has occurred? What is your new understanding of the learning event, issue, or situation? c Indicate how the learning event, issue, or situation affects future behavior. This includes the clarification of an issue, the development of a skill, or the resolution of a problem. How will you approach the same or similar event, issue, or situation in the future? What have you learnt about yourself through this process?

Assessing the journal. As noted above, a very specific structure has been developed to guide and assess students in their maturing of reflective practice. The marking criteria closely followed the structure of the journal (see Table 1) and was placed in the course outline at the beginning of the course. Describing the event gave the students a C grade. Including some analysis and making meaning of it moved the grade to a B—this included a good analysis of the course readings. Demonstrating how this understanding would create new behavior in the future was necessary for an A grade. Being able to demonstrate that learning and new action took place was the essence of this assessment. Yet new learning and action also emerged for us as teachers, conforming to what Ramsey (2002) and Williams and Wessel (2004) recalled as benefits for teachers. Through the development of this article, we developed an “engaged pedagogy” to enhance and refine this marking criteria. Subsequently, this framework is now being utilized by each of the three case study authors and authenticates its applicability in other contexts.

8

JOURNAL OF MANAGEMENT EDUCATION / Month XXXX

TABLE 1

Marking Criteria for Learning Journals: Case Three Grade

Description

Analysis

Meanings

Action

C C+/B B+/AA/A+

* * * *

* * *

* *

*

Comments:

Evaluation of the journal. In its first year (2004), there were 12 students enrolled, growing to 46 in its second year, 28 in 2006, and 30 in 2007. These journals play a significant role in helping students develop reflective learning. The following journal narrative from a Chinese student illustrates the significant struggles she went through to understand the process, and it highlights the numerous issues that we as teachers encounter in grappling with our own teaching pedagogy: Reflective journals were strange to me and none of my three journals has a good mark. When I first did the journal, I just thought this was an assessment to ensure the students would do the readings, and then write a summary about it. So I did the journals in my own way. However, one day I was really shocked by a classmate’s journal! Having the girl’s permission, the teacher read out her reflective journal to the class. I suddenly noticed the difference between hers and mine. She did the journal by her heart, she did not see the journal as an assessment, and the journal was from her deep voice. She related the reflective journal together with her feeling, her life experience and her spirit together. I suddenly noticed I am too little and small. I understand that study is not only gaining skills and knowledge; the purpose of study is to learn from one’s own heart and to improve one’s shortcomings. Therefore, I decided to change myself, change my attitude to the study. I decided to try my best to learn how to use spirituality to change my life. Now, I know that reflective journals is a useful tool which help people to go back to their own heart and to see what is their deep voice and feeling. I try to link the study with my daily life. I observe and feel everything happens to me and people around. Every night, when I lay on bed, I can hear my inner voice and I can sum up important things to my brain. As long as I study this course, I can feel my heart and my spirit is light.

This quote shows the struggles students have in writing about what they really feel, rather than the neutral passive voice so prevalent in academic writing. This requires the students to connect with their hearts first (the feeling), and their heads second (the thinking). Those who continued to write descriptively on class topics did not connect at that deeper level. The second challenge was getting students to focus on one situation to analyze—with a page limit, focus was important and only one experience was possible for reflective depth. However, over the three iterations of the course, these journals have improved

Pavlovich et al. / REFLECTIVE PRACTICE

9

dramatically, and most students were reasonably adept at the process of reflection by the end of the course. Student evaluations confirm this journal activity as being important in their development of mindfulness. CASE 2: HUMAN RESOURCE MANAGEMENT THEORY AND PRACTICE

The second case study is a human resource management course in the fourth and final year of the management degree. The purpose of the course is to provide students with the opportunity to apply theoretical knowledge acquired during their studies to a real-life organization setting. The course is based around a client-based project (CBP) and adopts a “blended” approach to learning, relying on the use of e-communication for distance interactions, limited face-to-face class-based interaction, and the development of selfmanaging teams. In 2006, the client-based project involved examining the skill shortage in the engineering industry, and students interviewed 50 managers in engineering enterprises. Deliverable outcomes included a management report and an oral presentation to the client’s Board. Central to the courselearning objectives is the requirement for each student to maintain a personal journal in which he or she is asked to reflect on the processes they are involved in and to think about their own personal learning. Purpose of the journal. The purpose of the reflective journal is • to “capture” critical events and experiences both inside and outside the classroom. • to reflect on the learning process at the personal level. • to act as a channel for exploration between the student and the class facilitator.

Design of the journal. Students are required to write a reflective paper as part of the course assessment, worth 20% of their final grade and due at the end of the course. First, they need to become familiar with the process of journal keeping and reflective learning through reading specific articles: Daudelin (1996), Hays (2004), and Loo and Thorpe (2002). The reflective paper was based on accumulated weekly electronic journal entries, and students were expected to make at least three journal entries each week. The e-journal can only be accessed by the individual student, and material can only be added. Thus, journal entries submitted before the current data cannot be edited or removed. The class facilitator has electronic access to each student’s journal, providing the opportunity to review and comment. This requires that the class facilitator provide timely feedback and encouragement. Approximately 80% of the communication between facilitator and students is through the e-communication channel. The majority of students had little experience in keeping a journal, and no one had written a reflective paper. At the start of the course, the purpose

10

JOURNAL OF MANAGEMENT EDUCATION / Month XXXX

of the journal entries and reflective paper were discussed, and students were encouraged to reflect on • important project-related experience that had taken place inside or outside the classroom that week • their own influence on the management of the project group • their perceptions of the effectiveness of their group and other groups • their feelings about how the group dealt with process issues such as interpersonal conflict • how they might have tackled process issues differently.

Assessing the journal. Each student received feedback and comments via the facilitator’s electronic link with the journal writer. Typically this would include an e-reply questioning, commenting, and encouraging the student’s efforts. The facilitator’s comments and queries would be taken up and discussed in subsequent journal entries. In some cases, the facilitator would stress the importance of keeping up with regular journals entries as the basis for the reflective paper. To give the student an indication of the quality of his or her journal entries, a grading (A – D) would accompany qualitative replies. Table 1 illustrates the marking schedule now applied. Evaluation of the journal. The e-journal has several advantages over traditional “hard-copy” journals: convenience, ease of use, immediacy, and visual impact. The e-journals became an easy and accepted means of “capturing” experiences and reflecting on them. Most students soon became comfortable communicating daily with each other and the facilitator on team-project matters through the e-channel. The journal from the same channel was easily accessed from home or campus. The second advantage, immediacy and visual impact, enabled the facilitator to view progress through each student’s journal “as it happened.” Each student’s experiences delivered through the journal could literally be “viewed” on screen simply by scrolling through the journal entries. An interesting example is the case of Polly (not her real name), an international student. At the start of the course, Polly struggled with the concept of reflecting through a journal with her entries simply described content issues. This example describes a creative planning tool, mind manager, which was demonstrated in class: Thursday 2 March: “Mind manager—— a tool for brainstorming and planning Advantages of using mind manager more visual (compared to list) helpful to organize ideas, thoughts, project clear to express what one wants to say (can show relationship between two) easy for others to see.”

Pavlovich et al. / REFLECTIVE PRACTICE

11

Feedback from the facilitator saw the student begin to expand her ideas, to a more free-flowing, creative, thoughtful reflection of her experiences and the processes. Thursday 9 March: Until today, I know a bit about what I was expected to write for a learning journal. One reason was that last night, I devoted myself to reading the three articles on reflective paper. Maybe I had not catch the whole idea, but I realized that my journals last week were on the wrong track. What I wrote last week, was just a summary of what the reading, material told, not my opinions, feelings and thoughts. Nevertheless, better later than never.

Scrolling through Polly’s e-journal showed her entries becoming longer, more creative, and more thoughtful. Her written English improved. She also began to take risks in reflecting on events in a way that she did not at the start of the course: Wednesday, 15 March 2006 Today’s meeting we divided us into two groups and one group were doing the proposal and the other group were working on the questionnaires. We found that it was much efficient than we do all the work as a group. Last time I worked on the proposal, so this time I was in the questionnaires group. As such, I knew each part of the whole project. I prepared the questionnaires last night, so I had some additional questions in mind already. During the meeting, I brought my questions forward, so we could discuss wether they are good questions which could be used to probe depth. I was happy that most my questions I gave were accepted by the group members and we agreed that we put those additional questions below the existing questions. I found that sharing opinions with each other was wonderful. I knew what I did was good and which part was not good, so that I could make improvement. Sunday, 26 March 2006 The interview time is getting close, and I feel a bit nervous and a bit excited. To be honest, I do not like interview. I am not sure whether it is because I am bad at interviewing or just I do not like. After think for a while about this problem, I still have no answer. If it is because I am bad at interviewing, can I improve it? Is it a skill that can be learned when somebody practices again and again? Or it is a bit like a gift that no matter how many times one practices, one just can not obtain the skill. I believe both can happen. But, what I can do is practicing to improve, even if I know that I am unable to perform the best, I can do my best. It is good to have improvement rather than to be at the origin, even if the origin is quite excellent yet. I think loss sometimes is good as I can know where I can improve myself. Also, about the contribution to work, discussion, I have different opinions. The meeting’s agenda were set by us three. So we can bring to class to discuss. Sometimes, many people talk at the same time is difficult for communication. I do not think that contribution to discussion equal to one have

12

JOURNAL OF MANAGEMENT EDUCATION / Month XXXX

to say a lot. For me, sometimes, I like to listening to other’s different opinions. I know that you may say that it is not an excuse to escape from participating. I like discussion, but we already had small discussion before the class meeting and my ideas are already spoken by the spokenperson. I am confused that if I do not come up with new ideas, I have no say. Will others say me have no contribution? Anyway, I think one habit I have to change is that what I said in the small group, I can also discuss it in the class meeting. Before, I did not do this as I think may be it is repetitive. The difference between Kiwis and me is that I am afraid that my opinion might be wrong and kiwis like showing their opinions. This is what I want to learn from them, so that I can participate in more discussion and have really fun. CASE 3: STRATEGIES FOR SUSTAINABILITY

This graduate-level course aims to enhance students’ understanding of sustainability issues confronting today’s managers. Course topics include: What is sustainability and why should business care? What are the criticisms of sustainable business? What corporate sustainability strategies are leading edge companies implementing? Purpose of the journal. The purpose of the journal is to give students space to reflect on themselves as learners. Through reflecting on themselves as learners, the students indirectly reflect on the course content. By taking the direct focus off the course content, students were less likely to superficially summarize the class that week but instead focus on the personal impact of the course content. Although this was a graduate-level class and many of the students had spent years in a classroom, for the most part they had not had an opportunity to reflect on what inspires or bores them, or what type of assessment they prefer, or why they respond the way they do to different learning environments. One excerpt from a learning journal highlights this point: I have gained a lot of insight into what affects my learning capabilities, such as my own self-concept and the dynamics of small and large group discussion. I am also more aware of the delivery styles that help me to learn and internalize concepts and theories. There were a range of presenters from our class and each delivered in a different way. The confidence of the presenter and his/her grasp of the topic were important to me.

Design of the journal. In this course, students were given options for their assessment and a learning journal was one of the options worth 10% of their overall course mark. Students were asked to show the instructor weekly entries of their journal. These entries were not read by the instructor but were merely a confirmation that the student had written that week. Although there was no grade penalty for a missed entry, having weekly checks helped to keep students writing (and reflecting) regularly rather than completing the task in one session right before the deadline.

Pavlovich et al. / REFLECTIVE PRACTICE

13

For many students this was an unfamiliar type of assessment, and there was some discomfort with what was expected of them. If students wanted some structure to help with the first few weeks’ entries, they were asked to give responses to a series of questions based on Brookfield (1995). For example: What have I learned this week about myself as a learner? What were the highest and lowest emotional moments in my learning activities this week? What learning task did I respond to most easily this week? Students were asked to take their weekly entries, draw out key themes, and hand in a monthly report of two to three typed pages. The third and last monthly report was longer as it included students’ reflections over the entire course. The monthly reports served the dual purpose of giving students guidance and direction for an unfamiliar assessment and provided the instructor critical ongoing feedback about the impact of the course. Assessing the journal. The assessment was formative as students were given written feedback on the monthly reports; however, marks were not given until the last report for the cumulative work. The learning journals are assessed on the incorporation of feedback, depth of reflection, and creativity. Furthermore, as noted in Case 1, the marking criteria has also been adopted in this course. Evaluating the journal. Learning journals have been an optional assessment for four years (2003 – 2007) with class size varying from 12 to 18 students. However, in 2005, the option was not given to students as the course instructor was on leave. The experienced faculty member teaching the course instead adopted every other part of the outline except the learning journal. On returning from leave, the colleague was queried about the omission, and he explained he was not comfortable with the subjective nature of the assessment. We discussed this difficulty in the literature review (Varner & Peck, 2003); however, it is worth noting that the idea of “grading students feelings” is a significant barrier to the adoption of learning journals. In the first year, 6 of 18 students chose the learning journal option, the second year, 2 of 18 , the third year, 4 of 12, and the fourth year 3 of 13 chose this option. There have been no observable common traits among students choosing the learning journal assessment, For example, over the three years there has been a fairly even split between males and females choosing the assessment. Feedback received from the course evaluation from one student stated: I picked the learning journal option because I thought it would be an easy assessment. I learned so much more than I expected! You should change this from an optional assessment to a required assessment

The learning outcomes from the journal have been so positive that making the assessment mandatory has been considered; however, students have

14

JOURNAL OF MANAGEMENT EDUCATION / Month XXXX

consistently responded to liking choice in their assessment. By providing choice, the course offers several different assessment options with a history of excellent learning outcomes. These other options include: out in the community, an essay, corporate philanthropy, the facilitation of a stakeholder negotiation (a further assessed work in the course), and Web site critiques. As the literature on learning journals suggests, the feedback instructors receive from journals about what is going on in the class is invaluable (Varner & Peck, 2003; Williams & Wessel, 2004). For example, the first year the sustainability course was taught, students’ first monthly reports indicated that four of the six students considered dropping the course in the first few weeks. There was no other indication of this undercurrent in the class. In their journals, the students wrote about feeling that they should know more about sustainability than they did, and it seemed to many of them that the other students in the course had more knowledge of the topic. The feedback might not have come through end-of-course evaluations because students would most likely have worked through those feelings. However, with the feedback an experiential exercise was added to the beginning of the course that showed the majority of students were starting the class with a similar knowledge foundation.

Discussion and Conclusion Although our design and assessment approach to learning journals varies, there are common themes that emerge from the three cases, and Table 2 summarizes the literature and findings from the three case studies. The purpose of the journal in all three cases aligns with the literature. It was not our intent to use the journals to increase specific knowledge of course content, instead we wanted to foster reflection skills thereby increasing students’ ability to be a critical thinker. The literature highlights the need for clear guidelines and a student-centered approach in the design of learning journals (Brookfield, 1995; Moon, 1999; Varner & Peck, 2003; Williams & Wessel, 2004). In addition, the design of the learning journal must encourage a reciprocal exchange between teacher and student (hooks, 1994; Palmer, 1998). Cases 2 and 3 required students to regularly input into their journal, and checks were designed to ensure this happened. Case 1 had the clearest guidelines for the students. One of the key design features in Cases 2 and 3 is also related to assessment. That is, both were designed as formative assessment, with students being given feedback before receiving a final mark. This assessment encourages the reciprocal exchange recommended in the literature. The benefit of this type of design is that it helps with some of the assessment issues outlined below.

Pavlovich et al. / REFLECTIVE PRACTICE

15

TABLE 2

Contributions to Reflection and Education Purpose Literature

Case 1

Case 2

Case 3

Design

Assessment

Evaluation

A way of Clear structure and Comprehensive, Feedback organizing guidelines shows instructors students to (Brookfield, 1995; understanding of receive from become better Moon, 1999; the material, journals connected with Varner & Peck, shows selfabout what is their academic 2003; Williams & awareness of the going on in subject and, Wessel, 2004) writer as learner the class is more important, Student-centered and demonstrates invaluable with their own approach (Varner that the writer is (Varner & self-awareness & Peck, 2003) prepared to take Peck, 2003; (Brearley, 2002; A reciprocal risks with the Williams & Gardner, exchange between material (Crème, Wessel, 2004) 1999) teacher and 2005) student (hooks, Descriptive, 1994; Palmer, analysis, 1993, 1998) meanings and action (Williams & Wessel, 2004) To develop Three entries over the Structured Journals played students’ course (4 pages modified from a significant reflective maximum each) Willams & role in helping abilities and Structured (topic) Wessel (2004) students foster description, - Description develop mindfulness feeling, - Analysis reflective consequence of - Meanings learning. feeling, analysis - Actions through literature, learning To reflect on the At least three Formative The e-journal learning contributions a assessment-onhas two major process at the week to their going feedback, advantages personal level e-journal comments and over and act as a Reflective paper encouragement traditional channel for due at end of the via the “hard-copy” communication course. Series of facilitator’s journals: and exploration topics given for electronic link convenience between the students to reflect with the journal and ease of student and on as a guideline. writer. use, and the class immediacy facilitator and visual impact To reflect on Weekly, ungraded Formative Even with a themselves as checks of journal assessmentcoherent learners and writing ongoing design and indirectly on Monthly reports feedback through assessment course content (2-3 pages) the monthly protocol, (continued)

16

JOURNAL OF MANAGEMENT EDUCATION / Month XXXX

TABLE 2 Purpose

(continued)

Design drawing out key themes from weekly entries. Series of questions given as a guideline

Assessment reports. To give the student an indication of the quality of the journal entries to that point, a grading (A - D) accompanied qualitative comments.

Evaluation “grading students feelings” is still a barrier to journals. In line with the literature, feedback from students was invaluable.

There is no question that one of the most difficult challenges of learning journals is in the assessment. As illustrated in the student quotes we included, students put “themselves” into their journal entries, and any grade can easily be interpreted as grading the student rather than their work. A well-designed journal assessment includes clear guidelines and ongoing feedback for the students, which in turn makes assessment of the journal less problematic. We have noted several examples of how the journals have assisted us to fine-tune our courses, and how they provide a vehicle for our own reflection and evaluation. However, the journals did much more for the students, as they provided a means to expand students’ learning in significant ways. To conclude, we identified three major themes, abductively generated (Weick, 2006), that intersected across the case studies that can further develop student learning from the reflective journal method. We believe this aligns with and furthers the literature on the importance of effective design and assessment. DESIGN: FINDING THE STUDENT’S VOICE

The first theme related to the voice used in writing, as the design of the journal required students to move beyond the externally focused passive voice of academic writing. We ask students to explore themselves and their actions. Mostly, we asked them to connect at an emotional level, which requires a very different skill set to the more usual academic engagement through intellectual analysis of phenomena. Indeed, the act of writing things down requires a connection through feeling, requiring honesty about how one feels through authenticity and spontaneity. This brings the “who” into the context, developing what Gardner (1999) called intrapersonal intelligence based on the capacity to understand one’s self and the context in which one is engaged. Thus, the use of the personal voice requires teaching to be student centered in that it incorporates the interpreting of daily habits of life, as referenced by Brearley (2002). The journaling process explores small details of routine and habit that are seemingly inconsequential except for the connections they bring. In going

Pavlovich et al. / REFLECTIVE PRACTICE

17

deeper, the student’s voice grows as he or she moves beyond describing objects toward the development of a relationship with the subject through the recognition of personal insights. Indeed, students may explore their “shadows” (Brearley, 2002) that this inner gaze demands, and requires us to take a journey alongside the student. Thus, the use of personal voice challenges our teaching pedagogy at an epistemological level. The following is an example from a student’s learning journal illustrating how some students practically “sing” with the opportunity to use their voice: I initially was quite interested in the concept behind this assignment. To have the chance to write what we really think rather than just quote some other old dude? Unheard of! Students actually have original thought that is worth reading? Never! And to think that a lecturer was interested in my opinion of class, and my reflections on the topic is really rather empowering and invigorating. And, even more so, the first few versions of the assignment aren’t to be marked, only given feedback on, which means that I have the opportunity to put more personality and spark into the assignment without fear of being marked down. That’s why this assignment is not in Times New Roman. And it’s not 12 point font. And it’s not portrait. And I’m even using first person tense. Impressive huh? I’ve decided to make the most of my opportunity to express my individuality. This is being written in “Viner Hand ITC”—it’s a font I’ve never heard of before, but I felt I could better sum up my reflections in a font that looks like this rather than the standard level of conformity that is Times New Roman.

Rather than the central voice of authority prevalent in the objective world, it is the internal dialogue that takes center stage, as our students seek to understand the connections between themselves and their cocreated world. DESIGN AND ASSESSMENT: A NEW SPACE FOR LEARNING

Our second theme is that well-designed and assessed journal provides a new space for learning. Our feedback indicates that our courses can change the way students look at the world. One of the major changes in my learning that I have noticed while completing this learning journal, has been that I am now less likely to accept everything which has been said in class, and now prefer to form my own opinions about different topics. I think this is a major change in my learning, and as a martial artist, I think there are similarities between this point and achieving a black belt. A black belt in karate does not symbolize that one is a master of the art, rather it symbolizes that the person has mastered the basics and is now able to start to truly learn the art, they have “learnt how to learn.”

Transformational learning can be exciting but also challenging as long-held ideas and beliefs undergo a new scrutiny, and students can be left feeling adrift. Learning journals are ideally suited to support transformational learning by providing students with the space to reflect on the evolution of their beliefs. Exposing those new beliefs to an instructor through a journal can help

18

JOURNAL OF MANAGEMENT EDUCATION / Month XXXX

validate the emerging thinking through instructor feedback. This journaling process reconnects the inner world with the outer and helps reduce the separation of self from context. One student articulately described this effect: I find that I learn in a different place now. Before learning was something that was done to me, whereas now I am learning because I want to improve myself. It’s become a much more inwardly focused action. Now I ask how will this help me to understand myself?

The journals provide a space for truthfulness, not only for us as teachers (and the markers) but more importantly for the students themselves. When truly examining one’s learning, there is no place to hide and no need to be less than honest. Finding and accepting an inner truth requires courage, as so often we overlook our weaknesses in an attempt to not appear ignorant to others. Thus, openness and honesty are powerful attributes that assist in reconnecting the learning spaces. This is eloquently described by Palmer (1993) who noted that “we often clutter our learning space with obstacles and distractions to evade the emotions that education evokes” (p. 83). Indeed, through leaving those emotions unattended, our learning too is stagnated in that there is no balancing of ambiguities. Thus, in choosing not to learn solely through the external world, a focus on our inner world brings our own personal identity and integrity into one interconnected space. EVALUATION: REALIZING A HIGHER PURPOSE

Our final theme is how learning journals enable some of our students to connect with a more purposeful life. One student noted, It amazes me that I took this paper because I wanted an easy ride this semester. Well what a ride it has been. Twelve weeks down the track, and I am a different person. I am a person with a purpose, but also a person who recognises that I am in charge of my own destiny. I recognise that I have faults, but I also recognise that they are fixable, adaptable and that they are worth working on. I recognise that it will be a hard road, but one that will be fulfilling and joyful.

This process of thinking and awareness strengthen the students’ learning toward a holistic understanding of living and purpose. Our experiences of reflective journals illustrate three outcomes of higher purpose. First, that of personal development as indicated above. The second was of meaningful career, with a reflective process allowing space for inner learning and the natural abilities of the person to filter to the surface. One student described, It’s funny to think that a class I nearly withdrew from in the first week has resulted in a change of life: I am now volunteering and choosing a different career path that has low pay but much more enjoyment. Two things that six months ago, I would never have picked.

Pavlovich et al. / REFLECTIVE PRACTICE

19

The final theme that emerged here was of the concept of mindfulness, noted earlier by Van Manen (1997), whereby one connects at a deep level of awareness through being present with one’s surroundings at each moment. This delightful student comment is one that gladdens a teacher’s heart: In the last class, I really got it! I knew there was something really significant that I had learnt, something about me had changed; and all I could say to the class was that some questions of mine had been answered but mostly it had opened up more questions for me. However, I realized this afternoon as I thought about it some more that I am more aware of my actions. I do things with intent—that is what I have learnt and what has changed my life. I think about the water when it comes out of the tap. I think about my breathing. I think about how great it was swimming for the first time in the sea this year. I think about how my feet were standing in the mud when I was playing volleyball the other day. This is what I have learnt. I do things with intention now.

In identifying these three themes, we contribute to a greater understanding of how learning journals can develop students’ inner awareness. New voices, new spaces, and more meaningful life purpose all challenge classroom conventions epistemologically. We believe that in adding this pedagogical approach, we are developing future managers who are more able to connect within their inner thoughts and emotions. Through this process, they may, in turn, develop stronger interpersonal skills. Indeed, we support Van Manen’s (1997) conviction that reflective practice is not so much problem solving, as it is resolution through deeper understanding. Thus, the art of managing is about connecting with others in a more meaningful way. We believe our approach to teaching assists this and conclude with an illustrative student entry: When my grandmother passed away I was asked to do a reading at her funeral by my Dad. I found myself at a loss about what to read to truly represent how I felt about her. A friend suggested that I read the paragraph from my second reflective journal as part of the reading to show the importance of my Grandmother in our lives and the difficulties that all my family encountered when she became ill. I was skeptical at first, thinking about myself and how the people there would perceive me as being selfish and self-centred. I then realized that I was falling into the same trap. It wasn’t about me, it was about my Grandmother, my family and all of her friends celebrating her life. They would be touched and proud to hear of the respect and significance I reserved for her.

References Brearley, L. (2000). Exploring the creative voice in an academic context. Qualitative Report, 5(3/4), 1-10. Retrieved January 11, 2005, from http://www.nova.edu/ssss/QR/QR5-3/brearley.html. Brearley, L. (2002). Beyond univocal authority: An exploration of creative voices in academic research. Retrieved December 12, 2006, from http://ultibase.rmit.edu.au/Articles/nov06/ brearley1.

20

JOURNAL OF MANAGEMENT EDUCATION / Month XXXX

Brookfield, S. (1995). Becoming a critical reflective teacher. San Francisco: Jossey Bass. Crème, P. (2005). Should student learning journals be assessed? Assessment & Evaluation in Higher Education, 30(3), 287-296. Cunliffe, A. (2004). On becoming a critically reflexive practitioner. Journal of Management Education, 28(4), 407-425. Daudelin, M. (1996). Learning from experiences through reflection. Organizational Dynamics, 24(3), 36-48. Dewey, J. (1933). How we think: A restatement of the relation of reflective thinking to the educative process. New York: D. C. Heath. English, L., Luckett, P., & Mladenovic, R. (2004). Encouraging a deep approach to learning through curriculum design. Accounting Education, 13(4), 461-488. Gardner, H. (1999). Intelligence reframed: Multiple intelligences for the 21st century. New York: Basic Books. Haigh, M. (2001). Constructing gaia: Using journals to foster reflective learning. Journal of Geography in Higher Education, 25(2), 167-189. Hall, M., Ramsay, A., & Raven, J. (2004). Changing the learning environment to promote deep learning approaches in first-year accounting students. Accounting Education, 13(4), 489-505. Hays, J. (2004). Keeping a learning journal. Retrieved February 5, 2006, from The Australian National University, College Teaching Notes Web site: http://teaching.fec.anu.edu.au/ BUSN2029/Learning%20Journal3.pdf. hooks, b. (1994). Teaching to transgress: Education as the practice of freedom. New York: Routledge. Kennison, M., & Misselwitz, S. (2002). Evaluating reflective writing for appropriateness, fairness and consistency. Nursing Education Perspectives, 23(5), 238-242. Kind, S., Irwin, R., Grauer, K., & De Cosson, A. (2005). Medicine wheel imag(in)ings: Exploring holistic curriculum perspectives. Art Education, 58(5), 33-38. Locke, K., & Brazelton, J. (1997). Why do we ask them to write, or whose writing is it anyway? Journal of Management Education, 21(1), 44-57. Loo, R., & Thorpe, K. (2002. Using reflective learning journals to improve individual and team performance. Team Performance Management: An International Journal, 8(56), 134-139. Miles, M., & Huberman, A. (1994). Qualitative data analysis: A sourcebook of new methods. Thousand Oaks, CA: Sage. Moon, J. A. (1999). Reflection in learning and professional development: Theory and practice. London: Kogan Page. Palmer, P. J. (1993). To know as we are known: Education as a spiritual journey. San Francisco: Harper. Palmer, P. J. (1998). The courage to teach. San Francisco: Jossey-Bass. Ramsey, V. J. (2002). Learning journals and learning communities. Journal of Management Education, 26(4), 380-401. Schön, D. (1983). The reflective practitioner: How professionals think in action. New York: Basic Books. Stake, R. (1995). The art of case study research. Thousand Oaks, CA: Sage. Van Manen, M. (1997). Researching lived experience. London: Althouse Press. Varner, D., & Peck, S. (2003). Learning from learning journals: The benefits and challenges of using learning journal assignments. Journal of Management Education, 27(1), 52-77. Weick, K. (2006). Faith, evidence and action: Better guesses in an unknowable world. Organization Studies, 27(11), 1723-1736. Williams, R., & Wessel, J. (2004). Reflective journal writing to obtain student feedback about their learning during the study of chronic musculoskeletal conditions. Journal of Applied Health, 33(1), 17-23. Yin, R. K. (2003). Case study research: Design and methods (3rd ed.). Thousand Oaks, CA: Sage.