25 January 2017

Qualitative quality: Eight “big-tent” criteria for excellent qualitative research.

Reference: Tracy, S. J. (2010). Qualitative quality: Eight “big-tent” criteria for excellent qualitative research. Qualitative Inquiry, 16(10), 837-851.

Abstract: This article presents a model for quality in qualitative research that is uniquely expansive, yet flexible, in that it makes distinctions among qualitative research’s means (methods and practices) and its ends. The article first provides a contextualization and rationale for the conceptualization. Then the author presents and explores eight key markers of quality in qualitative research including (a) worthy topic, (b) rich rigor, (c) sincerity, (d) credibility, (e) resonance, (f) significant contribution, (g) ethics, and (h) meaningful coherence. This eight-point conceptualization offers a useful pedagogical model and provides a common language of qualitative best practices that can be recognized as integral by a variety of audiences. While making a case for these markers of quality, the article leaves space for dialogue, imagination, growth, and improvisation.

Notes: [It's been a while since my last blog post!] I'll keep it short: design research REALLY needs to look at this type of papers where criteria of quality and rigour are discussed across research cultures and disciplines. Design research needs to develop its own criteria. 

24 July 2016

A tale of two cultures: Contrasting quantitative and qualitative research

Reference: Mahoney, J., & Goertz, G. (2006). A tale of two cultures: Contrasting quantitative and qualitative research. Political analysis, 14(3), 227-249.

Abstract: The quantitative and qualitative research traditions can be thought of as distinct cultures marked by different values, beliefs, and norms. In this essay, we adopt this metaphor toward the end of contrasting these research traditions across 10 areas: (1) approaches to explanation, (2) conceptions of causation, (3) multivariate explanations, (4) equifinality, (5) scope and causal generalization, (6) case selection, (7) weighting observations, (8) substantively important cases, (9) lack of fit, and (10) concepts and measurement. We suggest that an appreciation of the alternative assumptions and goals of the traditions can help scholars avoid misunderstandings and contribute to more productive “cross-cultural” communication in political science.

I found the book version of this paper by the same authors very interesting. Although my main interests or experiences don't include Political Science, the ideas by these authors apply to any disciplinary traditions. The way they dissect the similarities and differences across ways of doing research (cultures) has helped me significantly to shape my collaborations.

10 November 2015

The dialectics of serendipity in Management

Reference: Pina e Cunha, M., Rego, A., Clegg, S., & Lindsay, G. (2015). The dialectics of serendipity. European Management Journal, 33(1), 9-18.

Abstract: Serendipity in organizations has often been perceived as a mysterious occurrence. We approach the process of serendipity via reconsideration of Honda’s entry into the US market using an alternate templates analysis, showing that serendipity can be conceptually interpreted as the synthesis of preparation and openness to novelty, articulated through generative doubt. In this sense, it can be thought of as a dialectical process that thrives through the creative synthesis of the existing and the new. It is a practical accomplishment rather than an organizational form of mystery.

I enjoyed reading this, here's my favourite part: "We asked “how do organizations turn luck into serendipity”, and responded that they do so via the dialectical interplay of preparation, openness, and doubt. Serendipity can thus be defined as unexpected observations framed as opportunities, made actionable by a frame of reference that is kept dynamic via the cultivation of doubt..."

1 November 2015

Meta-analysis in design research: role of examples

Reference: Sio, U. N., Kotovsky, K., & Cagan, J. (2015). Fixation or inspiration? A meta-analytic review of the role of examples on design processes. Design Studies,39, 70-99.

Some papers make it straight to my reading list (and this blog) due to their title, venue, and authors. This is a clear example. I'm looking forward to reading this paper for several reasons:
1. Jon Cagan's excellent track record and diverse research interests
2. By itself, interesting to see meta-analyses in the field of design research
3. May be quite useful to see their findings and interpretations of the (I assume) non-obvious influences that precedents play in design processes.

I hope to see some insights here on disciplinary differences, as I know that examples play a hugely different role across design areas, from robotics to architecture, graphic design, games, mechanical design, etc.

21 August 2015

The power of feedback

Reference: Hattie, J., & Timperley, H. (2007). The power of feedback. Review of educational research77(1), 81-112.

Abstract: Feedback is one of the most powerful influences on learning and achievement, but this impact can be either positive or negative. Its power is frequently mentioned in articles about learning and teaching, but surprisingly few recent studies have systematically investigated its meaning. This article provides a conceptual analysis of feedback and reviews the evidence related to its impact on learning and achievement. This evidence shows that although feedback is among the major influences, the type of feedback and the way it is given can be differentially effective. A model of feedback is then proposed that identifies the particular properties and circumstances that make it effective, and some typically thorny issues are discussed, including the timing of feedback and the effects of positive and negative feedback. Finally, this analysis is used to suggest ways in which feedback can be used to enhance its effectiveness in classrooms.

Notes: "Most current assessments provide minimal feedback, too often because they rely on recall and are used as external accountability thermometers rather than as feedback devices that are integral to the teaching and learning process. It is the feedback information and interpretations from assessments, not the numbers or grades, that matter. In too many cases, testing is used as the measure to judge whether change has occurred rather than as a mechanism to further enhance and consolidate learning by teachers or students." 

Cited by 3215

11 August 2015

Creativity: The essence of mathematics

Reference: Mann, E. L. (2006). Creativity: The essence of mathematics. Journal for the Education of the Gifted, 30(2), 236-260.

Abstract: For the gifted mathematics student, early mastery of concepts and skills in the mathematics curriculum usually results in getting more of the same work and/or moving through the curriculum at a faster pace. Testing, grades, and pacing overshadow the essential role of creativity involved in doing mathematics. Talent development requires creative applications in the exploration of mathematics problems. Traditional teaching methods involving demonstration and practice using closed problems with predetermined answers insufficiently prepare students in mathematics. Students leave school with adequate computational skills but lack the ability to apply these skills in meaningful ways. Teaching mathematics without providing for creativity denies all students, especially gifted and talented students, the opportunity to appreciate the beauty of mathematics and fails to provide the gifted student an opportunity to fully develop his or her talents. In this article, a review of literature defines mathematical creativity, develops an understanding of the creative student of mathematics, and discusses the issues and implications for the teaching of mathematics.

Notes: I have heard some University lecturers in Engineering complain that their students "nail it" in the exams, but in the end fail to really comprehend the core ideas, and are unable to apply them later on. Some teachers have gained prominence by incorporating some "active learning" approaches to teaching Mathematics and Physics... but what I have not seen (enough, anyway) is this idea of targeting the creative dimension of mathematics.

9 August 2015

Idea evaluation: Error in evaluating highly original ideas

Reference: Licuanan, B. F., Dailey, L. R., & Mumford, M. D. (2007). Idea evaluation: Error in evaluating highly original ideas. The Journal of Creative Behavior41(1), 1-27.

Abstract: Idea evaluation is a critical aspect of creative thought. However, a number of errors might occur in the evaluation of new ideas. One error commonly observed is the tendency to underestimate the originality of truly novel ideas. In the present study, an attempt was made to assess whether analysis of the process leading to the idea generation and analysis of product originality would act to offset underestimation error in the evaluation of highly original new ideas. Accordingly, 181 undergraduates were asked to evaluate the originality of marketing campaigns being developed by six different teams where the level of idea originality was varied. Manipulations were induced to encourage active analysis of interactional processes and the originality of team products. It was found that active analysis of product originality and appraisal of interactional processes reduced errors in evaluating the originality of highly novel ideas. The implications of these findings for the evaluation of new ideas are discussed.

Notes: There is a clear bias in creativity research to study the production or generation of ideas (can ideas strictly be "generated" or ideas more like energy?), while only a few studies focus on the evaluation or assessment of ideas.

8 July 2015

The expatriate-creativity hypothesis

Reference: Fee, A., & Gray, S. J. (2012). The expatriate-creativity hypothesis: A longitudinal field test. Human Relations, 65(12), 1515-1538.

Abstract: While prior research suggests that the cognitive changes triggered by cross-cultural experiences can enhance an individual’s creative-thinking abilities, this is yet to be verified through empirical field research. We draw on schema theory, and the principle of psychological dissonance experienced during cultural adaptation, to argue that expatriates undergo wholesale cognitive changes that can lead to enhanced creative-thinking abilities. We test this hypothesis by measuring changes in the creative-thinking abilities of a sample of expatriates over the first 12 months of their placement. When compared with a control group of non-expatriates, the expatriates showed significant increases in overall creative-thinking abilities and cognitive flexibility, although not originality, elaboration, or ideational fluency.

Notes: TBD

14 June 2015

Teaching for creativity: from sage to guide to meddler

Reference: Erica McWilliam (2009) Teaching for creativity: from sage to guide to meddler,Asia Pacific Journal of Education, 29:3, 281-293

Abstract: This paper serves three purposes. First, it makes a case for seeing creativity as a keylearning outcome in our times, and thus the core business of education. It then goes on
to examine the nexus of creativity and pedagogy, showing the conceptual work done to
demonstrate creativity as a learnable set of dispositions and capabilities. Finally and
most importantly, the paper argues the value of a pedagogical approach the author calls
“Meddling-in-the-Middle”, in augmenting and enhancing the repertoires of “Sage-onthe-Stage” and “Guide-on-the-Side” in order to build students’ creative capacity.
Examples are given of what these meta-approaches might look like in relation to the
teaching of Shakespeare. The author concludes by arguing the important connection
between Meddling pedagogy and creative capacity building.

Notes: A culture of teaching that values obedient attentiveness or busy work for its own sake,rather than the attention and busy-ness that speaks of productive engagement, is death to
proactive, self-managing learning. Fortunately, active engagement, rather than listening
and regurgitating, reflects the learning preferences of the present generation of learners,
who are more likely in informal environments to try things out rather than follow
instructions “from above”. If teachers can understand the value of being “usefully
ignorant” about learning options and possibilities, at the same time as they are expert in
their disciplinary field and their pedagogical practice, who are active and inventive in the
classroom, who challenge and support, who do not make things too easy, and who are not
the only source of authority, who use processes of discovery, critique, argument and
counter-argument effectively, who enjoy learning themselves and who do not rush to
rescue their students from complexity – such teachers will contribute immeasurably to the
creative capacity of their students now and in the future.