Documenting method

"What if the work that's been done doesn't run on supported hardware/software any more?" (Ex 1, 1b-C)

"Software changes ... one has invested in the "old" software ... learning something new becomes a burden and a barrier. So much time to invest in learning new software is a very serious disincentive to use." (Ex 1, 1b-C)

"More transparent support for the scholarly process; e.g., embed data and methods inside papers to support replication and model the scholarly process as part of the work product" (Ex 1, 1b-G)

"Finding out what you've developed after users get their hands on the system; This is the only sustainable way to develop training in quickly-moving communities" (Ex 1, 1c-A)

"Allow users to write manuals, because they're the only ones who truly understand what they do." (Ex 1, 1c-A)

"There should be an emphasis on capturing what you do, so even if you re-invent the wheel, you'll know what you did." (Ex 1, 1c-A)

"We live in an outcome-focused world; process is valuable." (Ex 1, 1c-B)

"Infrastructure is already observably being used most for streaming -- that's what's the highest volume of bytes crossing the wire. "Outtake" footage is huge from documentaries, Dutch are starting to look at universities as repositories of that valuable material as research source material." (Ex 1, 1c-C)

"Archives w/ no clue of what that was at [large university]. Images of classical landscapes, slides from all over Europe -- don't know what that was. It was folklore, and knowledge base disappears with retirement of faculty. Impulse that made person take it is gone." (Ex 1, 1d-B)

"Make technologies accessible to Humanities Scholars; standards to understand how they work - descriptive for both content but function" (Ex 1, 1d-D)

"Digital technology shapes practices, changes content" (Ex 1, 1d-G)

"Importance of transparency of process, of method" (Ex 1, 1d-G)

"Transparency of processes and procedures, a hallmark of the humanities and arts." (Ex 1, 1d-H)

"the longevity of projects. Why do digital projects die so quickly." (Ex 1, 1d-H)

"Discover social networks; Can't be black box - needs visibility to get trust in arts and humanities. True across the board" (Ex 2, 1a-A)

"Analyze one's own methodology. Recombine one's own research. Evaluate one's own use of time" (Ex 2, 1a-C)

"Submit what one has done to an archive so others can see it. Not just in a large, structured appendix. One's university library might not take these extra materials, depending on policy. But it's hard to put one's research materials in coherent order for presentation to a library ... there's no credit in doing this work ... the library might not know how to take care of it ... what's a suitable archive in which materials can reside?" (Ex 2, 1a-C)

"Not just sharing data, but sharing one's particular take on the data. Archives of conference papers, electronic working papers like the sciences do. Registry of research activities as part of this social networking activity -- pre-print, awareness of area of work and particular argument, approach, methodology." (Ex 2, 1a-C)

"Analyze, analysis becomes its own object" (Ex 2, 1a-E)

"Capture, archive, to establish. To uncover activities, no memory of past events if not recorded" (Ex 2, 1a-E)

"preservation of data can be the contribution" (Ex 2, 1b-A)

"It's hard to put one's research materials in coherent order for presentation to a library ... there's no credit in doing this work ... the library might not know how to take care of it ... what's a suitable archive in which materials can reside? [... where is the] credit for depositing data when developing research?" (Ex 2, 1b-C)

"Recreating past methodologies: i.e. rediscovering historical ways of looking at what is now primary material." (Ex 3, 1b-F)

"You say "we're marking up the primary stuff", but we're not marking up your article? There's no semantic-web type capability for articles, unless I translate X into a series of keywords? Do you think a scholar when they submit their paper would take the time to do some kind of semantic markup? Pushed to do that more by journals now, but that doesn't solve the problem. More sophisticated tools that use Google-like technologies are more likely to help than pre-coded stuff" (Ex 2, 1d-A)

"have a career worth of notes that want to reference for new scholarship" (Ex 2, 1d-C)

"Issue of shoveling data is critical and variable depending on project or field. Was a faculty member at [large research university] and work with visual data. One project was to put together a db of images that would be annotated and searchable to share w. other faculty to make accessible for teaching mainly. Used Cumulus. W/ tagging I got lazy. Hard to imagine my colleagues using them, would have been a huge burden to do all meta tagging required. Several fields to make meaningful for all. Had research assistant to do it, but was a failure because I was only person who knew what it was. Typical issue when knowledge is esoteric. Someone in my field could generically explain what it was. Could interfere w/ other activities that are going to get you tenure. IT guys pounding on my door to get done. It's drudgery and stealing time. Images that I produced, IT digitized boxes of slides, installed in Cumulus db and waiting to be annotated. Mostly didn't get done." (Ex 2, 1d-D)

"Scholars only want to put out the finished product; want to hide all failures along the way. One interesting thing about blogs, etc. is it makes the "marginalia" of the research process more visible. Provide more exposure of the working process" (Ex 2, 1d-G)

"Recreating past methodologies: i.e. rediscovering historical ways of looking at what is now primary material." (Ex 3, 1b-F)

"recreate past methodologies" (Ex 3, 1b-I)

"tools don't care (how you use them). might be uses that are surprising to the toolmaker. people come in with preconceptions" (Ex 3, 1c-C)

"Part of what you have to determine is whether technology is introducing intrinsic biases" (Ex 3, 1c-D)

"Relates to exposing - exposing process. Don't have short research notes, like they do in the sciences. We don't have that. We need a whole narrative, an argument. When we do delineate they are in 25 pg white papers for funders which no one wants to read." (Ex 3, 1d-G)

"Wiki has talk-thru pages where people haggle what goes into an article. We don't have a space where we can talk about the process in process. It's what doesn't get spoken; wrestling w/ the parts of the process. The blogosphere is one extreme of that. Need a place where you can throw out, where the annealing starts, where the argument takes form." (Ex 3, 1d-G)

"a kind of accountability, somewhat dialectical -- accountable to what you're looking at (letting it speak), and accountable to understand one's own biases. Need to take responsibility for the fact that you're using a certain category. Might scholarly works need to be accompanied by statements of biases, assumptions, contexts as far as one understands them. Somehow, a question occurs to you -- something to understand. or, something needs to be understood. Using knowledge of others lacks context, assumptions. Involves violence, like smashing. Abstracting, annotating, assumption-linking, concept-splitting, emitting, extracting, goal-shifting, linking, matching, negotiating, segmenting, source-linking, stemming, zoning, ordering, articulation, a concordant discordance --> plotted into a narrative. Abstraction involves loss, filtering, bias -- contrast with concretization. details get filled back in when things are made concrete. Might look like thinking, or typing, or hand on the forehead, or an action, or like art-making. Must somehow be understandable and shareable. Don't rein in methods of sensemaking. Sometimes you have to be a bit more efficient and come to some agreements. How might you describe the mona lisa to someone who is blind? Curator, critic, historian's perspective. Multiplicity can be very helpful. Boundary conditions on interdisciplinary work" (Ex 4, 1b-A)

"Does methodology documentation count as research?" (Ex 4, 1c-C)

"Academic work should be explicit about judgment processes. Footnotes tell a certain story, introduction makes some of assumptions clear. At some level, you're supposed to make the analysis work without having all that laid bare. One of my colleagues was asked why she wasn't explicit about theoretical assumptions: "I don't wear my underwear on the outside."" (Ex 4, 1c-D)

"the ancillary information and data that are made on the way toward publication" (Ex 4, 1d-C)

"some application have very sensitive context-sensitive searching including proximity searches. Had a research task that couldn't be addressed by existing tools; had to modify how the tools (in this case the search) worked, and the results of that modification made it possible to do new forms of research." (Ex 4, 1d-D)

""Linguists talk about archiving stuff, when they mean slapping it up on a website, and that's not archiving, in my view." "Tell it, brother! Testify!"" (Ex 5, 1b-B)

"identify places where learning about error can enrich the process of research [and] enable constructive forward movement" (Ex 5, 1b-C)

"Field linguists go out and collect language, collect lexicons. The dissertation is given importance, and there's a mass of related information that never gets published, that is put in a box. But it takes a lot to put it in a box (assuming someone will take it). The discipline also needs to recognize the value of this primary data. Right now, only traditional forms of publication are given sufficient value. As a result, not much effort is put into preserving this." (Ex 5, 1b-E)

"University presses need to step up to this challenge. They're going down.. and they need to create new ways of letting repositories be recognized." (Ex 5, 1b-E)

"Field work, notes, deposited into archives, then you can cite them." (Ex 6a, 1a-C)

"Bamboo could offer other opportunities. Academic technology services. Should publish citation information. We need documentation with impact factors. Our only measure is quantity. If we could add one more metric, it would be great." (Ex 6b, 1a-C)

"Seeing much more focus on transparency" (Ex 6b, 1a-G)

"Biggest stumbling block is data structures and metadata. I would have a data architecture that would fulfill everyone needs and populate them with robust metadata." (Ex 6b, 1b-C)

"Does research discovery service imply research description method? So that when research is described differently, it might still be recognizable across disciplines. Perhaps an agreement on ontology so that the information can be kept up to date. " (Ex 6b, 1c-A)

"Documentation writing - someone else! could be a service" (Ex 6b, 1d-F)

"Faculty have data sets: how to preserve them." (Ex 7, 1a-H)

"document practices, show goals" (Ex 7, 1b-A)

"Prof. Wendrich is an archeologist who works in the field of Egyptology, conducting excavation in the Fayum with a multimember team in Egypt from September through December each year. The Fayum team's excavation and survey results will be submitted to several journals, and an edited volume will be published in a joint series of the Cotsen Institute of Archaeology at UCLA and the Groningen Archaeological Series (GAS) of the Rijksuniversiteit Groningen. Publication in book form is a prerequisite of the Egyptian Supreme Council of Antiquities for the continuation of the excavation permit. The Fayum Principal Investigators, therefore, will publish the edited volume in print (GAS) and through the recently established Cotsen Digital Archaeology Series (CDAS), published online through eScholarship ( The goal for the Fayum online publication is to link directly and dynamically to the raw excavation data so that researchers using the publication can independently verify the conclusions presented in the publication. Prof. Wendrich envisions that original excavation and survey results will be made accessible to colleagues and the general public. The GIS, the finds database, the excavation database, and the photo database of the Fayum Project are at the moment integrated in an online database system, based on MySQL. Wendrich plans to cooperate with existing initiatives and is in the process of assessing archaeological data collection and presentation initiatives such as the Alexandria Archive and" (SN-0022 Data Access in Secondary Publications, Willeke Wendrich, 1/8/09)

Bamboo tags: 

Add new comment