Monday, April 27, 2015

Week 13: Evaluating Digital Scholarship

Class session goal: develop our own list of criteria for evaluating digital projects.

  • What criteria should we use to assess digital scholarship? How do we know if a digital project is a success?
  • What kinds of problems do we need to take into consideration when evaluating digital history projects? How are these problems different from the problems associated with traditional history projects?
  • What is the context for most of the evaluations being discussed here? Are they talking about critical reviews, such as you might offer in a journal review of a website? Or are they talking about decisions about people’s jobs? Do some (or all) of these criteria apply in both contexts?
  • To what extent can academic tenure and promotion advice be translated to other contexts?
  • What criteria have we been using to evaluate websites? Based on the advice in these articles, what else could we be examining that we have not been talking about together?


Todd Pressner, “How to Evaluate Digital Scholarship,” Journal of Digital Humanities 1(4) (2012).
  • Why is it important to view a digital project in the medium in which it was created?
  • “New knowledge is not just new content but also new ways of organizing, classifying, and interacting with content.”
  • Are any criteria missing?
  • Do you find any of these criteria controversial?


Geoffrey Rockwell, “Short Guide to Evaluation of Digital Work,” Journal of Digital Humanities 1 (4) (2012).
  • What kinds of evaluations is he talking about?


James Smithies, “Evaluating Scholarly Digital Outputs: The Six Layers Approach,” Journal of Digital Humanities 1 (4) (2012).
  • Why would you want to pin a project into one of these categories?


 Laura Mandell, “Promotion and Tenure forDigital Scholarship,” Journal of Digital Humanities 1 (4) (2012).
  • Why did she write this document?
  • Why does she have to say explicitly that an article published in a digital journal is no different than an article published in a traditional print journal?
  • Do you agree that creating a platform for digital humanities scholarship (such as Hypercities) should count as much as offering a new interpretation?


Katherine D. Harris, “Explaining Digital Humanities in Promotion Documents,” Journal of Digital Humanities 1 (4): 2012.
  • What is a “legacy project”?
  • What does she mean by work that is ephemeral?
  • How can work that is ephemeral be integral to someone’s scholarly productivity?
  • What range of activities does she include in her case?



  • Why do “publicly engaged academic” historians need their own separate guidelines for tenure and promotion?
  • How is public history scholarship different from traditional academic scholarship?
  • What is the thrust of the list of best practices? Are any important considerations omitted?
  • What do they mean by “look beyond the traditional monograph”?
  • Why does this document give advice to departments and administrators as well as to digital scholars?


  • “Scholarship is a documented and disciplined conversation about matters of enduring consequence. Hiring, tenure, and promotion involve peer-based judgments evaluating the significance of a scholar’s contribution to one or more of those conversations.”
  • Why does this document give advice to departments as well as to digital scholars?
  • Why is digital scholarship so often “unfinished”?


Cohen and Rosenzweig, chapter 8 and “Some Final Thoughts
  • “The Ivar Aasen Centre of Language and Culture, a literary museum in Norway, lost the ability to use its large, expensive electronic catalog of holdings after the death of the one administrator who knew the two sequential passwords into the system.”
  • Is it obvious that all digital history projects should be preserved?
  • What is their general advice about how to choose the systems for coding and storing your project?
  • Why isn’t backing up your project on paper a really good idea?
  • What is “emulation” as a strategy for preserving digital materials? What are its advantages and disadvantages?
  • How can you strike a balance between being careful and being ponderously slow?


Monday, April 20, 2015

Week 12: Relational Databases (plus copyright)

Ansley T. Erickson, “Historical Research and the Problem ofCategories: Reflections on 10,000 Digital Note Cards,Writing History in the Digital Age
  • What is a relational database?
  • How do you keep track of all your notes for a project? How should you do this?
  • What was Erickson’s goal in using a relational database for her dissertation?
  • How much reading of and thinking about documents should you do in the archives? How much do you do later?
  • How did she take advantage of the possibilities of the database in her research and writing process?
  • When in the process should you start writing?
  • Do you actually organize your writing through categories, or through topics, or through narrative?


Gwendolyn Midlo Hall, “Africa and Africans in the African Diaspora: The Uses of Relational Databases,” American Historical Review (February 2010): 136-150.
  • What motivates this article? Why does whether women milled rice during the Middle Passage matter?
  • How do you know what is in a database you are working with? “Thousands of new Brazilian and Portuguese voyages have been added, correcting the Anglo-focused distortion of TSTD1.”
  • What limitations do databases have?
  • What does she mean by “unquantifiable data”?
  • What cautions does she offer about databases? “to answer, they can be rigid and inflexible, locking in outmoded research and questions and not allowing for new ones. Databases are not a higher form of knowledge that can somehow trump other kinds of research. Scholarship is not a zero-sum game.”



Cohen and Rosenzweig, chapter 7, “Owning the Past
  • What do you need to know about copyright law? How much do Cohen and Rosenzweig want you to worry about it?
  • Do course instructors still use course packets?
  • What stance toward copyright do you expect from digital historians?
  • What are the costs associated with acquiring permission to use published sources in a digital project?
  • “Good copyright citizens—cooperative residents of the digital commons—don’t try to grab rights they don’t have.”
  • What is Creative Commons?
  • What is fair use?







Monday, April 13, 2015

Week 11: Big Data


  • What is topic modeling? How do they do it?
  • What is network analysis? How do they do it?
  • Can you tell how much “live writing” they actually did for this project? How does their writing in public approach compare to Moravec’s?
  • What is github?
  • Are you persuaded by their proposal that shifts in training and standards are needed for historical education?
  • What kinds of historical questions can you ask with Big Data that you can’t with more traditional textual analysis methods?
  • At what stage in the research process would you imagine visualizing your primary sources with a tool like Voyant?
  • What do you think of this definition of Big Data?: “For us, big data is simply more data that you could conceivably read yourself in a reasonable amount of time – or, even more inclusively – information that requires computational intervention to make new sense of it.”
  • Does this book motivate you to learn to code?
  • Assuming you had a research problem that you needed a tool for…how would you find out what tools are available and which ones you might need to code yourself?
  • What concerns of copyright underpinned Google’s digitization of the five big libraries?
  • What kinds of historical questions do you think you can ask with Big Data?
  • What did they do with the Dictionary of Canadian Biography?
  • What do they mean by “distant reading”? (PhD Comics example: https://www.youtube.com/watch?v=tp4y-_VoXdA)
  • Differences among “information visualization,” “scientific visualization,” and “infographic”
  • Let’s compare the 3 kinds of written in public approaches that we have looked at so far this semester. What are their strengths and weaknesses?


Cohen and Rosenzweig, chapter 6, Collecting History Online
  • How are the challenges of digital archiving different now than they were when Cohen and Rosenzweig wrote this chapter a decade ago?
  • How do you know that you have a target project audience that is just the right size—not too narrow and not too broad?
  • How do you feel the blog is working for our class?
  • Do any of you run personal blogs? Why? Are they thematic in any way?
  • What lessons do you take from the story of the Sept. 11 Digital Archive?



                                                                                                                


Monday, April 6, 2015

Week 10: Writing in Public

This week's topic is "Writing in Public," a topic I did not include in the first iteration of History 717. I thought to include it this year only after reading Twitter accounts of the 2015 AHA meeting, which included a session on Writing in Public. Michele Moravec (Rosemont College) shares her work-in-progress online for readers to engage as she writes.

General questions:
What are the reasons for writing in public?
Would you do it?
Should you advertise it if you do?
Touch on dissertation/thesis embargo question.


Michele Moravec, #writinginpublic
  • How do you pick a platform for writing in public?
  • Why does Moravec write in public? What are other reasons for writing in public? Would you?
  • What are the risks of writing in public?
  • Is writing in public the same as “live writing”?
  • Would you do either?
  • How do you interact with yourself while you write?
  • How does writing in public work as a form of peer review?
  • What kind of “behind the scenes” writing activity might support a written in public project like this? For example, how does the organization emerge? How does revising work? What if the author needs to move things around? How far along in a project do you need to be before you start “writing it in public?” What are the implications of writing in two platforms, using different word processing tools? How would you manage keeping track of two organizational systems? How would you decide what to post in public and what to do in private? How would you leave notes for yourself about what still needed to be done, what you were confused by?
  • How could you use different platforms differently?
  • I’m intrigued by the idea of live commenting. When I am a peer reviewer in a traditional process, the author doesn’t get my comments as I go along. I suppose I could go back and insert them later, but I am too lazy to refigure where they all should go!


Michele Moravec, Politics of Women's Culture manuscript:
  • [Note that I end up with almost no substantive questions about this work, probably because it is so far afield for me. I can’t tell what might be known from previous scholarship and what is really new here, since I just am not immersed in that literature]
  • How did you decide how to navigate through the book?
  • Did you read the comments as you went along?
  • If an author puts up images in a work in progress written in public, does she have to get permissions for them the same way she would with a “published” work?
  • What argument could you get from the work in progress? Perhaps start with small groups to see what they think the argument is. Perhaps like trying to identify the elephant with a blindfold on?
  • What is this project about?
  • Do you feel like you need to read the finished book?
  • How would you handle footnoting if writing in public? How would footnoting integrate with the use of a program like Zotero or RefWorks that handled many of the fine details for you?
  • I wonder why comments are closed on the section on The Journal of Women’s History. I wanted to ask of paragraph 6 whether there are archives that would show the process by which authors decided what to do with their pieces and what to respond to. I’m sure I am only thinking of this because of reading in the open peer review format of this manuscript.


Cohen and Rosenzweig chapter 5, “Building an Audience
  • Do you respond to the idea of marketing in the negative way that Cohen and Rosenzweig assume?
  • Should writing in public be regarded as a form of marketing by building an audience?
  • How might you build an audience for the group projects you are working on?
  • How does Google work, according to Cohen and Rosenzweig?
  • What is the difference between “hits” and “visitors” and “users”?
  • What are some reliable ways of figuring out why users come to your site?