Category Archives: Announcements

Congratulations and farewell to Mike Adamo

This week, Digitization Specialist Mike Adamo will move on from Duke Libraries after 14 years to assume a new position as Digital Imaging Coordinator at the Libraries of Virginia Tech University. Mike has contributed so much to our Digital Collections program during his tenure, providing years of uncompromising still imaging services, stewardship in times of change for the Digital Production Center, as well as leadership of and then years of service on our Digital Collections Implementation Team. He has also been the lead digitization specialist on some of our most well known digital collections like the Hugh Mangum photographs, James Karales photographs and William Gedney collection.

In addition, Mike has been a principal figure on our Multispectral Imaging Team and has been invaluable to our development of this service for the library. He established the setup and led all MSI imaging sessions; collaborated cross-departmentally with other members on the MSI Team to vet requests and develop workflows; and worked with vendors and other MSI practitioners to develop best practices, documentation, and a preservation plan and service model for MSI services at Duke Libraries. He’s also provided maintenance for our MSI equipment, researching options for additional equipment as our program grew.

Side by side comparison of a papyri item under natural light and the same item after multispectral imaging and processing.

We are grateful to Mike for his years of dedication to the job at to the field of cultural heritage digitization as well as for the instrumental role he’s played in developing MSI Services at DUL. We offer a huge thank you to Mike for his work and wish him well in his future position!

Post contributed by Giao Luong Baker and Erin Hammeke

Smart People Who Care

It’s that time of year at the university when we’re working on our PEPs (Performance Evaluation and Planning forms) and I’m thinking about how grateful I am to have such smart staff who really care about their work, their colleagues, and the people they serve, as we advance technology across the libraries. In contrast to some corporate environments, the process here really does aim to help us improve, rather than rank us as a setup for “resource actions” (firings). This excellent article, The Feedback Fallacy by Marcus Buckingham and Ashley Goodall, reminds me to emphasize the things people do well, and encourage them to build on their strengths.

Attuned to ethical practices within organizations, I’m also excited about increasing awareness of ethics in the effects of the technologies we produce. Justin Sherman, co-founder of the Ethical Tech initiative here at Duke, did a stimulating talk at the Edge Workshop this month about ethical issues that surround technology, such as search engine bias, and AI tools that judges use to determine sentencing for crimes.  Justin recommends this podcast, with Christopher Lydon on Open Source, called Real Education About Artificial Intelligence.  Library staff are participating in the Kenan Institute for Ethics book club program (KIE), where the spring selection is Algorithms of Oppression: How Search Engines Reinforce Racism by Safiya Umoja Noble.

And, I’m pleased to exercise my hiring mantra, “smart people who care”, which has served me well for over 30 years, as we’re recruiting candidates with I/T and team leadership experience for a new position, Computing Services Supervisor.

Happy Spring!
Laura Cappelletti
Director, Information Technology Services

We are Hiring: Digital Repository Content Analyst

Duke University Libraries (DUL) is recruiting a Digital Repository Content Analyst to help us ingest and manage content in our digital preservation systems and platforms.  This position will partner with the Research Data Curation Program, Digital Collections Program, and various other departments around the Library and on campus to provide curation and preservation services.  This is an excellent entry level opportunity for anyone who enjoys managing large sets of data and/or files, working with colleagues across an organization, preserving essential data and library collections, and learning new technical skills.

Ideal applicants have been exposed to technical systems and file management techniques such as command line scripting, can communicate functional system requirements between groups with varying types of expertise, enjoys working with different types of data/collections, and loves solving problems.  The successful candidate will join the highly collaborative Digital Collections and Curation Services department (within the Digital Strategies and Technology Division) at DUL.

For a full job description please see https://library.duke.edu/about/jobs/digitalrepositorycontentanalyst. To apply, submit an electronic resume, cover letter, and list of 3 references: https://hr.duke.edu/careers/apply – refer to requisition #401537489. Review of applications will begin immediately and will continue until the position is filled.

Digital Collections Round Up 2018

It’s that item of year where we like to reflect on all we have done in 2018, and your favorite digital collections and curation services team is no exception.  This year, Digital Collections and Curation Services have been really focusing on getting collections and data into the Digital Repository and making it accessible to the world!

As you will see from the list below we launched 320 new digital collections, managed substantial additions to 2, and migrated 8. However, these publicly accessible digital collections are just the tip of the iceberg in terms of our work in Digital Collections and Curation Services.

A cover from the Ladyslipper, Inc Retail Catalogs digital collection.

So much more digitization happens behind the scenes than is reflected in the list of new digital collections.  Many of our larger projects are years in the making. For example, we continue to digitize Gedney photographs and we hope to make them publicly accessible next year.  There is also preservation digitization happening that we cannot make publicly accessible online.  This work is essential to our preservation mission, though we cannot share the collections widely in the short term.

We strongly believe in keeping our metadata healthy, so in addition to managing new metadata, we often revisit existing metadata across our repositories in order to ensure its overall quality and functionality.

Our team is also responsible for ingesting not just digital collections, but research data and library collections as well.  We preserved 20 datasets produced by the Duke Scholarly Community in the Research Data Repository (https://research.repository.duke.edu/)  via the Research Data Curation program https://library.duke.edu/data/data-management.

A selection from the Buffalo Bill papers, digitized as part of the Section A project.

New Digital Collections 2018

Additions to Existing Digital Collections

The men’s basketball team celebrates its 1991 championship win.

Collections Migrated into the Digital Repository

New Project Request Process

Last week, I presented our New Project Request Process at First Wednesday.  This request process is to help the Digital Strategies & Technology (DST) Leadership Team more effectively evaluate and prioritize projects that require ITS resources.  Over the summer, we developed and tested a two-stage workflow aimed to lower the barrier for library staff to submit project ideas and streamline the prioritization of projects into our three new project management streams: Library Systems, led by Karen Newbery; Web Experience, led by Tom Crichlow, and Application Development, led by Cory Lown, or into the existing Operations stream, led by John Pormann.

You can view the presentation here.  (My presentation begins at 35:45, but you should definitely watch Karen present on the Updated Request App and her trip to DKU.)

The quick summary notes of our process is this:

  • Project Summary is a short, one page summary of your project idea that includes 4 major elements:
    • Summary
    • Project Rationale
    • Goals
    • Stakeholders
  • The DST Leadership will evaluate Project Summaries within one month of submission and accept it, decline it, or request more information.
  • Accepted Project Summaries will be assigned a Project Lead, who will guide the Project Sponsor in writing the Project Charter.
  • Project Charter is an in-depth project plan that includes these elements:
    • Project Details:
      • Requirements – list of the high-level project requirements
      • Scope Statement – narrative description of the project scope
      • Deliverables – A deliverable is a unique and verifiable product, result or capability to perform a service that must be produced to complete a process, phase or project.
      • Estimated Schedule – focus on schedule and timeline, not specific dates
      • Completion Criteria – what must occur before project is considered complete
      • Goals – specific measurable objectives the project must achieve for completion
      • Dependencies – any outside factors, including people, data, and systems
      • Collaboration and communication strategy – frequency of meetings, project management tools used, plan to provide communication to those outside the project
    • Risks to Scope, Budget, Resources, Schedule, Technologies
    • Stakeholders – people outside of ITS (List of names and contact information)
    • Project Team – roles needed for team (Specific team members will be assigned, if project is approved and scheduled)
    • Budget – especially important for grant-based projects
  • The DST Leadership will review Project Charters within one month of submission.  Accepted project charters will be prioritized based on one or more of the following:
    • Portfolio Management review of resources by the Director, ITS
    • EG input for projects involving two or more divisions, or that impact campus users, or that impact a majority of DUL staff
    • Input of corresponding AUL, if competing projects require same team members of an previously approved project in queue
    • Input from DUL department or existing committee with governance oversight of a particular area, such as WebX or Digital Preservation and Production Program

We believe this process will enable us to plan projects more effectively with project sponsors and utilize the Libraries’ resources more efficiently.  We also believe this will improve communication with stakeholders and provide EG with better information to make priority decisions for projects that have benefit or impact to our staff and users.

You can download the Project Summary and Charter template here.  You can submit your Project Summary to dst-lt@win.duke.edu.

 

We are Hiring!

Duke University Libraries is recruiting a Digital Production Services Manager to direct the operations of our Digital Production Center, its staff (3 FTE plus student assistants), and associated digitization services. We are seeking someone experienced in leading digitization projects who is excited to partner with colleagues around the library to reformat and preserve unique library collections and provide access to them online. This is an excellent opportunity for someone who likes working with people, projects, and primary sources!

This newly created position combines people and project management responsibilities with hands-on digitization duties. Previous supervisory experience is not required; however, the ability to direct the work of others is essential to this position, as is a service oriented attitude. Strong organizational and project management skills are also a must. Some form of digitization experience in a library or other cultural heritage setting is required for this role as well. The successful candidate will join the highly collaborative Digital Collections and Curation Services department and work under the direct supervision of the department head.

The Digital Production Center (DPC) is a specialized unit that creates digital surrogates of primary resources from Duke University Libraries collections for the purposes of preservation and access. Learn more about the DPC on our web page, or through the Digital Strategies and Technology division’s blog, Bitstreams. To see some of the materials we have digitized, check out Duke Digital Collections online.

Duke is a diverse community committed to the principles of excellence, fairness, and respect for all people. As part of this commitment, we actively value diversity in our workplace and learning environments as we seek to take advantage of the rich backgrounds and abilities of everyone. We believe that when we understand, celebrate, and tap into our uniqueness to creatively solve problems and address shared goals, our possibilities are limitless. Duke University Libraries value diversity of thought, perspective, experience, and background and are actively committed to a culture of inclusion and respect.

Duke offers a comprehensive benefit package, which includes both traditional benefits such as health insurance, leave time and retirement, as well as wide ranging work/life and cultural benefits. Details can be found at: http://www.hr.duke.edu/benefits/index.php.

For a full job description please see https://library.duke.edu/about/jobs/dpsmanager. To apply, submit an electronic resume, cover letter, and list of 3 references: https://hr.duke.edu/careers/apply – refer to requisition #401463554. Review of applications will begin immediately and will continue until the position is filled.

New and Migrated Digital Collections Round up

We are halfway through 2018, and so it seems like a fitting time to share new and newly migrated digital collections.  

Digital Collections Launched or Migrated since January 1 2018:
These collections should be publicly accessible in late June or early July:

Looking ahead to the rest of the year, we will have more Radio Haiti recordings, 1990s issues of the Duke Chronicle, the Josephine Leary papers, more of your favorite legacy digital collections moving over to the digital repository and so much more! Stay tuned!

Announcing Multispectral Imaging Service, version 1

As regular Bitstreams readers know, a cross departmental team within Duke University Libraries has been exploring Multispectral Imaging and its potential to make Duke collections more accessible to researchers in the Duke scholarly community and beyond since 2015. After spending 2017 developing MSI workflows, building expertise, writing documentation, and responding to experimental imaging requests, we are now ready to unveil the first version of Duke University Libraries MSI service for researchers!

Our first service model version accommodates small requests that are not urgent. The MSI team wants to partner with researchers to facilitate their requests as well as hear feedback about our current service and any other needs for MSI. We are offering MSI services for free for the next few months, but will institute a fee structure this Summer.

The service breaks down into 4 general steps:

  • First, researchers submit a request for MSI services using a webform. The form prompts requesters to share their research question and details about what they want imaged. We also want to know where researchers are from, as we are expecting both Duke and non-Duke affiliated patrons.
  • Second, the MSI team will review all requests, as MSI is not the ideal imaging solution for all materials and research questions. Requests that will not benefit from MSI will not be approved.
  • Third, we schedule approved requests for imaging and processing. We plan to conduct 1 imaging and processing day per month, so it may take several weeks to a month for approved requests to make it though our full process.
  • Fourth, we deliver the processed files to our patrons along with a report that details the imaging and processing procedures and outcomes.

Please note the following:
We are currently only imaging Duke University Library holdings.
We are limiting requests to 1-3 individual items or 1-3 pages within a bound item (which is the number of items we can generally image and process in 1 day).
Allow 2-4 weeks for vetting and up to a month for imaging.

If you are interested in requesting MSI services, but your needs do not fit the service described here, we still want to hear from you! Please do not hesitate to fill out our researcher request form to get the process started, or contact Susan Ivey directly.

If you want to learn more about MSI, check out the recent talk we gave at the Friday Visualization Forum on February 23.

Interactive Transcripts have Arrived!

Interactive Transcripts have Arrived!

This week Duke Digital Collections added our first set of interactive transcripts to one of our newest digital collections: the Silent Vigil (1968) and Allen Building Takeover (1969) collection of audio recordings.   This marks an exciting milestone in the accessibility efforts Duke University Libraries has been engaged in for the past 2.5 years. Last October, my colleague Sean wrote about our new accessibility features and the technology powering them, and today I’m going to tell you a little more about why we started these efforts as well as share some examples.

Interactive Transcript in the Silent Vigil (1968) and Allen Building Takeover (1969) Audio Recordings

Providing access to captions and transcripts is not new for digital collections.  We have been able to provide access to pdf transcripts and caption both in digital collections and finding aids for years. See items from the Behind the Veil and Memory Project digital collections for examples.

In recent years however, we stepped our efforts in creating captions and transcripts. Our work began in response to a 2015 lawsuit brought against Harvard and MIT by the National Association of the Deaf. The lawsuit triggered many discussions in the library, and the Advisory Council for Digital Collections eventually decided that we would proactively create captions or transcripts for all new A/V digital collections assuming it is feasible and reasonable to do so.  The feasible and reasonable part of our policy is key.  The Radio Haiti collection for example is composed of thousands of recordings primarily in Haitian Creole and French.  The costs to transcribe that volume of material in non-English languages make it unreasonable (and not feasible) to transcribe. In addition to our work in the library, Duke has established campus wide web accessibility guidelines that includes captioning and  transcription.  Therefore our work in digital collections is only one aspect of campus wide accessibility efforts.

To create transcripts and captions, we have partnered with several vendors since 2015, and we have seen the costs for these services drop dramatically.  Our primary vendor right now is Rev, who also works with Duke’s Academic Media Services department.  Rev guarantees 99% accurate captions or transcripts for $1/minute.

Early on, Duke Digital Collections decided to center our captioning efforts around the WebVTT format, which is a time-coded text based file and a W3C standard.  We use it for both audio and video captions when possible, but we can also accommodate legacy transcript formats like pdfs.  Transcripts and captions can be easily replaced with new versions if and when edits need to be made.

Examples from the Silent Vigil (1968) and Allen Building Takeover (1969) Audio Recordings

When WebVTT captions are present, they load in the interface as an interactive transcript.  This transcript can be used for navigation purposes; click the text and the file moves to that portion of the recording.

Click the image above to see the full item and transcript.

In addition to providing access to transcripts on the screen, we offer downloadable versions of the WebVTT transcript as a text file, a pdf or in the original webVTT format.

An advantage of the WebVTT format is that it includes “v” tags, which can be used to note changes in speakers and one can even add names to the transcript.  This can require additional  manual work if the names of the speakers is not obvious to the vendor, but we are excited to have this opportunity.

As Sean described in his blog post, we can also provide access to legacy pdf documents.  They cannot be rendered into an interactive version, but they are still accessible for download.

On a related note, we also have a new feature that links time codes listed in the description metadata field of an item to the corresponding portion of the audio or video file.  This enables librarians to describe specific segments of audio and/or video items.  The Radio Haiti digital collection is the first to utilize this feature, but the feature will be a huge benefit to the H. Lee Waters and Chapel Recordings digital collections as well as many others.

Click the image above to interact with linked time codes.

As mentioned at the top of this post, the Duke Vigil and Allen Building Takeover collection includes our first batch of interactive transcripts.  We plan to launch more this Spring, so stay tuned!!

A Year in the Life of Digital Collections

2017 has been an action packed year for Digital Collections full of exciting projects, interface developments and new processes and procedures. This blog post is an attempt to summarize just a few of our favorite accomplishments from the last year. Digital Collections is truly a group cross-departmental collaboration here at Duke, and we couldn’t do complete any of the work listed below without all our colleagues across the library – thanks to all!

New Digital Collections Portal

Regular visitors to Duke Digital Collections may have noticed that our old portal (library.duke.edu/digitalcollections/) now redirects to our new homepage on the Duke Digital Repository (DDR) public interface. We are thrilled to make this change! But never fear, your favorite collections that have not been migrated to DDR are still accessible either on our Tripod2 interface or by visiting new placeholder landing pages in the Digital Repository.

Audiovisual Features

Supporting A/V materials in the Digital Repository has been a major software development priority throughout 2017. As a result our A/V items are becoming more accessible and easier to share. Thanks to a year of hard work we can now do and support the following (we posted examples of these on a previous post).

  • Model, store and stream A/V derivatives
  • Share A/V easily through our embed feature (even on Duke WordPress sites- a long standing bug)
  • Finding aids can now display inline AV for DAOs from DDR
  • Clickable timecode links in item descriptions (example)
  • Display captions and interactive transcripts
  • Download and Export captions and transcripts (as .pdf, .txt.,or .vtt)
  • Display Video thumbnails & poster frames

Rights Statements and Metadata

Bitstreams recently featured a review of all things metadata from 2017, many of which impact the digital collections program. We are especially pleased with our rights management work from the last year and our rights statements implementation (http://rightsstatements.org/en/). We are still in the process of retrospectively applying the statements, but we are making good progress. The end result will give our patrons a clearer indication of the copyright status of our digital objects and how they can be used. Read more about our rights management work in past Bitstreams posts.

Also this year in metadata, we have been developing integrations between ArchivesSpace (the tool Rubenstein Library uses for finding aids) and the repository (this is a project that has been in the works since 2015. With these new features Rubenstein’s archivist for metadata and encoding is in the process of reconciling metadata between ArchivesSpace and the Digital Repository for approximately 50 collections to enable bi-directional links between the two systems. Bi-directonal linking helps our patrons move easily from a digital object in the repository to its finding aid or catalog record and vice versa. You can read about the start of this work in a blog post from 2016.

MSI

At the end of 2016, Duke Libraries purchased Multispectral Imaging (MSI) equipment, and members of Digital Collections, Data and Visualization Studies, Conservation Services, the Duke Collaboratory for Classics Computing, and the Rubenstein Library joined forces to explore how to best use the technology to serve the Duke community. The past year has been a time of research, development, and exploration around MSI and you can read about our efforts on Bitstreams. Our plan is to launch an MSI service in 2018. Stay tuned!

Ingest into the Duke Digital Repository (DDR)

With the addition of new colleagues focussed on research data management, there have been more demands on and enhancements to our DDR ingest tools. Digital collections has benefited from more robust batch ingest features as well as the ability to upload more types of files (captions, transcripts, derivatives, thumbnails) through the user interface. We can also now ingest nested folders of collections. On the opposite side of the spectrum we now have the ability to batch export sets of files or even whole collections.

Project Management

The Digital Collections Advisory Committee and Implementation Team are always looking for more efficient ways to manage our sprawling portfolio of projects and services. We started 2017 with a new call for proposals around the themes of diversity and inclusion, which resulted in 7 successful proposals that are now in the process of implementation.

In addition to a thematic call for proposals, we later rolled out a new process for our colleagues to propose smaller projects in response to faculty requests, events or for other reasons. In other words, projects of a certain size and scope that were not required to respond to a thematic call for proposals. The idea being that these projects can be easily implemented, and therefore do not require extensive project management to complete. Our first completed “easy” project is the Carlo Naya photograph albums of Venice.

In 2016 (perhaps even back in 2015), the digital collections team started working with colleagues in Rubenstein to digitize the set of collections known in as “Section A”. The history of this moniker is a little uncertain, so let me just say that Section A is a set of 3000+ small manuscript collections (1-2 folders each) boxed together; each Section A box holds up to 30 collections. Section A collections are highly used and are often the subject of reproduction requests, hence they are perfect candidates for digitization. Our goal has been to set up a mass-digitization pipeline for these collections, that involves vetting rights, updating description, evaluating their condition, digitizing them, ingesting them into DDR, crosswalking metadata and finally making them publicly accessible in the repository and through their finding aids. In 2017 we evaluated 37 boxes for rights restrictions, updated descriptions for 24 boxes, assessed the condition of 31 boxes, digitized 19 boxes, ingested 4 boxes, crosswalked metadata for 2 boxes and box 1 is now online! Read more about the project in a May Bitstreams post. Although progress has felt slow given all the other projects we manage simultaneously, we really feel like our foot is on the gas now!

You can see the fruits of our digital collection labors in the list of new and migrated collections from the past year. We are excited to see what 2018 will bring!!

New Collections Launched in 2017

Migrated Collections