{"id":201,"date":"2007-11-28T16:05:32","date_gmt":"2007-11-28T20:05:32","guid":{"rendered":"http:\/\/library.duke.edu\/blogs\/scholcomm\/2007\/11\/28\/journal-value\/"},"modified":"2011-03-23T18:35:00","modified_gmt":"2011-03-23T18:35:00","slug":"journal-value","status":"publish","type":"post","link":"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/","title":{"rendered":"What makes a journal valuable?"},"content":{"rendered":"

For almost 90 years, librarians, faculty authors, tenure review committees and publishers themselves have relied on a single measure \u2013 the impact factor \u2013 to determine the relative quality of different scholarly journals. <\/span>Impact factors are based on the number of times articles from a particular journal are cited in other scholarly articles. <\/span>The citations to articles in one journal are cumulated to calculate the impact factor. <\/span>It is fairly obvious that this system has some problems, however. <\/span>For one thing, frequency of citation is a poor marker for quality, since all cited references to a work may not be positive and approving. <\/span>To posit an extreme example, many articles that cite one specific article as a particularly bad example will boost the citation rate for that article and could raise the impact factor of the journal that published the flawed study. <\/span>Also, journals are not all of equal quality or influence (which is the point, after all), so many citation from peripheral journals may not be as important as one or two citations in the really influential and universally-read publications. <\/span>Impact factor can flatten these distinctions in regard to a single article, although cumulation over time should cause the \u201cbest\u201d journals to rise to the top. <\/span><\/p>\n

A new measure of journal quality, called the Eigenfactor<\/a>, tries to address this last problem by starting with an evaluation of journal quality and assessing article impact on that basis. <\/span>As their explanation of their methods<\/a> says,<\/p>\n

\u201cEigenfactor provides a measure of the total influence that a journal
\nprovides, rather than a measure of influence per article\u2026 To make our
\nresults comparable to impact factor, we need to divide the journal
\ninfluence by the number of articles published.\u201d\n<\/p>\n

Leaving aside the complex mathematics explained at their site, the Eigenfactor is based on an algorithm that maps how a hypothetical researcher would move from article to article based on cited references. <\/span>This mapping yields a measure of the amount of time that researcher would spend with each particular journal. <\/span>The score of a journal is based on that finding, and the influence of articles is measured by the influence of the journal in which they are published. <\/span>This method corrects for peripheral citations and, it is claimed, for different citation patterns in different disciplines.<\/p>\n

Both of these methods, however, measure the quality of journals only from within the relatively closed world of traditional periodical publication. <\/span>Can we imagine ways of assess journal quality that can account for external factors and hence for the changes that are occurring within scholarship?<\/p>\n

The advent of online aggregators of journal content has offered one relatively simple external measurement of journal impact which librarians have been quick to embrace \u2013 cost per article download. <\/span>It used to be very cumbersome to try and tally which print journals were most used in a library, based on how often copies were picked up and reshelved. <\/span>Now databases offer constantly updated counts of downloads which are easily divided into the cost of the database to provide a measure of where collections budgets are best spent. <\/span>Since many downloads will reduce the cost per download, this metric also can serve as a rough indication of quality, or, at least, influence.<\/p>\n

The real question I have, however, is how to assess the importance of traditional journal publication vis-\u00e0-vis newer, informal means of communication that are growing in importance amongst scholars. <\/span>As blogs, wikis and exchanges of working papers via e-mail grow, scholars are getting their inputs and influences from new sources, and web publication of various kinds often supplements, and occasionally supplants, tradition publication. <\/span>As the ACRL\u2019s recent paper on \u201cEstablishing a Research Agenda for Scholarly Communications<\/a>\u201d puts it,<\/p>\n

<\/span> \u201cExtant measures may suffer from being tightly coupled to traditional
\nprocesses while also inhibiting the application of other measures of
\nvalue. In the new digital environment, activities other than traditional
\nor formal publication should be valued in the reward structure for scholarship.\u201d\n<\/p>\n

I know of no metric that can yet account for the variety of informal publications and their relative influence. <\/span>That, of course, is why it is part of a research agenda. <\/span>As these informal, digital means of sharing scholarly work become more common, one of the principle functions of traditional publication \u2013 that of communicating the finished products of research \u2013 may become less and less important. <\/span>Other functions, such as registration, certification and preservation, may continue to rely on traditional journals for a longer time. <\/span>But the academic world needs to look carefully for ways to evaluate and compare the influence of a variety of new communications if it is to value scholarship based on its true impact.<\/p>\n","protected":false},"excerpt":{"rendered":"

For almost 90 years, librarians, faculty authors, tenure review committees and publishers themselves have relied on a single measure \u2013 the impact factor \u2013 to determine the relative quality of different scholarly journals. Impact factors are based on the number of times articles from a particular journal are cited in other scholarly articles. The citations … Continue reading What makes a journal valuable?<\/span> →<\/span><\/a><\/p>\n","protected":false},"author":122,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[36],"tags":[],"class_list":["post-201","post","type-post","status-publish","format-standard","hentry","category-scholarly-publishing"],"yoast_head":"\nWhat makes a journal valuable? - Scholarly Communications @ Duke<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What makes a journal valuable? - Scholarly Communications @ Duke\" \/>\n<meta property=\"og:description\" content=\"For almost 90 years, librarians, faculty authors, tenure review committees and publishers themselves have relied on a single measure \u2013 the impact factor \u2013 to determine the relative quality of different scholarly journals. Impact factors are based on the number of times articles from a particular journal are cited in other scholarly articles. The citations … Continue reading What makes a journal valuable? →\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/\" \/>\n<meta property=\"og:site_name\" content=\"Scholarly Communications @ Duke\" \/>\n<meta property=\"article:published_time\" content=\"2007-11-28T20:05:32+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2011-03-23T18:35:00+00:00\" \/>\n<meta name=\"author\" content=\"Kevin Smith, J.D.\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@klsmith4906\" \/>\n<meta name=\"twitter:site\" content=\"@klsmith4906\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kevin Smith, J.D.\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/\"},\"author\":{\"name\":\"Kevin Smith, J.D.\",\"@id\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/#\/schema\/person\/efc9b8deb1a1e82626f11fd55a3ea759\"},\"headline\":\"What makes a journal valuable?\",\"datePublished\":\"2007-11-28T20:05:32+00:00\",\"dateModified\":\"2011-03-23T18:35:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/\"},\"wordCount\":777,\"commentCount\":2,\"articleSection\":[\"Scholarly Publishing\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/\",\"url\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/\",\"name\":\"What makes a journal valuable? - Scholarly Communications @ Duke\",\"isPartOf\":{\"@id\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/#website\"},\"datePublished\":\"2007-11-28T20:05:32+00:00\",\"dateModified\":\"2011-03-23T18:35:00+00:00\",\"author\":{\"@id\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/#\/schema\/person\/efc9b8deb1a1e82626f11fd55a3ea759\"},\"breadcrumb\":{\"@id\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"What makes a journal valuable?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/#website\",\"url\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/\",\"name\":\"Scholarly Communications @ Duke\",\"description\":\"Discussions about the changing world of scholarly communications and copyright\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/#\/schema\/person\/efc9b8deb1a1e82626f11fd55a3ea759\",\"name\":\"Kevin Smith, J.D.\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e621549dfd2ef4eccb0dfbe0c710482c7829676bf7bbe97134fd95e1d5ebd8e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e621549dfd2ef4eccb0dfbe0c710482c7829676bf7bbe97134fd95e1d5ebd8e?s=96&d=mm&r=g\",\"caption\":\"Kevin Smith, J.D.\"},\"url\":\"https:\/\/blogs.library.duke.edu\/scholcomm\/author\/ksmithl2duke-edu\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What makes a journal valuable? - Scholarly Communications @ Duke","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/","og_locale":"en_US","og_type":"article","og_title":"What makes a journal valuable? - Scholarly Communications @ Duke","og_description":"For almost 90 years, librarians, faculty authors, tenure review committees and publishers themselves have relied on a single measure \u2013 the impact factor \u2013 to determine the relative quality of different scholarly journals. Impact factors are based on the number of times articles from a particular journal are cited in other scholarly articles. The citations … Continue reading What makes a journal valuable? →","og_url":"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/","og_site_name":"Scholarly Communications @ Duke","article_published_time":"2007-11-28T20:05:32+00:00","article_modified_time":"2011-03-23T18:35:00+00:00","author":"Kevin Smith, J.D.","twitter_card":"summary_large_image","twitter_creator":"@klsmith4906","twitter_site":"@klsmith4906","twitter_misc":{"Written by":"Kevin Smith, J.D.","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/#article","isPartOf":{"@id":"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/"},"author":{"name":"Kevin Smith, J.D.","@id":"https:\/\/blogs.library.duke.edu\/scholcomm\/#\/schema\/person\/efc9b8deb1a1e82626f11fd55a3ea759"},"headline":"What makes a journal valuable?","datePublished":"2007-11-28T20:05:32+00:00","dateModified":"2011-03-23T18:35:00+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/"},"wordCount":777,"commentCount":2,"articleSection":["Scholarly Publishing"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/","url":"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/","name":"What makes a journal valuable? - Scholarly Communications @ Duke","isPartOf":{"@id":"https:\/\/blogs.library.duke.edu\/scholcomm\/#website"},"datePublished":"2007-11-28T20:05:32+00:00","dateModified":"2011-03-23T18:35:00+00:00","author":{"@id":"https:\/\/blogs.library.duke.edu\/scholcomm\/#\/schema\/person\/efc9b8deb1a1e82626f11fd55a3ea759"},"breadcrumb":{"@id":"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.library.duke.edu\/scholcomm\/2007\/11\/28\/journal-value\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.library.duke.edu\/scholcomm\/"},{"@type":"ListItem","position":2,"name":"What makes a journal valuable?"}]},{"@type":"WebSite","@id":"https:\/\/blogs.library.duke.edu\/scholcomm\/#website","url":"https:\/\/blogs.library.duke.edu\/scholcomm\/","name":"Scholarly Communications @ Duke","description":"Discussions about the changing world of scholarly communications and copyright","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.library.duke.edu\/scholcomm\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/blogs.library.duke.edu\/scholcomm\/#\/schema\/person\/efc9b8deb1a1e82626f11fd55a3ea759","name":"Kevin Smith, J.D.","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.library.duke.edu\/scholcomm\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e621549dfd2ef4eccb0dfbe0c710482c7829676bf7bbe97134fd95e1d5ebd8e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e621549dfd2ef4eccb0dfbe0c710482c7829676bf7bbe97134fd95e1d5ebd8e?s=96&d=mm&r=g","caption":"Kevin Smith, J.D."},"url":"https:\/\/blogs.library.duke.edu\/scholcomm\/author\/ksmithl2duke-edu\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.library.duke.edu\/scholcomm\/wp-json\/wp\/v2\/posts\/201","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.library.duke.edu\/scholcomm\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.library.duke.edu\/scholcomm\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.library.duke.edu\/scholcomm\/wp-json\/wp\/v2\/users\/122"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.library.duke.edu\/scholcomm\/wp-json\/wp\/v2\/comments?post=201"}],"version-history":[{"count":3,"href":"https:\/\/blogs.library.duke.edu\/scholcomm\/wp-json\/wp\/v2\/posts\/201\/revisions"}],"predecessor-version":[{"id":10293,"href":"https:\/\/blogs.library.duke.edu\/scholcomm\/wp-json\/wp\/v2\/posts\/201\/revisions\/10293"}],"wp:attachment":[{"href":"https:\/\/blogs.library.duke.edu\/scholcomm\/wp-json\/wp\/v2\/media?parent=201"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.library.duke.edu\/scholcomm\/wp-json\/wp\/v2\/categories?post=201"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.library.duke.edu\/scholcomm\/wp-json\/wp\/v2\/tags?post=201"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}