Uploaded image for project: 'DSpace'
  1. DSpace
  2. DS-459

OAI PMH is not delivering continuation tokens

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.6.0
    • Component/s: None
    • Labels:
      None
    • Attachments:
      0
    • Comments:
      3
    • Documentation Status:
      Needed

      Description

      Walker, David <dwalker@calstate.edu> Thu, Jan 7, 2010 at 7:36 AM
      To: "dspace-tech@lists.sourceforge.net" <dspace-tech@lists.sourceforge.net>
      Hi all,

      I'm trying to harvest our DSpace repos using the PKP OAI Harvester.

      The problem I face right now is that the Harvester is only pulling back just the first batch of records, instead of all records in the repo. I see this with all of our repos with more than 100 records.

      Just looking at the ListRecord response myself, I don't see a resumption token, which would explain the behavior of the harvester stopping with this first batch:

      http://sjsu-dspace.calstate.edu/oai/request?verb=ListRecords&metadataPrefix=oai_dc

      George Kozak at Cornell reported a similar problem back in October, but not sure if he or someone else was able to resolve the problem:

      http://old.nabble.com/OAI-Harvesting-problem-to25872830.html#a25887911

      I'm new to harvesting, so I may have missed something obvious.

      --Dave

      ==================
      David Walker
      Library Web Services Manager
      California State University
      http://xerxes.calstate.edu
      ------------------------------------------------------------------------------
      This SF.Net email is sponsored by the Verizon Developer Community
      Take advantage of Verizon's best-in-class app development support
      A streamlined, 14 day to market process makes app distribution fast and easy
      Join now and get one step closer to millions of Verizon customers
      http://p.sf.net/sfu/verizon-dev2dev
      _______________________________________________
      DSpace-tech mailing list
      DSpace-tech@lists.sourceforge.net
      https://lists.sourceforge.net/lists/listinfo/dspace-tech
      George Stanley Kozak <gsk5@cornell.edu> Thu, Jan 7, 2010 at 7:46 AM
      To: "Walker, David" <dwalker@calstate.edu>, "dspace-tech@lists.sourceforge.net" <dspace-tech@lists.sourceforge.net>
      David:

      Yes, I did fix my problem. Stuart Lewis from the Auckland Library told me that my problem was caused by the 'harvest.includerestricted.oai = false' option in the dspace.cfg file. I guess there's a bug in 1.5.2 that's fixed in 1.6. All I did was comment out the line and the harvesting now works fine.

      George Kozak
      Digital Library Specialist
      Division of Library Information Technologies (DLIT)
      501 Olin Library
      Cornell University
      Ithaca, NY 14853
      607-255-8924
      [Quoted text hidden]
      Walker, David <dwalker@calstate.edu> Thu, Jan 7, 2010 at 10:18 AM
      To: George Stanley Kozak <gsk5@cornell.edu>, "dspace-tech@lists.sourceforge.net" <dspace-tech@lists.sourceforge.net>
      That appears to have done the trick. Thanks, George.

      --Dave
      ==================
      David Walker
      Library Web Services Manager
      California State University
      http://xerxes.calstate.edu
      ________________________________________
      From: George Stanley Kozak [gsk5@cornell.edu]
      Sent: Thursday, January 07, 2010 7:46 AM
      To: Walker, David; dspace-tech@lists.sourceforge.net
      Subject: RE: No resumption token?
      [Quoted text hidden]
      Mark Diggory <mdiggory@atmire.com> Thu, Jan 7, 2010 at 11:16 AM
      To: "Walker, David" <dwalker@calstate.edu>
      Cc: "dspace-tech@lists.sourceforge.net" <dspace-tech@lists.sourceforge.net>
      David,

      I encountered the same issue when testing the TAMU Harvester against
      several DSpace instances... That would pose a some fairly strong
      evidence that there is a problem.

      Mark

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned
              Reporter:
              mdiggory Mark Diggory
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: