Uploaded image for project: 'DSpace'
  1. DSpace
  2. DS-2438

OAI indexing fails if a metadata field contains a value with more than 32766 Bytes

    XMLWordPrintable

    Details

    • Attachments:
      0
    • Comments:
      2
    • Documentation Status:
      Not Required

      Description

      Lucene changed the behaviour how it handles a immense term exception (https://issues.apache.org/jira/browse/LUCENE-5710). This leads to the termination of the indexing for the oai interface (like dspace oai index) if there is a metadata field with a realy long text value (exceeding 32766 Bytes)

      $ /dspace/bin/dspace oai import -c
      OAI 2.0 manager action started
      Clearing index
      Index cleared
      Using full import.
      Full import
      org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Exception writing document id 123456789/5 to the index; possible analysis error.
      at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:552)
      at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
      at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
      at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)
      at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
      at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
      at org.dspace.xoai.app.XOAI.index(XOAI.java:211)
      at org.dspace.xoai.app.XOAI.indexAll(XOAI.java:198)
      at org.dspace.xoai.app.XOAI.index(XOAI.java:131)
      at org.dspace.xoai.app.XOAI.main(XOAI.java:405)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:225)
      at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:77)

        Attachments

          Activity

            People

            Assignee:
            helix84 Ivan Masár
            Reporter:
            christian.scheible Christian Scheible
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Zendesk Support