Uploaded image for project: 'DSpace'
  1. DSpace
  2. DS-2488

Statistics Sharding cannot recover from error

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Volunteer Needed (View Workflow)
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 3.1, 4.2, 5.0, 5.1
    • Fix Version/s: None
    • Component/s: Solr
    • Labels:
      None
    • Attachments:
      0
    • Comments:
      1
    • Documentation Status:
      Needed

      Description

      When attempting to run the command, it creates an initial solr core and then fails. The process cannot be restarted due to the existence of that solr core.

      Based on my experience, I would not recommend this command to folks with older records in their statistics core.

      Error (DSpace 4.2)
      ------------------------
      Moving: 317727 into core statistics-2010
      Exception: Document is missing mandatory uniqueKey field: uid
      org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Document is missing mandatory uniqueKey field: uid
      at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
      at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
      at org.dspace.statistics.SolrLogger.shardSolrIndex(SolrLogger.java:1345)
      at org.dspace.statistics.util.StatisticsClient.main(StatisticsClient.java:101)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:225)
      at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:77)

      Error (DSpace 3.x)
      ---------------------
      [dspace@dspace-aux-1 ~]$ /opt/dspace/bin/dspace stats-util -s
      INFO [main] (DSpaceKernelInit.java:52) - Created new kernel: DSpaceKernel:org.dspace:name=0f8afeda-81b7-4bd1-80d3-d73a7f686f32,type=DSpaceKernel:lastLoad=null:loadTime=0:running=false:kernel=null
      INFO [main] (ConfigurationManager.java:1217) - Loading from classloader: file:/opt/dspace/config/dspace.cfg
      INFO [main] (ConfigurationManager.java:1217) - Using dspace provided log configuration (log.init.config)
      INFO [main] (ConfigurationManager.java:1217) - Loading: /opt/dspace/config/log4j.properties
      Exception: org.apache.solr.client.solrj.response.QueryResponse.getFacetRanges()Ljava/util/List;
      java.lang.NoSuchMethodError: org.apache.solr.client.solrj.response.QueryResponse.getFacetRanges()Ljava/util/List;
      at org.dspace.statistics.SolrLogger.shardSolrIndex(SolrLogger.java:1184)
      at org.dspace.statistics.util.StatisticsClient.main(StatisticsClient.java:101)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:183)

      Error when attempting to re-run the command
      ----------------------------------------------------------
      Exception: Error CREATEing SolrCore 'statistics-2010': Core with name 'statistics-2010' already exists.
      org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Error CREATEing SolrCore 'statistics-2010': Core with name 'statistics-2010' already exists.
      at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:424)
      at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
      at org.apache.solr.client.solrj.request.CoreAdminRequest.process(CoreAdminRequest.java:462)
      at org.dspace.statistics.SolrLogger.createCore(SolrLogger.java:1370)
      at org.dspace.statistics.SolrLogger.shardSolrIndex(SolrLogger.java:1318)
      at org.dspace.statistics.util.StatisticsClient.main(StatisticsClient.java:101)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:606)
      at org.dspace.app.launcher.ScriptLauncher.runOneCommand(ScriptLauncher.java:225)
      at org.dspace.app.launcher.ScriptLauncher.main(ScriptLauncher.java:77)

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned
              Reporter:
              terrywbrady Terrence W Brady
              Votes:
              1 Vote for this issue
              Watchers:
              1 Start watching this issue

                Dates

                Created:
                Updated: