Uploaded image for project: 'Fedora Repository Project'
  1. Fedora Repository Project
  2. FCREPO-1156

Performance degradation when adding a lot of datastreams

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Won't Fix
    • Affects Version/s: Fedora 3.6
    • Fix Version/s: Fedora 3.7
    • Component/s: legacy - Fedora
    • Labels:
      None
    • Environment:
      Linux 3.5.3-1-ARCH #1 SMP PREEMPT Sun Aug 26 09:14:51 CEST 2012 x86_64 GNU/Linux
      Java(TM) SE Runtime Environment (build 1.7.0_02-b13)
      Java HotSpot(TM) 64-Bit Server VM (build 22.0-b10, mixed mode)

      Description

      When adding a lot of manages datastreams to an object the ingestion throughput performance degrades in a linear fashion.
      When e.g. ingesting 1000 managed datastreams with 500KB each the time needed for adding the datastream for the first is ~20ms and this degrades to ~130ms on a local installation.
      I created a git hub project to reproduce this, which can be found here:
      https://github.com/fasseg/fcrepo-test-ingester.git
      which can be run as described in the README to reproduce this issue.

        Attachments

        1. ingest_no_audit.gif
          ingest_no_audit.gif
          13 kB
        2. managed_audit_xstream_attributes.gif
          managed_audit_xstream_attributes.gif
          10 kB
        3. managed_audit_xstream_plain.gif
          managed_audit_xstream_plain.gif
          10 kB
        4. non_versionable_patchedDateTimeUtiliy.gif
          non_versionable_patchedDateTimeUtiliy.gif
          22 kB
        5. non_versionable.gif
          non_versionable.gif
          20 kB
        6. result_ingest.png
          result_ingest.png
          10 kB
        7. result_update.png
          result_update.png
          12 kB
        8. versionable.gif
          versionable.gif
          18 kB

          Issue Links

            Activity

              People

              Assignee:
              fas frank asseg
              Reporter:
              fas frank asseg
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: