Uploaded image for project: 'Alfresco One Platform'
  1. Alfresco One Platform
  2. ACE-5746

Benchmark tests (Share and PublicAPI) need to be fixed

    Details

      Description

      Steps
      1. Executed the BM0013-Share tests and BM0012-PublicAPI tests on Alfresco 5.2.0
      2. Verify that the Benchmark projects don't have test suites with 100% fail rate

      Expected
      No Benchmark tests suites have 100% fail rate - the tests work correctly

      Actual
      Both Benchmark projects have test suites with 100% fail rate:
      BM0013 – Share tests
      Number of test suites included:

      • 5.1.2 – 15 test suites
      • 5.2.0 – 9 test suites (with 6 tests (40%) less test suites than 5.1.2)

      Number of test suites with all executions failed:

      • 5.1.2 – 1 test suite (share.nav.people)
      • 5.2.0 – 2 test suites (share.nav.people, share.site.create)

      No major performance decrease is visible on 5.2.0 result comparing the results with the 5.1.2. The 5.2.0 overall time responses results are better or around the same values as the ones from 5.1.2.

      BM0012 – PublicAPI tests
      Number of test suites included:

      • 5.1.2 – 31 test suites
      • 5.2.0 – 23 test suites (with 8 tests (26%) less test suites than 5.1.2)

      Number of test suites with all execution failed:

      • 5.1.2 – 0
      • 5.2.0 – 2 test suites (publicapi.getSites, publicapi.getPerson)

      The 5.2.0 overall time responses results are better or around the same values as the ones from 5.1.2.

        Attachments

        1. BM0012 512 .xlsx
          329 kB
        2. BM0012 520.xlsx
          254 kB
        3. BM0013 512.xlsx
          336 kB
        4. BM0013 520.xlsx
          201 kB

          Structure

            Activity

              People

              • Assignee:
                fbecker Frank Becker [X] (Inactive)
                Reporter:
                mmurarasu Marius Murarasu [X] (Inactive)
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Structure Helper Panel