Uploaded image for project: 'Search and Discovery'
  1. Search and Discovery
  2. SEARCH-2129

AclTracker is indexing ACLs more than one time

    Details

    • Type: Bug
    • Status: Done
    • Resolution: Done
    • Affects Version/s: Search Services 1.4
    • Fix Version/s: Search Services 2.0
    • Labels:
      None
    • Bug Priority:
      Category 2
    • Sprint:
      Team Ninja-King - S&I 24, Team Ninja-King - S&I 25, Team Ninja-King - S&I 26, Team Ninja-King - S&I 27, Team Ninja-King - S&I 28
    • Delivery Team:
      Search
    • Story Points:
      8
    • Release Train:
      Ealing Broadway

      Description

      When adding more detailed logs for SEARCH-2097, following behaviour has been exposed:

      • AclTracker gets all ACL Change Sets from database
      • An asynchronous job is launched in order to index all the ACLs contained
      • If this asynchronous job doesn't finish before AclTracker is being executed again (by default 5 seconds), a new asynchronous job with the same ACLs is fired
      • Only when the first asynchronous job finishes, AclTracker lastTransactionCommitTime is updated and no more asynchronous jobs are fired

      The greater the ACL list is, the more asynchronous jobs are fired, as it takes longer to finish.

      Additionally, every time AclTracker starts, the tracker verifies that the latest ACL Change Set is present in the SOLR Core. That can be also expensive when last ACL Change Set is large enough.

      Acceptance Criteria

      • The same ACLs and Nodes are not indexed twice (as seen with AsyncWorkers current approach)
      • Once everything is indexed, no transactions or ACLs are recovered from repository when checking new content to be indexed

        Attachments

        1. acl-tracking-process.png
          acl-tracking-process.png
          63 kB
        2. solr_acltracker.png
          solr_acltracker.png
          74 kB
        3. solr-async-performance.png
          solr-async-performance.png
          110 kB
        4. solr-load-data.png
          solr-load-data.png
          126 kB
        5. solr-sync-performance.png
          solr-sync-performance.png
          106 kB
        6. worker-comparison.png
          worker-comparison.png
          108 kB

          Issue Links

            Structure

              Activity

                People

                • Assignee:
                  Unassigned
                  Reporter:
                  aborroy Angel Borroy
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  4 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Structure Helper Panel