Remove CDO data layer completely from Snow Owl #257

cmark · 2018-08-13T08:59:18Z

The following changes have been applied to Snow Owl in order to support CDO features (like ORM, transactions, merging, conflict processing, etc.) via the ES based index module.

Removed all CDO, DB modules and all APIs that have been developed on top of them
Refactored how index.api module manages/searches/etc. revisions in a given repository (introduced RevisionBranchRef, RevisionBranchPoint, RevisionBranchSegment classes).
Developed a new commit API, the StagingArea (instead of directly writing revisions using the RevisionWriter interface) to provide similar functionality compared to the CDOEditingContext, CDOTransaction, CDOSavePoint APIs.
Added support for pre and post-commit hooks that pre and post process the contents of the StagingArea before and after commits.
Removed all EMF Ecore models and much of the infrastructure around them
Request APIs now use the domain and index document models to commit new/changed/deleted revisions to the underlying repository index.
Replaced the old commit history infrastructure with a brand new one that manages committed changes during StagingArea.commit and can be accessed via a dedicated API
The compare, merge and conflict processing APIs have been rewritten from the ground up on top of the new revision commit changeset API to support much of the infrastructure that existed in the CDO alternatives
Completely rewrote how Snow Owl manages/detects plug-ins (auto-detection via classpath scanning) to support simplified, easily understandable plug-in development flow
Refactored and improved Snow Owl CLI using the awesome picocli library
Deprecated and removed the current RF2 importer with a previously developed improved version

Remove BranchPointUtils.

Remove ObjectLockManager. Remove CodeSystemBuilder and CodeSystemVersionBuilder.

...in OSGi commands

Migrate repository initialization (WIP).

Remove unnecessary DocSearcher and DocWriter interfaces.

Remove SNOMED CT lookup services.

Remove jackson jaxrs and scala dependencies.

Refactor SnomedComponentReferencingDetachedConceptRule and add more entity properties to check for detached components during merge.

...on SNOMED CT component APIs Remove ISnomedComponentMixin add annotations directly to the domain classes.

...SnomedDescriptionAcceptabilityUpdateRequest, SnomedInactivationReasonUpdateRequest, SnomedAssociationTargetUpdateRequest.

...and ICDORepositoryManager

Add MessagingRequests. Add SendMessageRequest and Builder. Use new API from REST and CLI. Remove old IMessagingService and Impl.

...is annotated with Component and not the subclass.

Migrate commands from the old framework to the new: * BranchesCommand * RepositoriesCommand * SendMessageCommand * CodeSystemsCommand

…rclass..." This reverts commit 0581965.

Conflicts: snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/core/store/SnomedMemberBuilder.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/SnomedRf2ImportRequest.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2AssociationRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2AttributeValueRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2ComplexMapRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2DescriptionTypeRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2EffectiveTimeSlice.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2ExtendedMapRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2LanguageRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2MRCMAttributeDomainRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2MRCMAttributeRangeRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2MRCMDomainRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2MRCMModuleScopeRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2ModuleDependencyRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2OwlExpressionRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2SimpleMapRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2SimpleMapWithDescriptionContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2SimpleRefSetContentType.java snomed/com.b2international.snowowl.snomed.datastore/src/com/b2international/snowowl/snomed/datastore/request/rf2/importer/Rf2TransactionContext.java

Fix incorrect update of documents in SnomedVersioningRequest (note: always use the fully loaded document for an update, otherwise you lose a bunch of derived values).

cmark added 30 commits June 21, 2018 16:53

SO-3109: remove SNOMED CT ecore models 🙉

53d2092

SO-3109: remove CDO from BranchPathUtils

5d8be03

Remove BranchPointUtils.

SO-3109: temporarily fix compile errors in snowowl.core

6e189b5

SO-3109: remove CodeSystem ecore model 🙊

b1e69ab

SO-3109: remove SnomedListFeaturesTests

011c8fd

SO-3109: remove CDO Branch check from BranchRequest

68dad1b

SO-3109: remove various CDO based utility classes

c499eba

Remove ObjectLockManager. Remove CodeSystemBuilder and CodeSystemVersionBuilder.

SO-3109: removing CDO based repository and related classes

40ccce9

SO-3109: add userId field and parameter to import/export requests

26c7f84

SO-3109: use RepositoryManager instead of CDORepositoryManager...

299670e

...in OSGi commands

SO-3109: remove traceability services

99f5886

SO-3109: remove history services

82c0d4c

SO-3109: remove NsUriProvider

8b1f63d

SO-3109: remove CDOConnection, Factory and ext. point

c5f41a0

SO-3109: commit progress on committing directly form TransactionContext

33d052b

SO-3109: migrate initialization of Net4j and other services (WIP)

7160b79

Migrate repository initialization (WIP).

SO-3109: pull up multiget from RevisionSearcher

6b6310a

Remove unnecessary DocSearcher and DocWriter interfaces.

SO-3109: remove ILookupService interface

597de2c

Remove SNOMED CT lookup services.

SO-3109: remove CDOEditingContext and Factory and FactoryProvicer types

4e60fb3

SO-3109: migrate tx logic from CDOEditingContext to TransactionContext

7ef04eb

SO-3109: remove CodeSystemComponentTypeNotFoundException

7fc0ccf

SO-3109: update CodeSystem and Version entries and requests

a702462

SO-3109: remove even more unused classes

2a923ee

SO-3109: fix RemoteJobTracker and ValidationRepository

4896d01

SO-3109: remove editingContextFactory ext.point

7dd529e

SO-3109: migrate commit notification support

9a6022f

SO-3109: remove filtered CDO exception logging

e3f1cb7

SO-3109: remove unnecessary code from CDOConnectionManager

a3b57ac

SO-3109: remove ICDOChangeProcessor and ext.point

4c39b1b

SO-3109: support repository hooks (pre/post-commit)

66d1236

cmark and others added 27 commits August 10, 2018 18:01

SO-3109: support branch change listeners in BaseRevisionBranching

54ad7db

SO-3109: remove mysql connector library

f79643e

Remove jackson jaxrs and scala dependencies.

SO-3109: remove h2 database library

4e94e53

SO-3109: refactor StagingArea.merge

6528d40

SO-3109: refactor merge conflict reporting

c83d4b9

SO-3109: fix index launch config

f39b69d

SO-3109: fix almost all merge conflict tests cases

aeca2d5

SO-3109: remove no longer valid test cases from SnomedMergeConflictTest

7c152c5

Refactor SnomedComponentReferencingDetachedConceptRule and add more entity properties to check for detached components during merge.

SO-3109: fix serialization/deserialization of effectiveTime properties..

7226793

...on SNOMED CT component APIs Remove ISnomedComponentMixin add annotations directly to the domain classes.

SO-3109: fix unnecessary 2.3.3 restassured jar from test.deps

d66732d

SO-3109: fix equals check bug in SnomedRefSetMemberUpdateRequest

88242e0

SO-3109: fix updateEffectiveTime method implementations bugs in...

6f481c6

...SnomedDescriptionAcceptabilityUpdateRequest, SnomedInactivationReasonUpdateRequest, SnomedAssociationTargetUpdateRequest.

[import] Implement global validator for terminology components

3309adf

SO-3109: merge two component change compare detail into a single one

3a5ceac

SO-3109: remove SnomedClientProtocol, DatabaseConfiguration...

b7980e6

...and ICDORepositoryManager

SO-3109: introduce Messaging API

3fe2703

Add MessagingRequests. Add SendMessageRequest and Builder. Use new API from REST and CLI. Remove old IMessagingService and Impl.

SO-3109: support classpath scanning of classes where the superclass...

0581965

...is annotated with Component and not the subclass.

SO-3109: use picocli cli library for snowowl shell commands

25b4559

Migrate commands from the old framework to the new: * BranchesCommand * RepositoriesCommand * SendMessageCommand * CodeSystemsCommand

Revert "SO-3109: support classpath scanning of classes where the supe…

c0cbdc2

…rclass..." This reverts commit 0581965.

SO-3109: add Component annotations to Commands

7a2cb27

SO-3109: add snowowl locks shell command

c24c89f

SO-3109: remove old migrate support

b1099a8

SO-3109: fix compile errors after merging RF2 import branch

f25fc51

SO-3109: remove EquivalentConceptMerger

10a7bf3

SO-3109: speed up Rf2GlobalValidator

aca1888

SO-3109: fix import09 test case

4e91e87

Fix incorrect update of documents in SnomedVersioningRequest (note: always use the fully loaded document for an update, otherwise you lose a bunch of derived values).

cmark self-assigned this Aug 13, 2018

cmark merged commit d8540a5 into 7.x Aug 13, 2018

cmark deleted the remove-cdo-data-layer branch March 8, 2019 15:18

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Remove CDO data layer completely from Snow Owl #257

Remove CDO data layer completely from Snow Owl #257

cmark commented Aug 13, 2018

Remove CDO data layer completely from Snow Owl #257

Remove CDO data layer completely from Snow Owl #257

Conversation

cmark commented Aug 13, 2018