ODI - Endeca Integration (IKM SQL to Endeca Server)

About

The IKM SQL to Endeca Server provides integration and loading modules that enable writing source data to an Endeca Server target within ODI.

Prerequisites

  • The IKM SQL to Endeca Server 3.1.0 supports writing data to Endeca Server 7.6.0.
  • This version of IKM SQL to Endeca Server is compatible with Oracle Data Integrator 11g (11.1.1.x).
  • Download the files op https://edelivery.oracle.com. (Product Pack: Oracle Endeca, there is one media pack IKM SQL to Endeca Server for both Windows and UNIX platforms.)

Steps

Installing the library

  • Stop the agent process
  • Copy the jar files located in the lib directory of the downloaded files
  • Paste them in the following location. If the ODI agent is a
    • Java application running in WebLogic Server: C:\Oracle\Middleware\user_projects\domains\odiagent\lib.
    • Standalone agent: <install path>\odi\agent\lib
  • For an agent in a weblogic Server, add this java system property in the setDomainEnv script: JAVA_OPTIONS=-DUseSunHttpHandler=true
set JAVA_OPTIONS=-DUseSunHttpHandler=true
JAVA_OPTIONS=-DUseSunHttpHandler=true
export JAVA_OPTIONS
  • Start the agent

You must see in the agent log that the agents process new jars:

*sys-package-mgr*: processing new jar, 'C:\OdiHome\odi\agent\lib\endeca-server-driver.jar'
*sys-package-mgr*: processing new jar, 'C:\OdiHome\odi\agent\lib\endeca_bulk_load-7.6.jar'
*sys-package-mgr*: processing new jar, 'C:\OdiHome\odi\agent\lib\guava-14.0.jar'
*sys-package-mgr*: processing new jar, 'C:\OdiHome\odi\agent\lib\httpclient-4.0.3.jar'
*sys-package-mgr*: processing new jar, 'C:\OdiHome\odi\agent\lib\httpcore-4.0.1.jar'
*sys-package-mgr*: processing new jar, 'C:\OdiHome\odi\agent\lib\log4j-1.2.15.jar'
*sys-package-mgr*: processing new jar, 'C:\OdiHome\odi\agent\lib\slf4j-api-1.7.2.jar'
*sys-package-mgr*: processing new jar, 'C:\OdiHome\odi\agent\lib\slf4j-log4j12-1.7.2.jar'

Flex fields

  • Add the following jar in the metadata-import.bat file:
c:\OdiHomeEE\oracle_common\modules\oracle.jps_12.1.2\jps-api.jar;c:\OdiHomeEE\oracle_common\modules\oracle.idm_12.1.2\identitystore.jar
  • Start
3.1.0\tools>metadata-import.bat OdiRepository.properties
Loading properties from:
3.1.0\tools\OdiRepository.properties
ODI_MASTER_DRIVER=oracle.jdbc.OracleDriver

ODI_MASTER_URL=jdbc:oracle:thin:@localhost:1521/pdborcl.hotitem.local

ODI_WORK_REP=WORKREP

ODI_MASTER_USER=DEV_ODI_REPO

ODI_SUPERVISOR=SUPERVISOR

Please specify the database user password for the ODI repository database:
Please specify the Work repository login password:
Loading ODI repository configuration complete.
Mar 20, 2014 1:06:46 PM oracle.odi.core.datasource.DataSourceDefinitionUtils createDriverManagerDataSourceDefinition
INFO: New data source: [DEV_ODI_REPO/*******@jdbc:oracle:thin:@localhost:1521/pdborcl.hotitem.local]
Mar 20, 2014 1:06:48 PM oracle.odi.core.datasource.DataSourceDefinitionUtils createDriverManagerDataSourceDefinition
INFO: New data source: [DEV_ODI_REPO/*******@jdbc:oracle:thin:@(description=(address=(host=localhost)(protocol=tcp)(port=1521))(connect_data=(service_name=PDBOR
Mar 20, 2014 1:06:50 PM org.eclipse.persistence.default
INFO: EclipseLink, version: Eclipse Persistence Services - 2.4.2.v20130514-5956486
Mar 20, 2014 1:06:50 PM org.eclipse.persistence.default.connection
INFO: work-session login successful
Mar 20, 2014 1:06:50 PM org.eclipse.persistence.default.connection
INFO: master-session login successful
Mar 20, 2014 1:06:51 PM org.eclipse.persistence.default.connection
INFO:  login successful
Mar 20, 2014 1:06:51 PM oracle.odi.adapter.OdiAdapter refreshRepositorySeededObjects
WARNING: Refreshing static component type cache.
FlexField {Endeca Property IsUnique|ENDECA_PROPERTY_IS_UNIQUE} is added!
FlexField {Endeca Property Display Name|ENDECA_PROPERTY_DISPLAY_NAME} is added!
FlexField {Endeca Property Navigation Select|ENDECA_PROPERTY_NAVIGATION_SELECT} is added!
FlexField {Endeca Property Navigation Sorting|ENDECA_PROPERTY_NAVIGATION_SORTING} is added!
FlexField {Endeca Property Attribute Group|ENDECA_PROPERTY_ATTRIBUTE_GROUP} is added!
FlexField {Endeca Property IsValueSearchable|ENDECA_PROPERTY_IS_VALUE_SEARCHABLE} is added!
FlexField {Endeca Property Language|ENDECA_PROPERTY_LANGUAGE} is added!
FlexField {Endeca Property IsSingleAssign|ENDECA_PROPERTY_IS_SINGLE_ASSIGN} is added!
FlexField {Endeca Property Search Interface|ENDECA_PROPERTY_SEARCH_INTERFACE} is added!
FlexField {Endeca Property IsTextSearchable|ENDECA_PROPERTY_IS_TEXT_SEARCHABLE} is added!
FlexField {Endeca Property TextSearchWildcards|ENDECA_PROPERTY_TEXTSEARCHWILDCARDS} is added!
FlexField {Endeca Property ShowRecordCounts|ENDECA_PROPERTY_SHOW_RECORD_COUNTS} is added!
Mar 20, 2014 1:06:54 PM org.eclipse.persistence.default.connection
INFO: work-session logout successful
Mar 20, 2014 1:06:54 PM org.eclipse.persistence.default.connection
INFO: master-session logout successful

In ODI Studio

  • Windows > Odi Security Navigator > SECURITY ADMIN
  • Double click Column. On the Column tab, select Flexfields.

Creating the topology

  • an Endeca Server data server

  • a Physical Schema
  • a Logical Schema

Model

Mapping

  • Create a mapping with the “Empty Dataset” check-box unchecked
  • In the Logical View:
    • Verify the mapping properties
    • Drag the database table in the canvas
    • Drag the Endeca data store in the canvas
    • Verify in the target properties that the Integration Type is “Control Append”
    • Map the two by dragging a line between the two side-node
    • Verify the mapping by clicking on the target columns

  • In the physical view:
    • Verify in the properties that the preset staging location is the database
    • Verify by clicking on the target the Knowledge Module and its options:

Operator

Support

Message missing required fields: spec

java.lang.Exception: 
java.lang.Exception: 
com.oracle.endeca.eidi.mdex.exception.ConnectionException: 
com.google.protobuf.UninitializedMessageException: 
Message missing required fields: spec

The primary key for datastore records is called a “spec”.

Documentation / Reference


Powered by ComboStrap