This document will give a basic overview on monitoring SLT activities and will also highlight on basic checks that can be done to find the root cause for errors that might arise.
This is an ongoing document and is based on details given in SAP LT Application Operations Guide and on personal experience from SLT projects.
with this Blog I want to give you an update o the SLT scenario for Operational Data Provisioning.
Most important:
With the new SP7, the SLT scenario for ODP is no longer limited in terms of parallel initial load! That is, now every subscriber (up to 4) gets the initial load of requested tables, no matter if it is the first or fourth subscription on the Delta Queue.
Since SP6 already, SLT supports in this scenario also non-ABAP systems and pool- and cluster tables.
Use Cases:
The most important benefits for Data Replication with SLT into SAP BW are:
- Replacing nightly batch loads with (near) real-time data transfer
- Reducing the amount of transferred data from full loads to delta-only
Can also be used to replace generic BW extractors: combine the tables/fields of the extractor in a view and replicate only deltas with help of SLT. Make use of Advanced Replication Settings/ Transformation Rules.
- Management of multi client data extraction with SLT reduces management effort drastically
Customer could reduce the running data transfer processes and the number of DataSources to one, and the implementation of a new client means no effort for data replication.
SpeedDemo:
the newest SpeedDemo on DMIS2011 SP7 with BW 7.40 can be found here:
SAP TechEd 2015 is over – thanks a lot to those who joined our sessions or stepped by at our pod in the show floor. Our sessions were nearly sold out, but they were also recorded.
DMM164: SAP Landscape Transformation Replication Server: Real-Time Data Replication
SAP Landscape Transformation Replication Server is the cornerstone in landscapes requiring real-time data replication – such as landscapes with the SAP HANA platform; the SAP Business Warehouse (SAP BW) application; or SAP Simple Finance, central finance foundation. This session provides you with details about the new version, the functions, and the road map and gives you hands-on experience for different use cases.
DMM268: Streamline the Transfer of Data into SAP BW
Experience how the power of SAP Landscape Transformation replication server combines with operational data provisioning (ODP) to transfer delta data in real time into SAP Business Warehouse (SAP BW). Learn how to transform and filter data in the source system to reduce data traffic, and benefit from real-time data for your reporting requirements.
Recently i got the chance to work very closely with SAP Basis for installing the SAP HANA Live Components of various applications i.e. SAP ECC, CRM , TM , EM , APO, EWM and also HANA Live Browser as well etc.
Initially i was not sure and was not aware of various Prerequisites (HANA , SAP Source systems , SAP SLT Server requirements) for installing the same and it took a lot of time to come up with the information so as to plan for installation.
I would like to summarize this so that the same can be used for others saving time for installation.
Note: SAP LT Replication server was installed as a separate SAP System.
Addon/Component
Description
Prerequisite (HANA)
Prerequisite (SLT Server)
Prerequisite (Source system)
HCO_HBA_AF_EXPLORER
HANA Live Browser.
SAP HANA 1.0 SPS6.
Refer note 1914584.
NA
NA
HCO_HBA_ECC
HANA Live for ECC.
1. SAP HANA Platform Edition 1.0 SPS07, revision 70 or higher.
2. Prerequisite Tables as per note 1781992.
1. DMIS 2011_1 SP06 .
2. SAP Netweaver 7.02 (Basis Support Package 8).
3. SAP Kernel 7.20 patch level 110 or higher.
1. SAP ERP 6.0 SP 12 and all equivalent enhancement packages
2. DMIS 2011_1 SP06
HCO_HBA_CRM
HANA Live for CRM
1. SAP HANA PLATFORM EDIT. 1.0 SPS07, revision 70 or higher.
2. Prerequsite Tables as per note 1782066
1. DMIS 2011_1 SP06
2. SAP Netweaver 7.02 (Basis Support Package 8)
3. SAP Kernel 7.20 patch level 110 or higher
1. EHP2 for SAP CRM 7.0 SP05 or higher
2. DMIS 2011_1 SP06
HCO_HBA_SCM_APO
HANA Live for APO
1.SAP HANA PLATFORM EDIT. 1.0 SPS07, revision 70 or higher
2. Prerequisite Tables as per note 1782067
1. DMIS 2011_1 SP06
2. SAP Netweaver 7.02 (Basis Support Package 8)
3. SAP Kernel 7.20 patch level 110 or higher
1. SAP SCM 7.0 SP14 Check SAP note 1904500
2. DMIS 2011_1 SP06
HCO_HBA_EWM
HANA Live for EWM
1. SAP HANA PLATFORM EDIT. 1.0 SPS07, revision 70 or higher
2. Prerequisite Tables as per note 1952597 - Tables for SAP HANA Live for Extended Warehouse Management
1. DMIS 2011_1 SP06
2. SAP Netweaver 7.02 (Basis Support Package 8)
3. SAP Kernel 7.20 patch level 110 or higher
1. EHP2 for SAP EWM 7.0 SP00 or higher
2. DMIS 2011 SP06
HCO_HBA_EM
HANA Live for EM
1. SAP HANA PLATFORM EDIT. 1.0 SPS07, revision 70 or higher
2. Prerequisite tables as per note 1918524
1. DMIS 2011_1 SP06
2. SAP Netweaver 7.02 (Basis Support Package 8)
3. SAP Kernel 7.20 patch level 110 or higher
1. SAP Event Management 9.0 SP04
2. DMIS 2011_1 SP06
HCO_HBA_TM
HANA Live for TM
1. SAP HANA PLATFORM EDIT. 1.0 SPS07, revision 70 or higher
2. Prerequisite tables as per note 1918523
1. DMIS 2011_1 SP06
2. SAP Netweaver 7.02 (Basis Support Package 8)
3. SAP Kernel 7.20 patch level 110 or higher
1. SAP Transportation Management 9.0 SP07
2. DMIS 2011_1 SP06
Refer the mentioned SAP notes for the various Prerequisite Table for each of the above mentioned HANA Live Components.
Thanks for reading.Image may be NSFW. Clik here to view.
Our production system is ECC 6.0 and we are not planning to upgrade and migrate our system to HANA in a short period of time. On the other hand we want to use Hana live analitics and consume our real-time data with Lumira. For this requirement we decided to go with sidecar POC senario. With the DMIS addon capability we can make ABAP to ABAP replication for the specified tables. Our sidecar scenario requires standalone SLT and HANA license.
First of all we need to check our systems patch level and start for installing DMIS addon for SLT. On the ERP side we need to install DMIS 2011_1_700 SP9 addon. In our case, SAP LT Replication Server is in the same system and we don’t need to check compatibility for support package level on both systems.
In the target system (Business Suite on Hana, ECC 6.07) also I have installed DMIS addon 2011_1_731 SP9. Main OSS note for DMIS addon is “2191214 - Installation/Upgrade SLT - DMIS 2011 SP9”. As an alternate you can use SAP Solution Manager system as an LT Replication server for non production usage. For productive usage SAP recommends dedicated SAP LT Replication server.
In the both side RFC connections were created and tested before creating configuration. For ABAP source system, we created a new user (do not use DDIC) and assigned the role IUUC_REPL_REMOTE for RFC connection. With DMIS addon, two new roles have been created. In the replication system, roles SAP_IUUC_REPL_ADMIN and SAP_IUUC_REPL_DISPLAY are required to create, change or display configurations. Additionally i gave the roles related with NW Business Client which role names are including *NWBC*. You can follow the Application Operations Guide for SAP LT at service.sap.com/instguides.
After preparation steps, we defined a connection between the source and target system. SAP defines this information as a configuration. In the replication server via transcation LTR we have created new config which name is ERP2HANA. In the configuration wizard, we specified source and target system and rfc names with the standard transfer settings. Now we were ready for the replication. In the transaction LTRC, gone through Data Provisioning button and selected the tables VBAK and VBAP then executed succesfully. You need to check the tables are exist in the both side exactly, because SLT couldnot create the target table structure. Also if you have different client number between source and target; you need to specify transfer rules. In my case, i am using Lumira and handling with the help of it without defining transfer rules.
In the LT Replication Server Cockpit (LTRC) i can check the transfer status for tables, view and analyze errors, change table write modes, reset load and replication in the expert mode. During replication you can get dublicate error short dump and use oss note 1972009 for solving and resetting status. Also MWBMON transaction can be used for monitoring mass data transfer.Image may be NSFW. Clik here to view.
SLT as we know is one of demanding middleware technlogies today which can be very useful, though normally roadmap for SLT is HANA but in our case it was decided to use Oracle as target system and SAP ECC as the source. From SLT SP009 - it started supporting Oracle as target as well. Here is quick overview on few learnings -
Data Flow :
SAP ECC ->SLT- >Oracle DB
1) Sizing of Oracle DB Target -Memory size of Oracle DB need to be estimated correctly else often the issue occured where oracle system memory was full becaue of volume of data flowing from SAP ECC.Hence we needed to increase the memory size of Oracle to fix this issue and hence in longer term need to estimate size growth and accrodingly take actions.
2) Stats for Initial Load in SLT- For number of tables it was observed that initial loading stats information in LTRC T code was misisng and this was fixed when SAP suggested to apply SAP Notes but the same issue appeared again when we were loading other tables then SAP said this will be taken up in further release as this was major change.
3) Timestamp field Oracle requirement- There was requirement to add Timestamp field to tables in SLT, and send across data to Oracle in oracle time stamp format.This was acheived by passing hard coded value from SLT in Oracle time format and then script was written in Oracle which will overwrite this value with latest time stamp from Oracle.
So the timestamp generation in SLT was possible but while updating to Oracle data type changed to VarChar which was not required as user required it in TIMESTAMP data type of Oracle. Hence this was only posisble in Oracle system.
4)Language Text Issue- Certain Russian language characters were reported as question mark ? in Oracle as system could not recognize and hence to fix this Oracle was upgraded to have multi Lingual capability. Post that this was rectified.
In certain scenario there can be a case where in the data is required from one particular source system in same or different HANA databases using different controller systems (SLT replication servers).
Due to multiple Replication servers and only one source system, conflict between objects such as triggers, logging tables, synonyms and run time objects created by two separate SLT servers can occur.
The only reason for these conflict is the number ranges defined in the SLT system, the number range for SLT replication server is defined in 3 sections; as follows
DMC_FMID
This is the number range used during the generation of the runtime objects (function modules) which are called or created during replication startup for a particular application table
IUUC_SHDW
This Number range used during the generation of the Triggers and the logging tables
IUUC_TABID
This Number range used during the generation of the synonyms
To avoid such situations we need to update the above mentioned number ranges to one of the Controller system so that the conflicts can be avoided.
These changes are required to be done before creating any new configuration.
Ensure that these changes are applied before initiating or executing any data transfer activities from the central system on the connected SAP source system(s) - otherwise previously generated objects in the source or target system might become corrupted.
To change the number ranges in each additional central system, proceed as follows:
Enter transaction SNRO in each subsequent central system.
Change the default number range intervals for the following objects:
DMC_FMID (<15 digits>): Number used in name of generated runtime object (function module) For example starting with: - 000030000000000 in 2nd control system - 000050000000000 in 3rd control system, etc.
IUUC_SHDW (<7 digits>): Number for trigger and logging table For example starting with: - 3000000 for 2nd control system - 5000000 for 3rd control system
Note: the number range object IUUC_SHDW allows numbers with 8 digits. However, since some scenarios overwrite the first digit when creating object identifiers, you must use only 7 digits when defining the number range intervals.
Only relevant for SAP LT Replication Server:
IUUC_TABID (<11 digits>): Number of synonyms for 1:N replication - used by SAP LT replication server only! For example starting with: - 30000000000 for 2nd control system - 50000000000 for 3rd control system
With this blog I would like to share the learning which i had when i wanted to use the same source system for replication from different clients using the same controller SLT system.
In certain cases where any single client replication from a source system is not enough and we want to use the same source system again for the replication but this time from a different client.
For any SLT system we can use the same source systems 4 times, only if the reuse of the system is marked as true.
For making multiple source system connections using the same source system we have to make sure that the option “Allow Multiple Usage” option is checked during the first SLT replication configuration.
If the option “Allow Multiple Usage” is not selected for a particular source system the only option available in that case would be to delete the configuration and create a new one with this check “Allow Multiple Usage” as true. For new configuration we don't need to create a new schema in HANA we can use the same schema for replication.
Please Note: Checking the option “Allow Multiple Usage” doesn’t have any impact even if the source system is not configured again for replication. Thus it is always a best practice to check the option “Allow Multiple Usage”.
Please do let me know your feedback on same or let me know in case of any questions and concern.
a lot of customers approached us asking if they can transfer their delta data with SLT to Hadoop. See here how the setup can look like to transfer data with SLT to SAP HANA and from SAP HANA further on to Hadoop and what the benefits are if you use SLT - like full coverage of table types: transparent, pool and cluster tables as well as INDX type tables, and full coverage of all ABAP source systems from 4.6c on...
I want to share with you some special considerations and settings that has to be defined for specific tables if you replicate from an ABAP source or into an ABAP target that is using HANA as a database. I copied the note text:
2319897 - SLT – Replicating data from tables with no primary key on DB level
You are replicating data from an ABAP-based SAP system running on SAP HANA, and you face the following issue: You want to replicate data from an SAP application table whose primary key is defined in the ABAP Dictionary, not in the database. You want to replicate data into an SAP application table whose primary key is defined in the ABAP Dictionary, not in the database. This SAP Note explains how to avoid inconsistencies when replicating data from such tables.
Reason and Prerequisites
You use SAP LT Replication Server with release DMIS 2011
Within an SAP HANA-based SAP system (i.e. SAP S/4HANA, SAP Business Suite on SAP HANA) there are SAP application tables whose primary key is defined in the ABAP Dictionary, not in the database. This has been designed in order to save memory space in the in-memory SAP HANA database. Application logic of the source system ensures that no duplicate records occur.
The list of currently known tables include:
ACDOCA
ACDOCP
FAAT_DOC_IT FAAT_PLAN_VALUES
FAAT_YDDA
MATDOC
MATDOC_EXTRACT
VER28179_NP
The replication of data can result in duplicate records in the target system if no primary key (including a unique constraint) has been defined in the database for the target table.
Solution
1.) If you are using an RFC connection to connect to the receiver system, SLT expects the table to exist already. In this scenario SLT won't create any primary key (including a unique constraint) on the
2.) If you are using an RFC connection to connect to the source system database (standard option for an ABAP-based SAP system), SAP LT Replication Server will create a primary key (including a unique constraint) for the target table in the database automatically. This setting should not be changed, because otherwise replication of data into that table may cause duplicate records and therefore inconsistencies.
3.) If you are using a direct database connection (connection type DBCON) to connect to the source system database, SAP LT Replication Server will not find a primary key in the source system database for the relevant table, and therefore cannot create a trigger. Data cannot be replicated to the target system.
Solution:
- For each table whose primary key is defined in the ABAP Dictionary, not in the database, you need to explicitly tell SLT which fields to use to track changes. You therefore have to create entries in the following SLT delivered table IUUC_DB_TAB_KEYS according to the SAP ABAP Dictionary key definition of the application table.
- You can now start the replication of the table (or tables). In the target system, the target structure will be created according to the database view that was created in the source system (including the primary key and related unique constraint).
When using SLT to replicate data from Oracle DB to HANA, you might see SQL error 932 occurred on a specific table and the initial load was failed. The reason is that you have defined a long field in the table, e.g. VARCHAR(2000). Following is an example of the problem and the workaround.
Now let's check the proxy table of SLT_DEMO. You can see the data type of CCC and DDD were converted to "STRING" which should be "CHAR". However BBB was converted to "CHAR" correctly. Image may be NSFW. Clik here to view. Data type "STRING" is for "LONG" and "CLOB", so when SLT tried to read data from SLT_DEMO on the source DB, it hoped field CCC and DDD should be "LONG" or "CLOB". However it found the data type of CCC and DDD were"VARCHAR", then error "inconsistent datatype" occurred.
We do not have a plan to enhance this functionality at the moment and the design may change, so there is no Note or KBA to introduce the workaround. If you have the same problem, you have to refer to this blog.
Processing-Related - Corresponds to the code written at field.
Event-Related - Corresponds to event based code as its self explanatory.
For Testing purpose I gave both to check where this link will be available.
Double click on Processing Related Fields - TEST_FIELD.
Note : Please remember that this will be our Target field name we have used. For understanding purpose I am attaching Target structure once again as below.
The highlighted one in above screenshot is ABAP include where code is written.(As field symbol names are big it didnt fit in 72 char so need to create a new include and write the code in that. ex : <wa_s_zemployee_test>-new_field and other condition). When we write the code in include we need to use other fields as below instead of field symbol.
3. As we will use BW as target system, so here we choose RFC connection and scenario of "Persistent Staging Area (PSA) for SAP BW" . And then input the created RFC connection to BW system. And for Logical System Name, we input the name we want. And note this Logical System name, we will use it later.
12. BW side , when you double click on source system Z07, it will jump to the datasource "Unassigned Nodes" -> "test open sql from sum" . And you can find the datasouce "SLT_ZKLAUS_TEST", right click -> manage.
1. Go to transaction LTRS, then we need to define the advanced settings before we replicate the view.
Transaction LTRS -> Choose your Mass Transfer ID -> Right click on "Table Settings" -> Add table -> Here we add the base table "SLT_DEMO".
In "Structure Template", we input the view that we want to replicate
In "Deviating Table Name" , here we can define the name that you want in your target system. If you want the name in target system the same as your source system. Here you can input "VIEW_TEST" the same name as the view in your source Oracle system.
For "View for Initial Load" and "View for Replication", we input the same as "Structure Template"
After convert HANA to MCD (MultiTenant) some tasks must to be executed in SLT to connect with MCD Database.
In addition to Note 2101084 please check the SAP Note relevant for your DMIS version from the list below and ensure all corrections are applied to both source and SLT server where indicated in the note.
The IUCC HOST: Is the value you set in xsengine.ini -> public_urls
You need to add a virtual hostname in xsengine.ini -> public_urls You can do it from SystemDB or TenantDB, but if SystemDB is used, when saving the value, please select the TenantDB