Blog

SAP BO Data Services is an ETL tool used for Data integration, data quality, data profiling and data processing and allows you to integrate, transform trusted data to data warehouse system for analytical reporting.

BO Data Services consists of a UI development interface, metadata repository, data connectivity to source and target system and management console for scheduling of jobs.

Repository is used to store meta-data of objects used in BO Data Services. Each Repository should be registered in Central Management Console CMC and is linked with single or many job servers which is responsible to execute jobs that are created by you.

There are three types of Repositories:

Local Repository: It is used to store the metadata of all objects created in Data Services Designer like project, jobs, data flow, work flow, etc.

Central Repository: It is used to control the version management of the objects and is used for multiuse development. Central Repository stores all the versions of an application object so it allows you to move to previous versions.

Profiler Repository: This is used to manage all the metadata related to profiler tasks performed in SAP BODS designer. CMS Repository stores metadata of all the tasks performed in CMC on BI platform. Information Steward Repository stores all the metadata of profiling tasks and objects created in information steward.

Reusable Objects − Most of the objects that are stored in repository can be reused. When a reusable object is defined and save in the local repository, you can reuse the object by creating calls to the definition. Each reusable object has only one definition and all the calls to that object refer to that definition. Now if definition of an object is changed at one place you are changing object definition at all the places where that object appears.

An object library is used to contain object definition and when an object is drag and drop from library, it means a new reference to an existing object is created.

Single Use Objects − All the objects that are defined specifically to a job or data flow, they are called single use objects. Example-specific transformation used in any data load.

Real-time jobs “extract” data from the body of the real-time message received and from any secondary sources used in the job.

Central repository is used to control the version management of the objects and is used for multiuse development. Central Repository stores all the versions of an application object so it allows you to move to previous versions.

In Data Services, you can create a template table to move to target system that has same structure and data type as source table.

It is a developer tool which is used to create objects consist of data mapping, transformation, and logic. It is GUI based and work as designer for Data Services.

You can create various objects using Data Services Designer like Project, Jobs, Work Flow, Data Flow, mapping, transformations, etc.

• Delimited
• SAP Transport
• Unstructured Text
• Unstructured Binary
• Fixed Width

Data flow is used to extract, transform and load data from source to target system. All the transformations, loading and formatting occurs in dataflow.

• Source
• Target
• Transforms

• Execute once
• Parallelism
• Database links
• Cache

Workflows are used to determine the process for executing the workflows. Main purpose of workflow is to prepare for executing the data flows and to set the state of system once data flow execution is completed.

• Work flow
• Data flow
• Scripts
• Loops
• Conditions
• Try or Catch Blocks

You can also add Conditionals to workflow. This allows you to implement If/Else/Then logic on the workflows.

Transforms are used to manipulate data sets as inputs and creating one or multiple outputs. There are various transforms that can be used in Data Services.

• Data Integration
• Data Quality
• Platform
• Merge
• Query
• Text data processing

• Data_Generator
• Data_Transfer
• Effective_Date
• Hierarchy_flattening
• Table_Comparision, etc.

This allows you to extract the specific information from large volume of text. You can search for facts and entities like customer, product, and financial facts specific to an organization.

This transform also checks the relationship between entities and allows the extraction.

The data extracted using text data processing can be used in Business Intelligence, Reporting, query, and analytics.

Text data processing is used for finding relevant information from unstructured text data however data cleansing is used for standardization and cleansing structured data.

You can create real time jobs to process real time messages in Data Services designer. Like a batch job, real time job extracts the data, transform and load it.

Each real time job can extract data from a single message or you can also extract data from other sources like tables or files.

Embedded data flow is known as data flows which are called from another data flow in the design. The embedded data flow can contain multiple number of source and targets but only one input or output pass data to main data flow.

One Input: Embedded data flow is added at the end of dataflow.

One Output: Embedded data flow is added at the beginning of a data flow.

No input or output: Replicate an existing data flow.

Local variables in data services are restricted to object in which they are created.

Global variables are restricted to jobs in which they are created. Using global variables, you can change values for default global variables at run time.

Automatic Recovery – This allows you to run unsuccessful jobs in recovery mode.

Manually Recovery – This allows you to rerun the jobs without considering partial rerun previous time.

Data Services Designer provides a feature of Data Profiling to ensure and improve the quality and structure of source data. Data Profiler allows you to −

Find anomalies in source data, validation and corrective action and quality of source data.

The structure and relationship of source data for better execution of jobs, work flows and data flows.

The content of source and target system to determine that your job returns the result as expected.

SAP BO Data Services support multi user development where each user can work on application in their own local repository. Each team uses central repository to save main copy of an application and all the versions of objects in the application.

SCDs are dimensions that have data that changes over time.