Understand ETL As the extraction procedure, data transformation and loading, that is part of the life cycle of a Business Intelligence Implementation. Starting from this premise, we realize that there are certain conceptual variations relative to them. ETL processes, on which the performance of data handling processes will depend. Therefore, it is necessary to consider the technologies applied in each part of the procedure, from beginning to end.
In summary, it could be said that any procedure would start at the source of the data (Database, text files, etc.), would continue with the intervention of the ETL tool, to conclude on the destination of the Data (Database) that are available.
The ETL tool Allow:
- Connect to the source of the data.
- Perform the transformation within the same tool.
- Upload data to database destiny.
Understanding the E-LT concept
E-LT could be defined following the order of the initials that designate it. A) Yes, it can be said that it is the extraction, data loading and transformation, and is summarized in the following three steps:
- First: the data must be extracted and loaded in form “BULK” directly to a Database or to tables specially created for passing data (also known as staging). This means that this medium will only be useful temporarily., so it can be cleaned in every charging procedure. For this, it is recommended to perform simple transformations and clean up basic information.
- Second: when the information is contained in the staging, it will be necessary to continue with the elaboration of the data transformation procedure, which will then be transferred to the database of the Data warehouse. This transformation will be done with the database's own language, as a T-SQL sample, PL / SQL.
- Third: once the data has been transformed into the database processes themselves, would be inserted into the Data warehouse. After this action is complete, step data can be cleaned, if deemed appropriate.
Thus, the transformation procedure is integrated into the database engine.
Advantages of E-LT over ETL
Even though both concepts, E- LT and ETL lead to the same result, the difference is in the performance and procedural speed of the Loading procedure in each case. The main advantages of using E-LT instead of ETL would be associated with:
- Speed of procedure and transformation. The main advantage of E-LT is the way each tool involved works.. In the case of ETL, transformation tools evaluate record by record, while in e-lt the transformation is performed in the database that evaluates the records in batches.
- Resource Usage. Other E-LT Advantage, is that database You are ready for resource optimization, either disc, memory or procedure and this causes the performance of the procedure to be managed by the database configuration. Despite this, ETL tools do not take advantage of disk configuration (RAID) or the distribution of memory and processor, since they make temporary transformations and in several cases redundant.
Each tool gives us different advantages. Some make it easier for us to develop a transformation, even if not the best performance; while sometimes the opposite happens. In practice, it can happen that a customer who has a E-LT Tool to use ETL without knowing how to use its advantages. Thus, it is essential to be informed and to know the scope of available resources, to be able to make the right decisions, getting the best performance.
(function(d, s, id) {
var js, fjs = d.getElementsByTagName(s)[0];
if (d.getElementById(id)) return;
js = d.createElement(s); js.id = id;
js.src = “//connect.facebook.net/es_ES/all.js#xfbml=1&status=0”;
fjs.parentNode.insertBefore(js, fjs);
}(document, ‘script’, 'facebook-jssdk'));
