Data Flow Task Plus allows setup of dynamic data flows at runtime
COZYROC
Data Flow Task Plus allows setup of dynamic data flows at runtime
COZYROC
Data Flow Task Plus allows setup of dynamic data flows at runtime
COZYROC
SSIS Data Flow Task Plus with support for dynamic data flows at runtime by COZYROC
Data Flow Task Plus with support for dynamic data flows at runtime by COZYROC SSIS+
- No need to manually open and modify the data flow design when new Source and Destination columns have to be accommodated.
Data Flow Task Plus also supports features similar to the features implemented for Script Task Plus. Data Flow Task Plus allows exporting of data flow logic and reuse in other packages. Keeping your SSIS data flow logic separate from your package helps you keep track of the changes independently in your source control system. Data Flow Task Plus also provides a customizable user interface for setup of your data flow. You customize the data flow setup dialog by implementing an SSIS script, which is part of the data flow task.
These features will help you be more productive and allow you to componentize your common data flow logic.
In many integration scenarios ETL developers may find it challenging to automate their SSIS data flows with statically-defined metadata.
COZYROC Data Flow Task Plus provides the ability to acquire the metadata and map the columns at runtime, enabling the development of much more elegant solutions.
Here are several common use cases for using dynamic data flows created with Data Flow Task Plus (DFT+):
- If you are performing the same ETL operations for a lot of files, tables, entities, etc., DFT+ can be used in a loop to process any number of sources and destinations. Variables and expressions can be used to dynamically update names of tables, files, entities, sheet names, etc. each time through the loop. The column metadata will be updated and the columns will be mapped each time through the loop. Example scenarios are when, on a regular basis, you need to back up multiple files or need to generate multiple files from database tables or other types of sources.
- Another use case for DFT+ within a loop would be for migrating data from an on premises version of an application to the cloud-based version of an application. An example of this would be migrating from Dynamics CRM on premises to Dynamics 365 in the cloud. Variables and expressions would be used to loop through each entity to copy the data from on premises to the cloud. Tip: you will need to set the proper order to migrate the entities so that there are no failures due to prerequisites not being in place.
- Dynamic data flows can be useful even without a loop, e.g. in situations where the metadata changes frequently and its inconvenient to rework and redeploy an SSIS package that often. This use case does not require setting up variables and expressions. DFT+ would simply pick up the new or changed metadata when the package is executed.
- Another use case that does not require a loop would be to configure a somewhat generic package that can be used for any source/destination pair. For instance, you might want to have a generic package that copies data between tables. You would use variables and expressions to set up the specific table to copy data from and the specific table to copy data to.
COZYROC SSIS+ components suite
- Free developer license. It is free for download test and development within Visual Studio
- Support for SQL Server 2012 - 2022
- A licensed version can be deployed on-premises, on Azure-SSIS IR and on COZYROC Cloud
- One-time migrations and data transfers are completely FREE
- The toolkit is easy to use and follows the same guidelines and principles used by the standard out-of-the-box SSIS components.