Uncategorised | Andrew Smith

Data Flow Threading

SSIS provides for parallelism at multiple levels: (i) by running packages concurrently, (ii) by running tasks concurrently within a package, and (iii) by running transformations concurrently within a data flow.

This post investigates parallelism within the data flow, by comparing the time taken between non-parallel and […] “Data Flow Threading”

Source Control and SSIS

Source control plays an essential part of any software development project, where ETL is no exception.

At the very least it preserves source code such that recovery is possible to a previous point in time, whilst also allowing developers to work on multiple streams of the code such that new developments are isolated […] “Source Control and SSIS”

SSIS Bulk Load Settings

This post explores the SQL Server bulk load settings that are exposed to SSIS, and measures their effect on a simple SSIS data flow.

It considers bulk loads into heaps and clustered indexes, as well as showing the effect of minimally logged inserts into a database running with the simple recovery […] “SSIS Bulk Load Settings”

I’m Andrew Smith and I’m an experienced software professional with an employment history spanning a variety of industries and including blue-chip organisations such as Ford Motor Company, PricewaterhouseCoopers and IQVIA.

I’m currently architecting and implementing an AWS-based IoT system, including network and security design, RDS database implementation and the provision of high availability and disaster recovery capabilities.

Whilst this website was initially written to document research I was doing throughout the Microsoft SQL Server product suite, it’s now oriented around how best to use Amazon Web Services (AWS) to deliver solutions to problems in enterprise computing.