Jorriss.com

The Quest to Find Bad Data With Data Profiling

The legendary adventurer is on the quest of a lifetime. He’s found a database that holds the locations of the world’s greatest relics, but there’s a problem. No, it’s not snakes. The database was written using an ancient format and it may hold incorrect data. Our data archaeologist must find a way move the correct data into SQL Server or risk losing our most important treasures, forever. Luckily, he has an powerful tool, data profiling.

Data profiling is a way that you can identify bad data, measure inaccurate data, and know for sure that your queries are right. There are many different ways our adventurer can use data profiling. This session will show you what data profiling is and how it can help lead you to fortune and glory.

Demo code available on Github.

Richie Rump

// about the author

Richie Rump is a Dataveloper.

Richie Rump is a principal software engineer and software architect with more than two decades spent at the intersection of application code and the data layer. He builds and operates data-intensive products, including database diagnostic tools, cloud-native serverless platforms, and full-stack applications, owning them from architecture and database design all the way through to production. Beyond the day job, he created StatisticsParser.com, co-founded a user group, and co-hosted the Away From The Keyboard podcast. On this site, he writes about performance, database internals, and the engineering practices behind reliable systems.