The Curated Data Platform

ABSTRACT

The breadth of data platform options available to us today is staggering: between relational, object, graph, and document databases, we have a wide array of data storage and processing options. This talk will guide you through the contemporary data platform space and shed light on the way these technologies integrate and compete with one another. We'll discuss when to use (and when not to use) Spark, Postgres, Airflow, and Flink, as well as a range of other interesting tools and technologies. By the end of this talk, you may not have MongoDB or Neo4J, but you will know where they might (or might not!) fit in your environment.

ADDITIONAL MEDIA

No recordings or additional media are available for this talk.

SLIDES

Click here to access the slides for this presentation.

The slides are licensed under Creative Commons Attribution-ShareAlike.

DEMO CODE

No demos are available for this presentation.

LINKS & FURTHER INFO

Reference Architectures

• Data Warehouse reference architecture.
• Cosmos DB Use Case: Retail and marketing.
• Scalable web application.
• The Hadoop Ecosystem.
• The Data Lakehouse.
• Data warehousing with Redshift.
• Modern Data Warehouse architecture.
• Logical architectures for Big Data Analytics.
• What is the Lambda Architecture?.
• AWS Connected Vehicle Solution.
• Azure IoT reference architecture.
• The Complete Guide to the ELK Stack.

Additional Resources

• Data Lakes and Analytics on AWS gives you an overview of where to use the different AWS offerings in a solution.
• Azure data services gives a similar listing for Azure.