By:
On:
In: AWS

Redshift Spectrum ‘Patronus’ This post aims to analyze how Redshift Spectrum works and how we can take advantage of using it. I will try to load data from S3 such as Sessions (Parquet) & Raw Data (JSON). First of all, we will follow the Getting started using spectrum guide. To use Redshift Spectrum, the cluster needs to be at version 1.0.1294 or later. We can validate that executing select version();

To keep in mind – Redshift Pricing. Price Per Redshift Spectrum Query With Redshift Spectrum, you are billed at $5 per terabyte of data scanned, rounded up to the next megabyte, with a 10 megabyte minimum per query. For example, if you scan 10Read More →

AWS - Athena

By:
On:
In: AWS, BigData

AWS – Athena What is Athena? Amazon Athena is an interactive query service that makes it easy to analyze data directly in Amazon Simple Storage Service using standard SQL. With a few actions in the AWS Management Console, customers can point Athena at their data stored in Amazon S3 and begin using standard SQL to run ad-hoc queries and get results in seconds. Athena is serverless, so there is no infrastructure to set up or manage, and customers pay only for the queries they run. Athena scales automatically—executing queries in parallel—so results are fast, even with large datasets and complex queries. When should I useRead More →

By:
On:
In: AWS, BigData

Tableau + Presto & S3 Parquets Clickstream data is increasing fast, day by day, as more sites & features are being added. Our team provides new aggregated entities on top of that, meaning more data is produced. From Clickstream events we are able to produce Sessions, Visitors & Page Views objects that are stored in S3 with Parquet format. In order to stay up to date with new technologies, we wanted to do a PoC with Presto since some companies like Airbnb are using it instead of Redshift, our current solution. In this post, I’m going to explain my experience with Presto. First of all, we needRead More →