Data Engineering / Cloud

Scale Your Data Pipeline Efficiently

It can be a struggle to extract business value from your data. Disparate data sources and data quality are just a few of the complex issues you face.

Ensure that the entire pipeline of your data collection yields accurate, consistent results. When you partner with Chariot’s experienced data engineers, you develop highly optimized data pipelines that yield valuable business insights. From collection to analytics to preparation, your pipeline’s plumbing should withstand the digital flood.

AWS Practice Lead Keith Gregory interviews Andrew Ganim about how he helped a multinational company better analyze their data by building a more robust data pipeline.

Chariot Has Expertise In:

Data Lakes

Structuring data and designing queries to a single place, for use by multiple consumers.

Streaming Data

Near-real-time data populates analytics databases and drives customer interactions.

Big Data Databases

Data and queries are designed to yield efficient, cost-effective business intelligence.

Analytics Pipelines

Chariot combines multiple tools and services to acquire, cleanse, transform, and present business data.

Success Stories

The answer is in the architecture. Chariot’s team of experienced data engineers help simplify the process and guide you through the many choices in building the best data pipelines to serve your business needs. We partner with you to build secure, reliable, and highly scalable data pipelines rooted in data integrity.

Fast, Accurate Processing with AWS for a Live Gaming Loyalty Program

Loyalty programs are an excellent way to maintain and grow a company’s reach. Customers feel valued when they achieve reward status, and become more devoted to the brand. But not all loyalty programs are created alike, and each comes with its own set of challenges. Under the Hood of a Loyalty Program Consumer-facing apps and ... Read More

Water Out of the Closet: H2O Connected Exposes a Leaky Secret

Commercial property owners have no idea how much money is going down the drain. The hidden cost of leaky toilets is astounding. Consider the number of bathrooms in hotels, apartment buildings, office complexes, nursing homes, government buildings, and other large scale facilities. There are over 350 million tank toilets in North America and Canada. More ... Read More

Watch it Now: Chariot Migrates Telecom Platform to AWS

A global media and technology company based in Philadelphia engages and maintains television subscribers with personalized solutions. Customers want live streams, on demand, DVR, smart shortcuts and they want it fast. Multiply that by millions of customers, all at the same time. Migration to the Cloud Imagine the unimaginable streams of real time data feeding ... Read More

Articles, Tutorials, and Writing

Continuous learning is one of our core values here at Chariot, and we believe it’s important to share what we learn. Our data engineers are always writing tutorials, delivering talks, and reviewing the latest new tech. Browse a few pieces of our latest data-focused content here.

Rightsizing Data for Athena

Keith Gregory | October 22, 2021October 22, 2021 | athena, aws, big data, glue

Amazon Athena is a service that lets you run SQL queries against structured data files stored in S3. It takes a “divide and conquer” approach, spinning up parallel query execution engines that each examine only a portion of your data. The performance of these queries, however, depends on how you consolidate and partition your data. In this post I compare query times for a moderately large dataset, looking for the “sweet spot” between number of files and individual file size.

Read More ⟶

15 Minutes With: Keith Gregory on Building a Data Pipeline for Better Business Operations

Becca Refford | October 22, 2021 | aws, data, data management, data pipeline

Clickstream data – the behavior data collected from a user’s path through a website or app – is often used for business intelligence reports. It helps many companies answer questions…

Read More ⟶

Using CodeArtifact with Poetry

Keith Gregory | October 5, 2021 | aws, build tools, python

In my last post I discussed how an artifact server is the best way to publish locally-developed Python packages. In this post, I show you how to set up the AWS CodeArtifact service and use it with pip and Poetry.

Read More ⟶

Building Lambdas with Poetry

Keith Gregory | September 14, 2021November 22, 2021 | AWS lambda, python

Coming from a Java background, I consider the Python development process to be a bit of a mess. The pieces are all there: a central repository for publicly-available packages, a way to install the packages you want, and several ways to run your program with only those packages. But it seems that everybody has a different way to combine those pieces. So when a colleague introduced me to Poetry, my first reaction was “oh great, another tool that solves part of my problem.” But after spending time with it, I don’t want to build Lambdas any other way.

Read More ⟶

We’re proud to be a Certified AWS Partner.

AWS offers so many products for cloud computing that it takes an expert to understand which tools are best for your business process. Let our team of expert AWS consultants guide you through selection, implementation, maintenance and security.
Get More Information

Our Process

Collection → Ingestion → Preparation → Analytics/Data Science/ML → Presentation

Scale Your Data Pipeline Efficiently

Chariot Has Expertise In:

Data Lakes

Streaming Data

Big Data Databases

Analytics Pipelines

Success Stories

Articles, Tutorials, and Writing

Rightsizing Data for Athena

15 Minutes With: Keith Gregory on Building a Data Pipeline for Better Business Operations

Using CodeArtifact with Poetry

Building Lambdas with Poetry

We’re proud to be a Certified AWS Partner.

Our Process

Get In Touch

Partner with Chariot’s Cloud Team. Let’s start a conversation about your project.