Contact Us

Posts by Ian Pye, Co-founder & Principal Engineer

Designing for Database Fairness

By Ian Pye, Co-founder & Principal Engineer | Dec 21, 2015
Network Management, Technology

Kentik Detect is powered by Kentik Data Engine (KDE), a massively-scalable distributed HA database. One of the challenges of optimizing a multitenant datastore like KDE is to ensure fairness, meaning that queries by one customer don’t impact performance for other customers. In this post we look at the algorithms used in KDE to keep everyone happy and allocate a fair share of resources to every customer’s queries.

Read More

Metrics for Microservices

By Ian Pye, Co-founder & Principal Engineer | Nov 16, 2015
Network Management, Technology

Kentik Detect handles tens of billions of network flow records and many millions of sub-queries every day using a horizontally scaled distributed system with a custom microservice architecture. Instrumentation and metrics play a key role in performance optimization.

Read More

Transcending MySQL-Based NetFlow Analysis

By Ian Pye, Co-founder & Principal Engineer | Oct 12, 2015
Case Study

For many of the organizations we’ve all worked with or known, SNMP gets dumped into RRDTool, and NetFlow is captured into MySQL. This arrangement is simple, well-documented, and works for initial requirements. But simply put, it’s not cost-effective to store flow data at any scale in a traditional relational database.

Read More

PostgreSQL Foreign Data Wrappers

By Ian Pye, Co-founder & Principal Engineer | Sep 11, 2015
How-To

Relational databases like PostgreSQL have long been dominant for data storage and access, but sometimes you need access from your application to data that’s either in a different database format, in a non-relational database, or not in a database at all. As shown in this “how-to” post, you can do that with PostgreSQL’s Foreign Data Wrapper feature.

Read More