3 Tools for Testing Microservices

3 Tools for Testing Microservices

Testing microservices can be tricky; in this post I’ll cover some tools that can help you do so. But first, how exactly should you test your microservices?

This is a special case of a broader question: how should you test your software? The answer I’ve come up with over the past few years is that there are four types of testing, and you need to use each one at different points in a product’s lifecycle:

1. Understanding Users: using methods like A/B testing and usability testing, your goal is to discover what you users need and what problems they are having.
2. Correct Functionality: using manual testing, code review and the like, your goal is to ensure your software is correct, that it matches its specification.
3. Preventing Change: using unit tests and other automated tests, your goal is to prevent unwanted changes from being introduced into your code.
4. Understanding Runtime Behavior: by stress testing, load testing and monitoring of your production system, your goal is to discover what operational problems your software has.

This testing model is the result of personal experiences and failures outside the realm of microservices. But since the model is generic it can be applied to microservices as well, so in this post I’d like to share three tools that can enable these necessary forms of testing.

Preventing Change with Hoverfly

A microservice will rarely stand alone: it will rely on cloud infrastructure like databases, as well as on other microservices. These dependencies will present an API, which is by its nature is expected to be stable. This then is the realm of automated tests, whose goal is to prevent change: you want to assure yourself your interactions with other APIs don’t change unexpectedly when you change your code.

Hoverfly is a tool for simulating APIs, and simulating latency and failures in your APIs. This allows you to write automated tests that can run independently of other microservices.

Understanding Runtime Behavior with Lyft Envoy and Ambassador

When you’re running many microservices you want to expose them all easily, and one way to do that is with an API gateway. Edge Stack is an API gateway from Ambassador Labs that builds on Lyft’s Envoy proxy and communication bus, allowing microservices to easily register their public API endpoint.

Once you’re running your microservices in production you want to understand how they’re behaving. Envoy provides a variety of ways to get statistics about traffic and monitor messages; see Ambassador’s documentation for details on how to get this information with Ambassador.

Correct Functionality with Telepresence

If you want to make sure your software is behaving correctly, or you need to debug a complex problem, there’s no substitute for human judgment: only a person can tell you whether something is correct behavior. Telepresence allows you to swap out running code in a staging Kubernetes or OpenShift cluster, replacing it with code running on your laptop. That means you can manually try out your code in a realistic environment, or step through your code with a debugger as you reproduce the problem in a real environment.

Beyond tools

Tools can help you test your software, but in the end the most important decision you’ll make is how to test your software.