Amazon ElastiCache

Amazon ElastiCache is a fully managed in-memory data store and cache service by Amazon Web Services (AWS). The service improves the performance of web applications by retrieving information from managed in-memory caches, instead of relying entirely on slower disk-based databases. ElastiCache supports two open-source in-memory caching engines: Memcached and Redis (also called “ElastiCache for Redis”).^[1]

As a web service running in the computing cloud, Amazon ElastiCache is designed to simplify the setup, operation, and scaling of memcached and Redis deployments. Complex administration processes like patching software, backing up and restoring data sets and dynamically adding or removing capabilities are managed automatically. Scaling ElastiCache resources can be performed by a single API call.^[2]

Amazon ElastiCache was first released on 22 August 2011,^[3] supporting memcached. This was followed by support for reserved instances on 5 Apr 2012^[4] and Redis on 4 Sep 2013.^[5]

Uses

As a managed database service with multiple supported engines, Amazon ElastiCache has a wide range of uses, including

Performance acceleration

Database limitations are often a bottleneck for application performance. By placing Amazon ElastiCache between an application and its database tier, database operations can be accelerated.^[6]

Cost reduction

Using ElastiCache for database performance acceleration can significantly reduce the infrastructure needed to support the database. In many cases, the cost savings outweigh the cache costs. Expedia was able to use ElastiCache to reduce provisioned DynamoDB capacity by 90%, reducing total database cost by 6x.^[7][8]

Processing time series data

Using the Redis engine, ElastiCache can rapidly process time-series data, quickly selecting newest or oldest records or events within range of a point-in-time.^[9]

Leaderboards

Leaderboards are an effective way to show a user quickly where they currently stand within a gamified system. For systems with large numbers of gamers, calculating and publishing player ranks can be challenging. Using Amazon ElastiCache with the Redis engine can enable high-speed at scale for leaderboards.^[10]

Rate limitation

Some APIs only allow a limited number of requests per time period. Amazon ElastiCache for Redis engine can use incremental counters and other tools to throttle API access to meet restrictions.^[11]

Atomic counter

Programs can use incremental counters to limit allowed quantities, such as the maximum number of students enrolled in a course or ensuring a game has at least 2 but not more than 8 players. Using counters can create a race condition where an operation is allowed because a counter was not updated promptly. Using the ElastiCache for Redis atomic counter functions, where a single operation both checks and increments the counter’s value, prevents race conditions.^[12]

Chat rooms and message boards

ElastiCache for Redis supports publish-subscribe patterns, which enable the creation of chat rooms and message boards where messages are automatically distributed to interested users.^[13]

Deployment Options

Amazon ElastiCache can use on-demand cache nodes or reserved cache nodes.

On-demand nodes provide cache capacity by the hour, with resources in the AWS cloud assigned when a cache node is provisioned. An on-demand node can be removed from service by its owner at any time. Each month, the owner will be billed for the hours used.^[14]

Reserved nodes require a 1-year or 3-year commitment, which dedicates cache resources to the owner. The hourly cost of reserved nodes is significantly lower than the hourly cost of on-demand nodes.^[15]

Performance

An efficient cache can significantly increase application’s performance and user navigation speed. Amazon CloudWatch exposes ElastiCache performance metrics that can be tracked.^[16]

Key performance metrics

• Client metrics (measure the volume of client connections and requests): Number of current client connections to the cache, Get and Set commands received by the cache
• Cache performance: Hits, misses, Replication Lag, Latency
• Memory metrics: Memory usage, Evictions, Amount of free memory available on the host, Swap Usage, Memory fragmentation ratio
• Other host-level metrics: CPU utilization, Number of bytes read from the network by the host, Number of bytes written to the network by the host

Metric collection

Many ElastiCache metrics can be collected from AWS via CloudWatch or directly from the cache engine, whether Redis or Memcached, with a monitoring tool integrating with it:^[17]

• Using the AWS Management Console

Using the online management console is the simplest way to monitor ElastiCache with CloudWatch. It allows to set up basic automated alerts and to get a visual picture of recent changes in individual metrics.

• CloudWatch Command Line Interface

Metrics related to ElastiCache can also be retrieved using command lines. It can be used for spot checks and ad hoc investigations.

• Monitoring tool integrated with CloudWatch

The third way to collect ElastiCache metrics is via a dedicated monitoring tool integrating with Amazon CloudWatch.

Notable Customers

Users of Amazon ElastiCache include

• Airbnb^[18]
• Expedia^[19]
• Zynga^[20]
• FanDuel^[21]
• Mapbox^[22]

Limitations

As an AWS service, ElastiCache is designed to be accessed exclusively from within AWS, though it is possible to connect the service to applications and databases that are not hosted by AWS.^[23]

Alternatives

Other vendors provide cloud data cache services comparable to Amazon ElastiCache, including Redis To Go, Redis Labs, IBM Compose, openredis, Redis4You, RedisGreen and Rackspace ObjectRocket.

References

External links

Wikimedia Commons has media related to Amazon Web Services.

• Official website
• Official website for ElastiCache for Redis
• What is Redis?