DEV Community

Setup for AWS centralised logging

Dharshan Bharathuru on February 05, 2019

What will be a better setup for centralised logging(application logs) for multiple instances(rails apps) running behind an AWS application load balancer?

- ELK (manual setup)
- AWS ElasticSearch
- APN (AWS Partner Networks) like datadog, spluk
Collapse
 
samuelabreu profile image
Samuel Abreu

Why not cloudwatch?

Collapse
 
dharshann profile image
Dharshan Bharathuru

I'm using cloudwatch for different system/app metric alarms now. Didn't know it can also be used for centralised logging. Any useful link/writeup you like to share?

Collapse
 
samuelabreu profile image
Samuel Abreu

Never used but i think it's easy to integrate with third party logging services, for example (splunk.com/blog/2017/02/03/how-to-...)

Collapse
 
shenril profile image
Shenril

I would go with the official documentation
docs.aws.amazon.com/AmazonCloudWat...

You basically watch file and send them into streams

As good as it is for central logging, I still find the UI and search functionalities really poor compared to the other solutions you mentioned

Collapse
 
belynlai profile image
Belyn

Full disclosure, I work for Elastic (we make Elasticsearch).

You could also try Elasticsearch Service with the Elastic Stack 6.6 (Logs UI, Hot/Warm + index curation + APM server).

Here's a link our users find helpful: elastic.co/cloud/elasticsearch-ser...