Elastic Beanstalk allows deploying and managing applications in the AWS Cloud without having to learn about the infrastructure that runs those applications. With Elastic Beanstalk you can run a website, web application, or web API that serves HTTP requests but you can also run a worker applications for running long tasks. The Elastic Beanstalk supports several preconfigured platforms including Go, ...
Read More »An AWS Elasticsearch Post-Mortem
So it happened that we had a production issue on the SaaS version of LogSentinel – our Elasticsearch stopped indexing new data. There was no data loss, as elasticsearch is just a secondary storage, but it caused some issues for our customers (they could not see the real-time data on their dashboards). Below is a post-mortem analysis – what happened, ...
Read More »Running a Safe Database Cluster in AWS With Auto-Scaling Groups
When you have to run a scalable application on AWS, your database must also be scalable. It’s easier to scale the stateless application layer, where each node is mostly disposable – even if a node in a 3-node cluster fails, you can just fire up another one and nobody notices. The database layer is stateful and therefore there’s a risk ...
Read More »Autoscaling Groups with terraform on AWS Part 3: Elastic Load Balancer and health check
Previously we set up some Apache Ignite servers in an autoscaling group. The next step is to add a Load Balancer in front of the autoscaling group. Before any steps let’s add some environmental variables to variables.tf. 1 2 3 4 5 6 7 8 9 variable "autoscalling_group_elb_name" { type = string default = "autoscallinggroupelb" } variable "elb_security_group_name" { ...
Read More »Autoscaling Groups with terraform on AWS Part 2: Instance security group and Boot Script
Previously we followed the minimum steps required in order to spin up an autoscaling group in terraform.On this post we shall add a security group to the autoscaling group and an http server to serve the requests. Using our base configuration we shall create the security group for the instances. 01 02 03 04 05 06 07 08 09 10 ...
Read More »Autoscaling Groups with terraform on AWS Part 1: Basic Steps
So you want to create an autoscaling group on AWS using terraform. The following are the minimum steps in order to achieve so. Before writing the actual code you shall specify the aws terraform provider as well as the region on the provider.tf file. 1 2 3 4 5 6 7 8 provider "aws" { version = "~> 2.0" region ...
Read More »Extending the AWS Ecosystem with Universal Data Access
Amazon Web Services (AWS) helps organizations host and manage their data processes, like building data visualizations and performing ETL tasks. At CData, we make it easy to connect AWS Services with heterogeneous business applications and distributed data stores to ultimately help businesses develop a more holistic analysis of their data. With CData’s comprehensive connectivity between AWS and 150+ SaaS, Big ...
Read More »SQL as a Service
I’ve been thinking about this since 2007, somewhere around the time S3 was launched by Amazon. I even tried to implement it a few times, but failed right after the design phase. I’ve heard about a startup, which tried to do it too, but also failed. I’m still not sure whether it’s possible to do, but it could definitely become ...
Read More »Database Week at the AWS Loft
Here are my notes: https://databaseweekoctober2019sf.splashthat.com Databases on AWS: The Right Tool for the Right Job I’m not taking super deep notes for many of these talks. I’m focusing on the highlights. PostgreSQL came after MySQL. 8 categories of DBs on AWS: RelationalKey valueDocumentIn-memoryGraphSearchTime seriesLedger Search for: AWS Database Services For relational, they have Amazon Aurora. It’s compatible with MySQL and ...
Read More »