DEV Community: R o r d a n ♨️

Manage AWS S3 Object Storage via the CLI

R o r d a n ♨️ — Wed, 30 Nov 2022 22:10:06 +0000

AWS S3 is a viable serverless object storage service that can be utilized via your command line.

A bucket is the name for the cloud storage and an object is the file within it.

To create a bucket, simply have your aws cli already configured and run the following command with the region in which you would like your storage to be hosted.

aws s3api create-bucket --bucket <name> --<region>

Sending data from your local directory straight to an s3 bucket can be done by utilizing the copy command.

aws s3 cp <local directory> <s3 bucket w/ path>

Call the local directory path with the s3 path-based naming style afterwards by appending s3:// as a prefix to the bucket name.

Note that the difference between using aws s3 vs aws s3api is that the s3api command reflects the operations of plain API commands, while as "aws s3" can be utilized for higher level commands such as file transferring.

View currently active s3 buckets with the following command.

aws s3api list-buckets

The data is neatly shown in JSON format with the name of each bucket and its creation date.

To view the contents of and individual bucket run

aws s3 ls <bucket name>

And lastly to clean up an environment, and in turn save on additional unwanted costs, its necessary to remove old s3 buckets and the objects within them.

Remove a bucket including all the contents within it, , and --force as an ending flag.

aws s3 rb s3://<bucket name> --force

Install Terraform and deploy an EC2 instance on AWS with code

R o r d a n ♨️ — Wed, 02 Nov 2022 21:37:30 +0000

Infrastructure as a Code is a common DevOps practice used to automate the provisioning of cloud resources. Terraform is a third-party open source software that enables deployment and connectivity to the vast majority of Cloud Service Providers.

To begin using Terraform, it's first necessary to create a terraform file within your Integrated Development Environment (IDE).

The touch command creates a file, it can be named anything as long as the suffix of '.tf' is appended to the end indicating it will be written in terraform. Then entering code before your file name will open the file onto your main workspace.

Next install a Terraform extension for autocompletion and code highlighting. I went with the extension offered by the creators of Terraform, HashiCorp.

There are two methods to provide authentication, your access key and secret access key from AWS can either be exported with the following commands via the AWS CLI;

export AWS_ACCESS_KEY_ID=
export AWS_SECRET_ACCESS_KEY=

Or directly hardcoded into your script as such;

From the Terraform documentation there is an example template listed under AWS which will use JSON code to enable automation for the creation of an ec2 instance.

The only change I made to this section of code is my Amazon Machine Image selection. Via the AWS AMI Catalog, which can be found under AWS EC2 in the console, I went with the latest Ubuntu image.

And proceeded to copy and paste the AMI id into its respective line of code.

Next, to install Terraform from your Linux CLI, use the following commands;

wget -O- https://apt.releases.hashicorp.com/gpg | gpg --dearmor | sudo tee /usr/share/keyrings/hashicorp-archive-keyring.gpg
echo "deb [signed-by=/usr/share/keyrings/hashicorp-archive-keyring.gpg] https://apt.releases.hashicorp.com $(lsb_release -cs) main" | sudo tee /etc/apt/sources.list.d/hashicorp.list
sudo apt update && sudo apt install terraform

Troubleshooting
If the installation does not work when all three commands are pasted at once, retry the installation line by line instead.

If there is an error message regarding a source list not being read, remove the hashicorp.list file with sudo rm /etc/apt/sources.list.d/hashicorp.list .

And if an issue regarding a missing package named lsb_release is shown, use sudo apt update && apt install -y lsb-release to download the necessary package.

Once completed, the terraform -help command can be run to confirm the installation.

Use terraform init to initialize the configuration within the terraform file, which in this case links to AWS on the backend.

Use terraform plan to check for changes to the configuration. If no suggestions are shown make sure that the file has been saved with 'ctrl s'.

Re-run the terraform plan command and a list will appear.

Finally, run terraform apply to execute the suggested actions.

Back in the AWS EC2 Console we can confirm the initialization of our newly provisioned Instance, which after a few moments will begin running.

Alternatively, the instance status can also be checked via the AWS CLI with the following command;
aws ec2 describe-instances

Using CodeCommit with AWS free-tier

R o r d a n ♨️ — Fri, 21 Oct 2022 20:20:57 +0000

First I created a budget to alert me of any charges accrued on my account

Then added an admin user to perform duties within my account

Granted the necessary user permissions

Downloaded the csv file created for the user

Able to sign in with credentials

Changed the auto-generated password

Created a repository via CodeCommit

Downloaded necessary access information for HTTP connection

Copied clone link to initiate the session in VScode

Pasted the clone link

Started a new WSL terminal from within VScode

Using git add , able to put the demo files onto staging

Next, git commit -m "<message>" and git push can be used to complete the upload. Because this connection occurs over HTTPS, it will be necessary to insert the CSV credentials downloaded previously each time.

Versioning and can editing can now be done from within CodeCommit

Demo JSON code shown from w3schools

I can select edit and add any code

Highlighted where the change has been made

Code commit will log the changes and show exactly where the changes were made. If this were a production case, the change can then be reviewed here before being pushed to the master branch