DEV Community: VineethKumar Marpadge

Unlocking the Power of CodeWhisperer in Your SageMaker Notebook: A Step-by-Step Guide.

VineethKumar Marpadge — Sat, 02 Sep 2023 14:10:35 +0000

In the world of data science and machine learning, having a seamless and efficient development environment is crucial. Amazon SageMaker has been a go-to platform for many data professionals, providing a collaborative space to build, train, and deploy machine learning models. But what if you could supercharge your SageMaker Notebook experience even further? That’s where CodeWhisperer comes into play.

In this article, we’ll walk you through the process of configuring CodeWhisperer in your SageMaker Notebook Instance, step by step. let’s dive right in.

Step 1: Customize Your Notebook Instance with a Script

To make sure CodeWhisperer is good to go every time you fire up your SageMaker Notebook, just follow these straightforward steps:

# Create a Lifecycle Configuration Script

Go to the SageMaker console at https://console.aws.amazon.com/sagemaker/.
On the left, click “Lifecycle configurations.”
Now, switch to the “Notebook Instance” tab.
Choose Create configuration
Give it a name (only letters, numbers, and hyphens, no spaces, please).
To make sure this script runs when you create and start a notebook, choose “Start notebook.”
Now, paste this script in the “Start notebook editor”:

    #!/bin/bash

    set -e

    # OVERVIEW
    # This script installs a single Jupyter Notebook server extension package in SageMaker Notebook Instance

    sudo -u ec2-user -i <<'EOF'

    # PARAMETERS
    PIP_PACKAGE_NAME=amazon-codewhisperer-jupyterlab-ext
    EXTENSION_NAME=amazon_codewhisperer_jupyterlab_ext

    source /home/ec2-user/anaconda3/bin/activate JupyterSystemEnv

    pip install $PIP_PACKAGE_NAME
    jupyter server extension enable $EXTENSION_NAME --py --sys-prefix

    source /home/ec2-user/anaconda3/bin/deactivate

    EOF

    # The restart command is dependent on the current running Amazon Linux and JupyterLab
    CURR_VERSION=$(cat /etc/os-release)
    if [[ $CURR_VERSION == *$"http://aws.amazon.com/amazon-linux-ami/"* ]]; then
        sudo initctl restart jupyter-server --no-wait
    else
        sudo systemctl --no-block restart jupyter-server.service
    fi

Click “Create configuration.”

# Update the Notebook Instance to use a Lifecycle Configuration Script

Open the SageMaker console at https://console.aws.amazon.com/sagemaker/.
Navigate to “Notebook instances.”
Select the notebook instance you want to update by clicking its name.
If the notebook status isn’t “Stopped,” click “Stop” to halt the notebook instance.
Click “Edit” to open the Edit notebook instance page.
Under “Additional configuration,” select the lifecycle configuration created in step 1.1.
Click “Update Notebook Instance.”

Step 2: Updating the Notebook Instance Execution Role to Allow CodeWhisperer Usage

Open the SageMaker console at https://console.aws.amazon.com/sagemaker/.
Navigate to “Notebook instances.”
Select your notebook instance.
Scroll down to the “Permissions and encryption” section.
Grab the Notebook Instance Execution Role.
Update the role with the following policy:

    {
        "Version": "2012-10-17",
        "Statement": [
            {
                "Sid": "CodeWhispererPermissions",
                "Effect": "Allow",
                "Action": [
                    "codewhisperer:GenerateRecommendations"
                ],
                "Resource": "*"
            }
        ]
    }

Once you’ve updated the policy, Start Jupyter Labs and the CodeWhisperer extension will be enabled.

Conclusion

With these simple steps, you can enhance your SageMaker Notebook Instance with CodeWhisperer, unlocking a wealth of features and functionalities for your data science and machine learning projects. So, why wait? Give it a try and experience the difference yourself. Happy coding!

Connect with me on Linkedin

How I Cleared AWS Solution Architect Associate(SAA-C03) in 2 Weeks!

VineethKumar Marpadge — Mon, 07 Sep 2020 06:41:59 +0000

Hello Everyone !

I cleared "AWS Certified Solutions Architect - Associate(SAA-C03)" and I thought of sharing my preparations and exam experience in this blog so that it may be useful for others who are planning to take the exam.

One of the most in-demand qualifications for cloud engineers is the AWS Certified Solutions Architect - Associate certification. While the focus of this article will be on exactly how to pass it, especially if you are not a cloud engineer, it is important to note why this certification can be so valuable.

The Solutions Architect - Associate focuses on 4 different domains, each carrying a percentage weighting in the exam:

Design Secure Architectures (30%)
Design Resilient Architectures (26%)
Design High-Performing Architectures (24%)
Design Cost-Optimized Architectures (20%)

Pre-requisites

As per AWS guidelines, examinee should have one year of hands-on experience in designing architecture, performance architecture, cost-efficient, fault-tolerant, and scalable distributed systems on AWS.

Join an Online Course

Ultimate AWS Certified Solutions Architect Associate It's created by Stephane Maarek, one of my favorite instructors and another AWS Certified Solutions Architect & Developer.
AWS Certified Solutions Architect - Associate(SAA-C03) It's Adrian Cantrill Course.
AWS Certified Solutions Architect - Associate 2020 This is a free course on youtube created by edureka .This course can used an additional material to the above mentioned course. This provides has Cheat Sheets which can be very helpful for your preparation.

Practice Exams

1.AWS Certified Solutions Architect Associate SAA-C03 Practice Exams 2023

2.AWS Certified Solutions Architect Associate Practice Exams It consists of 6 practice tests .Each question has detailed explanations at the end of each set that will help you gain a deeper understanding of the AWS services. The explanation provides an overview of the topic, reference links to AWS docs and a rationale on why the option is correct or incorrect.

Exam Preparation

Step 1 : Complete All Udemy Modules.Take detailed notes and build an organized study guide.(spend at least 4-5 hours daily in learning and revising concepts)
Step 2: If still any doubt and you want to learn in a simple language, please refer this link to clear your doubt. I find it very helpful as sometimes, we may not be able to understand the Cloud Terminology. I watched this for VPC,Load balancer and other important series.
Step 3: Create a VPC ( Virtual Private Cloud ) with your own memory.
Step 4: Pick each service/topic mentioned in the exact guide, read its corresponding technical documentation and try to use that service from AWS Management Console using your free tier account.
Step 5: In addition to reading about individual services look at reference architectures and read the principles behind these - AWS | Application Architecture Center.
Step 6: Try to Practice as much as mock exam given in the udemy course and other free practice tests. Make sure concepts are clear.

Work on Hands-on AWS Labs

Practice inside AWS console is very important if you aspire to work as a Solution Architect for AWS Cloud. In general, I advise to join a course that also has practice labs and also opens an AWS free tier account.
Since you only remember if you do the stuff, these AWS practical sessions will help you to understand and memorize the services which you are reading like EC2, S3, DynamoDB, IAM, and others. You can sign up for a free AWS account here.

Read AWS White Papers

If you want to go one step more, you can also read AWS documentation as it provides the most up-to-date information, which is undoubtedly an essential factor given AWS is still evolving, and there are hundreds of updates to catch up.
Alternatively, you can also see videos of AWS weekly on ACloudGuru's youtube channel , which is a great way to keep up-to-date with new AWS changes. Here is the link to read AWS whitepapers.

Read FAQ's

Read FAQs of S3, IAM, EC2, VPC, SQS, Autoscaling, Elastic Load Balancer, EBS, RDS, Lambda, API Gateway, ECS. Here is the link to read AWS FAQ's.

Exam Tips

If you see any questions on DB read performance issue, always go for answers having Read Replica keyword in the option.
If you see any question on highly available architecture, always go for answers having Multi AZ keyword in the option.
If you see any question on traversing internet from Private subnet then always go for answers having NAT Gateway in the options.
If you are confused in selecting the preferred RDS DB name then always go for Aurora ( Amazon own DB ).
If you see any IOT devices in the keyword then go for Kinesis.
Do not assume that , we have to always the answers having Cost effective unless this is not asked in questions. Priority is high availability architecture.
I would suggest do not read for AWS Whitepapers as it will be at very high and expert level.
Security Group Vs NACL
S3 Storage Classes.
Fault tolerance and high availability both are different terms make sure while selecting the answer what solution will be the best.
Instead of setting up everything from scratch always prefer to use AWS managed services.
If you find more than one options are correct but you have to select any one of them, then go with the one which is most cost-effective.
Get hands-on experience through the free tier that AWS avails for its services

Exam Day

As part of check in process link for home , you have to take 6 photographs and upload (your face, your id, then your room (4 angles)
Have your passport or driving license ready. You can check the FAQ here link to see which all documents are accepted as ID proof.
Login 30 minutes before the exam and click on 'Begin exam' and start the check in process. If you face issues, process may go up to 1 hr. It took 50 minutes for me. (If everything goes fine, you can finish check-in process in 15 minutes)
During exam time, you need to be in front of the webcam full time. No break allowed! Also ensure no one enter the room during the exam.

Useful Links from AWS officials website

AWS certified solutions architect associate
AWS Exam guide
AWS Certifications FAQ's
AWS Sample Paper
AWS Whitepapers
All the best guys!!!