Tutorials in ML, AWS, R and Java
When a data scientist starts a training job, it is useful to enforce tagging so that cost can be allocated to the training job. We need to enforce both the tag key and the value. For example, a tag key can be ‘project’ and its value could be ‘projectA’. The user should not be able … Read more
DeepSpeed library optimizes training and inference for foundational models. Learn more about its features.
Why S3 lifecycle policies S3 lifecycle policies allow you to do two things: Reduce cost by deleting data that is not longer required. Implement your security policies by : Retaining data for the required duration and reducing cost by moving it to low cost storage. Deleting data that you are not allowed to retain for … Read more
In this blog I will show you how to deploy a static website on Amazon S3, along with an HTTPS endpoint and content delivered by CloudFront CDN. Here’s a video of the steps Six steps to deploying a static website on Amazon S3 Step 1. Create a Bucket As the first step I create a … Read more
Encryption allows you to store objects in such a way that only an entity that has the encryption key, or access to the encryption key can access that object. S3 Encryption types There are five ways in which you can encrypt objects that you write to S3. S3 Server Side Encryption using Amazon S3 Managed … Read more
There are three ways to control access to s3 bucket and its objects Using bucket policies. Using bucket Access Control Lists (ACL) Using User policies ACL is used only in cases where Objects are not owned by the bucket owner. I.e. objects are uploaded by another account and the bucket owner does not own these … Read more
In this blog we will talk about S3 pricing. Important points to consider are: Pricing is based on region. In this blog we will look at pricing for Sydney region. Pricing varies based on storage used. The more storage you use, the lesser is the price per GB. Here’s the storage cost for 1000G in … Read more
Amazon Athena is a serverless query engine that allows you to query data in Amazon S3 using standard SQL. You can also use the query result to create another table. This table can then be used as a source of further analytics or reporting. For example : You can use Athena to perform feature engineering … Read more
Amazon SageMaker helps data scientists and Machine Learning developers build, train and deploy machine learning models. It includes Jupyter notebook to build and train model as well SageMaker API to train and deploy model with a few lines of code. Amazon CloudFormation helps in provisioning AWS resources using code. It automates provisioning and configuring resources … Read more
DynamoDB Basics DynamoDB Overview DynamoDb is an AWS managed NoSQL database. It offers the following: Encryption at rest Scale throughput without downtime On demand backup and point in time recovery Data stored in SSD and replicated accross multiple AZs. DynamoDB Components table –> items –> attributes DynamoDB tables table is a collection of data items. … Read more