Amazon S3 encryption

Encryption allows you to store objects in such a way that only an entity that has the encryption key, or access to the encryption key can access that object. S3 Encryption types There are five ways in which you can encrypt objects that you write to S3. S3 Server Side Encryption using Amazon S3 Managed … Read more

Amazon S3 access control and permissions

There are three ways to control access to s3 bucket and its objects Using bucket policies. Using bucket Access Control Lists (ACL) Using User policies ACL is used only in cases where Objects are not owned by the bucket owner. I.e. objects are uploaded by another account and the bucket owner does not own these … Read more

Amazon S3 pricing

In this blog we will talk about S3 pricing. Important points to consider are: Pricing is based on region. In this blog we will look at pricing for Sydney region. Pricing varies based on storage used. The more storage you use, the lesser is the price per GB. Here’s the storage cost for 1000G in … Read more

Batch Normalisation

Before we describe what Batch Normalisation is, here are a few introductory terms Internal covariate shift Stochastic Gradient Descent uses a minibatch of input to train the parameters of a layer. The input to a layer is the output from the previous layer. A change in the parameters of the previous layer causes a change … Read more

Distributed Machine Learning – Part 2 Architecture

Why Distributed Machine Learning? In the previous article we looked at how GPGPU, ASICS, AWS’s Inferentia, the new NVidia A100 chip and other advances in hardware have tremendously improved the performance of Machine Learning training and inference. However the increase in the volume of data and the increasing complexity of the machine learning models require … Read more

CloudFormation for SageMaker instance

Amazon SageMaker helps data scientists and Machine Learning developers build, train and deploy machine learning models. It includes Jupyter notebook to build and train model as well SageMaker API to train and deploy model with a few lines of code. Amazon CloudFormation helps in provisioning AWS resources using code. It automates provisioning and configuring resources … Read more