TheDeveloperBlog.com

Home | Contact Us

C-Sharp | Java | Python | Swift | GO | WPF | Ruby | Scala | F# | JavaScript | SQL | PHP | Angular | HTML

AWS | Cross Region Replication

AWS | Cross Region Replication with aws, tutorial, introduction, amazon web services, aws history, features of aws, aws free tier, storage, database, network services, redshift, web services etc.

<< Back to AWS

Cross Region Replication

  • Cross Region Replication is a feature that replicates the data from one bucket to another bucket which could be in a different region.
  • It provides asynchronous copying of objects across buckets. Suppose X is a source bucket and Y is a destination bucket. If X wants to copy its objects to Y bucket, then the objects are not copied immediately.

Some points to be remembered for Cross Region Replication

  • Create two buckets: Create two buckets within AWS Management Console, where one bucket is a source bucket, and other is a destination bucket.
  • Enable versioning: Cross Region Replication can be implemented only when the versioning of both the buckets is enabled.
  • Amazon S3 encrypts the data in transit across AWS regions using SSL: It also provides security when data traverse across the different regions.
  • Already uploaded objects will not be replicated: If any kind of data already exists in the bucket, then that data will not be replicated when you perform the cross region replication.

Use cases of Cross Region Replication

  • Compliance Requirements
    By default, Amazon S3 stores the data across different geographical regions or availability zone to have the availability of data. Sometimes there could be compliance requirements that you want to store the data in some specific region. Cross Region Replication allows you to replicate the data at some specific region to satisfy the requirements.
  • Minimize Latency
    Suppose your customers are in two geographical regions. To minimize latency, you need to maintain the copies of data in AWS region that are geographically closer to your users.
  • Maintain object copies under different ownership: Regardless of who owns the source bucket, you can tell to Amazon S3 to change the ownership to AWS account user that owns the destination bucket. This is referred to as an owner override option.

Let's understand the concept of Cross Region Replication through an example.

  • Sign in to the AWS Management Console.
  • Now, we upload the files in a jtpbucket. The jtpbucket is an s3 bucket created by us.
Cross Region Replication
  • Add the files in a bucket.
Cross Region Replication
  • Now, we add two files in a bucket, i.e., version.txt and download.jpg.
Cross Region Replication
  • Now, we create a new bucket whose name is jtp1bucket with a different region.
Cross Region Replication

Now, we have two buckets, i.e., jtpbucket and jtp1bucket in s3.

  • Click on the jtpbucket and then move to the Management of the jtpbucket.
Cross Region Replication
  • Click on the Replication. On clicking, the screen appears as shown below:
Cross Region Replication
  • Click on the Get started button.
  • Enable the versioning of both the buckets.
  • You can either replicate the entire bucket or tags to the destination bucket. Suppose you want to replicate the entire bucket and then click on the Next.
Cross Region Replication
  • Enter your destination bucket, i.e., jtp1bucket.
Cross Region Replication
  • Create a new IAM role, and the role name is S3CRR and then click on the Next.
Cross Region Replication
  • After saving the settings, the screen appears as shown below:
Cross Region Replication

The above screen shows that the Cross region replication has been updated successfully. We can also see the source bucket and destination with their associated permissions.

  • Now, we will see whether the files have been replicated from jtpbucket to the jtp1bucket. Click on the jtp1bucket.
Cross Region Replication

The above screen shows that the bucket is empty. Therefore, we can say that the objects do not replicate from one bucket to another bucket automatically, we can replicate only by using AWS CLI (Command Line Interface). To use the AWS CLI, you need to install the CLI tool.

  • After installation, open the cmd and type aws configure.
Cross Region Replication
  • Now, we need to generate the Access Key ID which is a user name and secret access key which is a password. To achieve this, we first need to create an IAM Group.
Cross Region Replication
  • Set the Group Name, i.e., TheDeveloperBlog.
Cross Region Replication
  • Check the AdministratorAccess policy to access the AWS console through AWS CLI.
  • Now, create an IAM User.
  • Add the user name with programmatic access.
Cross Region Replication
  • Add the user to a group, i.e., TheDeveloperBlog.
Cross Region Replication
  • Finally, the user is created.
Cross Region Replication

From the above screen, we observe that access key and scret access key have been generated.

  • Copy the access key and secret access key to the cmd.
Cross Region Replication
  • To view the S3 buckets, run the command aws s3 ls.
Cross Region Replication
  • To copy the objects of jtpbucket to jtp1bucket, run the command aws s3 cp?recursive s3://jtpbucket s3://jtp1bucket.
Cross Region Replication

The above screen shows that the objects of jtpbucket have been copied to the jtp1bucket.

  • Click on the "jtp1bucket".
Cross Region Replication

From the above screen, we observed that all the files in the original bucket have been replicated to another bucket, i.e., jtp1bucket.

Note: If any further changes made in the original bucket will always be copied to its replicated bucket.

Important points to be remembered:

  • Versioning must be enabled on both the source and destination buckets.
  • The regions of both the buckets must be unique.
  • All the files in an original bucket are not replicated automatically, and they can be replicated through AWS CLI. All the subsequent files are replicated automatically.
  • Files in a file cannot be replicated to multiple buckets.
  • Delete markers are not replicated.
  • Delete versions or Delete markers are not replicated.





Related Links:


Related Links

Adjectives Ado Ai Android Angular Antonyms Apache Articles Asp Autocad Automata Aws Azure Basic Binary Bitcoin Blockchain C Cassandra Change Coa Computer Control Cpp Create Creating C-Sharp Cyber Daa Data Dbms Deletion Devops Difference Discrete Es6 Ethical Examples Features Firebase Flutter Fs Git Go Hbase History Hive Hiveql How Html Idioms Insertion Installing Ios Java Joomla Js Kafka Kali Laravel Logical Machine Matlab Matrix Mongodb Mysql One Opencv Oracle Ordering Os Pandas Php Pig Pl Postgresql Powershell Prepositions Program Python React Ruby Scala Selecting Selenium Sentence Seo Sharepoint Software Spellings Spotting Spring Sql Sqlite Sqoop Svn Swift Synonyms Talend Testng Types Uml Unity Vbnet Verbal Webdriver What Wpf