Restic - Revision history

Leo at 18:12, 21 November 2022

2022-11-21T18:12:32Z

← Older revision		Revision as of 18:12, 21 November 2022
Line 20:		Line 20:
	\|<code>restic backup --tag $tag /path/to/files</code>		\|<code>restic backup --tag $tag /path/to/files</code>
	\|-		\|-
	\|Show available snapshots		\|Show available snapshots and their snapshot IDs
	\|<code>restic snapshots</code>		\|<code>restic snapshots</code>
	\|-		\|-
	\|Restore a snapshot to the given destination		\|Restore a snapshot to the given destination
	\|<code>restic restore $snapshotid -t $destination</code>		\|<code>restic restore $snapshotid -t $destination</code>
			\|-
			\|Restore a specific file from a specific snapshot
			\|<code>restic restore $snapshotid -t $destination -i $path_to_file</code>
			\|-
			\|Mount a snapshot (to explore/restore)
			\|<code>restic mount $mountpoint</code>
	\|-		\|-
	\|Delete all snapshots and prune backend storage		\|Delete all snapshots and prune backend storage

Leo: /* AWS storage tiers */

2022-10-25T21:32:36Z

AWS storage tiers

← Older revision		Revision as of 21:32, 25 October 2022
Line 73:		Line 73:
	# <code>STANDARD_IA</code>, Standard-Infrequent Access. Minimum 30 day storage duration.		# <code>STANDARD_IA</code>, Standard-Infrequent Access. Minimum 30 day storage duration.
	# <code>ONEZONE_IA</code>, One Zone-Infrequent Access. Costs 20% less than S3 Standard-IA. Stores data in only one availability zone vs. the standard minimum of three. Minimum 30 day storage duration.		# <code>ONEZONE_IA</code>, One Zone-Infrequent Access. Costs 20% less than S3 Standard-IA. Stores data in only one availability zone vs. the standard minimum of three. Minimum 30 day storage duration.
	# <code>INTELLIGENT_TIERING</code>, Intelligent-Tiering. Costs $2.5 per 1,000,000 objects per month. Infrequently accessed data gets stored on the infrequent access tier at a reduced price ($0.0125 vs the standard $0.023 per GB/mo).		# <code>INTELLIGENT_TIERING</code>, Intelligent-Tiering. Costs $2.5 per 1,000,000 objects per month. Infrequently accessed data (older than 180 days / 6 months) gets stored on the infrequent access tier at a reduced price ($0.0125 vs the standard $0.023 per GB/mo).
	# <code>REDUCED_REDUNDANCY</code>		# <code>REDUCED_REDUNDANCY</code>

Leo: /* AWS storage tiers */

2022-10-25T21:30:55Z

AWS storage tiers

← Older revision		Revision as of 21:30, 25 October 2022
Line 67:		Line 67:
	==== AWS storage tiers ====		==== AWS storage tiers ====
	Restic backups to Amazon S3 will use the <code>STANDARD</code> storage class and supports some of the other instant retrieval storage classes. Restic does not officially support the slower retrieval storage classes including S3 Glacier Deep Archive since the program expects quick retrieval times to function. It also may incur additional early deletion fees when it tries to prune data blobs because it likely will need to rewrite (ie. delete and re-upload) data.		Restic backups to Amazon S3 will use the <code>STANDARD</code> storage class and supports some of the other instant retrieval storage classes. Restic does not officially support the slower retrieval storage classes including S3 Glacier Deep Archive since the program expects quick retrieval times to function. It also may incur additional early deletion fees when it tries to prune data blobs because it likely will need to rewrite (ie. delete and re-upload) data.

	Restic only supports the following storage classes:		Restic only supports the following storage classes:

	# <code>STANDARD</code>,		# <code>STANDARD</code>,
	# <code>STANDARD_IA</code>, Standard-Infrequent Access		# <code>STANDARD_IA</code>, Standard-Infrequent Access. Minimum 30 day storage duration.
	# <code>ONEZONE_IA</code>, One Zone-Infrequent Access. Costs 20% less than S3 Standard-IA. Stores data in only one availability zone vs. the standard minimum of three.		# <code>ONEZONE_IA</code>, One Zone-Infrequent Access. Costs 20% less than S3 Standard-IA. Stores data in only one availability zone vs. the standard minimum of three. Minimum 30 day storage duration.
	# <code>INTELLIGENT_TIERING</code>, Intelligent-Tiering		# <code>INTELLIGENT_TIERING</code>, Intelligent-Tiering. Costs $2.5 per 1,000,000 objects per month. Infrequently accessed data gets stored on the infrequent access tier at a reduced price ($0.0125 vs the standard $0.023 per GB/mo).
	# <code>REDUCED_REDUNDANCY</code>		# <code>REDUCED_REDUNDANCY</code>

Leo at 21:16, 25 October 2022

2022-10-25T21:16:35Z

← Older revision		Revision as of 21:16, 25 October 2022
Line 46:		Line 46:

	=== S3 compatible backend ===		=== S3 compatible backend ===
	~~Define~~ the ~~following~~ environment variables ~~before running <code>restic init</code>~~.		A S3 backed repository can be created by defining the AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY environment variables and then initializing a new repository using a s3 endpoint.

			# Set up the two environment variables.
	{{Highlight		{{Highlight
	\| code = export AWS_ACCESS_KEY_ID="***"		\| code = export AWS_ACCESS_KEY_ID="***"
	export AWS_SECRET_ACCESS_KEY="***"		export AWS_SECRET_ACCESS_KEY="***"
	~~export RESTIC_REPOSITORY="s3:https://s3-server/bucket-name"~~
	\| lang = text		\| lang = text
			}} On Oracle Cloud Infrastructure (OCI), you need to generate the AWS access key id and secret under Identity & Security -> Users -> your account -> Customer Secret Keys. The S3 repository on OCI follows this format: <code>https://<namespace>.compat.objectstorage.<region>.oraclecloud.com</code>, where <namespace> is given under your bucket information and region is found in your dashboard's URL. On AWS, you will need to set up a new user under IAM with a 'programmatic access' access type. You will then have to allow this account access (DeleteObject, GetObject, PutObject, ListBucket, GetBucketLocation) to this S3 resource. Once the account is created, you should be able to see its Access key ID and Secret access key.
			# Initialize the repository to use your S3 bucket.
			{{Highlight
			\| code = # export RESTIC_REPOSITORY="s3:https://s3-server/bucket-name"
			# restic init

			## Or, without defining RESTIC_REPOSITORY, specify the repository with -r
			# restic -r s3:https://s3-server/bucket-name init
			\| lang = terminal
	}}		}}
	~~On Oracle Cloud, you need~~ to ~~generate~~ the ~~AWS access key id and secret under Identity & Security -~~> ~~Users -~~> ~~your account~~ -~~> Customer Secret Keys~~. ~~The S3 repository follows this format~~: <code>~~https:~~//<~~namespace~~>.~~compat~~.~~objectstorage~~.<~~region~~>~~.oraclecloud.com~~</code>, ~~where~~ <~~namespace~~> ~~is given under your bucket information and region is found in your dashboard's URL~~.		# Provider a password to your new repository

			==== AWS storage tiers ====
			Restic backups to Amazon S3 will use the <code>STANDARD</code> storage class and supports some of the other instant retrieval storage classes. Restic does not officially support the slower retrieval storage classes including S3 Glacier Deep Archive since the program expects quick retrieval times to function. It also may incur additional early deletion fees when it tries to prune data blobs because it likely will need to rewrite (ie. delete and re-upload) data.
			Restic only supports the following storage classes:

			# <code>STANDARD</code>,
			# <code>STANDARD_IA</code>, Standard-Infrequent Access
			# <code>ONEZONE_IA</code>, One Zone-Infrequent Access. Costs 20% less than S3 Standard-IA. Stores data in only one availability zone vs. the standard minimum of three.
			# <code>INTELLIGENT_TIERING</code>, Intelligent-Tiering
			# <code>REDUCED_REDUNDANCY</code>

			See: https://aws.amazon.com/s3/storage-classes/

	{{Navbox Linux}}		{{Navbox Linux}}
	[[Category:Linux]]		[[Category:Linux]]
	[[Category:LinuxUtilities]]		[[Category:LinuxUtilities]]

Leo: Added categories and navbar

2022-01-03T06:17:47Z

Added categories and navbar

← Older revision		Revision as of 06:17, 3 January 2022
Line 54:		Line 54:
	}}		}}
	On Oracle Cloud, you need to generate the AWS access key id and secret under Identity & Security -> Users -> your account -> Customer Secret Keys. The S3 repository follows this format: <code>https://<namespace>.compat.objectstorage.<region>.oraclecloud.com</code>, where <namespace> is given under your bucket information and region is found in your dashboard's URL.		On Oracle Cloud, you need to generate the AWS access key id and secret under Identity & Security -> Users -> your account -> Customer Secret Keys. The S3 repository follows this format: <code>https://<namespace>.compat.objectstorage.<region>.oraclecloud.com</code>, where <namespace> is given under your bucket information and region is found in your dashboard's URL.

			{{Navbox Linux}}
			[[Category:Linux]]
			[[Category:LinuxUtilities]]

Leo: Initial Content

2022-01-02T00:27:29Z

Initial Content

New page

Restic is an open source backup program written in Golang and can run on Linux, Windows, and Mac.

Download: https://github.com/restic/restic/releases/latest

== Cheat sheet ==
{| class="wikitable"
!Description
!Command
|-
|Initialize a new repository
|<code>restic init</code>
|-
|Backup files
|<code>restic backup /path/to/files</code>
|-
|Backup files using a file list
|<code>restic backup --files-from=$filelist</code>
|-
|Backup files with a specific tag
|<code>restic backup --tag $tag /path/to/files</code>
|-
|Show available snapshots
|<code>restic snapshots</code>
|-
|Restore a snapshot to the given destination
|<code>restic restore $snapshotid -t $destination</code>
|-
|Delete all snapshots and prune backend storage
|<code>restic forget --prune</code>
|-
|Delete all snapshots except a specific tag
|<code>restic forget --keep-tag=$tag</code>
|}
To automate restic, you may want to pass in the repository password in the <code>RESTIC_PASSWORD</code> environment variable.

== Setup ==

=== Automate backups with cron ===
Add a cronjob:
{{Highlight
| code = # crontab -e
## Add:
## */15 * * * * . ~/.restic.env ; /usr/local/bin/restic backup --files-from=/root/restic.files --tag automated 2>> ~/restic.err >> ~/restic.log
| lang = terminal
}}

=== S3 compatible backend ===
Define the following environment variables before running <code>restic init</code>.
{{Highlight
| code = export AWS_ACCESS_KEY_ID="***"
export AWS_SECRET_ACCESS_KEY="***"
export RESTIC_REPOSITORY="s3:https://s3-server/bucket-name"
| lang = text
}}
On Oracle Cloud, you need to generate the AWS access key id and secret under Identity & Security -> Users -> your account -> Customer Secret Keys. The S3 repository follows this format: <code>https://<namespace>.compat.objectstorage.<region>.oraclecloud.com</code>, where <namespace> is given under your bucket information and region is found in your dashboard's URL.