Sam Hooke

The Important Files: Part 9

TL;DR: Backup status was showing as “Idle” even though logs indicate backups had been succeeding. Decided to accept the rsync.net request to update my account to the new format in case that was (in part) responsible.

Backup status is showing as red, with “Idle Days” at 97, implying a backup has not succeeded for a long time. Let’s investigate.

First, let’s manually run a backup:

root@fnbbu:~ # ./borg_backup_from_jail.sh
***START***
Running backup job
2024-04-12 17:05:17
Creating local backup
2024-04-12 17:05:17
------------------------------------------------------------------------------
Archive name: fnbbu-2024-04-12T17:05:21
Archive fingerprint: c03fc2932f443e02e0be96fbda83492ef4bad30a328282b78fd170e50128c137
Time (start): Fri, 2024-04-12 17:05:22
Time (end):   Fri, 2024-04-12 17:06:18
Duration: 56.63 seconds
Number of files: 42386
Utilization of max. archive size: 0%
------------------------------------------------------------------------------
                       Original size      Compressed size    Deduplicated size
This archive:              275.89 GB            274.59 GB              7.15 MB
All archives:                4.73 TB              4.70 TB            269.60 GB

                       Unique chunks         Total chunks
Chunk index:                  139444              2414201
------------------------------------------------------------------------------
Creating remote backup
2024-04-12 17:06:22
Remote: compaction freed about 1.58 kB repository space.
------------------------------------------------------------------------------
Archive name: fnbbu-2024-04-12T17:06:23
Archive fingerprint: 7537cc5b56001aa788a288cda57f3da210da71bfb8816d3e24d3085c21cb468a
Time (start): Fri, 2024-04-12 17:06:26
Time (end):   Fri, 2024-04-12 17:07:06
Duration: 39.93 seconds
Number of files: 42386
Utilization of max. archive size: 0%
------------------------------------------------------------------------------
                       Original size      Compressed size    Deduplicated size
This archive:              275.89 GB            274.59 GB              7.04 MB
All archives:                4.73 TB              4.70 TB            269.59 GB

                       Unique chunks         Total chunks
Chunk index:                  139394              2415035
------------------------------------------------------------------------------
Pruning local backups
2024-04-12 17:07:14
Keeping archive: fnbbu-2024-04-12T17:05:21            Fri, 2024-04-12 17:05:22 [c03fc2932f443e02e0be96fbda83492ef4bad30a328282b78fd170e50128c137]
Keeping archive: fnbbu-2024-04-09T05:00:10            Tue, 2024-04-09 05:00:11 [896783e635e0f18fbda9f3127b82c80789aaeb81a42dd602abd180e11b8728a8]
Keeping archive: fnbbu-2024-04-08T05:00:04            Mon, 2024-04-08 05:00:05 [358d96e6174d9984af39c9edf87f2d60f287fd1151ef058e4a0137666beeeaf8]
Keeping archive: fnbbu-2024-04-07T05:00:12            Sun, 2024-04-07 05:00:13 [67f973744caef502eaf6dfb7ea6e36f3a2ec5b9326c68c8b2234668f6ee1aa6b]
Keeping archive: fnbbu-2024-01-05T05:00:09            Fri, 2024-01-05 05:00:10 [d899f30c3379e802499540d8088073bf7ec4ee7ef03c745b9eed60b3235d8253]
Keeping archive: fnbbu-2024-01-04T05:00:04            Thu, 2024-01-04 05:00:05 [6080af4bddb85cd0b1b93cde54d26c1cbc7bcf25ec9541d0048b334e3507f430]
Keeping archive: fnbbu-2024-01-03T05:00:00            Wed, 2024-01-03 05:00:01 [b8f6e2518e5a7963af1e6c60b52d61b3865d7d7c9f4fd63632c6f62d558adea8]
Pruning archive: fnbbu-2024-01-02T05:00:12            Tue, 2024-01-02 05:00:12 [e956333b5051f64fdb03647e00c0ada45e096182c230902efa398b7a1101052d] (1/1)
Keeping archive: fnbbu-2023-12-31T05:00:04            Sun, 2023-12-31 05:00:05 [5ad329200cc1d813ab8a3fe3af8aa4860ebf74c10f001cee1930e549d6200998]
Keeping archive: fnbbu-2023-12-22T05:00:07            Fri, 2023-12-22 05:00:08 [e5b47a031eb85c2dd376d84985ee93d4f209555ca144c5d4a9b320c360b1ffd2]
Keeping archive: fnbbu-2023-12-17T05:00:07            Sun, 2023-12-17 05:00:08 [e38b63712676b2fdd675eb8d1ee3ff9fb3e7872bdda6db7b4fbd4895fd16ee9a]
Keeping archive: fnbbu-2023-10-14T05:00:08            Sat, 2023-10-14 05:00:09 [f20fd2dcd1649a4bfcd1d796f13e60e6e591c08f4f32ee4439d6c54f6c89d867]
Keeping archive: fnbbu-2023-05-23T05:00:06            Tue, 2023-05-23 05:00:07 [f88a568e32a714dd5478264188419b70cec0ee14e73a7feb30865c1d8618133e]
Keeping archive: fnbbu-2023-04-17T05:00:03            Mon, 2023-04-17 05:00:04 [5cf3beea47595b09963c80161c63cf595798d29d8fc2c69e01ed9e59d3afc5fe]
Keeping archive: fnbbu-2023-03-17T05:00:07            Fri, 2023-03-17 05:00:08 [d336298496187c5bddd32ad7bc3f6e5d01b51706e37d4db016b246497f778307]
Keeping archive: fnbbu-2023-02-28T05:00:07            Tue, 2023-02-28 05:00:08 [9108fd5b0a52e94e80a4444e029ba8c57ecc197007db42c59da2c1497e6cdc23]
Keeping archive: fnbbu-2023-01-16T05:00:01            Mon, 2023-01-16 05:00:02 [d35429d0ade9f8372bad0240781113815c92e28d01546226b9c392813eb2e2c9]
Keeping archive: fnbbu-2022-12-31T05:00:13            Sat, 2022-12-31 05:00:14 [65461f214943a720c21ad2777ebba388877b686d3193a3702452cef0ed4d0ce8]
Pruning remote backups
2024-04-12 17:07:21
Keeping archive: fnbbu-2024-04-12T17:06:23            Fri, 2024-04-12 17:06:26 [7537cc5b56001aa788a288cda57f3da210da71bfb8816d3e24d3085c21cb468a]
Keeping archive: fnbbu-2024-04-09T05:00:59            Tue, 2024-04-09 05:01:02 [f8eb68ce5668d90c1e62d35cf9ef37ee5b77ecfbae48f6c2e6eb78327a4060a1]
Keeping archive: fnbbu-2024-04-08T05:01:06            Mon, 2024-04-08 05:01:09 [a42c470c93f1de8fe97d9447601e60d5e86b9916c3715429709c82f25e10c6fe]
Keeping archive: fnbbu-2024-04-07T05:01:13            Sun, 2024-04-07 05:01:16 [5c837da29dc332d7eb20ab643d2174d166b54db1c959608bf715f04137edd889]
Keeping archive: fnbbu-2024-01-05T05:01:03            Fri, 2024-01-05 05:01:06 [2f1c01cdf6826d691038f569d6932ad9417b4cb7a3877d95ccf6ba153d39e25b]
Keeping archive: fnbbu-2024-01-04T05:00:56            Thu, 2024-01-04 05:00:58 [2c42543f1a59a3336597ef0f50388567ce8d6236a8bca1121a7ded5c86e88be1]
Keeping archive: fnbbu-2024-01-03T05:00:50            Wed, 2024-01-03 05:00:54 [198006e9c13c19b6e5c8d8976358a6be1638b3f132ce3b5f7379d74b0dd07144]
Pruning archive: fnbbu-2024-01-02T05:01:01            Tue, 2024-01-02 05:01:06 [05fba6feb76b471787f73cbd19cbcad219564306c9b3c2647bf9f3b14c92614e] (1/1)
Keeping archive: fnbbu-2023-12-31T05:04:00            Sun, 2023-12-31 05:04:03 [e9f74b65f8f4690c4a694161db190673d4a2ac9d42d8f2d56d02d0f42f60ce8a]
Keeping archive: fnbbu-2023-12-22T05:00:56            Fri, 2023-12-22 05:01:00 [7d16c08e2b9baa4204026ded25ff8d675396627ed384dff83cebd46fe8cd0d66]
Keeping archive: fnbbu-2023-12-17T05:06:48            Sun, 2023-12-17 05:06:52 [0893b0ce5b750c76d7a249262ca40ebdb417f459a70f58783addc4bfee812f64]
Keeping archive: fnbbu-2023-10-14T05:00:57            Sat, 2023-10-14 05:01:00 [510f0ab0fe4a61212f13fee9d6a0b29f71b5e6bfd86a4d9e9f0f4643bd6aa297]
Keeping archive: fnbbu-2023-05-23T05:08:31            Tue, 2023-05-23 05:08:36 [ac6d428a5b4bf4361b695614a1c81a0c94067f9c5afc8a34da475dbd1ee227b8]
Keeping archive: fnbbu-2023-04-17T05:00:52            Mon, 2023-04-17 05:00:57 [5c4836675a431da320f5b0ce54ed727a484a2f0aa8119f4800b8726eca114c53]
Keeping archive: fnbbu-2023-03-17T05:00:54            Fri, 2023-03-17 05:00:59 [0baccfb4a66976075ce4337065d9a8ea7777621752c8bf6ef7dd96691494e178]
Keeping archive: fnbbu-2023-02-28T05:00:54            Tue, 2023-02-28 05:00:59 [dbffcba395442ea550f309a00641d526fd4cb125d5b99e2bc97231925711784a]
Keeping archive: fnbbu-2023-01-16T05:00:46            Mon, 2023-01-16 05:00:51 [b13699f3afe8c2eb85ddba0f06fb05c7c614b6e408d771daebe2dc2abca16f0d]
Keeping archive: fnbbu-2022-12-31T05:00:55            Sat, 2022-12-31 05:01:00 [9303f3a234b64c2dc1c6b992e68715f88107d749619e0e943f873c0db7ffdace]
Remote: compaction freed about 7.03 MB repository space.
Finished backup job
2024-04-12 17:07:31
***END***

Looks like it is working.

Let’s check the log to see how past backups have been doing:

root@fnbbu:~ # less backup.log
***START***
Running backup job
2024-01-04 05:00:04
Creating local backup
2024-01-04 05:00:04
Creating remote backup
2024-01-04 05:00:55
Pruning local backups
2024-01-04 05:01:44
Pruning remote backups
2024-01-04 05:01:52
Finished backup job
2024-01-04 05:02:01
***END***
***START***
Running backup job
2024-01-05 05:00:09
Creating local backup
2024-01-05 05:00:09
Creating remote backup
2024-01-05 05:01:02
Pruning local backups
2024-01-05 05:01:52
Pruning remote backups
2024-01-05 05:02:02
Finished backup job
2024-01-05 05:02:13
***END***
***START***
Running backup job
2024-04-07 05:00:10
Creating local backup
2024-04-07 05:00:10
Creating remote backup
2024-04-07 05:01:12
Pruning local backups
2024-04-07 05:02:03
Pruning remote backups
2024-04-07 05:02:09
Finished backup job
2024-04-07 05:02:18
***END***
***START***
Running backup job
2024-04-08 05:00:02
Creating local backup
2024-04-08 05:00:02
Creating remote backup
2024-04-08 05:01:05
Pruning local backups
2024-04-08 05:01:55
Pruning remote backups
2024-04-08 05:02:02
Finished backup job
2024-04-08 05:02:11
***END***
***START***
Running backup job
2024-04-09 05:00:10
Creating local backup
2024-04-09 05:00:10
Creating remote backup
2024-04-09 05:00:58
Pruning local backups
2024-04-09 05:01:46
Pruning remote backups
2024-04-09 05:01:52
Finished backup job
2024-04-09 05:02:01
***END***

The log looks good. It appears to have been running backups without issues. And yet rsync.net says “Idle Days” are 97?

I have a request to upgrade. Perhaps this is related:

IMPORTANT NOTICE: We would like to upgrade/update your account, please read on

Re: 98765

We deployed a new username@hostname format several years ago that makes accounts more portable and thus allows us to seamlessly move accounts to more resilient and fault tolerant infrastructure that we’ve been building over the past 4-5 years.

We would like to switch your account to this new format. When the switch is complete you will receive a new username and server hostname, but your data will not be impacted as will all authentication tokens (password and SSH keys will be preserved). Your billing will also not change. The only action you would need to make would be to adjust your username and hostname in your backup configuration.

Please email us and let us know when it would be convenient to make this switch. After the switch is made we will send you the new login information.

While this is not mandatory, you are strongly encouraged to make this switch when convenient.

Note- once your account is migrated you will be connecting to a newer, more compliant sshd. If you are connecting from older hosts it’s possible they will have some issues connecting to the new sshd. We encourage you to check your connections once you’ve updated your config. If you have any issues connecting please let us know so we can provide a workaround.

Okay, let’s reply and give the go ahead:

mailto:support@rsync.net?subject=Upgrade Request - 98765&body=Please update my account(s): 98765 at your earliest convenience.

Sent the email on 2024-04-19 @ 19:55. Upgrade happened same day @ 22:38. Speedy!