This is caused by the way NovaBACKUP communicates with Amazon S3, and that the response is "paginated" but not processed by the NovaBACKUP client.
You can still backup more than 1000 items in a directory, but when attempting to restore data from the backup, via the NovaBACKUP client, you will only see the first 1000 items in any directory while in the Restore tab. Note: If your NovaBACKUP backup job to Amazon S3 has compression and encryption options disabled, at the job level, you would be able to utilize the Amazon AWS website to restore all of your data without requiring the NovaBACKUP client and you can still have Amazon S3's native encryption enabled on your backups if enabling encryption on the bucket itself via the AWS website (https://console.aws.amazon.com/s3); the limit does not affect in this case as you would be restoring the data via AWS website's own restore function and not via the backup client.
NovaStor Technical Support recommends performing your backups to S3 only after changing the following backup job [Settings], this will enable you to turn on versioning on the bucket if needed as well as be able to restore your data directly from S3 using any utility you want.
- ☐ Compress backup files
- i.e. Turn Compression OFF (the default option is ON)
- Do Not enable Encryption
- if you need this data encrypted, enable native encryption on the S3 Bucket instead inside the AWS website (https://console.aws.amazon.com/s3).
What you need to do is add a sub-directory for any set of data, on S3, that has more than 1000 items, as NovaBACKUP CAN NOT Iterate past the first 1000 items the way it is programmed using the LEGACY API/SDK (this is what is limiting the bucket you can choose as well).
In the S3 Bucket
Using this path as reference:
\path\to\data\<more than 1000 items here>\<actual docs>.abc
Start here when browsing the S3 bucket using something besides NovaBACKUP:
\path\to\data\
At this level, you should be seeing the directory with <more than 1000 items here>.
Add a directory, move data using either method below
A) Move up to 1000 items into the new folder, creating a new folder for each set of data, then restore from the new location.
OR
B) Restore the first 1000 items you can see on the Restore tab, then move these to a new directory (such as \path\to\data\00_Restored), then repeat for the next 1000 items until all directories are restored. This method does not move any data from the original location it was backed up from until it has already been restored.
In either case, you will need to perform a separate restore operation. To refresh the view on the Restore tab, open another backup from the list, then open the one you need and locate the data you need to restore.
Adjust Default Settings for NovaBACKUP
You can adjust the default settings for the restore job from the Main Menu ("N" logo at the top left) to specify the "Restore to" location, so you don't have to do it every time throughout this process.
Please keep in mind that the folder structure is restored as well., starting from the location you provide. Windows Network paths must not exceed the MAX_PATH limits of 255 characters.
If this data was originally on a network share
You need to provide the Restore Job Network Credentials for it to be able to write data to the original location.
You also can restore this data to an alternate location to make sure it is not overwriting anything on accident, plus it will move faster when restoring to a local device.
To change the default Network Credentials if needed, follow these steps found in: [Guide] Backup to NAS (with Retention) Walkthrough
- Setup your Network Device: In NovaBACKUP on the Home tab click on [Add Network Device] or open the Device tab and click on “Add”.
In the drop down menu select “Network Device”, click "OK".
Under “Device Name” give it a simple name, my example is NasBackup. Under “Network Path” type in the UNC path or browse for it. “Domain Name”, “User name”, and “User Password” are all optional depending on how your network device is configured on the network.
NOTE: These credentials are those utilized to connect to the Network Share, for most devices you will use "admin" or "root" as the username.
Click on "OK", if any of the above fields are incorrect, an error message will appear. If correct you will be taken to the Home tab, and see your device listed on the device tab.
- Configure your Default Setting to run as an administrator, change the default backup location, and configure default backup notification emails. Click on the NovaBackup logo on the top left corner and choose "Default Settings".
Click on “Default settings”, Click on the “Run as Tab”, put a dot on “Run as specific user”. Fill in your Domain Name, User Name, and User Password. (Most home users will not be in a domain.) Click “Check Credentials” to confirm you have entered all the correct information.
- Change the default backup location to the previously added network device to ensure the network credentials are saved for Retention jobs.
