Backup Jobs allows you to configure how JetBackup generates and manages your backups according to your backup job configuration. In this section, you will be able to create, modify and manage your Backup Jobs.
By default, ALL accounts (active and suspended) are included in a backup job. You can adjust which accounts are included by using account filters.
To create a new backup job, click on "+ Create New Backup Job".
Specify a unique name for your backup job. This will be used internally for your convenience.
Specify the creator for this Backup Job. This grants the creator and its parent account(s) permission to modify and delete this Backup Job. Please note that the creator specified will also need Can Manage Backup Jobs permission granted under the Permissions section.
Specify which destination(s) to transfer/store your generated backups to. You can find more details regarding supported destinations in the Destinations Overview section. Backup Jobs are able to backup to multiple destinations per job.
If a new destination is added, JetBackup will continue with incremental backups on the original destination and generate the initial full backups on the new destination.
JetBackup can perform the following types of backups. Here's a brief explanation for each type:
You can choose to include/exclude the following:
Panel Configurations
Home directory Files
Databases (Incremental backups is not supported for this type *)
Database Users
Email Accounts/Structure **
FTP Accounts
Cron Jobs
Domains
SSL Certificates
* In the case of an incremental job, all files included in this job are backed up incrementally with the exception of databases. Databases are regenerated and synced to the destination. Each job run will add the disk usage of each database dump file to the backup. If a database did not change from a previous backup, then the database dump file from the previous snap is used instead of creating a new database dump file.
** When choosing the option to backup email structure, the backup will contain the email account structure without the email content. The Exclude Junk option will exclude trash, spam, junk and draft directories from the backup job.
You can choose to exclude databases from the backup job. The excludes can be set to have the backup job only exclude databases that exceed a selected size threshold. To modify which database size threshold to exclude, select Edit Excludes. A popup will appear allowing you to modify the database size threshold you would like to exclude.
Backup structures tells how backups are generated and stored. JetBackup supports the following backup structures:
Compressed/Archived backups only convert the homedir, database, and config file data to their respective formats.
Note: JetBackup 5 stores a Compressed/Archived Backup locally in the JetBackup Workspace before transferring to the destination. The minimal required space for these Backup Structures is 110% of the largest account.
For more information about the Backup structures supported for your destination, go to Destinations Overview.
When enabled, the retry failed items option allows Jetbackup 5 to retry backing up any failed items during a backup job for one additional time.
Backup directory names will differ, depending on two factors: # Backup Type # Backup Structure
Backup Type | Backup Structure | ||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
|
JB Config Backup | ||
---|---|---|
|
Choose whether or not backups will be encrypted on the backup destination. This option is only available with Archived and Compressed Backup Structure. Please note that users/accounts that opts for encrypted backups exclusively will be automatically excluded from all other backup jobs with encrypted backups disabled.
Account Filters allows you to specify conditions on which to include/exclude on you Backup Job(s). By default (no filters added), all accounts (active and suspended) are included in the backup job. Multiple filters may also be applied and are combined by AND/OR statements.
AND - the condition on EACH filter(s) must be met in order for an account to be included in the backup job.
OR - the condition on EITHER filter(s) must be met in order for an account to be included in the backup job.
Newly excluded accounts will NOT have their snapshots cleaned(deleted) automatically unless the snapshots are Orphan/Manual Snapshots. These snapshots will remain on the destination(s) until the account is included or the snapshots fall under the Delete orphan backups older than/Manual Backups TTL.
In order to create an account filter, either click on "Manage Account Filters" > "+ Create New Filter" or through the Account Filters section under the Backup Job configuration page.
* Reseller Filters only affect the accounts that a reseller account owns, not the reseller account itself. Reseller accounts will be included in the affects of a Reseller Filter if the reseller account owns itself.
Specify a unique name for your account filter(s). This will be used internally for your convenience.
Specify the creator for this account filter. This grants the creator and its parent account(s) permission to modify and delete this account filter. Please note that the creator specified will also need Can Manage Backup Jobs permission granted under the Permissions section.
Whatever to included or excluded accounts filtered by this filter.
Examples of filter results where Filter 1 contains Account 1 & Account 3, and Filter 2 contains Account 2 & Account 3
Legend
Filter 1 | Filter 2 | Account 1 | Account 2 | Account 3 | Others | |
---|---|---|---|---|---|---|
Include | AND | Include | ||||
OR | ||||||
AND | Exclude | |||||
OR | ||||||
Exclude | AND | Include | ||||
OR | ||||||
AND | Exclude | |||||
OR |
Select which directories and files you would like to add to your Directories backup job. Click on "Select Files" to use the File Browser or "Insert Multiple" to add multiple paths manually. All includes are relative to the account home directory.
NOTE: Directories can be excluded on a per account basis rather than by Backup Job to provide more individualized control over exclusions. This is controlled in the Account Backup Jobs Excludes settings.
Excludes have higher priority than includes.
For example:
/folder1
was excluded and /folder1/file1
was include, JetBackup will still exclude /folder1/file1
/folder1
was included and /folder1/file1
was excluded, JetBackup will exclude /folder1/file1
as expectedExcluding files & folders from backup is a very important feature, and we recommend to use it. Each backup job has it's own exclude list that can be specified and modified. The exclude list will be piped to our sync operation. The supported path format should be in glob pattern.
When using Rsync-Based destinations, rsync
(by default) will traverse the excluded directory and all files in the directory but will not write any of the excluded files/directory to the destination if a wildcard is added after the directory you wanted to exclude.
For example:
/PATH/TO/DIRECTORY/EXAMPLE/*
will exclude all contents in the EXAMPLE/
directory, but will create an empty EXAMPLE/
directory folder when restored./PATH/TO/DIRECTORY/EXAMPLE/
will completely exclude the EXAMPLE/
directory, and will not create an EXAMPLE/
directory folder when restored.All excludes are relative to the account home directory. So, different patterns can be used to exclude directories. i.e.
/*/lscache/*
: Exclude the lscache directory on any level, starting on the 2nd level
/lscache/*
: Exclude the lscache directory on 1st level only
lscache/* or **/lscache/* or */lscache/*
: Exclude the lscache directory on any level
Specify a file/folder path on the field and click on "Add Path" to add on the exclude list or click on "Insert Multiple" to exclude in bulk.
Exclude files and folders in bulk:
Here are some recommendations for files/folders to exclude.
*.bkup
*.gz
*.jpa
*.log
*.sql
*.tar
*.tar.gz
*.wpress
*.zip
*/.wysiwygPro_*
*/backupbuddy_backups/*
*/cache/smarty/*
*/com_akeeba/backup/*
*/core.[0-9]*
*/error_log
*/var/amasty_fpc/*
*/var/backups/*
*/var/cache/*
*/var/debug/*
*/var/export/*
*/var/import/*
*/var/log/*
*/var/report/*
*/var/session/*
*/var/tmp/*
*/wp-content/cache/*
*/wp-content/wphb-cache/*
*/wp-content/uploads/wpcf7_captcha/*
*/wp-content/widget-cache/*
*/wptsc-cachedir/*
.MirrorSearch
.cpanel/*.sock
.trash
access-logs/*
backup-*.tar.gz
**/logs/*
public_ftp/*
public_html/cache/*
site-*.tar.gz
softaculous_backups/*
tmp/*
lscache/*
JetBackup 5 has certain files and folders that are excluded by default for the Home directory Backup Item depending on the panel installed. Please see the lists below to see which files and folders are excluded from all Accounts Backup Job.
NOTE: Some default exluded files/folders are backed up in other Backup Items. For example: The /mail folder for cPanel accounts will be integrated with the Email Account Backup Item. Having it excluded from Homedirectory backups will allow for efficient backups and avoid duplicates.
Backup Job Schedules tells JetBackup the time and frequency a backup job will be executed as well as the number of backups to keep for the corresponding schedule (backup retention).
JetBackup gives you the option to set multiple schedules for each backup job. There are no extra overhead between backups with multiple schedules running at the same time as JetBackup will automatically mark each coinciding backup with the appropriate schedule types.
NOTE: Changing between schedule types may remove backups generated from the previous schedule type. Please review how to properly make changes on your schedule.
Specify a unique name for your schedule. This will be used internally for your convenience.
To safely change between schedule types, please add a new schedule on top of your existing schedule(s) and give your backup job ample time (the full retention length of your new schedule) to generate and correctly mark backups with the appropriate schedule type(s). You can then safely remove the previous schedule once the backup job runs for one full cycle of your retention.
With an Hourly Schedule Type, you may choose to execute the backup job every one/two/three/four/six/eight/twelve Hours.
Backup Retain specifies how many backups to keep with the corresponding schedule type.
With an /Daily/Weekly/Monthly Schedule Type, you may specify the time of day (based on your server local time) on when to execute the backup job.
With a After Backup/Clone/cPanel job is done Schedule Type, you may set how much time to delay a backup job in minutes/hours/days before executing the backup job.
The time that you want all schedules to be executed.
The Backup Job monitor is a feature that will allow JetBackup 5 to send alerts to your configured Notification Integrations for each of the following conditions:
Job Monitor Alerts will marked with the Critical Level.
Click on the preferred Backup Job listed in the Backup Job section to expand and view the available backup job settings.
Click on "Enable Backup Job" to toggle between enabling and disabling your backup job.
Click on 'Manage Backup Job' to modify your backup job configuration.
Execute your Backup Job manually and on-demand.
Manually running backup jobs does not count towards your scheduled backup job rotation. To set the retention and TTL for manually executed backups, please visit Manual Backup Settings.
Click on 'View Backup Job' to see Logs associated to the selected Backup Job.
Click on 'Duplicate Backup Job' to make a copy of the selected Backup Job.
Click on 'Delete Backup Job' to Delete your job permanently.
During each (Manual and Scheduled) Backup Job run, JetBackup marks all backups which exceed the retention rate and files that need to be removed. These files will then be cleaned up and deleted during the Backup Cleanup and Integrity Check process. The Backup Cleanup & Integrity Check Schedule adjusts the frequency at which the process is run.
Note: The backups/files that are marked for deletion are not removed at the end of a backup job (Manual and Scheduled) and will remain on the destination until the Backup Cleanup and Integrity Check process runs. Therefore, there may be a temporary increase in disk usage until the Backup Cleanup and Integrity Check process is completed.
We recommend setting the Backup Cleanup & Integrity Check Schedule to allow the process to run more freuqently (minimum once per day) in order to minimize the amount of disk space used.
"Point-In-Time" incremental backups - For retentions on incremental backups, JetBackup generates "point-in-time" incremental backups that use as little space as possible (using hard links). For example, on a 2GB DirectAdmin account with 30-day backup retention, it will only consume 2GB + 30 Days worth of new/changed data.
For databases, JetBackup generates a full dump of the databases for the initial incremental backup. If the databases are modified, JetBackup will then generate a new full dump for the incremental backup. Otherwise, the previous snap of the database dump will be used in the incremental backup.
The Initial FIRST Run of Incremental Backup Jobs may take a significantly longer time to finish as JetBackup generates the initial FULL Backup of your accounts.
If a Backup Job remains processing and goes past its next expected schedule, JetBackup will recalculate the next run to the next "open" schedule upon completion.
You may set a Backup Fork TTL under your JetBackup Performance Settings to limit how long (in hours) a single Backup Fork can process one account backup.
Please note that manually running a Backup Job does not count towards your Scheduled Backups. JetBackup will generate a separate set of Backups (including the initial Full Backup) for both the Manual and Scheduled runs of your Backup Job.
* A symlink or Symbolic Link is simply a shortcut to another file or folder. It is a file/folder that points to another file/folder. You can think of Symlinks as shortcuts sometimes created byroot
users.
On destinations that utilize our jetindex engine (All non-legacy destinations), JetBackup does backup and restore symlinks in the home directory. This includes symlinks that point to a directory outside of the account's home directory. Please note that for symlinks that lead outside of the account's home directory, only the symlink will be included in the backup, and the files/folders ARE NOT included and therfore CANNOT be restored.
For legacy destinations (SSH, Local(legacy)), JetBackup will only restore symlinks that point to another file in the account's home directory. Symlinks that point outside of the account's home directory or to a separate mounted disk DO NOT get backed up and CANNOT be restored.
For both legacy and jetindex destinations, email accounts (files/folders) will be included in the backup regardless if the email contents are symlinked from a directory outside of the account's home directory. When restored, the symlink will no longer exist, and the email account files/direcories will be in the account's mail directory.
If any issues are discovered during the integrity check of the backups, JetBackup will label those snapshot(s) as "Damaged". This indicates that one or more items in the selected backup are corrupted or did not transfer properly during backup and attempting to restore the account with these "Damaged" backups may result in unexpected errors/failures.
To determine if the backups are damaged, we must first run the Integrity Check. You may run the Integrity Check process manually by executing the command below.
jetbackup5api -F runIntegrityCheck
If the Integrity Check finds any issues with the backups, it will mark them as "Damaged". Below are several methods to verify whether the backups have been labeled as "Damaged"
64_LOGID.log
grep -Rn 'found to be damaged' /usr/local/jetapps/var/log/jetbackup5/queue/
Damaged: 1
in the result.jetbackup5api -F listBackupForTypeName -D "type=1&contains=511&account_id={$ACCOUNT_ID}&name={USERNAME}"
_id: 663e892e0490bd0d35025a15
parent_id: 663e89260490bd0d350259d5
account_id: 663675ba98c5c818fd0b34d3
destination: 663e7f7d0f17de7b54086f22
destination_name: localv2
name: demo1
created: 2024-05-10T20:52:54+00:00
path:
backup_type: 1
backup_contains: 511
account: demo1
account_data:
_id: 663675ba98c5c818fd0b34d3
username: demo1
owner: admin
owner_id: 663675b998c5c818fd0b34d2
package: undefined
suspended:
reseller:
root:
size: 281996
params:
backup_structure: 1
notes:
location:
safety:
deleted:
lock:
lock_ttl:
damaged: 1 <<< Backup is damaged
disabled:
schedules:
0: 8
hidden:
encrypted:
encryption_id:
encryption_key_required:
encryption_key_exists: 1
In JetBackup 5, there are 2 underlying priority systems at work which allows you to control how JetBackup prioritizes backups, restores & downloads. Both of which works so that the lower the value, the higher its priority on the queue. For more Information regarding JetBackup 5's priority systems, please CLICK HERE.
In Jetbackup 5, the Queue utilizes a First in First out method in processing each tasks. It batches each tasks by its appropriate priority value across each Task Type (Backup, Restore, Download, Clone) and can simultaneously process tasks depending on the number of Concurrent Tasks set under Performance Settings.
JetBackup can't restore files and/or directories with certain special characters or permissions.
For a list of recommended special characters and file permissions to avoid, please visit: Characters to Avoid when naming Files and Folders