Which database jobs are run?

The following database jobs are installed with the Web Log Database and Email Log Database:

• The Extract, Transform, and Load (ETL) job runs continually, receiving data from Log Server, processing it, and then inserting it into the partition database. When trend data (Web) retention is enabled, the ETL job is also responsible for inserting trend data into the catalog database.

  The ETL job must be running to process log records into the Log Database.

• The database maintenance job performs database maintenance tasks. This job runs nightly, by default.

  (Web) Once data is processed and moved to the database tables used by the Cloud App report, the maintenance job is also responsible for deleting cloud apps data that is more than 2 days old from temporary log database tables.

ETL jobs are run, then re-run 10 seconds after they finish for SQL Server Standard and Enterprise. For SQL Server Express, 60 seconds elapse between completion of one job and start of the next.

Maintenance jobs are run once every night by default. The jobs are run automatically. The Web Log Database also installs the following jobs:

• The Internet browse time (IBT) job analyzes data and calculates browse time for each user. The IBT database job is resource intensive, requiring significant server resources. This job runs nightly.
• When trend data retention is enabled, the trend job uses daily trend data created by the ETL job to update weekly, monthly, and yearly trend records for use in presentation reports. This job runs nightly.

  Even when trend data retention is disabled, the trend job processes data from the threats (AMT) partition to provide trend data on the Threats dashboard.

• The Advanced Malware Threat (AMT) ETL job receives, processes, and inserts data into the threats partition database. Only log records that include a severity ranking are recorded in the threats partition. Data from this partition is used to populate the Threats dashboard.

  The AMT ETL job also populates the database tables used to provide the data for all application reports and the Advanced File Analysis report.

When configuring the start time for the (Web and Email) maintenance job and the (Web) Internet browse time job, consider system resources and network traffic. These jobs can be resource intensive and time consuming, so they can have a negative impact on logging and reporting performance. When trend data (Web) retention is enabled, the trend job is run, by default, at 4:30 AM. Try to avoid starting other jobs at time that might overlap with the trend job.

Both Log Databases require either the SQL Server Agent service (SQL Server Standard or Enterprise) or Service Broker (SQL Server Express) to run database jobs.