Load Data

This section details the methods that Accelerator uses to load data into the database.

Automatic Loading

Checkout data files generated from sampled data will be automatically and continuously loaded if the daemon-based loader is enabled.

Job data files generated by the server are automatically and continuously loaded when the daemon-based loader is enabled. Refer to Set Up for more information.

Manual Loading

Manual loading of job data files can be accomplished by using the vovsql_load_jobs command line utility.

To execute the utility, set up the CLI:

% vovproject enable vnc


vovsql_load_jobs: Usage Message
  
  DESCRIPTION:
      Load job-logs into the SQL database.  Useful also to merge
      the data from multiple sites (or multiple clusters).
      The name of the site should preferably be short.
  
  USAGE:
      % vovsql_load_jobs [OPTIONS] <listOfJobsLogs>
  
  OPTIONS:
      -db               -- Override DB selection
      -force            -- Force loading of log files
      -site <NAME>      -- Specify a name of a site
      -notools          -- Disable processing of toolnames.
                           The toolname is normally the tail of the first
                           argument of a command. In some sites, the tools
                           are auto-generated and are unique for each
                           command, so that they have no meaning but cause
                           a tremendous overhead.
      -v                -- Increase verbosity
      -q                -- Quiet verbosity
  
  EXAMPLES:
      % vovsql_load_jobs ./jobs/2009*
      % vovsql_load_jobs -site rome ./jobs/2009*
      % vovsql_load_jobs -db ./jobs.sq3 jobs.log
      % vovsql_load_jobs -notools  jobs.log