Virtualization Manager - Virtual Machines Report

A resource-intensive VM running on a host operating system can create a severe dent in not only the resources of the host, but also the consolidated resources of the cluster to which the host belongs. It is imperative that you monitor the current and historical performance of the VMs in a cluster, so that resource contentions can be captured early and resolved quickly. The Cluster - Virtual Machines report provides you with historical insights into the performance of VMs with a cluster, thereby turning the spotlight on potential resource contentions.

To generate this report, do the following:

  1. Select the Virtual Machines option from the vCenter Reports node of the REPORTS BY FUNCTION tree.
  2. Figure 1 will then appear.

    Figure 1 : Providing the specifications of the Cluster - Virtual Machines report

  3. First, pick a Report Type. For a graphical representation of the VM performance, pick the Graph option. To view the metrics related to the resource usage of the VMs in a cluster in a tabulated form, pick the Data option.
  4. If the Report Type is Graph, then the View by list will offer 2 options - Timeline and Distribution. While the Timeline option will provide a time-of-day measure graph depicting resource pool performance, the Distribution option will result in distribution pie charts and bar graphs being displayed. The default selection is however Timeline.
  5. By default, the Report for list will display VMware vCenter as its selection.
  6. From the vCenter Server list, pick the vCenter server for which the report is to be generated.
  7. Upon selecting the vCenter Server, the Cluster list will get automatically populated with those clusters that are being managed by the chosen vCenter Server. Pick a cluster for which this report is to be generated.
  8. Then, pick an option from the Report by list. By default, the Virtual Machines option will be chosen here.
  9. Next, pick a measure for which a graph is to be generated, from the Measure list.
  10. Then, specify the Timeline for the graph. You can either provide a fixed time line such as 1 hour, 2 days, etc., or select the Any option from the list to provide a From and To date/time for report generation.

    Note:

    For every user registered with the eG Enterprise system, the administrator can indicate the maximum timeline for which that user can generate a report. Once the maximum timeline is set for a user, then, whenever that user logs into eG Reporter and attempts to generate a report, the Timeline list box in the report page will display options according to the maximum timeline setting of that user. For instance, if a user can generate a report for a maximum period of 3 days only, then 3 days will be the highest option displayed in the Timeline list - i.e., 3 days will be the last option in the fixed Timeline list. Similarly, if the user chooses the Any option from the Timeline list and proceeds to provide a start date and end date for report generation using the From and To specifications, eG Enterprise will first check if the user's Timeline specification conforms to his/her maximum timeline setting. If not, report generation will fail. For instance, for a user who is allowed to generate reports spanning over a maximum period of 3 days only, the difference between the From and To dates should never be over 3 days. If it is, then, upon clicking the Run Report button a message box will appear, prompting the user to change the From and To specification.

  11. In addition to the settings discussed above, this report comes with a set of default specifications. These settings are hidden by default. If you do not want to disturb these default settings, then you can proceed to generate the report by clicking the Run Report button soon after you pick a Measure. However, if you want to view and then alter these settings (if required), click on the button. The default settings will then appear in the MORE OPTIONS drop down window (see Figure 2). The steps below discuss each of these settings and how they can be customized.

    Figure 2 : The default settings for generating the Cluster Virtual Machines report

  12. The speed with which a report is generated depends primarily on the report Timeline. While a Timeline that varies between a couple of days to a week enables the eG Enterprise system to quickly retrieve the required data, timelines that span multiple weeks/months could slow-down the data retrieval and report generation process to a considerable extent, owing to the volume of data involved. In order to ensure quick and easy access to reports, eG Enterprise provides you the option of enabling data retrieval from the Trend information in the database, instead of the Detailed test information that is used by default for report generation. The Detailed test information based comprises of multiple measurement records for a test - one or more each for every test execution. Whereas, the Trend information includes only hourly, daily, and monthly summary computations for a test performed on a continuous basis. For instance, during a period of 1 hour, a test that runs every 5 minutes inserts atleast 12 records into the Detailed test information base. On the other hand, the Trend information base would consist of only 1 record for the same 1 hour period. Fewer the number of records, query execution becomes much quicker, and data retrieval faster. To use the trend data for report generation, you will have to select the Trend option from the Show Data field in Figure 2. By default, the Detailed option is selected in Figure 2 indicating that the report data is retrieved from the detailed test information in the database. If need be, you can also ensure that all reports always use the Detailed test tables alone by hiding the Show Data field from the reporter interface. To achieve this, do the following: 

    • Login to the eG administrative interface as 'admin'.
    • Select the Manager option from the Settings tile that appears when the button against the Admin tab is clicked.
    • From the GENERAL SETTINGS page that then appears, if you set the Compute average/sum of metrics while trending flag to No, then the Show Data field will not appear in the reporter interface; this denies users access to the Trend option, and thus ensures that reports are always generated using the Detailed tables.

      Note:

      • A Trend report will not include the data for the current day since trend data is only computed at the end of the day.
      • If the Trend option is chosen, the time period of the report should be greater than 1 day.
      • The usage of Detailed test tables for generating reports, especially those that span weeks, increases the stress on the eG database, thus resulting in undue delays in report generation. In order to ensure that the database is not choked by such voluminous data requests, you can configure eG Enterprise to automatically "force" the use of the Trend option if the Timeline of a report exceeds a pre-configured duration. To specify this time boundary, do the following:

        • Edit the eg_report.ini file in the <EG_INSTALL_DIR>\manager\config directory.
        • In the [MISC] section of the  file, you will find a DetailedTime parameter.
        • Specify the duration (in days) beyond which Detailed reports cannot be generated, against the DetailedTime parameter, and save the eg_report.ini file
        • For instance, to make sure that Detailed reports are disallowed for a Timeline of over 2 weeks, set the DetailedTime parameter to 14 and save the file. 
        • Say, subsequently, you attempt to generate a Detailed report for a FixedTimeline of 3 weeks (which is greater than the 14-day limit set in our example). The instant you select the 3 weeks option from the Fixed list box, the Detailed option gets automatically disabled, and the Trend option gets enabled. Similarly, if you specify an AnyTimeline that runs over 14 days, then, upon clicking the Run Report button to generate the report, a message box appears informing you that only the Trend option is permitted.
        • To proceed with the Trend report generation, click the ok button in the message box. To terminate Trend report generation, click the Cancel button. 
  13. If the timeline specified for the report needs to exclude the data collected during the Weekends, then set Exclude weekends to Yes. If not, select No.

    Note:

    By default, the weekend constitutes Saturday and Sunday. To override this default setting, do the following:

    • Edit the eg_report.ini file in the <EG_INSTALL_DIR>\manager\config directory.
    • In the [virtual_cluster] section of the file, the exclude_weekendparameter is set to Saturday,Sunday by default. You can modify this by setting the exclude_weekend parameter to a comma-separated list of other days of the week - say Friday,Saturday.
    • Save the file after making the required changes.
  14. Next, indicate the report Time period.
  15. You can further filter the resultset of your report picking one of the following options from the Filter by list:

    • TOP-N- Select this option and pick a TOP-Nor a LAST-Noption from the drop-down list adjacent to it to ensure that the resulting graph only plots the values of the specified number of TOP / LASTplayers in the chosen performance arena.
    • Range- Pick this option and provide a value range in the Fromand Totext boxes that appear alongside.
    • Greaterthan- Pick this option and provide a value in the text box that appears alongside to view the details of only those resource pools which have registered a value greater than the value specified in that box for the chosen Measure.
    • Lessthan- Pick this option and provide a value in the text box that appears alongside to view the details of only those resource pools which have registered a value lesser than the value specified in that box for the chosen Measure.
  16. In large environments, reports generated using months of data can take a long time to complete. Administrators now have the option of generating reports on-line or in the background. When a report is scheduled for background generation, administrators can proceed with their other monitoring, diagnosis, and reporting tasks, while the eG manager is processing the report. This saves the administrator valuable time. To schedule background processing of a report, you can either select the Background Save - PDF option or the Background Save - CSV option from the Report Generation list. In this case, a Report Name text box will appear, where you would have to provide the name with which the report is to be saved in the background. To process reports in the foreground, select the Foreground Generation - HTML option from this list.

    Note:

    • The Report Generation list will appear only if the EnableBackgroundReport flag in the [BACKGROUND_PROCESS] section of the eg_report.ini file in the [EG_INSTALL_DIR]\manager\config directory is set to Yes.
    • The default selection in the Report Generation list will change according to the Timeline specified for the report. If the Timeline set is greater than or equal to the number of days specified against the MinDurationForReport parameter in the [BACKGROUND_PROCESS] section of the eg_report.ini file, then the default selection in the Report Generation list will be Background Save - PDF. On the other hand, if the Timeline set for the report is lesser than the value of the MinDurationForReport parameter, then the default selection in the Report Generation list will be Foreground. This is because, the MinDurationForReport setting governs when reports are to be processed in the background. By default, this parameter is set to 2 weeks - this indicates that by default, reports with a timeline of 2 weeks and above will be processed in the background.
  17. Finally, click the Run Report button.
  18. If the Report Type is Graph, the View by selection is Timeline, the Report by option is Resource Pools, and the option chosen from the Report Generation list is Foreground Generation - HTML, then, clicking the Run Report button will invoke Figure 3.

    rep1

    Figure 3 : A Cluster - Resource Pools report if the 'View by' option chosen is 'Timeline' and 'Report by' option is 'Resource pools'

  19. Figure 3, as you can see, displays a time-of-day graph - this graph compares the behavior of the chosen performance measure acriss all the resource pools within the selected cluster during the specified timeline. For instance, if CPU usage is the Measure chosen, then this graph will compare the CPU usage of the resource pools in the cluster, thus visually enabling you toidentify which resource pool is utilizing CPU excessively.
  20. If the Report Type is Graph, the View by selection is Timeline, the Report for option is Physical Servers, and the option chosen from the Report Generation list is Foreground Generation - HTML, then, clicking the Run Report button will invoke . The graph displayed in will enable you to quickly compare the chosen performance metric across all the physical servers in the selected cluster so that, resource-intensive servers in the cluster can be isolated.

    rep3-reportbyvirtualmachines

    Figure 4 : The Cluster -Virtual Machines report if the 'View by' selection is 'Timeline' and the 'Report by' selection is 'Virtual machines'

  21. Now, if the Report Type is Graph, the View by selection is Distribution, the Report by option is Virtual Machines, and the option chosen from the Report Generation list is Foreground Generation - HTML, then, clicking the Run Report button will invoke Figure 5.

    rep6-reportbyvmsviewbydis

    Figure 5 : A Cluster - Resource pools report that appears when the 'View by' option is 'Distribution' and 'Report by' option is 'Virtual Machines'

  22. Figure 5 reveals the following:

    • A distribution pie chart that depicts the number of virtual machines that are in different distribution ranges. The distribution ranges are obtained by applying the first of the configured functions on the chosen Measure. For instance, assume that Physical CPU utilization is the chosen Measure. Say that you have configured to display the Avg and Max of this measure in a Data report. Typically, both these configured values will appear only in the Data report. In the case of a Graph report however, the first of the two functions - i.e., Avg of Physical CPU utilization - alone is calculated for every virtual machine configured on each physical server in the chosen Cluster. The resulting pie chart enables administrators to deduce, at a glance, the number of virtual machines where the chosen performance metric has fared well and/or badly. Clicking on a particular slice in the pie chart lists the VMs that fall within the value range represented by that slice (see Figure 6). Against every server, the actual values for each of the configured functions (both Avg and Max, in our example) will be displayed. A cluster-level Summary of the chosen Measure will also be available.  

      Note:

      By default, the chart type for distribution is a pie chart. However, you can have a bar graph depict the same data instead of a pie chart, by following the steps given below: 

      • Edit the eg_report.ini file in the <EG_INSTALL_DIR>\manager\config directory.
      • Change the value of the chartTypeForDist parameter in the [virtual_CENTER] section of this file from the default Pie, to Bar.
      • Save the eg_report.ini file.

      By default, the number of value ranges that need to be configured for the distribution chart is 10. To override this default setting, do the following:  

      • Edit the eg_report.ini file in the <EG_INSTALL_DIR>\manager\config directory.
      • Specify a number of your choice against the nofRangeForDist parameter in the [virtual_cluster] section of this file. By default, this parameter will hold the value 10.
      • Save the eg_report.ini file.

        rep6-reportbyvmsviewbydis-clickonpie

        Figure 6 : The virtual machines that fall within the usage range clicked on

    • Adjacent to the pie chart, you will find a bar chart that indicates the VMs that have topped/failed in a selected performance realm (i.e., the Measure) during the specified Timeline. For example, for the Physical CPU utilization measure, this bar chart reveals the VMs in the cluster that are using CPU excessively. Like the pie chart, the values for the bar chart are also calculated by applying the first of the configured functions on the chosen Measure.

      Note:

      You can configure the colors to be used in the distribution chart and the Top <N> Components bar chart in the zone report, by editing the eg_report.ini file in the <EG_INSTALL_DIR>\manager\config directory. The [VIRTUAL_cluster] section of the file defines the 20 default colors of the distribution and bar charts:

      [VIRTUAL_CLUSTER]

      ChartColor=#8399b0,#ffd95a,#a4ac91,#98d980,#d5b996,#f48848,#8b8cc2,
      #eb4052,#c4b3d0,#b18651,#ebb7ce,#028768,#f5c372,#887c65,#e4c536,
      #b5582c,#f94989,#770d72,#97a067,#89aeb7

       

      distColor=#115fa6,#f25454,#60bd68,#b276b2,#81bef7,#a61120,#ffd13e,
      #770d72,#887c65,#a4ac91

       

      You override the default color settings of the distribution chart by modifying the color-codes specifying against distColor. For changing the colors used by the Top <N> Components chart, alter the codes listed against the ChartColor parameter.

      Note:

      The number of components to be displayed in theTop <N> Components bar chart is configurable. To specify the number, select Top-N from the Filter by list in Figure 2 and pick an option from the adjacent drop-down list.

  23. If the Report Type is Data, then the View by list will no longer appear. Also, the Report by section will now allow you to choose between the Physical Servers and the Virtual Machines options - here again, the Virtual Machines option will be chosen by default. Moreover, besides enabling you to view the data pertaining to all/specific clusters managed by a chosen vCenter server, the Data report will also enable you to view the data pertaining to all/specific Resource Pools.
  24. If the Virtual Machines check box alone is selected from Report by, then, will appear upon clicking the Run Report button. As you can see, in addition to the default sections focusing on CPU and memory usage, provides a Virtual Machines section that indicates how resource-intensive each VM in the cluster is. Using this information, you can figure out whether any of the VMs have contributed to any deterioration in the performance of the cluster.

    14

    Figure 7 : A Cluster Details Report additionally providing virtual machine information

  25. Clicking on a VM in this section will lead you to the Virtual Machine Details report of that VM.
  26. If the All option had been chosen from the Cluster list in Figure 1, the resulting report will display CPU and memory usage metrics related to every cluster configured on the chosen vCenter Server (see Figure 8). If both the Physical Servers and Virtual Machines check boxes are selected, then the report will also explore the resource usage of the ESX servers and VMs in all the clusters managed by the chosen vCenter Server (see Figure 8). 

    allclusters1

    Figure 8 : The Cluster Details report revealing the CPU and memory usage of every cluster on a vCenter

  27. To zoom into the performance of a particular cluster, just click on it. Figure 9 will then appear.

    12

    Figure 9 : A report displaying the details of a particular cluster

  28. On the other hand, if the Background Save - PDF option is chosen from the Report Generation list, then clicking on the Run Report button will not generate the report and display it in this page for your benefit. Instead, a message indicating that the report is being processed in the background will appear. This will be accompanied by a link that will lead you to the page that lists all the reports that are being processed in the background, and their current status. If background report generation fails for a report, you can regenerate that report using this page, or can even delete that report if need be. On the other hand, if background processing successfully completes for your report, then, you can view a PDF of the report by clicking on the icon in that page.

Note:

By default, the metrics displayed in the Cluster - Physical Servers, Cluster - Virtual Machines, Cluster - Resource Pools, and Cluster - Details report and the functions applied on them are pre-configured in two groups - namely, Cpu_usage and Memory_usage - in the [virtual_cluster] section in the eg_report.ini file in the <eg_install_dir>\manager\config directory. The names of these default groups cannot be changed, but you can modify the eg_report.ini file to include more metrics  to the groups and apply additional functions to them. Typically, all CPU-related metrics will be added to the Cpu_usage group, and the memory-related metrics to the Memory_usage group. To add a new measure to say, the Cpu_usage group, you will have to insert a line in the following format in the [virtual_cluster] section of the eg_report.ini file:

Cpu_usage:<InternalTestName>:<InternalMeasureName>=<Comma-separated list of functions>

For instance, to add the Physical CPU used measure to the Cpu_usage group, insert the following line:

Cpu_usage:ClusterResPoolTest:Physical_cpu_used=Avg,Max

Similarly, to add the Memory used measure to the Memory_usage group, insert the following line:

Memory_usage: ClusterResPoolTest:Memory_used=Avg,Max

The default measure configurations for the Physical Servers Report section will be available in the [virtual_host] section of the file. You can override this default setting by adding more physical server-related tests or removing some existing tests. To add a new measure to this section, add an entry of the following format:

<InternalTestName>:<InternalMeasureName>#<MeasureDisplayName>=<Comma-separated list of functions>

For instance, to add the Registered guests measure to the Physical Servers section, your specification should be:

EsxGuestStatusTest:Registered_guests#Registered guests=Avg,Max

The default measure configurations for the Virtual Machines section on the other hand will be available in the [virtual_guest] section of the file. You can override this default setting by adding more VM-related tests or removing some existing tests. To add a new measure to this section, add an entry of the following format:

<InternalTestName>:<InternalMeasureName>#<MeasureDisplayName>=<Comma-separated list of functions>

For example, to add the Physical CPU used measure to the Virtual Machines section, your specification should be:

EsxGuestTest:Cpu_used#CPU Used=Avg,Max

To know the internal names of tests and measures, follow the steps discussed in Page First, determine the Internal name of the test and measure to be configured. For that, do the following: of this manual.