Table of content
Path based charting
Since BVQ Version 5.0 it is possible to display a table (Treetable) below the Treemap. Now we went one step further and extended the Topology view with the option to add a performance chart to interact with the objects visible in Treemap or Treetable. This enhances the possibilities to select and restrict objects based on dynamic filters and selected conditions. Now there are three views available to be displayed in the Toplology view: Treemap, Treetable and Chart. Currently you can display two of them simultaneously in ever combination.
One of the most useful extensions with this feature is the possibility to show multiple aggregated metrics. Aggregated metrics are always calculated based on the objects visible in the Treemap or Treetable. In combination with the new Enhanced Filtering the views can be made highly dynamic and reusable as favorites for specific use cases.
To manage the objects visible in the chart a Chart visibility Context menu was added for Treemap and Treetable objects.
The validity of information a BVQ or SVC object can provide is highly dependent on relations to other objects in many situations. The BVQ path browser reflects these relationships since the beginning but was only capable of displaying objects that fulfill all relations. The NULL Object is able to soften this restrictions and provide a way to display objects that don't meet all requirements. This is really useful to find objects that aren't configured correctly or aren't accessible through a usual path. The Null Object is always displayed as undef.
- Show all MDisks that are not part of an MDisk Group
- Group objects without a site or room
Example: Hosts grouped by Room and Site
All Hosts that aren't assigned to any room are grouped in a Site undef. and Room undef. None of them has been visible in previous versions.
Since version 5.0 it is possible to use basic filter options inside the Topology View. This type of filter was restricted to direct object attributes which could be connected with AND conditions.
The new enhanced filtering added a lot of additional filter options to specify filters that exactly fit your needs even if they are highly complex.
- Compare different object attributes with each other
- Compare object attributes with context attributes (subelementcount, subelementsize, etc)
- Concatenate with AND, OR, NOT, XOR
- Graphical editor to support condition creation
- Selective enable/disable filter conditions
How to filter Clusters and MDisk groups that contain VDisks with a virtual capacity greater than 500GiB or with more than 500 IO/s in average the last day
The BVQA Web Dashboard is based on Grafana, which is one of the leading open source software tools to visualize time series data that can interact with different data sources (https://grafana.com/).
The BVQ Server now provides an API to access most performance metrics you know from the BVQ GUI, to visualize them in Grafana. Therefore, you have the option to install a preconfigured Grafana with some default Dashboards inside the BVQ Server. This offers a great possibility to view general "realtime" information directly in the browser without the need to open the BVQ GUI.
In the first release of BVQ Grafana it is not possible to create or change dashboards. This feature will be added in a future release.
Microsoft Excel is the most important and flexible Reporting Tool. Manifold opportunities to create tables, charts, calculations, etc. bundled with a variety of different skills makes it useful in a lot of different situations. Excel provides a wide range of options to import data from different formats in files, databases or API's.
BVQ now provides an API to connect Excel to Topology information based on favorites located in "All Users". The information can be displayed in a Treetable and imported into Excel for further processing.
- Asset management
- Enrichment with additional data
- Report exchange
To access and explore the API endpoints, the BVQ-Server provides an overview page to display the required URL and all information connected to the favorite.
Reporting → Data sources
Although the API is promoted with Excel it is also possible to connect other systems
New Scanner module
The scanner module has been revised completely to simplify adding, updating and changing settings for individual scanner and support more systems to be scanned. Therefore the scanner has been moved into one dedicated service that will perform the work for multiple systems with less resource utilization.
The "old" scanner method (seperate scanner modules for SVC and VMware) will be removed in BVQ version 5.5
To manage the scanner the BVQ-Server provides an easy to use Web UI.
Settings for VMware and SVC scanner vary in some details but are comparable to the known settings from previous BVQ scanner.
To show the log files for a scanner, click the blue "log icon" in the overview page. The logs will be presented in 1h buckets with additional coloring for WARN and ERROR messages.
All way pathing
You are now able to combine all objects in a meaningful path. This is enabled by using graphs internally.
In the last BVQ Releases favorites became more and more important. To make them accessible more easily, we added a "Favorites"-option directly to the BVQ Main menu. All previous methods to open a favorite are still available.
Additionally, we removed the old obsolete Table View menu and added a Table view section to the system favorites. They are now enriched with a lot of additional meaningful content and supported with documentation and links to further information.
Thin coverage ratio
New attribute "Coverage %" shows the ratio of over-allocated thin capacity covered by a pool or cluster. You can set an alert on it to be warned before you run out of space due to thin space allocation eating up all your free space.
In the example above, thin provisioned volumes could potentially fill unused 60TB, but this is only covered by 30TB of free space in the providing pools. Thus the coverage ratio is only 50%. Coverage ratio is available in object types aggregating MDisk groups (Pools) like Storage classes, Mobility zones and in such aggregating VDisks like Hosts, VDisk groups, or Applications.
Retrospective tabular reports
Enables you to create a tabular report on a past point in time.
Requirements and restrictions
Requirements of the HW/SW environment
Minimum BVQ version required for an update
V5.1.0 (without Data Migration)
|Recommended Java Runtime version|
Update from a previous MongoDB Installation step by step
- Check that the environment is working properly, in particular the scanners.
- Manually stop BVQ Scanner and Alerting-service, Scheduler-services and also of all GUIs and reporting-clients
- Backup the BVQ installation directory and BVQ DB (e.g. DB backup with mongodump, VMware snapshots)
- Start again the BVQ Scanner
- Update BVQ Install Package Repository:
- DB Schema update
- BVQ GUI update
- BVQ Server update
- BVQ SVC Scanner update
- BVQ VMware Scanner update
- BVQ Scheduler update
- BVQ Alerting update
- Perform functional tests
- If necessary inform colleagues about the need to update locally installed BVQ GUI clients.
|Path integrated charting: Group multiple aggregation curves according to path|
GUI: Topology view
|GUI: Topology view + Reporting|
Show unassigned objects within a "NULL" container
|BVQ-11746||Reporting||Reporting interface for Microsoft Excel datasources|
|BVQ-11879||Server: Grafana||Use Grafana as a Web based user interface to visualize BVQ performance metrics (v1)|
|BVQ-11750||Scanner||Consolidate scanner instances into a single service|
|GUI||Attributes: Add overprovisioned capacity coverage %|
|GUI: Topology view||Be able to combine all objects with each other in a path (switch to object type relations based on graphs)|
|Drop calculation for T0 Performance Indicators and integrate dynamic loading|
|Context Menu: Optimize Isolate Menu|
Attributes: Controller: Show queue depth in Controller Port and Controller
|Allow change for start view flag for system favorites|
|VDisk group relation: Preselect VDisk group if called from its editor|
|GUI: Multi view||Try to copy selection to Topology-View|
|GUI: Multi view||Open detail pane blocks CTRL+SHIFT+R to come through|
|GUI: Performance view||Options: Timing: Time favo button should have a label|
|GUI: Topology view||Add MDisk tier coloring to coloring tooltip|
|GUI: Table view||Aspect Capacity Utilization: Add special attributes for free space and ratio|
|BVQ-11679||GUI: Table view||Enrich inital default table config and make it customizeable|
|Common||SVC 7.8.1: Add new copy and clean rates|
|BVQ-7790||Common||Encrypt passwords for all modules in all registry and properties values|
|Server, DB||A lot of important performance improvements|
|Critical||BVQ-12253||DB||History corrupted by history migration and Scanner persists running in parallel|
|Critical||BVQ-12254||DB||History corrupted by missing migration of "vdisk_copy_hist"|
|Critical||BVQ-12288||GUI||Multi Views: Window change flag missing|
|Error on "Email Error Notification" without smtp credentials|
|"Link controllers to rooms" does not show all assigend Rooms|
|Managing VDisk groups leads to duplicate history entries|
|Performance View: NPE when trying to change scale of y-axis|
|Some deleted CMDGs not marked as deleted in history collection|
|Minor||BVQ-11192||GUI||Detail Pane: Wrong IP port handling for svc_node_port|
|Minor||BVQ-11950||GUI||Event Table / Performance View: BVQRuntimeException & NullPointerException when trying to show events|
|Minor||BVQ-12198||GUI: Favorites||Rename folder does not refresh folder tree|
|Minor||BVQ-12032||GUI: Performance View||Options: Timing: Reset timing to default causes exception|
|Minor||BVQ-12279||Common||Missing line break in properties files|
|Add Favorites to main menu|
|Allow MongoDB cache size < 4GB|
|Resolve interruption of performance scan if 1 node is offline or in service state|
|Critical||BVQ-12519||DB||Repair entries with BVQ_ID = null|
|Critical||BVQ-12259||Installer||MongoDB: Service does not start when password contains %|
|Important||BVQ-12390||Alerting||Possible Exeption if filter condition of alert rule cannot be calculated|
|Important||BVQ-12473||GUI: Performance view||View > clone insists on a selection|
|Important||BVQ-12443||GUI: Performance view||Node Upper cache latency avg without decimal|
|VDisk group: Exception after assignment of multiple VDisk groups to Application|
GUI: Performance indicators
|Custom PI (longterm) leads to faulty latency calculation and response time compliance exception|
|Connection error when using @ within SSH password|
|Minor||BVQ-12508||GUI: Path based charting||NullPointerException when creating PIP MultiView|
|Show hint in installer dialog if default property values are used|
|Excel: Consolidate URL, Title and Navigationbar|
|Critical||BVQ-12580||Installer||Fix Pack check not working in some rare situations|
|Critical||BVQ-12570||Installer||Passwords are reset to default if user has to be elevated|
|Critical||BVQ-12645||SVC Scanner||Flash System: VDisk can't be persisted because of missing preferred node|
|Important||BVQ-12559||SVC Scanner||Drive Performance: Some metrics are interchanged|
|Important||BVQ-12560||GUI||Property dialog does not pop up|
|Important||BVQ-12562||GUI: Topology||Exception after right click on filtered host object|
|Exception after invocation of favorite "Dissimilar copied volumes"|
GUI: Performance view
|Node CPU Core Compression stats about factor 100 too high|
GUI: Performance view
|Node CPU: Relation between Max CPU core and displayed chart curves are faulty|
|Important||BVQ-12544||GUI: Table||Node ports: State "inactive_unconfigured" shows up as "unusual"|
|Important||BVQ-12512||Reporting||SRS Capacity Report: SnippetParametersNotValidException|
|Important||BVQ-12566||Reporting||Snippet loop creates wrong pie charts with all existing objects|
|Important||BVQ-12571||Reporting||Editing of "system" templates via Reports overview should not be possible|
|Minor||BVQ-12513||GUI||Shortcut [CTRL+N] causes NPE in empty window|
|Minor||BVQ-12591||GUI: Performance view||Chart visibility > Hide > Selected does not work|
|Minor||BVQ-12533||GUI: Performance view||Metric color change does not trigger a redraw|
|Minor||BVQ-12590||GUI: Performance view||Attribute "wh" for VDiskUpperCache has wrong normalization|
|Minor||BVQ-12551||GUI: Performance view||Start / End time: Cursor keys not consumed by input field|
|Minor||BVQ-12589||GUI: Table||PortLogin: Attribute "state" does not display color icon in cell|
|Minor||BVQ-12611||GUI: Topology view||Options Panel causes NPE if events are displayed|
|Menu option to modify favorite information is renamed to "edit info"|
|Multi View: Refresh: Add shortcut "F5"|
|Show supported browsers on login-pages|
|Add possibility to filter by NULL|
|Disable "System" Tree in Reporting Table Snipptes & Excel Interface.|
Please copy System favorites to a folder in "All users", if you want to use them in your reports or data sources. System favorites could be changed without notice and thus are not stable for use in reports.
|Critical||BVQ-12725||Scanner||Remove dependency to the mongodb service|
|Critical||BVQ-12699||Server||Parsing large logfiles can cause out-of-memory errors|
|Important||BVQ-12788||Server||Poor browser performance in environments without internet connectivity|
|Important||BVQ-12690||Scanner||Statistics-collector can throw ConcurrentModificationException|
|Important||BVQ-12799||GUI: Performance view||Node CPU compression stats factor 100 too low (partially solved).|
Aggregated node compression stats still 100x too low. Will be solved in 5.4.0
|Important||BVQ-12679||GUI: Null object||Favorite to map Mdisks to drive arrays did not work.|
|Important||BVQ-12630||GUI: Path based charting||Chart selection method differs from Treemap / Table|
|Important||BVQ-12744||GUI: Editors||Float number input fields do not accept "." or "," correctly|
|Important||BVQ-12754||GUI: Editors||MDisk group & VDisk: Alert assignment change does not activate Apply / OK buttons|
|Important||BVQ-12661||GUI: Favorites||DB favorite store "version" field in MongoDB entity not changed after migration|
|Minor||BVQ-12643||GUI||Perf-Cache: Bucket-fullness detection not always working correctly|
|Minor||BVQ-12717||GUI||Drives show a capacity value of 0|
|Minor||BVQ-7529||GUI||VMware: Names are slightly different|
|Minor||BVQ-12638||GUI: Favorites||Favorites: Menu: Only shows default icon. Custom Icons ignored.|
|Minor||BVQ-12716||GUI: Performance view||IllegalStateException: Next min date equals last min date|
|Minor||BVQ-12550||GUI: Path based charting||Inital Chart End time sometimes = Now instead of EoD|
|Minor||BVQ-12701||GUI: Treemap||Filters: Changing Aspect with filters disables the "enable" checkbox in the menu|
|Minor||BVQ-12659||GUI: Filtering||Does not support negative integers|
|Minor||BVQ-12739||GUI: Filtering||Parsing unit based values in CLI without unit does not apply default units|
|Minor||BVQ-12737||Scanner||Research repeating "Error connecting to host!" during topology scan|
|Minor||BVQ-12787||Scanner||Scanned data consitency check needs exceptions|
|Minor||BVQ-12772||Reporting||"Capacity Report - Capacity per Cluster" missing stack graph in section "Overview of clusters"|
|Minor||BVQ-12664||Installer||Reduce the number of scanner instances doesn't delete the corresponding folders and services|
|Minor||BVQ-12706||GUI: Favorites||Filter: Unit based values in filters not parsed correctly from technical CLI string|
|Installer for consolidated scanner (local & remote)|
|Critical||BVQ-12826||GUI: Objects||Path "/BVQ/VM Datastore/VM Virtual disk" doesn't show any VM Virtual disks|
|Important||BVQ-12825||GUI: Editors||VDisk, MDisk group: Alert rules: Buttons below chooser missing|
|Important||BVQ-12817||Reporting||ClassCastExceptions from MDiskGroupCapacityDataTableRenderer|
|Important||BVQ-12841||VMware Scan||Topology StringIndexOutOfBoundsException|
|Minor||BVQ-12821||BVQ Server||Username validation: Allow "_" and "-" in username|
|Minor||BVQ-12824||GUI||PI Calculation fails during time change in October|
|Minor||BVQ-12828||Grafana||Reduce parallel consumer count|
|Critical||BVQ-12864||GUI:Perf View||VDisk: Scsi Layer Transfer latency is divided by R & W|
|Minor||BVQ-12859||GUI||Error creating topology model|
|Minor||BVQ-12863||GUI: Path Browser||NPE after switching empty input field from text mode to menu mode|
|Critical||BVQ-12905||GUI:Perf View||VDisk: Scsi Layer Transfer latency must be divided by R & W|
Charts use only interval widths available in GUI
|Critical||BVQ-12911||GUI:Treemap||Custom PI Aspect shows values of Real time PIs|
Formats of numbers in excel on some machines in english despite of different format locale