Seddryck/NBi
NBi is a testing framework (add-on to NUnit) for Business Intelligence and Data Access. The main goal of this framework is to let users create tests with a declarative approach based on an Xml syntax. By the means of NBi, you don't need to develop C# or Java code to specify your tests! Either, you don't need Visual Studio or Eclipse to compile your test suite. Just create an Xml file and let the framework interpret it and play your tests. The framework is designed as an add-on of NUnit but with the possibility to port it easily to other testing frameworks.
๐ฆ Framework
- [#701](https://github.com/Seddryck/NBi/issues/701) - [lookup-matches](http://www.nbi.io/docs/lookup-matches/) assertion is now returning no error when a row from the candidate result-set has no matching key in the reference result-set.
- [#717](https://github.com/Seddryck/NBi/issues/717) - Environment variables can also be gathered from the process scope
๐ฆ genbiL
- [#702](https://github.com/Seddryck/NBi/issues/702) - Add Exception handling also for Quiet Execution
๐ฆ Framework
- [#632](https://github.com/Seddryck/NBi/issues/632) - `query-scalar` to get a Json value out of a database
- [#623](https://github.com/Seddryck/NBi/issues/623) - Iterative result-set
- [#584](https://github.com/Seddryck/NBi/issues/584) - Add namespaces to CSharpScalarResolver
- Some new alterations to ease the writing of tests:
- [#620](https://github.com/Seddryck/NBi/issues/620) - Alteration `union` to create a single result-set from two
- [#617](https://github.com/Seddryck/NBi/issues/617) - Alteration `duplicate`
- [#618](https://github.com/Seddryck/NBi/issues/618) - Output transformations within the duplicate alteration
- [#562](https://github.com/Seddryck/NBi/issues/562) - Alteration filtering on unique-rows
- + 7 more
๐ bug fixes
- [#663](https://github.com/Seddryck/NBi/issues/663) - `run-once` is broken
- [#638](https://github.com/Seddryck/NBi/issues/638) - Wait for Power BI Desktop to Get Going
- [#600](https://github.com/Seddryck/NBi/issues/600) - Error while trying to open Power BI Desktop
- [#612](https://github.com/Seddryck/NBi/issues/612) - `save suite` action incorrectly serializes CSV profile properties
- [#591](https://github.com/Seddryck/NBi/issues/591) - Nunit FileLoadException when using Bootstrapper in Visual Studio 2019
๐ฆ genbiL
- [#610](https://github.com/Seddryck/NBi/issues/610) - Adding CSV profile and other small additions to genbiL
๐ฆ Framework
- [#248](https://github.com/Seddryck/NBi/issues/248) - Support rest-api with JSON content
- [#266](https://github.com/Seddryck/NBi/issues/266) - Rest should support XML content-type
- [#269](https://github.com/Seddryck/NBi/issues/269) - Support of JSONPath
- [#553](https://github.com/Seddryck/NBi/issues/553) - Global variable value provided by custom code
- [#487](https://github.com/Seddryck/NBi/issues/487) - Local-variable values provided by custom code
- [#488](https://github.com/Seddryck/NBi/issues/488) -Any sequence should support a filter
- [#574](https://github.com/Seddryck/NBi/issues/574) - Use variables inside <xpath> node
- [#380](https://github.com/Seddryck/NBi/issues/380) - Group-by should support grouping rows' logic based on predicates
- + 6 more
๐ bug fixes
- [#573](https://github.com/Seddryck/NBi/issues/573) - Complex alteration of a result-set including numeric and text values leading to a numeric with the wrong decimal separator
- [#578](https://github.com/Seddryck/NBi/issues/578) - Name of a connection-string not correctly displayed in error message
- [#579](https://github.com/Seddryck/NBi/issues/579) - xml-source file path error
๐ฆ genbiL
- [#582](https://github.com/Seddryck/NBi/issues/582) - Load optional file for test-case
๐ฆ Framework
- [#358](https://github.com/Seddryck/NBi/issues/358) - Replace the result-set defined in the equal-to assertion by the new one
- [#527](https://github.com/Seddryck/NBi/issues/527) - New result-set should support the xml-source element
- [#534](https://github.com/Seddryck/NBi/issues/534) and [#531](https://github.com/Seddryck/NBi/issues/531)- Improve management of namespaces in the xml-source
- [#543](https://github.com/Seddryck/NBi/issues/543) - equal-to assertion with behavior set to single-row is now supporting columns' name and not just ordinal position of columns
- [#495](https://github.com/Seddryck/NBi/issues/495) - Add support of intersection-of in addition to subset/superset
- [#411](https://github.com/Seddryck/NBi/issues/470) - Add support for tolerance when using lookup-matches
- [#493](https://github.com/Seddryck/NBi/issues/493) - New alteration for renaming a column of a result-set
- [#548](https://github.com/Seddryck/NBi/issues/548) - New alteration for renaming supports a way to not fail when the column doesn't exist
- + 23 more
๐ bug fixes
- [#547](https://github.com/Seddryck/NBi/issues/547) - single-row assertion gives false positive
- [#480](https://github.com/Seddryck/NBi/issues/480) - Potential double evaluation of a variable when used in the system-under-test and the assert of the same test.
- [#517](https://github.com/Seddryck/NBi/issues/517) - Using format in a parameter: casting error
- [#464](https://github.com/Seddryck/NBi/issues/464) - Empty/NULL value as a part of the key
- [#511](https://github.com/Seddryck/NBi/issues/511) - Regex no longer working correctly with | (or) symbol
- [#551](https://github.com/Seddryck/NBi/issues/551) - Timeout in seconds and not milliseconds for queries
- [#544](https://github.com/Seddryck/NBi/issues/544) - MDX query parameter interpreted as a column name for a row-context and not as a literal
๐ฆ genbiL
- [#504](https://github.com/Seddryck/NBi/issues/504) - Add the possibility to include tests in a group and not only at the root
- [#501](https://github.com/Seddryck/NBi/issues/501) - Add support to redirect generated tests to different groups with genbiL
- [#502](https://github.com/Seddryck/NBi/issues/502) - Support for adding a setup or cleanup to a group through genbiL
๐ฆ GitHub package repository (GPR)
- The different packages are now also available on *GitHub package repository* at https://github.com/Seddryck/NBi/packages
๐ฆ Framework
- [#358](https://github.com/Seddryck/NBi/issues/358) - Replace the result-set defined in the equal-to assertion by the new one
- [#527](https://github.com/Seddryck/NBi/issues/527) - New result-set should support the xml-source element
- [#534](https://github.com/Seddryck/NBi/issues/534) and [#531](https://github.com/Seddryck/NBi/issues/531)- Improve management of namespaces in the xml-source
- [#495](https://github.com/Seddryck/NBi/issues/495) - Add support of intersection-of in addition to subset/superset
- [#411](https://github.com/Seddryck/NBi/issues/470) - Add support for tolerance when using lookup-matches
- [#493](https://github.com/Seddryck/NBi/issues/493) - New alteration for renaming a column of a result-set
- [#385](https://github.com/Seddryck/NBi/issues/385) - New alteration to hold or remove columns of a result-set by name or index
- [#507](https://github.com/Seddryck/NBi/issues/507) - New alteration to add a new column based on value of other columns and the NCalc engine
- + 19 more
๐ bug fixes
- [#480](https://github.com/Seddryck/NBi/issues/480) - Potential double evaluation of a variable when used in the system-under-test and the assert of the same test.
- [#517](https://github.com/Seddryck/NBi/issues/517) - Using format in a parameter: casting error
- [#464](https://github.com/Seddryck/NBi/issues/464) - Empty/NULL value as a part of the key
- [#511](https://github.com/Seddryck/NBi/issues/511) - Regex no longer working correctly with | (or) symbol
๐ฆ genbiL
- [#504](https://github.com/Seddryck/NBi/issues/504) - Add the possibility to include tests in a group and not only at the root
- [#501](https://github.com/Seddryck/NBi/issues/501) - Add support to redirect generated tests to different groups with genbiL
- [#502](https://github.com/Seddryck/NBi/issues/502) - Support for adding a setup or cleanup to a group through genbiL
๐ฆ GitHub package repository (GPR)
- The different packages are now also available on *GitHub package repository* at https://github.com/Seddryck/NBi/packages
๐ฆ Framework
- [#358](https://github.com/Seddryck/NBi/issues/358) - Replace the result-set defined in the equal-to assertion by the new one
- [#495](https://github.com/Seddryck/NBi/issues/495) - Add support of intersection-of in addition to subset/superset
- [#411](https://github.com/Seddryck/NBi/issues/470) - Add support for tolerance when using lookup-matches
- [#493](https://github.com/Seddryck/NBi/issues/493) - New alteration for renaming a column of a result-set
- [#385](https://github.com/Seddryck/NBi/issues/385) - New alteration to hold or remove columns of a result-set by name or index
- [#507](https://github.com/Seddryck/NBi/issues/507) - New alteration to add a new column based on value of other columns
- [#512](https://github.com/Seddryck/NBi/issues/512) - New alteration to unstack a result-set
- [#364](https://github.com/Seddryck/NBi/issues/364) - New alteration for summarization
- + 13 more
๐ bug fixes
- [#480](https://github.com/Seddryck/NBi/issues/480) - Potential double evaluation of a variable when used in the system-under-test and the assert of the same test.
- [#517](https://github.com/Seddryck/NBi/issues/517) - Using format in a parameter: casting error
- [#464](https://github.com/Seddryck/NBi/issues/464) - Empty/NULL value as a part of the key
- [#511](https://github.com/Seddryck/NBi/issues/511) - Regex no longer working correctly with | (or) symbol
๐ฆ genbiL
- [#504](https://github.com/Seddryck/NBi/issues/504) - Add the possibility to include tests in a group and not only at the root
- [#501](https://github.com/Seddryck/NBi/issues/501) - Add support to redirect generated tests to different groups with genbiL
- [#502](https://github.com/Seddryck/NBi/issues/502) - Support for adding a setup or cleanup to a group through genbiL
๐ฆ Framework
- [#411](https://github.com/Seddryck/NBi/issues/411) - Create several cases from one test's definition
- [#431](https://github.com/Seddryck/NBi/issues/431) - Support loop-sentinel with a duration step
- [#466](https://github.com/Seddryck/NBi/issues/466) - Support of half-open intervals for loop-sequences
- [#434](https://github.com/Seddryck/NBi/issues/434) - Support list of values when settling local-variable values
- [#441](https://github.com/Seddryck/NBi/issues/441) - Use local-variables to define categories and traits or customize test's name
- [#405](https://github.com/Seddryck/NBi/issues/405) - Support to check that columns resulting of a lookup match with expectations
- [#442](https://github.com/Seddryck/NBi/issues/442) - Support custom parsers for flat files
- [#444](https://github.com/Seddryck/NBi/issues/444) - Support a fallback to an empty result-set when a csv file is missing
- + 10 more
๐ฆ genbiL
- [#455](https://github.com/Seddryck/NBi/issues/455) - The value of the regular expression contained in a ```matches-regex``` is now surrounded by CDATA
- [#439](https://github.com/Seddryck/NBi/issues/439) - Support filter distinct when rows have arrays
- [#456](https://github.com/Seddryck/NBi/issues/456) - Combination of predicates should allow for a list of less than 2 predicates
๐ฆ Framework
- [#411](https://github.com/Seddryck/NBi/issues/411) - Create several cases from one test's definition
- [#431](https://github.com/Seddryck/NBi/issues/431) - Support loop-sentinel with a duration step
- [#466](https://github.com/Seddryck/NBi/issues/466) - Support of half-open intervals for loop-sequences
- [#434](https://github.com/Seddryck/NBi/issues/434) - Support list of values when settling local-variable values
- [#441](https://github.com/Seddryck/NBi/issues/441) - Use local-variables to define categories and traits or customize test's name
- [#405](https://github.com/Seddryck/NBi/issues/405) - Support to check that columns resulting of a lookup match with expectations
- [#442](https://github.com/Seddryck/NBi/issues/442) - Support custom parsers for flat files
- [#444](https://github.com/Seddryck/NBi/issues/444) - Support a fallback to an empty result-set when a csv file is missing
- + 10 more
๐ฆ genbiL
- [#455](https://github.com/Seddryck/NBi/issues/455) - The value of the regular expression contained in a ```matches-regex``` is now surrounded by CDATA
- [#439](https://github.com/Seddryck/NBi/issues/439) - Support filter distinct when rows have arrays
- [#456](https://github.com/Seddryck/NBi/issues/456) - Combination of predicates should allow for a list of less than 2 predicates
๐ฆ Framework
- [#352](https://github.com/Seddryck/NBi/issues/352) - Add support for checking the referencial integrity of a table when defined on one or more columns
- [#413](https://github.com/Seddryck/NBi/issues/413) - Support reversed lookup
- [#406](https://github.com/Seddryck/NBi/issues/406) - Basic support of scoring for a result-set
- [#414](https://github.com/Seddryck/NBi/issues/414) - Full support of variables for predicateโs reference
- [#421](https://github.com/Seddryck/NBi/issues/421) - Add support for dynamic filename in result-set
- [#419](https://github.com/Seddryck/NBi/issues/419) - You can now reference a variable as a parameter of a query in the assert block
- [#410](https://github.com/Seddryck/NBi/issues/410) - Read environment variables in config/test suite
- [#409](https://github.com/Seddryck/NBi/issues/409) - Override variables' value within the config file
- + 10 more
๐ฆ genbiL
- [#375](https://github.com/Seddryck/NBi/issues/375) - Trim columns' content in genbiL
- [#389](https://github.com/Seddryck/NBi/issues/389) - ```case cross``` is now supporting a join on multiple columns
- [#401](https://github.com/Seddryck/NBi/issues/401) - *(bug fix)* genbiL adding attributes ```column-index``` and ```type``` to ```expression``` element
- [#392](https://github.com/Seddryck/NBi/issues/392) - *(bug fix)* genbiL adding column-index to the ```transformation``` element
- [#376](https://github.com/Seddryck/NBi/issues/376) - *(bug fix)* Action ```cross``` doesn't work when one the columns contains an array
- [#372](https://github.com/Seddryck/NBi/issues/372) - *(bug fix)* Serialization of ```expression``` includes unexpected attributes
- [#422](https://github.com/Seddryck/NBi/issues/422) - *(bug fix)* Incorrect serialization for ```csv-profile``` (missing-cell and empty-cell)
๐ฆ Framework
- [#352](https://github.com/Seddryck/NBi/issues/352) - Add support for checking the referencial integrity of a table when defined on one or more columns
- [#413](https://github.com/Seddryck/NBi/issues/413) - Support reversed lookup
- [#406](https://github.com/Seddryck/NBi/issues/406) - Basic support of scoring for a result-set
- [#414](https://github.com/Seddryck/NBi/issues/414) - Full support of variables for predicateโs reference
- [#421](https://github.com/Seddryck/NBi/issues/421) - Add support for dynamic filename in result-set
- [#419](https://github.com/Seddryck/NBi/issues/419) - You can now reference a variable as a parameter of a query in the assert block
- [#410](https://github.com/Seddryck/NBi/issues/410) - Read environment variables in config/test suite
- [#409](https://github.com/Seddryck/NBi/issues/409) - Override variables' value within the config file
- + 10 more
๐ฆ genbiL
- [#375](https://github.com/Seddryck/NBi/issues/375) - Trim columns' content in genbiL
- [#389](https://github.com/Seddryck/NBi/issues/389) - ```case cross``` is now supporting a join on multiple columns
- [#401](https://github.com/Seddryck/NBi/issues/401) - *(bug fix)* genbiL adding attributes ```column-index``` and ```type``` to ```expression``` element
- [#392](https://github.com/Seddryck/NBi/issues/392) - *(bug fix)* genbiL adding column-index to the ```transformation``` element
- [#376](https://github.com/Seddryck/NBi/issues/376) - *(bug fix)* Action ```cross``` doesn't work when one the columns contains an array
- [#372](https://github.com/Seddryck/NBi/issues/372) - *(bug fix)* Serialization of expression includes unexpected attributes
- [#422](https://github.com/Seddryck/NBi/issues/422) - *(bug fix)* Incorrect serialization for csv-profile (missing-cell and empty-cell)
Review of the build and fix issue when deploying NBi with [Nuget](http://www.nuget.org). If you're not using Nuget you can continue to use the release 1.18.0 (it was a pure metadata issue).
โจ New features
- Extensions for execution engine
- #322 Refactoring of the namespace NBi.Core.Query and creation of the NBi.Extensibility
- #329 Configuration is loaded for each test and shouldn't
- #344 [Add support for validating result-sets based on a gremlin query on the Azure Cosmos DB using the Graph API](https://seddryck.wordpress.com/2018/01/16/automating-the-testing-of-an-azure-cosmos-db-instance-with-nbi/)
- [Improvements to predicates](http://www.nbi.io/docs/resultset-predicate/#different-predicates)
- #335 Attribute 'not' not taken into account on the predicate element
- #337 Add predicates to validate that a text is a valid numeric or date or time: ```
- #338 Add a predicate to validate that a value is within a list of expected values`: ```any-of```
- + 3 more
๐ฆ Genbi
- #348 [Add new action 'case duplicate column' for genbiL](www.nbi.io/automation/column-duplicate/)
- #347 Improve performances of genbi when creating large test-suites
- #346 [Accept empty string as default value for a new column](www.nbi.io/automation/column-add/#default-value)
โจ New features
- Extensions for execution engine
- #322 Refactoring of the namespace NBi.Core.Query
- #329 Configuration is loaded for each test and shouldn't
- #344 [Add support for validating result-sets based on a gremlin query on the Azure Cosmos DB using the Graph API](https://seddryck.wordpress.com/2018/01/16/automating-the-testing-of-an-azure-cosmos-db-instance-with-nbi/)
- [Improvements to predicates](http://www.nbi.io/docs/resultset-predicate/#different-predicates)
- #335 Attribute 'not' not taken into account on the predicate element
- #337 Add predicates to validate that a text is a valid numeric or date or time
- #338 Add a predicate to validate that a value is within a list of expected values
- + 3 more
๐ฆ Genbi
- #348 [Add new action 'case duplicate column' for genbiL](www.nbi.io/automation/column-duplicate/)
- #347 Improve performances of genbi when creating large test-suites
- #346 [Accept empty string as default value for a new column](www.nbi.io/automation/column-add/#default-value)
๐ Bug fixes
- [#328](https://github.com/Seddryck/NBi/issues/328) Variables not initialized depending on the runner
- [#330](https://github.com/Seddryck/NBi/issues/330) Can't load embedded templates
- [#331](https://github.com/Seddryck/NBi/issues/331) Can't run packages from the catalog
โจ New features
- [Data Quality Rules Engine]()
- #309 Define a way to report a message in TestResult.xml when test is successful
- #307 Define a way to export result's analysis with a non-markdown formatter
- [Improvements to global variables](http://www.nbi.io/docs/variable-define/)
- #320 Usage of a global variable to define a query parameter
- #304 Define a variable with a SQL query
- #307 Using a global variable in a row-count assert
- #286 [Test that the rows-count of a query is greater than the rows-count of another query](http://www.nbi.io/docs/resultset-rows-count/#row-count-of-another-result-set)
- + 5 more
๐ Bug fixes
- #318 The condition 'service-running' crashes when the service doesn't exist!### Improvement and bug fix for genbi
๐ฆ Other improvements
- #315 Improve Nuget packages by removing external dependencies
โจ New features
- [Data Quality Rules Engine]()
- #309 Define a way to report a message in TestResult.xml when test is successful
- #307 Define a way to export result's analysis with a non-markdown formatter
- [Improvements to global variables](http://www.nbi.io/docs/variable-define/)
- #320 Usage of a global variable to define a query parameter
- #304 Define a variable with a SQL query
- #307 Using a global variable in a row-count assert
- #286 [Test that the rows-count of a query is greater than the rows-count of another query](http://www.nbi.io/docs/resultset-rows-count/#row-count-of-another-result-set)
- + 5 more
๐ Bug fixes
- #318 The condition 'service-running' crashes when the service doesn't exist!### Improvement and bug fix for genbi
๐ฆ Other improvements
- #315 Improve Nuget packages by removing external dependencies
โจ New features
- #89 [Add support for testing that a result-set has no duplicated rows](http://www.nbi.io/docs/resultset-rows-uniqueness/)
- #196 [Test whether a recordset is a subset/superset of an asserted recordset](http://www.nbi.io/docs/compare-superset-subset/)
- #300 [Support of result-sets defined in files in the system-under-test for equalTo (superset/subset)](http://www.nbi.io/docs/compare-equivalence-resultsets/#csv)
- [Predicates for all/no-rows](http://www.nbi.io/docs/resultset-predicate/)
- #301 Global variables for predicates
- #303 Support implicit variables for predicates
- #305 New predicates for checking that a value has no decimal or no seconds
- #262 Add predicate range for numerical and date values
- + 9 more
๐ Bug fixes
- #311 Rounding setting not correctly applied with midpoints
๐ Improvement and bug fix for genbi
- #189 [Support to load multiple templates before generating the tests](http://www.nbi.io/automation/template-add/)
- #306 [Add support for definition of global variables in genbiL]()
- #245 [Introduce a way to use declare and assign consumables for a template](http://www.nbi.io/automation/consumable-set/)
โจ New features
- #241 When comparing result-sets, identify columns by name (and not only by index)
- #105 Display columns' name in error message
- #291 Support for SSIS 2017
- #275 Addictional CSV configuration (empty and missing cells' default value)
- #261 Predicates to test null or empty cells
- #229 Predicates for text cells: regex operator
- #263 Predicates for text cells: starts-with, ends-with and contains
- #270 Improve handling of issues in configuration of a batch to run during setup/cleanup
- + 1 more
๐ Bug fixes
- #269 SQLOLEDB is the official provider identification for Microsoft OLE DB Provider for SQL Server
- #267 30 seconds timeout in queries set as standard
๐ Improvement and bug fix for genbi
- #161 Pass <![CDATA]< in template
- #268 Template generated with Genbi fails to run when using sql-run
- #284 genbiL swaps XML elements
โจ New features
- #215 Support comparison of resultsets with a single row without keys (values only)
- #214 Transform values of a column before the comparison with the other dataset
- #190 Test a shared dataset without specifying a report
- #217 Support the new special value blank
- #212 Support odbc connections for relational databases
- #223 support assertion of an unsuccessful run for an ETL
๐ Bug fixes
- #210 Override project parameters on ETL run
- #208 Unable to change the query timeout using attribute "timeout-milliSeconds"
- #213 Oledb is not correctly supporting Performance tests
- #211 Cell marked as (any) not validated when query returns a NULL
- #187 Fix issues with roles and connection-strings containing carriage return and/or line feeds
- #227 Uid was max bounded to 255. Changed to 4 billions
- #220 Assembly element is now supporting the connection string attribute
๐ฆ What's next ?
- Main ideas for release 1.15 (or next)
- Add more features in the tests of SSRS
- Support an additional tool such as Apache Drill or R platform
- Add features to validate a result-set based on regex, fuzzy string comparisons, ...
- Add some native transformation of a result-set
- Support to test if rows have been added (or updated or deleted) in a table after the execution of a SQL statement or a ETL.
โจ New features
- #215 Support comparison of resultsets with a single row without keys (values only)
- #214 Transform values of a column before the comparison with the other dataset
- #190 Test a shared dataset without specifying a report
- #217 Support the new special value blank
- #212 Support odbc connections for relational databases
๐ Bug fixes
- #210 Override project parameters on ETL run
- #208 Unable to change the query timeout using attribute "timeout-milliSeconds"
- #213 Oledb is not correctly supporting Performance tests
- #211 Cell marked as (any) not validated when query returns a NULL
โจ New features
- #192 Support of SSIS 2016 [... more info ...](http://www.nbi.io/docs/etl-define/)
- #133 Use 'row-count' with a condition and support % of rows validating the condition compared to full result-set. [... more info ...](http://www.nbi.io/docs/resultset-rows-count-advanced/)
- #148 & #59 Assert that all/no rows return by a query validate an expression (less-than, equal, more-than). A replacement, with additional features, for the deprecated `evaluate-rows`. [... more info ...](http://www.nbi.io/docs/resultset-all-no-rows/)
- #154 Improvement in the task to start PowerBI [... more info ...](http://www.nbi.io/docs/setup-wait/)
- #166 Clean-cache is now also available for SSAS (MD and tabular) [... more info ...](http://www.nbi.io/docs/query-performance/#clean-the-cache)
- #163 Possibility to specify that you don't need to take into account an inherited default parameter for some queries [... more info ...](http://www.nbi.io/docs/query-parameters/#overriding-parameters-defined-at-the-test-suite-level)
- #175 Read a connection-string from an ODC file
- #160 Specify a timeout for an individual query
- + 3 more
๐ Bug fixes
- #159 In some conditions the command `group`could result in a list of string in place of an array
- #142 If the test fails then the tasks in the cleanup element are not executed
- #173 Rounding is invalid for negative values
- #162 Tests of structure for relational models only work with SqlConnections (not with OleDb)
- #164 Existing packages are not found when using the Catalog
- #197 Tests for "schema existence" fail when schema_owner is not "dbo"
- #193 genbiL doesn't support two consecutive comments
๐ฆ What's next ?
- Main ideas for release 1.14 (or next)
- Continue to support xml as a data source. The final goal is to be able to query xml files from reports (SSRS).
- Add support for testing that a result-set has no duplicated rows
- Support to test if rows have been added (or updated or deleted) in a table after the execution of a SQL statement or a ETL.
โจ New features
- #133 Use 'row-count' with a condition and support % of rows validating the condition compared to full result-set.
- #148 & #59 Assert that all/no rows return by a query validate an expression (less-than, equal, more-than). A replacement, with additional features, for the deprecated `evaluate-rows`.
- #154 Improvement in the task to start PowerBI
- #166 Clean-cache is now also available for SSAS (MD and tabular)
- #163 Possibility to specify that you don't need to take into account an inherited default parameter for some queries
- #175 Read a connection-string from an ODC file
- #160 Specify a timeout for an individual query
- #156 Support stored procedures when using a report element
- + 1 more
๐ Bug fixes
- #159 In some conditions the command `group`could result in a list of string in place of an array
- #142 If the test fails then the tasks in the cleanup element are not executed
- #173 Rounding is invalid for negative values
- #162 Tests of structure for relational models only work with SqlConnections (not with OleDb)
- #164 Existing packages are not found when using the Catalog
๐ฆ What's next ?
- Main ideas for release 1.14 (or next)
- Continue to support xml as a data source. The final goal is to be able to query xml files from reports (SSRS).
- Add support for testing that a result-set has no duplicated rows
- Support to test if rows have been added (or updated or deleted) in a table after the execution of a SQL statement or a ETL.
โจ New features
- #133 Use 'row-count' with a condition and support % of rows validating the condition compared to full result-set.
- #148 & #59 Assert that all/no rows return by a query validate an expression (less-than, equal, more-than). A replacement, with additional features, for the deprecated `evaluate-rows`.
- #154 Improvement in the task to start PowerBI
๐ Bug fixes
- #159 In some conditions the command `group`could result in a list of string in place of an array
- #142 If the test fails then the tasks in the cleanup element are not executed
๐ฆ What's next ?
- Main ideas for release 1.13 (or next)
- Continue to support xml as a data source. The final goal is to be able to query xml files from reports (SSRS).
- Add support for testing that a result-set has no duplicated rows
- Support to test if rows have been added (or updated or deleted) in a table after the execution of a SQL statement or a ETL.
โจ New features
- #151 You can define Power BI Desktop solutions and run tests for structure, members or queries.
- #152 Two new tasks to run during setup and cleanup: exe-kill and wait
- #132 You can now specify the environment when defining an SSIS package
- #112 Support for testing parameters of a routine
- #143 The ordering of members can be define by a query
- #138 The notion of group of rows for test-cases has been reviewed to support two new actions and let you create more than one group
- #139 new action to split a column into several new columns
- #141 new action to split a column in order to create groups
- + 1 more
๐ Bug fixes
- #113 Undetermined runtime of tests due to large non-matching datasets
- #46 Hashes collision with huge result-sets
- #137 Fix a bug in csv-profile if at least one of the separators was not specified
- #134 Command Exe-Run was not correctly dealing with relative path
- #115 Fix bug when creating two single comments in genbiL
- #136 Fix early check for existence of an external dependency
- #144 Fix bug with currency-format equal to kโฌ or (โฌ)
๐ฆ What's next ?
- Main ideas for release 1.13 (or next)
- Continue to support xml as a data source. The final goal is to be able to query xml files from reports (SSRS).
- Support assertions about the count of rows
- added (or updated or deleted) in a table after the execution of a SQL statement or a ETL.
- validating a predicate (with a percentage)
- Support for testing the parameters of routine
โจ New features
- #151 You can define Power BI Desktop solutions and run tests for structure, members or queries.
- #152 Two new tasks to run during setup and cleanup: exe-kill and wait
- #132 You can now specify the environment when defining an SSIS package
- #112 Support for testing parameters of a routine
- #143 The ordering of members can be define by a query
- #138 The notion of group of rows for test-cases has been reviewed to support two new actions and let you create more than one group
- #139 new action to split a column into several new columns
- #141 new action to split a column in order to create groups
- + 1 more
๐ Bug fixes
- #113 Undetermined runtime of tests due to large non-matching datasets
- #46 Hashes collision with huge result-sets
- #137 Fix a bug in csv-profile if at least one of the separators was not specified
- #134 Command Exe-Run was not correctly dealing with relative path
- #115 Fix bug when creating two single comments in genbiL
- #136 Fix early check for existence of an external dependency
- #144 Fix bug with currency-format equal to kโฌ or (โฌ)
๐ฆ What's next ?
- Main ideas for release 1.12 (or next)
- Continue to support xml as a data source. The final goal is to be able to query xml files from reports (SSRS).
- Support assertions about the count of rows
- added (or updated or deleted) in a table after the execution of a SQL statement or a ETL.
- validating a predicate (with a percentage)
- Support for testing the parameters of routine
โจ New features
- Framework
- Load result-sets from xml files [More info](http://www.nbi.io/docs/compare-equivalence-resultsets/#xml-file)
- You can test the data-type of a column in a relational model [More info](http://www.nbi.io/docs/model-data-type/)
- Support of SSIS 2008R2 and 2012 for ETL testing [More info](http://www.nbi.io/docs/etl-define/#define-an-etl)
- Add routines (stored procedures, table-valued-functions and scalar functions) to the testable objects of a relational model. [More info](http://www.nbi.io/docs/model-objects/)
- Register database providers in the config file to improve support of non-Microsoft data sources [More info](http://www.nbi.io/docs/config-database-providers)
- One-sided tolerance [More info](http://www.nbi.io/docs/compare-tolerances-roundings#one-sided-tolerance)
- genbiL
- + 2 more
๐ Bug fixes
- Framework
- [#98 Failure profile defined in config file is not used](https://github.com/Seddryck/NBi/issues/98)
- [#116 Impossible to record null values in a CSV file](https://github.com/Seddryck/NBi/issues/116)
- [#114 Display-folder not correctly taken into account](https://github.com/Seddryck/NBi/issues/114)
- [#111 Use same relative path for SettingsFilename as TestSuiteFilename](https://github.com/Seddryck/NBi/issues/111)
- [#110 Unable to reference connection strings in setup and cleanup tasks](https://github.com/Seddryck/NBi/issues/110)
- [#129 In assertion 'row-count', the xsd doesn't accept the value 0 for the option 'more-than'](https://github.com/Seddryck/NBi/issues/129)
- genbi
- + 3 more
๐ฆ What's next ?
- Main ideas for release 1.12 (or next)
- Improve performance for comparison of large datasets and fix bug about invalid duplicated rows
- Continue to support xml as a data source. The final goal is to be able to query xml files from reports (SSRS).
- Support assertions about the count of rows added (or updated or deleted) in a table after the execution of a SQL statement or a ETL.
- Support for testing the parameters of routine
- Other ideas probably not for 1.12 but for later
- Create fakes or stubs of views, stored procedures or functions during the setup of a test and remove them during the cleanup. _Work already started_
- Support to surround the test with a transaction and rollback the transaction when the test has been executed.
- + 11 more
โจ New features
- #113 Undetermined runtime of tests due to large non-matching datasets [More Info](https://github.com/Seddryck/NBi/issues/113)
- #46 Hashes collision with huge result-sets [More Info](https://github.com/Seddryck/NBi/issues/46)
๐ฆ What's next ?
- Main ideas for release 1.12 (or next)
- Continue to support xml as a data source. The final goal is to be able to query xml files from reports (SSRS).
- Support assertions about the count of rows added (or updated or deleted) in a table after the execution of a SQL statement or a ETL.
- Support for testing the parameters of routine
โจ New features
- Load result-sets from xml files [More info](http://www.nbi.io/docs/compare-equivalence-resultsets/#xml-file)
- You can test the data-type of a column in a relational model [More info](http://www.nbi.io/docs/model-data-type/)
- Support of SSIS 2008R2 and 2012 for ETL testing [More info](http://www.nbi.io/docs/etl-define/#define-an-etl)
- Add routines (stored procedures, table-valued-functions and scalar functions) to the testable objects of a relational model. [More info](http://www.nbi.io/docs/model-objects/)
- Register database providers in the config file to improve support of non-Microsoft data sources [More info](http://www.nbi.io/docs/config-database-providers)
- One-sided tolerance [More info](http://www.nbi.io/docs/compare-tolerances-roundings#one-sided-tolerance)
๐ Bug fixes
- Framework
- [#98 Failure profile defined in config file is not used](https://github.com/Seddryck/NBi/issues/98)
- [#116 Impossible to record null values in a CSV file](https://github.com/Seddryck/NBi/issues/116)
- [#114 Display-folder not correctly taken into account](https://github.com/Seddryck/NBi/issues/114)
- [#111 Use same relative path for SettingsFilename as TestSuiteFilename](https://github.com/Seddryck/NBi/issues/111)
- [#110 Unable to reference connection strings in setup and cleanup tasks](https://github.com/Seddryck/NBi/issues/110)
- genbi
- [#100 Microsoft.AnalysisServices.AdomdClient missing in folder Genbi](https://github.com/Seddryck/NBi/issues/100)
๐ฆ What's next ?
- Promote this release from status _Beta_ to _Stable_
- Main ideas for release 1.12 (or next)
- Continue to support xml as a data source. The final goal is to be able to query xml files from reports (SSRS).
- Support assertions about the count of rows added (or updated or deleted) in a table after the execution of a SQL statement or a ETL.
- Support for testing the parameters of routine
- Other ideas probably not for 1.12 but for later
- Create fakes or stubs of views, stored procedures or functions during the setup of a test and remove them during the cleanup. _Work already started_
- Support to surround the test with a transaction and rollback the transaction when the test has been executed.
- + 11 more
โจ New features
- Support the testing of structure for relational database: you can use the assertions _exists, contain, equivalent and subsetOf_ on objects from a relational model including _table, views, schemas_ (More to come in next releases). [More info](http://www.nbi.io/docs/model-objects/)
- Support the testing of _sets_ for the structure of tabular and multidimensional models. [More info](http://www.nbi.io/docs/model-objects/)
- Support the testing of members of _sets_ for tabular and multidimensional models. [More info](http://www.nbi.io/docs/members/)
- Support of a default type (_text, numeric, boolean, dateTime_) for columns identified as _value_. [More info](http://www.nbi.io/docs/compare-configuration/#default-type-for-a-result-set)
- Support of keys with a different type (_text, numeric, boolean, dateTime_) than _text_. [More info](http://www.nbi.io/docs/compare-configuration/)
- Tolerance is now supporting a combination of a percentage and a minimal/maximal absolute value. [More info](http://www.nbi.io/docs/compare-tolerances-roundings/#absolute-and-relative-tolerance)
- Improved performances when loading a test-suite with NUnit GUI.
- Improved user-experience when creating a test-suite with ETL. If some attributes are missing in the definition of the etl, NBi will clearly report the missing attributes.
- + 1 more
๐ Bug fixes
- Framework
- [#86: Tolerance and negative values](http://github.com/Seddryck/NBi/issues/86) When a value was negative the tolerance was not correctly calculated.
- [#77: connectionString is not forwarded to some asserts](http://github.com/Seddryck/NBi/issues/77)
- [#79: SSIS DTS Variables do not work with dates](http://github.com/Seddryck/NBi/issues/79)
- [#84: Only "SubsetOf" (and not "Contain" or "EquivalentTo") supports comparaison of members based on another instance](http://github.com/Seddryck/NBi/issues/84)
- [#91: In some cases when xml syntax is invalid, NBi returns an object reference not set](http://github.com/Seddryck/NBi/issues/91)
- genbi
- [#85: xml attribute _timeout_ for element _etl_ not correctly managed by genbi](http://nbi.codeplex.com/workitem/85)
โป๏ธ Major refactoring
- The code supporting the assertions of structure (model) has been refactored to improve maintainability and speed up future development.
๐ฆ Consequences of this move
- The website is hosted http://www.nbi.io
- The [downloads](http://github.com/seddryck/nbi/releases/) section has been moved to GitHub
- This repository (for source code) is now at https://github.com/Seddryck/nbi, [Bitbucket](http://bitbucket.org/Seddryck/nbi) will be a mirror and codeplex will be discarded.
- The issue tracker will also be moved to GitHub at https://github.com/seddryck/nbi/issues
- The documentation is now hosted by GitHub at http://www.nbi.io/docs and http://www.nbi.io/automation/ and is built with Jekyll. The source for this documentation is available and editable at https://github.com/Seddryck/NBi/tree/gh-pages
๐ฆ What's next ?
- Main ideas for release 1.11 (or next)
- Create fakes or stubs of views, stored procedures or functions during the setup of a test and remove them during the cleanup. _Work already started_
- Support tests on the xml of a report (SSRS). _Work already started_
- Support assertions about the count of rows added (or updated or deleted) in a table after the execution of a SQL statement or a ETL.
- Support for asserting the type of a column or attribute
- Other ideas probably not for 1.11 but for later
- Support to surround the test with a transaction and rollback the transaction when the test has been executed.
- Execute tests with etls running on a remote server.
- + 10 more
โจ New features
- Support the testing of structure for relational database: you can use the assertions _exists, contain, equivalent and subsetOf_ on objects from a relational model including _table, views, schemas_ (More to come in next releases). [More info](http://www.nbi.io/docs/model-objects/)
- Support the testing of _sets_ for the structure of tabular and multidimensional models. [More info](http://www.nbi.io/docs/model-objects/)
- Support the testing of members of _sets_ for tabular and multidimensional models. [More info](http://www.nbi.io/docs/members/)
- Support of a default type (_text, numeric, boolean, dateTime_) for columns identified as _value_. [More info](http://www.nbi.io/docs/compare-configuration/#default-type-for-a-result-set)
- Support of keys with a different type (_text, numeric, boolean, dateTime_) than _text_. [More info](http://www.nbi.io/docs/compare-configuration/)
- Tolerance is now supporting a combination of a percentage and a minimal/maximal absolute value. [More info](http://www.nbi.io/docs/compare-tolerances-roundings/#absolute-and-relative-tolerance)
- Improved performances when loading a test-suite with NUnit GUI.
- Improved user-experience when creating a test-suite with ETL. If some attributes are missing in the definition of the etl, NBi will clearly report the missing attributes.
- + 1 more
๐ Bug fixes
- Framework
- [#86: Tolerance and negative values](http://github.com/Seddryck/NBi/issues/86) When a value was negative the tolerance was not correctly calculated.
- [#77: connectionString is not forwarded to some asserts](http://github.com/Seddryck/NBi/issues/77)
- [#79: SSIS DTS Variables do not work with dates](http://github.com/Seddryck/NBi/issues/79)
- [#84: Only "SubsetOf" (and not "Contain" or "EquivalentTo") supports comparaison of members based on another instance](http://github.com/Seddryck/NBi/issues/84)
- [#91: In some cases when xml syntax is invalid, NBi returns an object reference not set](http://github.com/Seddryck/NBi/issues/91)
- genbi
- [#85: xml attribute _timeout_ for element _etl_ not correctly managed by genbi](http://nbi.codeplex.com/workitem/85)
โป๏ธ Major refactoring
- The code supporting the assertions of structure (model) has been refactored to improve maintainability and speed up future development.
๐ฆ Consequences of this move
- The website is hosted http://www.nbi.io
- The [downloads](http://github.com/seddryck/nbi/releases) section has been moved to GitHub
- This repository (for source code) is now at https://github.com/Seddryck/nbi, [Bitbucket](http://bitbucket.org/Seddryck/nbi) will be a mirror and codeplex will be discarded.
- The issue tracker will also be moved to GitHub at https://github.com/seddryck/nbi/issues
- The documentation is now hosted by GitHub at http://www.nbi.io/docs and http://www.nbi.io/automation/ and is built with Jekyll. The source for this documentation is available and editable at https://github.com/Seddryck/NBi/tree/gh-pages
๐ฆ What's next ?
- Main ideas for release 1.11 (or next)
- Create fakes or stubs of views, stored procedures or functions during the setup of a test and remove them during the cleanup. _Work already started_
- Support tests on the xml of a report (SSRS). _Work already started_
- Support assertions about the count of rows added (or updated or deleted) in a table after the execution of a SQL statement or a ETL.
- Other ideas probably not for 1.11 but for later
- Support to surround the test with a transaction and rollback the transaction when the test has been executed.
- Execute tests with etls running on a remote server.
- Add a setup command to process parts of a cube (SSAS).
- + 9 more
