datachecks/dcs-core

📋 What's Changed

• fix: oracle schema prefix by @Ryuk-me in https://github.com/datachecks/dcs-core/pull/296
• chore: version bump to 0.8.3 by @Ryuk-me in https://github.com/datachecks/dcs-core/pull/297
• Full Changelog: https://github.com/datachecks/dcs-core/compare/v0.8.2...v0.8.3

📋 What's Changed

• feat: bigquery query table/columns names with schema prefix by @Ryuk-me in https://github.com/datachecks/dcs-core/pull/292
• chore: version bump to 0.8.2 by @Ryuk-me in https://github.com/datachecks/dcs-core/pull/294
• Full Changelog: https://github.com/datachecks/dcs-core/compare/v0.8.1...v0.8.2

📋 What's Changed

• feat: get column/tables details from query, quoted columns/tables/database by @Ryuk-me in https://github.com/datachecks/dcs-core/pull/290
• chore: version bump to 0.8.1 by @Ryuk-me in https://github.com/datachecks/dcs-core/pull/291
• Full Changelog: https://github.com/datachecks/dcs-core/compare/v0.8.0...v0.8.1

📋 What's Changed

• fix: sybase IQ driver & sql connection engine dispose by @Ryuk-me in https://github.com/datachecks/dcs-core/pull/282
• Full Changelog: https://github.com/datachecks/dcs-core/compare/v0.7.0...v0.8.0

✨ New Feature

• feat: Oracle integration by @Ryuk-me in https://github.com/datachecks/dcs-core/pull/258
• feat: add delta validation by @subhankarb in https://github.com/datachecks/dcs-core/pull/261
• feat: ibm-db2 integration by @Ryuk-me in https://github.com/datachecks/dcs-core/pull/262

🐛 Fix

• fix: mssql database connect by @Ryuk-me in https://github.com/datachecks/dcs-core/pull/260

🔒 Security

• build(deps): bump snowflake-connector-python from 3.12.2 to 3.12.3 by @dependabot in https://github.com/datachecks/dcs-core/pull/264
• Full Changelog: https://github.com/datachecks/dcs-core/compare/v0.4.0...v0.5.0

✨ New Features

• feat: add spark integration support by @subhankarb in https://github.com/datachecks/dcs-core/pull/207
• feat: [DCS-210] add count_uuid and percent_uuid functions by @subhankarb in https://github.com/datachecks/dcs-core/pull/211
• feat: [DCS-222] add valid/invalid values validity functions by @Ryuk-me in https://github.com/datachecks/dcs-core/pull/214
• feat: [DCS-220] add count_usa_phone and percent_usa_phone functions by @ashank2603 in https://github.com/datachecks/dcs-core/pull/221
• feat: [DCS-225] add count_email and percent_email functions by @ashank2603 in https://github.com/datachecks/dcs-core/pull/226
• feat: add string length validators and tests by @YamoshiCode in https://github.com/datachecks/dcs-core/pull/223
• feat: [DCS-230] add usa state code and zip code validations by @ashank2603 in https://github.com/datachecks/dcs-core/pull/231
• feat: Geolocation Validity Metrics by @YamoshiCode in https://github.com/datachecks/dcs-core/pull/228
• + 9 more

🐛 Bug Fix

• fix: sql schema hardcoded in method query_get_table_metadata #212 by @Ryuk-me in https://github.com/datachecks/dcs-core/pull/213
• fix: tests configurations issue by @WeryZebra-Yue in https://github.com/datachecks/dcs-core/pull/216

🐛 Security Fix

• build(deps): bump webpack from 5.89.0 to 5.94.0 in /ui by @dependabot in https://github.com/datachecks/dcs-core/pull/238

✨ New Contributors

• @ashank2603 made their first contribution in https://github.com/datachecks/dcs-core/pull/221
• @YamoshiCode made their first contribution in https://github.com/datachecks/dcs-core/pull/223
• @Ksaurav3380 made their first contribution in https://github.com/datachecks/dcs-core/pull/233
• Full Changelog: https://github.com/datachecks/dcs-core/compare/v0.3.1...v0.4.0

📋 What's Changed

• upgrade: sqlalchemy poetry version by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/208
• Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.3.0...v0.3.1

📋 What's Changed

• Configuration change by @subhankarb in https://github.com/waterdipai/datachecks/pull/203
• [DCS-193] fix mssql dependency by @subhankarb in https://github.com/waterdipai/datachecks/pull/205
• Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.2.6...v0.3.0

✨ New Features

• [DCS-193] add snowflake integration by @subhankarb in https://github.com/waterdipai/datachecks/pull/194
• [DCS-195] add sql server integration by @subhankarb in https://github.com/waterdipai/datachecks/pull/196

🐛 Fix

• fix(typo): renamed datasource iris to iris_pgsql by @Anu-Ra-g in https://github.com/waterdipai/datachecks/pull/171
• fix(core): added new parsing logic for the configurations files by @Anu-Ra-g in https://github.com/waterdipai/datachecks/pull/181
• fix(dependency): added pytz as a direct dependency by @Anu-Ra-g in https://github.com/waterdipai/datachecks/pull/180
• fix: white nav icons by @driptanil in https://github.com/waterdipai/datachecks/pull/183
• fix(poetry): postgres library issue by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/192

🔒 Security

• build(deps): bump cryptography from 42.0.0 to 42.0.2 by @dependabot in https://github.com/waterdipai/datachecks/pull/185
• build(deps): bump ws from 7.5.9 to 7.5.10 in /ui by @dependabot in https://github.com/waterdipai/datachecks/pull/197
• build(deps): bump ejs from 3.1.9 to 3.1.10 in /ui by @dependabot in https://github.com/waterdipai/datachecks/pull/188
• Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.2.5...v0.2.6

✨ New Features:

• feat: add custom SQL metric by @subhankarb in https://github.com/waterdipai/datachecks/pull/157
• feat: dashboard design changes by @driptanil in https://github.com/waterdipai/datachecks/pull/158
• feat: add metric storage framework by @datageek00 in https://github.com/waterdipai/datachecks/pull/142
• feat: add an example for a quick start by @datageek00 in https://github.com/waterdipai/datachecks/pull/160
• feat: add support for configuration directory with multiple configuration files by @datageek00 in https://github.com/waterdipai/datachecks/pull/161

🐛 Bug Fix

• fix(ui): frontend dependency issues by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/144
• fix: schema defaults to public if schema is not present by @Anu-Ra-g in https://github.com/waterdipai/datachecks/pull/153
• fix(yaml): duplicate datasource names by @Anu-Ra-g in https://github.com/waterdipai/datachecks/pull/147
• fix(filters): filter option application fixed by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/155
• fix: duplicate metric names by @Anu-Ra-g in https://github.com/waterdipai/datachecks/pull/152

📦 Others

• docs: Update README.md by @subhankarb in https://github.com/waterdipai/datachecks/pull/133
• build(deps): bump pyarrow from 13.0.0 to 14.0.1 by @dependabot in https://github.com/waterdipai/datachecks/pull/138
• build(deps): bump cryptography from 41.0.4 to 41.0.6 by @dependabot in https://github.com/waterdipai/datachecks/pull/149
• refactor(dashboard): Update dashboard contracts by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/156
• dependency(nivo): updated d3-color dependency by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/165
• refactor: example configurations suffixed with data sources type by @Ryuk-me in https://github.com/waterdipai/datachecks/pull/164
• dependency(ui): removed unnecessary dependencies by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/166
• upgrade to v0.2.5 by @datageek00 in https://github.com/waterdipai/datachecks/pull/168

✨ New Contributors

• @Anu-Ra-g made their first contribution in https://github.com/waterdipai/datachecks/pull/147
• @driptanil made their first contribution in https://github.com/waterdipai/datachecks/pull/158
• @Ryuk-me made their first contribution in https://github.com/waterdipai/datachecks/pull/164
• Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.2.4...v0.2.5

📋 What's Changed

• docs: update validation docs by @subhankarb in https://github.com/waterdipai/datachecks/pull/125
• docs: fix docs failure by @datageek00 in https://github.com/waterdipai/datachecks/pull/127
• fix(dashboard): type decimal is not json serializable in html report generation by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/129
• build(deps): bump urllib3 from 1.26.17 to 1.26.18 by @dependabot in https://github.com/waterdipai/datachecks/pull/130
• build(deps): bump @babel/traverse from 7.23.0 to 7.23.2 in /ui by @dependabot in https://github.com/waterdipai/datachecks/pull/131
• Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.2.3...v0.2.4

✨ Features

• feat(metrics): implemented sum metric + tests by @niyasrad in https://github.com/waterdipai/datachecks/pull/109
• feat(datasource): aws redshift datasource by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/122
• feat(metrics): implemented standard deviation + tests by @niyasrad in https://github.com/waterdipai/datachecks/pull/108
• feat(validation): metric validation framework by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/107
• feat: add initial dashboard framework by @datageek00 in https://github.com/waterdipai/datachecks/pull/116

🐛 Bug Fix

• fix(dashboard): html report slack icon should route to slack by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/121

🐛 Build Fix

• build(deps): bump cryptography from 41.0.3 to 41.0.4 by @dependabot in https://github.com/waterdipai/datachecks/pull/103
• build(deps): bump urllib3 from 1.26.16 to 1.26.17 by @dependabot in https://github.com/waterdipai/datachecks/pull/114
• build(deps): bump webpack from 5.53.0 to 5.76.0 in /ui by @dependabot in https://github.com/waterdipai/datachecks/pull/117

📝 Documentation

• docs: update readme.md file by @datageek00 in https://github.com/waterdipai/datachecks/pull/120
• Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.2.2...v0.2.3

✨ Features

• feat(metric): implemented null count calculation by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/72
• feat(metrics): implemented distinct count with tests by @niyasrad in https://github.com/waterdipai/datachecks/pull/67
• feat(metric): implemented null percentage calculation by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/76
• feat: add bigquery data source by @datageek00 in https://github.com/waterdipai/datachecks/pull/79
• feat: add databricks data source by @datageek00 in https://github.com/waterdipai/datachecks/pull/82
• feat: add elasticsearch data source by @datageek00 in https://github.com/waterdipai/datachecks/pull/83
• feat(metrics): added empty-string-count and tests by @niyasrad in https://github.com/waterdipai/datachecks/pull/78
• feat: add mysql data source by @datageek00 in https://github.com/waterdipai/datachecks/pull/84
• + 1 more

🐛 Bug Fix

• fix(metric): the metric configuration filters does not apply by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/93
• fix(import): modules to import isn't being identifiable by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/95
• fix(metrics): round function in average and variance metric by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/97
• fix(metric): field_name not being accepted in open-search and elastic-search in freshness metric by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/96
• fix(datasource): included qualified_table_name to all table calls by @niyasrad in https://github.com/waterdipai/datachecks/pull/87

📝 Documentation Improvement

• docs: fix the issue link by @fabriciodadosbr in https://github.com/waterdipai/datachecks/pull/88
• docs: add slack channel to readme by @datageek00 in https://github.com/waterdipai/datachecks/pull/94
• docs: update metric configurations by @datageek00 in https://github.com/waterdipai/datachecks/pull/98
• docs: added tracking for docs by @subhankarb in https://github.com/waterdipai/datachecks/pull/99
• docs: update website-docs by @PULAK0717 in https://github.com/waterdipai/datachecks/pull/73

✨ New Contributors

• @PULAK0717 made their first contribution in https://github.com/waterdipai/datachecks/pull/73
• @fabriciodadosbr made their first contribution in https://github.com/waterdipai/datachecks/pull/88
• Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.2.1...v0.2.2

📋 What's Changed

• fix: added better error handle for inpect run by @datageek00 in https://github.com/waterdipai/datachecks/pull/47
• feat: add CLI output for metrics by @datageek00 in https://github.com/waterdipai/datachecks/pull/58
• docs: add getting started page by @datageek00 in https://github.com/waterdipai/datachecks/pull/60
• feat(metric): numeric metric variance calculation by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/56
• fix: add postgres schema name in create engine by @datageek00 in https://github.com/waterdipai/datachecks/pull/62
• docs: update configuration documentation by @datageek00 in https://github.com/waterdipai/datachecks/pull/63
• docs: Update usage_analytics by @datageek00 in https://github.com/waterdipai/datachecks/pull/64
• feat(metric): implement combined metric by @WeryZebra-Yue in https://github.com/waterdipai/datachecks/pull/65
• + 3 more

✨ Feature

• Automatic field profiling for SQL and Search Index data source. The automatic profiler will discover all the tables, indices, and fields for a given dataset. And will generate metrics for all the numeric and text fields
• Added numeric distribution metric for the average value.
• Added numeric distribution metric for minimum value.

✨ New Contributors

• @niyasrad made their first contribution in https://github.com/waterdipai/datachecks/pull/25
• @WeryZebra-Yue made their first contribution in https://github.com/waterdipai/datachecks/pull/39
• Full Changelog: https://github.com/waterdipai/datachecks/compare/v0.1.2...v0.2.0

📋 What's Changed

• Add support for the freshness metric
• Add support for opensearch data source

✨ New Contributors

• @subhankarb made their first contribution in https://github.com/waterdipai/datachecks/pull/1
• @dependabot made their first contribution in https://github.com/waterdipai/datachecks/pull/8
• @datageek00 made their first contribution in https://github.com/waterdipai/datachecks/pull/10
• Full Changelog: https://github.com/waterdipai/datachecks/commits/v0.1.2