Azure-Player/azure.datafactory.tools

📋 What's Changed

• Fixed ClientAssertionCredential authentication failure for federated identity (OIDC) credentials by removing redundant `Get-AzAccessToken` calls in `Get-AzDFV2Credential` and `Remove-AdfObjectRestAPI` #492 by @NowinskiK in https://github.com/Azure-Player/azure.datafactory.tools/pull/493
• Full Changelog: https://github.com/Azure-Player/azure.datafactory.tools/compare/v.1.15.0...v1.16

✨ Added

• Credential type of ADF objects is now supported for deployment via REST API

🐛 Fixed

• Fix DryRun not loading deployment state from storage for hash comparison by @pardhasaradhireddy in https://github.com/Azure-Player/azure.datafactory.tools/pull/476
• Starting blob event trigger fails with 'Resource cannot be updated during provisioning' - now waits for provisioning to complete before retrying #484, #474, #463
• Fixed REST API calls failing with 401 Unauthorized due to Az.Accounts 5.x returning SecureString from Get-AzAccessToken
• Fixed DryRun not loading deployment state from storage for hash comparison #476
• README.md updated and new Structured Documentation created

✨ New Contributors

• @pardhasaradhireddy made their first contribution in https://github.com/Azure-Player/azure.datafactory.tools/pull/476
• Full Changelog: https://github.com/Azure-Player/azure.datafactory.tools/compare/v.1.14.0...v.1.15.0

✨ Added

• New input parameters for `Get-AdfDocDiagram` function: Include, Exclude.

🐛 Fixed

• Fixed trigger start retry logic to exit immediately on successful start instead of running all 5 attempts #465
• Fixed CSV parametrization line count reporting when CSV contains empty lines #446

🐛 Fixed

• Adopted to breaking change in Az.Accounts v5.0 with Get-AzAccessToken that doesn't support String anymore #449

✨ Added

• Error during the import when required Az.Resource module is not loaded #336
• Az.DataFactory module is required to import adftools
• Added function `Set-AdfToolsAuthToken` to enable changing URL to API when target environment is different the default Global Azure #356 #441

🐛 Fixed

• Error when deleting credentials #403

✨ Added

• Error during the import when required Az.Resource module is not loaded #336
• Az.DataFactory module is required to import adftools
• Added function `Set-AdfToolsAuthToken` to enable changing URL to API when target environment is different than default Global Azure #356 #441

🐛 Fixed

• Error when deleting credentials #403

🐛 Fixed

• Unknown object type: SparkJobDefinition #428 by adding the type to the ignored list

🐛 Fixed

• Fixed saving deployment state file with UTF8 BOM-less regardless of PS version #425

🐛 Fixed / Added

• Incremental deploy feature causes payload limit issue #374
• Incremental state is no longer saved into Global Parameter of ADF, but now it's stored in provided Storage Account #374

🐛 Fixed / Added

• Incremental deploy feature causes payload limit issue #374
• Incremental state is no longer saved into the Global Parameters of ADF, but now it's stored in provided Storage Account #374

🐛 Fixed

• Trigger Activation Failure Post-Selective Deployment when TriggerStopMethod = `DeployableOnly` #386
• Significantly improved performance of unit tests by mocking target ADF

🐛 Fixed

• `Test-AdfCode` failed when run on Docker image and $ConfigPath param is not provided #394

🐛 Fixed

• Fixed failure of publishing ADF when globalConfigurations exist in Factory file but Global Params does not #387

🐛 Fixed

• Incremental re-deployment of deleted and recreated objects #355

🐛 Fixed

• Deployment of Global Parameters might not work sometimes #354

✨ Added

• Stop and restart only changed triggers #264 #332
• New option to Stop/Start only the triggers that are already Started #291

🐛 Fixed

• `RootFolder` must be absolute otherwise temp files cannot be written #335
• Catch InvalidOperation exception when reading empty FilterFilePath in New-AdfPublishOption.ps1 #338
• Purview configuration gets overwritten when deploy Global Parameters using ADF deployment task #343
• Incremental Deployment seems to not work when factory folder does not exist #346
• The publish cmdlet tries to delete enabled (active) trigger (not in source) when TriggerStartMethod = KeepPreviousState #350

✨ Added

• Remove pipeline's from check (`Test-AdfCode`) for dashes in name #309
• Test-AdfLinkedService can use internally Invoke-AzRestMethod #144
• Test-AdfLinkedService return an object #165
• Test-AdfLinkedService accepts parameters of testing LS #222

🐛 Fixed

• Bug #311: Fixed deletion of credential type of objects
• Bug #331: Fixed `Test-AdfCode` for [credential] objects

✨ Added

• More precise error message when value in config is empty #300
• Incremental deployment!!! #195
• Support for credentials deployment & delete #156

🐛 Fixed

• Defined ignored types in references and added `BigDataPool` to it #289

🐛 Fixed

• Validation of ADF files fails when JSON contains property with single quote #287
• Validation of ADF files fails when a pipeline has reference to Synapse notebook

📦 [1.1.0] - 2023-02-23

• Support for new SynapseNotebook activity #279

📦 [1.0.0] - 2023-01-02

• Version 1.0 released
• 100% tests passed

🐛 Fixed

• Bug #260: Fixed newly introduced bug in Test-AdfCode

🐛 Fixed

• Bug #260: Test-AdfCode function: The property 'globalParameters' cannot be found on this object.

🐛 Fixed

• Bug #226: Cannot overwrite/set DateTime type of value via config file

🐛 Fixed

• Bug #229: Wildcard in name not working in `json` config file

🐛 Fixed

• The module accepts Credentials type of object (when loading from files), but the deployment is skipped and not supported yet. #156

🐛 Fixed

• `Publish-AdfV2UsingArm` cmdlet to make it compatible with PS 5.1
• Updating value of global params of boolean types #203

✨ Added

• Added tests for `Publish-AdfV2UsingArm`
• Added `OutputFolder` input parameter to `Export-AdfToArmTemplate`
• Added new cmdlet: `Test-AdfArmTemplate` #191

🐛 Fixed

• Bug: Error in replacing property using config.csv when empty element exists #186
• Bug: Replacing properties from json-config for managedPrivateEndpoints #184 #185

📦 [0.95.1] - 2021-12-07

• Bug fixed: Loading ADF from code fails when excluding any object and ManagedVNET exist #171

📦 [0.95.0] - 2021-10-23

• Added structure to return object for Test-AdfCode which allows to check number of warnings too
• Fixed tests