Azure Data Lake
Azure Data Lake is a fully managed, scalable, and highly available service from Microsoft. It includes built-in disaster recovery.
When you enable the Export to Azure Data Lake add-in, you connect your F&O environment to a designated data lake. Authorized users can then copy data from your F&O environment to that data lake. Tools such as Power BI and Azure Synapse enable analytics, business intelligence, and machine learning scenarios for data in the data lake.
Data that is stored in the data lake is organized in a folder structure that uses Common Data Model format. Common Data Model format provides additional metadata in a machine-readable JavaScript Object Notation (JSON) format, so that downstream tools can determine the semantics of the data. The additional metadata includes the table structure, descriptions, and data types.
- Model.json
- Metadata file contains information about entity records/attributes and links to data files
- Data Files
- Data files have well-defined structure and format and are references in model.json file
- Files must be in .csv format without header information
- Columns defined in model.json
- CSV files containing the data
Configure Export to Data Lake
- Create Service Principal for Microsoft
Dynamics ERP Microservices
- Configure Azure Resources
- Create an application in Azure Active
Directory
- Create a Data Lake Storage (Gen2)
account in your subscription
- Grant access control roles to
applications
- Create a key vault
- Add secrets to the key vault
- Authorize the application to read
secrets in the key vault
- Power Platform integration
- Install the Export to Data Lake add-in
in LCS
- Enable the Export to Data Lake feature in F&O
- Select tables to export to Data lake
- Monitor the tables in Data Lake
