Export D365 F&O data to Azure Data Lake

Azure Data Lake        

Azure Data Lake is a fully managed, scalable, and highly available service from Microsoft. It includes built-in disaster recovery. 

When you enable the Export to Azure Data Lake add-in, you connect your F&O environment to a designated data lake. Authorized users can then copy data from your F&O environment to that data lake. Tools such as Power BI and Azure Synapse enable analytics, business intelligence, and machine learning scenarios for data in the data lake.

Data that is stored in the data lake is organized in a folder structure that uses Common Data Model format. Common Data Model format provides additional metadata in a machine-readable JavaScript Object Notation (JSON) format, so that downstream tools can determine the semantics of the data. The additional metadata includes the table structure, descriptions, and data types.

• Model.json
• Metadata file contains information about entity records/attributes and links to data files

• Data Files
• Data files have well-defined structure and format and are references in model.json file
• Files must be in .csv format without header information
• Columns defined in model.json
• CSV files containing the data

Configure Export to Data Lake

1. Create Service Principal for Microsoft Dynamics ERP Microservices
2. Configure Azure Resources
3. Create an application in Azure Active Directory
4. Create a Data Lake Storage (Gen2) account in your subscription
5. Grant access control roles to applications
6. Create a key vault
7. Add secrets to the key vault
8. Authorize the application to read secrets in the key vault
9. Power Platform integration
10. Install the Export to Data Lake add-in in LCS

11. Enable the Export to Data Lake feature in F&O
12. Select tables to export to Data lake
13. Monitor the tables in Data Lake

Reference :- Source from Microsoft Docs

https://gurug.com/blogs/d365-fo-azure-data-lake-integration/