Menu
we are looking at developing a BI solution in Azure to analyse client airline search requests to our system. The requests are stored as xmls and there are around 50 million generated each day. What azure solutions would you recommend to load these to the cloud, analyse this data...trends across time (so keeping historical data), real time system performance/errors..the data is included in the xmls?
I assume we would also need something like express route to transfer the data to the cloud
683
XML format is supported for the following connectors: Amazon S3, Amazon S3 Compatible Storage, Azure Blob, Azure Data Lake Storage Gen1, Azure Data Lake Storage Gen2, Azure Files, File System, FTP, Google Cloud Storage, HDFS, HTTP, Oracle Cloud Storage and SFTP. It is supported as source but not sink.
The XML file format is based on the XML Document Object Model (DOM) that is a programming API for HTML and XML documents. The XML DOM defines a standard method to access and manipulate the XML document elements.
XML data sharing is based on the Client-Server architecture, i.e. one application (Web server) owns the data and one or more applications (Web clients) read these data or write into them. The PROMOTIC application can be both the Web server and the Web client for XML data.
At the moment (2020-06), XML is still not supported by Azure Synapse (Azure DW).
A feasible approach is using Azure Functions to either parse the XML, or translate it to JSON (and then use SQL json_query/value). The second approach does mean losing Xquery functionality.
Classic Azure SQL Server (or it's hyperscale version) does support regular XML queries.
86
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With
