Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Import data using mlcp, a csv file and transform parse date

I have a csv file. I've managed import these data into MarkLogic using mlcp which then created a xml file in MarkLogic.

Now in csv I have this format "6/29/2013 5:00:00 PM" random in one of the column. How do I use xquery and probably node-replace as a transform function to convert this date into a different format such as "2013-06-29" as MarkLogic default date format?

Any help is appreciated...


I have created transform.xqy and install it on Modules in MLogic. I'm thinking about using "xdmp:node-replace" to replace the date with expected format. Or should I go thorugh the csv column by column (How to do?) and use "castable as xs:dateTime" to determine date value or not. Yet, even just printing out the content value/uri, always giving me error.

xquery version "1.0-ml";
module namespace example = "http://test.com/example";

(: If the input document is XML, insert @NEWATTR, with the value
 : specified in the input parameter. If the input document is not
 : XML, leave it as-is.
 :)
declare function example:transform(
  $content as map:map,
  $context as map:map
) as map:map*
{
  let $the-doc-uri := map:get($content, "uri")
  let $the-doc := map:get($content, "value")
  return
    trace($the-doc, 'The value of doc is: ')
};
like image 734
stuckedoverflow Avatar asked Feb 20 '26 05:02

stuckedoverflow


1 Answers

The MarkLogic documentation contains a full example of an MLCP transform:

https://docs.marklogic.com/guide/mlcp/import#id_65640

It shows this example, which adds an attribute to the XML content:

declare function example:transform(
  $content as map:map,
  $context as map:map
) as map:map*
{
  let $attr-value := 
   (map:get($context, "transform_param"), "UNDEFINED")[1]
  let $the-doc := map:get($content, "value")
  return
    if (fn:empty($the-doc/element()))
    then $content
    else
      let $root := $the-doc/*
      return (
        map:put($content, "value",
          document {
            $root/preceding-sibling::node(),
            element {fn:name($root)} {
              attribute { fn:QName("", "NEWATTR") } {$attr-value},
              $root/@*,
              $root/node()
            },
            $root/following-sibling::node()
          }
        ), $content
      )
};

Keep in mind you are supposed to update the "value" property of the $content map:map, and return $content to get your transformation result added to the database. I suggest using a (potentially recursive) typeswitch to identify element nodes, and then adjusting their value accordingly..

HTH!

like image 116
grtjn Avatar answered Feb 22 '26 16:02

grtjn



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!