I created a glue job and enabled the job bookmark, want to see the metadata stored by glue to keep track of processed files.
Unfortunately AWS Glue job bookmarking details are not available for customers. As far as I know it is based on the job name, source file name and transformationContext
strings passed to DynamicFrame's methods like getSinkWithFormat()
, applyMapping()
, getCatalogSource()
.
Besides that Job.init()
and Job.commit()
must be called at the beginning and end of a script respectively to make bookmarking working.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With