Is there any way we can capture ADF data flow activity logs?

Question

I was trying to log the data flow activity information by using the data flow activity's output object which has a key named 'metrics' which contains 'RowsRead' and 'RowsWritten' but sometimes when data flow activity insert data into database, the metrics show 'NULL' value although records were read and written into database.

question from:https://stackoverflow.com/questions/65932762/is-there-any-way-we-can-capture-adf-data-flow-activity-logs

Answer 1

Yes you can do that in ADF

You can create a parameterized stored procedure to do this activity.

Then call that Stored Procedure in ADF pipeline to store the logs in Database.

You can follow this link to know how to develop that Stored Procedure and invoke the same in your ADF pipeline

Thanks!