bandsbad.blogg.se

(1) Do you use Azure SQL Database or SQL Server on premises? And a thank you to anyone who can help me solve this! Currently, I have around 15 SQL tables and not all have this issue, but we are getting quite a few with these issues so any help would be appreciated. Hoping this is enough detail, but please if more detail is needed feel free to ask. The data flow being used (very simple transformation) The column doesn't disappear and shows data in the sink data preview (col_indsutry_pirl)ĭata disappears in the SQL table (col_indsutry_pirl) Source file with data in the data preview (using col_idnum)Ĭolumn disappears in sink, data preview (missing col_idnum)Ĭolumn reappears in SQL table but without data (col_idnum)ĭata type matches in the data flow projection and in the SQL schema

The strange thing is that 1) the source data does have full data in these particular columns 2) in the sink, the column completely disappears even though it is in the mapping OR 3) if the column doesn't go missing in the sink, the data shows up in the sink (data preview) but not in the SQL table. However, I am currently having issues with some data from some columns not showing up in their respective SQL tables or the columns disappearing from the sink.

I have managed to create a pipeline that ingests data and dumps it into a SQL database. I am relatively new to using Azure, currently working on a data migration project.