Skip to main content
Solved

Data Type in table which import thru CSV file


Forum|alt.badge.img+1

Hello 

I noticed that data type for table import thru CSV file is by default as string, how can I change it to other data type like boolean, array and etc? 

 

Regards

Best answer by Sunil Krishnamoorthy

Hi @Haw Keat Lim Thanks for question.

RAW(aka the staging area) is a temporary storage area for data copied from source systems. It’s a json blob storage behind the scenes. Since it’s a temporary storage it’s not designed to store schema and is not optimised for direct querying or analytics. 

Users are expected to use transformations or functions to read data from RAW, enforce schema and write to the data model and then query the data. 

 

I hope that helps. Let’s us know if you think we you need schema retained in RAW for your usecase. We would like to understand better. 

 

Cheers!
Sunil

View original
Did this topic help you find an answer to your question?

Sunil Krishnamoorthy
Seasoned Practitioner
Forum|alt.badge.img

Hi @Haw Keat Lim Thanks for question.

RAW(aka the staging area) is a temporary storage area for data copied from source systems. It’s a json blob storage behind the scenes. Since it’s a temporary storage it’s not designed to store schema and is not optimised for direct querying or analytics. 

Users are expected to use transformations or functions to read data from RAW, enforce schema and write to the data model and then query the data. 

 

I hope that helps. Let’s us know if you think we you need schema retained in RAW for your usecase. We would like to understand better. 

 

Cheers!
Sunil


Dilini Fernando
Seasoned Practitioner
Forum|alt.badge.img+2

Hi @Haw Keat Lim,

We are following up to see whether you're satisfied with the responses you've received?

If you found the responses offered by our community members to be instructive and helpful, we kindly request that you consider marking the most helpful response as the "Best Answer."This little action will acknowledges the person who offered the answer and also makes it simpler for other community members to find the most correct comments.

Best regards
Dilini

 


Reply


Cookie Policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie Settings