And snowflake uses INFER_SCHEMA I believe you can do this
select * from table(
infer_schema(
location=>'@stage/my file.csv',
file_format=>'my_csv_format'
)
);
Although tbh I'm not sure if that's what you're looking for. You might enjoy looking at duckdb for stuff like this. My policy when starting data engineering was to bung everything into pandas dataframes, and now my policy is to try to avoid them at all costs because they're slow and memory hungry!
bq load --autodetect --source_format=CSV mydataset.mytable ./myfile.csv
And snowflake uses INFER_SCHEMA I believe you can do this
select * from table( infer_schema( location=>'@stage/my file.csv', file_format=>'my_csv_format' ) );
Although tbh I'm not sure if that's what you're looking for. You might enjoy looking at duckdb for stuff like this. My policy when starting data engineering was to bung everything into pandas dataframes, and now my policy is to try to avoid them at all costs because they're slow and memory hungry!