We do exactly that at work - Liquibase with SQL for about 7 years now. It's wonderful and you don't have to learn anything on top of your SQL dialect. Also, it makes database-first a breeze since you can export your changes to SQL from any IDE these days and drop it right into a migration.
https://docs.liquibase.com/workflows/liquibase-community/mig...