cosmicbboy
Joined 8 years ago
Karma
3
Submissions
16
Member since
Jan 2
ML Engineer, Data Scientist.
View on Hacker NewsRecent submissions
Comment · 12 days ago
I created hlock https://docs.hlock.ai/ to exactly tackle some of these problems: it lets you port your harness configuration across the different harnesses (open source and proprietary)
Comment · 4 years ago
It's very early days for this project, so if you're interested in getting involved or learning more, you can go to the:
- Docs: https://unionml.readthedocs.io/en/latest/
- Repo: https://github.com/unionai-oss/unionml
- Slack: https://flyte-org.slack.com/archives/C03JL38L65V
- Product Hunt: https://www.producthunt.com/posts/unionml
Comment · 5 years ago
Hi all, author here! I just made one of the biggest releases for Pandera since the project's start.
Pandas is a dataframe validation tool, and so far pandera schemas could only validate pandas dataframes. That changes with v0.8.0, which adds support for dask, modin, and koalas dataframes. The future direction of this project is to also support xarray, pyarrow, and any other dataframe-like data structure that the pandera community wants to support.
This release also:
* makes pandera schemas a valid pydantic validator, so you can include them in your pydantic.BaseModel definitions * adds support for mypy static type-linting if you need that extra type safety
Repo: https://github.com/pandera-dev/pandera Release Notes Discussion: https://github.com/pandera-dev/pandera/discussions/678 Docs: https://pandera.readthedocs.io/en/stable/