florianleibert

Joined 15 years ago

Karma

318

Submissions

105

Member since

Apr 11

View on Hacker News

Recent submissions

Comment · 6 months ago

hi! open sourced a serving config for Kimi K2.6 from 90 tok/s 508 tok/s on 8xMI300X. Same weights / 0 quality loss.

Scaling is linear @15.8 tok/s per slot latency is constant. REpo has command launcher, Dockerfile, benchmark tool. Known limitations: BF16 KV only (FP8 crashes due to an AITER 384-expert constraint)

5.6x throughput on Kimi K2.6 by speculating less huggingface.co

11 florianleibert 6 months ago 2 comments

Nvidia's moat is not what it used to be

6 florianleibert 6 months ago 11 comments

Comment · 2 years ago

This is pretty cool.

First Interaction with Kubernetes on DC/OS mesosphere.com

1 florianleibert 8 years ago 0 comments

3 Definitions of Cloud and Why They Matter thenewstack.io

5 florianleibert 8 years ago 0 comments

Uber Drives Distributed Deep Learning Forward mesosphere.com

1 florianleibert 9 years ago 0 comments

Training Your Custom Model with the DC/OS TensorFlow Package mesosphere.com

1 florianleibert 9 years ago 0 comments

Distributed TensorFlow on Any Infrastructure with Mesosphere DC/OS mesosphere.com

2 florianleibert 9 years ago 0 comments

Mesosphere DC/OS Brings Large-Scale Real-Time Processing to Geospatial Data thenewstack.io

3 florianleibert 9 years ago 0 comments

Distributed TensorFlow on Any Infrastructure with Mesosphere DC/OS mesosphere.com

8 florianleibert 9 years ago 1 comments

Challenges in Cycle Counting mesosphere.com

1 florianleibert 9 years ago 0 comments

Containers and Distributed Systems: Where They Came from and Where They’re Going mesosphere.com

288 florianleibert 9 years ago 41 comments

Comment · 9 years ago

There is also a tutorial on the Spinnaker website. https://www.spinnaker.io/guides/tutorials/codelabs/dcos-sour...

Continuous Delivery for DC/OS with Spinnaker engineering.cerner.com

68 florianleibert 9 years ago 4 comments