theo31

I use it and I love checking it in the morning to see what my team is up to, I don’t have to ping people and break their flow.

It helps us figure out what got done and where we are in our roadmap

Those frameworks are installed by default in our custom environment. There is no additional setup/configuration required from you.

At the moment, no, only the random hash gives some kind of security by obfuscation. More advanced security controls are coming soon.

We don't use TensorRT at the moment, but it is something that we are exploring.

Oh that's very interesting, how ready for production is it? It only works for TF right?

> If you need a few dozen inferences per second per server, this is the cheapest way. And you're not depending on a proprietary solution whose parent company could go out of business in a year.

Definitely the cheapest way.

We've been in business for more than a year already actually :)

Yes! A more in-depth blog post is coming soon. We do host the hardware ourselves, for complete control over the GPUs. We found a great infrastructure provider that is also experiencing shortages.

The response time guaranteed is for a reasonably sized model. Bigger models (> 700 MB) will take a bit longer.

The model size is the zipped size of your model that is uploaded to Inferrd (either through the SDK or the website).

I'll fix the full screen problem right away, thank you for reporting.

We only have servers in the United States at the moment but are looking to have servers all around NA and EU very soon.