matroid

I guess it would be a good experiment these days, to see how Nano Banana or OpenAI's latest image to image models will be at transferring lighting while preserving the original style domain, like you suggest.

Thanks for the thoughts :)

That's a good question!

We made the training data for this using a physically based renderer (i.e, Cycles in Blender).

For non-photorealistic art, there are way too many ways in which artists communicate lighting (even in sketch, which is different from pixel-art / video game, there are at least a couple of ways (a) solid shading (b) hatching).

I'm not sure how to extend our methodology (synthetic data in 3D modeling software + train model) to these settings.

Ooh, I didn't know about Myst-style games. I'll definitely check them out!

Hello, I have this project where you can move lights in 3D inside a photograph.

This is the project page and has some cool demos (atleast I think!). Do check them out and let me know what you all think!

Thanks. I'll link it in the first line in the README. I think the interlocking-free part can pack cups like you suggest. They propose a flood fill algorithm which computes all the reachable places for the voxelized shape. It doesn't put assumptions on convexity. I think it would be a great example to try it out on though.

A while back, I implemented a paper that had showed up on HN for a course project (Dense, Interlocking-Free and Scalable Spectral Packing of Generic 3D Objects).

Over the holidays, I cleaned up the implementation (with the help of Claude Code, although this is not an advertisement for it) and released it on GitHub.

If anyone needs fast 3D packing in python, do give this a shot. Hopefully I have attributed all the code/ideas I have used from elsewhere properly (if not, please feel free to let me know).

Hey everyone, I wanted to share my friend's work on Single Portrait Photograph to 3D Head Model. He has a Huggingface demo that you can play with!

Thanks Zie for the message. I'm sorry to hear about your "interpreter" encounter :(

I do think these problems are much, much worse for ISL as you rightly noted.

I think I should have been careful when I said "solve" in my post. But that really came from a place of optimism/excitement.

Also, in India, many hearing-impaired people know only ISL.

That is correct. We want to translate between English and ISL. English, because it is by and large the language of the Web and I think we should try to connect ISL to it rather than Indian Languages.

From my understanding, they are quite dissimilar. A person who knows ISL will not understand ASL, for example.

Thanks for the feedback. You raise great points and this was the reason why we wrote this post, so that we can hear from people where the actual problem lies.

On a related note, this sort of explains why our model is struggling to fit on 500 hours of our current dataset (even on the training set). Even so, the current state of automatic translation for Indian Sign Language is that, in-the-wild, even individual words cannot be detected very well. We hope that what we are building might at least improve the state-of-the-art there.

> It's more of a bad and broken transliteration that if you struggle to think about you can parse out and understand.

Can you elaborate a bit more on this. Do you think if we make a system for bad/broken transliteration and funnel it through ChatGPT, it might give meaningful results? That is ChatGPT might be able to correct for errors as it is a strong language model.