wr
hn
Top
New
Best
Ask
Show
Jobs
Back
j
jmuncor
Joined 1 year ago
Karma
95
Submissions
39
Member since
Mar 24
View on Hacker News
Recent submissions
Comment · 3 months ago
Tokentap is a tool that helps you print the whole context window as you interact with an LLM (Claude, Codex, Gemini, etc). So that you can understand exactly what is going on 'under the hood' of your interaction.
Tokentap – Print what your LLM is thinking
g
github.com
2
jmuncor
3 months ago
1
comments
Comment · 8 months ago
This repo is a local database that stores your facts, memories and facts locally so that you centralize everything in your local system. Mumpu - Middleware for Universal Memory Persistence and Understanding
Local memory for any LLM agent
g
github.com
1
jmuncor
8 months ago
1
comments
Comment · 9 months ago
That was what I wanted to answer.. hehe What edge cases can you think of, and what polish do you think I can add?
Comment · 9 months ago
Sometimes simplicity is the best thing to have.
Comment · 9 months ago
Not only trust, but how you later optimize what is in the context to cater how you use llms... There is a whole world to be explored inside that context window.
Comment · 9 months ago
Thank you, what I was thinking was more along the lines of optimizing how you use your context window. So that the LLM can actually access what it needs to, like a incredibly powerful compact that runs in the background with your file system working as a long term memory... Still thinking how to make it work, so I am super open to ideas.
Comment · 9 months ago
I love this idea... Going to look into it, thank you!
Comment · 9 months ago
Yes, I think you can actually later store this in a database and start querying and optimizing what is happening there. Even you can start using these files or a destilation of these as long term memory.
Comment · 9 months ago
That is exactly the idea, later we can actually tap into the middle and optimize how the context is actually being used. Feels like the current anthropic tools like compact don't do a great job at it.
Comment · 9 months ago
You can always try right?
Comment · 9 months ago
Yes... Got it patched up and fixed some security issues it had. Let me know what you think of the new version.
Comment · 9 months ago
Ohh my, no offense taken... The next time I will be a lot more careful with the stuff that I put out there. Learning and getting the hang of it, would love if you either comment on the code or here any other things you think could be improved. I am in the process of getting better and appreciate all the blunt and transparent feedback. No one grows out of praise.
Comment · 9 months ago
I love the real feedback tbh, I am still learning, and want to learn as much as possible. Would love if you can review it and tell me bluntly either in the repo or here the things that should be improved. I would love to learn more from you and get better :D