I’m Maor Cohen, a software engineer and manager based in Tel Aviv. This is my personal blog where I talk about software, product and management.
Check out my latest post:
What I learned trying to build an AI coding assistant
I tried building an LLM coding assistant using GPT4. This is what I learned about the current limits of this tech. The main challenge is handling projects that exceed the LLM’s context size, a problem familiar to other LLM applications like document Q&A. This is especially challenging when each query needs to use the most recent data, and the data is updated frequently. Fine-tuning the model for every request isn’t feasible, so an alternative data access solution is required....