Is plugin choice becoming an LLM agent differentiator?

In the past few days, there’s been chatter about a perceived decline in the ChatGPT experience with GPT4, particularly when used with plugins. One theory is that these plugins might pollute the initial prompt, which is typically highly optimized, thus leading to subpar outcomes.

If this theory is accurate, we should be careful about the plugins we integrate with our AI agent. More connected plugins might lead to worse results. Different plugin combinations could yield varying results.

Future AI agents could be distinguished not just by their base model, prompts, and long-term memory but also by choice of connected plugins. Just like humans excel in different areas, we may end up with AI agents specialized for specific tasks.

This could be a significant differentiator in the AI agents market. In addition to seeing a few prominent vendors that sell general-purpose agents, we might see many smaller companies sell more specialized agents- back-end software engineer agents, product agents, marketing agents, etc.

What do you think? Let me know on Twitter.