I know I am getting down voted for this because people haven’t tried it. And let me differ, it has reasoning skills, it now gets beyond predicting the next word. And even reducing it to next word is some kind of primitive reasoning.
By experience, by telling the AI to not guess APIs and function names and instead provide it with a way of looking through docs, and inspecting the code and other tools to get it do some tests, the hallucinations disappear. I’ve been able to have better results with this setup.
This is very different than the “no mistakes” joke.
“it has reasoning skills” Nope. It has larger context windows and someone coded in the ability to reprompt itself for “thinking” steps that are literally just a new prompt with the same context that gets fed back in which merely increases the chances of it guessing the next output token correctly.
It still doesn’t “reason”. It still doesn’t know what the words mean. The modified algorithms are just attempting to generate the corrective prompts for you. If you’ve ever messed with them long enough, you’d understand that these, “no wait fix it” prompts have rapidly diminishing returns at the best of times. Their “thinking” is a bandaid, and a piss poor one at that.
I know I am getting down voted for this because people haven’t tried it.
People here have tried it, LLM use is basically enforced at a ton of companies and the tech industry crowd is a huge portion of the population here.
You’re likely being downvoted as you seem to have a fundamental misunderstanding of how LLMs function. LLMs don’t reason. LLMs don’t think. Telling an LLM to not guess might help ever so slightly, but LLMs can and do hallucate search results regularly.
It’s a mistake to trust that LLMs aren’t hallucinating just because you told the LLM to not guess.
I juste don’t want to talk about this any more becausefor me adding those instructions in AGENTS.MD and giving it the full API and language and platform docs dropped significantly the hallucinations. You just disregarding my experience and want me to believe in your assumptions.
It’s not an assumption. You can give an LLM all of the instructions in the world and it can still hallucinate. This is the fundamental flaw with LLMs, they’re always hallucinating. They just have guidelines which make it so they get things right sometimes. They are not to be trusted just because you tell it to search or use agents.md.
You still have this fundamental misunderstanding. I encourage you to actually look into how LLMs work. Do not use an LLM to do this research for you.
It doing sgupid stuff is another issue separate from hallucinations. Preventing LLM from doing dumb shit is more difficult, you need more guards and harnesses.
I don’t agree it’s a separate issue. Sure you can add in more guardrails, and spend more time making the best prompt. But no matter what you do, at some point it WILL do something you either didn’t ask for, or explicitly told it not to do.
I know I am getting down voted for this because people haven’t tried it. And let me differ, it has reasoning skills, it now gets beyond predicting the next word. And even reducing it to next word is some kind of primitive reasoning.
By experience, by telling the AI to not guess APIs and function names and instead provide it with a way of looking through docs, and inspecting the code and other tools to get it do some tests, the hallucinations disappear. I’ve been able to have better results with this setup.
This is very different than the “no mistakes” joke.
“it has reasoning skills” Nope. It has larger context windows and someone coded in the ability to reprompt itself for “thinking” steps that are literally just a new prompt with the same context that gets fed back in which merely increases the chances of it guessing the next output token correctly.
It still doesn’t “reason”. It still doesn’t know what the words mean. The modified algorithms are just attempting to generate the corrective prompts for you. If you’ve ever messed with them long enough, you’d understand that these, “no wait fix it” prompts have rapidly diminishing returns at the best of times. Their “thinking” is a bandaid, and a piss poor one at that.
People here have tried it, LLM use is basically enforced at a ton of companies and the tech industry crowd is a huge portion of the population here.
You’re likely being downvoted as you seem to have a fundamental misunderstanding of how LLMs function. LLMs don’t reason. LLMs don’t think. Telling an LLM to not guess might help ever so slightly, but LLMs can and do hallucate search results regularly.
It’s a mistake to trust that LLMs aren’t hallucinating just because you told the LLM to not guess.
I juste don’t want to talk about this any more becausefor me adding those instructions in AGENTS.MD and giving it the full API and language and platform docs dropped significantly the hallucinations. You just disregarding my experience and want me to believe in your assumptions.
It’s not an assumption. You can give an LLM all of the instructions in the world and it can still hallucinate. This is the fundamental flaw with LLMs, they’re always hallucinating. They just have guidelines which make it so they get things right sometimes. They are not to be trusted just because you tell it to search or use agents.md.
You still have this fundamental misunderstanding. I encourage you to actually look into how LLMs work. Do not use an LLM to do this research for you.
It helps, sure. But it still does stupid shit CONSTANTLY.
So do humans. Constantly.
It doing sgupid stuff is another issue separate from hallucinations. Preventing LLM from doing dumb shit is more difficult, you need more guards and harnesses.
I don’t agree it’s a separate issue. Sure you can add in more guardrails, and spend more time making the best prompt. But no matter what you do, at some point it WILL do something you either didn’t ask for, or explicitly told it not to do.
Agree, That is why I said 90% reduction of hallucinations.
How do you know it’s 90% reduction of hallucinations?