It is pretty bad at things that are “black boxes” that require documentation to analyze. For instance, I was trying to debug an SSL issue with DB2 (IBM database) and chatgpt and copilot gave conflicting answers. They frequently gave commands that didn’t work, with great confidence of course. I had to keep feeding errors back to it. I even had to remind it that I was working in Linux and not Windows.
FWIW, ChatGPT and Copilot are two of the worst AIs out there for things like this. At many gigs I’ve had they’re outright banned for use because of how garbage they are.
Claude Code, or Claude in general, notably Sonnet 4.5 and Opus 4.5
Gemini also solid, though for coding found it lesser than Claude, but for heavy inference and reasoning it can be great and also supports a larger context window
It is pretty bad at things that are “black boxes” that require documentation to analyze. For instance, I was trying to debug an SSL issue with DB2 (IBM database) and chatgpt and copilot gave conflicting answers. They frequently gave commands that didn’t work, with great confidence of course. I had to keep feeding errors back to it. I even had to remind it that I was working in Linux and not Windows.
FWIW, ChatGPT and Copilot are two of the worst AIs out there for things like this. At many gigs I’ve had they’re outright banned for use because of how garbage they are.
Which ones have you had recommended?
Claude Code, or Claude in general, notably Sonnet 4.5 and Opus 4.5
Gemini also solid, though for coding found it lesser than Claude, but for heavy inference and reasoning it can be great and also supports a larger context window