Atlas AI – agent building and chatbot notes

The Good

• Able to switch between list and tile view as well as Search.
• Having a Description is helpful.
• Nice that there are sample questions.
• Loading feedback.
• Ability to stop generation.
• Legal disclaimer near prompt area.
• Nice that it shows reasoning steps.
• Like the suggestions with Show More
• Bot background color is fine.
• Reasonable area to write a prompt.
• Great to be able to view the details using the info icon of what each agent is good at before switching to it.

Could be improved

Priority 1

• Starting a new chat is “risky” because there is no history, copy or chat download/export functionality. Part of the point is to aggregate information for analysis later, sharing or collaboration
• Chat history/multiple threads
• Need a way to set expectations up front so that when a new chat is started, we can orient users as to what can and cannot be done. Description helps but gets cut off.
• Sample questions as defaults are not injected but auto triggered. This can be an issue since the prompt is most likely not exactly what they want.
• Need some sort of prompt library so that users will be presented with prompts that have been vetted, and we are sure will produce relevant answers and get them quickly started. So not just examples but starter prompts.
• When it suggests follow ups, it would be great if these may be clicked and injected into the prompt area (but not auto submitted).

Priority 2

• I would expect the naming for Atlas Agents to be in Industrial Tools and Agent Library to be in the Atlas AI.
• Ability to choose to share threads
• Edit icon should maybe use a plus. I know Copilot uses that but it’s still odd.
• Not sure what to do about location action and listing. What does this mean or how does it affect bot?
• Needs link to terms or docs.
• No file attachment. Users will probably want need this to override on a case by case basis.
• Publish / Unpublish flow is a bit awkward when prompt engineering between multiple people.
• Prompt area should be fixed to a certain height (perhaps one half the viewport) and scroll or be resizable.
• The use of a full takeover modal with a close button is odd when starting a chat.
• Switching to a new chat when moving between agents without a chat history is somewhat dangerous since users will lose all their work.
• It’s good that we can switch between agents while in a thread. However, I would expect that when I am in the agent library, clicking on another agent starts a new thread with that agent. Returning to the original agent would show my previous conversation with the agent.
• Cannot generate tables easily. Although I did manage to do so one time.
• I easily miss My Agents and Published tab. This causes a starter problem.
• Would like to add multiple tools at a time and not need to add them one by one.

Possible bugs

• Seemed to lose past chats bubbles after a certain amount of conversation. Reloading shows them. Need to verify.
• Ran into an issue when switching between an agent within a thread created a new chat.