Bugs in Gemini Enterprise that will break your custom agents

It's not all moonlight and roses in the battle for Enterprise AI

There is a lot of excitement about Gemini Enterprise, especially if you run in GCP circles. The pitch is simple: Build with Google’s Agent Development Kit (ADK), deploy to Agent Engine, and expose it via Gemini Enterprise. It sounds like the perfect pipeline. It is a great vision! But before we get too excited, and assume this is ready for complex production workflows, let’s look at what you might encounter when you publish that agent to Agent Space and add it to Gemini Enterprise.

I’ve been spending time in the trenches connecting these pieces, and I’ve hit some bugs that aren’t just minor annoyances—they are real roadblocks in certain circumstances.

It is important to note that none of these bugs are caused by ADK or Agent Engine. They all seem to be introduced by Gemini Enterprise and how it currently interacts with custom agents.

I have recorded a video in which I walk through some of the issues I have encountered so far:

• Sessions not working as expected: You’d expect a Session ID to persist throughout a chat so you can manage state or store files. In Gemini Enterprise against a custom agent? It resets on every single conversation turn.

• Issues rendering files to users: If your agent tries to render multiple unique PDFs to the user, Gemini Enterprise struggles. It ignores display names and, worse, if you try to preview different files, the UI frequently renders the exact same document for all of them. It’s a UI bug that makes document retrieval frustratingly unreliable.

• Not being able to access user uploaded files in their original format: This is the big one. When a user uploads a file (like a Word doc) to your agent, you probably want the raw binary to process yourself. Gemini Enterprise intercepts it, "helpfully" chunks it into text and images, and hands you the processed scraps.

The source code used in this video can be found at https://github.com/christo-olivier/gemini-enterprise-bugs