--- title: Don’t lose company data to ChatGPT | &‌amp description: In this blog article, you can learn all the steps of how to implement an innovative solution, your custom chatbot for Google Chat. image: https://miro.medium.com/v2/resize:fit:700/1*0AKHNL0I72kKaJPk3BvR3g.jpeg --- [Skip to content](https://insights.andamp.io/blog/dont-lose-company-data-to-chatgpt#main-content) [![andamp logo black (ampersand symbol)](https://insights.andamp.io/hubfs/logo_black.svg "andamp logo black (ampersand symbol)")](https://insights.andamp.io/?hsLang=en) - [About Us](https://insights.andamp.io/about-us) - [Career](https://insights.andamp.io/career) - [Code of Conduct](https://insights.andamp.io/code-of-conduct) - [Blog](https://insights.andamp.io/blog) # Don’t lose company data to ChatGPT [![](https://insights.andamp.io/hubfs/Linda%20Arab.jpg)](https://insights.andamp.io/blog/author/linda-arab) [Linda Arab](https://insights.andamp.io/blog/author/linda-arab) 15. Februar 2024 ![](https://miro.medium.com/v2/resize:fit:700/1*0AKHNL0I72kKaJPk3BvR3g.jpeg) Photo by [Growtika](https://unsplash.com/@growtika?utm_content=creditCopyText&utm_medium=referral&utm_source=unsplash) on [Unsplash](https://unsplash.com/photos/an-abstract-image-of-a-sphere-with-dots-and-lines-nGoCBxiaRO0?utm_content=creditCopyText&utm_medium=referral&utm_source=unsplash) **Work without ChatGPT?** It has simply become unthinkable. ChatGPT has long evolved into the superhero of productivity tools. Even right now, as I type, it helps me come up with cooler phrases. To your luck! Yet, the data dilemma lurks. It is no secret that ChatGPT stores each and every prompt sent to it. Yes, even the most embarrassing ones… Some companies play it cool, letting employees ChatGPT away with rules like »anonimize the input« or »exclude sensitive data«. Others drop the banhammer entirely. **We, at **[**&**](http://andamp.io/)**, do things differently.** No bans, no restrictions. Just our very own chatbot, ampGPT, integrated into our company’s Google Chat and powered by Azure OpenAI Service. This way, we can interact with our own instance of OpenAI’s ChatGPT model, while ensuring the team enjoys a seamless, carefree, and, above all, private experience. Curious about how we did it? # Architecture ![](https://miro.medium.com/v2/resize:fit:700/1*_V8-pc57Zb4ilZA03rGPzA.jpeg) Architecture In an initial step, we planned out the architecture. Our focus was clear: Select technologies which play well with both Google Chat and Azure OpenAI Service. During our research, we discovered numerous options to develop for Google Chat. Some of them hosted by Google itself such as App Scripts, AppSheet, Cloud Functions, and Cloud Pub/Sub. Some of them hosted by us such as a web hook or a web service. Ultimately, we landed on the web service because the Google-hosted options were too restrictive and a web hook would not have allowed for user interaction. We also took into consideration existing libraries. On the one hand, the [Google API Client Libraries](https://developers.google.com/api-client-library). They help develop for Google Chat and are available for Dart, Go, Java, JavaScript, Node.js, Objective-C, PHP, Python, Ruby, and .NET. On the other hand, the [Azure OpenAI Client Libraries](https://learn.microsoft.com/en-us/azure/ai-services/openai/supported-languages). They facilitate communication with OpenAI models from Azure OpenAi Service and are available for C#, Go, Java, JavaScript, and Python. Eventually, we decided to build ampGPT as a web service using Spring Boot as our framework, Java as our language, and the above mentioned libraries as our helpers. # Terminology Before we delve into the details, let’s clarify some Google terms. First up is »Google Workspace«, formerly known as »GS Suite«. It is a collection of cloud-based business solutions including Google Chat, Google Drive, Google Calendar, etc. Collectively, we refer to them as »Google Workspace apps«. As developers, we can build extensions for Google Workspace apps, including Google Chat. That’s what ampGPT is. A noteworthy detail is that Google calls extensions of Google Chat »Google Chat apps«, but refers to extensions of other Google Workspace apps as »Google Workspace add-ons«. You may also come across the term »Google Chat bot« or just »bot« as a synonym for Google Chat app. Google Workspace add-ons can be downloaded from the Google Workspace Marketplace. Google Chat apps can be, additionally, installed from inside Google Chat. Last but not least, the predecessor of Google Chat was called »Google Hangouts«. So you may still find traces of it. For example, as comments inside libraries or as code in outdated tutorials. # Communication with Google Chat ![](https://miro.medium.com/v2/resize:fit:700/1*Uq4GZDlMWM1ftEHgnwipbQ.jpeg) Communication with Google Chat At this point, we have a clear idea of what we are building (a web service), what to call it (a Google Chat app), and which framework, language, and libraries to use (Spring Boot, Java, Google Chat API Client Library for Java, Azure OpenAI Client Library for Java). However, we still need to code everything. Google Chat apps, implemented as web services, have one thing in common. They expose a singular HTTP endpoint. This endpoint will receive POST requests when users interact with our Google Chat app. Each POST request contains an [Event](https://developers.google.com/chat/api/reference/rest/v1/Event) object as its request body. Depending on the occasion, this event can have one of three types. Namely, ADDED\_TO\_SPACE, MESSAGE, or REMOVED\_FROM\_SPACE. To respond, our endpoint simply sends back a [Message](https://developers.google.com/chat/api/reference/rest/v1/spaces.messages) object. Our response will then be displayed in the corresponding conversation inside Google Chat. We do not have to handle this ourselves. There is just one exception. When replying to REMOVED\_FROM\_SPACE events, our response is simply ignored. However, by then, the user has already left the space, anyways. There is just one last thing to remember: Google Chat only gives us 30 seconds to respond. Otherwise, a timeout will occur and a disappointed user will be greeted with the error message »\[app name\] not responding« inside Google Chat. See a sample endpoint below. The Google API Client Library for Java provides us with the Message object.   Sample endpoint # Communication with Azure OpenAI Service ![](https://miro.medium.com/v2/resize:fit:700/1*3Ddf3TGz7evtOV0rp0ewiA.jpeg) Communication with Azure OpenAI As of now, our responses are as boring as »Event type was ADDED\_TO\_SPACE«. We want more. We want our responses to be generated by our own instance of OpenAI’s ChatGPT model. Azure offers us REST API access to GPT-3.5 and GPT-4. We simply need an Azure Subscription with access to Azure OpenAI. Deploying our own instance of the ChatGPT model is as easy as filling in fields and clicking on buttons. Here is a [guide](https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/create-resource?pivots=web-portal) by Azure! As mentioned above, the Azure OpenAI Client Library for Java is worth looking at. It helps us connect our Spring Boot app with Azure OpenAI Service. Personally, we wrote a service, *OpenAiClient*, which uses this library to communicate with our OpenAI model.   Sample client for Azure OpenAI Service Now, we only need to make a few changes to make our responses sound much smarter…   Smarter sample endpoint # Connecting everything Our code is complete! There are only two more things left to do: (1) Deploy our Spring Boot app. (2) Create a Google Cloud project. For deployment, we used Azure’s Web App Service. The Google Cloud project is our link to Google Chat. It is what transforms our Spring Boot app into a Google Chat app. Inside the configurations, we simply need to enable the Google Chat API. Inside the Google Chat API configurations, we can then paste the address to our endpoint. Here is a [guide](https://developers.google.com/chat/api/guides/message-formats#receive) by Google. And with that, we officially created a Google Chat app! During development, you can configure a maximum of five test users. You will find the option in the configurations for the Google Chat API. The selected few will now find our Google Chat app among the others inside Google Workspace Marketplace or Google Chat. They can use it right away! If you want to publish, you need to enable the Google Marketplace API. In the Google Marketplace API configurations, you can then determine a scope of access fitting to your purpose. Personally, we restricted access to our Google Workspace organisation. # Considerations When moving forward, there are some aspects you might want to consider: - **Authentication + Authorisation:** To make your Google Chat app secure, you need to secure both incoming and outgoing requests. - **Timeout Issue:** In theory, your HTTP endpoint needs to respond within 30 seconds. However, it may take the OpenAI model longer to generate a response. This issue can be solved by using the Google Chat API to send your responses as separate POST requests. Google calls this »asynchronous communication«. - **Attachment Handling:** In Google Chat, users can attach files to messages. These can be downloaded using one of the Google APIs. If you want to take it further, you can forward these to your OpenAI model. That’s what ampGPT does, too. - **Context:** The OpenAI model itself does not remember previous requests. If you want to give it a memory, you need to include the Google Chat history in your requests. # Further Readings - [Choose an architecture](https://developers.google.com/chat/concepts/structure) - [Authenticate Incoming Requests](https://developers.google.com/chat/api/guides/message-formats#verify-app) - [Publish Google Chat Apps](https://developers.google.com/chat/how-tos/apps-publish#configure-publish) - [Java Code Sample: Basic App](https://github.com/googleworkspace/google-chat-samples/blob/main/java/basic-app/src/main/java/com/google/chat/app/basic/App.java) - [Java Code Sample: Asynchronous Communication](https://github.com/googleworkspace/google-chat-samples/blob/main/java/basic-async-app/src/main/java/com/google/chat/app/basic/async/App.java) - [Other, Official Code Samples](https://developers.google.com/chat/samples) # It’s time to build! We, at [&](http://andamp.io/), are building various applications — from chatbots to enterprise cloud applications. If you want to work with us or have any questions about how we built ampGPT in more detail, [get in touch](mailto:linda.arab@andamp.io)! [ChatGPT](https://insights.andamp.io/blog/tag/chatgpt) [Chatbot Design](https://insights.andamp.io/blog/tag/chatbot-design) [Google Chat](https://insights.andamp.io/blog/tag/google-chat) [Chatbot Development](https://insights.andamp.io/blog/tag/chatbot-development) [Chatbots](https://insights.andamp.io/blog/tag/chatbots) ## Read On [![Concurrent Programming](https://miro.medium.com/v2/resize:fit:700/0*cyscSjaqyeZ6eRBl)](https://insights.andamp.io/blog/concurrent-programming-a-taxonomy?hsLang=en) ### [Concurrent Programming: A Taxonomy](https://insights.andamp.io/blog/concurrent-programming-a-taxonomy?hsLang=en) If you're unsure about how to model your concurrent program, this blogpost will help you explore your options. [![Vue.js and React logo](https://miro.medium.com/v2/resize:fit:700/1*R64hTtNXtNlx4KKsuT2CLA.png)](https://insights.andamp.io/blog/vue.js-for-react-devs-who-wins-the-burger-building-contest?hsLang=en) ### [Vue.js for React devs: Who Wins the Burger Building Contest?](https://insights.andamp.io/blog/vue.js-for-react-devs-who-wins-the-burger-building-contest?hsLang=en) What are the key similarities and differences between React and Vue.js from the perspective of a React developer? [![Google Cloud Function Admin SDK Integration](https://miro.medium.com/v2/resize:fit:700/0*cOLOqk1DFAnUWwvg)](https://insights.andamp.io/blog/google-cloud-function-admin-sdk-integration?hsLang=en) ### [Google Cloud Function Admin SDK Integration](https://insights.andamp.io/blog/google-cloud-function-admin-sdk-integration?hsLang=en) In this blog post, the author presents a new guide on integrating the Google Admin SDK in Google Cloud Functions. If you're building enterprise software on Google Cloud and need to manage Google Workspace resources, it's a valuable read. [![logo_white](https://27222727.fs1.hubspotusercontent-eu1.net/hubfs/27222727/logo_white.svg "logo_white")](http:/?hsLang=en) [Follow &andamp on LinkedIn](https://www.linkedin.com/company/andamp/) [Follow &andamp on Instagram](https://www.instagram.com/_andamp_) ## Our Services - [Team as a Service](https://insights.andamp.io/team-as-a-service/) ## Sitemap - [Blog](https://insights.andamp.io/blog) - [Career](https://insights.andamp.io/career) - [About Us](https://insights.andamp.io/about-us) - [Code of Conduct](https://insights.andamp.io/code-of-conduct) - [Our Diversity Journey](https://andamp.io/diversity-journey) ## Our Mission We offer a risk-free way to optimize customer experience and realise your business' potential through MVPs ## Case Studies - [Notarity](https://insights.andamp.io/case-studies/notarity/) ## Location andamp GmbH Währinger Straße 48/2. Hof 1090 Vienna, Austria ## Contact Us [hello@andamp.io](mailto:hello@andamp.io) We would love to hear about your ideas! ### Let's build your project! This site is protected by reCAPTCHA and the Google [Privacy Policy](https://policies.google.com/privacy) and [Terms of Service](https://policies.google.com/terms) apply. ® 2025 andamp GmbH [Legal Notice](https://insights.andamp.io/legal-notice/?hsLang=en) [Privacy Policy](https://insights.andamp.io/privacy-policy/?hsLang=en) ```json { "@context" : "https://schema.org", "@type" : "BlogPosting", "author" : { "@type" : "Person", "name" : "Linda Arab", "url" : "https://insights.andamp.io/blog/author/linda-arab" }, "dateModified" : "2024-02-15T10:48:01.233Z", "datePublished" : "2024-02-15T10:48:01.000Z", "headline" : "Don’t lose company data to ChatGPT", "image" : [ "https://miro.medium.com/v2/resize:fit:700/1*0AKHNL0I72kKaJPk3BvR3g.jpeg" ], "mainEntityOfPage" : { "@id" : "https://insights.andamp.io/blog/dont-lose-company-data-to-chatgpt", "@type" : "WebPage" }, "publisher" : { "@type" : "Organization", "logo" : { "@type" : "ImageObject", "url" : "https://insights.andamp.io/hubfs/andamp%20Full%20Logo%20Blue%20Light.svg" }, "name" : "andamp GmbH" } } ```