Challenge
Our Japan-based client, a multi-national telecom company, wanted an AI tool that allows corporate employees to get accurate and adaptive insights in real-time. They envisioned it to be a quick, intuitive, and secure conversational platform where users can ask queries in their language, and the AI-powered tool will analyze the database consisting of shared libraries and company documents to provide appropriate answers.
The client specifically requested that their Gen AI tool should not require complex setup or training. They want to protect organizational knowledge while making it easily accessible to employees, all while maintaining privacy.
We were tasked with building an AI-powered solution for a telecom company to help its employees easily access organizational knowledge and gain valuable insights with confidence.
Key Challenges
The primary concerns for our development team while building an AI-powered conversational platform were:
- Creating a conversational AI interface that analyzes web sources, internal documents, and SharePoint libraries to provide accurate and context-based answers to employees.
- Offering employees a centralized platform to upload and manage diverse forms of content, including public URLs, Word documents, and PDFs.
- Using multiple AI models like DALL-E3 and GPT-4 to empower the platform to generate text and image-based answers required for both simple queries as well as complex analytical use cases.
- Designing a robust admin interface capable of handling predefined prompt templates, access control, model tokens, and user roles.
- Providing built-in libraries and guided assistants to help employees create effective AI prompts tailored to business functions in domains such as finance, HR, and legal.
- Delivering a secure architecture that prevents external data access and protects confidential information.
Expertise
-
Development Platform
.NET Core
-
Server
Linux (Azure)
-
Database
PostgreSQL
-
LLM Integrations
Chat-GPT-4o • Chat-GPT-4o mini • DALL-E3
-
Tools & Technology
Angular • .NET Core • Docker • Kubernetes • Microsoft Azure • Service Bus • Azure DevOps • Python • Flask
Solution
Leveraging our hard-earned expertise and experience, our team successfully transformed the client’s idea into reality. We delivered a Gen AI, an AI-powered platform with the following associated modules:
- Conversational FirstThis module allows users to upload and integrate diverse content types, such as company-managed information from SharePoint, public web data, images, and documents, into the platform for enhanced interactions. Featuring an interactive interface, the platform is powered by AI engines like DALL-E and ChatGPT-4 to generate precise answers.
- Prompt Wizard This feature streamlines the prompt creation process for employees by offering a wide range of templates, each tailored to specific business functions. It enables users to select or craft accurate prompts for the LLM.
- LLM General Knowledge Employees can use LLMs to gain general knowledge through task-specific questions or prompts. LLMs on this platform are powered by ChatGPT-4 and DALL-E to address a variety of queries submitted by employees.
- Custom Web Search Employees can request specific web data or components by pasting a relevant URL. This helps the LLM provide more accurate responses and information related to the submitted URL.
- Excel Agent This feature enables employees to upload an Excel file containing necessary information and inquire about any data or components within the file. The system generates accurate responses and provides information related to the uploaded Excel file.
- Multi-language Capabilities The platform supports multiple languages for front-end and template management, ensuring accessibility for employees across different regions.
- User Notifications This feature handles all alerts and notifications on the platform, keeping users informed about important tasks and updates.
- System Administration The platform includes a robust admin panel to manage templates, profiles, users, access, permissions, and Corporate SharePoint sites for indexing. Administrators can oversee all AI models on the platform, including their token usage. System administrators have the authority to monitor alerts and notifications and manage API consumers to ensure platform operations remain controlled, secure, and efficient
Result
TatvaSoft offered a Gen AI platform with features that helped the client achieve their business goals efficiently. It provided employees with an AI-based interactive online space to access both general and organizational information. This platform streamlines knowledge management and boosts productivity through task-specific prompts. More importantly, with conversational AI and multi-LLM support, employees can gain real-time insights, leading to informed decision-making and enhanced operational efficiency.