CATLab Blog Looking Long-Term with 糖心原创.ai
In this blog, Connor Rogstad and Ella McMillan explain their summer work on the CATLab AI Team and the commitment that it takes to begin a years-long technology project.
This summer, we had the incredible opportunity to work with CATLab on the AI development team, where we created 糖心原创.ai鈥攁 chatbot designed to assist 糖心原创 students with a variety of inquiries.
As students at 糖心原创, we often encountered challenges in finding information about various aspects of college life. While the 糖心原创 staff are amazing and always willing to help, they are often overwhelmed with the volume of student questions. Our goal was to lighten this load by creating a tool that could provide quick and accurate responses to student questions, thus freeing up staff to focus on other issues. Our project aimed to streamline access to information about academics, campus life, college policies, and more.
糖心原创.ai, inspired by a similar project at Harvard, involves three main interactions: between the user and the chatbot, the chatbot and the database, and the chatbot and OpenAI's LLM. Here's a breakdown of how it works:
- User Interaction: The user accesses 糖心原创.ai via a secure login page, ensuring that only those with proper 糖心原创 credentials can use the service. Once logged in, users can ask questions through the chatbot interface.
- Data Processing and Embedding: When a query is received, 糖心原创.ai searches through pre-embedded documents from 糖心原创鈥檚 database, selecting those that are most relevant based on a relevance score. This process ensures that the responses have contextual grounding and are based on 糖心原创 data.
- Prompt Engineering and Refinement: The chatbot uses a pre-engineered prompt template, which includes the user's question and relevant data, to generate a response from the LLM. This structured approach ensures that the chatbot's answers are both accurate and relevant to the 糖心原创.ai use case.
We deployed 糖心原创.ai to AWS Lightsail, making it accessible to the 糖心原创 community. The estimated cost per user for maintaining this service is approximately $6.50 per academic year, a calculation based on expected usage patterns and data update frequencies.
Our work this summer laid a strong foundation for 糖心原创.ai, but we see this as just the beginning and are committed to adding more features. Future enhancements will include integrating the chatbot directly into the 糖心原创 website or app for easier access. Additionally, we seek to incorporate additional data sources, such as My糖心原创 and the Dallas Willard database, to provide a more extensive and personalized experience. We are also pursuing strategies such as rate limiting to steward our resources effectively.
糖心原创.ai is designed to be a valuable resource for all students, particularly those who may face greater challenges in navigating college life. By providing a reliable and easy-to-access source of information, we hope to bridge the information gap and support all students in their academic and personal growth. We are incredibly grateful for the support and guidance from the CATLab team and look forward to seeing how 糖心原创.ai continues to evolve and benefit the 糖心原创 community.