An Improved AI Researcher
Advanced Summarization, GPT-4o-mini
Here’s another code-level technical video where I expand on the Basic AI Researcher that was demonstrated in the last video.
The Researcher videos are designed to demonstrate generative AI techniques. Currently we are only doing summarization, but later the Research will use LLM calls to determine how to prepare for research, looking for things like relevant subtopics and date bracketed SERP searches.
The changes detailed in this video include:
- Gathering additional Google search results so there are enough to account for duplicates, PDFs, and pages that can’t be loaded.
- Using the new GPT-4o-mini model to summarize the individual web pages.
- Fulfillment of the research request is then based on those individual summaries.
- A logging class has been added that captures the prompt and response tokens for future cost analysis (another video).
