Quiz
Week 2 Exercise - Head-to-Head: Evaluating AI Models
Objective:
Evaluate and compare the ChatGPT 4.0 and the Gemini model on the same task.
This exercise will help you understand the strengths and limitations of both models.
Steps:
- Step 1 – Test using ChatGPT 4.0 (Default Model):
- Access ChatGPT: Log into AICamp, ChatGPT 4.0 is available by default.
- Run a Prompt: Use any testing or work-related prompt.
- Record Results: Document the output, noting aspects like clarity, correctness, and any extra details provided.
- Step 2 – Load the Gemini Model:
- Add Gemini: Navigate to the model integration section on AICamp and add the Gemini (Google) model. (Remember, adding Gemini is free!). Here is the guide to generating a free Gemini API key: Get a Gemini API key | Google AI for Developers
- Verify Integration: Confirm that Gemini has been successfully loaded and is available on your dashboard.
- Add Gemini: Navigate to the model integration section on AICamp and add the Gemini (Google) model. (Remember, adding Gemini is free!). Here is the guide to generating a free Gemini API key: Get a Gemini API key | Google AI for Developers
- Step 3 – Test Gemini:
- Run the Same Prompt: Use the identical testing prompt you ran with ChatGPT on the Gemini model.
- Record Results: Again, document the output focusing on clarity, correctness, and any unique features or differences from ChatGPT.
- Step 4 – Compare and Analyze: Create a comparison summary that highlights:
- Response Quality: What are the differences in how each model responds?
- Accuracy: Evaluate which output better meets your requirements.
- Step 5 – Final Reflection: Summarize your key takeaways in the reply.
