Single prompt across all models to check basic functionality, response quality and speed. The first script to run in the whole repository.
cd phase-1-first-experiments python3 test1_basic_test.py
The script prints a banner before starting so you know what it is doing, then queries each model one at a time with a live "waitingβ¦" indicator. You will see output immediately as each model responds β you do not need to wait for all models to finish.
ollama serve is running in a separate terminalconfig.yaml β phase1.MODELS are pulled
(ollama pull <model>)test2_full_evaluations.py β then
test2_score_evaluations.py
[1/N] Querying <model> ... Sending prompt β waiting for response... followed by
the full response and time as soon as it arrives. No silent waiting.
A single joke prompt sent to all models. Goal: see if models respond at all, how fast they are, and whether responses differ in style.
| deepseek-r1:7b | mistral | llama3.1:8b | gemma2:9b | |
|---|---|---|---|---|
| Output | Certainly! Here's a short joke for you: Why don't scientists trust atoms? Because they make up everything! |
Of course! Here's one for you: Why don't scientists trust atoms? Because they make up everything! |
Here's one: What do you call a fake noodle? An impasta. Hope that made you smile! Do you want to hear another one? |
Why don't scientists trust atoms? Because they make up everything! π |
| Time | 54.13s | 11.63s | 19.39s | 20.49s |
| Note | Slowest β reasoning-focused model | Fastest response | Different joke β more creative | Added emoji for casual tone |
evaluation_results.json.evaluation_results.json exists, this script reads it and walks you through each response one by
one, asking you to rate it 1β5 on metrics like coherence, accuracy, and conciseness. No model is called β
you are the judge. Takes about 10β15 minutes of reading and typing. Your scores are saved to
scores.json.