• 5 Posts
  • 6 Comments
Joined 7 years ago
cake
Cake day: January 21st, 2020

help-circle








  • for one test, i felt a bit disappointed on this prompt: answer(sample):

    Most software engineering tasks involve much more than just relational data or logical inference. Here’s what Prolog struggles with:
                                                                   #### 1. **Data Complexity & Type System**
    - Real-world data includes strings, numbers, dates, JSON, XML, images, audio, etc.
    

    in comparison… every 2B-4B distill model, immediately launched into deeper explorations and answers.

    my evaluation:

    • deceptively good. the answer isnt flashy but actually a decent summary with many subtle,but important, points.
    • prompting matters.
    • smaller models are on par for simple prompts like this. but performance and speed is fantastic. so there is no not much cost difference.