lonestar-lemmy
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
noneabove1182@sh.itjust.worksM to LocalLLaMA@sh.itjust.worksEnglish ·
edit-2
1 year ago

Orca 2: Teaching Small Language Models How to Reason

www.microsoft.com

external-link
message-square
5
link
fedilink
2
external-link

Orca 2: Teaching Small Language Models How to Reason

www.microsoft.com

noneabove1182@sh.itjust.worksM to LocalLLaMA@sh.itjust.worksEnglish ·
edit-2
1 year ago
message-square
5
link
fedilink
At Microsoft, we’re expanding AI capabilities by training small language models to achieve the kind of enhanced reasoning and comprehension typically found only in much larger models.

Orca 2 released by Microsoft!

Full weights here:

https://huggingface.co/microsoft/Orca-2-7b

https://huggingface.co/microsoft/Orca-2-13b

My own exllamav2 quants here:

https://huggingface.co/bartowski/Orca-2-7b-exl2

https://huggingface.co/bartowski/Orca-2-13b-exl2

GGUF from TheBloke (links to GPTQ/AWQ inside it):

https://huggingface.co/TheBloke/Orca-2-7B-GGUF

https://huggingface.co/TheBloke/Orca-2-13B-GGUF

alert-triangle
You must log in or register to comment.
  • Hanabie@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 year ago

    What’s the context window size?

    • noneabove1182@sh.itjust.worksOPM
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      according to the config it looks like it’s only 4096, and they specify in the arxiv that they kept the training data under that value so it must be 4096… i’m sure people will expand it soon like they have with others

      • Hanabie@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 year ago

        I’ll wait a little then I guess. I need 16k for what I’m doing. Thanks for the heads up 🙂

        • noneabove1182@sh.itjust.worksOPM
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          Btw there’s a 16k tune available now:

          https://huggingface.co/bartowski/Orca-2-13B-16k-exl2

          • Hanabie@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 year ago

            Nice, will give it a try. Thank you 😊

LocalLLaMA@sh.itjust.works

localllama@sh.itjust.works

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !localllama@sh.itjust.works

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 4 users / day
  • 89 users / week
  • 498 users / month
  • 1.03K users / 6 months
  • 1 local subscriber
  • 2.96K subscribers
  • 255 Posts
  • 1.2K Comments
  • Modlog
  • mods:
  • SkySyrup@sh.itjust.works
  • pax@sh.itjust.works
  • noneabove1182@sh.itjust.works
  • SmokeyDope@lemmy.world
  • MonsterBug@sh.itjust.works
  • BE: 0.19.11
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org