LLama Archives - Gizmochina

Meta Unveils New Open-source Language Model, Llama 3.1 with an increased Context Length of 128K tokens

Anubhav — Tue, 23 Jul 2024 18:02:01 +0000

Meta unveiled its latest open-source language model, Llama 3.1, on July 23rd. This new iteration boasts several improvements, including enhanced inference capabilities, broader multilingual support, and a significant increase in context length to 128K tokens.

The new LLM is comparable to GPT-4, GPT-4o, and Claude 3.5 Sonnet

The star of the show is the flagship 405B parameter Llama 3.1-405B. This powerhouse model, according to Meta, rivals the performance of leading closed-source models in tasks like common-sense reasoning, guidance, mathematics, tool use, and multilingual translation. Meta compares its capabilities to GPT-4, GPT-4o, and Claude 3.5 Sonnet.

But the improvements extend beyond the top tier. The 8B and 70B parameter versions of Llama 3.1 are also said to be highly competitive with other open-source and closed-source models of similar sizes.

For those eager to experiment, Llama 3.1 is now downloadable from Meta’s official website and Hugging Face. Additionally, over 25 major partners including cloud giants like AWS, Azure, and Google Cloud, alongside hardware manufacturers like Nvidia and Dell, have been confirmed as ready to support the new model.

(Via)

The post Meta Unveils New Open-source Language Model, Llama 3.1 with an increased Context Length of 128K tokens appeared first on Gizmochina.

Meta rolls out its ChatGPT rival Llama 2 for Free

Sean — Thu, 20 Jul 2023 08:31:17 +0000

Meta has just announced its very own competitor to take on ChatGPT and Google Bard. But it is distinguishing its artificial intelligence based system by launching the Llama 2 for free.

Meta Llama 2 is open for personal and commercial use

Earlier this week, Mark Zuckerberg, CEO of Meta announced that Llama 2 was built in collaboration with Microsoft. It is the latest AI language model, which is open for research and commercial use for free. With its Llama 2 model, Meta will take on the various AI-based models being offered online and will also profit from generative AI tools (for images, texts, and more), similar to ChatGPT.

But to stand out from the crowd, Meta plans on being more accessible than some of its competitors. Llama 2 will be more transparent with the data and code it uses, which the company claims can help mitigate the bias that AI systems pick up. Zuckerberg stated that “Open source drives innovation because it enables many more developers to build with new technology. It also improves safety and security because when software is open, more people can scrutinize it to identify and fix potential issues. I believe it would unlock more progress if the ecosystem were more open, which is why we’re open sourcing Llama 2.”

Notably, the American tech giant is also collaborating with Qualcomm to bring on-device AI with Llama 2 models. LLaMA is also an acronym for Large Language Model Meta AI and people can download the new AI models directly or through a partnership.

RELATED:

(Via)

The post Meta rolls out its ChatGPT rival Llama 2 for Free appeared first on Gizmochina.

Qualcomm and Meta Collaborate to Bring On-Device AI with Llama 2 Models

Anubhav — Wed, 19 Jul 2023 02:24:09 +0000

The tech industry is no alien to Meta and Qualcomm. Both these massive tech organizations have a strong hold over different aspects of the industry. As per the latest reports, Qualcomm and Meta have joined forces to optimize the execution of Meta’s Llama 2 large language models directly on-device, eliminating the need for heavy reliance on cloud services. By running generative AI models like Llama 2 on smartphones, PCs, VR/AR headsets, and vehicles, developers can offer users more private, reliable, and personalized experiences while saving on cloud costs.

On-device AI can function seamlessly even in airplane mode

The partnership aims to make on-device Llama 2-based AI implementations available, empowering developers to create innovative AI applications. Customers, partners, and developers will be able to harness the power of these AI experiences to build intelligent virtual assistants, productivity tools, content creation platforms, and entertainment applications. One significant advantage of on-device AI is its capability to function in areas with no internet connectivity or even in airplane mode.

Durga Malladi, senior vice president, and general manager of technology, planning, and edge solutions businesses at Qualcomm Technologies, expressed support for Meta’s approach to open and responsible AI. Malladi emphasized the company’s commitment to driving innovation and facilitating AI development for developers of all sizes, envisioning generative AI to run seamlessly on both the cloud and edge devices such as smartphones, laptops, vehicles, and IoT devices.

The collaboration between Meta and Qualcomm Technologies builds upon their longstanding history of driving technology innovation to deliver premium device experiences. This partnership includes joint research and product engineering efforts aimed at supporting the Llama ecosystem. Qualcomm Technologies’ leadership in on-device AI uniquely positions it to support Llama, given its extensive presence at the edge, powering billions of smartphones, vehicles, XR headsets, glasses, PCs, and IoT devices with industry-leading AI hardware and software solutions.

Scheduled to be available from 2024 onwards, Qualcomm Technologies plans to offer Llama 2-based AI implementations on devices powered by Snapdragon. Developers can get started today by optimizing their applications for on-device AI using the Qualcomm® AI Stack, a dedicated set of tools enabling more efficient AI processing on Snapdragon. This breakthrough technology makes on-device AI possible even in small, thin, and light devices. The future of technology seems promising, and full of surprises. We are here for it all!

RELATED:

(Source)

The post Qualcomm and Meta Collaborate to Bring On-Device AI with Llama 2 Models appeared first on Gizmochina.

LLaMA, Meta’s New AI Language Model is Not Your Average ChatGPT

Anubhav — Sat, 25 Feb 2023 07:47:23 +0000

As of late, language models are the talk of the tech town. A plethora of models developed by major players like Microsoft, Google, and OpenAI are already present on the scene with their AI-powered models. As per latest news, Meta, Facebook’s parent company, has also been making significant strides in this field and is releasing a new AI language generator called LLaMA today.

Unlike other language models like Bing or ChatGPT, LLaMA is not like ChatGPT or Bing in the sense that the general public cannot interact with it through prompts and messages. Rather, it is more of a research tool that Meta is sharing so that users can readily and easily access this important and fast-changing field. By releasing LLaMA under a noncommercial license that is focused on research use cases, Meta is granting access to universities, NGOs, and industry labs to help experts address issues like bias and toxicity in AI language models.

CEO Mark Zuckerberg expressed Meta’s commitment to open research. He highlighted Meta’s committment to this open model of research, stating that the company will make their new model available to the AI research community. By releasing LLaMA, Meta hopes to foster collaboration among academic researchers, civil society, policymakers, and industry to develop clear guidelines around responsible AI and responsible large language models.

While Meta has previously released its own AI chatbots, like BlenderBot and Galactica, the reception has been mixed at best. With LLaMA, Meta is hoping for a better response. LLaMA is actually a quartet of different-sized models, with the numbers in their names referring to the billions of parameters in each model. The second-smallest model, LLaMA-13B, can even run on a single data center-grade Nvidia Tesla V100 GPU, making it accessible for smaller institutions wanting to run tests on these systems.

Meta’s release of LLaMA is notable because it demonstrates its dedication to AI research and the company’s willingness to share resources with the wider community. As the field of AI language models continues to evolve and grow, it is exciting to see what advancements and breakthroughs will emerge from the use of tools like LLaMA.

RELATED:

(Via)

The post LLaMA, Meta’s New AI Language Model is Not Your Average ChatGPT appeared first on Gizmochina.