Ai News
4 Minutes of reading

Meta execs obsessed over beating OpenAI’s GPT-4 internally 🤖

Executives and researchers leading Meta’s AI efforts focused intensely on surpassing OpenAI’s GPT-4 model while developing Llama 3, according to internal messages revealed during a court case on AI copyright issues, Kadrey v. Meta.
Written by
Bullwaves
Published on
January 16, 2025

“Honestly… Our goal needs to be GPT-4,” said Meta’s VP of Generative AI, Ahmad Al-Dahle, in an October 2023 message to researcher Hugo Touvron. “We have 64k GPUs coming! We need to learn how to build frontier and win this race.”

While Meta publicly releases open AI models, internal discussions show their leadership was more focused on outpacing competitors like OpenAI and Anthropic, which do not release model weights but gate access via APIs. Models like Anthropic’s Claude and OpenAI’s GPT-4 were seen as the standard to surpass.

The French AI startup Mistral, considered a major open competitor, was also mentioned but with a dismissive tone. “Mistral is peanuts for us,” Al-Dahle remarked in one exchange. “We should be able to do better,” he added.

The intense competition within the tech industry to lead in advanced AI is evident in the messages. Meta’s AI leaders were described as “very aggressive” in acquiring data to train Llama, with one executive admitting, “Llama 3 is literally all I care about.” However, prosecutors allege that shortcuts were occasionally taken, including the use of copyrighted materials for training.

In one exchange, Touvron acknowledged the need for better datasets for Llama 3 and discussed leveraging the LibGen dataset, which includes copyrighted materials. “Do we have the right datasets in there?” Al-Dahle asked. “Is there anything you wanted to use but couldn’t for some stupid reason?”

Meta CEO Mark Zuckerberg previously emphasized closing the gap between Llama models and proprietary models from competitors like OpenAI and Google. In a July 2024 letter, he claimed, “This year, Llama 3 is competitive with the most advanced models and leading in some areas. Starting next year, we expect future Llama models to become the most advanced in the industry.”

When Llama 3 was released in April 2024, it proved competitive with top proprietary models and outperformed other open options, including those from Mistral. However, lawsuits questioning the legality of the training data used continue to pose challenges for Meta.

Powered by Markelitics.com

Navigate the trading markets
Start Trading now with Bullwaves
Start Now
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

Start your trading journey today


Discover a world of opportunities.

Bullwaves is a brand name and a trading name with multiple entities and authorised in various jurisdictions, such as Equitex Capital Limited (Registration No. 8434948-1), a company authorized and regulated by the Financial Services Authority (the "FSA", licence no. SD185) and Moonance LLC, a company regulated by MISA in Comoros Island.

Bullwaves.global website is owned by Moonance LLC, a company incorporated in St. Vincent & the Grenadines with registration no. 2141 LLC 2022 And registered address at First Floor, First St Vincent Bank Ltd Building, James Street, Kingstown, St. Vincent and the Grenadines.

Moonance LLC is authorized and regulated by MISA with License Number T2022122

ETX Services Limited, with company registration number HE455407, a company registered in Cyprus with a registered address at Archiepiskopou Makariou III 160, 3026 Limassol, acts to facilitate payments and provide supporting services to Moonance LLC.

Risk Disclaimer:

Over-the-counter derivatives are complex instruments and come with a high risk of losing your initial capital rapidly due to leverage. You should consider whether you understand how over-the-counter derivatives work and whether you can afford to take the high level of risk to your capital. Investing in over-the-counter derivatives carries significant risks and is not suitable for all investors.

When acquiring our derivative products you have no entitlement, right or obligation to the underlying financial asset. Moonance LLC is not a financial advisor and all services are provided on an execution only basis. Information is of a general nature only and does not consider your financial objectives, needs or personal circumstances. Important legal documents in relation to our products and services are available on our website. You should read and understand these documents before applying for any Bullwaves products or services and obtain independent professional advice as necessary.

Regional Restrictions:

The information or services described on this website is not directed at or offered to residents of North Korea, United States, Afghanistan, Belarus, Central African Republic, China, Cuba, Libya, Nicaragua, Palestinian Authority/Gaza/West Bank, Venezuela and to jurisdictions on the FATF and EU/UN sanctions lists or any other person in any jurisdiction where such distribution or use would be contrary to local laws or regulations. For more information please contact our support. Clients who onboarded via www.bullwaves.com can contact our support team at support@bullwaves.com.For complaints please email us at compliance@bullwaves.com