With a license that authorizes commercial use! BUT ….
Its better than falcon 7b on most benchmarks, and its 2x better than falcon on QuAC (Question Answering in Context), and MMLU (Massive Multitask Language Understanding). Way to go Yann LeCun, can’t wait to instruct fine tune this with QLORA. But there is a lot of concerns about the licenses, is it really open for commercial use?
So I analyzed Llama 2’s Community License Agreement, and here are the results:
Fine tuning:
The Llama 2 Community License Agreement does not explicitly mention fine-tuning. Fine-tuning is a common practice in the field of natural language processing (NLP) where a pre-trained language model, like Llama 2, is further trained on a specific dataset or task to make it more specialized and accurate for that particular use case.
Since the agreement grants a license to use, reproduce, distribute, and create derivative works of the Llama Materials, it is reasonable to assume that fine-tuning is allowed as long as it falls within the scope of the granted license. In other words, if you fine-tune Llama 2 and create a derivative model for a specific task or dataset, you can use and distribute that fine-tuned model under the terms of the Llama 2 Community License Agreement.
Attribution Notice:
When distributing the Llama Materials or derivative works, you must include an attribution notice stating that Llama 2 is licensed under the LLAMA 2 Community License by Meta Platforms, Inc.
Example: Company G uses Llama 2 to develop an AI-powered chat application. When releasing the application, they include the required attribution notice within the application’s documentation.
Ownership of Derivative Works
If you create derivative works and modifications of the Llama Materials, you will be the owner of those works.
Example: Individual F develops a new AI algorithm using Llama 2 as a foundation and can claim ownership of their new algorithm.
License to Use and Modify
The Agreement grants you a non-exclusive, worldwide, non-transferable, and royalty-free limited license to use, reproduce, distribute, copy, create derivative works of, and modify the Llama Materials.
Example: Company E can create an AI-powered language translation service using Llama 2 and offer it to their customers.
Compliance with Laws and Regulations
Your use of Llama Materials must adhere to all applicable laws and regulations, including trade compliance laws and regulations.
Example: Company D, based in the United States, must ensure that their use of Llama 2 complies with export control laws and regulations when providing their AI services to clients in other countries.
Prohibited Improving Other Models
You are not allowed to use the Llama Materials or any results obtained from them to improve any other large language model that is not Llama 2 or its derivatives.
Example: Company C cannot use the knowledge gained from Llama 2 to enhance the capabilities of their own proprietary language model or any other language model they use in their products.
Monthly Active Users Limit:
If your product or service, along with its affiliates, reaches over 700 million monthly active users, you must request a separate license from Meta, and until you receive such license, you cannot exercise the rights granted under the Agreement.
Example: Social media platform X uses Llama 2 for their AI-powered content moderation system. Once the number of their monthly active users crosses 700 million, they must seek a separate license from Meta to continue using Llama 2 in their system. This one I find less of a restriction for startup companies and most medium size use cases.
Redistribution to Third Parties:
If you distribute or make the Llama Materials or any derivative works thereof available to a third party, you must provide a copy of the License Agreement to them. This means you cannot simply give the Llama Materials to others without informing them of the terms and conditions.
Example: Company A creates an AI-powered chatbot using Llama 2 and wants to sell it to Company B for use on their website. Before doing so, Company A must provide a copy of the License Agreement to Company B
Overall, its good news for startups. Of course fine tuning this beast is another challenge.