File size: 12,598 Bytes
0c68e46 b8f1cf9 0c68e46 925ad9e 0c68e46 b8f1cf9 925ad9e b8f1cf9 925ad9e 0c68e46 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e 067619a 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 925ad9e b8f1cf9 0c68e46 b8f1cf9 0c68e46 b8f1cf9 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 |
---
license: other
license_name: plamo-community-license
license_link: https://plamo.preferredai.jp/info/plamo-community-license-en
language:
- en
- ja
pipeline_tag: translation
library_name: transformers
extra_gated_heading: PLaMo community license to download PLaMo 2 translate
extra_gated_description: >-
To download PLaMo 2 translate, you have to agree to our license. PLaMo 2 translate is
released PLaMo community license. For non-commerical use, please contact us
via this [form](https://forms.gle/mTL8tBLrMYXKNZD56).
extra_gated_button_content: agree to PLaMo community license
extra_gated_prompt: >-
### PLaMo Community License Agreement
The PLaMo Community License Agreement outlines the terms and conditions for utilizing the large-scale language foundation model PLaMo and its derivatives provided by Preferred Networks, Inc., as well as any obligations the USER must observe. The USER’s access to the PLaMo model and its derivatives is subject to this AGREEMENT. By agreeing to or utilizing this MODEL, the USER shall be bound by the terms of this AGREEMENT.
#### Article 1 (Definitions)
(1) "AGREEMENT" refers to the PLaMo Community License Agreement.
(2) "PFN" refers to Preferred Networks, Inc.
(3) "MODEL" denotes the model weights, model code, tokenizer, training scripts, and other supplementary materials provided by PFN under the name "PLaMo" as separately specified.
(4) "USER" means an individual or legal entity utilizing the MODEL.
(5) "DERIVED MODEL" refers to models created through modification or use of the MODEL, including their model weights, code, and other associated materials.
(6) "OUTPUT" means the results produced by the MODEL or DERIVED MODEL.
(7) " MODEL MATERIALS" collectively refers to the MODEL, DERIVED MODEL, and OUTPUT.
(8) "LICENSE" means PFN's authorization to grant the USER permission to use the MODEL MATERIALS under this AGREEMENT.
(9) "COMMERCIAL PURPOSE" means any use beyond personal or academic use, including business applications or commercial purposes. Notably, COMMERCIAL PURPOSE also includes usage for developing, modifying, or providing products, services, or business operations (including through hosting services or APIs), and usage within the USER's organizational frameworks.
#### Article 2 (User Requirements)
The USER must be 18 years of age or older, or have reached the age of legal capacity in the USER’s country of residence, unless the USER's legal guardian or legal representative has consented to this AGREEMENT on the USER’s behalf.
#### Article 3 (This License)
(1) PFN grants the USER permission to use the MODEL MATERIALS under the terms and conditions and scope specified in this AGREEMENT, provided that the USER agrees to and comply with this AGREEMENT.
(2) This LICENSE is non-exclusive, worldwide, non-transferable, and royalty-free.
(3) The USER may utilize the MODEL MATERIALS for COMMERCIAL PURPOSE only if the USER satisfies all of the following conditions. If the USER fails to meet any of these conditions, the USER may no longer use the MODEL MATERIALS for COMMERCIAL PURPOSE and must obtain a new commercial license from PFN if the USER wishes to use the MODEL MATERIALS for COMMERCIAL PURPOSE.
(i) Prior registration on PFN's official registration page (https://forms.gle/mTL8tBLrMYXKNZD56).
(ii) The USER's or the USER’s affiliated company's annual revenue or sales must not exceed 1 billion yen (converted to the local currency of the USER's jurisdiction).
#### Article 4 (Redistribution and Attribution Requirements)
(1) When providing the MODEL MATERIALS to third parties, the USER must meet the following requirements:
(i) Provide a copy of this AGREEMENT and ensure the recipients comply with its terms.
(ii) Explicitly indicate "Built with PLaMo" in related websites, user interfaces, blog posts, product information pages, or product documentation.
(iii) Include "PLaMo" in the names of AI models created using the MODEL MATERIALS.
#### Article 5 (Usage of Outputs)
(1) The USER may publicly distribute the OUTPUT provided that the USER clearly indicates that it is the output of the MODEL or DERIVED MODEL.
(2) If models are trained using the OUTPUT, those models shall be treated as DERIVED MODEL subject to this AGREEMENT's terms, and may only be used, distributed, and commercialized under the same license conditions.
#### Article 6 (Additional Usage Terms)
The USER must not engage in any of the following activities regarding the use of the MODEL MATERIALS:
(1) Actions violating laws or public order and morals
(2) Criminal activities or any actions that threaten, participate in, or facilitate such activities
(3) Actions infringing upon the rights or interests of PFN or third parties
(4) Actions that damage the reputation or credibility of PFN or third parties
(5) Dissemination of information that could create the false impression that the OUTPUT represents PFN's official views, etc.
(6) Dissemination of false information
(7) Any other actions that PFN reasonably determines to be inappropriate
#### Article 7 (Warranty Disclaimer)
(1) The MODEL and the OUTPUT are provided "as is" without any warranties from PFN regarding accuracy, truthfulness, merchantability, quality, performance, fitness for specific purposes, non-infringement, or any other matter.
(2) The USER must not use the OUTPUT as the sole evidence, evaluation, or opinion regarding legal matters, medical diagnoses, financial decisions, or important personal assessments.
(3) The USER assumes all responsibility for the use of the MODEL MATERIALS and any consequences arising therefrom.
#### Article 8 (Limitation of Liability)
(1) Regardless of whether liability arises from contract, tort, product liability, or other legal grounds, PFN's maximum liability to the USER regarding this AGREEMENT and the MODEL MATERIALS is limited to direct and ordinary damages only (including loss of profits, special damages, indirect damages, and other damages, regardless of foreseeability). The maximum liability amount shall be 500 yen. This limitation does not apply if PFN is found to have acted with intent or gross negligence.
(2) Notwithstanding the preceding paragraph, if the USER utilizes the MODEL MATERIALS for business purposes, PFN shall assume no liability whatsoever, including any damages or other obligations, regarding this AGREEMENT and the MODEL MATERIALS.
#### Article 9 (User Responsibility)
(1) The USER shall comply with all applicable laws and regulations (including those related to import/export and trade) and this AGREEMENT regarding the acquisition and use of the MODEL MATERIALS.
(2) If the USER causes PFN any damages due to breach of this AGREEMENT or use of the MODEL MATERIALS, the USER must compensate PFN for those damages.
(3) If PFN receives any claims for damages or other demands from third parties due to USER's use of the MODEL MATERIALS, the USER shall indemnify PFN against such claims and ensure PFN is not harmed.
#### Article 10 (Ownership Rights)
(1) All rights to the MODEL belong to PFN or any third party licensed by PFN to license the MODEL.
(2) For DERIVED MODEL, rights pertaining to the portions modified by the USER belong to the USER, while all other rights belong to PFN.
(3) All rights to the OUTPUT belong to the USER.
#### Article 11 (Contract Term and Termination)
(1) This AGREEMENT shall be effective from the time the USER agrees to this AGREEMENT or access the MODEL MATERIALS and continue until termination.
(2) If the USER violates any terms of this AGREEMENT, PFN may immediately terminate this AGREEMENT, and the USER must delete all copies of the MODEL MATERIALS and cease usage immediately.
#### Article 12 (Contract Modification)
PFN may modify this AGREEMENT (including rules and regulations related to the MODEL MATERIALS; the same applies hereinafter). When modifying this AGREEMENT, PFN shall notify the USER of the modification details and the effective date of the change through the method specified by PFN by the effective date.
#### Article 13 (Governing Law and Jurisdiction)
(1) The laws of Japan shall govern this AGREEMENT.
(2) Any disputes arising from the MODEL MATERIALS or AGREEMENT shall be subject to the exclusive jurisdiction of the Tokyo District Court.
base_model: pfnet/plamo-2-8b
tags:
- plamo
- translation
---
# PLaMo Translation Model
PLaMo翻訳モデルはPreferred Networksによって開発された翻訳向け特化型大規模言語モデルです。
詳しくは[ブログ記事](https://tech.preferred.jp/ja/blog/plamo-translate/)および[プレスリリース](https://www.preferred.jp/ja/news/pr20250527/)を参照してください。
PLaMo Translation Model is a specialized large-scale language model developed by Preferred Networks for translation tasks.
For details, please refer to the [blog post](https://tech.preferred.jp/ja/blog/plamo-translate/) and [press release](https://www.preferred.jp/ja/news/pr20250527/).
List of models:
- [plamo-2-translate](http://huggingface.co/pfnet/plamo-2-translate) ... Post-trained model for translation
- [plamo-2-translate-base](http://huggingface.co/pfnet/plamo-2-translate-base) ... Base model for translation
- [plamo-2-translate-eval](http://huggingface.co/pfnet/plamo-2-translate-eval) ... Pair-wise evaluation model
PLaMo Translation Model is released under PLaMo community license. Please check the following license and agree to this before downloading.
- (EN) https://plamo.preferredai.jp/info/plamo-community-license-en
- (JA) https://plamo.preferredai.jp/info/plamo-community-license-ja
**NOTE**: This model has **NOT** been instruction-tuned for chat dialog or other downstream tasks.
### For *commercial* users
Please check the PLaMo community license and contact us via the following form to use commercial purpose.
- (EN/JA) https://forms.gle/mTL8tBLrMYXKNZD56
## Usage
### main/base model
```py
import vllm
# max_model_len/max_num_batched_tokens can be increased when running on a GPU with substantial memory.
# NOTE: Switch to "pfnet/plamo-2-translate-base" to try the base model.
llm = vllm.LLM(model="pfnet/plamo-2-translate", trust_remote_code=True, max_model_len=2000, max_num_batched_tokens=2000)
prompt = r'''<|plamo:op|>dataset
translation
<|plamo:op|>input lang=English
Write the text to be translated here.
<|plamo:op|>output lang=Japanese
'''
responses = llm.generate([prompt] * 1, sampling_params=vllm.SamplingParams(temperature=0, max_tokens=1024, stop=["<|plamo:op|>"]))
# NOTE: This outputs "ここに翻訳するテキストを入力してください。".
print(responses[0].outputs[0].text)
```
### evaluation model
```py
import vllm
# max_model_len/max_num_batched_tokens can be increased when running on a GPU with substantial memory.
llm = vllm.LLM(model="pfnet/plamo-2-translate-eval", trust_remote_code=True, max_model_len=2000, max_num_batched_tokens=2000)
prompt = r'''<|plamo:op|>dataset
translation evaluation
<|plamo:op|>input lang=English
This is an apple.
<|plamo:op|>output id=A lang=Japanese
これはりんごです。
<|plamo:op|>output id=B lang=Japanese
これはリンゴです。
<|plamo:op|>best
id='''
responses = llm.generate([prompt] * 1, sampling_params=vllm.SamplingParams(temperature=0, max_tokens=1, stop=["<|plamo:op|>"]))
# NOTE: This outputs "A".
print(responses[0].outputs[0].text)
```
## Bias, Risks, and Limitations
PLaMo Translation Model is a new technology that carries risks with use. Testing conducted to date has been in English and Japanese, and has not covered, nor could it cover all scenarios. For these reasons, as with all LLMs, PLaMo Translation Model’s potential outputs cannot be predicted in advance, and the model may in some instances produce inaccurate, biased or other objectionable responses to user prompts. Therefore, before deploying any applications of PLaMo Translation Model, developers should perform safety testing and tuning tailored to their specific applications of the model.
## Acknowledgement
This model is trained under the project, “Research and Development Project of the Enhanced Infrastructures for Post 5G Information and Communication System” (JPNP 20017), subsidized by the New Energy and Industrial Technology Development Organization (NEDO).
## AI policies for Preferred Networks, Inc. group
- (EN) https://www.preferred.jp/en/company/aipolicy/
- (JA) https://www.preferred.jp/ja/company/aipolicy/
|