File size: 12,598 Bytes
0c68e46
 
 
b8f1cf9
0c68e46
 
 
925ad9e
0c68e46
b8f1cf9
925ad9e
b8f1cf9
925ad9e
 
0c68e46
925ad9e
 
b8f1cf9
 
 
925ad9e
 
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
 
b8f1cf9
925ad9e
b8f1cf9
925ad9e
 
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
 
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
 
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
 
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
 
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
 
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
925ad9e
 
b8f1cf9
925ad9e
b8f1cf9
925ad9e
067619a
925ad9e
b8f1cf9
925ad9e
 
b8f1cf9
925ad9e
b8f1cf9
925ad9e
b8f1cf9
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
0c68e46
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
b8f1cf9
 
0c68e46
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
b8f1cf9
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
---
license: other
license_name: plamo-community-license
license_link: https://plamo.preferredai.jp/info/plamo-community-license-en
language:
- en
- ja
pipeline_tag: translation
library_name: transformers
extra_gated_heading: PLaMo community license to download PLaMo 2 translate
extra_gated_description: >-
  To download PLaMo 2 translate, you have to agree to our license. PLaMo 2 translate is
  released PLaMo community license. For non-commerical use, please contact us
  via this [form](https://forms.gle/mTL8tBLrMYXKNZD56).
extra_gated_button_content: agree to PLaMo community license
extra_gated_prompt: >-

  ### PLaMo Community License Agreement
 
  The PLaMo Community License Agreement outlines the terms and conditions for utilizing the large-scale language foundation model PLaMo and its derivatives provided by Preferred Networks, Inc., as well as any obligations the USER must observe. The USER’s access to the PLaMo model and its derivatives is subject to this AGREEMENT. By agreeing to or utilizing this MODEL, the USER shall be bound by the terms of this AGREEMENT.


  #### Article 1 (Definitions)

  (1) "AGREEMENT" refers to the PLaMo Community License Agreement.

  (2) "PFN" refers to Preferred Networks, Inc.

  (3) "MODEL" denotes the model weights, model code, tokenizer, training scripts, and other supplementary materials provided by PFN under the name "PLaMo" as separately specified.

  (4) "USER" means an individual or legal entity utilizing the MODEL.

  (5) "DERIVED MODEL" refers to models created through modification or use of the MODEL, including their model weights, code, and other associated materials.

  (6) "OUTPUT" means the results produced by the MODEL or DERIVED MODEL.

  (7) " MODEL MATERIALS" collectively refers to the MODEL, DERIVED MODEL, and OUTPUT.

  (8) "LICENSE" means PFN's authorization to grant the USER permission to use the MODEL MATERIALS under this AGREEMENT.

  (9) "COMMERCIAL PURPOSE" means any use beyond personal or academic use, including business applications or commercial purposes. Notably, COMMERCIAL PURPOSE also includes usage for developing, modifying, or providing products, services, or business operations (including through hosting services or APIs), and usage within the USER's organizational frameworks.


  #### Article 2 (User Requirements)

  The USER must be 18 years of age or older, or have reached the age of legal capacity in the USER’s country of residence, unless the USER's legal guardian or legal representative has consented to this AGREEMENT on the USER’s behalf.


  #### Article 3 (This License)

  (1) PFN grants the USER permission to use the MODEL MATERIALS under the terms and conditions and scope specified in this AGREEMENT, provided that the USER agrees to and comply with this AGREEMENT.

  (2) This LICENSE is non-exclusive, worldwide, non-transferable, and royalty-free.

  (3) The USER may utilize the MODEL MATERIALS for COMMERCIAL PURPOSE only if the USER satisfies all of the following conditions. If the USER fails to meet any of these conditions, the USER may no longer use the MODEL MATERIALS for COMMERCIAL PURPOSE and must obtain a new commercial license from PFN if the USER wishes to use the MODEL MATERIALS for COMMERCIAL PURPOSE.

    (i) Prior registration on PFN's official registration page (https://forms.gle/mTL8tBLrMYXKNZD56).

    (ii) The USER's or the USER’s affiliated company's annual revenue or sales must not exceed 1 billion yen (converted to the local currency of the USER's jurisdiction).


  #### Article 4 (Redistribution and Attribution Requirements)

  (1) When providing the MODEL MATERIALS to third parties, the USER must meet the following requirements:

    (i) Provide a copy of this AGREEMENT and ensure the recipients comply with its terms.

    (ii) Explicitly indicate "Built with PLaMo" in related websites, user interfaces, blog posts, product information pages, or product documentation.

    (iii) Include "PLaMo" in the names of AI models created using the MODEL MATERIALS.


  #### Article 5 (Usage of Outputs)

  (1) The USER may publicly distribute the OUTPUT provided that the USER clearly indicates that it is the output of the MODEL or DERIVED MODEL.

  (2) If models are trained using the OUTPUT, those models shall be treated as DERIVED MODEL subject to this AGREEMENT's terms, and may only be used, distributed, and commercialized under the same license conditions.


  #### Article 6 (Additional Usage Terms)

  The USER must not engage in any of the following activities regarding the use of the MODEL MATERIALS:

  (1) Actions violating laws or public order and morals

  (2) Criminal activities or any actions that threaten, participate in, or facilitate such activities

  (3) Actions infringing upon the rights or interests of PFN or third parties

  (4) Actions that damage the reputation or credibility of PFN or third parties

  (5) Dissemination of information that could create the false impression that the OUTPUT represents PFN's official views, etc.

  (6) Dissemination of false information

  (7) Any other actions that PFN reasonably determines to be inappropriate


  #### Article 7 (Warranty Disclaimer)

  (1) The MODEL and the OUTPUT are provided "as is" without any warranties from PFN regarding accuracy, truthfulness, merchantability, quality, performance, fitness for specific purposes, non-infringement, or any other matter.

  (2) The USER must not use the OUTPUT as the sole evidence, evaluation, or opinion regarding legal matters, medical diagnoses, financial decisions, or important personal assessments.

  (3) The USER assumes all responsibility for the use of the MODEL MATERIALS and any consequences arising therefrom.


  #### Article 8 (Limitation of Liability)

  (1) Regardless of whether liability arises from contract, tort, product liability, or other legal grounds, PFN's maximum liability to the USER regarding this AGREEMENT and the MODEL MATERIALS is limited to direct and ordinary damages only (including loss of profits, special damages, indirect damages, and other damages, regardless of foreseeability). The maximum liability amount shall be 500 yen. This limitation does not apply if PFN is found to have acted with intent or gross negligence.

  (2) Notwithstanding the preceding paragraph, if the USER utilizes the MODEL MATERIALS for business purposes, PFN shall assume no liability whatsoever, including any damages or other obligations, regarding this AGREEMENT and the MODEL MATERIALS.


  #### Article 9 (User Responsibility)

  (1) The USER shall comply with all applicable laws and regulations (including those related to import/export and trade) and this AGREEMENT regarding the acquisition and use of the MODEL MATERIALS.

  (2) If the USER causes PFN any damages due to breach of this AGREEMENT or use of the MODEL MATERIALS, the USER must compensate PFN for those damages.

  (3) If PFN receives any claims for damages or other demands from third parties due to USER's use of the MODEL MATERIALS, the USER shall indemnify PFN against such claims and ensure PFN is not harmed.


  #### Article 10 (Ownership Rights)

  (1) All rights to the MODEL belong to PFN or any third party licensed by PFN to license the MODEL.

  (2) For DERIVED MODEL, rights pertaining to the portions modified by the USER belong to the USER, while all other rights belong to PFN.

  (3) All rights to the OUTPUT belong to the USER.


  #### Article 11 (Contract Term and Termination)

  (1) This AGREEMENT shall be effective from the time the USER agrees to this AGREEMENT or access the MODEL MATERIALS and continue until termination.

  (2) If the USER violates any terms of this AGREEMENT, PFN may immediately terminate this AGREEMENT, and the USER must delete all copies of the MODEL MATERIALS and cease usage immediately.


  #### Article 12 (Contract Modification)

  PFN may modify this AGREEMENT (including rules and regulations related to the MODEL MATERIALS; the same applies hereinafter). When modifying this AGREEMENT, PFN shall notify the USER of the modification details and the effective date of the change through the method specified by PFN by the effective date.


  #### Article 13 (Governing Law and Jurisdiction)

  (1) The laws of Japan shall govern this AGREEMENT.

  (2) Any disputes arising from the MODEL MATERIALS or AGREEMENT shall be subject to the exclusive jurisdiction of the Tokyo District Court.
base_model: pfnet/plamo-2-8b
tags:
- plamo
- translation
---

# PLaMo Translation Model

PLaMo翻訳モデルはPreferred Networksによって開発された翻訳向け特化型大規模言語モデルです。
詳しくは[ブログ記事](https://tech.preferred.jp/ja/blog/plamo-translate/)および[プレスリリース](https://www.preferred.jp/ja/news/pr20250527/)を参照してください。

PLaMo Translation Model is a specialized large-scale language model developed by Preferred Networks for translation tasks.
For details, please refer to the [blog post](https://tech.preferred.jp/ja/blog/plamo-translate/) and [press release](https://www.preferred.jp/ja/news/pr20250527/).

List of models:
- [plamo-2-translate](http://huggingface.co/pfnet/plamo-2-translate) ... Post-trained model for translation
- [plamo-2-translate-base](http://huggingface.co/pfnet/plamo-2-translate-base) ... Base model for translation
- [plamo-2-translate-eval](http://huggingface.co/pfnet/plamo-2-translate-eval) ... Pair-wise evaluation model

PLaMo Translation Model is released under PLaMo community license. Please check the following license and agree to this before downloading.

- (EN) https://plamo.preferredai.jp/info/plamo-community-license-en
- (JA) https://plamo.preferredai.jp/info/plamo-community-license-ja

**NOTE**: This model has **NOT** been instruction-tuned for chat dialog or other downstream tasks.

### For *commercial* users

Please check the PLaMo community license and contact us via the following form to use commercial purpose.

- (EN/JA) https://forms.gle/mTL8tBLrMYXKNZD56

## Usage

### main/base model

```py
import vllm

# max_model_len/max_num_batched_tokens can be increased when running on a GPU with substantial memory.
# NOTE: Switch to "pfnet/plamo-2-translate-base" to try the base model.
llm = vllm.LLM(model="pfnet/plamo-2-translate", trust_remote_code=True, max_model_len=2000, max_num_batched_tokens=2000)

prompt = r'''<|plamo:op|>dataset
translation
<|plamo:op|>input lang=English
Write the text to be translated here.
<|plamo:op|>output lang=Japanese
'''

responses = llm.generate([prompt] * 1, sampling_params=vllm.SamplingParams(temperature=0, max_tokens=1024, stop=["<|plamo:op|>"]))
# NOTE: This outputs "ここに翻訳するテキストを入力してください。".
print(responses[0].outputs[0].text)
```

### evaluation model

```py
import vllm

# max_model_len/max_num_batched_tokens can be increased when running on a GPU with substantial memory.
llm = vllm.LLM(model="pfnet/plamo-2-translate-eval", trust_remote_code=True, max_model_len=2000, max_num_batched_tokens=2000)

prompt = r'''<|plamo:op|>dataset
translation evaluation
<|plamo:op|>input lang=English
This is an apple.
<|plamo:op|>output id=A lang=Japanese
これはりんごです。
<|plamo:op|>output id=B lang=Japanese
これはリンゴです。
<|plamo:op|>best
id='''

responses = llm.generate([prompt] * 1, sampling_params=vllm.SamplingParams(temperature=0, max_tokens=1, stop=["<|plamo:op|>"]))
# NOTE: This outputs "A".
print(responses[0].outputs[0].text)
```

## Bias, Risks, and Limitations

PLaMo Translation Model is a new technology that carries risks with use. Testing conducted to date has been in English and Japanese, and has not covered, nor could it cover all scenarios. For these reasons, as with all LLMs, PLaMo Translation Model’s potential outputs cannot be predicted in advance, and the model may in some instances produce inaccurate, biased or other objectionable responses to user prompts. Therefore, before deploying any applications of PLaMo Translation Model, developers should perform safety testing and tuning tailored to their specific applications of the model.

## Acknowledgement

This model is trained under the project, “Research and Development Project of the Enhanced Infrastructures for Post 5G Information and Communication System” (JPNP 20017), subsidized by the New Energy and Industrial Technology Development Organization (NEDO).


## AI policies for Preferred Networks, Inc. group

- (EN) https://www.preferred.jp/en/company/aipolicy/
- (JA) https://www.preferred.jp/ja/company/aipolicy/