Spaces:

ecyht2
/

transformers-nlp-template

Sleeping

ecyht2 commited on Jan 22, 2024

Commit

be7c0a9

verified ·

1 Parent(s): ecae120

fix: Fix crash when generating

Files changed (1) hide show

app.py CHANGED Viewed

@@ -56,7 +56,7 @@ def generate(
     logging.debug("Prompt: %s", formatted_prompt)
     logging.info("Generating Text")
-    stream = model.generate(tokenizer(prompt, return_tensors="pt"), **generate_kwargs)
     logging.info("Creating Output")
     output = ""

     logging.debug("Prompt: %s", formatted_prompt)
     logging.info("Generating Text")
+    stream = model.generate(tokenizer(prompt, return_tensors="pt").input_ids, **generate_kwargs)
     logging.info("Creating Output")
     output = ""