o @d#@s$ddlZddlZddlZddZdS)NcCsJdddddd}d}|j|t||ddd }t|d d dS) NgY@r)Zlength_penaltyZmax_new_tokensZ temperatureZ min_lengthZno_repeat_ngram_sizez.bloomz-7b1-mt-2023-04-19-09-41-24-189-endpoint)Zinputs parameterszapplication/json)Z EndpointNameBodyZ ContentTyperutf8)Zinvoke_endpointjsondumpsprintreaddecode) smr_clientpromptr endpoint_nameZresponse_modelrS/Users/ybalbert/Documents/workspace/MyGithub/QA-chatbot-workshop/code/Bloomz_LLM.pyGenerates"  r)rboto3numpynprrrrrs