Issues

• 401 error on llama2 model while access granted

  question
  hyperonym/basaran#289 · Filter by author tomtomtomtom44 opened on Dec 16, 2023

• Runpod Serverless

  question
  hyperonym/basaran#288 · Filter by author stonejohnson opened on Dec 15, 2023
  1

• Loading basaran on multiple gpus leads to error

  question
  hyperonym/basaran#280 · Filter by author tanmaylaud opened on Nov 30, 2023

• Can you create a Gradio app for this Trained model

  hyperonym/basaran#276 · Filter by author yhammadmufin opened on Nov 14, 2023

• Suggestion: Passthrough to OpenAI GPT3.5 for testing

  hyperonym/basaran#273 · Filter by author FetchFast opened on Nov 1, 2023

• Tried multiple different models but get "The model weights are not tied..." error every time..

  question
  hyperonym/basaran#266 · Filter by author jontstaz opened on Sep 30, 2023

• Strong need for multiple models in a single deployment

  enhancement
  hyperonym/basaran#263 · Filter by author KastanDay opened on Sep 21, 2023
  3

• Use basaran API as Langchain LLM

  question
  hyperonym/basaran#256 · Filter by author brightebyte opened on Sep 8, 2023

• TypeError: issubclass() arg 1 must be a class

  bug
  hyperonym/basaran#253 · Filter by author gsuuon opened on Sep 4, 2023
  1

• How to send Audio Inputs to the Basaran

  enhancement
  hyperonym/basaran#234 · Filter by author Tushar-ml opened on Jul 27, 2023
  3

  

• Llama 2 models not working - how to pass auth token?

  enhancement
  hyperonym/basaran#232 · Filter by author arsaboo opened on Jul 21, 2023
  1

• TypeError: __init__() got an unexpected keyword argument 'load_in_4bit'

  question
  hyperonym/basaran#227 · Filter by author tanshuai opened on Jul 11, 2023
  1

• FR support for using fine tuned models that use Peft

  enhancement
  hyperonym/basaran#221 · Filter by author samos123 opened on Jul 3, 2023

• I want use the function prefix_allowed_tokens_fn, where of basaran's source code shall I modify?

  question
  hyperonym/basaran#220 · Filter by author zoubaihan opened on Jun 29, 2023
  1

• RuntimeError: expected scalar type Float but found Half

  question
  hyperonym/basaran#215 · Filter by author Ac1drainn opened on Jun 16, 2023

• crash when running mosaicml/mpt-7b-* models: KeyError: 'attention_mask'

  bug
  hyperonym/basaran#213 · Filter by author tarasglek opened on Jun 12, 2023
  2

• Falcon 40B : too slow and random answers

  question
  hyperonym/basaran#204 · Filter by author ArnaudHureaux opened on Jun 6, 2023
  7

  

• Langchain Prompt Format

  bugenhancement
  hyperonym/basaran#198 · Filter by author 0xDigest opened on Jun 1, 2023
  5

  

• in stream mode, the English word has no space after detokenizer and Chinese were messed up

  question
  hyperonym/basaran#197 · Filter by author lucasjinreal opened on Jun 1, 2023
  14

• How to set my own parameters in model.generate() in basaran?

  question
  hyperonym/basaran#193 · Filter by author zoubaihan opened on May 17, 2023
  2

• Do you have Discord community?

  question
  hyperonym/basaran#185 · Filter by author karfly opened on Apr 25, 2023
  1

• Docker run runs and then exits, does not set up server

  dependencieshelp wanted
  hyperonym/basaran#183 · Filter by author handrew opened on Apr 25, 2023
  2

• RuntimeError: mat1 and mat2 shapes cannot be multiplied

  bugduplicate
  hyperonym/basaran#181 · Filter by author lcw99 opened on Apr 24, 2023
  1

• GPTQ & 4bit

  duplicate
  hyperonym/basaran#180 · Filter by author olihough86 opened on Apr 22, 2023
  3

• The requested URL was not found on the server

  help wanted
  hyperonym/basaran#151 · Filter by author artivis opened on Apr 18, 2023
  2