Skip to main content
Filter by
Sorted by
Tagged with
0 votes
0 answers
17 views

YOLOv5 Class Imbalance and Overfitting Issues

I’m working on a seat belt and mobile phone detection system using YOLOv5s to detect the windshield, driver, passenger, seat belt, and mobile phone. My dataset has a class imbalance issue since not ...
Wrrrrr's user avatar
  • 1
-1 votes
0 answers
21 views

Training gemini AI with custom database [closed]

I've created a chat bot app using Gemini API. Now, I want that the Gemini should fetch data from my database. For example if I ask - "Show me today's sales" or "Show me this month's ...
Tanay Sarkar's user avatar
0 votes
0 answers
15 views

TFWhisperForConditionalGeneration model.generate() returns repetitions of first word in sequence after finetuning

I fine-tuned TFWhisperForConditionalGeneration.from_pretrained("openai/whisper-tiny") on the German version of mozilla-foundation/common_voice_11_0. The training process looks fine (...
David's user avatar
  • 21
1 vote
0 answers
14 views

Implementing Domain Adaptation Network (DAN) for a custom MLP Keras Model

I am trying to implement DAN (Domain Adaptation Network) for an MLP model using Keras. def build_network(): source_input = layers.Input(shape=(config_dict['patch_size'], config_dict['patch_size'], ...
nooshinha's user avatar
  • 279
0 votes
0 answers
42 views

Processing dataset for Llama 3.1 Instruct using PyTorch

Hey I am finetuning Llama 3.1 Instruct using PyTorch. I was wondering how to correctly process the dataset. Can you tell me if I am using the prompt template correctly and can I pass the whole prompt ...
Skorbit's user avatar
0 votes
2 answers
59 views

LLaMA 3.1 Fine-tuning with QLoRA - CUDA Out of Memory Error

I'm trying to fine-tune the LLaMA 3.1 8 billion parameters model using the QLoRA technique with the help of the 4-bit bitsandbytes library on a mental health conversations dataset from Hugging Face. ...
Palthya Deepmalik's user avatar
0 votes
0 answers
19 views

Why does my transfer leaning model works only one dataset pair?

I am new at coding (trying to learn some for my masters). I need to create a neural network with pytorch for an assigment that I will pretrain on one dataset (I have 3) and finetune/test on another. Ι ...
Andreas Rouvalis's user avatar
0 votes
0 answers
29 views

Fine-Tuning LLMs: CUDA OOM Errors Despite Various Optimization Techniques

I'm working on fine-tuning an LLM to build a fantasy football league model. The goal is to have the model output a team with high potential (hopefully) given a round of games. I have built an RAG ...
Noy Rahmani's user avatar
0 votes
0 answers
29 views

How to Generate an Instruct Dataset from a Text file for LLM Fine-Tuning?

I want to generate an instruct dataset in JSON format from a text file. Most available resources online already assume that I have the JSON format already and want to fine-tune an LLM. However, I only ...
Mohamed Hendy's user avatar
-2 votes
0 answers
129 views

How to fine-tune llama 3.1 8B Instruct on my dataset

I wanna fine-tune llama 3.1 8B Instruct on my custom dataset. But this dataset is tiny and in russian language. What should I do? Fine-tune on good big russian dataset, then on my custom? Or search ...
Алихан's user avatar
1 vote
1 answer
52 views

Fine-tuning a Pretrained Model with Quantization and AMP: Scaler Error "Attempting to Unscale FP16 Gradients"

I am trying to fine-tune a pretrained model with limited VRAM. To achieve this, I am using quantization and automatic mixed precision (AMP). However, I am encountering an issue that I can't seem to ...
landings's user avatar
  • 730
1 vote
1 answer
33 views

How to save the best model after running hyperparameter_search with Hugging Face Transformers?

I'm currently doing hyperparameter tuning by using the 'hyperparameter_search' function from the Transformers library. However, the process run completely, but I'm curious on how can I save the best ...
Winson's user avatar
  • 11
1 vote
0 answers
37 views

Fine-Tuning EfficientNetB0 with pretrained 'imagenet' is not reproducIble

I am encountering an issue with fine-tuning an EfficientNetB0 model that was originally pretrained on ImageNet. Model Training and Fine-Tuning: I start with an EfficientNetB0 model pretrained on ...
Qasim's user avatar
  • 11
1 vote
0 answers
573 views

Quantize and fine-tune Llama 3.1 8B for Ollama

I want to fine-tune locally the Meta's Llama 3.1 8B Instruct model with custom data and then save it in a format compatible with Ollama for further inference. As I do everything locally and don't have ...
Adrien's user avatar
  • 13
-1 votes
1 answer
32 views

How to Fine-Tune mBART or mT5 for Transliteration from Romanized Text to Native Script?

I'm working on a project that involves converting Romanized text (where the characters are in the Latin alphabet) into its corresponding native script. Specifically, I'm dealing with Romanized Hindi (...
sameera perera's user avatar
0 votes
0 answers
32 views

Fine-Tuning Whisper for translate task "speech in cutom dialect to translated text in another custom language"

I recently fine-tuned the Whisper-Tiny model on my custom speech dataset for transcription tasks, and it worked well. However, when I tried to fine-tune the model for a translation task using the same ...
maria labed's user avatar
0 votes
0 answers
68 views

Problems configuring a custom dataset for torchtune and LLama 3.1

I am trying to use torchtune to finetune Meta-Llama-3.1-8B-Instruct, but I am not being very sucessfull. I put my data on the format of AlpacaInstruct as a jsonl file that is in the format: {"...
DanielCamara's user avatar
1 vote
1 answer
259 views

TORCH_USE_CUDA_DSA to enable device-side assertions

I'm trying to finetune llama 3 model with 1L dataset, I'm getting the below mentioned error in between training, to be precise I'm getting this error after completion 30k steps. Training with 2 GPU ...
Siddharth S's user avatar
0 votes
0 answers
31 views

I have installed CUDA toolkit 11.8 and set the environmental variable and paths for it, yet I am facing this issue, when trying to install auto-gptq

(base) C:\Users\hells>conda activate finetune (finetune) C:\Users\hells>pip install auto-gptq Collecting auto-gptq Using cached auto_gptq-0.7.1.tar.gz (126 kB) Preparing metadata (setup.py) ...
Noah Volstaire Wynknight's user avatar
0 votes
0 answers
60 views

Cost-Effective Methods for Fine-Tuning LLMs with RAFT

I'm new to LLMs and fine-tuning in general so please bear with me if I've made obvious mistakes! I have no GPU/cloud based platform other than a free tral GCP account. I'm trying to fine-tune an LLM ...
Merve's user avatar
  • 1
0 votes
0 answers
41 views

How to implement a Small language model? using gemma2:2b

I am trying to implement a Small Language Model using Gemma2:2b. Based on research I have done so far, I understand small language models, which are quantized versions of LLM like Gemma2b, can be ...
balanv's user avatar
  • 10.9k
0 votes
0 answers
539 views

Output images of my Stable Diffusion Fine tuning unchanged same? No difference after training. (Python, Diffusers)

i am currently trying to finetune sd1.5 with python and i dont get any errors but my output test images are exactly the same (pixelcomparisson online with img2go), also i compared the .safetensors ...
Hoho Bart's user avatar
0 votes
1 answer
46 views

Recency-aware finetuning for question answering

I am looking to fine-tune LLaMA 3 for a question-answering task using specific data that I have collected. Each question-answer pair in my dataset includes a timestamp (in the format MM/DD/YY) ranging ...
Arash Vahabpour's user avatar
1 vote
1 answer
38 views

NLLB Fine-Tuning Error: Missing data_prefix Configuration (English-German Translation)

I'm attempting to fine-tune the NLLB model "facebook/nllb-200-distilled-600M" for a scientific translation task from English (eng_Latn) to German (deu_Latn). I followed the official ...
PrincessIris's user avatar
0 votes
0 answers
43 views

How to evaluate LLM using rouge score elegantly

I am trying to evaluate the performance of a base model on a summarization task, using rouge score. My objective is to re-calculate the rouge score after fine-tuning. from datasets import load_dataset ...
Arindam's user avatar
  • 324
0 votes
0 answers
18 views

How do I train an assistant api on yelp dataset using OpenAi api dashboard?

I have the yelp acedemic dataset, if possible I would like to find another new dataset that maybe more up to date and includes all businesses in New York State. So right now with the dataset i have it ...
Overly vile's user avatar
0 votes
1 answer
43 views

I can't generate text with trained fine-tune model with node.js

I've trained a new fine-tune model and upload to openAI. Now I get a new fine-tune model, so I try to generate a text with a new model. This is a code const response = await openai.chat.completions....
Denis Prosvietov's user avatar
0 votes
1 answer
31 views

Can't retrieve fine-tuning model after creating it with node.js

I'm fine-tuning a model and generating actions from text. I create a train.jsonl file, upload it, and fine-tune the model. However, when I try to get the name of the model I just created, it returns ...
Denis Prosvietov's user avatar
1 vote
0 answers
82 views

Size Mismatch Error When Loading State Dict for (Fine-tuned model)

I'm encountering a RuntimeError while trying to load a state_dict for LlamaForCausalLM. The error message indicates a size mismatch: RuntimeError: Error(s) in loading state_dict for LlamaForCausalLM: ...
Deera's user avatar
  • 11
0 votes
0 answers
16 views

how to merge Peft model with the base model of Falcon-7B

I'm currently learning on fine-tuning a Falcon LLM model so that it can be used for my use case. im using a free tier google colab environment for doing this. I've looked up internet tutorial but ...
ZHLN's user avatar
  • 11
0 votes
2 answers
157 views

isinstance() arg 2 must be a type, a tuple of types, or a union

I'm getting an error message when trying to train my model, but some reason its giving me the same message every time I alter it. Here is the code: # Define training arguments training_args = ...
Jay-Tech456's user avatar
0 votes
0 answers
64 views

Unable to solve dtype issue using UnslothAI fine tuning for Llama 3.1 8B model

I am new to fine tuning LLMs and I have been trying to run the notebooks provided by UnSlothAI. For this question, I am running the code for fine-tuning LLaMa 3.1 8B model as posted here This colab ...
adhok's user avatar
  • 431
0 votes
0 answers
109 views

Fine-tune LLM on custom schema to be used in sqlcoder, an ollama based llm

I am working on a POC to convert Natural language to SQL. I have used phi3 and now planning to use sqlcoder as part of the llm. All this are set up via ollama which I am running on docker. The one ...
Srikant Sahu's user avatar
0 votes
0 answers
158 views

Optimal hyperparameters for fine tuning LLM

could I ask you for help? I am doing fine tuning of LLM model Llama3 8b (with LoRA) for text classification. I am using Trainer from Huggingface. I am looking for the optimal ...
Roman Frič's user avatar
-1 votes
1 answer
55 views

IndexError: list index out of range, when trying to predict from the fine tuned model using Hugginface

i am trying to learn on how to fine tune a pretrained model and use it. this is my code from transformers import AutoModelForSequenceClassification, AutoTokenizer, TrainingArguments, Trainer from ...
Lijin Durairaj's user avatar
0 votes
1 answer
359 views

'LlamaForCausalLM' object has no attribute 'max_seq_length'

I'm fine-tuning llama3 using unsloth , I trained my model and saved it successfully but when I tried loading using AutoPeftModelForCausalLM.from_pretrained ,then I used TextStreamer from transformer ...
Sarra Ben Messaoud's user avatar
0 votes
0 answers
73 views

Knowing the format of dataset a pretrained model was trained on

i am working on a Multilingual TTS project , and developing a TTS for my regional language by using a pretrained model from Hugging Face hub , the model i am trying to fine tune is facebook-mms-tts ...
Injila's user avatar
  • 1
0 votes
1 answer
41 views

Difference between batch size and train batch size and validation batch size

The finetuning job creation required us to specify the values for these three kinds of batch sizes in the Azure ML Studio but I do not understand why we are specifying the batch size initially if we ...
S R's user avatar
  • 11
0 votes
0 answers
47 views

Vertex AI Studio: Fine-tuned chat-bison@002 returns results are not in training data

I have a training dataset of about 1500 samples, in 1 JSONL file. I tried to fine-tune chat-bison@002 model but none of the answers in the test prompt is desired. Even when I try to copy a short ...
nogias's user avatar
  • 583
0 votes
1 answer
159 views

RuntimeError: Placeholder storage has not been allocated on MPS device while fine-tuning model on MacBook Pro M2

I'm trying to create a proof of concept (PoC) for a local code assistant by fine-tuning the tiny_starcoder_py-vi06 model on my MacBook Pro with an M2 chip. My dataset looks like this: [ { "...
Varuzhan's user avatar
0 votes
1 answer
58 views

Exception: Cannot load model parameters from checkpoint /home/krish/content/1.2B_last_checkpoint.pt; please ensure that the architectures match

I am fine-tuning the M2M model, with 1.2B model as the last checkpoint. But while training the model I am getting this error that it cannot load the paramters and the model architechure should match ...
KRISH MANTRI's user avatar
-1 votes
1 answer
125 views

How to prepare data for batch-inference in Azure ML?

The data format (.csv) that I am using for inferencing produces the error : "each data point should be a conversation array" when running the batch scoring job. All the documentations ...
S R's user avatar
  • 11
0 votes
0 answers
244 views

The issue of bitsandbytes package supporting CUDA 12.4 version

when running the peft fine-tuning program, execute the following code: model = get_peft_model(model, peft_config) report errors: Could not find the bitsandbytes CUDA binary at WindowsPath('D:/Users/1/...
paul qin's user avatar
1 vote
0 answers
132 views

Fine tune llama3 with message replies like dataset (slack)

I want to fine tune llama3 on a dataset in which the data structure is a list of messages considering the below rules: there are channels. in each channel there are messages from all sort of users. ...
Ben's user avatar
  • 423
0 votes
0 answers
18 views

Fine-tunning model vs training from scrath

I used two approaches to train a YOLOv8X detection model. In the first approach, I split the dataset into three parts, trained the model from scratch on the first part, then fine-tuned it on the ...
Krilaria's user avatar
0 votes
0 answers
14 views

Layer "sequential_29" expects 1 input(s), but it received 3 input tensors

I am trying to use GridSearchCV on a trained model. But the following error occurs: Layer "sequential_29" expects 1 input(s), but it received 3 input tensors. Inputs received: [<tf....
user25720613's user avatar
0 votes
1 answer
55 views

Different results for the same epoch using different number of total epochs

I am training a Machine Learning model for STS task using the Sentence Transformers library. When I was testing it, I noticed that my model generated different results for the same number of epochs ...
Hígor Hahn's user avatar
0 votes
0 answers
55 views

Pretrained Model Weights Not Updating During DPO Training

I'm trying to apply DPO to a pre-trained model. However, during the training process, the scores given by the pre-trained model and the fine-tuned model are identical, and the loss remains the same ...
jeash's user avatar
  • 1
0 votes
0 answers
100 views

Fine tune Llama 2 model with custom dataset but getting zero training loss and validation loss

My problem is that the output of training loss and validation loss is 0 for the 3 epoch Here I am using kaggle notebook !pip install transformers datasets torch bitsandbytes peft accelerate import ...
Menna Bakry's user avatar
0 votes
0 answers
66 views

What's the correct data structure and format to fine-tune OpenAI assistant as a vector file?

I'm trying to fine-tune an assistant that depends on gpt-3.5-turbo model with numbers and bullets but bullets never show up. I created both docx and txt files with different data format like: Title: ...
PHP User's user avatar
  • 2,412

1
2 3 4 5 6