280
questions
0
votes
0
answers
17
views
YOLOv5 Class Imbalance and Overfitting Issues
I’m working on a seat belt and mobile phone detection system using YOLOv5s to detect the windshield, driver, passenger, seat belt, and mobile phone. My dataset has a class imbalance issue since not ...
-1
votes
0
answers
21
views
Training gemini AI with custom database [closed]
I've created a chat bot app using Gemini API. Now, I want that the Gemini should fetch data from my database. For example if I ask - "Show me today's sales" or "Show me this month's ...
0
votes
0
answers
15
views
TFWhisperForConditionalGeneration model.generate() returns repetitions of first word in sequence after finetuning
I fine-tuned TFWhisperForConditionalGeneration.from_pretrained("openai/whisper-tiny") on the German version of mozilla-foundation/common_voice_11_0. The training process looks fine (...
1
vote
0
answers
14
views
Implementing Domain Adaptation Network (DAN) for a custom MLP Keras Model
I am trying to implement DAN (Domain Adaptation Network) for an MLP model using Keras.
def build_network():
source_input = layers.Input(shape=(config_dict['patch_size'], config_dict['patch_size'], ...
0
votes
0
answers
42
views
Processing dataset for Llama 3.1 Instruct using PyTorch
Hey I am finetuning Llama 3.1 Instruct using PyTorch. I was wondering how to correctly process the dataset. Can you tell me if I am using the prompt template correctly and can I pass the whole prompt ...
0
votes
2
answers
59
views
LLaMA 3.1 Fine-tuning with QLoRA - CUDA Out of Memory Error
I'm trying to fine-tune the LLaMA 3.1 8 billion parameters model using the QLoRA technique with the help of the 4-bit bitsandbytes library on a mental health conversations dataset from Hugging Face. ...
0
votes
0
answers
19
views
Why does my transfer leaning model works only one dataset pair?
I am new at coding (trying to learn some for my masters). I need to create a neural network with pytorch for an assigment that I will pretrain on one dataset (I have 3) and finetune/test on another.
Ι ...
0
votes
0
answers
29
views
Fine-Tuning LLMs: CUDA OOM Errors Despite Various Optimization Techniques
I'm working on fine-tuning an LLM to build a fantasy football league model. The goal is to have the model output a team with high potential (hopefully) given a round of games. I have built an RAG ...
0
votes
0
answers
29
views
How to Generate an Instruct Dataset from a Text file for LLM Fine-Tuning?
I want to generate an instruct dataset in JSON format from a text file. Most available resources online already assume that I have the JSON format already and want to fine-tune an LLM. However, I only ...
-2
votes
0
answers
129
views
How to fine-tune llama 3.1 8B Instruct on my dataset
I wanna fine-tune llama 3.1 8B Instruct on my custom dataset. But this dataset is tiny and in russian language. What should I do? Fine-tune on good big russian dataset, then on my custom? Or search ...
1
vote
1
answer
52
views
Fine-tuning a Pretrained Model with Quantization and AMP: Scaler Error "Attempting to Unscale FP16 Gradients"
I am trying to fine-tune a pretrained model with limited VRAM. To achieve this, I am using quantization and automatic mixed precision (AMP). However, I am encountering an issue that I can't seem to ...
1
vote
1
answer
33
views
How to save the best model after running hyperparameter_search with Hugging Face Transformers?
I'm currently doing hyperparameter tuning by using the 'hyperparameter_search' function from the Transformers library. However, the process run completely, but I'm curious on how can I save the best ...
1
vote
0
answers
37
views
Fine-Tuning EfficientNetB0 with pretrained 'imagenet' is not reproducIble
I am encountering an issue with fine-tuning an EfficientNetB0 model that was originally pretrained on ImageNet.
Model Training and Fine-Tuning: I start with an EfficientNetB0 model pretrained on ...
1
vote
0
answers
573
views
Quantize and fine-tune Llama 3.1 8B for Ollama
I want to fine-tune locally the Meta's Llama 3.1 8B Instruct model with custom data and then save it in a format compatible with Ollama for further inference. As I do everything locally and don't have ...
-1
votes
1
answer
32
views
How to Fine-Tune mBART or mT5 for Transliteration from Romanized Text to Native Script?
I'm working on a project that involves converting Romanized text (where the characters are in the Latin alphabet) into its corresponding native script. Specifically, I'm dealing with Romanized Hindi (...
0
votes
0
answers
32
views
Fine-Tuning Whisper for translate task "speech in cutom dialect to translated text in another custom language"
I recently fine-tuned the Whisper-Tiny model on my custom speech dataset for transcription tasks, and it worked well. However, when I tried to fine-tune the model for a translation task using the same ...
0
votes
0
answers
68
views
Problems configuring a custom dataset for torchtune and LLama 3.1
I am trying to use torchtune to finetune Meta-Llama-3.1-8B-Instruct, but I am not being very sucessfull. I put my data on the format of AlpacaInstruct as a jsonl file that is in the format:
{"...
1
vote
1
answer
259
views
TORCH_USE_CUDA_DSA to enable device-side assertions
I'm trying to finetune llama 3 model with 1L dataset, I'm getting the below mentioned error in between training, to be precise I'm getting this error after completion 30k steps. Training with 2 GPU ...
0
votes
0
answers
31
views
I have installed CUDA toolkit 11.8 and set the environmental variable and paths for it, yet I am facing this issue, when trying to install auto-gptq
(base) C:\Users\hells>conda activate finetune
(finetune) C:\Users\hells>pip install auto-gptq
Collecting auto-gptq
Using cached auto_gptq-0.7.1.tar.gz (126 kB)
Preparing metadata (setup.py) ...
0
votes
0
answers
60
views
Cost-Effective Methods for Fine-Tuning LLMs with RAFT
I'm new to LLMs and fine-tuning in general so please bear with me if I've made obvious mistakes!
I have no GPU/cloud based platform other than a free tral GCP account.
I'm trying to fine-tune an LLM ...
0
votes
0
answers
41
views
How to implement a Small language model? using gemma2:2b
I am trying to implement a Small Language Model using Gemma2:2b. Based on research I have done so far, I understand small language models, which are quantized versions of LLM like Gemma2b, can be ...
0
votes
0
answers
539
views
Output images of my Stable Diffusion Fine tuning unchanged same? No difference after training. (Python, Diffusers)
i am currently trying to finetune sd1.5 with python and i dont get any errors but my output test images are exactly the same (pixelcomparisson online with img2go), also i compared the .safetensors ...
0
votes
1
answer
46
views
Recency-aware finetuning for question answering
I am looking to fine-tune LLaMA 3 for a question-answering task using specific data that I have collected. Each question-answer pair in my dataset includes a timestamp (in the format MM/DD/YY) ranging ...
1
vote
1
answer
38
views
NLLB Fine-Tuning Error: Missing data_prefix Configuration (English-German Translation)
I'm attempting to fine-tune the NLLB model "facebook/nllb-200-distilled-600M" for a scientific translation task from English (eng_Latn) to German (deu_Latn). I followed the official ...
0
votes
0
answers
43
views
How to evaluate LLM using rouge score elegantly
I am trying to evaluate the performance of a base model on a summarization task, using rouge score. My objective is to re-calculate the rouge score after fine-tuning.
from datasets import load_dataset
...
0
votes
0
answers
18
views
How do I train an assistant api on yelp dataset using OpenAi api dashboard?
I have the yelp acedemic dataset, if possible I would like to find another new dataset that maybe more up to date and includes all businesses in New York State. So right now with the dataset i have it ...
0
votes
1
answer
43
views
I can't generate text with trained fine-tune model with node.js
I've trained a new fine-tune model and upload to openAI.
Now I get a new fine-tune model, so I try to generate a text with a new model.
This is a code
const response = await openai.chat.completions....
0
votes
1
answer
31
views
Can't retrieve fine-tuning model after creating it with node.js
I'm fine-tuning a model and generating actions from text. I create a train.jsonl file, upload it, and fine-tune the model. However, when I try to get the name of the model I just created, it returns ...
1
vote
0
answers
82
views
Size Mismatch Error When Loading State Dict for (Fine-tuned model)
I'm encountering a RuntimeError while trying to load a state_dict for LlamaForCausalLM. The error message indicates a size mismatch:
RuntimeError: Error(s) in loading state_dict for LlamaForCausalLM:
...
0
votes
0
answers
16
views
how to merge Peft model with the base model of Falcon-7B
I'm currently learning on fine-tuning a Falcon LLM model so that it can be used for my use case. im using a free tier google colab environment for doing this. I've looked up internet tutorial but ...
0
votes
2
answers
157
views
isinstance() arg 2 must be a type, a tuple of types, or a union
I'm getting an error message when trying to train my model, but some reason its giving me the same message every time I alter it.
Here is the code:
# Define training arguments
training_args = ...
0
votes
0
answers
64
views
Unable to solve dtype issue using UnslothAI fine tuning for Llama 3.1 8B model
I am new to fine tuning LLMs and I have been trying to run the notebooks provided by UnSlothAI. For this question, I am running the code for fine-tuning LLaMa 3.1 8B model as posted here
This colab ...
0
votes
0
answers
109
views
Fine-tune LLM on custom schema to be used in sqlcoder, an ollama based llm
I am working on a POC to convert Natural language to SQL. I have used phi3 and now planning to use sqlcoder as part of the llm. All this are set up via ollama which I am running on docker.
The one ...
0
votes
0
answers
158
views
Optimal hyperparameters for fine tuning LLM
could I ask you for help? I am doing fine tuning of LLM model Llama3 8b (with LoRA) for text classification. I am using Trainer from Huggingface. I am looking for the optimal ...
-1
votes
1
answer
55
views
IndexError: list index out of range, when trying to predict from the fine tuned model using Hugginface
i am trying to learn on how to fine tune a pretrained model and use it. this is my code
from transformers import AutoModelForSequenceClassification, AutoTokenizer, TrainingArguments, Trainer
from ...
0
votes
1
answer
359
views
'LlamaForCausalLM' object has no attribute 'max_seq_length'
I'm fine-tuning llama3 using unsloth , I trained my model and saved it successfully but when I tried loading using AutoPeftModelForCausalLM.from_pretrained ,then I used TextStreamer from transformer ...
0
votes
0
answers
73
views
Knowing the format of dataset a pretrained model was trained on
i am working on a Multilingual TTS project , and developing a TTS for my regional language by using a pretrained model from Hugging Face hub , the model i am trying to fine tune is facebook-mms-tts ...
0
votes
1
answer
41
views
Difference between batch size and train batch size and validation batch size
The finetuning job creation required us to specify the values for these three kinds of batch sizes in the Azure ML Studio but I do not understand why we are specifying the batch size initially if we ...
0
votes
0
answers
47
views
Vertex AI Studio: Fine-tuned chat-bison@002 returns results are not in training data
I have a training dataset of about 1500 samples, in 1 JSONL file. I tried to fine-tune chat-bison@002 model but none of the answers in the test prompt is desired. Even when I try to copy a short ...
0
votes
1
answer
159
views
RuntimeError: Placeholder storage has not been allocated on MPS device while fine-tuning model on MacBook Pro M2
I'm trying to create a proof of concept (PoC) for a local code assistant by fine-tuning the tiny_starcoder_py-vi06 model on my MacBook Pro with an M2 chip. My dataset looks like this:
[
{ "...
0
votes
1
answer
58
views
Exception: Cannot load model parameters from checkpoint /home/krish/content/1.2B_last_checkpoint.pt; please ensure that the architectures match
I am fine-tuning the M2M model, with 1.2B model as the last checkpoint. But while training the model I am getting this error that it cannot load the paramters and the model architechure should match
...
-1
votes
1
answer
125
views
How to prepare data for batch-inference in Azure ML?
The data format (.csv) that I am using for inferencing produces the error :
"each data point should be a conversation array" when running the batch scoring job. All the documentations ...
0
votes
0
answers
244
views
The issue of bitsandbytes package supporting CUDA 12.4 version
when running the peft fine-tuning program, execute the following code:
model = get_peft_model(model, peft_config)
report errors:
Could not find the bitsandbytes CUDA binary at WindowsPath('D:/Users/1/...
1
vote
0
answers
132
views
Fine tune llama3 with message replies like dataset (slack)
I want to fine tune llama3 on a dataset in which the data structure is a list of messages considering the below rules:
there are channels.
in each channel there are messages from all sort of users.
...
0
votes
0
answers
18
views
Fine-tunning model vs training from scrath
I used two approaches to train a YOLOv8X detection model. In the first approach, I split the dataset into three parts, trained the model from scratch on the first part, then fine-tuned it on the ...
0
votes
0
answers
14
views
Layer "sequential_29" expects 1 input(s), but it received 3 input tensors
I am trying to use GridSearchCV on a trained model. But the following error occurs:
Layer "sequential_29" expects 1 input(s), but it received 3 input tensors. Inputs received: [<tf....
0
votes
1
answer
55
views
Different results for the same epoch using different number of total epochs
I am training a Machine Learning model for STS task using the Sentence Transformers library.
When I was testing it, I noticed that my model generated different results for the same number of epochs ...
0
votes
0
answers
55
views
Pretrained Model Weights Not Updating During DPO Training
I'm trying to apply DPO to a pre-trained model. However, during the training process, the scores given by the pre-trained model and the fine-tuned model are identical, and the loss remains the same ...
0
votes
0
answers
100
views
Fine tune Llama 2 model with custom dataset but getting zero training loss and validation loss
My problem is that the output of training loss and validation loss is 0 for the 3 epoch
Here I am using kaggle notebook
!pip install transformers datasets torch bitsandbytes peft accelerate
import ...
0
votes
0
answers
66
views
What's the correct data structure and format to fine-tune OpenAI assistant as a vector file?
I'm trying to fine-tune an assistant that depends on gpt-3.5-turbo model with numbers and bullets but bullets never show up. I created both docx and txt files with different data format like:
Title: ...