Questions tagged [neural-network]

Network structure inspired by simplified models of biological neurons (brain cells). Neural networks are trained to "learn" by supervised and unsupervised techniques, and can be used to solve optimization problems, approximation problems, classify patterns, and combinations thereof.

Filter by
Sorted by
Tagged with
0 votes
0 answers
9 views

Neuralprophet forecast output doesn't seem to add up

I have a query regarding the forecast output from neuralprophet. I would expect the sum of the various decomposed elements of the forecast to equal the yhat/prediction value, but that doesn't appear ...
Joe_w's user avatar
  • 11
0 votes
0 answers
15 views

Calling model.fit on target array of columns vs array of rows

The two should be equivalent in terms of how they are fed into the model or one should be accepted and the other incompatible. A list of columns vs a list of rows. My model architecture takes 5 inputs ...
Governor's user avatar
  • 300
0 votes
0 answers
14 views

Trying EfficientNetV2 with CBAM

I am trying to build EfficientNetV2 model with CBAM (Convolutional Block Attention Module) by using Keras. I've implemented it myself, using this Github as a reference. Could you confirm that the ...
occ's user avatar
  • 1
0 votes
0 answers
10 views

Simple classification problem between real and fake data always gives zero loss

Hey I have just started with machine learning and was trying to classify between real (label 1) and fake data (label 0). Here is the code that I have written. The real_loss and fake_loss is always ...
sbp's user avatar
  • 101
-1 votes
0 answers
8 views

Transformer Sequntial Decoder

I am working now to learn on how to work transformers, the below code is in pytorch API. during the code review I come across some uncertainities. enter image description here Can anyone explain to me ...
Amir's user avatar
  • 1
0 votes
0 answers
11 views

Neural prophet cannot index with multidimensional key

I am using the neural prophet fit function on a df. The data frame is created by: group_by_turbine = train_set.groupby("Turbine_ID") group_by_turbine.groups.keys() dict_keys(['T01', 'T06', ...
 C A OB1's user avatar
-3 votes
0 answers
25 views

How to clone users voice and generate a speech audio with that same voice [closed]

Me and my team were actually doing a project on dubbing videos to Indian regional languages using Python. We've managed to complete till transcribing the video and converting it to other languages, to ...
VISHWAA's user avatar
0 votes
0 answers
23 views

Detect anomalies on Big Data (19GB of txt files)

I want to detect anomalies in this data (around 19GB of .txt files). My approach so far is moving the files in my hadoop hdfs, and run pyspark where I have my jupyter notebook. I have my pyspark ...
129's user avatar
  • 3
-2 votes
0 answers
9 views

Is there a Wikipedia link graph or neural network graph I can look at? [closed]

Sorry, I know this isn't a programming question, but it's where people who would have came across it would be. I wanna look at the distribution of knowledge registered in Wikipedia. Could be done with ...
vicy spann's user avatar
-1 votes
0 answers
11 views

Does cutting of the top layer of the network lead to over-fitting?

I read that over-fitting is a major hurdle for neural networks including tesseract. But, I don't have a deeper understanding of neural networks. I have been trying to add a few new characters to the ...
Dellu's user avatar
  • 153
-2 votes
0 answers
15 views

How can you get the algorithm for layer normalization backpropagation? [closed]

I can't understand how the backpropagation algorithm for layer normalization works. Can someone explain it to me like I'm dumb? There is not that much stuff online and most of it is behind a lot of ...
altywalty's user avatar
0 votes
0 answers
15 views

Given groups=1, weight of size [64, 2, 3, 3], expected input[15, 6, 256, 256] to have 2 channels, but got 6 channels instead

I am working on a problem for Image Inpainting. For this, I am using the Unet as a generator. So it is working fine on Gray Image (Single channel), when I tried to move it to 3 Channels (RGB), it ...
Adnan Mehmood's user avatar
-1 votes
0 answers
23 views

LSTM neural network for predicting stock prices, predicts unreadable results, that are far from the actual prices

As the title says. Here is a plot of the neural network prediction on the test dataset. Here is the code: import numpy as np import matplotlib.pyplot as plt import pandas as pd import datetime as dt ...
Boyan's user avatar
  • 9
-2 votes
0 answers
12 views

Idea to have auto selection of number of neurons in each hidden layer with embedding R2 in the model behind the loss optimizer for each batch ✨

I will describe a simple way to have auto selection of number of neurons in each hidden layer, but I can't implement it. let's focused on one neuron and its input neurons. As you now each neuron make ...
Ahmed El-Taher's user avatar
-2 votes
0 answers
19 views

VAE with convolutional layers converges on the whole data but doesn't learn a single data [closed]

I have a VAE with 2 convolutional layers (kernel_size=1, fileter_num = 256) on each of encoder and decoder with ReLU activations. I train it with a data that has 64 features. When I train my model on ...
RTn's user avatar
  • 49
0 votes
0 answers
38 views

TypeError: cross_val_score() got an unexpected keyword argument 'validation_batch_size' while trying to calculate and fitting scikeras KC model

I'm stuck at this point where I am unable to calculate cross_val_score() and further unable to fit the model as I keep getting the error 'TypeError: cross_val_score() got an unexpected keyword ...
Hemil Shah's user avatar
1 vote
1 answer
54 views

LSTM model has a concerning loss graph and returns a constant value on predictions

My dataset is 597515 rows, 31 columns measuring one variable. So input shape (31,1). import pandas as pd import tensorflow as tf gpu_devices = tf.config.experimental.list_physical_devices("GPU&...
mospira's user avatar
  • 31
1 vote
0 answers
22 views

How to train a neural network with a custom loss function that is informed by outputs from the input layer in TensorFlow 2?

This seems to be a very commonly asked question, but I am still struggling to find a minimal workable example to solidify my understanding. So here goes another attempt with a MWE. I am trying to ...
bad_chemist's user avatar
0 votes
0 answers
25 views

Model CNN Computer Vision (Pizza VS Steak) pretty much just guesses

# Load images and split them into batches images_train = Images( images_dir_train, image_size = (224, 224), batch_size = 32 ) images_test = Images( images_dir_test, image_size = (...
Arsenii Kvachan's user avatar
-1 votes
0 answers
9 views

How can I sum two incompatible matrices? [closed]

In this book on the page 119 they are adding matrices with different dimensions; please see the last line of the snippet: n x n and d x n is there. What is an explanation for this ?
user1766349's user avatar
-3 votes
0 answers
39 views

Debugging a neural Network build from scratch [closed]

I am currently building a NeuralNetwork from scratch (with a tutorial). But I can't get it to train properly. I think the problem is the calculateOutputs method in Layer.cpp as it is suppost to save ...
Dragon's user avatar
  • 1
-1 votes
1 answer
30 views

ValueError: could not broadcast input array from shape (2,128) into shape (1,128)

i'm creating a neural network that predict different type of drugs, and i'm getting an error that i don't understand and i don't find the issue in the code, if anyone can help me and give me an ...
matteoppet's user avatar
-2 votes
0 answers
13 views

how to hyper-tune a neural network model

Basically i built a neural network model, when i finished training the model, for unknown test input it predicts the outputs, but i can see there is some error percentage btw the predicted output and ...
krishna vamshi 9573's user avatar
0 votes
0 answers
13 views

AssertionError: ../final_dataset\trainA is not a valid directory

I am getting error even after placing the corresponding folder trainA in train_dataset folder Options D_P_times2: False IN_vgg: False batchSize: 32 beta1: 0.5 checkpoints_dir: ./checkpoints config: ...
Saketh Garuda's user avatar
-2 votes
0 answers
19 views

How to model a trumpet-like trigonometric function? [closed]

I'm using tensorflow to train a trumpet-like data like this: The orange data points are the trained data. The blue line is the prediction. The model is like this: model = tensorflow.keras.Sequential([...
Gary Allen's user avatar
0 votes
1 answer
18 views

Backpropagation through concatenation of elements of a batch

I have two feature vectors V1(N, F1, 1) and V2(N, F2, 1). I want to concatenate them across dimension 1 to create a vector V3(N, F1+F2, 1) and apply self attention across elements of the batch, i.e ...
Hitul Desai's user avatar
-3 votes
1 answer
33 views

How to get class prediction for new entry value in neural networks? [duplicate]

I am new to Nerual Networks model building !! I am doing an multi-class text classification using neural networks. Steps I have done : 1.Data Cleaning 2.Keras - Text Vectorization for Input Data 3....
Chandra's user avatar
0 votes
0 answers
24 views

Optimization of a function with several arguments using neural network

I have a function F(args: tuple) => tuple with 11 arguments that yields 4-elements-tuple as a result. The project uses a tensorflow library. How should I implement this with the help of a neural ...
Cyrus Florence's user avatar
-7 votes
0 answers
19 views

Asking about neural network?(hidden dimensions, hidden layers) [closed]

Can anyone explain to me what is hidden dimensions and hidden layer in this code pls? It is code about creating a 2-layers fc neural network. class TwoLayerNet(object): """ A ...
Thanh Pham's user avatar
0 votes
0 answers
36 views

Which layers to use for a Neural Network fit of a strange function?

I am using a neural network to find the best fit of a function that has a step aspect (blue is my real data, orange is the neural network prediction): I am new to this and the paper I am basing ...
Nihilum's user avatar
  • 559
-3 votes
0 answers
19 views

VGG16 model is not giving the correct results

I have trained a 3-class image classifier to predict the severity of vehicle body damages using Keras and VGG16 transfer learning. I have 1349 sample images per class and used image augmentation on ...
Shajeeth Suwarnarajah's user avatar
-1 votes
0 answers
15 views

Invalid parameter activation_f for estimator KerasRegressor

I have the following problem when I run this code (a few days ago it was working perfectly, but yesterday I started having the problem.). I work with google colab: x_train_norm_full, x_test_norm_full, ...
Rodrigo Canaglia's user avatar
-2 votes
0 answers
9 views

Quantization method for linear models and neural networks of sklearn [closed]

I am developing SkimXDP, a simple tool integrating the machine learning model created with scikit-learn into XDP, a technique to execute packet processing inside the Linux kernel. This tool aims to ...
Koukyosyumei's user avatar
0 votes
0 answers
13 views

What amount of volatility is to be expected for validation set?

I constructed an LSTM model as follows. Parameters were optimized via Optuna. model = tf.keras.Sequential() model.add(tf.keras.layers.LSTM(25, return_sequences=True, input_shape=(5,5))) model.add(tf....
mospira's user avatar
  • 31
0 votes
1 answer
19 views

problem in use batchNormalization in the first layer with tensorflow 2.2

I need to use batchnormalization in the first layer and still use tensorflow 2.2, as the place where the trained network model will be sent has a tensorflow of 2.2 and cannot be updated. My code There ...
Fernando Augusto's user avatar
0 votes
0 answers
10 views

Understanding and Resolving Hanging Issue in NeuralProphet Code Execution

I am currently facing a perplexing problem while running a Python code snippet using the NeuralProphet library. Specifically, I am encountering a hang or unresponsive state in my code execution. ...
Tích Thiện Nguyễn's user avatar
0 votes
0 answers
21 views

Feature importance for neural networks?

I'm currently following this tutorial (https://keras.io/examples/graph/gat_node_classification/) to create a graph neural network using tensorflow keras. I was under the impression that graph ...
user17753's user avatar
0 votes
0 answers
10 views

Backpropagating Error Through a Trained Neural Network to Train Another Neural Network

I am reading Nguyen and Widrow’s 1990 paper “Neural networks for self-learning control systems.” I have a general understanding of the paper: a neural network (NN) is first trained to emulate an ...
SmartAutonomyLab's user avatar
0 votes
0 answers
38 views

Wrong Prediction on Dumping the ML model

I am trying to train a mlp model, data points are transformed to hashes and then passed to model... While training i am using the code: import pandas as pd import numpy as np from sklearn....
Aditya Bhat's user avatar
0 votes
0 answers
19 views

Why does accuracy score drop within a single batch?

On my neural network I’m passing a dataset of 10,000 rows in batches of 10 at a time, the average accuracy score of all the batches is 55-57%, however there is a pqttern within every single batch: the ...
Big Labronov's user avatar
1 vote
1 answer
31 views

Auto Encoder didn't improve my neural network loss

so I'm trying to improve my neural network result by using auto encoder for preprocessing. The data looks more or less like this : Column A Column B Column C Column D Target -70 -76 -76 -80 1 -93 -...
Secondary Juggernaut's user avatar
0 votes
0 answers
14 views

Trainin, saving and importing a Libtorch Neural Network in C++

I'm starting to get into neural networks in C++ using libtorch. I've created a simple game and trained a neural network with the Q learning method. I trained the network in a program, and now that I ...
Nicolas F's user avatar
  • 505
0 votes
1 answer
22 views

Problems plotting loss vs epochs for train and test data in MLPClassifier using sklean

I saw this code in the community to plot loss vs epochs using MLPClassifier. I think there is something is wrong in the code because the validation curve looks odd. Could someone give me an advice on ...
user14929029's user avatar
0 votes
0 answers
32 views

Invalid number in scalar divide

i'm trying to make a golf AI, but, after about 5 generations, when it is changing the weights, it says: main.py:109: RuntimeWarning: invalid value encountered in scalar divide wX = backward([...
pirosow's user avatar
  • 32
2 votes
1 answer
37 views

Keras LSTM for continuous output and with EarlyStopping

I wrote an LSTM regression model. It is a model with batch_size=1 and return_sequences = True for the last LSTM layer. I also set validation_data and patience for training. But there seem to be ...
蘇泳誌's user avatar
-1 votes
0 answers
16 views

Why does performance of a single hidden layer neural network on the training set decrease with increased number of neurons?

I am playing around with the MLPRegressor from the scikit learn library and want it to learn the sine function using a simple one hidden layer neural network trained with stochastic gradient descent. ...
Trailblazer's user avatar
0 votes
0 answers
39 views

Training a neural network without collapsing

I am trying to train a pytorch neural network to map from image space to 2D. I have the condition that I only want to use the ReLU activation function, linear layers, conv2d layers, and avgpool2d ...
CCole's user avatar
  • 1
0 votes
1 answer
34 views

How to multiply an embedding and mask with different dimensions in PyTorch?

In my forward method, I currently have a character embedding of size torch.Size([8,22,16]), where 8 represents the batch size, 22 represents the maximum character length of each word in my dataset, ...
as1092's user avatar
  • 1
0 votes
1 answer
18 views

How to create a weight adaptive network in keras?

I would like to make a simple model in keras with few dense layers where the weights and biases of the first layer can be created by another model. something similar to this paper but more simple, ...
curious's user avatar
-1 votes
0 answers
45 views

Error while using intel arc GPU for neural networks

i am getting this error File "D:\gputest\ann.py", line 50, in <module> y_pred=model.forward(X_train) ^^^^^^^^^^^^^^^^^^^^^^ File "D:\gputest\ann.py", line 26, in forward x=F....
Neelesh's user avatar

1
2 3 4 5
400