Questions tagged [tensorflow-model-analysis]

TensorFlow Model Analysis (TFMA) is a library for evaluating TensorFlow models. It allows users to evaluate their models on large amounts of data in a distributed fashion, using the same metrics defined in their trainer. These metrics can also be computed over different slices of data, and the results can be visualized in Jupyter Notebooks.

Filter by
Sorted by
Tagged with
0 votes
0 answers
12 views

Render_plot is failing

System information I have used stock example script provided in TensorFlow Model Analysis: https://github.com/tensorflow/tfx/blob/master/docs/tutorials/model_analysis/tfma_basic.ipynb OS Platform and ...
sroy's user avatar
  • 1
1 vote
0 answers
73 views

Tensorflow Fairness Indicators for Multiclass output

According to the github page for tensorflow fairness-indicators : Fairness Indicators enables easy computation of commonly-identified fairness metrics for binary and multiclass classifiers. However, ...
Saurabh Verma's user avatar
1 vote
1 answer
2k views

TFX Tensorflow model validator component - You passed a data dictionary with keys ['image_raw_xf']. Expected the following keys: ['input_1']

I'm building a tfx pipeline based on the cifar10 example : [https://github.com/tensorflow/tfx/tree/master/tfx/examples/cifar10] The difference is that I don't want to convert it to tf_lite model and ...
Juan Acevedo's user avatar
  • 1,778
3 votes
0 answers
268 views

tfma.view.render_plot() won't render in Jupyter, getting 404 on GET /static/tensorflow_model-analysis.js?v=2020103020382

I'm not getting tfma.view.render_plot to render plots with: tfma.view.render_plot(result) or tfma.view.render_time_series note that tfma.view.render_slicing_metrics does work.. I suspect it's related ...
Jason Anderson's user avatar
0 votes
1 answer
955 views

TFX Pipeline Error While Executing TFMA: AttributeError: 'NoneType' object has no attribute 'ToBatchTensors'

Basically I only reused code from iris utils and iris pipeline with minor change on serving input: def _get_serve_tf_examples_fn(model, tf_transform_output): model.tft_layer = ...
suisen's user avatar
  • 53
2 votes
1 answer
757 views

How to make a custom metric available to TFMA/Beam?

I have created a custom Keras metric, similar to the demo implementation below: import tensorflow as tf class MyMetric(tf.keras.metrics.Mean): def __init__(self, name='my_metric', dtype=None): ...
neurix's user avatar
  • 4,196
0 votes
1 answer
485 views

Run TFMA for Keras models without compiling

I am training a Keras model using custom training loops in TensorFlow, where the weights are updated using gradient tape rather than the model.fit() method. As such, the model is not compiled before ...
andre's user avatar
  • 41
0 votes
1 answer
2k views

how to fix "Command errored out with exit status 1"

I'm trying to install it on colab notebook. The command I tried is : pip install models It's giving me error as: Collecting models Using cached https://files.pythonhosted.org/packages/92/3c/...
Sonali Jadhav's user avatar
1 vote
0 answers
250 views

Unable to find pip package

I have been using bazel build for my im2txt model from TensorFlow and it shows me ModuleNotFoundError: No module named 'nltk' I have installed the package nltk and tried to even create an ...
user avatar
0 votes
1 answer
140 views

tensorflow-model-analysis release 0.13.2 and 0.13.1 does not run in python2

I downloaded tfma source code 0.13.2 and ran it in jupyter notebook locally with python2, and it does not work Working code: import tensorflow as tf import third_party.tensorflow_model_analysis....
Zixun Zhang's user avatar
2 votes
0 answers
400 views

tfma.view.render_slicing_metrics not working

I am trying to visualize model results using tfma.view.render_slicing_metrics. I am getting the results with tfma.load_eval_result(tfma_artifact.uri) and I am able to print the results. [EvalResult(...
Rathna Subramanian.T.A's user avatar
4 votes
1 answer
976 views

Tensorflow model analysis, TFMA for keras model

I would like to use TFMA with keras model. The keras model was created with TF 2.0 alpha. The model is a pretrained model with a classification layer: ...
eilalan's user avatar
  • 679
3 votes
1 answer
4k views

Keras + Tensorflow Model Optimization: TypeError: clone_model() got an unexpected keyword argument 'clone_function'

I'm trying Tensorflow Model Optimization in order to prune a simple Neural Network. Here's my code: from __future__ import absolute_import, division, print_function, unicode_literals, ...
razimbres's user avatar
  • 4,824
7 votes
1 answer
442 views

What happens if tf.stop_gradient is not set?

I am reading the faster-rcnn code of tensorflow models. I am confused with the use of tf.stop_gradient. Consider the following code snippet: if self._is_training: proposal_boxes = tf....
tidy's user avatar
  • 4,807
0 votes
1 answer
269 views

how to resolve install problem with tensorflow-model-analysis using jupyterlab notebook?

I am trying to follow the guide on this link but I get an error on the second step for enabling TFMA visualization in Jupyter Notebook. I assume this is something you do in a cell?
netskink's user avatar
  • 4,189
2 votes
2 answers
112 views

Which model should i use for tensorflow (contrib or models)?

For example if i want to use renset_v2, there are two model file on tensorflow: one is here, another is here. Lots of tensorflow model are both in models/research and tensorflow/contrib. I am very ...
tidy's user avatar
  • 4,807
0 votes
2 answers
470 views

installing tensorflow-model-analysis on Google Cloud datalab

I am running the followoing command: !pip install tesnorflow-model-analysis and receiving the following error: Collecting tesnorflow-model-analysis Could not find a version that satisfies the ...
eilalan's user avatar
  • 679
0 votes
1 answer
1k views

ImportError: import tensorflow_model_analysis as tfma [ PYTHON on datalab]

I would like to add model analysis to my model but was unable to import the libraries: I am using datalab environment. import tensorflow as tf !pip install tensorflow_model_analysis import ...
eilalan's user avatar
  • 679
0 votes
0 answers
376 views

Asking for help about tensorflow " models mobilenet_v1_0.5_128 " / " mobilenet_v1_1.0_224 "

I want to train my custom model using the pretained model " mobilenet_v1_0.5_128 " / " mobilenet_v1_1.0_224 " from tensorflow downloaded at: download.tensorflow.org/models/mobilenet_v1_2018_08_02/...
EE2017's user avatar
  • 59
1 vote
1 answer
227 views

Tensorflow Custom Object Detection Training Speed

I tried to train a frcnn for detecting money it has 3 classes. I used this link https://github.com/EdjeElectronics/TensorFlow-Object-Detection-API-Tutorial-Train-Multiple-Objects-Windows-10 to ...
trabz's user avatar
  • 7
0 votes
0 answers
593 views

ModuleNotFoundError: No module named '_tkinter'

I'm trying to eval my model trained with tensorflow object detection api. Run: python eval.py --logtostderr --pipeline_config_path=ssd_inception_v2_coco.config --checkpoint_dir=models/train/ --...
Evgeniya Tveritinova's user avatar
3 votes
2 answers
478 views

How to convert a saved_model.pb to EvalSavedModel?

I was going through the tensorflow-model-analysis documentation evaluating TensorFlow models. The getting started guide talks about a special SavedModel called the EvalSavedModel. Quoting the getting ...
Jash Shah's user avatar
  • 2,084
0 votes
1 answer
339 views

How can I evaluate the performance of my TensorFlow model on specific slices of a large dataset?

How can I evaluate the performance of my TensorFlow model on specific slices (segments) of a large evaluation dataset?
Jarek Wilkiewicz's user avatar