TypeError:无法将Sparsetensor类型的对象转换为Tensor [英] TypeError: Failed to convert object of type Sparsetensor to Tensor
问题描述
我正在为imdb情绪分析数据集构建文本分类模型.我下载了数据集,并按照此处给出的教程进行操作- https://developers.google.com/machine-learning/guides/text-classification/step-4
I am building a text classification model for imdb sentiment analysis dataset. I downloaded the dataset and followed the tutorial given here - https://developers.google.com/machine-learning/guides/text-classification/step-4
我得到的错误是
TypeError: Failed to convert object of type <class 'tensorflow.python.framework.sparse_tensor.SparseTensor'> to Tensor. Contents: SparseTensor(indices=Tensor("DeserializeSparse:0", shape=(None, 2), dtype=int64), values=Tensor("DeserializeSparse:1", shape=(None,), dtype=float32), dense_shape=Tensor("stack:0", shape=(2,), dtype=int64)). Consider casting elements to a supported type.
x_train和x_val的类型为scipy.sparse.csr.csr_matrix.传递给顺序模型时,这会产生错误.该怎么解决?
the type of x_train and x_val are scipy.sparse.csr.csr_matrix. This give an error when passed to sequential model. How to solve?
import tensorflow as tf
import numpy as np
from tensorflow.python.keras.preprocessing import sequence
from tensorflow.python.keras.preprocessing import text
from sklearn.feature_extraction.text import TfidfVectorizer
from sklearn.feature_selection import SelectKBest
from sklearn.feature_selection import f_classif
# Vectorization parameters
# Range (inclusive) of n-gram sizes for tokenizing text.
NGRAM_RANGE = (1, 2)
# Limit on the number of features. We use the top 20K features.
TOP_K = 20000
# Whether text should be split into word or character n-grams.
# One of 'word', 'char'.
TOKEN_MODE = 'word'
# Minimum document/corpus frequency below which a token will be discarded.
MIN_DOCUMENT_FREQUENCY = 2
# Limit on the length of text sequences. Sequences longer than this
# will be truncated.
MAX_SEQUENCE_LENGTH = 500
def ngram_vectorize(train_texts, train_labels, val_texts):
"""Vectorizes texts as ngram vectors.
1 text = 1 tf-idf vector the length of vocabulary of uni-grams + bi-grams.
# Arguments
train_texts: list, training text strings.
train_labels: np.ndarray, training labels.
val_texts: list, validation text strings.
# Returns
x_train, x_val: vectorized training and validation texts
"""
# Create keyword arguments to pass to the 'tf-idf' vectorizer.
kwargs = {
'ngram_range': NGRAM_RANGE, # Use 1-grams + 2-grams.
'dtype': 'int32',
'strip_accents': 'unicode',
'decode_error': 'replace',
'analyzer': TOKEN_MODE, # Split text into word tokens.
'min_df': MIN_DOCUMENT_FREQUENCY,
}
vectorizer = TfidfVectorizer(**kwargs)
# Learn vocabulary from training texts and vectorize training texts.
x_train = vectorizer.fit_transform(train_texts)
# Vectorize validation texts.
x_val = vectorizer.transform(val_texts)
# Select top 'k' of the vectorized features.
selector = SelectKBest(f_classif, k=min(TOP_K, x_train.shape[1]))
selector.fit(x_train, train_labels)
x_train = selector.transform(x_train)
x_val = selector.transform(x_val)
x_train = x_train.astype('float32')
x_val = x_val.astype('float32')
return x_train, x_val
推荐答案
There's a similar open issue that you can find here.
建议的解决方案是使用Tensorflow版本2.1.0和Keras版本2.3.1.
Solution proposed is use Tensorflow version 2.1.0 and Keras version 2.3.1.
这篇关于TypeError:无法将Sparsetensor类型的对象转换为Tensor的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!