python – 麻烦运行Gensim LDA

我正在尝试运行分布式LDA示例,如下所述:

https://radimrehurek.com/gensim/dist_lda.html

我按照以下教程创建了一组文档:

https://radimrehurek.com/gensim/dist_lsi.html

通过“将文件扩展到1M文件,通过重复其文件”来表示

我正在使用python 3.3和numpy 1.9.2
我一直收到以下错误:

Exception in thread oneway-call:
Traceback (most recent call last):
  File "/usr/lib64/python3.3/threading.py", line 901, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.3/site-packages/Pyro4/core.py", line 1484, in run
    super(_OnewayCallThread, self).run()
  File "/usr/lib64/python3.3/threading.py", line 858, in run
    self._target(*self._args, **self._kwargs)
  File "/usr/lib64/python3.3/site-packages/gensim/models/lda_worker.py", line 71, in requestjob
    self.processjob(job)
  File "/usr/lib64/python3.3/site-packages/gensim/utils.py", line 98, in _synchronizer
    result = func(self, *args, **kwargs)
  File "/usr/lib64/python3.3/site-packages/gensim/models/lda_worker.py", line 80, in processjob
    self.model.do_estep(job)
  File "/usr/lib64/python3.3/site-packages/gensim/models/ldamodel.py", line 480, in do_estep
    gamma, sstats = self.inference(chunk, collect_sstats=True)
  File "/usr/lib64/python3.3/site-packages/gensim/models/ldamodel.py", line 423, in inference
    if doc and not isinstance(doc[0][0], six.integer_types):
ValueError: The truth value of an array with more than one element is ambiguous. Use a.any() or a.all()

我运行分布式lsi示例,它运行正常,但由于某种原因,我似乎无法使lda工作.

我尝试将/usr/lib64/python3.3/site-packages/gensim/models/ldamodel.py中的第423行更改为:

if doc is not None and not isinstance(doc[0][0], six.integer_types):

错误消失了,但我收到了警告

FutureWarning: comparison to `None` will result in an elementwise object comparison in the future.

有人能解释我做错了什么吗?我对此文件的更改是否正确?或者我应该以不同的方式运行LDA?

解决方法:

这是gensim中的一个bug,它被提升了here.

编辑 – 此问题现已在this pull request中解决.

上一篇:统计学习方法第二十章作业:潜在狄利克雷分配 LDA 吉布斯抽样法算法 代码实现


下一篇:LDA线性判别分析原理及python应用(葡萄酒案例分析)=好好的学习