酸洗错误:不能酸洗<type 'function'>

2022-01-12 00:00:00 python numpy multiprocessing pickle core

问题描述

我想知道这个错误可能意味着什么:

I am wondering what this error might mean:

PicklingError: Can't pickle <type 'function'>: attribute lookup __builtin__.function failed

我知道这与使用多核有关.我在集群上运行我的程序,并在我的这行代码中使用了 15 个线程:

I understand that it has something to do with using multiple cores. I am running my program on a cluster and using 15 threads in this line of my code:

gauss2 = PTSampler(ntemps, renwalkers, rendim, lnlike, lnprior, threads=15)

有问题的采样器是在 http:///dan.iel.fm/emcee/current/user/pt/

知道这个错误可能意味着什么吗?

Any idea what this error might mean?


解决方案

这个错误意味着你试图腌制一个内置的 FunctionType……而不是函数本身.这可能是由于某个地方的编码错误导致了函数的类而不是函数本身.

The error means you are trying to pickle a builtin FunctionType… not the function itself. It's likely do to a coding error somewhere picking up the class of the function instead of the function itself.

>>> import sys
>>> import pickle
>>> import types
>>> types.FunctionType
<type 'function'>
>>> try:
...     pickle.dumps(types.FunctionType)
... except:
...     print sys.exc_info()[1]
... 
Can't pickle <type 'function'>: it's not found as __builtin__.function
>>> def foo(x):
...   return x
... 
>>> try:
...     pickle.dumps(type(foo))
... except:
...     print sys.exc_info()[1]
... 
Can't pickle <type 'function'>: it's not found as __builtin__.function
>>> try:
...     pickle.dumps(foo.__class__)
... except:
...     print sys.exc_info()[1]
... 
Can't pickle <type 'function'>: it's not found as __builtin__.function
>>> pickle.dumps(foo)
'c__main__
foo
p0
.'
>>> pickle.dumps(foo, -1)
'x80x02c__main__
foo
qx00.'

如果您有一个 FunctionType 对象,那么您需要做的就是获取该类的一个实例——即像 foo 这样的函数.

If you have a FunctionType object, then all you need to do is get one of the instances of that class -- i.e. a function like foo.

相关文章