什么可能导致python模块导入两次？ [英] What could cause a python module to be imported twice?

问题描述

据我所知，python模块永远不会导入两次，即模块中的代码仅在第一次导入时执行。后续的import语句只是将模块添加到导入范围。

As far as I understand, a python module is never imported twice, i.e. the code in the module only gets executed the first time it is imported. Subsequent import statements just add the module to the scope of the import.

我有一个名为TiledConvC3D.py的模块，似乎多次导入。我使用pdb在这个模块的代码顶部打印堆栈。

I have a module called "TiledConvC3D.py" that seems to be imported multiple times though. I use pdb to print the stack at the top of the code for this module.

这是从第一次执行模块开始的堆栈跟踪结束：

Here is the end of the stack trace from the first time the module is executed:

File "<anonymized>/python_modules/Theano/theano/gof/cmodule.py", line 328, in refresh
  key = cPickle.load(open(key_pkl, 'rb'))
File "<anonymized>/ops/TiledConvG3D.py", line 565, in <module>
  import TiledConvC3D
File "<anonymized>/ops/TiledConvC3D.py", line 18, in <module>
  pdb.traceback.print_stack()

它继续被执行多次。但是，第二次调用它的完整堆栈跟踪不会显示对 reload 的任何调用，因此不应执行这些执行：

It goes on to be executed several more times. However, the complete stack trace for the second time it is called does not show any calls to reload, so these executions should not be occurring:

File "sup_train_conj_grad.py", line 103, in <module>
  dataset = Config.get_dataset(dataset_node)
File "<anonymized>/Config.py", line 279, in get_dataset
  from datasets import NewWiskott
File "<anonymized>/datasets/NewWiskott.py", line 16, in <module>
  normalizer_train = video.ContrastNormalizer3D(sigma, global_per_frame = False, input_is_5d = True)
File "<anonymized>/util/video.py", line 204, in __init__
  self.f = theano.function([input],output)
File "<anonymized>/python_modules/Theano/theano/compile/function.py", line 105, in function
  allow_input_downcast=allow_input_downcast)
File "<anonymized>/python_modules/Theano/theano/compile/pfunc.py", line 270, in pfunc
  accept_inplace=accept_inplace, name=name)
File "<anonymized>/python_modules/Theano/theano/compile/function_module.py", line 1105, in orig_function
  fn = Maker(inputs, outputs, mode, accept_inplace = accept_inplace).create(defaults)
File "/u/goodfeli/python_modules/Theano/theano/compile/function_module.py", line 982, in create
  _fn, _i, _o = self.linker.make_thunk(input_storage = input_storage_lists)
File "<anonymized>/python_modules/Theano/theano/gof/link.py", line 321, in make_thunk
  output_storage = output_storage)[:3]
File "<anonymized>/python_modules/Theano/theano/gof/cc.py", line 1178, in make_all
  output_storage = node_output_storage)
File "<anonymized>/python_modules/Theano/theano/gof/cc.py", line 774, in make_thunk
  cthunk, in_storage, out_storage, error_storage = self.__compile__(input_storage, output_storage)
File "<anonymized>/python_modules/Theano/theano/gof/cc.py", line 723, in __compile__
  output_storage)
File "<anonymized>/python_modules/Theano/theano/gof/cc.py", line 1037, in cthunk_factory
  module = get_module_cache().module_from_key(key=key, fn=self.compile_cmodule)
File "<anonymized>/python_modules/Theano/theano/gof/cc.py", line 59, in get_module_cache
  return cmodule.get_module_cache(config.compiledir)
File "<anonymized>/python_modules/Theano/theano/gof/cmodule.py", line 576, in get_module_cache
  _module_cache = ModuleCache(dirname, force_fresh=force_fresh)
File "<anonymized>/python_modules/Theano/theano/gof/cmodule.py", line 268, in __init__
  self.refresh()
File "<anonymized>/python_modules/Theano/theano/gof/cmodule.py", line 326, in refresh
  key = cPickle.load(open(key_pkl, 'rb'))
File "<anonymized>/ops/TiledConvV3D.py", line 504, in <module>
  import TiledConvG3D
File "<anonymized>/ops/TiledConvG3D.py", line 565, in <module>
  import TiledConvC3D
File "<anonymized>/ops/TiledConvC3D.py", line 22, in <module>
  pdb.traceback.print_stack()

此外，我还检查<$的ID c $ c> __ builtin __.__ import __ 。在我的主脚本的最开始，我导入 __ builtin __ 并打印 id（__ builtin __.__ import __）然后再做其他任何其他操作进口。我还从我的模块中打印多次导入 id（__ builtin __。import __），并且id的值不会改变。

Moreover, I also check the id of __builtin__.__import__ . At the very start of my main script, I import __builtin__ and print id(__builtin__.__import__) before doing any other imports. I also print id(__builtin__.import__) from inside my module that is being imported multiple times, and the value of the id does not change.

除了调用重载和覆盖 __ builtin __.__ import __ 之外还有其他机制可以解释我的模块多次加载吗？

Are there other mechanisms besides calling reload and overriding __builtin__.__import__ that could explain my module getting loaded multiple times?

推荐答案

如果在路径中找到模块两次，则可以导入两次Python模块。例如，假设您的项目布局如下：

A Python module can be imported twice if the module is found twice in the path. For example, say your project is laid out like so:

• src /
  
  
  
  • package1 /
    
    
    
    • spam.py
    
    
    • eggs.py
    
    

    假设您的PYTHONPATH（sys.path）包含src和src / package1：

    Suppose your PYTHONPATH (sys.path) includes src and src/package1:

    PYTHONPATH=/path/to/src:/path/to/src/package1
    

    如果是这种情况，你可以像这样两次导入同一个模块：

    If that's the case, you can import the same module twice like this:

    from package1 import spam
    import spam
    

    Python会认为它们不同模块。这是怎么回事？

    And Python will think they are different modules. Is that what's going on?

    另外，根据下面的讨论（对于搜索此问题的用户），模块可以导入两次的另一种方式是中途是否有异常通过第一次进口。例如，如果垃圾邮件导入鸡蛋，但导入鸡蛋导致模块内的异常，则可以再次导入。

    Also, per the discussion below (for users searching this question), another way a module can be imported twice is if there is an exception midway through the first import. For example, if spam imports eggs, but importing eggs results in an exception inside the module, it can be imported again.

    这篇关于什么可能导致python模块导入两次？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！