ICode9

精准搜索请尝试: 精确搜索
首页 > 其他分享> 文章详细

TensorFlow DeepLab教程初稿-tensorflow gpu安装教程

2019-07-24 19:52:32  阅读:608  来源: 互联网

标签:DeepLab 教程 lib py site tensorflow gpu packages


TensorFlow DeepLab教程初稿-tensorflow gpu安装教程

商务合作,科技咨询,版权转让:向日葵,135—4855__4328,xiexiaokui#qq.com

Summary: DeepLab需要1.10以上版本。

本日志详细记录在两台不同笔记本电脑安装/更新 TensorFlow-GPU的具体过程

这是本人第3次,4次安装tf,这两次是gpu版。

第一次是安装cpu版,第二次是在python2.7 arcpy环境下安装32位 tf,但不能运行。第三次安装成功,但电脑配置过低,只能使用cpu功能;第四次安装成功,可以正确运行,使用gpu。

向日葵2019年7月24日于长沙

Confirm tensorflow installed correctly

>>> import tensorflow as tf

>>> hello=tf.constant("Hello tf")

>>> tf.Session().run(hello)

b'Hello tf'

 

查看tf版本

C:\Users\think>python --version

Python 3.6.7 :: Anaconda custom (64-bit)

 

Anaconda3 (3.6, 64-bit) interactive window [PTVS 16.0.19074.1-16.0]

Type $help for a list of commands.

>>> import tensorflow as tf

>>> tf.VERSION

'1.12.0'

>>>

 

>>> tf.__version__

'1.12.0'

 

查看CPU GPU版本

import os

from tensorflow.python.client import device_lib

os.environ["TF_CPP_MIN_LOG_LEVEL"]="99"

device_lib.list_local_devices()

 

[name: "/device:CPU:0"

device_type: "CPU"

memory_limit: 268435456

locality {

}

incarnation: 5642870862507944

]

>>> if __name__ == "main":

... print(device_lib.list_local_devices)

...

>>>

 

查看python安装路径

>>> import sys

>>> sys.path

['.', 'D:\\ProgramData\\Anaconda3\\', 'd:\\ProgramData\\Anaconda3\\python36.zip', 'd:\\ProgramData\\Anaconda3\\DLLs', 'd:\\ProgramData\\Anaconda3\\lib', 'd:\\ProgramData\\Anaconda3', 'd:\\ProgramData\\Anaconda3\\lib\\site-packages', 'd:\\ProgramData\\Anaconda3\\lib\\site-packages\\win32', 'd:\\ProgramData\\Anaconda3\\lib\\site-packages\\win32\\lib', 'd:\\ProgramData\\Anaconda3\\lib\\site-packages\\Pythonwin']

 

>>> import os

>>> os.path

<module 'ntpath' from 'd:\\ProgramData\\Anaconda3\\lib\\ntpath.py'>

Python.exe的路径:

"D:\ProgramData\Anaconda3\python.exe"

 

 

更新为gpu版本

Type cmd to enter dos command line and type:

pip3 install --ignore-installed --upgrade tensorflow-gpu

 

C:\Users\think>pip3 install --ignore-installed --upgrade tensorflow-gpu

Collecting tensorflow-gpu

Downloading https://files.pythonhosted.org/packages/c7/e8/f7ba3acc4e45bea553ef085846e0240daa71986a04e1819bafef569f055b/tensorflow_gpu-1.14.0-cp36-cp36m-win_amd64.whl (287.7MB)

 

由于空间原因,安装失败。

Installing collected packages: astor, wheel, wrapt, six, setuptools, protobuf, numpy, google-pasta, termcolor, grpcio, h5py, keras-applications, absl-py, keras-preprocessing, gast, tensorflow-estimator, markdown, werkzeug, tensorboard, tensorflow-gpu

Could not install packages due to an EnvironmentError: [Errno 28] No space left on device

重输入命令,可以续装,自动使用缓存。

 

tensorflow 1.12.0 has requirement tensorboard<1.13.0,>=1.12.0, but you'll have tensorboard 1.14.0 which is incompatible.

 

Installing collected packages: six, setuptools, protobuf, numpy, h5py, keras-applications, absl-py, grpcio, tensorflow-estimator, termcolor, google-pasta, wrapt, wheel, gast, werkzeug, markdown, tensorboard, astor, keras-preprocessing, tensorflow-gpu

Successfully installed absl-py-0.7.1 astor-0.8.0 gast-0.2.2 google-pasta-0.1.7 grpcio-1.22.0 h5py-2.9.0 keras-applications-1.0.8 keras-preprocessing-1.1.0 markdown-3.1.1 numpy-1.16.4 protobuf-3.9.0 setuptools-41.0.1 six-1.12.0 tensorboard-1.14.0 tensorflow-estimator-1.14.0 tensorflow-gpu-1.14.0 termcolor-1.1.0 werkzeug-0.15.5 wheel-0.33.4 wrapt-1.11.2

 

尝试卸载

C:\Users\think>pip3 uninstall tensorflow

Uninstalling tensorflow-1.12.0:

Would remove:

d:\programdata\anaconda3\lib\site-packages\tensorflow-1.12.0.dist-info\*

 

Proceed (y/n)? y

Successfully uninstalled tensorflow-1.12.0

成功卸载

 

重新尝试安装gpu版本:

C:\Users\think>pip3 install --ignore-installed --upgrade tensorflow-gpu

Collecting tensorflow-gpu

Using cached https://files.pythonhosted.org/packages/c7/e8/f7ba3acc4e45bea553ef085846e0240daa71986a04e1819bafef569f055b/tensorflow_gpu-1.14.0-cp36-cp36m-win_amd64.whl

 

开始使用缓存安装

结果TensorFlow-gpu 安装成功

 

测试tf

C:\Users\think>python

Python 3.6.7 |Anaconda custom (64-bit)| (default, Oct 28 2018, 19:44:12) [MSC v.1915 64 bit (AMD64)] on win32

Type "help", "copyright", "credits" or "license" for more information.

>>> import tensorflow as tf

D:\ProgramData\Anaconda3\lib\site-packages\numpy\core\__init__.py:29: UserWarning: loaded more than 1 DLL from .libs:

D:\ProgramData\Anaconda3\lib\site-packages\numpy\.libs\libopenblas.CSRRD7HKRKC3T3YXA7VY7TAZGLSWDKW6.gfortran-win_amd64.dll

D:\ProgramData\Anaconda3\lib\site-packages\numpy\.libs\libopenblas.TXA6YQSD3GCQQC22GEQ54J2UDCXDXHWN.gfortran-win_amd64.dll

stacklevel=1)

Traceback (most recent call last):

File "<stdin>", line 1, in <module>

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\__init__.py", line 28, in <module>

from tensorflow.python import pywrap_tensorflow # pylint: disable=unused-import

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\__init__.py", line 47, in <module>

import numpy as np

File "D:\ProgramData\Anaconda3\lib\site-packages\numpy\__init__.py", line 142, in <module>

from . import core

File "D:\ProgramData\Anaconda3\lib\site-packages\numpy\core\__init__.py", line 91, in <module>

raise ImportError(msg.format(path))

ImportError: Something is wrong with the numpy installation. While importing we detected an older version of numpy in ['D:\\ProgramData\\Anaconda3\\lib\\site-packages\\numpy']. One method of fixing this is to repeatedly uninstall numpy until none is found, then reinstall this version.

 

Uninstall numpy

C:\Users\think>pip3 uninstall numpy

Uninstalling numpy-1.16.4:

Would remove:

d:\programdata\anaconda3\lib\site-packages\numpy-1.16.4.dist-info\*

d:\programdata\anaconda3\lib\site-packages\numpy\*

d:\programdata\anaconda3\scripts\f2py.exe

Would not remove (might be manually added):

d:\programdata\anaconda3\lib\site-packages\numpy\.libs\libopenblas.CSRRD7HKRKC3T3YXA7VY7TAZGLSWDKW6.gfortran-win_amd64.dll

d:\programdata\anaconda3\lib\site-packages\numpy\_import_tools.py

d:\programdata\anaconda3\lib\site-packages\numpy\_mklinit.cp36-win_amd64.pyd

d:\programdata\anaconda3\lib\site-packages\numpy\add_newdocs.py

d:\programdata\anaconda3\lib\site-packages\numpy\core\multiarray.cp36-win_amd64.pyd

d:\programdata\anaconda3\lib\site-packages\numpy\core\umath.cp36-win_amd64.pyd

d:\programdata\anaconda3\lib\site-packages\numpy\distutils\environment.py

d:\programdata\anaconda3\lib\site-packages\numpy\distutils\site.cfg

d:\programdata\anaconda3\lib\site-packages\numpy\random_intel\__init__.py

d:\programdata\anaconda3\lib\site-packages\numpy\random_intel\setup.py

d:\programdata\anaconda3\lib\site-packages\numpy\testing\_private\pytesttester.py

Proceed (y/n)? y

Successfully uninstalled numpy-1.16.4

 

Install numpy

C:\Users\think>pip3 install numpy

Requirement already satisfied: numpy in d:\programdata\anaconda3\lib\site-packages (1.15.4)

 

测试tf

>>> import tensorflow as tf

Traceback (most recent call last):

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\platform\self_check.py", line 75, in preload_check

ctypes.WinDLL(build_info.cudart_dll_name)

File "D:\ProgramData\Anaconda3\lib\ctypes\__init__.py", line 348, in __init__

self._handle = _dlopen(self._name, mode)

OSError: [WinError 126] The specified module could not be found

 

During handling of the above exception, another exception occurred:

 

Traceback (most recent call last):

File "<stdin>", line 1, in <module>

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\__init__.py", line 28, in <module>

from tensorflow.python import pywrap_tensorflow # pylint: disable=unused-import

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\__init__.py", line 49, in <module>

from tensorflow.python import pywrap_tensorflow

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 30, in <module>

self_check.preload_check()

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\platform\self_check.py", line 82, in preload_check

% (build_info.cudart_dll_name, build_info.cuda_version_number))

ImportError: Could not find 'cudart64_100.dll'. TensorFlow requires that this DLL be installed in a directory that is named in your %PATH% environment variable. Download and install CUDA 10.0 from this URL: https://developer.nvidia.com/cuda-90-download-archive(tf提示错误:应为https://developer.nvidia.com/cuda-100-download-archive)

结果:

1. 找不到cuda v10.0

2. tf安装程序的提示版本错误,但提示的dll版本信息是正确的。

由于已经安装了最新版的cuda,查看版本及文件名

G:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.1\bin

cudart64_101.dll

 

 

结果:已安装cuda版本过高。

重新安装cuda v10.0

查看环境变量:

path

G:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\V10.0\bin

G:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\V10.0\libnvvp

 

CUDA_PATH

G:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\V10.0

 

CUDA_PATH_V10_0

G:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\V10.0

 

 

Test tensorflow

>>> import tensorflow as tf

Traceback (most recent call last):

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 58, in <module>

from tensorflow.python.pywrap_tensorflow_internal import *

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 28, in <module>

_pywrap_tensorflow_internal = swig_import_helper()

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 24, in swig_import_helper

_mod = imp.load_module('_pywrap_tensorflow_internal', fp, pathname, description)

File "D:\ProgramData\Anaconda3\lib\imp.py", line 243, in load_module

return load_dynamic(name, filename, file)

File "D:\ProgramData\Anaconda3\lib\imp.py", line 343, in load_dynamic

return _load(spec)

ImportError: DLL load failed: The specified procedure could not be found.

 

During handling of the above exception, another exception occurred:

 

Traceback (most recent call last):

File "<stdin>", line 1, in <module>

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\__init__.py", line 28, in <module>

from tensorflow.python import pywrap_tensorflow # pylint: disable=unused-import

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\__init__.py", line 49, in <module>

from tensorflow.python import pywrap_tensorflow

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 74, in <module>

raise ImportError(msg)

ImportError: Traceback (most recent call last):

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 58, in <module>

from tensorflow.python.pywrap_tensorflow_internal import *

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 28, in <module>

_pywrap_tensorflow_internal = swig_import_helper()

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 24, in swig_import_helper

_mod = imp.load_module('_pywrap_tensorflow_internal', fp, pathname, description)

File "D:\ProgramData\Anaconda3\lib\imp.py", line 243, in load_module

return load_dynamic(name, filename, file)

File "D:\ProgramData\Anaconda3\lib\imp.py", line 343, in load_dynamic

return _load(spec)

ImportError: DLL load failed: The specified procedure could not be found.

 

 

Failed to load the native TensorFlow runtime.

 

See https://www.tensorflow.org/install/errors

 

for some common reasons and solutions. Include the entire stack trace

above this error message when asking for help.

 

Reinstall cudnn

安装cuDNN

官网下载好后可以直接解压文件夹。然后将这个文件夹下的文件按照如下操作复制到CUDA路径下:

 

Copy  <installpath>\cuda\bin\cudnn64_*.dll     to    C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\ v10.0\bin.

Copy  <installpath>\cuda\ include\cudnn.h    to    C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\ v10.0\include.

Copy  <installpath>\cuda\lib\x64\cudnn.lib    to    C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.0\lib\x64.

 

测试:

>>> import tensorflow as tf

Traceback (most recent call last):

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 58, in <module>

from tensorflow.python.pywrap_tensorflow_internal import *

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 28, in <module>

_pywrap_tensorflow_internal = swig_import_helper()

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 24, in swig_import_helper

_mod = imp.load_module('_pywrap_tensorflow_internal', fp, pathname, description)

File "D:\ProgramData\Anaconda3\lib\imp.py", line 243, in load_module

return load_dynamic(name, filename, file)

File "D:\ProgramData\Anaconda3\lib\imp.py", line 343, in load_dynamic

return _load(spec)

ImportError: DLL load failed: The specified procedure could not be found.

 

During handling of the above exception, another exception occurred:

 

Traceback (most recent call last):

File "<stdin>", line 1, in <module>

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\__init__.py", line 28, in <module>

from tensorflow.python import pywrap_tensorflow # pylint: disable=unused-import

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\__init__.py", line 49, in <module>

from tensorflow.python import pywrap_tensorflow

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 74, in <module>

raise ImportError(msg)

ImportError: Traceback (most recent call last):

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow.py", line 58, in <module>

from tensorflow.python.pywrap_tensorflow_internal import *

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 28, in <module>

_pywrap_tensorflow_internal = swig_import_helper()

File "D:\ProgramData\Anaconda3\lib\site-packages\tensorflow\python\pywrap_tensorflow_internal.py", line 24, in swig_import_helper

_mod = imp.load_module('_pywrap_tensorflow_internal', fp, pathname, description)

File "D:\ProgramData\Anaconda3\lib\imp.py", line 243, in load_module

return load_dynamic(name, filename, file)

File "D:\ProgramData\Anaconda3\lib\imp.py", line 343, in load_dynamic

return _load(spec)

ImportError: DLL load failed: The specified procedure could not be found.

 

 

Failed to load the native TensorFlow runtime.

 

See https://www.tensorflow.org/install/errors

 

for some common reasons and solutions. Include the entire stack trace

above this error message when asking for help.

结果:依然出错

卸载

C:\Users\think>pip3 uninstall tensorflow-gpu

Uninstalling tensorflow-gpu-1.14.0:

Would remove:

d:\programdata\anaconda3\lib\site-packages\tensorflow\*

d:\programdata\anaconda3\lib\site-packages\tensorflow_gpu-1.14.0.dist-info\*

d:\programdata\anaconda3\scripts\freeze_graph.exe

d:\programdata\anaconda3\scripts\saved_model_cli.exe

d:\programdata\anaconda3\scripts\tensorboard.exe

d:\programdata\anaconda3\scripts\tf_upgrade_v2.exe

d:\programdata\anaconda3\scripts\tflite_convert.exe

d:\programdata\anaconda3\scripts\toco.exe

d:\programdata\anaconda3\scripts\toco_from_protos.exe

 

Run python3.7 installed with vs

pythonpath

C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64

 

C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\Scripts

 

 

重装

C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\Scripts>pip3 install tensorflow-gpu

Collecting tensorflow-gpu

Downloading https://files.pythonhosted.org/packages/81/d1/9222b9aac2fa27dccaef38917cde84c24888f3cd0dd139c7e12be9f49a7a/tensorflow_gpu-1.14.0-cp37-cp37m-win_amd64.whl (287.7MB)

 

Installing collected packages: tensorflow-estimator, google-pasta, numpy, six, grpcio, astor, wheel, wrapt, gast, absl-py, setuptools, werkzeug, protobuf, markdown, tensorboard, h5py, keras-applications, keras-preprocessing, termcolor, tensorflow-gpu

Could not install packages due to an EnvironmentError: [WinError 5] Access is denied: 'c:\\program files (x86)\\microsoft visual studio\\shared\\python37_64\\Lib\\site-packages\\tensorflow_estimator'

Consider using the `--user` option or check the permissions.

 

You are using pip version 18.1, however version 19.2.1 is available.

You should consider upgrading via the 'python -m pip install --upgrade pip' command.

 

 

更新pip

结果:失败

C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64>python -m pip install --upgrade pip

Collecting pip

Downloading https://files.pythonhosted.org/packages/62/ca/94d32a6516ed197a491d17d46595ce58a83cbb2fca280414e57cd86b84dc/pip-19.2.1-py2.py3-none-any.whl (1.4MB)

100% |████████████████████████████████| 1.4MB 6.0MB/s

Installing collected packages: pip

Found existing installation: pip 18.1

Uninstalling pip-18.1:

Could not install packages due to an EnvironmentError: [WinError 5] Access is denied: 'c:\\program files (x86)\\microsoft visual studio\\shared\\python37_64\\lib\\site-packages\\pip-18.1.dist-info\\entry_points.txt'

Consider using the `--user` option or check the permissions.

 

You are using pip version 18.1, however version 19.2.1 is available.

You should consider upgrading via the 'python -m pip install --upgrade pip' command.

 

设置所有权限

重新更新pip

结果:成功

C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64>python -m pip install --upgrade pip

Collecting pip

Using cached https://files.pythonhosted.org/packages/62/ca/94d32a6516ed197a491d17d46595ce58a83cbb2fca280414e57cd86b84dc/pip-19.2.1-py2.py3-none-any.whl

Installing collected packages: pip

Found existing installation: pip 18.1

Uninstalling pip-18.1:

Successfully uninstalled pip-18.1

Successfully installed pip-19.2.1

 

 

重新安装tf-gpu

C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64>cd C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\Scripts

 

C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\Scripts>pip3 install tensorflow-gpu

Collecting tensorflow-gpu

Using cached https://files.pythonhosted.org/packages/81/d1/9222b9aac2fa27dccaef38917cde84c24888f3cd0dd139c7e12be9f49a7a/tensorflow_gpu-1.14.0-cp37-cp37m-win_amd64.whl

 

WARNING: The script f2py.exe is installed in 'c:\program files (x86)\microsoft visual studio\shared\python37_64\Scripts' which is not on PATH.

Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.

Running setup.py install for wrapt ... done

Found existing installation: setuptools 40.6.2

Uninstalling setuptools-40.6.2:

Successfully uninstalled setuptools-40.6.2

WARNING: The script wheel.exe is installed in 'c:\program files (x86)\microsoft visual studio\shared\python37_64\Scripts' which is not on PATH.

Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.

Running setup.py install for absl-py ... done

WARNING: The script markdown_py.exe is installed in 'c:\program files (x86)\microsoft visual studio\shared\python37_64\Scripts' which is not on PATH.

Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.

WARNING: The script tensorboard.exe is installed in 'c:\program files (x86)\microsoft visual studio\shared\python37_64\Scripts' which is not on PATH.

Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.

Running setup.py install for termcolor ... done

Running setup.py install for gast ... done

WARNING: The scripts freeze_graph.exe, saved_model_cli.exe, tensorboard.exe, tf_upgrade_v2.exe, tflite_convert.exe, toco.exe and toco_from_protos.exe are installed in 'c:\program files (x86)\microsoft visual studio\shared\python37_64\Scripts' which is not on PATH.

Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.

Successfully installed absl-py-0.7.1 astor-0.8.0 gast-0.2.2 google-pasta-0.1.7 grpcio-1.22.0 h5py-2.9.0 keras-applications-1.0.8 keras-preprocessing-1.1.0 markdown-3.1.1 numpy-1.16.4 protobuf-3.9.0 setuptools-41.0.1 six-1.12.0 tensorboard-1.14.0 tensorflow-estimator-1.14.0 tensorflow-gpu-1.14.0 termcolor-1.1.0 werkzeug-0.15.5 wheel-0.33.4 wrapt-1.11.2

 

添加path环境变量

c:\program files (x86)\microsoft visual studio\shared\python37_64\Scripts

 

 

测试tf

>>> import tensorflow as tf

>>> tf.__version__

'1.14.0'

结果:成功

 

测试cpu还是gpu

>>> import os

>>> from tensorflow.python.client import device_lib

>>> os.environ["TF_CPP_MIN_LOG_LEVEL"]="99"

>>> device_lib.list_local_devices()

[name: "/device:CPU:0"

device_type: "CPU"

memory_limit: 268435456

locality {

}

incarnation: 11073789457534317226

]

 

测试是否在gpu上运行

>>> import tensorflow as tf

>>> sess = tf.Session(config=tf.ConfigProto(log_device_placement=True))

2019-07-24 18:55:42.319137: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2

2019-07-24 18:55:42.324349: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library nvcuda.dll

2019-07-24 18:55:42.859900: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1640] Found device 0 with properties:

name: Quadro K1100M major: 3 minor: 0 memoryClockRate(GHz): 0.7055

pciBusID: 0000:01:00.0

2019-07-24 18:55:42.864411: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.

2019-07-24 18:55:42.869847: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1717] Ignoring visible gpu device (device: 0, name: Quadro K1100M, pci bus id: 0000:01:00.0, compute capability: 3.0) with Cuda compute capability 3.0. The minimum required Cuda capability is 3.5.

2019-07-24 18:55:42.902715: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:

2019-07-24 18:55:42.905383: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187] 0

2019-07-24 18:55:42.907013: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1200] 0: N

Device mapping: no known devices.

2019-07-24 18:55:42.910171: I tensorflow/core/common_runtime/direct_session.cc:296] Device mapping:

结果:

由于tf 最小cuda计算能力要求为3.5,本gpu(device: 0, name: Quadro K1100M, pci bus id: 0000:01:00.0, compute capability: 3.0)不满足要求。

 

换台电脑,在python3.6上安装tf-gpu

主要内容:

1. 添加权限

2 安装cuda,cudnn

3 根据提示更新pip

4 安装tf-gpu

 

测试是否在gpu上运行

>>> import tensorflow as tf

>>> sess=tf.Session(config=tf.ConfigProto(log_device_placement=True))

2019-07-24 19:05:52.174361: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2

2019-07-24 19:05:52.180939: I tensorflow/stream_executor/platform/default/dso_loader.cc:42] Successfully opened dynamic library nvcuda.dll

2019-07-24 19:05:52.309641: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1640] Found device 0 with properties:

name: GeForce 940MX major: 5 minor: 0 memoryClockRate(GHz): 1.2415

pciBusID: 0000:01:00.0

2019-07-24 19:05:52.317307: I tensorflow/stream_executor/platform/default/dlopen_checker_stub.cc:25] GPU libraries are statically linked, skip dlopen check.

2019-07-24 19:05:52.322696: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1763] Adding visible gpu devices: 0

2019-07-24 19:05:53.599442: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1181] Device interconnect StreamExecutor with strength 1 edge matrix:

2019-07-24 19:05:53.603636: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1187] 0

2019-07-24 19:05:53.605884: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1200] 0: N

2019-07-24 19:05:53.608481: I tensorflow/core/common_runtime/gpu/gpu_device.cc:1326] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 1391 MB memory) -> physical GPU (device: 0, name: GeForce 940MX, pci bus id: 0000:01:00.0, compute capability: 5.0)

Device mapping:

/job:localhost/replica:0/task:0/device:GPU:0 -> device: 0, name: GeForce 940MX, pci bus id: 0000:01:00.0, compute capability: 5.0

2019-07-24 19:05:53.618489: I tensorflow/core/common_runtime/direct_session.cc:296] Device mapping:

/job:localhost/replica:0/task:0/device:GPU:0 -> device: 0, name: GeForce 940MX, pci bus id: 0000:01:00.0, compute capability: 5.0

进一步测试

>>> import os

>>> from tensorflow.python.client import device_lib

>>> os.environ["TF_CPP_MIN_LOG_LEVEL"] = "99"

>>> print(device_lib.list_local_devices())

[name: "/device:CPU:0"

device_type: "CPU"

memory_limit: 268435456

locality {

}

incarnation: 2949566760586279955

,

 

name: "/device:GPU:0"

device_type: "GPU"

memory_limit: 1459018137

locality {

bus_id: 1

links {

}

}

incarnation: 14182985404273149922

physical_device_desc: "device: 0, name: GeForce 940MX, pci bus id: 0000:01:00.0, compute capability: 5.0"

]

 

总结

在anaconda3.6安装最新版(未指定版本)tf-gpu,失败。因为没有提示具体错误,难以分析具体原因,所以拟在别的位置的python上重新安装。

失败的原因可能是在本python下已经安装了tf cpu '1.12.0'

找到vs安装的python3.7,添加环境变量和权限后,更新pip命令,未指定版本, '1.14.0',安装成功,发现下载速度很快,一会儿就安装好了,但不能正确运行。

之后换位置安装好,但gpu版本太低,无法应用gpu加速。

最后换电脑安装,终于成功。

结论:

1. 查看gpu-cuda计算能力,是否大于3.5

2. 如果python安装c盘,需要添加权限

3 更新pip

4. 安装tf-gpu,目前最新版为1.14.0

5.安装cuda和cudnn,需要完全核定版本,这一步可以根据运行tf的结果来确认版本。

 

商务合作,科技咨询,版权转让:向日葵,135—4855__4328,xiexiaokui#qq.com

标签:DeepLab,教程,lib,py,site,tensorflow,gpu,packages
来源: https://www.cnblogs.com/xiexiaokui/p/11240393.html

本站声明: 1. iCode9 技术分享网(下文简称本站)提供的所有内容,仅供技术学习、探讨和分享;
2. 关于本站的所有留言、评论、转载及引用,纯属内容发起人的个人观点,与本站观点和立场无关;
3. 关于本站的所有言论和文字,纯属内容发起人的个人观点,与本站观点和立场无关;
4. 本站文章均是网友提供,不完全保证技术分享内容的完整性、准确性、时效性、风险性和版权归属;如您发现该文章侵犯了您的权益,可联系我们第一时间进行删除;
5. 本站为非盈利性的个人网站,所有内容不会用来进行牟利,也不会利用任何形式的广告来间接获益,纯粹是为了广大技术爱好者提供技术内容和技术思想的分享性交流网站。

专注分享技术,共同学习,共同进步。侵权联系[81616952@qq.com]

Copyright (C)ICode9.com, All Rights Reserved.

ICode9版权所有