caffe跑试验遇到错误:Check failed: error == cudaSuccess (2 vs. 0) out of memory
来源:互联网 发布:网络超市logo 编辑:程序博客网 时间:2024/06/10 15:58
在调试自己编写的小网络时出现了以下问题
I1221 14:40:57.487751 15003 sgd_solver.cpp:106] Iteration 0, lr = 0.001F1221 14:40:57.493633 15003 syncedmem.cpp:56] Check failed: error == cudaSuccess (2 vs. 0) out of memory*** Check failure stack trace: *** @ 0x7f2f64ed0daa (unknown) @ 0x7f2f64ed0ce4 (unknown) @ 0x7f2f64ed06e6 (unknown) @ 0x7f2f64ed3687 (unknown) @ 0x7f2f655da931 caffe::SyncedMemory::to_gpu() @ 0x7f2f655d9c99 caffe::SyncedMemory::mutable_gpu_data() @ 0x7f2f654d4462 caffe::Blob<>::mutable_gpu_data() @ 0x7f2f6561e26c caffe::SGDSolver<>::ComputeUpdateValue() @ 0x7f2f6561ec63 caffe::SGDSolver<>::ApplyUpdate() @ 0x7f2f654cf68c caffe::Solver<>::Step() @ 0x7f2f654cfe99 caffe::Solver<>::Solve() @ 0x408b0b train() @ 0x405e6c main @ 0x7f2f6372bf45 (unknown) @ 0x406773 (unknown) @ (nil) (unknown)
首先我使用如下命令查看显存
nvidia-smi
发现没有多余的程序。
后来又上网找了找,找到了如下解决方案:
The error you get is indeed out of memory, but it's not the RAM, but rather GPU memory (note the the error comes from CUDA).
Usually, when caffe is out of memory - the first thing to do is reduce the batch size (at the cost ofgradient accuracy), but since you are already at batch size = 1...
Are you sure batch size is 1 for both TRAIN and TEST phases?
大概意思就是batch_size太大了,一次性读入的图片太多了,所以就超出了显存。因此需要将train.prototxt中的文件train和test的batch_size调小一点。
终于解决。nice
0 0
- 【caffe跑试验遇到错误:Check failed: error == cudaSuccess (2 vs. 0) out of memory】
- caffe跑试验遇到错误:Check failed: error == cudaSuccess (2 vs. 0) out of memory
- caffe跑试验遇到错误:Check failed: error == cudaSuccess (2 vs. 0) out of memory
- 【caffe跑试验遇到错误:Check failed: error == cudaSuccess (2 vs. 0) out of memory】
- caffe在训练时遇到:Check failed: error == cudaSuccess (2 vs. 0) out of memory
- Caffe | Check failed: error == cudaSuccess (2 vs. 0) out of memory
- Caffe FCN Test | Check failed: error == cudaSuccess (2 vs. 0) out of memory
- caffe训练过程中显示Check failed:error == cudaSuccess(2 vs. 0) out of memory
- Check failed: error == cudaSuccess (2 vs. 0) out of memory Abort(core dumped)
- Check failed: error == cudaSuccess (2 vs. 0) out of memory
- caffe failed: error == cudaSuccess (2 vs. 0) out of memory
- caffe 报错 Check failed: error == cudaSuccess (77 vs. 0) an illegal memory access was encountered
- caffe:cudaSuccess (2 vs. 0) out of memory
- caffe运行错误: im2col.cu:61] Check failed: error == cudaSuccess (8 vs. 0) invalid device function
- 【caffe】 Check failed: error == cudaSuccess (30 vs. 0) unknown error
- caffe-windows10 安装问题 Check failed: error == cudaSuccess (8 vs.0) invalid device function
- CUDA/caffe ERROR:cudaGetDeviceCount returned 30/35,Check failed: error == cudaSuccess (30/35 vs. 0)
- 配置SSD-caffe测试时出现“Check failed: error == cudaSuccess (10 vs. 0) invalid device ordinal”解决
- React Native 组件之Image
- Java NIO使用及原理分析(三)
- CCF工资计算
- Java Socket通信—聊天室
- 跨域与跨域访问
- caffe跑试验遇到错误:Check failed: error == cudaSuccess (2 vs. 0) out of memory
- http://blog.csdn.net/kobejayandy/article/details/12690041
- Maven 项目生成或者update jdk变为1.5的问题
- Linux设备管理(四)_从sysfs回到ktype
- Linux系列课程之Linux的介绍
- css-画虚线
- 【Spring】Spring MVC原理及配置详解
- 和外包公司还有一些没确认的情况
- Socket长连接学习