Place some nodes of the same network on GPU and others on CPU?

When defining a network in Caffe/Caffe2, can you place some of the nodes on the CPU and others on GPU? If so, how? (If your answer pertains a specific version of Caffe, please specify which)

What does mask r-cnn's AP, AP50, AP70 mean?

I'm novice on r-cnn. There are term AP, AP50, AP75 on mask r-cnn paper. 50, 75 is small postfix, but I can't make it small, sorry. Anyway the paper says it is averaged over IOU thresholds. For...

May i install caffe or caffe2 on Google Colaboratory?

I have try !pip install caffe and !pip install caffe2, but it is not useful. If ok, how to install caffe or caffe2? What about other framework? Thank you.

What is the best way to deploy a tensorflow trained graph into production?

I have been working on machine learning problems lately as part of my internship. So far I have been using Tensorflow with python because that's what I am most comfortable with. Once a problem is...

AWS Deep Learning AMI Virtual Environment Activation

I'm trying to set up a Jupyter Server using AWS EC2 starting with a Deep Learning AMI (Ubuntu) Version 7.0 AMI. It says that it comes with separate virtual environments: Comes with latest...

How do you convert a .onnx to tflite?

I've exported my model to ONNX via: # Export the model torch_out = torch.onnx._export(learn.model, # model being run x, # model input...

How can one control the number of threads Windows ML is using for evaluation

I'm trying to benchmark Windows ML against other backends and see some weird distribution of inference times (see plot). This is with the CPU backend using the ARM64 architecture. On ARM there's...

Pyinstaller unable to find dlls for the project dependencies while creating exe

Pyinstaller failed to find certain dlls that are required for binding in dependencies into one exe. Please find the error logs below. We have tried installing these libraries: pip3 install...

Install and import Caffe with Anaconda (on Windows 10)

I'm struggling to just install and import caffe on my windows 10's Anaconda (conda 4.7.11). I really don't know why such a well-known deep-learning package is that hard to just install! First, I...

Caffe2 doesn't seem to see cuDNN?

I am trying to install SpConv (spatially sparse convolution library), however when running python3 setup.py bdist_wheel, I get an error which seems to be related to Caffe2 not being able to see...

ModuleNotFoundError: No module named 'elmoformanylangs' when I installed ELMo in Colab

I followed the following steps to install ELMoForManyLangs ! git clone https://github.com/HIT-SCIR/ELMoForManyLangs.git cd ELMoForManyLangs/ ! python setup.py install from elmoformanylangs import...

Using a PyTorch model in C++ application on Windows

Following the official PyTorch tutorial, I created the model in Python, converted it to Torch Script via tracing, and saved a script module to a .pt file. The C++ code loading the model and...

PyTorch C++ convert data to tensor fails

I am trying / using the torch_script tool to run my PyTorch trained NN in C++. The below code fails with linker errors cv::Mat amplitudePatch = Assigned somewhere above in code; auto options =...

Operator translate error occurs when I try to convert onnx file to caffe2

I train a boject detection model on pytorch, and I have exported to onnx file. And I want to convert it to caffe2 model : import onnx import caffe2.python.onnx.backend as onnx_caffe2_backend #...

Running Detectron2 inference in Caffe2

I have a Detectron2 .pth model that I converted successfully to Caffe2 .pb via the Detectron2 tools functionality located here:...

How to install torch 0.4.1 on Windows 10?

I have windows 10 on a Lenovo Thinkpad P72 with a Nvidia Quadro P5200, and I absolutely need to install (py)torch v0.4.1 to use a 3D Mask R-CNN. So I tried the following...

Minimal (light version) PyTorch and Numpy packages in production

I am putting a model into production and I am required to scan all dependencies (Pytorch and Numpy) beforehand via VeraCode Scan. I noticed that the majority of the flaws are coming from test...

How to find c++ source code of torch.bmm of pytorch

I have trouble finding the source code of torch.bmm(), which is defined in...

Why use Caffe2 or Core-ML instead of LibTorch(.pt file) on iOS?

It seems like there are several ways to run Pytorch models on iOS. PyTorch(.pt) -> onnx -> caffe2 PyTorch(.pt) -> onnx -> Core-ML (.mlmodel) PyTorch(.pt) -> LibTorch (.pt) PyTorch Mobile? What...

Linkage problem when building program with libtorch on Raspberry PI

I'm writing a C++ program using libtorch and OpenCV. Here is the output of my CMakeLists.txt, with the libraries versions : -- Pytorch status : -- libraries:...

Unable to load model trained on Pytotch version 1.6.0 in Pytorch version 1.5.1

I have recently updated my Pytorch version to 1.6.0 on my local machine to use their mixed-precision training, since then I am encountering this issue, I have tried the solution mentioned here,...

Pytorch import error in Jupyter notebook in Windows

I installed torch 1.5.1 using conda install with CUDA 10.2. I was able to install it successfully. While importing torch in Jupyter, I am getting below error. OSError: [WinError 127] The specified...

How to load checkpoints across different versions of pytorch (1.3.1 and 1.6.x) using ppc64le and x86?

As I outlined here I am stuck using old versions of pytorch and torchvision due to hardware e.g. using ppc64le IBM architectures. For this reason, I am having issues when sending and receiving...

PyTorch dll issues for Caffe2

I am using a Windows 10 Machine and after re-installing Anaconda and all of the packages I had previously, including torchvision, torch and necessary dependencies, I am still getting this...

trying to build pytorch 1.0.0 cuda 10.2 with support for old gpu (3.0)

I'm playing with a couple of projects that explicitly require pytorch == 1.0.0, but I have an old graphics card that only supports cuda 3.0 so I'm using the cpu, which is very slow, being the...

Caffe2 cannot find the CUDA libraries

For my project, I am trying to integrate a c++ library into an Android app. This library uses PyTorch. For the first test implementation I used the example from...

caffe2 inference a onnx model , happend IndexError: Input 475 is undefined

Error: when I use caffe2 for pretraind model. the model is from https://github.com/onnx/models/blob/master/vision/classification/vgg/model/vgg16-7.onnx the model I use is pretrained model, I do...

ImportError: cannot import name 'PY3' from 'torch._six'

I am testing ZED Camera with the code on https://github.com/stereolabs/zed-pytorch. While running the final command: python zed_object_detection.py --config-file...

How can i build pytorch from the source on M1 Mac?

I tried to build pytroch from the source file as right now we can't install pytroch directly using pip. So i ran few commands which are mentioned below: 1. git clone...

Issues with AWS Lambda Docker Container (permission denied)

I am deploying a Docker container with AWS Lambda which executes a machine learning model. But whenever I attempt to load the saved checkpoints, I am getting a permission denied message when...