Our Migration from GPU to CPU Inferencing | Accubits Dev Blog

A cheaper route to the same goal

What we need is a cheaper route to achieve the same goal. Here the goal is to produce accurate output, results from the computer vision solution without compromising on the quality of the output. GPU infrastructure is costly as well as it affects the overall system performance, something which is not entertained by the buyers, especially for POCs or demos. So, the challenge I faced is to find a lighter and more efficient architecture to run our CV use cases. What I observed is that tasks like inferencing are not as resource heavy as training the models and CPUs are more than enough to execute the inferencing tasks. This can lead to significant cost savings.

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Accubits Technologies Inc

Accubits Technologies Inc

31 Followers

Accubits Technologies is an enterprise solutions development company focusing on AI and Blockchain technologies, based in Virginia, USA. https://accubits.com/