Find Jobs
Hire Freelancers

Implement GPU offloading for our containerized python app (flexible compensation)

$200-300 USD

Closed
Posted over 3 years ago

$200-300 USD

Paid on delivery
We run a containerized implementation of our solution. Our servers are Ubuntu 18/cli, frontend is vuejs with typescript and vuetify and our backend is built on python with fastapi. You will be working with the backend for this project. Our application is using advanced market data for digital assets/finance pulled from our own API and stored in local Redis. We run a series of user specified range-based criteria's against that data to identify trends and find truths. We have a brute force back testing engine that schedules 1000's-100k's of combinations of tests to run and then coordinates those tests that ultimately callout python scripts for each test. We can specify the number of workers of which will then run the scheduled jobs in parallel but currently limited by the number of CPU's we have on our server. We are looking to enable GPU offloading. We don't have experience in this area, whether we should consider cuda or tensorflow or ?? and what libraries would better suit our need. We need you to identify the way forward and then develop a solution that enables us to offload work to a GPU and leverage something such as the NVidia P4 or k40 or v100 or possibly standard GPU's such as nvidia 1080 (but also still supporting non-gpu based systems as it currently does). Ideally the solution will enable us to pass switches and or configs in our cli/ python scripts. We run these scripts inside of a containers so solution should be compatible with docker/kubernetes. See the code you will be working with here > [login to view URL] If you think you can likely tackle this job engage us and request any additional data you may need to bid on this job. When you provide a bid on this contract you should outline the following: 1. Your chosen approach (libraries, etc) 2. Estimated timeframe for delivery 3. Flat rate bid (pad for any uncertainties) Notes about how we do business. -If you deliver a working product perceivably free from major bugs in the timeframe you told us (#2 above), we pay an additional 10% bonus -If you do not deliver a working product within 2x of the promised timeframe, we will delete your branch and cancel the contract. -We wont leave bad reviews unless you really mess up but we will leave great reviews when you deliver!
Project ID: 27973244

About the project

1 proposal
Remote project
Active 3 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
1 freelancer is bidding on average $1,400 USD for this job
User Avatar
Hi, I have experience in dockerizing GPU applications on Ubuntu 18.04 LTS. To answer your question: 1. To be able to use GPU inside docker containers, nvidia-docker-tookit will be used, some information is needed from your side before we can further decide what library can be used. a. What are the model used in your system, if is it a tensorflow model, we can use the tensorflow-serving to serve the model to your application code. b. if it is some CPU codes, they might need to be re-written into cuda/tensorflow code before able to be executed on GPU. 2. Need more information before I can make a better estimation. 3. Need more information before I can make a better estimation. Hopefully I have the opportunity to work with you on this project. Thank you.
$1,400 USD in 14 days
5.0 (4 reviews)
3.7
3.7

About the client

Flag of UNITED STATES
United States
0.0
0
Member since Oct 21, 2020

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.