Make python code run on all cores

$10-30 USD

Closed

Posted

over 4 years ago

$10-30 USD

Paid on delivery

I have a python script that is taking way to long to run. I just relized its only running on one cpu core so I didnt get much of a performance gain from purchasing a 48 core cpu. I need help reworking this code to make it run on multiple cores. I followed this tutorial [login to view URL] but dose not seem like that code is running properly since it compiles in a second (When running processes example) or dose not get the cores past one percent in task manager when running threads example.

Python

Machine Learning (ML)

Keras

Tensorflow

Project ID: 22798088

About the project

7 proposals

Remote project

Active 4 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

7 freelancers are bidding on average $35 USD for this job

@smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :)

$35 USD in 3 days

4.9

(71 reviews)

5.5

@kaloyan13

I have great experience with parallel programming, and know how to use multithreading in Python.............

$30 USD in 1 day

4.9

(44 reviews)

5.1

@GreenTower

hi, I can help you to fix this and improve the performance. yes we can try it by using multiprocessing, and improve it's performance. need some details about your current code and it's operation and performance before starting the work.

$83 USD in 2 days

4.9

(12 reviews)

3.8

@CROlakiluk

Hi, Thread version should end in 48 * T seconds (where T is the time to finish calc() function once), while in process version it should be done in T seconds. If I did understand you correctly, threads version did not pass one percent in Task Manager. That could be due to reporting of CPU usage. Best, Vedran

$25 USD in 1 day

5.0

(6 reviews)

3.2

@MrxMartino

Hi, I see the problem with your script. I think I can help you to use all the cores on your system. If interested, please contact me, so we can start ASAP. Solving the problem should not take more than 1 day.

$30 USD in 1 day

0.0

(0 reviews)

0.0

@nishantkaushik

Hi, I have 5+ years of experience in Data analytics in terms of Statistical Modeling, Predictive modeling, Data Visualization,Model deployment. Indian Institute of Technology, Madras certified in Machine Learning with Tensorflow. And I am working for Google(Client) as vendor payroll, so i can handle and complete your project. Regards, Nishant kaushik

$25 USD in 7 days