Find Jobs
Hire Freelancers

300,000 row sql database constantly updating but running slow (need fix)

$30-250 USD

In Progress
Posted about 8 years ago

$30-250 USD

Paid on delivery
New mysql/mysqli/? method of constantly updating sql rows Reaccuring action: Delete FROM table where field1 = 1 AND timefield > 3 hours 5000+ times UPDATE table SET info, info, info WHERE xid=? While this continuously happens the front end of the website is like a search engine with many filters for all of the different fields THE PROBLEM: We are currently using older php/mysql code and it requires a heavy dedicated server in order to handle all the query requests + updates + deleting The current process happens to run slow sometimes requiring a sql server reboot. THE SOLUTION We are looking for someone with extensive knowledge when it comes to dealing with large databases that are constantly having the rows updated and queried to help find a way to change the process in which we do things. We need to be able to update the table without it taking so much effort by the server. The goal is to be able to run this properly on a less expensive server that will require less power due to the newer code and sql setup. I believe do to unefficient coding that its much more taxing on the server than it really has to be. Need someones expert opinion on the proper way to be running this. And if a solution is possible, need them to recode the files and sql run correctly.
Project ID: 9853485

About the project

21 proposals
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
We have 8+years work experience in .NET,FLASH,C#,Linux,Visual Studio2010,Joomla,ASP,Javascript,Java,PHP,Python,Prestashop, MS access,SQL,Shell script,XML,moodle,AJAX,CMS,HTML,Drupal,SEO,CSS,wordpress,Bootstrap,Photoshop,Oscommerce, CSS,Paypal API technologies [login to view URL] have a web and tech savvy [login to view URL] have satisfied more clients successfully in short [login to view URL] will give you very good quality and high level of Accuracy for this [login to view URL] can accept your payment terms and method here,Keep me posted. Specialization Areas Website Development Website Testing Project Management( Base camp) Data Collection Advanced VBA and Excel Macros E commerce PayPal Payment Gateway Integration Directory Automation Scraping Application Development Mobile Application Development Amazon Product services Graphic Design Windows and Linux Server Administration Thank you.
$155 USD in 3 days
3.7 (6 reviews)
4.4
4.4
21 freelancers are bidding on average $185 USD for this job
User Avatar
hi, we are able to complete this work with its innovative ideas and excellent customer service. we will make some different to your expectation. we are available via Skype, phone and e-mail and are always open for discussion of progress, issues, functionality changes etc I'll be glad to continue our discussion and hope to talk to you soon. waiting for your prompt reply. i have read your requirement and i will do that real quickly if u want to any query or question then come on chat on freelancer.com Thanks Nammy Makwana Creativeitech
$200 USD in 3 days
5.0 (100 reviews)
6.7
6.7
User Avatar
I'm SQL expert with many years of experience that's why I'm sure you'll be impressed with my work. Please show me your database schema for the tables you want to update so I can check everything. Thanks. Roman
$98 USD in 1 day
5.0 (235 reviews)
6.5
6.5
User Avatar
Hello, I have gone through your outsourced requirements "300,000 row sql database constantly updating but running slow (need fix)" and have analyzed that I have right credentials (Skills required MySQL, PHP, Software Architecture, SQL) to execute your esteemed project. I will complete your project within 2 days, LIFETIME error free guarantee and provide 365 days (ONE YEAR) support... ===== Why choose me? ===== 5.0 / 5.0 rating, 100% completion rate, 100% on-time completion, 100% on-budget :) Kindly, check my profile: http://www.freelancer.com/u/BitLabs.html I work smart, hard, and strictly bid only what we can do! No sub-contracting... ever! You will never go wrong choosing me :)
$190 USD in 1 day
5.0 (90 reviews)
6.0
6.0
User Avatar
A proposal has not yet been provided
$55 USD in 1 day
4.8 (22 reviews)
4.7
4.7
User Avatar
hi, I will need to first look at the code and analyze it. There is a great chance that optimizing the code will results in lesser queries fired and improving the performance. If still performance is not achieved then we might have to take some decisions like delaying the queries for batch processing (if some delay is bearable). I am a senior software engineer. We face performance challenges on daily basis. We solve it either through code at server side or optimize the db queries (using RDMBS provided functions). Looking forward for your reply. best regards
$250 USD in 3 days
5.0 (12 reviews)
4.1
4.1
User Avatar
Hello! I have a huge experience in MySQL (performance tuning for small and large (up to 500G) databases). I work with huge database every day and have fixed a lot of untypical and typical issues. Let's discuss the details (I need at least table's structure and its size, but it is better if you provide me with some sample dataset - to test on my side and provide you with the fix, which suits your requirements). P.S. The number of rows (300,000) is not so huge.
$155 USD in 2 days
4.9 (7 reviews)
3.8
3.8
User Avatar
We are database professionals and we will deliver you in less time with quality for sure. we have experts more than 11 yrs. Let us know. Thanks
$155 USD in 0 day
4.8 (12 reviews)
3.9
3.9
User Avatar
Hi, I am a professional web developer having 6 years of experience in web development. I have worked on many large and small web projects using custom PHP, wordpress, drupal, magento, and much more, Also i have good experience in jquery, ajax, css, html, bootstrap, developing landing pages, Trouble shooting, debugging and fixing code errors, code reviews. I understood your sql issue. Please feel free to contact me back for further details. I am available to start immediately and my basic goal is client's satisfaction Looking forward to hear from you soon.
$155 USD in 3 days
5.0 (7 reviews)
2.7
2.7
User Avatar
Good Afternoon I'm Enmanuel Soria Sytems Analyst from venezuela, and im interested in your case, while the delete seems rather standard i think collation checking and correct indexes should be able to improve that part. on th eupdate part however your current way of doing it is awful in the least, intead of 5000 single row updates i would propose one 5000 rows insert into a middle table and one update query linking both tables that way you avoid the overhead transmiting 5000 headers and opening and closing connections, that should make a significant speed boost and reduce resource usage in one single stroke.
$111 USD in 3 days
5.0 (2 reviews)
2.9
2.9
User Avatar
I can optimize
$130 USD in 2 days
5.0 (2 reviews)
2.7
2.7
User Avatar
A proposal has not yet been provided
$222 USD in 10 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Create and index for field1, this should improve performance a little. OR Change query so it looks into the xid field (if that field is indexed and defined as auto incremental). Like this: delete from table where xid <= ( select max(xid) where timefield > 3 hours )
$155 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Oracle Certified Professional MySQL DBA, 20 years experience. Daily, in-the-trenches experience handling MySQL performance problems. A couple of quick comments on your issue: 1) It matters a great deal whether MyISAM or InnoDB is used as the engine for the tables affected by the large DELETE and UPDATE operations. MyISAM uses table-level locking only, so the entire table will be locked during any write operation, resulting in slower performance and, potentially, in query backlogs. This will often present as "bursty" website performance -- acceptable or even good performance broken up by sporadic slowdowns. 2) If InnoDB is the underlying engine, care must be taken to break large write transactions into multiple smaller transactions. They don't give a lot of space here for details, so I'll wrap this up with: I know what I'm doing and I can assess your situation and either provide a solution or explain why you need the horsepower you're currently using. I won't provide a solution that I found by Googling around and guessing -- I have a professional-level understanding of MySQL and you will benefit from my 20+ years of real-world experience. I am in the US (South Carolina) and am flexible in terms of scheduling calls, etc. Hope to hear from you.
$277 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Sounds like you are having the same issues that we've been having for months here where I work. I was able to finally solve this problem by breaking the job up into multiple steps using an SSIS package. What you are looking for I can accomplished in multiple ways. I can either use Powershell, SSIS (Integrate Services) or a simple Storage Procedure. Real quick on what we accomplished in the last couple of days. The process that they had in place was to move 3 billion rows of data from Mainframe database to a SQL server database. It took days to do this load. We created a new package by breaking up the data into multiple parts and was able to move 3.5 billion rows of data in 11 hours. This is broken down in moving 6 million rows of data across the network every min. I know this is the solution to your problem.
$155 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi , I'm an application developer and I worked in multiple web and stand-alone applications using SQL server back-end and the project. if you want full details about my services you can check my website at www.appdev-solutions.com. I delivered similar projects for other clients. Thanks, Saad
$155 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hands-On experience in SQL database for about 2.5 years. I would like to take up challenges such as these.
$155 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Bloomsburg, United States
4.8
21
Payment method verified
Member since Apr 18, 2009

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.