Find Jobs
Hire Freelancers

We have a Billions of data that need to be organized

$250-750 USD

Completed
Posted over 6 years ago

$250-750 USD

Paid on delivery
Hello, We have about 1 Billions of data in different files, all are in CSV format. Some are with email and other information like phone, addresse, city .... and other is with only email. We need to build a solution to organize all the data in on place and have the possiblity to filter it and match it and export is as we want. There is any solution for that. PS : there is some data with header on the file and other without and there is more than 100 000 differents files.
Project ID: 14847602

About the project

57 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
I would manage all the data and bring into order to store and retrieve and able to use as per data attribute. thank you for posting job.
$250 USD in 3 days
4.9 (3 reviews)
2.6
2.6
57 freelancers are bidding on average $717 USD for this job
User Avatar
Greetings sir, i am an expert freelancer for this job and your 100% satisfaction is assured if you allow me to serve. Here is the reason. Why you should pick me? a) I am a very expert and have the same kind of experience of 5 years. b) I work very hard (16+ hours a day and 7 days a week) and also very fast so... it will be done very soon than most of the other providers c) And most important part is my policy: "I will give you (to my client) life time support (as long as you keep relation with me). And fix any bugs/problem without any cost. So, don't ever worry about me” Please sir, leave a reply ASAP, as I am waiting for your kind reply
$500 USD in 5 days
4.9 (282 reviews)
7.9
7.9
User Avatar
Dear sir. I am a professional mobile app & web developer with 7+ years rich experience. I also have been certificated mobile & web development skill tests in here freelancer.com I’ve carefully gone through your project description and so I am very interested in your project. "Your idea + my skill = good product". My fast and exact understanding about your project and best skill, high quality deliver in time made you satisfying!!! That's why I always received good and wonderful feedback from my clients. ****** Please check my profile - 100% job completed and more than 70 positive feedback https://www.freelancer.com/u/Beautistar.html ****** We can discuss other details on chat. Kind regards Beautistar
$555 USD in 10 days
4.9 (37 reviews)
7.6
7.6
User Avatar
A proposal has not yet been provided
$693 USD in 7 days
5.0 (161 reviews)
7.3
7.3
User Avatar
Dear Sir/Ma'am, I am a Web research, Data Entry & Web Scrapping expert. I checked and understood your requirements. I can handle this job very well to your appreciation. I can find and extract the information from different websites into an Excel sheet. I am ready to hear the details of the project more in detail now. I have always created a long-term collaboration with my clients through hard work and quality output for a reasonable price. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir
$526 USD in 10 days
4.9 (199 reviews)
7.3
7.3
User Avatar
Hello Sir, we have 8 member team and we can start work right now just give us one chance we will do our best,awaiting ur answer.
$275 USD in 2 days
4.9 (387 reviews)
7.0
7.0
User Avatar
I am very proficient in java. I have 16 years java developing experience now, and have worked for more than 6 years. My work is online game developing, and mainly focus on server side, using java under Linux environment. I used java to make many great projects, for example, I made the tools which can convert java files into c++ scripts, of course garbage collection included, this job is very similar to a compiler, and is very complex. I also made our own mobile game using java, I can show you the demo of client, if you like. I am very proficient in c++ also. I have a very good review on Freelancer.com, I never miss a project once I accept the job, you can check my review. Trust me, please let expert help you.
$300 USD in 5 days
4.9 (84 reviews)
6.5
6.5
User Avatar
Hello Sir/Madam, It is my pleasure to be able to bid on your project. Really very much interested to have this project, if you permit. I am 100% confident that I can execute the project with good quality that will satisfy you. For better clarification, you can also have a look onto several feedback that I have earned so far on Freelancer. If you want I can also do a free pilot project (free demo assignment) for you. It will also be helpful for you to judge my adaptability and skill level. Thanks Skype: ayank06
$400 USD in 5 days
5.0 (269 reviews)
5.7
5.7
User Avatar
Hi, I have working on python for over 7 years. I can help you with organising this data. I can parse through all that data recognising each datum on the basis of regex matches and then putting every thing in a non sql database like mongoDb for easier access, search and filtering later. Also, it will be easier to export that data into any format once it is structured in mongo Let's discuss more about the task Thanks
$388 USD in 10 days
5.0 (33 reviews)
5.4
5.4
User Avatar
I have excellent expertise in this area, in fact I worked on such project 10 days ago. I would like to offer myself a probable candidate assignment as I am confident of delivering quality output. I have 7 years of IT experience in window application,website design and developments Skills: java,j2ee,javascript,spring,hibernate,jsp/servlet,jms,soap/rest,jquery,css,angular js
$555 USD in 10 days
4.8 (34 reviews)
4.8
4.8
User Avatar
I am well equip to this kind of task, can handle it pretty well. I already done related to this job before. Let me know the best of your time so we can discuss further based on your requirements.
$299 USD in 5 days
4.7 (23 reviews)
4.8
4.8
User Avatar
hello dear friend how are you hope you are well dear friend I have understand your project I can merge all your 100000 files into a single csv file I am expert in this field so please hire me for this job thanks
$750 USD in 10 days
5.0 (2 reviews)
3.8
3.8
User Avatar
csv files extracting and organization into categories for export and other uses. the app/website will assist in getting this done
$497 USD in 10 days
5.0 (7 reviews)
3.7
3.7
User Avatar
Hello, I am interested in this project post. I will give you quality work at very affordable rate and timely delivery. You can view my profile for reviews. Let’s discuss more over chat. Cheers
$750 USD in 30 days
4.3 (4 reviews)
3.2
3.2
User Avatar
Hi, I have experience in data sorting on large datasets. Java is my strong key area and day to day writing python scripts too. Please consider my bid and would like to hear more from you about this project. Thank you. Jason
$750 USD in 3 days
4.7 (2 reviews)
3.0
3.0
User Avatar
Hello, I'd like suggest use Postgres databese with several java scripts for the data processing. As you use numbers of csv files of the same scructure (mainly as i understand) this will be enough to make several classes for data processing will allow parse/store/retrieve data from cvs and export back (postgres has its own import/export mechanism, but it is not so flexible). As a result: you will be able add csv file into some folder. Then special script will be run (i.e. once a hour or a day - it is configurable). After this your data will be parsed and stored into database. In case there are related info in these csv we will be able combine in in the database, also will be able normally process duplicates. As an example i can use my own solution for all the trading info is made my Ukrainian goverment. There are about 5 millions regords, the system works on 2 core server with 1 GB ram and 30 GB drive (14 GB is for DB). Average time for data retreawing - 3 minutes (and it is very complicated requests. I'd like make a call or chat do discuss the system in details. I'm available from 8 AM to 8 PM UTC everyday. Briefly about me: Mid Java dev and Senior QA/QC with more than 11 years in software development. I'm good in databases (was a team member of MS SQL Srvr 2005, now mostly work with Postgres), backend Java development, algorithms (MD in Math and Computer Science) + clients on JavaFX or Swing. Looking forward for work with you. Sincerely, Sergii Lopka
$833 USD in 20 days
5.0 (1 review)
2.3
2.3
User Avatar
Hi there. The software called SAS can help you. It is very powerfull for that type of project. Pleace contact me if you need my help. Thanks. Justin
$555 USD in 10 days
5.0 (5 reviews)
2.1
2.1
User Avatar
Hi I propose to use MSSQL Server for the database. I will Create SSIS Packages to import the data into the SQL Server. I will also create some reports in SSRS (SQL Server Reporting Services) to make search in the Data.
$10,000 USD in 360 days
5.0 (1 review)
2.0
2.0
User Avatar
Specialized in work of this type, integral solutions to the clients, technological transfer, transparency, guaranteed quality and efficiency, special and careful treatment to the client, negotiable price
$450 USD in 5 days
5.0 (1 review)
1.7
1.7
User Avatar
my solution to handle big data - I will create an Access program connecting all the csv files, before that I will put header for all csv files . in this method you can connect all the files and can also extract whatever data fields as required . I will complete the work in 3-4 days for 300 USD with regards Ramesh KS from Chennai ,India
$300 USD in 10 days
5.0 (1 review)
1.7
1.7
User Avatar
I have done countless other data process and data entry projects and will be a perfect fit for what you are looking for. Please let me know of any specifics needed and I will get the job done quickly. Thank you for the opportunity!
$555 USD in 10 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of MOROCCO
rabat, Morocco
4.9
258
Payment method verified
Member since Aug 14, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.