Data Analytics - AWS

$750-1500 USD

Closed

Posted

about 3 years ago

$750-1500 USD

Paid on delivery

Looking for an expert/experienced AWS engineer. About Project- 1. Use AWS Glue for Extract, Transform and load processes. The goal is to produce fine-grained, quality assured and highly optimal data (Data Lake bucket) from a source of data that is not fully optimised (Acquired data bucket). 2. Glue processes will be triggered by using Lambda functions that run when defined conditions are met, like new data landing in the S3 buckets. 3. Glue crawlers will run to produce DataCatalogs that will be also updated with databases and tables so can identify that data. Require a solid proposal with a roadmap about how you are going to execute this and the amount of time that you require to complete each task.* *Sheet will be shared with you at a later instance to fill in the details.

Project ID: 29398713

About the project

12 proposals

Remote project

Active 3 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

12 freelancers are bidding on average $1,093 USD for this job

@ruslikpetr

Hi I've read your requirements in detail. Here's my proposal and hope it will solid. 1. First of all, I'd like to check a source of data that is not fully optimised and create a structure and algorithm of fine-grained, quality assured and highly optimal data. Based on that algorithm, I will write a python script that will be run on the AWS Glue. 2. Then I will build another script and Lambda functions to trigger the Glue processed to AWS S3. 3. Modify the crawlers to produce DataCatalogs. To the last, this is my abstract suggestion. The exact time and budget proposal will be decided after sufficient discussion of your existing services. Thank you. Vladislav

$1,000 USD in 7 days

5.0

(5 reviews)

3.1

@SunshineConsult

Hello, I am an AWS consultant having many years of industry experience, could help you with data processing, Thanks.

$1,250 USD in 7 days

4.7

(13 reviews)

3.2

@kabhisheksss

Hi, I am an AWS expert with +4 years of extensive experience in solution architecture and infrastructure management. I would like to work with you on this project - building a data catalog from an unoptimised source and monitoring results for the successful catalog building. A pipeline for such an ETL task is to be created. Happy to chat further about it. Best, A

$1,350 USD in 7 days

5.0

(2 reviews)

2.4

@vishwali

I have experience of data entry and copy paste work.i worked with many us companies. I am able to do your work on time with a quality.

$750 USD in 7 days

0.0

(0 reviews)

0.0

@svikas65

I have gone through your requirement. I have 15 years of experience in Data engineering and 4 years on AWS services related to data engineering. I can do the task by using S3, lambda, Glue. I have good experience in these AWS services along with very good python and pyspark coding skills. Regards, Vikas Singh

$1,111 USD in 7 days

0.0

(0 reviews)

0.0

@jatinpatel2575

Sr Big data Developer having more than 7 years of experience with a demonstrated history of working in HW and EMR spark jobs and various services. Skilled in Apache Spark, Apache Spark Streaming, Apache Spark Graphx, Apache Spark SQL, Apache Kafka, Apache Avro, Apache Cassandra, Confluent Platform, Jenkins, Hotornwork, EMR, CMD, Scala and Java. Strong engineering professional with a Bachelor of Engineering (BE) focused in Information Technology from Gujarat Technological University.

$1,225 USD in 15 days