AWS Hadoop Spark Mongo DB

Cerrado Publicado hace 6 años Pagado a la entrega
Cerrado Pagado a la entrega

I have setup AWS cluster with Hadoop, Spark and Mongo DB nodes

I just need help with ingesting raw data into Hadoop and Spark should read and process this data then store in Mongo DB.

Setup ETL pipeline :

Download and unzip the pageview dataset from a website

Ingest the raw data into Hadoop

Use Spark to read data from the Hadoop cluster and compute the per-language statistics

Store the per-language statistics into MongoDB directly from Spark

Write scripts for automation every month once

Amazon Web Services Big Data Sales Hadoop NoSQL Couch y Mongo Spark

Nº del proyecto: #15500314

Sobre el proyecto

13 propuestas Proyecto remoto Activo hace 6 años

13 freelancers están ofertando un promedio de $399 por este trabajo

rutvikparmar

I have previously worked with Big Data Technologies like Spark and Hadoop and being a data scientist i have also worked with NoSQL databases like Cassandra and MongoDB. I can help you with ur project. Relevant Skills Más

$200 CAD en 3 días
(14 comentarios)
4.9
mihalm

Hi, I can propose you solution with AWS Pipeline using on-premise or on-demand EMR cluster for processing. Data flow and scheduling options will be fully managed from AWS Console. Relevant Skills and Experience I have Más

$1722 CAD en 5 días
(6 comentarios)
4.7
shivampanchal

I have a good hand on working with Advanced Excel, R and Python. I have quite a good knowledge of deep learning Algorithm , have also developed dashboards and Shiny Web Application in R Relevant Skills and Experience Más

$250 CAD en 3 días
(6 comentarios)
4.0
nirmaljeetverma

As per my expertise in this field, I can assure you that I can easily do this task. And my only aim is to provide you with the fastest and the best solution for your job. Relevant Skills and Experience Amazon Web Serv Más

$155 CAD en 3 días
(16 comentarios)
3.9
gkbhardwaj87

Hi, I have experience in hadoop/spark/java. for more info ping me Relevant Skills and Experience java/hadoop/spark/java Proposed Milestones $222 CAD - final

$222 CAD en 3 días
(1 comentario)
3.5
Ankit1007

Dear sir, I have a team of expert developer and designer who can give make any kind of application with their skill set. Relevant Skills and Experience I have seen requirements and I am 100 % sure that I can make i Más

$155 CAD en 3 días
(0 comentarios)
0.0
goncalocarito

This work is very similar with the one I did in a past job with the startup company Clickly where I was the main Data Scientist, so I did it before and I believe I am the best person to do it. Stay tuned, I'm still w Más

$222 CAD en 3 días
(0 comentarios)
0.0
deepyad

Would like to see current setup through screen sharing before accepting project Relevant Skills and Experience Java / J2EE / AWS 13 Years Exp Proposed Milestones $222 CAD - Would like to see current setup through scr Más

$222 CAD en 3 días
(0 comentarios)
0.0
vedprak21

A proposal has not yet been provided

$233 CAD en 3 días
(0 comentarios)
0.0
datotahost

Hi, We will do this job by weekly $1200 usd .in this we do the hodoop work and informatica or tableau Relevant Skills and Experience hadoop ,informatica,tableau Proposed Milestones $1266 CAD - hadoop ,informatica

$1266 CAD en 7 días
(0 comentarios)
0.0