Find Jobs
Hire Freelancers

create mapreduce program and run it on amazon aws linux nodes

$30-250 USD

Cerrado
Publicado hace alrededor de 6 años

$30-250 USD

Pagado a la entrega
Build your own Hadoop AMI, starting from the Amazon Linux AMI ([login to view URL]). You have to use latest stable Hadoop release. You are required to store this AMI in S3, and its name must include your last name. This AMI will be tested with the application built for task 2. However, if your AMI doesn’t work you are allowed to use one of the pre-built Hadoop AMIs for task 2. Write a Hadoop/Yarn MapReduce application that takes as input the 50 Wikipedia web pages dedicated to the US states (we will provide these files for consistency) and: Computes how many times the words “education”, “politics”, “sports”, and “agriculture” appear in each file. Then, the program outputs the number of states for which each of these words is dominant (i.e., appears more times than the other three words). Identify all states that have the same ranking of these four words. For example, NY, NJ, PA may have the ranking 1. Politics; 2. Sports. 3. Agriculture; 4. Education (meaning “politics” appears more times than “sports” in the Wikipedia file of the state, “sports” appears more times than “agriculture”, etc.) INPUT FILE IS GIVEN - [login to view URL]
ID del proyecto: 16354070

Información sobre el proyecto

12 propuestas
Proyecto remoto
Activo hace 6 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
12 freelancers están ofertando un promedio de $297 USD por este trabajo
Avatar del usuario
Hello there, We are a team of expert Big Data developers with more than 10 years of rich inductry experience & have succesfully delivered multiple projects in the past like a)recipe recommendation b)movie recommendation c)Course recommendation system d)Stock movement prediction Our technology expertise related to Big data includes:- Python R language Cassandra Mongo Hadoop Spark Hbase Rabbitmq Kafka Titan graph etc. Our hard earned 5-star rating & great client reviews would help to gain confidence in our team,you can be sure of getting the best solution withn time & budget. Please let me know the best time to discuss the project requirements in detail so that we can take it further. Thanks for reading the proposal.
$277 USD en 3 días
5,0 (7 comentarios)
5,4
5,4
Avatar del usuario
Hello, I have extensively worked in map reduce progran in Python Scala and Java. Can we talk directly in the chat? Thanks!
$200 USD en 3 días
5,0 (24 comentarios)
4,6
4,6
Avatar del usuario
Hi, I have more than 3+years of experience in hadoop technologies like MapReduce,HDFS, Spark, sqoop etc. I can write the mapreduce program according to your requirements and I can deploy on amazon aws Contact me for more details
$250 USD en 3 días
4,9 (7 comentarios)
4,7
4,7
Avatar del usuario
Hi, I am an IT specialist and data scientist and thus have the skills required for this job. I have experience building AWS EC2 machines from AMIs as well as installing and configuring Hadoop. Finally, I have experience using Apache Pig/Spark on Yarn to create mapreduce applications. Thus, I can ingest the required files into HDFS perform mapreduce to get the ranking of words per state and return the states with matching top 4 states. Regards, Chris
$222 USD en 5 días
5,0 (7 comentarios)
4,3
4,3
Avatar del usuario
NOTE: Most of the requirement of your project scope is already completed by us and we have demo for you as well. We are Amazon MWS / Ebay API experts and completed so many projects using its API I have ready to use API for -- 1) Amazon Orders of seller 2) Amazon Product API 3) Amazon Price API 4) Amazon Repricer 5) Amazon SES API 6) Amazon SQS API 7) Amazon Product Advertising API I have done so many complex projects based on Amazon MWS / Ebay API and i am sure your project would be very easy for me. I have demos ready along with me, ping me so that i can share the links of demos with you. Thanks
$155 USD en 3 días
5,0 (1 comentario)
3,4
3,4
Avatar del usuario
Hi, We are a Team of Amazon certified Solutions Architects, we have more then +3 years experience with amazon AWS and more than +5 years as Linux SysOps. We can help you with this Please let me know if you need more information. Regards Jose
$250 USD en 5 días
5,0 (1 comentario)
2,3
2,3
Avatar del usuario
Hey, Can we start project ASAP and will complete within 3 working days so kindly suggest time to connect with you.
$222 USD en 3 días
0,0 (0 comentarios)
1,3
1,3
Avatar del usuario
Languages: JAVA. Java/J2EE: Core JAVA,JAVAFX, Advanced JAVA, Servlet, JSP, JSTL, EJB, JDBC, Junit, Web Services, XML, XSD, JAX-RS, DOM, SAX, Multithreading, JTA, Custom Tags, JPA API’s. Web Technologies: Html, DHTML, JavaScript, JQuery, Anguler JS, CSS, AJAX, Web Services ( REST). Big Data : Hadoop,Spark,Hive,Pig,Kafka,Hbase,Sqoop,Flume,Impala,MongoDB. Databases: Oracle, MYSQL. Database Tools: SQL Developer. ORM Mapping: JPA, Hibernate Web/Application Servers: Jetty 8.x/9.x, WebLogic 12.x/11.x/9.x, Apache Tomcat 6.x/7.x. DevOps Tools: Jenkins,BugZilla,Jira Frameworks: Struts 1.x/2.x, Hibernate 3.x/4.x, Spring MVC, Spring 2.x/3.x, Spring Boot. Operating Systems: Mac, Linux and Windows. IDEs / Versioning / Performance /Tools: Eclipse, My Eclipse, Net Beans, git, SVN, CVS, Ant, Maven, Log4j. Testing Tools: Junit, TestNG. Methodologies: Waterfall Model, Agile, OOAD, Test Driven Development (TDD).
$255 USD en 7 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
A proposal has not yet been provided
$277 USD en 3 días
0,0 (0 comentarios)
0,0
0,0
Avatar del usuario
I've been working in a big data company for 2 years. I'm very good at hadoop/spark. I know how to optimize difficult map reduce jobs. What's more, I'm good at system-level optimization. I know how to analyze IO/network/CPU/memory's influences on applications. I can finish this job in one day.
$222 USD en 1 día
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de UNITED STATES
United States
0,0
0
Forma de pago verificada
Miembro desde feb 22, 2018

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.