PySpark Expert

$25-50 USD / hour

Cerrado

Publicado

hace más de 5 años

$25-50 USD / hour

We are looking for a PySpark Expert to help optimise our PySpark pipeline. We are using Kafka for ingestion, PySpark for Stream processing and Elasticsearch for storage. Our pipeline has a couple of bottlenecks, which we want to unclog. We want someone who understands how to use the various optimisation techniques in Spark, knows how to set the configurations for hardware resources and understands YARN. If you are an expert in this space, please reach out to us.

ID del proyecto: 18170398

Información sobre el proyecto

6 propuestas

Proyecto remoto

Activo hace 5 años

¿Buscas ganar dinero?

Dirección de email

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto

Cobra por tu trabajo

Describe tu propuesta

Es gratis registrarse y presentar ofertas en los trabajos

6 freelancers están ofertando un promedio de $37 USD /hora por este trabajo

@matlabxperts

Hi. I have been working on pyspark since 5 months, In one of my project i had to made pipeline which get data from mysql and perform some parallel operation and submit back to the mysql, the purpose of doing that to minimize query time and I process 1 lac rows in 6 seconds. Thanks, Regards: Sajid.

$41 USD en 40 días

5,0

(18 comentarios)

6,6

@shadabkhan92

https://www.freelancer.com/projects/software-architecture/Elastic-search-kibana-cuckoo-API https://www.freelancer.com/projects/javascript/Webdevelopment-Project-for-Shadab/ https://www.freelancer.com/projects/software-architecture/Small-Python-programming-project/ Done the similar tasks sucessfully configured ealstic search with Yarn rule. Virus Total. python scripts. vti api etc. lets chat

$47 USD en 40 días

4,9

(29 comentarios)

6,2

@deytps86

Hello I am working in Bigdata/Hadoop technologies for years. I worked in Hadoop, Mapreduce, Spark (Streaming & MLLib), Kafka, ELK Stack, Cassandra, MongoDB, Postgre. I implemented above using Python as well as Java and Scala. Alao worked Shell, Perl and Python Can we talk further on this? Thank you!

$30 USD en 35 días