Data Engineer

Role: Software Engineer

Experience: 2+ Years

Technology: Java (Must)

Location: Bangalore

About the Role:

Seeking individuals with demonstrated experience in data engineering for developing and maintaining data engineering modules and pipelines for our product reporting platform. Your primary focus will be to develop/enhance/optimize/maintain data engineering pipelines. You will also be responsible for supporting customer’s proof of validations and implementations from data engineering perspective.

About the team:

PayU Finance is the credit and lending arm of the PayU brand (a wholly-owned subsidiary of the Prosus group. Previously Naspers group) headquartered in Amsterdam, Netherlands. PayU Finance India has disbursed about 20 billion loans to date by volume and has disbursed more than $280 million in consumer credit. PayU Finance provides consumers with easy access to affordable short-term loans up to INR 5 lacs that can be availed in the form of personal loans, point of sale EMI, and express loans. 

PayU Finance operates under two brands - LazyPay and PaySense with a focus on Buy now Pay later and personal loan products.

Excited yet? Continue reading to find out more about the role:

Excellent Coding skills in Python, SQL and PySpark is a must

Hands on Experience with any of the cloud providers such as AWS or Azure or GCP

Experience of writing/maintaining Spark code base in a production environment

Experience in working as a Big Data Engineer (Apache Spark, Hadoop ecosystem, Apache Kafka) : query tuning, performance tuning, troubleshooting, and debugging Spark and other big data solutions

Experience in Relational Databases (Postgres, MySQL etc.) and NoSQL databases (MongoDB and Cassandra etc.)

Well Versed with orchestration frameworks like Airflow, Kubeflow etc.

Build & support scalable data engineering pipelines (ETLs etc.). This will entail extract, load and transform of ‘big data’ from a wide variety of sources, both batch & streaming, using latest data frameworks and technologies, along with real time monitoring dashboards and alerting.

Essential experience of working with distributed systems software development.

Demonstrated experience of production experience in big data infrastructure and data modelling.

Critical experience performance optimisation for both data loading and data ingestion.

Experience in developer’s toolkit such as GitHub, Dockers etc.

Build & support scalable data engineering pipelines (load, extract, cleaning, transform, ingest etc.) for our Data Platform and data assets.

Build and Deploy the Data Engineering pipelines for scale using Airflow

Have ownership of multiple data pipelines and reporting projects

Review, audit and improve the Data Engineering pipelines

Document and communicate technical and functional design (HLD, LLD), timelines and plans

Work closely with Engineering, Product, DevOps and Data Science team

Work with the engineering and implementation team to understand business problems and implement efficient software solutions

Follow configurable programming practices (config files, modular programming, parameterization, etc.)

Support Maintenance/enhancement of deployed pipelines. This includes bug-fixes and performance improvement.

Participate in organization building activities (cross team training, hiring, etc.) to further the PayU mission and culture

What we offer

A positive, get-things-done workplace

A dynamic, constantly evolving space (change is par for the course – important you are comfortable with this)

An inclusive environment that ensures we listen to a diverse range of voices when making decisions.

Ability to learn cutting edge concepts and innovation in an agile start-up environment with a global scale

Access to 5000+ training courses accessible anytime/anywhere to support your growth and development (Corporate with top learning partners like Harvard, Coursera, Udacity)

About us:  

At PayU, we are a global fintech investor and our vision is to build a world without financial borders where everyone can prosper. We give people in high-growth markets the financial services and products they need to thrive. Our expertise in 18 high-growth markets enables us to extend the reach of financial services. This drives everything we do, from investing in technology entrepreneurs, to offering credit to underserved individuals, to helping merchants buy, sell and operate online. Being part of Prosus, one of the largest technology investors in the world, gives us the presence and expertise to make a real impact. Find out more www.payu.com 

Our Commitment To Building A Diverse And Inclusive Workforce 

As a global and multi-cultural organization with varied ethnicities thriving across locations, we realize that our responsibility towards fulfilling the D&I commitment is huge. Therefore, we continuously strive to create a diverse, inclusive and safe environment, for all of our people, communities and customers. Our leaders are committed to create an inclusive work culture which enables transparency, flexibility and unbiased attention to each and every PayUneer so they can succeed, irrespective of gender, color or personal faith. An environment where every person feels they belong, that they are listened to, and where they are empowered to speak up. At PayU we have zero tolerance towards any form of prejudice whether a specific race, ethnicity, or of persons with disabilities or the LGBTQ communities.