Senior Data Engineer

Responsibilities:
  • Interface with clients to understand high level as well as detailed project requirements and understand business problems.
  • Develop solution architecture to extract, transform and load data and other required solution to answer business questions, be responsible for end to end data management.
  • Manage client communication and meetings, documentation and other processes. Generate and communicate insights and project results to client, seek and incorporate feedback.
  • Lead and manage team members.
Should have hands-on experience in one or more of the followings:
  • Programming in Python (frameworks and libraries like Pandas, Numpy, SQLAlchemy, PySpark etc), Java, etc
  • Data ETL tools like Fivetran, Stitchdata, CloverDX, Alteryx etc.
  • Proficiency and working knowledge of Talend.
  • Management and operation on databases like MySQL, PostgreSQL, MS SQL, MongoDB, Cassandra, Neo4j etc.
  • Cloud platforms like Amazon Web Services (EC2, Glue, Athena, RDS, Redshift, EMR etc.), Google Cloud Platform (BigQuery, Cloud SQL etc.), MS Azure (ADF, Datalake, Synapse, HDInsights etc.), Databricks, Snowflake etc.
  • Working with REST and SOAP APIs.
Desired Candidate Profile:
  • Ability to lead a team and manage projects independently.
  • Eye for detail, passion for accuracy.
  • Great analytical and problem-solving skill.
  • Ability to adapt and thrive in a fast paced and demanding environment of a young start-up.