Senior Data Engineer
May 13, 2020
Responsibilities:
- Interface with clients to understand high level as well as detailed project requirements and understand business problems.
- Develop solution architecture to extract, transform and load data and other required solution to answer business questions, be responsible for end to end data management.
- Manage client communication and meetings, documentation and other processes. Generate and communicate insights and project results to client, seek and incorporate feedback.
- Lead and manage team members.
Should have hands-on experience in one or more of the followings:
- Programming in Python (frameworks and libraries like Pandas, Numpy, SQLAlchemy, PySpark etc), Java, etc
- Data ETL tools like Fivetran, Stitchdata, CloverDX, Alteryx etc.
- Proficiency and working knowledge of Talend.
- Management and operation on databases like MySQL, PostgreSQL, MS SQL, MongoDB, Cassandra, Neo4j etc.
- Cloud platforms like Amazon Web Services (EC2, Glue, Athena, RDS, Redshift, EMR etc.), Google Cloud Platform (BigQuery, Cloud SQL etc.), MS Azure (ADF, Datalake, Synapse, HDInsights etc.), Databricks, Snowflake etc.
- Working with REST and SOAP APIs.
Desired Candidate Profile:
- Ability to lead a team and manage projects independently.
- Eye for detail, passion for accuracy.
- Great analytical and problem-solving skill.
- Ability to adapt and thrive in a fast paced and demanding environment of a young start-up.