Experience: 7-8 years
Skill set required (Technology stack)
- Spark/ Spark-SQL
- ETL(ANY TOOL)
- HBase/Redis/Cassandra (Any NoSQL database)
- Cloudera/ Data fabric
- Shell scripting
- 7+ years of relevant experience in data engineering.
- A solid track record of data management showing flawless execution and attention to detail.
- Experience of working on different Hadoop flavours like Cloudera and data fabric.
- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
- Extensive Experience around SQL, Streaming and ETL.
- Extensive experience in Kafka, spark, python or Scala
- Experience with any NoSQL databases (like HBase, Cassandra, Redis)
- Experience with integration of data from multiple data sources.
- Technical expertise regarding data models, database design development, data mining and segmentation techniques
- Programming experience, ideally in Python or Scala
- Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks.
- Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.
- A willingness to explore new alternatives or options to solve data mining issues, and utilize a combination of industry best practices, data innovations and your experience to get the job done.
- Experience in production support and troubleshooting.