Big Data Engineer Consultant
Dell
- Bratislava, Bratislavský kraj
- Trvalý pracovný pomer
- Plný úväzok
- Drive perception
- Drive demand
- Grow the buyer base
- Build the best content
- Feature engineering: Stitching together and aggregation of multiple large data sets working with the data scientist to a desired format. You will need to optimize both queries and architecture to support big data sets. SQL is usually the preferred language, but some NoSQL or Spark jobs are necessary.
- Implement complex Data pipelining / ETL process: Once the initial dataset are prepared, it is normally run through a further pipeline to prepare it for modelling. Here you will create features that make ML/AI algorithms work (e.g., translating text into category variables). Python/R is usually the preferred language.
- Develop and maintain documentation.
- Producing ad hoc datasets and reports.
- Degree in Business, Computer Science, Engineering, or equivalent professional experience.
- 8 to 10 years of related experience in a professional role with a Bachelor’s degree; or 6 to 8 years with a Master’s degree.
- Experience as a technical leader embedded with Data engineering teams operating in Agile methodologies such as Lean Software Development, Extreme Programming or equivalent.
- Self-directed and ability to build products that drive tangible user outcomes in a fast-paced environment.
- Strong and demonstrable external client-facing skills specifically in the areas of communication, issue, and escalation management, with demonstrated ability to drive cross-functional decision making for highly technical solutions.
- Experience with data processing software (such as Hadoop, Spark, Pig, Hive), along with data processing algorithms (MapReduce, Flume).
- Exposure to machine learning or machine learning pipelines is a plus.