Databricks Solutions Architect
Apply Now
Job Description
What you will be doing
- Be a core member of our rapidly growing Databricks practice
- Work directly with end customers and architect, scope, negotiate & lead enterprise scale Databricks migration projects
- Provide thought leadership in the areas of data migration, master data management, data modeling, data governance, data transformations, curation and data integration
- Develop data architecture blueprints, patterns and frameworks that will enable reuse and standardization
- Grow the practice by influencing sales deals and assist with scoping, solutioning and estimating effort
- Lead efforts to develop reusable frameworks, accelerators and internal product development
- Help us hire, train and develop highly differentiated and diverse team of Big Data experts
The skills you will brin
- g
7+ years experience of data engineering, data platforms &analytic - s.10+ years of consulting experien
- ceMinimum 6-8+ projects delivered with hands-on experience in development on databrick
- s.Current knowledge across the Databricks product *& platform features - and/ or complete Databricks Data Engineering Professional Certification (upon joining
- ).Deep understanding and experience working with modern cloud data architectures and engineering for one or more of the common cloud ecosystems - AWS, Azure or G
- CPFamiliarity with cloud native technologies specifically - Python / PySpark/ JavaScript, CI/CD for production deployments , ML Ops, cloud devops, containers (kubernetes/docker, etc
- .)Deep experience with distributed computing with Spark, with knowledge of Spark runtime interval
- s.Strong abilities to provide a firm point of view on core cloud platform capabilities, security, and best practic
- esKnowledge of cloud and Big Data ecosystems to advise clients on optimal solutions and best practic
- esUnderstanding of cloud data architecture and data integration patterns (Databricks, Starburst, Azure Data Factory, AWS Glue and others), storage and processing (Redshift, Azure Synapse, BigQuery, Snowflake); Infrastructure as code (CloudFormation, Terrafor
- m)Understanding of enterprise data concepts such as Master Data Management and Enterprise Data Warehouse, experience with MDM standar
- dsUnderstanding of SQL, report generation using visualization tools such as Tableau/Power BI, programming using Python/Scala/Spa
- rkAbility to identify, debug bottlenecks and significantly optimizes low running data pipelin
- esExperience migrating applications from legacy Hadoop or Data Warehouses to the cloud running Apache Spark or Databricks a huge pl
usOther nice to have skill
- s:
Demonstrating prior Big 4 or proven consulting experience in strategy through execution projects is a p - lusExperience leading and working with large Cloud Data Platform, Cloud Data migration or Enterprise Information Management progr
- amsYou bring an uncompromising Growth mind
- setYou are highly motivated, creative in your approach to technical problems and know how to leverage both internal and external netwo
- rksYou invest in keeping technical skills updated and are constantly looking for the next big challe
- ngeYou will bring both broad and deep knowledge in Data Engineering and can architect a solution by mapping a customer business problem to an end-to-end soluti
- on.You are resourceful, confident and composed under press