Senior Data Engineer IRC197069

Description:

The client has requested GlobalLogic to build a Data portal that Enables Data Discovery, Data Domains, Metadata Management, Workflows, Enterprise Glossary Management, Data Access Management, Operational Dashboards (like DQ, Data Usage) etc.

Enterprise Data Portal is expected to be strategic leading-edge unified data ecosystem that provides framework, processes, tools and services, enabling consistent and frictionless access to trusted data across on-premise, cloud, other SaaS and external partners. It maximizes the value of our data and provides flexible self-service and advanced capabilities to support a wide range of use cases including enterprise, research and analytical needs.

Requirements:

• Minimum of 3-4 years in working with Enterprise Data Warehouse technologies including Multi-Dimensional Data Modeling, Data Architectures or other work related to the construction of enterprise data assets
• Extensive experience in developing microservices by using Python
• Experience in analyzing data using Python
• Data modeling and schema design
• Strong SQL programming background with the ability to troubleshoot and tune the code
• Proven understanding and demonstrable implementation experience of cloud data platform technologies
• Strong understanding of following Big Data Tech is MUST:

1. HDFS
2. Hadoop
3. Spark
4. Hive
5. Airflow
6. Trino
7. Jupyter
8. PySpark, DQ - Great Expectations
9. DQ - Data Brew
10. Databricks

• Would be benefits previous years of experience and a substantial understanding in:

1. Kafka
2. AWS pipeline orchestration technologies, such as Data Pipeline(in use), Step Functions, and Lambda (in use)
3. AWS data access/warehousing tools, such as Athena (in use) and Aurora
4. AWS Lake formation

• Strong problem solving, troubleshooting and analysis skills
• Able to mentor junior grade engineers
• Good knowledge of Agile Scrum
• Good communication skills
• English - Upper-Intermediate

Job Responsibilities:

• Develop and manage large scale data systems and ingestion capabilities and infrastructure
• Support Design and development of solutions for the deployment of dashboards and reports to various stakeholders
• Work directly with the business teams to rapidly prototype analytics solutions based upon business requirements
• Architect data pipelines and ETL processes to connect with various data sources
• Design and maintain enterprise data warehouse models
• Manage cloud based data & analytics platform
• Deploy updates and fixes and assist technical support

#LI-TY1

What We Offer

Empowering Projects: With 500+ clients spanning diverse industries and domains, we provide an exciting opportunity to contribute to groundbreaking projects that leverage cutting-edge technologies. As a team, we engineer digital products that positively impact people's lives.

Empowering Growth: We foster a culture of continuous learning and professional development. Our dedication is to provide timely and comprehensive assistance for every consultant through our dedicated Learning & Development team, ensuring their continuous growth and success.

DE&I Matters: At GlobalLogic, we deeply value and embrace diversity. We are dedicated to providing equal opportunities for all individuals, fostering an inclusive and empowering work environment.

Career Development: Our corporate culture places a strong emphasis on career development, offering abundant opportunities for growth. Regular interactions with our teams ensure their engagement, motivation, and recognition. We empower our team members to pursue their career goals with confidence and enthusiasm.

Comprehensive Benefits: In addition to equitable compensation, we provide a comprehensive benefits package that prioritizes the overall well-being of our consultants. We genuinely care about their health and strive to create a positive work environment.

Flexible Opportunities: At GlobalLogic, we prioritize work-life balance by offering flexible opportunities tailored to your lifestyle. Explore relocation and rotation options for diverse cultural and professional experiences in different countries with our company.

About GlobalLogic

GlobalLogic is a leader in digital engineering. We help brands across the globe design and build innovative products, platforms, and digital experiences for the modern world.

By integrating experience design, complex engineering, and data expertise-we help our clients imagine what's possible, and accelerate their transition into tomorrow's digital businesses.

Headquartered in Silicon Valley, GlobalLogic operates design studios and engineering centers around the world, extending our deep expertise to customers in the automotive, communications, financial services, healthcare and life sciences, manufacturing, media and entertainment, semiconductor, and technology industries.

GlobalLogic is a Hitachi Group Company operating under Hitachi, Ltd. (TSE: 6501) which contributes to a sustainable society with a higher quality of life by driving innovation through data and technology as the Social Innovation Business.