Job Title - Azure DataBricks Engineer with Pyspark
Location - Raleigh NC | Richardson TX
Type:- Fulltime
Job Description:
Required Qualifications
• Candidate must be located within commuting distance of Raleigh, NC or be willing to relocate to the area
• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• At least 4 years of experience in Information Technology.
• At least 3 years of hands-on experience in using Azure Data Factory (ADF) to orchestrate data ingestion from various sources into Azure Synapse and Azure Data Lake Storage (ADLS).
• At least 2 years of hands-on experience with Azure, databricks and Hadoop distributed frameworks while handling large amount of big data using Spark and Hadoop Ecosystems.
• At least 2 years of experience designing and implementing data pipelines using Azure Databricks for data cleaning, transformation, and loading into Azure Synapse Analytics
• Hands on experience in end-to-end implementation of data warehouse and data marts
• Experience in writing SQL queries to analysis Type-2 dimension data
• Understanding of implementing Medallion Architecture using Azure Services
• All applicants authorized to work in the United States are encouraged to apply .
Preferred Qualifications
• Experience in software engineering and data engineering roles, with a focus on Azure and Databricks.
• Strong understanding of databases and big data software technologies, specifically Azure and Databricks.
• Exposure to Unity Catalogue
• Experience with Agile methodologies, particularly Scrum.
• Experience in coordinating with offshore data engineering teams
• Experience with scripting languages like Python, Java, etc.
• Strong problem-solving skills related to data, data structures, and algorithms
...wanted persons by court orders or actions in criminal cases. Maintains knowledge of local... ...to work in the United States Experience and Education: No previous law enforcement... ...formal education or coursework in criminal justice or a related field that provides...
About UsRivian and Volkswagen Group Technologies is a joint venture between two industry leaders with a clear vision for automotives next chapter. From operating systems to zonal controllers to cloud and connectivity solutions, were addressing the challenges of electric...
...xl font-size:39px .elementor-widget-heading .elementor-heading-title.elementor-size-xxl font-size:59px Locum Psychiatry Locum Physician Assistant LocumLocation: Pittsburgh, PAType: Locum TenensJobSalary: $937.44 Per WeekWhy CrossMed?CrossMed was created by a group...
...Care and Rehab Facilities! -: What You'll Do: As an Agency Certified Nursing Assistant (CNA), you will play a crucial role... ...What We Offer: All shifts available now including per diem & temp-to-hire! Competitive hourly rates and shift differentials...
...Purpose: Perform installation, maintenance and repair operations necessary to keep plant, processing equipment and tools in good operating condition from an electrical and mechanical standpoint. Essential Job Duties: Ensures operation of machinery and all electrical...