We are seeking a Pyspark Developer to build robust data processing solutions on Azure Cloud using PySpark to drive innovation within the financial services industry. Our challenge is to leverage extensive PySpark experience and hands-on expertise in Azure Cloud to navigate the complexities of big data, ensuring compliance with industry standards while delivering impactful results. We aim to rapidly adapt to evolving technologies and create scalable data solutions that enhance operational efficiency and decision-making.
Responsibilities:
Develop, maintain, and optimize data processing pipelines using PySpark on Azure Cloud.
Collaborate with cross-functional teams to understand data requirements and translate business needs into technical specifications.
Design and implement scalable data models and data architecture to support analytical and reporting needs.
Perform data cleansing, transformation, and enrichment processes to enhance data quality and usability.
Monitor and troubleshoot data processing jobs, ensuring high availability and performance.
Implement best practices for data governance and security within Azure Cloud.
Stay up-to-date with emerging technologies in big data, cloud computing, and the financial services industry.
Requirements:
Minimum of 9 years of experience in PySpark development.
Proven experience working with Azure Cloud services (Azure Data Factory, Azure Databricks, etc.).
Prior experience in the banking, investment banking, or financial services sector is mandatory.
Proficient in PySpark for data processing and ETL tasks.
Experience with SQL and NoSQL databases.
Familiarity with data warehousing concepts and tools.
Knowledge of Azure services related to big data and analytics.
Preferred, but not required:
Experience with containerization technologies (e.g., Docker, Kubernetes).
Familiarity with machine learning frameworks (e.g., MLlib, TensorFlow).
...challenging and constantly evolving game. WHO YOULL WORK WITH As the Manager, Marketplace Supply Chain for DSG, you will use your leadership skills, cross-functional business knowledge, and supply-chain expertise to deliver product...
...seeking an experienced Associate Litigation Attorney to join our team in the Law Practice in San Diego, LA or in SF. This can be a remote/hybrid role. As a full-time Litigation... ..., motions, briefs, and other legal documents Prepare for and participate in depositions...
Windwalker Transportation is hiring an experienced Heavy Duty Truck Mechanic. If you want to join an experienced maintenance crew and a company that treats you like family, look no further! Job Requirements At least 3 years of experience with diesel fleet mechanical...
Our people are the heart and soul of our business, and we are on the hunt for talented, driven, and caring individuals to become a part of our Leadership Team. Whether you are looking to gain and practice valuable leadership skills or take the next step to learn more about...
About Us: Haven Staffing Solutionsis a task force staffing agency. Wea re looking for aBartenderto work at a Restaurant Located in Haven Park Hotel which is located in te Bronx. ***OPEN HOUSE: Tuesday - Wednesday - Thursday - June 3rd, 4th and 5th , 2025 from...