Hadoop/Dataproc Platform Analyst
We are seeking a highly skilled Hadoop/Dataproc Expert to support a strategic initiative focused on the reverse engineering, analysis, and retirement/migration of our existing Hadoop/Google Cloud Dataproc platform. This role is critical to enabling the project team to fully understand the current data ecosystem and prepare for a seamless transition.
Key Responsibilities:
Platform Analysis & Assessment: Conduct a comprehensive review of the Hadoop/Dataproc environment, including cluster configurations, resource usage, and job execution patterns. Identify and document all active components, services, and dependencies.
Data & Metadata Extraction: Pull and catalog all data sources, datasets, and associated metadata across the platform. Map data lineage and relationships to support reverse engineering efforts.
Feed & Log Analysis: Analyze incoming and outgoing data feeds, including batch and streaming pipelines. Review system logs, audit trails, and job histories to identify integration points and data flow patterns.
Collaboration & Documentation: Work closely with data engineers, architects, and project leads to provide insights and technical guidance. Document findings in a structured format to support migration planning and platform decommissioning.
Required Skills & Experience:
Proven expertise in Hadoop ecosystem (HDFS, Hive, Pig, Spark, etc.) and Google Cloud Dataproc.
Strong understanding of platform management, including cluster operations, job orchestration, and performance tuning.
Familiarity with cloud migration strategies and legacy platform retirement best practices.
Excellent analytical, communication, and documentation skills.
...7 Bertner Ave before being deployed to work from home. Please confirm with your candidates that... ...Three years experience in healthcare, insurance, or related field. With preferred... ....00 per hour Benefits: ~401(k)~ Health insurance ~ Life insurance Work...
...! Position Summary: As a Document Entry Clerk, you will be responsible for coordinating... .... ~1 year of work experience in data entry and document processing is preferred... ...Ave, Buena Park CA 90620. Benefits: ~ Medical, Vision, Dental, and Life Insurance. ~4...
Endoscopy RN Req ID: 63360 Must have AK RN license in hand for Auto Offer. Assignment Length: 13 or 26 Weeks available Start Date:ASAP Shift: 4x10 Days (40Hrs) Years of Experience: 1 First Timers Accepted: Yes Certs REQ: BLS, Preferred: ACLS, PALS, SGNA Cert Skills REQ:...
Well established practice in central Florida continues to see growth. The group is now looking to adda BE/BC Gastroenterologist.Monday to Friday with shared call - call is lightAbout a 60/40split between office and hospital - could be more office if desiredVery ...
Gaurdicore Network Segmentation Specialist Location Texas City, TX : Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation...