Lead Data Engineer Job at Biogensys, Remote

Qlg5UkVsLzBSMW5HZGVvSjNhLzZwUXo5NXc9PQ==
  • Biogensys
  • Remote

Job Description

We are hiring a Lead Data Engineer Remote for one of our clients.

Job Description:

  • Develop and enhance ETL pipelines used by UDP platform
  • Contribute to the implementation of key requirements as defined in Phase 1 discovery.
  • Automate implemented requirements as appropriate, including infrastructure as code and runbooks.
  • Document processes and standard operating procedures.
  • Ensure the platform meets defined requirements.

Skills/Technology Needed:

  • Experienced with Python, PySpark and SQL
  • Automation and CI/CD skills, unit and integration testing
  • Familiarity with orchestration and ETL solutions
  • Hands-on experience with AWS Services (Redshift, Glue, LakeFormation, Lambda)
  • Understanding of AWS Least Privilege Security Model and AWS Security Model (IAM)
  • Experience with Microsoft Office (Word, Excel, Powerpoint)
  • Experience with handling data in Open Table formats (Iceberg, Parquet, Delta Format). Big Data Handling Understanding of such as Buckets and Partitioning
  • (Lead) Understanding of PySpark, Glue job optimization techniques to improve operations.

Additional information:

  • Location: Remote
  • Job Type: Contract
  • Duration: 4 Months
  • Interview process: 3 interviews.

About Us:

We are specialized in recruiting and deliver the best professional talent of industry and we are committed to deliver best experience for our clients and job seekers. With over two decades of experience in the recruitment industry, we proudly help you to find the next job that matches your professional skills. Our team understands your needs or requirement before starting the recruitment, that enables to find the high quality of talent with high success rate of talent delivery, keeps us continue to be the best in the industry. By responding to this job posting, you are consenting to receive text/SMS messages from us. Thank you.

Job Tags

Contract work, Work at office, Remote work,

Similar Jobs

Ripple Effect

Web Developer (NIH, CMS) Job at Ripple Effect

 ...mission. This role will work closely with other teams to oversee the development of high-quality websites, collaborate with designers and...  ...elements such as user interface features, site animation, web apps, special effects, databases, and e-business applications Integrate... 

Schneider

Owner-operator Reefer truck driver - Kroger Job at Schneider

 ...trailer hauling frozen and refrigerated goods. ~ Approximately 10% driver assist pallet jack unloads. ~ Approximately 30% drop-and-hook...  .... ~ Drive within IN, MI, OH and WV. Owner-operator Truck Drivers are eligible for: ~ Get $228 on your second settlement... 

IICRC

Janitor Job at IICRC

 ...required ~ Opens and locks facilities, enable and disable security system as required. ~1-2 years' experience as a custodian, janitor, housekeeper a plus but not required ~ Will provide on the job training to those with strong work ethic and willingness to learn.... 

Blayzer Digital

Digital Marketing Intern Job at Blayzer Digital

One of the best digital marketing agencies in St. Louis has an internship program to help you learn the ropes and gain experience with real web and marketing projects. Want in?Blayzer interns learn how to create and optimize marketing content, manage professional social... 

IMI

Local Truck Driver - Class B CDL Job at IMI

 ...commercial drivers in your area. We have multiple CDL Driver positions available. Class "A" or "B" CDL Required ~ Local Delivery Only ~ No Overnights ~ Competitive Pay ~ Low-Priced Family Medical Benefits ~ Paid Holidays ~ Daily Overtime after 8...