USM Business Systems · Portland
Data & AIContractposted 118mo ago
Hi,
We have immediate opportunity with our direct client send your resume asap upon your interest. Thank you.
Position: Sr Big Data Engineer
Location: Beaverton, OR.
Duration: Long Term
Skills
Typical Office: This is a typical office job, with no special physical requirements or unusual work environment.
Core responsibilities: Expert data engineers will work with product teams across client to help automate and integrate various of data domains with a wide variety of data profiles (different scale, cadence, and volatility) into client's next-gen data and analytics platform. This is an opportunity to work across multiple subject areas and source platforms to ingest, organize, and prepare data through cloud-native processes.
Required skills/experience:
- 5+ years of professional development experience between either Python (preferred) or Scala/Java; familiarity with both is ideal
- 5+ years of data-centric development with a focus on efficient data access and manipulation at multiple scales
- 3+ years of experience with the HDFS ecosystem of tools (any distro, Spark experience prioritized)
- 3+ years of significant experience developing within the broader AWS ecosystem of platforms and services
- 3+ years of experience optimizing data access and analysis in non-HDFS data platforms (Traditional RDMS's, NoSQL / KV stores, etc)
- Direct task development and/or configuration experience with a remote workflow orchestration tool – Airflow (preferred), Amazon Data Pipeline, Luigi, Oozie, etc.
- Intelligence, strong problem-solving ability, and the ability to effectively communicate to partners with a broad spectrum of experiential backgrounds
Several of the following skills are also desired:
- A demonstrably strong understanding of security and credential management between application / platform components
- A demonstrably strong understanding of core considerations when working with data at scale, in both file-based and database contexts, including SQL optimization
- Direct experience with Netflix Genie is another huge plus
- Prior experience with the operational backbone of a CI/CD environment (pipeline orchestration + configuration management) is useful
- Clean coding practices, passion for development, being a generally good team player, etc, etc (and experience with GitHub) is always nice
Keys to Success:
- Deliver exceptional customer service
- Demonstrate accountability and integrity
- Be willing to learn and adapt every day
- Embrace changeSkills
Regards
Nithya
All your information will be kept confidential according to EEO guidelines. please send the profiles to nithyar(at)usmsystems.com and contact No# 703-794-2380.