Data Engineer
Beaverton Oregon
Contract-6 Months+
Lead Consultant- Data Engineer
In this role, you will be responsible for coding, testing and delivering high quality deliverables, and should be willing to learn new technologies.
Responsibilities
Design and build reusable components, frameworks and libraries at scale to support analytics products
Design and implement product features in collaboration with business and Technology stakeholders
Identify and solve issues concerning data management to improve data quality
Clean, prepare and optimize data for ingestion and consumption
Collaborate on the implementation of new data management projects and re-structure of the current data architecture
Implement automated workflows and routines using workflow scheduling tools
Build continuous integration, test-driven development and production deployment frameworks
Analyze and profile data for designing scalable solutions
Troubleshoot data issues and perform root cause analysis to proactively resolve product and operational issues
Qualifications we seek in you!
Minimum Qualifications
Strong understanding of data structures and algorithms
Strong understanding of solution and technical design
Has a strong problem solving and analytical mindset.
Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders
Able to quickly pick up new programming languages, technologies, and frameworks
Experience building cloud scalable, real time and high-performance data lake solutions
Fair understanding of developing complex data solutions
Experience working on end-to-end solution design
Willing to learn new skills and technologies
Has a passion for data solutions
Preferred Qualifications/ Skills
Hands on experience in Databricks and AWS - EMR [Hive, Pyspark], S3, Athena.
Familiarity with Spark Structured Streaming
experience working experience with Hadoop stack dealing huge volumes of data in a scalable fashion
hands-on experience with SQL, ETL, data transformation and analytics functions
hands-on Python experience including Batch scripting, data manipulation, distributable packages
experience working with batch orchestration tools such as Apache Airflow or equivalent, preferable Airflow
working with code versioning tools such as GitHub or BitBucket; expert level understanding of repo design and best practices
Familiarity with deployment automation tools such as Jenkins
hands-on experience designing and building ETL pipelines; expert with data ingest, change data capture, data quality; hand on experience with API development
designing and developing relational database objects; knowledgeable on logical and physical data modelling concepts; some experience with Snowflake
Familiarity with Tableau or Cognos use cases
...other days by their manager. Department Overview GBH News creates and broadcasts original content on multiple platforms including Radio, TV, and Digital. GBH News team covers and produces local and national news including in-depth feature stories and interviews,...
...close at 12:01 a.m. CT on the specified Closing Date (if designated). Working Title: Assistant Professor of Entertainment and Theatre Arts - IFO Institution: Southwest Minnesota State University Classification Title: State University Faculty...
...saving capabilities. Position Summary: The Frontend Software Developer is instrumental in developing and implementing high-quality, intuitive, and visually appealing user interfaces for our web applications, leveraging Telerik UI components within a Blazor...
...Communications wants fresh, bold talent to train as the next digital superstar. Dont sweat your resume. We want ambition, charisma... ...,000 or more (seriously) Complete professional training, no experience needed Fully remote career The freedom to manage your own...
...Doral Health & Wellnessis hiring a dedicatedPatient Care Technician (PCT)to join our growing dialysis team in Brooklyn, NY. As aPCT technicianin our unit, youll play a vital role in supporting patients with kidney disease by delivering safe, hands-on care under the...