REMOTE Data Engineers with Airbnb Job at S M Software Solutions Inc, United States

S0UxbXJIcXNwMUJDWFZia3J4ZmdXMTJ1RXc9PQ==
  • S M Software Solutions Inc
  • United States

Job Description

Client: Airbnb 
Title:  Data Engineers.  Remote.

 
JD:

Expertise:
5-9+ years of relevant industry experience with a BS/Masters, or 2+ years with a PhD
Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3)
Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks
Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse)
Excellent written and verbal communication skills
A Typical Day:
Design, build, and maintain robust and efficient data pipelines that collect, process, and store data from various sources, including user interactions, financial details, and external data feeds.
Develop data models that enable the efficient analysis and manipulation of data for merchandising optimization. Ensure data quality, consistency, and accuracy.
Build scalable data pipelines (SparkSQL & Scala) leveraging Airflow scheduler/executor framework
Collaborate with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to define data requirements, and deliver data solutions that drive merchandising and sales improvements.
Contribute to the broader Data Engineering community at Airbnb to influence tooling and standards to improve culture and productivity
Improve code and data quality by leveraging and contributing to internal tools to automatically detect and mitigate issues.
Skill Sets - Python, SQL (expert level),  Spark and Scala (intermediate).

 

Skills
Not every Data Engineer will require all of these skills, but we expect most Data Engineers to be strong in a significant number of these skills to be successful at Airbnb.

 
Data Product Management

  • Effective at building partnerships with business stakeholders, engineers and product to understand use cases from intended data consumers 
  • Able to create & maintain documentation to support users in understanding how to use tables/columns
Data Architecture & Data Pipeline Implementation
  • Experience creating and evolving dimensional data models & schema designs to structure data for business-relevant analytics. 
  • Strong experience using ETL framework (ex: Airflow) to build and deploy production-quality ETL pipelines.
  • Experience ingesting and transforming structured and unstructured data from internal and third-party sources into dimensional models.
  • Experience with dispersal of data to OLTP (ex: MySQL, Cassandra, HBase, etc) and fast analytics solutions. 
Data Systems Design
  • Strong understanding of distributed storage and compute (S3, Hive, Spark)
  • Knowledge in distributed system design, such as how map-reduce and distributed data processing work at scale
  • Basic understanding of OLTP systems like Cassandra, HBase, Mussel, Vitess etc.
Coding
  • Experience building batch data pipelines in Spark
  • Expertise in SQL
  • General Software Engineering (e.g. proficiency coding in Python, Java, Scala)
  • Experience writing data quality unit and functional tests.
  • Proficiency in Salesforce and understanding of its data structure. (Optional) 
  • Knowledge on Salesforce Bulk Operators. (Optional)

Job Tags

Remote job, Contract work,

Similar Jobs

Stay Strong Fitness

Health And Wellness Coach Job at Stay Strong Fitness

 ...ensure they're using equipment safely. This position requires excellent customer service skills as well as a passion for fitness and assisting others with their health and wellness. Please apply now if you have experience working in the fitness industry as an instructor... 

Tracy Electric Inc.

Accounts Receivable/Contract Administrator Job at Tracy Electric Inc.

 ...and estimators and ensuring reports are accurate Assist as a Payroll Clerk to ensure all time from the field is entered in the ERP...  ... A supportive and collaborative team environment Flexible remote work options [JE1]Previous: Requesting/Receiving/maintaining... 

Beacon Street Services

Proofreader Job at Beacon Street Services

Overview: We're looking for an enthusiastic, detail-oriented Proofreader to help the editorial team make sure our research goes out error-free. This position will report to the Executive Editor. Responsibilities: Scrutinize investment newsletters and e... 

恒诺微电子(嘉兴)有限公司

Power Semiconductor Die Bond Process Engineer Job at 恒诺微电子(嘉兴)有限公司

 ...mechanical engineering, Electronics engineering, material science or equivalent2)Min 3 years' experience in Discrete or Module semiconductor die attach or SMT engineering using ASM, ESEC, Yamaha(SMT), Datacon, others die bonder or SMT machine experience3)Solder and epoxy... 

Katsam, LLC

Pressure Washer Job at Katsam, LLC

 ...quarterly bonus after 90 days! (potential for an extra $2,000 each year!) We're a property maintenance contractor in need of a Pressure Washer. You will work in teams operating trailer-mounted pressure washing equipment to clean retail sidewalks and parking garages....