Series A, well-funded US startup in HRTech developing WorkHQ.com and an AI Recruiter product.
This is a US-only, Remote role (Mainland).
Lead data infrastructure architect managing billions of data points across 250M+ professional profiles.
Hire data engineers to aid you in that journey.
Design scalable data pipelines processing massive record volumes
Architect ETL processes using PySpark on Amazon EMR (Open to shifting to other solutions like Data Bricks / Snowflake)
Distribute enriched data through medallion architecture across Postgres, Athena, OpenSearch
Integrate new data sources into the main pipeline
Implement advanced data matching using Splink
5-8 years professional data engineering experience
Good proficiency in:
PySpark and distributed computing
AWS data services (EMR, Glue, Athena)
Docker
Pandas and DataFrame manipulation
Complex data format handling (JSONL, Parquet)
Strong background in:
Big data processing architectures
Data warehouse design
Performance optimization
Advanced Python, SQL skills
Probabilistic record linking expertise
OpenSearch/elasticsearch technologies
Machine learning data pipeline design
Recruitment tech ecosystem knowledge
Big Data: PySpark, EMR
Databases: Postgres, OpenSearch
Cloud: AWS
Containerization: Docker
Data Formats: JSONL, Parquet
Analytics: Metabase, Athena, Glue
Data Processing: Pandas, Splink
While this role has specific requirements - if you lack a few technical skills, but motivated to learn and lead the platform, please apply for consideration.
If you are coming from Director/Head of/VP levels that is relevant to this job, you can apply as well.
You will need to apply directly on our platform.
Thank you for your time.
...applying so that you know what kind of videos we create: Job Description Were looking for flexible, creative, and ambitious writers to create, edit and review video scripts. You must be able to generate great ideas and write scripts/treatments for a wide variety...
Overview: Beer Barrel Pizza & Grill is seeking motivated and reliable candidates to join our team! Expos will assist with food preparation, tray setup, plate presentation, food running, and kitchen cleaning and sanitation.Expeditors are required to communicate effectively...
We are seeking a professional, detail-oriented Receptionist to support our fast-paced law firm. This hybrid role is essential in ensuring smooth daily operations, serving as the first point of contact at the front desk while providing backup administrative support to...
...Content Writer Job Duties: Writing Take podcast episodes and turn them into amazing blogs, LinkedIn posts, and show notes that flatter... ...in feedback loops with customers, the producer, and the Creative Director to make sure our workflows and customer satisfaction are...
...Dermatology Physician at Renown Health summary: A Dermatology Physician at Renown Health provides specialized medical care for skin conditions within a dynamic, multi-specialty medical group serving Northern Nevada and surrounding regions. The role involves collaborating...