Data Engineer, Spark / AWS data infrastructure (Remote, Full-time) — Micro1 via AI Gig Scout

micro1 is hiring a Data Engineer, full-time and remote, to build and scale the data infrastructure that powers AI-driven products and research initiatives. The listed base salary range is $100,000–$150,000 USD a year. You will develop distributed data pipelines, manage large-scale datasets across cloud environments and design reliable data systems for data processing, experimentation and model development at scale.

Key responsibilities: design, build and maintain scalable pipelines that ingest, process and transform large datasets from multiple sources; develop and optimize distributed processing workflows with Spark and cloud-native technologies; build and maintain SQL and NoSQL storage for scalability, performance and reliability; design data architectures on AWS for high-volume ingestion, processing and distribution; write efficient Python and SQL; ensure data quality, integrity, monitoring and operational reliability; collaborate with AI researchers, data scientists and engineering teams; and implement automation, orchestration and monitoring workflows.

Requirements: strong Python, SQL and distributed processing frameworks such as Apache Spark; hands-on AWS data services and cloud-native data architectures; experience with both SQL and NoSQL databases; managing and processing large-scale datasets in distributed environments; and a strong understanding of data partitioning, performance optimization and scalable architectures. Nice to have: exposure to AI/ML workflows, data visualization tools (Matplotlib, Seaborn, Plotly) and LLM-related data workflows.

Details and apply link: https://aigigscout.com/jobs/micro1/data-engineer-4e941f66?utm_source=kubernetesjobs&utm_medium=jobboard&utm_campaign=aigigscout_growth

Disclosure: posted by AI Gig Scout, an independent listing site (not Micro1). The apply link may be a referral link.