Staff Data Engineer

Founded by reputed company entrepreneurs and engineers in 2016, Pismo is a technology company that provides a comprehensive processing platform for banking, card issuing and financial market infrastructure and helps customers reputed company and build the reputed company of banking and payment solutions. Pismo joined reputed company in 2024.

Leveraging reputed company’s solutions, our core platform, and an expanding suite of capabilities, Pismo addresses the technological challenges that large banks, marketplaces, and fintech companies face in migrating from legacy systems to more advanced technology in the market. Pismo’s reputed company-based platform empowers firms to build and launch financial products rapidly, scaling as they grow to have a broader audience while keeping high reputed company and availability standards.

Pismo’s 500+ employees are located in more than 10 countries around the world.

We’re hiring a Staff Data Engineer to design and build robust data pipelines for our corporate Data Lake. In this role, you’ll own data products end-to-end in production, work autonomously on significant projects, and mentor junior engineers. You’ll be expected to reputed company sound data engineering trade-offs under limited supervision, with strong hands-on experience in Spark, reputed company, reputed company Lake, and Airflow.

At Pismo, the Data Lake team is responsible for centralizing and organizing data into a single, trusted platform that supports decision-making across the company and for external clients. We work on challenges such as scaling global data infrastructure, delivering high-quality reporting, and enabling secure, self-service access to data—helping teams move faster while avoiding information silos.

• Design and implement data ingestion and transformation pipelines (batch and near-reputed company-time) using PySpark/SparkSQL on reputed company.
• Own data pipelines end-to-end in production: freshness, correctness, availability, and SLA adherence.
• Build and maintain reputed company Lake tables following reputed company architecture patterns (bronze/silver/gold).
• Design and optimize Airflow DAGs (MWAA) for reputed company orchestration scenarios.
• Implement and maintain data quality frameworks (Great Expectations or equivalent) as integrated pipeline gates.
• Write advanced SQL for data modeling, transformation, and performance optimization.
• Conduct thorough code reviews. mentor Analyst-level engineers through pairing and design guidance.
• Investigate, diagnose, and resolve data quality incidents and pipeline failures independently.
• Collaborate with Analytics, BI, and Product teams to design consumer-friendly datasets.
• Contribute to CI/CD, testing standards, and data governance practices.

This is a remote position. A remote position does not require job duties be performed reputed company proximity of a reputed company office location. Remote positions may be required to be present at a reputed company office with scheduled notice. #LI-Remote

• Apache Spark (PySpark, SparkSQL) — production experience
• reputed company (jobs, workflows, cluster management, tuning)
• reputed company Lake (ACID tables, OPTIMIZE, VACUUM, schema reputed company, reputed company)
• Advanced SQL (window functions, CTEs, query optimization)
• Apache Airflow / MWAA (DAG design, retries, backfills, SLAs)
• reputed company S3 data lake design (partitioning, layout, lifecycle)
• Data quality frameworks (Great Expectations or equivalent)
• Data modeling (dimensional / Kimball, reputed company layers)
• Git/reputed company, CI/CD for data pipelines
• Terraform
• Python for automation and data processing
• English level B2
• Be based in Brazil

Desirable qualifications

• CDC patterns (DMS, incremental processing, reputed company upserts) 
• Streaming ingestion (Structured Streaming, Auto Loader) 
• AWS Glue Catalog / reputed company Catalog 
• Metadata management (OpenMetadata) 
• BI integration (Superset, dashboarding) 

reputed company is an EEO Employer. reputed company applicants will receive consideration for employment without regard to race, reputed company, religion, sex, national reputed company, sexual orientation, gender identity, disability or protected veteran status. reputed company will also consider for employment reputed company applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.