Save Job Back to Search Job Description Summary Similar JobsWork with cloud and big data technologies at scaleShape critical business decisions through dataAbout Our ClientOur client is a major e-commerce and technology organization operating one of Japan's largest online marketplace platforms. The business leverages modern cloud and data technologies to manage high-volume transaction data and deliver data-driven services across a large and complex digital ecosystem.Job DescriptionDesign, build, and optimize large-scale batch and streaming data pipelines using Spark, Kafka, Spark Streaming, Python, and Google Cloud PlatformDevelop and maintain data infrastructure supporting a high-traffic e-commerce platformAutomate data ingestion and processing workflows to improve efficiency and reliabilitySupport the migration of data platforms and workloads from on-premises environments to Google Cloud PlatformOperate and maintain applications responsible for processing large-scale datasetsResolve complex data storage, retrieval, and performance challengesMonitor, troubleshoot, and support production systems using logging, alerting, and monitoring toolsCollaborate with engineering teams, stakeholders, and cross-functional partnersContribute to technical leadership initiatives and project deliveryDeliver scalable, reliable, and high-quality data solutions that support business-critical metrics and insightsThe Successful Applicant5+ years of experience as a Data EngineerHands-on experience developing and operating Spark and Kafka applicationsStrong programming skills in Python, Java, or ScalaExperience with Google Cloud Platform and BigQueryAdvanced SQL and relational database expertiseProven experience building and optimizing large-scale data pipelines and datasetsExperience with Docker, Kubernetes, and infrastructure managementStrong understanding of data modeling conceptsLinux development experienceStrong analytical and problem-solving skills related to data processing and transformationExperience managing projects and delivering high-quality technical solutionsBusiness-level Japanese communication skills (reading, writing, and speaking)Conversational-level English communication skillsPreferred QualificationsExperience working with large-scale big data environmentsDatabase administration and performance tuning experienceStrong understanding of DevOps and microservices architectureExperience with Jenkins or other CI/CD toolsScrum or Agile development experienceExperience with Looker semantic layer developmentPrevious experience leading or mentoring software engineering teamsWhat's on OfferOpportunity to work with one of Japan's largest e-commerce data ecosystemsExposure to modern cloud, streaming, and distributed data technologiesLong-term project with strong business impactInternational and collaborative engineering environmentWork on data solutions that directly influence business growth and customer experienceStandard working hours: 9:00 AM to 5:30 PMWeekends and public holidays offContactSerena WuQuote job refJN-092026-7115218Phone number+81 3 6627 6137Job summaryFunctionITSpecialisationDatabase EngineeringSpecialisationTechnology & TelecomsLocationTokyo 23 WardsJob TypeTemporaryConsultant nameSerena WuConsultant phone+81 3 6627 6137Job ReferenceJN-092026-7115218Company TypeForeign Multinational