Office Data Loader team is hiring a Software Engineer to build one of the most largest hyper-scale data ingestion service in the world for Office365 services.
With hundreds of millions of users using Office365 services, huge amount of data are generated every day. Data is mission critical for Office365 services. It helps engineering teams to understand the quality of live services, generate insights of feature usage and user behavior, troubleshoot bugs and issues. It also offers better visibility to product and management teams on business impacts, empowers product and scientist teams to build intelligence features.
To support the continuously growth of business needs from Office365, Office Data Loader team builds the hyper-scale distributed data ingestion service. We directly manages the ingestion service on more than 300,000 Exchange Online machines, which upload more than 30,000 TB data to our hyper-scale distributed storage every day. We also support the ingestion service running on even more machines for other Office365 products.
As the fundamental data ingestion service, we play an incredibly important role to make sure data uploading meet the privacy and compliance requirements. Sensitive data needs to be transformed to prevent privacy leaks or ne. Moreover, privacy leak detection and resolution are also built by us as the safeguard. User data that empowers Machine Learning scenarios has even higher requirements on the design of our service. Privacy and compliance are always our top priority, because Microsoft runs on Trust!
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Responsibilities
The quality of the service means a lot for the success of Office365 services. You will have plenty of opportunities to take on challenges to achieve high uploading completeness (>99.9%) and make sure privacy and compliance requirements are always met.
Design and build high quality, performant and reliable distributed ingestion service.- Design and build modernized telemetry/monitoring/reporting systems to get the insights of service quality.
- Improve service performance and efficiency to reduce COST of service.
- Work with downstream data consumer teams in different geo locations to onboard data ingestion service, and provide supports in daily work.
- Work with privacy & compliance teams to design and build solutions to prevent/detect/resolve privacy issues, also provide guidance and best practice for engineering teams within Office365.
- Responsible for the daily operations and maintenance of the live service and ensure quality of service.
- Collaborate with other Office365 teams to manage their data ingestion service, provide solutions and guidance.
Qualifications
Required Qualifications:
-
Bachelor's Degree in Computer Science, or related technical discipline with proven experience coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Solid coding skills (No requirements on certain language, assuming the candidate can demonstrate fast learning).
-
Solid Computer Science fundamentals.
-
Solid problem analysis and solving skills.
-
Solid communication skills. (Good written English, Avg+ oral English).
-
Passionate to solve hard problems.
-
Passionate to learn new skills/knowledge.
-
Knowledge and experience of distributed system, large-scale big data platform technologies is a plus.
-
Knowledge and experience of performance tuning is a plus.
- Knowledge and experience of data privacy is a plus.
Other Requirements:
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
- Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Preferred Qualifications:
-
Bachelor's Degree in Computer Science
- OR related technical field AND 1+ year(s) technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Master's Degree in Computer Science or related technical field with proven experience coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
#M365Core