Building a world where people can safely discover, create and connect. The Trust & Safety (T&S) team at TikTok helps ensure that our global online community is safe and empowered to create and enjoy content across all of our applications. We have invested heavily in human and machine-based moderation to remove harmful content quickly and often before it reaches our general community.
About Training & Quality (TnQ) Team
The Ground Truth team works as the representative of TnQ that provides final judgment for video content,
including the correct answer, vagueness, difficulty, etc. They should work with the Policy team regarding
Policy cascading and alignment in the market. Meanwhille, they work with moderation teams on calibration,
reporting, and quality improvement. But they're not participating in other ad-hoc or on-call-related requests.
Content that Content Quality Assurance interacts with includes images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child safety; depictions of harm to self and others, and harm to animals
What will I be doing?
Quality Evaluation:
- Provide Ground truth: Conduct quality assessment work by ensuring ground truth for regular moderation quality measurement (GT Sampling), CGVR, and TCOR labeling
- Provide quality analysis: Conduct root cause data analysis and summary of findings, as well as provide quality reports.
Quality improvement:
- Calibration: Be the owner of the calibration process and outcome for sampling and GA error and ensure an accurate understanding of localized policy amongst moderation teams by aligning the interpretation and policy understanding.
Policy Updates and Policy Feedback:
- A: Enhance the enforceability of new policy updates by highlighting foreseeable policy gaps caused by vague guidelines.
- B: To consistency between all policy documents and any subsequent updates. Escalating policy gaps to the Policy Team. Escalate policy issues to the Policy Team to pursue a further solution. Policy Understanding /Policy Cascading: Ensure that all policy roll-outs can be understood and delivered to all team-related teams.
- Vague: Escalate vague cases/policy titles to the Policy team and follow up on action plans
- Tooling improvement: Work with Platform and Algo teams to optimize moderation-assisted tooling
Report job
