Contact tracing has become a major weapon against fighting the spread of diseases like SARS-CoV-2. Unfortunately, the ability to inform potentially infected people always comes with a downside to privacy, as contacts traced could also be misused in other contexts. In this paper, we present CampusTracer, a novel contact tracing system specialized for university campus environments. Based on an in-depth analysis of existing contact tracing approaches and university-specific requirements, we elaborate a Privacy-by-Design solution to contact tracing that caters for most real-world requirements while preserving the privacy of its users in a best-possible way.