Competition Scoring Guide¶
Scoring Weights and Categories¶
Service Scans¶
20% of overall score.
An automated service scanner, IScorE, will attempt to access your services every 5 minutes. You will receive points for each of the required services that IScorE sees working properly when each check runs.
Please see the scenario for further details on the requirements of each of these services.
Documentation¶
10% of overall score.
Green Team Documentation¶
50% of documentation score.
Your team may turn in green team documentation which details how your users should access your network and its features. For more information, please reference the Competition Rules document.
White Team Documentation¶
50% of documentation score.
Your team may turn in White Team documentation which details how you designed and implemented your network, including any security controls and preventative measures. For more information, please reference the Competition Rules document.
Intrusion Reports¶
5% of overall score.
Your team may turn in an intrusion summary report every two hours. For more information, please reference the Competition Rules document.
Red Team Evaluation Score¶
10% of overall score.
Your red team score is computed based on three categories at the end of the competition. The “ideal” CDC team should have a perfect Red Team score.
Appropriate Measures¶
0-100 points
Did the team take appropriate measures to secure their network that would hold up in a real-world environment, both technically and politically (e.g., realistic limits on user accounts, appropriate intervention of user activities, not breaking functionality such as web-based file uploads, etc)?
Rational Responses¶
0-100 points
Did the team respond to attacks in a rational and appropriate manner that would be acceptable in a real-world situation, even if this was simply by having no response (e.g., not blocking large ranges of IP addresses, not killing users’ sessions [whack-a-mole], not removing the users’ web content)?
Spirit¶
0-50 points
A catch-all including, but not limited to: physical security, social engineering, overall conduct, and any factors determined to be noteworthy in a given competition.
Note
Overall conduct may include, but is not limited to: derogatory messages to red, white, green, or blue teams.
Red and Blue Flags¶
20% of overall score.
The flags represent a malicious hacker’s successful ability to write, read, or modify your mission-critical server data. Each flag is worth 100 points. This score starts at full credit at the beginning of the competition, and is reduced by 100 points every time a flag is captured or planted.
Blue teams have the ability to earn back up to 50 points of each of their lost flags. When a flag is captured or planted, the blue team has the option of describing exactly how their system was compromised, how the flag was planted or captured, and what they will do to prevent that from happening again in the future.
This earn-back system will be available to you on IScorE. The red team will see your submission and then subjectively give you 0-50 points depending on how well you have shown your understanding of the attack. Flags which were not planted will be not be eligible for earnbacks.
Green Usability¶
20% of overall score.
Throughout the competition, the green team will be checking the usability of your services. Here are some suggestions to ensure high usability scores:
- Reduce service outage. Green team cannot give any usability points for a service that they cannot access or doesn’t work.
- Provide detailed documentation. The better your green team documentation, the more likely green team will be able to understand how to navigate and use your services.
- Make sure user data persists. If the green team’s data randomly disappears (due to restoring of a snapshot with no data backups) you will lose usability points
- Be certain site functions work. Things like the development environment and the web server’s core application need to function correctly. For example, if green team uploads a file with the file uploader but then cannot access the file because of permissions, your team would lose usability points.
- Ensure your backup solution is working. The White and Green Teams may ask for your backups at any time during the competition. If you cannot provide them, you will lose points.
The green team will perform somewhere between 2-4 full service usability checks using your provided green team documentation throughout the competition. In addition to these full service checks, green team will also be checking the compliance of other requirements listed in the scenario. These will also factor into your green team usability score.
Green Team Anomalies¶
15% of overall score.
In the real world of IT, there is never a dull moment. Green team anomalies simulate the seemingly never-ending stream of requests that everyday IT employees must be prepared to handle.
Completion of non-required anomalies is optional. However, if you choose not to complete an anomaly, you will not be awarded any anomaly points for it. We leave it up to you, the blue team, to decide if completing an anomaly is worth the risk. For example, sometimes users want admin access!