Spaces:
Running on CPU Upgrade

iadyen commited on
Commit
8ea031e
·
verified ·
1 Parent(s): 982910d

Edit validation message

Browse files
Files changed (1) hide show
  1. dabstep_benchmark/content.py +6 -6
dabstep_benchmark/content.py CHANGED
@@ -50,13 +50,13 @@ VALIDATION_GUIDELINES = """
50
 
51
  All submissions are initially added to the **Unvalidated Leaderboard**. The Adyen/Hugging Face team will attempt, with the participation of the respective submission team, to validate any entries that rank within the top 10.
52
 
53
- **Validation** confirms that a submission's results were achieved using a novel approach involving data analysis agents. To support validation, participants must provide clear evidence of their methodology. This can be done in one of the following ways:
54
 
55
- - **Preferred:** Share a research paper or blog post along with the source code to enable full reproducibility.
56
- - Submit a complete dataset that includes **reasoning traces** demonstrating how the results were produced.
57
- - Provide access to an **API** that the Adyen/Hugging Face team can use to independently validate and reproduce results.
58
 
59
- Our goal with **DABStep** is to foster rapid progress and collaboration in the open research community. We strongly encourage participants to share their work and open-source their code whenever possible.
60
 
61
- Once validated, submissions will be featured and showcased on the **Validated Leaderboard**, including annotations indicating the validation method used (e.g., `traces`, `code`, `API`).
 
 
62
  """
 
50
 
51
  All submissions are initially added to the **Unvalidated Leaderboard**. The Adyen/Hugging Face team will attempt, with the participation of the respective submission team, to validate any entries that rank within the top 10.
52
 
53
+ **Validation** confirms that a submission's results were achieved using a novel approach involving data analysis agents.
54
 
55
+ ### Notice Regarding Validations
 
 
56
 
57
+ **Validation requests are closed.** With DABStep-v2 launching in the coming weeks, we are no longer accepting new validation requests. The Validated Leaderboard is now closed to new entries; previously validated submissions remain as-is.
58
 
59
+ The Unvalidated Leaderboard remains open — you can still submit and receive a score.
60
+
61
+ Thank you to everyone who has contributed to DABStep so far. We're excited for the next phase of this benchmark and will share more details on v2 soon.
62
  """