Hi - would it be possible to have the validator return a list of all the ‘errors’ in IATI data, and then e.g. the number of cases for each one (grouped by error, not by the datafile)? I think the validator stores runs tests on the data in the background so this might be feasible? Or maybe it would be a specific job that looped through all the files - perhaps possible via the validator API?
+1 month bump @IATI-techteam any ideas? It would be useful to see where the majority of errors were to know which parts of the standard needed most work?
Thanks @matmaxgeds. Apologies for very slow response on this!
-
As you know, the validator validates single files. For each file you can see the errors presented as you suggest, but currently not a summary for all files.
-
To your point on being able to see a list of all errors, we are actually now working on developing a feature to be added to the validator that gives you a summary of critical, errors and warnings per publisher to support measures in the IATI Results Framework. This will not yet include the detailed summary for specific error types that you suggest. I agree it is indeed something that will be useful to have in the future, and that we can look into, but we are now prioritising the measure for the results framework.
-
On the public API, currently there is no public API for the validator. With the launch of the validator, we have been engaging with publishers directly and are now starting to consult on user requirements for a public API.
Hope this helps but happy to speak if more helpful.
Thanks @IATI-techteam - as a non publisher, but with a data use hat on, I am trying to figure out how the Validator could be made useful e.g. “what is the most common error in element X”, or what errors have gone longest without being fixed etc.
We have something like this in our IATI CoVE tool
Specifically, we added this on the ruleset tests, so you can group the feedback by activity or by ruleset. Is that what you meant @matmaxgeds ?
Here’s an example on the first dataset listed as invalid on the IATI dashboard
Added bonus: you can then convert that IATI XML into a spreadsheet - whereby the one-to-many aspect of IATI is pushed into relevant sheets. I find this super useful!
Thanks…the ability to swap between ‘see results by ruleset’ and ‘by activity’ feature is very helpful e.g. if I have a publisher for whom we are having difficulty parsing their data for a specific element, then this is much easier that going through each activity one-by one (as I think is the option in the new validator?)