Improving The Data

How We Measure the “Health” of a Project Record

The purpose of AidData’s “Health of Record” methodology is to rate the completeness and verifiability of each project record. The methodology produces a source triangulation and a field completeness score. Our team uses these scores to prioritize project records that require further investigation and validation; they can also be used by external users to isolate and analyze project records with varying levels of data quality. The public disclosure of these data quality scores is part of a larger effort at AidData to be as transparent as possible about the data it produces through the Tracking Under-reported Financial Flows (TUFF) methodology. For more information on how you can help improve the “health” of a particular project record, please see the section titled, "Improving the Data".
Source Triangulation Score: This score, which varies from 0 to 20 (with higher scores representing better-sourced project records) is designed to capture the diversity and quality of sources and source types used to construct individual project records. These sources not only include those codified in the TUFF methodology (e.g. media reports, government documents, and scholarly articles), but also sources gained via ground-truthing efforts. 

Base Score: The base score is determined by the number of media reports used to source a project.  It is informed by the actual distribution of sources in the database.

  • Projects receive 1 point for each additional media report (2 and above)
  • Points will be capped at 4 because of the diminishing value of additional media sources (due to repetition of information).

Value Added Score: This score awards extra points to project records that are sourced from other, more credible sources. Extra points are awarded for each source type that informs a project record. Project records do not receive additional points for more than one source within each category; rather, this score is used to assess the diversity of source types attached to a project record.
  • Official Government Sources (Donor/Recipient): 3
  • Other Official Sources (non-Donor/non-Recipient): 3
  • Implementing Agency Source: 2
  • Academic Journal Articles/Other Academic Sources: 2
  • NGO/Civil Society/Advocacy: 1
  • Social Media, including unofficial Blogs: 1

Bonus Points: Additional points are awarded for ground-truthed or sky-truthed projects. Evidence of such a procedure is found in multimedia content uploaded to the page of a project record. 
  • Successfully ground-truthed: 4 points

Field Completeness Sc
ore: This score assesses a project record’s level of completeness (i.e. having all of its fields populated). It varies from 0 to 9; higher values represent project records with more populated fields. We prioritize the presence of 7 ‘key’ fields (defined below); if any of these fields are missing information, a project record’s completeness score is reduced by 1point. Additionally, a project record earns an extra point when any ‘high-value’ field (defined below) is populated. In order to ensure that the field completeness score only assumes positive values, all project records start base value of 8 before deductions begin. The theoretical max of this score is therefore 9. 

High value fields:
  • Transaction Amount: Projects with missing financial amounts will receive a 1 point deduction
  • Commitment Year: Project without a commitment year or tagged “year uncertain” will receive a 1 point deduction
  • Flow Class: “vague” records will receive 1 point deduction
  • Flow Type: Vague-TBD/Unset records will receive a 1 point deduction
  • Sector: Unallocated/Unspecific projects will receive a 1 point deduction

Status: To identify records that merit an additional round of searchers to see if new information is available, the completeness score will take status into account. It is reasonable to assume that completed or cancelled projects will not receive additional media coverage whereas pipeline, implementing, or suspended projects could receive additional coverage.
  • Projects that are marked as completed or cancelled will receive 1 point since we can be confident that additional information will not be forthcoming.
  • Projects that are marked pipeline or implementation’ receive 0 points.

Other fields:
  • Funding Agency: Projects without a funding agency lose a point.
  • Implementing/Accountable Agency: Projects without an implementing or accountable agency also lose a point.

Improving The Data

Getting Involved

While AidData’s initial Chinese Official Finance to Africa database was built by our own staff and researchers, it has since then benefited from the input of dozen of independent contributors.

We’d like you to help us improve the data by identifying errors and omissions, and by suggesting alternative sources of information.

This public resource was created in anticipation of the fact that others who are knowledgeable about specific Chinese official finance activities would help improve the accuracy, scope and depth of the database over time.

AidData staff follow a specific set of procedures to review and approve suggested content. If your contribution is approved, you will receive an email notification from our team to let you know that your comment has been integrated into the online record.


Video: Improving the data


Edit an Existing Project

Find a project record

1.    Access our online database at china.aiddata.org.

2.    If you have a specific project in mind, then use the search page and find the project based on the information you know about it. Alternatively, if you know the ID of the project record in our database, you can “Find by Project ID”. Finally, on the home page, you can enter a keyword (i.e. “stadium) into the search toolbar on the right-hand side of the screen and wait for the drop-down menu.

Challenge or Confirm

Once you have entered an ID or clicked on a particular project record on the search page, you will be led to the project page for that individual record. On this page, you will be able to see the different attributes of that single project. If you can verify any of the information that is entered in a variable or project description, hover over that variable name and click “confirm.” Alternatively, if you believe there is an error (whether in the project description or for a specific variable), then hover over the variable name and click "challenge". Then, enter the desired revision for this data field. For verification purposes, we highly recommend linking to the source document in the “source” section; otherwise, your challenge will require corroborating evidence from another commenter or source. Once you enter this information, an AidData staff member or researcher will review your contribution and choose whether to accept it on the page. If accepted, your username and contribution will appear to other users on that project page.

Leave a comment

If you do not wish to "challenge" the existing data but simply have additional information for a project, then you can input this information in the comment box at the bottom of the project page.. See adjacent Screenshot for a visual.

Upload a file

You can also attach files to project records. To do so, navigate to a project page and upload files using the box in the top-right side of the page. By choosing one of the options, you can upload photos and PDFs, share videos and download files that other users have shared.

 



Suggest a New Project

If you believe that a project is missing from our records, you can suggest a project. An AidData staff member or researcher will review your suggestion and verify its accuracy. Please be sure to include URLs for your sources.

 

如何帮助我们提高数据质量

如何参与

这个初始的数据库由AidData的研究员们建立。现在AidData希望您能帮助我们提高这个数据库的质量。您可以指出这个数据库中的错误和遗漏,并提供相关数据来源。如果您对中国在非援助发展投资的某一方面有更多的了解,我们非常欢迎您与我们分享,并帮助我们提高这个数据库的准确性。

视频:如何帮助我们提高数据质量

如何编辑一个已存在的项目记录

搜索一个项目记录

  1. 访问我们的在线数据平台China.AidData.org
  2. 如果您想寻找一个特定的项目,我们推荐使用”搜索”功能,并根据您掌握的具体信息进行高级搜索。

“提出疑议”或者“进行确认"

如果您在浏览某一项目信息时发现了错误,您可以将光标移动到相应信息上,停留片刻后,您会发现两个图标 “提出疑议”“进行确认” 。您可以在此键入您掌握的正确信息。我们的研究员稍后会对您提出的疑议进行确认。为了成功进行确认,我们强烈建议您对新的数据提供信息来源,否则我们可能需要另一位评论者的支持和新的信息源来对这个“质疑”进行确认。

Flag a value



进行评论

我们也欢迎除了“提出质疑”外的任何其它相关评论,您可以在一个项目页下端的 “评论栏”里进行评论。或者在“提出质疑”图标旁边找到“进行确认”的绿色图标,键入相关的信息,这也是您留下评论的另一个方式。下面是“评论栏”的屏幕截图.

Leave a comment

上传一个文件

您也可以针对某个项目上传相关文件。您可以点击“文件”之后加载文件进行上传

Upload a file



提议一个新项目

如果您发现了一个没有包含在我们数据库里的新项目,我们期待您与我们分享。您可以点击“提议一个新项目”,并为您的提议加上数据来源链接。AidData的员工会稍后审阅您的提议。

Suggest a project