Summary
We need to add an additional data import process to pull 990 data for Giving Tuesday. This should mimic the existing Charity Navigator process. In addition, we have a need to gather metrics (at this time just counts) of items across the system. A simple command to generate those counts would be great. Finally, documentation on all 3 items mentioned.
Problem / Opportunity
This resolves the challenge of importing data from GT as well as gathering simple record counts
Proposed solution
I propose that we generate 2 new scripts:
- givingTuesday.ts
- getMetrics.ts
I also propose that we add a 'docs' folder off the root with the following files:
- charityNavigator.md
- givingTuesday.md
- getMetrics.md
Acceptance criteria
The documentation is considered complete once it's generated. It should include:
- Parameter information
- Which external systems are being used
- Data flows
- Field mappings
- etc...
The getMetrics script will simply generate a count of items per REST endpoint. Unit tests will also be included.
The givingTuesday script will reach out to the GT 990 interface at: https://990-infrastructure.gtdata.org. It will then match EINs from the PDC (based on the API in use) and only request information for those organizations. It will then parse and load the data (as mapped) into the PDC. Unit tests will also be included.
Priority
Medium
Summary
We need to add an additional data import process to pull 990 data for Giving Tuesday. This should mimic the existing Charity Navigator process. In addition, we have a need to gather metrics (at this time just counts) of items across the system. A simple command to generate those counts would be great. Finally, documentation on all 3 items mentioned.
Problem / Opportunity
This resolves the challenge of importing data from GT as well as gathering simple record counts
Proposed solution
I propose that we generate 2 new scripts:
I also propose that we add a 'docs' folder off the root with the following files:
Acceptance criteria
The documentation is considered complete once it's generated. It should include:
The getMetrics script will simply generate a count of items per REST endpoint. Unit tests will also be included.
The givingTuesday script will reach out to the GT 990 interface at: https://990-infrastructure.gtdata.org. It will then match EINs from the PDC (based on the API in use) and only request information for those organizations. It will then parse and load the data (as mapped) into the PDC. Unit tests will also be included.
Priority
Medium