Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get repo topics and created at date data from search results #11

Open
4 tasks
Tracked by #1
Relequestual opened this issue May 14, 2024 · 0 comments
Open
4 tasks
Tracked by #1

Get repo topics and created at date data from search results #11

Relequestual opened this issue May 14, 2024 · 0 comments
Labels
📈 Stats Related to gathering or displaying statistics related to the JSON Schema ecosystem Status: Available No one has claimed responsibility for resolving this issue.

Comments

@Relequestual
Copy link
Member

The GitHub REST API Search endpoint, when searching for repositories, returns a lot more data than expected.

We don't actually need to make more requests to get back the Respository Topics or create date.

Using the data from the search result totally removes the need to do requests per repo.

This does require quite a change to the code, and attempting to modify such might want to wait till #10 is merged, or that PR might not even be needed now.

For the json-schema topic on Github (like a "tag" for repos, but tags are something else, so I guess they picked another word), there are under 2k results, and you can request 1k results per query with the search API. The response contains all the initial data required.

  • Change Search API call to ask for 1k results
  • Collect data required from the Search response
  • Do not do any additional API requests
  • Make sure data is still saved to file

Currently we aimed to have both the created at date and the first release date, but let's forgoe having the first release date, as that makes this more complicated, and we probably don't even need it.

@Relequestual Relequestual added the 📈 Stats Related to gathering or displaying statistics related to the JSON Schema ecosystem label May 14, 2024
@Relequestual Relequestual added the Status: Available No one has claimed responsibility for resolving this issue. label May 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
📈 Stats Related to gathering or displaying statistics related to the JSON Schema ecosystem Status: Available No one has claimed responsibility for resolving this issue.
Projects
Status: Waiting for Contributions
Development

No branches or pull requests

1 participant