Use AniDB's Title Dump/Fuzzy Name Searching #11
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
added 30 commits
November 6, 2018 15:17
…er python calls them
that used the id field use 'lxml-xml' instead of 'lxml' for parser in get_soup md5digest initialized to reduce complexity of the line increase timed limiter to 3 seconds xml_cache_path is now a class variable in __load_xml_to_database change == to > to actually skip already added anime start to rewrite __load_xml_to_database, its shit rewrite by_name to use the database, still not up to my standards linted some stuff updated tox.ini
added 19 commits
November 27, 2018 19:48
Initialize AnidbParser with a session and an anime add _get_anime to set the parser's anime remove session from parse use self.series remove future imports (see README.md) anidb_parsing_interface.py: remove unneeded imports make anime_seasons a list fix _get_anime_season to actually return a season use self.session add _get_list_tag to easily parse certain AniDB tags anidb_search.py: fix stupid typo of 'language' calculate if cache is expired and use that in the if to reduce complexity add last_lookup to potentially speed up searches remove by_name as it is no longer used anywhere api_anidb.py: remove future imports minor changes to Anime.expired and Anime.__repr__ anidb_cache.py: remove future imports
…he anime, it is closed on __del__, which only works on Python 3.4+
start rewrite of parser
lookup has a session again fix order of variables in AnidbParser.is_banned wrap most of AnidbParser.parse in a session.no_flush to prevent autoflushing muss up api_anidb and the schema, does it work? probably
|
I'm losing steam. My motivation has plummeted since I was banned from the API. Not sure if I will get unbanned. I went on the AniDB IRC channel and was warmly greeted by their saint of an admin.. Apparently |
XVicarious
force-pushed
the
title_dump
branch
from
4304bbf
to
75d5154
Compare
added 9 commits
December 18, 2018 22:56
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Utilize the title dump from AniDB instead of the 3rd party website for finding the ID. Also use fuzzy searching for the title so we can get good results.