Skip to content
This repository has been archived by the owner on Dec 14, 2023. It is now read-only.

Fix feeds fox #845

Draft
wants to merge 19 commits into
base: master
Choose a base branch
from
Draft

Conversation

thepsalmist
Copy link

Fix bug from Feeds Error processing feed for download 3869998282: Error processing feed for http://feeds.foxnews.com/foxnews/politics: object has no attribute 'enclosures' Error processing feed for download 3871398204: Error processing feed for http://feeds.foxnews.com/foxnews/politics: object has no attribute 'enclosures'

philbudne and others added 19 commits March 6, 2022 17:37
	(can be overridden via MC_NO_DEDUP_SENTENCES env var)

apps/common/src/python/mediawords/util/config/__init__.py: add env_bool function
apps/extract-and-vector/bin/extract_and_vector_worker.py: honor MC_NO_DEDUP_SENTENCES
…processing backlog

up FETCH_BLOCK_SIZE from 100 to 200:
ammortizes citus connection startup time by processing fetching larger blocks of text.

Honor skip_update_snapshot option (defaults to true):
skip setting snapshots.searchable=true
(Jinja2 2.11.3 can't cope with the new MarkupSafe 2.1.1)
PG server running on postgresql EC2 server w/o docker
Removed extra AND to try to fix mediacloud#833 as suggested by Rahul.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants