Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

These links cannot be resolved #207

Open
HeyDorvin opened this issue Apr 19, 2023 · 3 comments
Open

These links cannot be resolved #207

HeyDorvin opened this issue Apr 19, 2023 · 3 comments

Comments

@HeyDorvin
Copy link

Expected behavior

Support parsing.

Actual behavior

Failed to parse.
Failed to detect feed type: https://www.bleepingcomputer.com/feed/ https://www.ghacks.net/feed
XML syntax error: https://3gstudent.github.io/3gstudent.github.io/feed.xmlhttps://kingx.me/feed.xmlhttps://labs.watchtowr.com/rsshttps://www.synacktiv.com/feed/lastblog.xmlhttps://ssd-disclosure.com/feed/

Although there are a few parts that do not support parsing, it has been done very well and hope to continue improving in the future.

@mmcdole
Copy link
Owner

mmcdole commented Mar 15, 2024

@HeyDorvin

I tested a few of these...

Feed 1: https://www.bleepingcomputer.com/feed/

The feed parses fine.

However, the above feed is being protected by Cloudflare WAF. If you download it manually from the browser, and then parse the feed, it parses fine. This means anti-bot protection from Cloudflare is likely stopping the requests Gofeed makes. I suggest you attempt to change the User-Agent settings in the Parser settings and see if it allows the request to go through.

This worked form me:

curl https://www.bleepingcomputer.com/feed/ > feed.xml
./ftest feed.xml

Feed 2: https://www.ghacks.net/feed

This feed parses fine.

./ftest https://www.ghacks.net/feed

Feed 3: https://3gstudent.github.io/3gstudent.github.io/feed.xml

This feed URL returns a 301 Permanently Moved error. The page it redirects to is an HTML page, not an RSS page. However, if you use the following URL, it parses fine: https://3gstudent.github.io/atom.xml

@mmcdole
Copy link
Owner

mmcdole commented Mar 15, 2024

I'll try to look at the others when I have some time. But if you get a chance, try downloading them manually and parsing.

@HeyDorvin
Copy link
Author

I'll try to look at the others when I have some time. But if you get a chance, try downloading them manually and parsing.

Thank you for your reply. I didn't consider the error carefully when I saw it, and I didn't expect it to be because of these reasons.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants