Quantcast
Channel: Active questions tagged feedparser - Stack Overflow
Browsing latest articles
Browse All 106 View Live
↧

Python program using feedparser slows over time [closed]

I have a Python program which is running in a loop and downloading 20k RSS feeds using feedparser and inserting feed data into RDBMS.I have observed that it starts from 20-30 feeds a min and gradually...

View Article


How to use an rss feed in python?

I have never worked with an RSS feed before, I can't seem to find the url of the feed.The page which is offering the RSS Feed:https://www.sec.gov/edgar/browse/?CIK=717826&owner=excludeI am using...

View Article


How to cycle through indices

so in this script I am writing to learn python, I would like to just put a wildcard instead of rewriting this whole block just to change line 2. what would be the most efficient way to consolidate this...

View Article

Retrieve info between paragraph tags with feedparser

I've been reading through the documentation for feedparser and haven't been able to find a solution to this: I would like to retrieve only the string between <p></p>. An example of an...

View Article

How to parse a xml feed using feed parser python?

Im trying to parse a feed in python using feedparser. But all I get is None returned. Im not sure what im missing. Here is my code:import feedparserdef rss(self): rss =...

View Article


Feedparser not returning values, only metadata

I'm using feedparser to get info from a public database (https://knesset.gov.il/Odata/ParliamentInfo.svc/KNS_Bill()).Each of my entries looks as followsWhen accessing specific properties:url =...

View Article

How to find why thread is suspended when using multiprocessing or bypass that?

I use feedparser to get rss feeds from some sites, my core code is like this:def parseworker(procnum, result_queue, return_dict, source_link): try: data = feedparser.parse(source_link)...

View Article

Unexpected error when using feedparser.py

I have had great success parsing RSS feeds from the National Hurricane Center using the feedparser module:import feedparserfeedparser.parse('https://www.nhc.noaa.gov/gis-at.xml') #Works...

View Article


Why is my pythonscript breaking after hours of working fine?

I wrote a small simple program which checks the RSS feed of a german news site, saves the pubDate, title, description and link of the last article and saves it to a txt file. After running over 11...

View Article


Using Python to get Substack posts without scraping

I want to create a dataframe of Substack posts from all the newsletter I subscribe to. But using feedparser+ Substack's RSS feeds only seem to go back ~20 posts—even if a particular newsletter has...

View Article

Unable to get all image url in for looop

I want to output all avaible images from rss feed. My code only getting first image of the feed .. help me to get all imagess import feedparser d =...

View Article

Feedparser pubdate gives error when trying to store into a table with asyncpg

I am trying to store feedparser data into a Postgres database via asyncpg and I am getting an error while storing pubdate that is of type timestamptz in the databaseI have a Postgres table test with...

View Article

Skipping analyzing "feedparser.util": module is installed, but missing...

How do I fix this error? It seems feedparser does not support mypy typings? I could not find a typeshed implementation for feedparserUPDATE 1I see an option called ignore_missing_imports that I can add...

View Article


--- Article Not Found! ---

*** *** *** RSSing Note: Article is missing! We don't know where we put it!!. *** ***

View Article

--- Article Not Found! ---

*** *** *** RSSing Note: Article is missing! We don't know where we put it!!. *** ***

View Article


Python rss feed gets AttributeError

Running this code:import feedparserFeed = feedparser.parse('http://www.reddit.com/r/python/.rss')pointer = Feed.entries[1]print (pointer.summary)print (pointer.link)I get this error:AttributeError:...

View Article

ModuleNotFoundError: No module named 'feedparser'

I have Python 3.11 and I have done everything expect Anaconda thing in this video below to try and fix this issue.https://www.youtube.com/watch?v=RvbUqf3Tb1s&t=181s&ab_channel=TechWithTimHere...

View Article


Formatting a tweet from python using tweepy

I'm trying to tweet my movie reviews from Letterboxd using python's tweepy but I can't format the tweet. I tried printing the tweet without the square brackets or printing the title and link to the...

View Article

Feedparser-basics how to

I'm very new to Feedparser and have returned to Python after a long break so would appreciate any help. I've tried the docs, which are very good, but I'm still slightly lagging.How would I get...

View Article

How to scrape data into PythonAnywhere database

I have a database on PythonAnywhere and credentials in place.The aim is to scrape a whole load of news websites and chuck the data into a new website using Flask.Here's my code for a section of my...

View Article

Python Feedparser Not Showing Entries

I've watched a lot of videos about feedparser library in tutorials everybody use this library like in my code but my code is not working... Anyone help me? my codeI still can't get output even though I...

View Article


Correctly sort RSS items by time

I'm getting RSS items from different RSS channels. And I'd like to sort them correctly by time and take into account the time zone, from the latests to the oldests. So far, I have the following...

View Article


Not sure why URL isn't being passed into a scraper of RSS feeds

Just want to scrape news feeds from RSS.import feedparserimport pandas as pdfrom datetime import datetimearchive = pd.read_csv("national_news_scrape.csv")# Your list of feedsfeeds = [{"type":...

View Article

How to add rows to dataframe in pandas

Building a scraper for news:import feedparserimport pandas as pdfrom datetime import datetimearchive = pd.read_csv("national_news_scrape.csv")pd.set_option('display.max_colwidth', None)# Your list of...

View Article

How to query arXiv for a specific year?

I'm using the code shown below in order to retrieve papers from arXiv. I want to retrieve papers that have words "machine" and "learning" in the title. The number of papers is large, therefore I want...

View Article


feedparser with timeout

My code got stuck on this function call:feedparser.parse("http://...")This worked before. The url is even not possible to open in the browser.How would you cure this case? Is there a timeout...

View Article

Feedparser errors during SSl read operation when accessing NASDAQ RSS Feeds

By utliizing Python 3.12, Feedparser 6.0.11, ca-certificates installedWhen attempting to read this RSS feed: https://www.nasdaq.com/feed/rssoutbound?category=Financial+Advisors. Feedparser library...

View Article

Parse error while chaining object methods in PHP4

I have a client who needs a website urgently, but I have no access to information such as the control panel.PHP Version is 4.4 Which is a pain as I'm used to 5.The first problem is I keep getting:Parse...

View Article

ModuleNotFoundError: No module named 'feedparser' when deploying Streamlit...

I'm trying to deploy my Streamlit app on Streamlit Cloud, but I'm encountering an issue where the feedparser module is not found. The app works perfectly fine on my local machine, but when I deploy it,...

View Article



Pygooglenews import failure

I have the following versions installed:Name: pygooglenewsVersion: 0.1.3Name: feedparserVersion: 6.0.11Nevertheless, when I try to import pygooglenews, I get the following...

View Article
Browsing latest articles
Browse All 106 View Live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>