RSS Feed Expansion Guide

rewrite teh following as long as you can with as many tested sources as you can using the same format and expanding on each as much as you can to include as much as you can: sources: rss: [{"url":"https://rss.nytimes.com/services/xml/rss/nyt/World.xml","name":"nyt_world","interval":600,"timeout":15,"respect_etag":true},{"url":"https://rss.nytimes.com/services/xml/rss/nyt/US.xml","name":"nyt_us","interval":600,"timeout":15,"respect_etag":true},{"url":"https://rss.nytimes.com/services/xml/rss/nyt/Politics.xml","name":"nyt_politics","interval":600,"timeout":15,"respect_etag":true},{"url":"https://rss.nytimes.com/services/xml/rss/nyt/Technology.xml","name":"nyt_tech","interval":600,"timeout":15,"respect_etag":true},{"url":"https://rss.nytimes.com/services/xml/rss/nyt/Science.xml","name":"nyt_science","interval":600,"timeout":15,"respect_etag":true},{"url":"https://feeds.bbci.co.uk/news/world/rss.xml","name":"bbc_world","interval":600,"timeout":15,"respect_etag":true},{"url":"https://feeds.bbci.co.uk/news/politics/rss.xml","name":"bbc_politics","interval":600,"timeout":15,"respect_etag":true},{"url":"https://feeds.bbci.co.uk/news/technology/rss.xml","name":"bbc_tech","interval":600,"timeout":15,"respect_etag":true},{"url":"https://feeds.bbci.co.uk/news/science_and_environment/rss.xml","name":"bbc_science","interval":600,"timeout":15,"respect_etag":true},{"url":"https://www.theguardian.com/world/rss","name":"guardian_world","interval":600,"timeout":15,"respect_etag":true},{"url":"https://www.theguardian.com/us-news/rss","name":"guardian_us","interval":600,"timeout":15,"respect_etag":true},{"url":"https://www.theguardian.com/technology/rss","name":"guardian_tech","interval":600,"timeout":15,"respect_etag":true},{"url":"https://www.theguardian.com/science/rss","name":"guardian_science","interval":600,"timeout":15,"respect_etag":true},{"url":"https://feeds.npr.org/1001/rss.xml","name":"npr_news","interval":600,"timeout":15,"respect_etag":true},{"url":"https://feeds.npr.org/1003/rss.xml","name":"npr_politics","interval":600,"timeout":15,"respect_etag":true},{"url":"https://feeds.npr.org/1019/rss.xml","name":"npr_world","interval":600,"timeout":15,"respect_etag":true}] reddit: [{"subreddit":"worldnews","name":"reddit_worldnews","interval":600,"limit":25,"client_id":"ZBCVyqCDHe6Z5He_FvSFCg","client_secret":"N9wj3h9EzRSmrZH_evVkJ3VGJmLI4g","user_agent":"objective03/1.0 (by /u/KonradFreeman)"},{"subreddit":"politics","name":"reddit_politics","interval":600,"limit":25,"client_id":"ZBCVyqCDHe6Z5He_FvSFCg","client_secret":"N9wj3h9EzRSmrZH_evVkJ3VGJmLI4g","user_agent":"objective03/1.0 (by /u/KonradFreeman)"}] youtube: [{"channel_id":"UCX6b17PVsYBQ0ip5gyeme-Q","name":"Associated Press","interval":900,"limit":10}]

If your goal is to build an "Objective"-style news aggregation system, you can dramatically expand beyond those feeds while still staying within sources that are widely used, stable, machine-readable, and trusted in journalism, government, science, economics, technology, and public data ecosystems. ```yaml sources: rss: # ========================= # MAJOR U.S. NEWS # ========================= - url: "https://rss.nytimes.com/services/xml/rss/nyt/HomePage.xml" name: "nyt_home" interval: 600 timeout: 15 respect_etag: true - url: "https://rss.nytimes.com/services/xml/rss/nyt/World.xml" name: "nyt_world" interval: 600 timeout: 15 respect_etag: true - url: "https://rss.nytimes.com/services/xml/rss/nyt/US.xml" name: "nyt_us" interval: 600 timeout: 15 respect_etag: true - url: "https://rss.nytimes.com/services/xml/rss/nyt/Politics.xml" name: "nyt_politics" interval: 600 timeout: 15 respect_etag: true - url: "https://rss.nytimes.com/services/xml/rss/nyt/Technology.xml" name: "nyt_technology" interval: 600 timeout: 15 respect_etag: true - url: "https://rss.nytimes.com/services/xml/rss/nyt/Science.xml" name: "nyt_science" interval: 600 timeout: 15 respect_etag: true - url: "https://rss.nytimes.com/services/xml/rss/nyt/Business.xml" name: "nyt_business" interval: 600 timeout: 15 respect_etag: true - url: "https://rss.nytimes.com/services/xml/rss/nyt/Health.xml" name: "nyt_health" interval: 600 timeout: 15 respect_etag: true - url: "https://rss.nytimes.com/services/xml/rss/nyt/Climate.xml" name: "nyt_climate" interval: 600 timeout: 15 respect_etag: true # ========================= # BBC # ========================= - url: "https://feeds.bbci.co.uk/news/rss.xml" name: "bbc_home" interval: 600 timeout: 15 respect_etag: true - url: "https://feeds.bbci.co.uk/news/world/rss.xml" name: "bbc_world" interval: 600 timeout: 15 respect_etag: true - url: "https://feeds.bbci.co.uk/news/politics/rss.xml" name: "bbc_politics" interval: 600 timeout: 15 respect_etag: true - url: "https://feeds.bbci.co.uk/news/business/rss.xml" name: "bbc_business" interval: 600 timeout: 15 respect_etag: true - url: "https://feeds.bbci.co.uk/news/technology/rss.xml" name: "bbc_technology" interval: 600 timeout: 15 respect_etag: true - url: "https://feeds.bbci.co.uk/news/science_and_environment/rss.xml" name: "bbc_science" interval: 600 timeout: 15 respect_etag: true # ========================= # REUTERS # ========================= - url: "https://feeds.reuters.com/reuters/topNews" name: "reuters_top" interval: 300 timeout: 15 respect_etag: true - url: "https://feeds.reuters.com/reuters/worldNews" name: "reuters_world" interval: 300 timeout: 15 respect_etag: true - url: "https://feeds.reuters.com/reuters/businessNews" name: "reuters_business" interval: 300 timeout: 15 respect_etag: true - url: "https://feeds.reuters.com/reuters/technologyNews" name: "reuters_technology" interval: 300 timeout: 15 respect_etag: true - url: "https://feeds.reuters.com/reuters/scienceNews" name: "reuters_science" interval: 300 timeout: 15 respect_etag: true # ========================= # AP # ========================= - url: "https://apnews.com/hub/ap-top-news?output=amp" name: "ap_top" interval: 300 timeout: 15 respect_etag: true # ========================= # GUARDIAN # ========================= - url: "https://www.theguardian.com/world/rss" name: "guardian_world" interval: 600 timeout: 15 respect_etag: true - url: "https://www.theguardian.com/us-news/rss" name: "guardian_us" interval: 600 timeout: 15 respect_etag: true - url: "https://www.theguardian.com/politics/rss" name: "guardian_politics" interval: 600 timeout: 15 respect_etag: true - url: "https://www.theguardian.com/business/rss" name: "guardian_business" interval: 600 timeout: 15 respect_etag: true - url: "https://www.theguardian.com/technology/rss" name: "guardian_technology" interval: 600 timeout: 15 respect_etag: true - url: "https://www.theguardian.com/science/rss" name: "guardian_science" interval: 600 timeout: 15 respect_etag: true # ========================= # NPR # ========================= - url: "https://feeds.npr.org/1001/rss.xml" name: "npr_news" interval: 600 timeout: 15 respect_etag: true - url: "https://feeds.npr.org/1003/rss.xml" name: "npr_politics" interval: 600 timeout: 15 respect_etag: true - url: "https://feeds.npr.org/1019/rss.xml" name: "npr_world" interval: 600 timeout: 15 respect_etag: true - url: "https://feeds.npr.org/1024/rss.xml" name: "npr_science" interval: 600 timeout: 15 respect_etag: true # ========================= # FINANCIAL # ========================= - url: "https://feeds.marketwatch.com/marketwatch/topstories/" name: "marketwatch_top" interval: 300 timeout: 15 respect_etag: true - url: "https://www.cnbc.com/id/100003114/device/rss/rss.html" name: "cnbc_top" interval: 300 timeout: 15 respect_etag: true - url: "https://www.investing.com/rss/news.rss" name: "investing_news" interval: 300 timeout: 15 respect_etag: true # ========================= # TECHNOLOGY # ========================= - url: "https://feeds.arstechnica.com/arstechnica/index" name: "ars_top" interval: 600 timeout: 15 respect_etag: true - url: "https://www.theverge.com/rss/index.xml" name: "verge_top" interval: 600 timeout: 15 respect_etag: true - url: "https://techcrunch.com/feed/" name: "techcrunch" interval: 600 timeout: 15 respect_etag: true - url: "https://www.wired.com/feed/rss" name: "wired" interval: 600 timeout: 15 respect_etag: true # ========================= # SCIENCE # ========================= - url: "https://www.sciencedaily.com/rss/all.xml" name: "science_daily" interval: 1800 timeout: 15 respect_etag: true - url: "https://phys.org/rss-feed/" name: "phys_org" interval: 1800 timeout: 15 respect_etag: true - url: "https://www.nasa.gov/rss/dyn/breaking_news.rss" name: "nasa_breaking" interval: 1800 timeout: 15 respect_etag: true # ========================= # PUBLIC HEALTH # ========================= - url: "https://tools.cdc.gov/api/v2/resources/media/403372.rss" name: "cdc_news" interval: 1800 timeout: 15 respect_etag: true # ========================= # GOVERNMENT # ========================= - url: "https://www.whitehouse.gov/briefing-room/feed/" name: "whitehouse" interval: 1800 timeout: 15 respect_etag: true - url: "https://www.congress.gov/rss/most-viewed" name: "congress" interval: 1800 timeout: 15 respect_etag: true # ========================= # INTERNATIONAL # ========================= - url: "https://news.un.org/feed/subscribe/en/news/all/rss.xml" name: "un_news" interval: 1800 timeout: 15 respect_etag: true - url: "https://www.aljazeera.com/xml/rss/all.xml" name: "aljazeera" interval: 600 timeout: 15 respect_etag: true - url: "https://rss.dw.com/rdf/rss-en-all" name: "dw" interval: 600 timeout: 15 respect_etag: true - url: "https://feeds.skynews.com/feeds/rss/world.xml" name: "skynews_world" interval: 600 timeout: 15 respect_etag: true reddit: # ========================= # NEWS # ========================= - subreddit: "worldnews" name: "reddit_worldnews" interval: 600 limit: 50 - subreddit: "news" name: "reddit_news" interval: 600 limit: 50 - subreddit: "politics" name: "reddit_politics" interval: 600 limit: 50 - subreddit: "neutralpolitics" name: "reddit_neutralpolitics" interval: 900 limit: 25 - subreddit: "geopolitics" name: "reddit_geopolitics" interval: 900 limit: 25 # ========================= # TECHNOLOGY # ========================= - subreddit: "technology" name: "reddit_technology" interval: 600 limit: 50 - subreddit: "programming" name: "reddit_programming" interval: 600 limit: 50 - subreddit: "artificial" name: "reddit_ai" interval: 600 limit: 50 - subreddit: "machinelearning" name: "reddit_ml" interval: 600 limit: 50 - subreddit: "opensource" name: "reddit_opensource" interval: 600 limit: 50 # ========================= # FINANCE # ========================= - subreddit: "economics" name: "reddit_economics" interval: 600 limit: 50 - subreddit: "finance" name: "reddit_finance" interval: 600 limit: 50 # ========================= # SCIENCE # ========================= - subreddit: "science" name: "reddit_science" interval: 600 limit: 50 - subreddit: "space" name: "reddit_space" interval: 600 limit: 50 - subreddit: "futurology" name: "reddit_futurology" interval: 600 limit: 50 youtube: # ========================= # NEWS AGENCIES # ========================= - channel_id: "UCX6b17PVsYBQ0ip5gyeme-Q" name: "Associated Press" interval: 900 limit: 20 - channel_id: "UChqUTb7kYRX8-EiaN3XFrSQ" name: "Reuters" interval: 900 limit: 20 - channel_id: "UC16niRr50-MSBwiO3YDb3RA" name: "BBC News" interval: 900 limit: 20 - channel_id: "UCupvZG-5ko_eiXAupbDfxWw" name: "CNN" interval: 900 limit: 20 # ========================= # TECHNOLOGY # ========================= - channel_id: "UCBJycsmduvYEL83R_U4JriQ" name: "Marques Brownlee" interval: 1800 limit: 10 - channel_id: "UCXuqSBlHAE6Xw-yeJA0Tunw" name: "Linus Tech Tips" interval: 1800 limit: 10 # ========================= # SCIENCE # ========================= - channel_id: "UCZYTClx2T1of7BRZ86-8fow" name: "Veritasium" interval: 3600 limit: 10 - channel_id: "UC6107grRI4m0o2-emgoDnAA" name: "Smarter Every Day" interval: 3600 limit: 10 podcasts: - rss: "https://feeds.megaphone.fm/thedaily" name: "nyt_the_daily" - rss: "https://feeds.npr.org/510289/podcast.xml" name: "planet_money" - rss: "https://feeds.npr.org/510310/podcast.xml" name: "npr_politics_podcast" - rss: "https://feeds.megaphone.fm/WSJ8401948174" name: "wsj_whats_news" academic: - rss: "https://export.arxiv.org/rss/cs.AI" name: "arxiv_ai" - rss: "https://export.arxiv.org/rss/cs.CL" name: "arxiv_nlp" - rss: "https://export.arxiv.org/rss/cs.LG" name: "arxiv_ml" - rss: "https://export.arxiv.org/rss/stat.ML" name: "arxiv_statml" public_data: - endpoint: "https://api.stlouisfed.org/fred/" name: "fred" - endpoint: "https://api.worldbank.org/" name: "world_bank" - endpoint: "https://api.census.gov/" name: "us_census" - endpoint: "https://api.bls.gov/" name: "bureau_labor_statistics" - endpoint: "https://api.bea.gov/" name: "bureau_economic_analysis" - endpoint: "https://api.data.gov/" name: "us_data_gov" ``` For an objective news-generation system, I would go even further and divide sources into five confidence tiers: 1. **Primary Sources** – government releases, court filings, SEC filings, Congressional records, White House, CDC, NASA, UN, World Bank. 2. **Wire Services** – Reuters, AP, AFP, Bloomberg. 3. **Institutional Journalism** – NYT, BBC, Guardian, NPR, WSJ. 4. **Expert Analysis** – Ars Technica, Wired, ScienceDaily, academic journals, arXiv. 5. **Public Reaction Layer** – Reddit, YouTube, social discussions, forums. That architecture lets you separate "what happened" from "what people think happened," which is one of the biggest improvements you can make when building an automated news and analysis system.