Extract website content, use GPT for analysis
sentiment-analysisweb-scrapingcontent-extractionweb-automationplaywrightopenai-apimarkdown-formattingwebsite-scrapinggpt-apiai-driven-text-processingcontent-proofreading
-
Updated
Nov 11, 2025 - Python
#
website-scraping
Here are 4 public repositories matching this topic...
FastAPI service that classifies publisher websites for affiliate campaigns using an LLM pipeline (scrape → signals → RAG → scoring). Detects cashback, adult, gambling, scams. Supports OpenAI/Ollama, Redis cache, Docker.
dockerredisopenaipython-asyncioaffiliate-marketingragpydantichttpxsentence-transformersllmwebsite-scrapingchromadbtrafilaturaollamascam-detectionpublisher-website-classifiergambling-detectionadult-content-filtercashback-detection
-
Updated
Mar 30, 2026 - Python
Python web scraping project that extracts product details (name, price, rating, reviews, image URL) from a Flipkart product listing page.
websitescraperscrapingrequestsweb-scrapingdata-analysisbeautifulsoupdata-scrapingwebsite-scraperbeautifulsoup-librarydata-scraperbeautifulsoup4requests-moduledata-scrapersrequests-pythonrequests-library-pythonweb-scraping-pythonwebsite-scrapingwebsite-scraping-tooldata-scraping-projects
-
Updated
May 2, 2026 - Python
high-performance website content extractor
data-extractioncontent-analysiscontent-aggregationwebsite-scrapingcompetitive-researchsite-structure-analysisbulk-url-crawlertext-deduplicationparallel-crawlingweb-data-insights
-
Updated
Nov 11, 2025 - Python
Improve this page
Add a description, image, and links to the website-scraping topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the website-scraping topic, visit your repo's landing page and select "manage topics."