All issues

Search results

[Improvement] WARC writer: WARC-Protocol header to follow WARC field proposals

Status: Open.

#1998In apache/stormcrawler;

· sebastian-nagel opened on Jul 14, 2026

[Improvement] Add configuration to stop parsing PDFs after X pages

Status: Open.

#1901In apache/stormcrawler;

· jnioche opened on May 8, 2026

[Improvement] Work towards Maven 4 Compatibility

good first issue

help wanted

Status: Open.

#1662In apache/stormcrawler;

· rzo1 opened on Sep 19, 2025

Delete redirected pages

core

good first issue

Status: Open.

#994In apache/stormcrawler;

· jnioche opened on Aug 8, 2022

Send host info on a specific stream

enhancement

good first issue

help wanted

Status: Open.

#867In apache/stormcrawler;

· jnioche opened on Mar 26, 2021

New XPATH implementation based on JSON file and organised per hostname or domain

core

enhancement

good first issue

Status: Open.

#586In apache/stormcrawler;

· jnioche opened on Jun 13, 2018

wish: WARCHdfsBolt with CDX index

good first issue

help wanted

warc

wish

Status: Open.

#567In apache/stormcrawler;

· dportabella opened on May 5, 2018

Capture stats about hosts on status stream post fetching

good first issue

ideas

Status: Open.

#504In apache/stormcrawler;

· jnioche opened on Oct 6, 2017

Adaptative URL filter to normalize URLs based on canonical tag

good first issue

Status: Open.

#315In apache/stormcrawler;

· jnioche opened on Jul 11, 2016

Remove needsDOM() in ParseFilter

good first issue

help wanted

question

Status: Open.

#158In apache/stormcrawler;

· jnioche opened on Jul 8, 2015

Normalise HTTP headers

core

fetcher

good first issue

help wanted

Status: Open.

#108In apache/stormcrawler;

· jnioche opened on Mar 12, 2015

URLPartitionerBolt to partition on arbitrary metadata value

core

enhancement

good first issue

Status: Open.

#85In apache/stormcrawler;

· jnioche opened on Feb 3, 2015