Fix deletion of redirected URLs

[Atmuri-SatyaPrakash]

Description

Fixes deletion of URLs that are redirected.

When a URL receives a REDIRECTION status, the URL was previously not emitted to the deletion stream. This could leave the old URL in the index after it redirects to another URL.

This change emits REDIRECTION statuses to the deletion stream while preserving the existing ERROR behavior.

Testing

Added a regression test to verify that redirected URLs are emitted to the deletion stream.

Tested with:

mvn -pl core -Deditorconfig.skip=true -Dtest=AbstractStatusUpdaterBoltTest test

Result:
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0
BUILD SUCCESS

[dpol1]

You missed this: https://github.com/apache/stormcrawler/blame/e1d54a6572438a5518d772cb88ac51e8dada57fb/README.md#L43

[dpol1]

Real gap, thanks - good regression test too.

Couple of questions:

1. What happens with a temporary redirect? All 3xx end up as REDIRECTION, so a site doing a 302 during maintenance would get its doc deleted - and with the default schedule that delete re-fires daily. Should we limit this to 301/308 (via fetch.statusCode - though JSoup meta-refresh emits REDIRECTION with status 200), or make it opt-in via config for existing topologies?
2. Since the ERROR branch got restructured, could we also assert ERROR still emits exactly one delete and FETCHED none? And does assertEquals(metadata, ...) actually test anything? Metadata has no equals(), so it's comparing the object with itself - maybe assert on a key instead.