Use custom headers

[jeremyzaire]

Hi !
I tried to use com.digitalpebble.stormcrawler.protocol.okhttp.HttpProtocol to scrape some websites but I can't add custom headers. Is there a way to add custom headers without write a new Protocol ?

Thanks regards,
Jeremy

[jnioche]

thanks @jeremyzaire
I thought this was the case but looking at the code I can't see any way of doing this. That would be a great contribution if you are interested in doing it.

[jnioche]

@jeremyzaire any chance you could try #912?

[jeremyzaire]

Thanks @jnioche I will test today. Thanks for your contribution

[jeremyzaire]

It works fine ! Thanks you for your amazing job

[jnioche]

Fab, thanks for the feedback