feat: create crawler api server

[adityak74]

This PR creates an express server that exposes /crawl endpoint that accepts the config as a post-request body and responds to the crawled json.

Swagger API Documentation at: /api-docs

Doesn't support concurrency yet. - #120

• Create a basic structure for the server
• Modularize port and host for deployments
• Add validations for config parsing and conversion.
• Swagger UI for API documentation

Fixes: #43

[BikeF]

I did not run your changes, but I am concerned that this API does not support concurrent calls. He cannot be used simultaneously

[databill86]

Any news on this feature ? :)

[adityak74]

@databill86 I am working on the docker file, facing some small issues, I should get it in a couple of days.

[adityak74]

@databill86 - This PR is ready to be reviewed. I will attempt to Dockerize in another PR. This should get us started with the API running locally.

[steve8708]

looks great, thanks for the contribution @adityak74! would be great if you could send a followup PR updating the README about how to use this as an API as well, so new users know what is possible and how to use these updates

[github-actions]

🎉 This PR is included in version 1.2.0 🎉

The release is available on:

• npm package (@latest dist-tag)
• GitHub release

Your semantic-release bot 📦🚀

[adityak74]

@steve8708 - Thanks and sure I will create README PR soon.