fork to deploy sw-job-scraper as lambda
Go to file
2024-06-08 18:24:54 +00:00
.gitignore i alrady hate lambda 2024-06-08 19:35:01 +02:00
build.sh added bash script to build and zip 2024-06-08 19:50:48 +02:00
go.mod added aws lambda integrations 2024-06-08 16:48:00 +02:00
go.sum added aws lambda integrations 2024-06-08 16:48:00 +02:00
main.go i alrady hate lambda 2024-06-08 19:35:01 +02:00
readme.md readme markdown 2024-06-08 18:24:54 +00:00

The Hub Scraper

deprecated as lambda was a bad solution for this, without setting up dynamodb, api etc. This will go live in a ec2 so it can write to local storage instead of running on demand.

Go is fast but free tier lambda is not and I am not yet a smart man.

This is a simple scraper that extracts job details from the The Hub website.

It's a fork of the original The Hub Scraper by Rannes.

## Usage

To run the scraper zip it deploy it to AWS Lambda and then call the function.