rannes.dev/sw-jobs-scraper

Go to file

christian f7fcb41a87 Update readme.md

2024-07-30 13:10:54 +00:00

.gitignore

added scraper for it-jobbank

2024-06-11 11:38:05 +02:00

go.mod

initial commit

2024-06-08 16:11:40 +02:00

go.sum

initial commit

2024-06-08 16:11:40 +02:00

main.go

moved cache to details collector

2024-06-19 20:26:36 +02:00

readme.md

Update readme.md

2024-07-30 13:10:54 +00:00

run-scrapers.sh

added run script

2024-06-10 11:53:27 +02:00

readme.md

The Hub Scraper

This is a simple scraper that extracts job details from the The Hub website and itjobbank.

Usage

To run the scraper, simply execute the following command:

go run scraper.go

The scraper will create a thehub.json and itjobbank.json file in the current directory, which contains a list of job details in JSON format. It caches the pages, so very light on resources and requests.