rannes.dev/sw-jobs-go
1
0
Fork 1
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Scraper for entry and mid level sw jobs http://51.20.250.24/jobs
17 Commits 1 Branch 0 Tags 79 KiB
Go 99.1%
Shell 0.9%
main
Go to file
christian 9b0941a04a Update readme.md
2024-07-30 13:12:34 +00:00
.gitignore added scraper for it-jobbank 2024-06-11 11:38:05 +02:00
go.mod initial commit 2024-06-08 16:11:40 +02:00
go.sum initial commit 2024-06-08 16:11:40 +02:00
main.go moved cache to details collector 2024-06-19 20:26:36 +02:00
readme.md Update readme.md 2024-07-30 13:12:34 +00:00
run-scrapers.sh added run script 2024-06-10 11:53:27 +02:00

readme.md

IT jobs scraper

This is a simple scraper that extracts job details from the The Hub website and itjobbank.

Filtering

The scraper filters out a list of keywords like senior, architect etc. as I wrote it for entry and mid level roles. It also filters out unpaid form the hub, and keyword based from itjobbank.

Usage

To run the scraper, simply execute the following command:

go run scraper.go

The scraper will create a thehub.json and itjobbank.json file in the current directory, which contains a list of job details in JSON format. It caches the pages, so very light on resources and requests.