rannes.dev/sw-jobs-scraper
1
0
Fork 1
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Scraper for entry and mid level sw jobs
18 Commits 1 Branch 0 Tags 104 KiB
Go 96.3%
Dockerfile 2.8%
Shell 0.9%
709464b5f7
Go to file
hook-lord 709464b5f7
Some checks failed
Build and Push Docker Image / build-and-push (push) Failing after 33s
Details
added dockerfile and workflow
2024-12-06 18:00:11 +01:00
.gitea/workflows added dockerfile and workflow 2024-12-06 18:00:11 +01:00
.gitignore added scraper for it-jobbank 2024-06-11 11:38:05 +02:00
Dockerfile added dockerfile and workflow 2024-12-06 18:00:11 +01:00
go.mod initial commit 2024-06-08 16:11:40 +02:00
go.sum initial commit 2024-06-08 16:11:40 +02:00
main.go moved cache to details collector 2024-06-19 20:26:36 +02:00
readme.md Update readme.md 2024-07-30 13:12:34 +00:00
run-scrapers.sh added run script 2024-06-10 11:53:27 +02:00

readme.md

IT jobs scraper

This is a simple scraper that extracts job details from the The Hub website and itjobbank.

Filtering

The scraper filters out a list of keywords like senior, architect etc. as I wrote it for entry and mid level roles. It also filters out unpaid form the hub, and keyword based from itjobbank.

Usage

To run the scraper, simply execute the following command:

go run scraper.go

The scraper will create a thehub.json and itjobbank.json file in the current directory, which contains a list of job details in JSON format. It caches the pages, so very light on resources and requests.