Scraper for entry and mid level sw jobs
http://51.20.250.24/jobs
.gitignore | ||
go.mod | ||
go.sum | ||
main.go | ||
readme.md | ||
run-scrapers.sh |
The Hub Scraper
This is a simple scraper that extracts job details from the The Hub website and itjobbank.
Usage
To run the scraper, simply execute the following command:
go run scraper.go
The scraper will create a thehub.json
and itjobbank.json
file in the current directory, which contains a list of job details in JSON format. It caches the pages, so very light on resources and requests.