sw-jobs-scraper/readme.md

# IT jobs scraper

This is a simple scraper that extracts job details from the [The Hub](https://thehub.io) website and itjobbank.


## Filtering

The scraper filters out a list of keywords like senior, architect etc. as I wrote it for entry and mid level roles. It also filters out unpaid form the hub, and keyword based from itjobbank.

## Usage

To run the scraper, simply execute the following command:

```bash
go run scraper.go
```

The scraper will create a `thehub.json` and `itjobbank.json` file in the current directory, which contains a list of job details in JSON format. It caches the pages, so very light on resources and requests.
Update readme.md 2024-07-30 13:12:34 +00:00			`# IT jobs scraper`
initial commit 2024-06-08 14:11:40 +00:00
Update readme.md 2024-07-30 13:10:54 +00:00			`This is a simple scraper that extracts job details from the [The Hub](https://thehub.io) website and itjobbank.`

initial commit 2024-06-08 14:11:40 +00:00
Update readme.md 2024-07-30 13:12:13 +00:00			`## Filtering`

			`The scraper filters out a list of keywords like senior, architect etc. as I wrote it for entry and mid level roles. It also filters out unpaid form the hub, and keyword based from itjobbank.`

initial commit 2024-06-08 14:11:40 +00:00			`## Usage`

			`To run the scraper, simply execute the following command:`

			```bash
			`go run scraper.go`
			```

Update readme.md 2024-07-30 13:10:54 +00:00			The scraper will create a `thehub.json` and `itjobbank.json` file in the current directory, which contains a list of job details in JSON format. It caches the pages, so very light on resources and requests.